2024-09-21T05:52:25.065 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T05:52:25.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:52:25.172 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full} email: pdonnell@redhat.com first_in_suite: false job_id: '7913522' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - disabled cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM3vJfDnPP83P4tqcsFXjcV+NSV3jJKU7qw8BdgChgV6qrQK/r7Xp8hYCZvEoDb/iYJnsEiIi3gEUIMyds2hb2w= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/ulJPm7YVXYCYPZJg7ZnhgNt6jkTHy6jwFBRVikkz+0XaWv2rHilUBW9dILxKYr2N0Lbm14D+EvJHjfaEckzw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T05:52:25.172 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T05:52:25.173 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T05:52:25.173 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T05:52:25.174 INFO:teuthology.task.internal:Checking packages... 2024-09-21T05:52:25.194 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T05:52:25.194 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T05:52:25.194 INFO:teuthology.packaging:ref: None 2024-09-21T05:52:25.195 INFO:teuthology.packaging:tag: None 2024-09-21T05:52:25.195 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:52:25.195 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:52:25.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:52:25.337 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T05:52:25.339 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T05:52:25.345 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T05:52:25.345 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T05:52:25.350 INFO:teuthology.task.internal:Saving configuration 2024-09-21T05:52:25.367 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T05:52:25.372 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T05:52:25.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:46:48.579317', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM3vJfDnPP83P4tqcsFXjcV+NSV3jJKU7qw8BdgChgV6qrQK/r7Xp8hYCZvEoDb/iYJnsEiIi3gEUIMyds2hb2w='} 2024-09-21T05:52:25.418 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:46:48.577435', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/ulJPm7YVXYCYPZJg7ZnhgNt6jkTHy6jwFBRVikkz+0XaWv2rHilUBW9dILxKYr2N0Lbm14D+EvJHjfaEckzw='} 2024-09-21T05:52:25.418 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T05:52:25.424 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T05:52:25.424 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T05:52:25.424 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T05:52:25.470 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6a74857520>, signals=[15]) 2024-09-21T05:52:25.470 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T05:52:25.476 INFO:teuthology.task.internal:Opening connections... 2024-09-21T05:52:25.476 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T05:52:25.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:52:25.555 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T05:52:25.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:52:25.631 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T05:52:25.637 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-09-21T05:52:25.655 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-09-21T05:52:25.655 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-09-21T05:52:25.714 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:52:25.715 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:52:25.716 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:52:25.716 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:52:25.716 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:52:25.716 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-09-21T05:52:25.735 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-21T05:52:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-21T05:52:25.754 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-21T05:52:25.812 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-09-21T05:52:25.812 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:52:25.813 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:52:25.814 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-21T05:52:25.835 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T05:52:25.843 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T05:52:25.848 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T05:52:25.848 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:52:25.850 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:52:25.869 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T05:52:25.875 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T05:52:25.875 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:52:25.908 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:52:26.012 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T05:52:26.075 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T05:52:26.087 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T05:52:26.087 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-21T05:52:26.087 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-21T05:52:26.088 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:52:26.088 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:52:26.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:52:26.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T05:52:26.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:52:26.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T05:52:26.265 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:52:26.265 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T05:52:26.266 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T05:52:26.269 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:52:26.269 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T05:52:26.269 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-21T05:52:26.283 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:52:26.284 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:52:26.284 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T05:52:26.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum upgrade -y linux-firmware 2024-09-21T05:52:26.287 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:52:26.287 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:52:26.287 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T05:52:26.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum upgrade -y linux-firmware 2024-09-21T05:52:28.836 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T05:52:29.223 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.3 MB 00:01 2024-09-21T05:52:30.880 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 37 MB/s | 20 MB 00:00 2024-09-21T05:52:34.045 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-09-21T05:52:35.180 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T05:52:36.956 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-21T05:52:37.735 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T05:52:38.504 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-21T05:52:40.171 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-21T05:52:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T05:52:43.274 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T05:52:45.274 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T05:52:45.278 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T05:52:45.278 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 1 Package 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T05:52:45.279 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 388 M 2024-09-21T05:52:45.280 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T05:52:46.247 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-21T05:52:48.227 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-21T05:52:48.238 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 1 Package 2024-09-21T05:52:48.239 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T05:52:48.239 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 388 M 2024-09-21T05:52:48.239 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T05:52:57.200 INFO:teuthology.orchestra.run.smithi149.stdout:linux-firmware-20240905-146.el9.noarch.rpm 33 MB/s | 388 MB 00:11 2024-09-21T05:52:57.200 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:52:57.200 INFO:teuthology.orchestra.run.smithi149.stdout:Total 33 MB/s | 388 MB 00:11 2024-09-21T05:53:00.330 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T05:53:00.406 INFO:teuthology.orchestra.run.smithi118.stdout:linux-firmware-20240905-146.el9.noarch.rpm 32 MB/s | 388 MB 00:12 2024-09-21T05:53:00.406 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:53:00.406 INFO:teuthology.orchestra.run.smithi118.stdout:Total 32 MB/s | 388 MB 00:12 2024-09-21T05:53:00.429 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T05:53:00.429 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T05:53:03.518 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T05:53:03.685 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T05:53:03.685 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T05:53:03.704 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T05:53:03.705 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T05:53:07.121 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T05:53:07.121 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T05:53:13.303 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T05:53:13.959 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T05:53:14.039 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:53:14.623 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:53:14.623 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T05:53:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:53:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T05:53:15.427 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-21T05:53:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T05:53:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T05:53:15.428 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T05:53:15.756 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T05:53:15.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:53:15.904 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T05:53:15.904 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T05:53:15.907 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-09-21T05:53:18.556 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T05:53:18.910 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T05:53:18.990 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:53:19.610 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:53:19.610 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T05:53:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:53:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T05:53:20.346 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-09-21T05:53:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T05:53:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T05:53:20.346 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T05:53:20.670 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T05:53:20.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:53:20.830 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T05:53:20.830 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T05:53:20.836 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi118.front.sepia.ceph.com to complete... 2024-09-21T05:53:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21 05:53:22 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T05:53:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:FINISHED --2024-09-21 05:53:22-- 2024-09-21T05:53:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:Total wall clock time: 6.6s 2024-09-21T05:53:22.538 INFO:teuthology.orchestra.run.smithi149.stderr:Downloaded: 1 files, 343M in 6.3s (54.2 MB/s) 2024-09-21T05:53:22.541 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-21T05:53:22.541 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T05:53:24.602 INFO:teuthology.orchestra.run.smithi149.stdout:Verifying... ######################################## 2024-09-21T05:53:24.732 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing... ######################################## 2024-09-21T05:53:24.792 INFO:teuthology.orchestra.run.smithi149.stdout:Updating / installing... 2024-09-21T05:53:28.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21 05:53:28 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T05:53:28.127 INFO:teuthology.orchestra.run.smithi118.stderr:FINISHED --2024-09-21 05:53:28-- 2024-09-21T05:53:28.127 INFO:teuthology.orchestra.run.smithi118.stderr:Total wall clock time: 7.3s 2024-09-21T05:53:28.127 INFO:teuthology.orchestra.run.smithi118.stderr:Downloaded: 1 files, 343M in 6.9s (49.9 MB/s) 2024-09-21T05:53:28.130 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T05:53:28.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T05:53:30.185 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying... ######################################## 2024-09-21T05:53:30.243 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing... ######################################## 2024-09-21T05:53:30.302 INFO:teuthology.orchestra.run.smithi118.stdout:Updating / installing... 2024-09-21T05:53:32.856 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T05:53:38.319 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T05:54:10.383 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T05:54:10.383 DEBUG:teuthology.orchestra.run.smithi149:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T05:54:10.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T05:54:10.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T05:54:10.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T05:54:10.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T05:54:10.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T05:54:10.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T05:54:10.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T05:54:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T05:54:10.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T05:54:10.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T05:54:10.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T05:54:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T05:54:10.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T05:54:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T05:54:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T05:54:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T05:54:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T05:54:10.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T05:54:10.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T05:54:10.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T05:54:10.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T05:54:10.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T05:54:10.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T05:54:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T05:54:10.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T05:54:10.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T05:54:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T05:54:10.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T05:54:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T05:54:10.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T05:54:10.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T05:54:10.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T05:54:10.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T05:54:10.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T05:54:10.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T05:54:10.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T05:54:10.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T05:54:10.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T05:54:10.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T05:54:10.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T05:54:10.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T05:54:10.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T05:54:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T05:54:10.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T05:54:10.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T05:54:10.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T05:54:10.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T05:54:10.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T05:54:10.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T05:54:10.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T05:54:10.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T05:54:10.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T05:54:10.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T05:54:10.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T05:54:10.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T05:54:10.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T05:54:10.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T05:54:10.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T05:54:10.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T05:54:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T05:54:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T05:54:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T05:54:10.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T05:54:10.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T05:54:10.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T05:54:10.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T05:54:10.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T05:54:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T05:54:10.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T05:54:10.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T05:54:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T05:54:10.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T05:54:10.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T05:54:10.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T05:54:10.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T05:54:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T05:54:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T05:54:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T05:54:10.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T05:54:10.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T05:54:10.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T05:54:10.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T05:54:10.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T05:54:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T05:54:10.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T05:54:10.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T05:54:10.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T05:54:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T05:54:10.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T05:54:10.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T05:54:10.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T05:54:10.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T05:54:10.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T05:54:10.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T05:54:10.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T05:54:10.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T05:54:10.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T05:54:10.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T05:54:10.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T05:54:10.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T05:54:10.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T05:54:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T05:54:10.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T05:54:10.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T05:54:10.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T05:54:10.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T05:54:10.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T05:54:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T05:54:10.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T05:54:10.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T05:54:10.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T05:54:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T05:54:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T05:54:10.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T05:54:10.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T05:54:10.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T05:54:10.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T05:54:10.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T05:54:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T05:54:10.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T05:54:10.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T05:54:10.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T05:54:10.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T05:54:10.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T05:54:10.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T05:54:10.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T05:54:10.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T05:54:10.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T05:54:10.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T05:54:10.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T05:54:10.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T05:54:10.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T05:54:10.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T05:54:10.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T05:54:10.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T05:54:10.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T05:54:10.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T05:54:10.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T05:54:10.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T05:54:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T05:54:10.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T05:54:10.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T05:54:10.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T05:54:10.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T05:54:10.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T05:54:10.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T05:54:10.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T05:54:10.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T05:54:10.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T05:54:10.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T05:54:10.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T05:54:10.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T05:54:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T05:54:10.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T05:54:10.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T05:54:10.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T05:54:10.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T05:54:10.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T05:54:10.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T05:54:10.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T05:54:10.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T05:54:10.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T05:54:10.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T05:54:10.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T05:54:10.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T05:54:10.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T05:54:10.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T05:54:10.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T05:54:10.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T05:54:10.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T05:54:10.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T05:54:10.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T05:54:10.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T05:54:10.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T05:54:10.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T05:54:10.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T05:54:10.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T05:54:10.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T05:54:10.659 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.659 DEBUG:teuthology.orchestra.run.smithi149:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout:for file in vmlinuz System.map config; do 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout: fi 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout:done 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T05:54:10.683 INFO:teuthology.orchestra.run.smithi149.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.684 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2024-09-21T05:54:10.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 82.el9 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8274670 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-09-21T05:54:10.759 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-09-21T05:54:10.760 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T05:54:10.761 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:54:10.761 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:54:10.762 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:10.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:54:11.360 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-21T05:54:12.883 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[37908]) leaked on vgs invocation. Parent PID 15164: grub2-probe 2024-09-21T05:54:12.883 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[43167]) leaked on vgs invocation. Parent PID 15164: grub2-probe 2024-09-21T05:54:12.919 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[37908]) leaked on vgs invocation. Parent PID 15164: grub2-probe 2024-09-21T05:54:12.919 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[43167]) leaked on vgs invocation. Parent PID 15164: grub2-probe 2024-09-21T05:54:13.090 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:54:13.123 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-21T05:54:13.125 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T05:54:13.181 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.mtl91p3SZ8 2024-09-21T05:54:13.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mtl91p3SZ8 2024-09-21T05:54:13.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.mtl91p3SZ8 2024-09-21T05:54:13.386 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.mtl91p3SZ8 is 6KB 2024-09-21T05:54:13.435 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.mtl91p3SZ8 2024-09-21T05:54:13.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:54:13.513 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:54:13.513 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:54:13.513 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:54:13.513 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T05:54:13.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:13.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-09-21T05:54:23.821 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T05:54:23.821 DEBUG:teuthology.orchestra.run.smithi118:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T05:54:23.890 INFO:teuthology.orchestra.run.smithi118.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:23.890 INFO:teuthology.orchestra.run.smithi118.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:23.890 INFO:teuthology.orchestra.run.smithi118.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:23.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:23.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T05:54:23.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T05:54:23.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T05:54:23.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T05:54:23.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T05:54:23.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T05:54:23.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T05:54:23.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T05:54:23.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T05:54:23.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T05:54:23.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T05:54:23.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T05:54:23.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T05:54:23.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T05:54:23.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T05:54:23.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T05:54:23.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T05:54:23.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T05:54:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T05:54:23.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T05:54:23.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T05:54:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T05:54:23.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T05:54:23.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T05:54:23.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T05:54:23.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T05:54:23.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T05:54:23.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T05:54:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T05:54:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T05:54:23.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T05:54:23.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T05:54:23.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T05:54:23.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T05:54:23.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T05:54:23.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T05:54:23.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T05:54:23.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T05:54:23.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T05:54:23.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T05:54:23.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T05:54:23.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T05:54:23.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T05:54:23.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T05:54:23.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T05:54:23.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T05:54:23.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T05:54:23.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T05:54:23.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T05:54:23.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T05:54:23.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T05:54:23.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T05:54:23.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T05:54:23.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T05:54:23.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T05:54:23.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T05:54:23.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T05:54:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T05:54:23.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T05:54:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T05:54:23.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T05:54:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T05:54:23.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T05:54:23.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T05:54:23.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T05:54:23.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T05:54:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T05:54:23.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T05:54:23.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T05:54:23.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T05:54:23.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T05:54:23.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T05:54:23.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T05:54:23.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T05:54:23.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T05:54:23.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T05:54:23.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T05:54:23.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T05:54:23.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T05:54:23.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T05:54:23.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T05:54:23.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T05:54:23.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T05:54:23.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T05:54:23.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T05:54:23.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T05:54:23.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T05:54:23.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T05:54:23.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T05:54:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T05:54:23.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T05:54:23.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T05:54:23.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T05:54:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T05:54:23.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T05:54:23.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T05:54:23.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T05:54:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T05:54:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T05:54:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T05:54:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T05:54:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T05:54:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T05:54:23.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T05:54:23.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T05:54:23.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T05:54:23.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T05:54:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T05:54:23.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T05:54:23.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T05:54:23.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T05:54:23.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T05:54:24.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T05:54:24.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T05:54:24.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T05:54:24.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T05:54:24.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T05:54:24.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T05:54:24.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T05:54:24.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T05:54:24.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T05:54:24.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T05:54:24.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T05:54:24.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T05:54:24.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T05:54:24.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T05:54:24.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T05:54:24.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T05:54:24.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T05:54:24.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T05:54:24.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T05:54:24.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T05:54:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T05:54:24.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T05:54:24.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T05:54:24.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T05:54:24.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T05:54:24.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T05:54:24.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T05:54:24.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T05:54:24.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T05:54:24.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T05:54:24.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T05:54:24.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T05:54:24.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T05:54:24.033 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:24.033 DEBUG:teuthology.orchestra.run.smithi118:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T05:54:24.055 INFO:teuthology.orchestra.run.smithi118.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout:for file in vmlinuz System.map config; do 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout: fi 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout:done 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-09-21T05:54:24.056 INFO:teuthology.orchestra.run.smithi118.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T05:54:24.057 INFO:teuthology.orchestra.run.smithi118.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:24.057 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-09-21T05:54:24.057 INFO:teuthology.orchestra.run.smithi118.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T05:54:24.057 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T05:54:24.057 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:24.057 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-09-21T05:54:24.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2024-09-21T05:54:24.140 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.06 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 82.el9 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Group : Unspecified 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 8274670 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:54:24.141 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : builder@centos.org 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T05:54:24.142 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:54:24.143 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:54:24.143 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:24.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:54:24.734 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-09-21T05:54:26.140 INFO:teuthology.orchestra.run.smithi118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:54:26.172 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-09-21T05:54:26.174 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-21T05:54:26.190 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.WG5Gcd0WCj 2024-09-21T05:54:26.190 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WG5Gcd0WCj 2024-09-21T05:54:26.258 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.WG5Gcd0WCj 2024-09-21T05:54:26.394 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.WG5Gcd0WCj is 6KB 2024-09-21T05:54:26.443 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.WG5Gcd0WCj 2024-09-21T05:54:26.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:54:26.520 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:54:26.521 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:54:26.521 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:54:26.521 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T05:54:26.522 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:54:26.680 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2024-09-21T05:54:43.678 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T05:54:43.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T05:54:43.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:54:56.697 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T05:54:56.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T05:54:56.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:01.999 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T05:55:11.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T05:55:11.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:14.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T05:55:15.055 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-21T05:55:24.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T05:55:24.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:26.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T05:55:26.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:27.119 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-21T05:55:39.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T05:55:39.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:42.195 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-21T05:55:44.495 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-21T05:55:57.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T05:55:57.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:59.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T05:55:59.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:59.946 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T05:56:00.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T05:56:00.500 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T05:56:00.500 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-21T05:56:00.544 INFO:teuthology.orchestra.run.smithi149.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:56:00.545 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:56:00.545 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:56:00.545 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:56:01.547 DEBUG:teuthology.parallel:result is None 2024-09-21T05:56:29.167 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-21T05:56:29.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T05:56:29.696 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T05:56:29.697 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-21T05:56:29.731 INFO:teuthology.orchestra.run.smithi118.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:56:29.732 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:56:29.732 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:56:29.732 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:56:30.734 DEBUG:teuthology.parallel:result is None 2024-09-21T05:56:30.734 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T05:56:30.741 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T05:56:30.741 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:56:30.745 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:56:30.786 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T05:56:30.792 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T05:56:30.798 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T05:56:30.799 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:56:30.821 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:56:30.886 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T05:56:30.893 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T05:56:30.893 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:56:30.897 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:56:31.048 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:56:31.072 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:56:31.078 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:56:31.169 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:56:31.173 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T05:56:31.180 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T05:56:31.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:56:31.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:56:31.240 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T05:56:31.248 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T05:56:31.249 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:56:31.252 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:56:31.287 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:56:31.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:56:31.467 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:56:31.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:56:31.604 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T05:56:31.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:56:31.679 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:56:31.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:56:31.823 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:56:31.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:56:31.956 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T05:56:31.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:56:32.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-09-21T05:56:32.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-21T05:56:32.112 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:56:32.133 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:56:32.596 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T05:56:32.611 INFO:teuthology.task.internal:Starting timer... 2024-09-21T05:56:32.611 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T05:56:32.642 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T05:56:32.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-09-21T05:56:32.754 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-09-21T05:56:32.757 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-09-21T05:56:32.842 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-09-21T05:56:32.846 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T05:56:32.846 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-09-21T05:56:32.887 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-09-21T05:56:32.887 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-09-21T05:56:32.924 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-09-21T05:56:32.924 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-09-21T05:56:32.924 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T05:56:32.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:56:32.987 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T05:56:33.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:56:33.046 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T05:56:33.046 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:56:33.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:56:33.169 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T05:56:33.179 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T05:56:33.181 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T05:56:33.283 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T05:56:33.292 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T05:56:33.293 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:01:20.526 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-21T06:01:20.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T06:01:20.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:01:20.618 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-21T06:01:20.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-21T06:01:20.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T06:01:20.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:01:20.840 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-21T06:01:20.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-21T06:01:20.954 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:01:20.974 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:01:20.974 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:01:20.974 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:01:20.979 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:01:20.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:01:21.040 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:01:21.055 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:01:21.070 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:01:21.085 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:01:21.122 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-09-21T06:01:21.136 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-09-21T06:01:21.146 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-09-21T06:01:21.160 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-09-21T06:01:21.175 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:01:21.189 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:01:21.204 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:01:21.219 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:01:21.306 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:01:21.314 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:01:21.317 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:01:21.317 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-21T06:01:21.317 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.317 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.318 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.318 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.320 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:01:21.321 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T06:01:21.321 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.321 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.321 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.321 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:01:21.322 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:01:21.330 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:01:21.330 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:01:21.330 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:01:21.330 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:01:21.335 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:01:21.336 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:01:21.336 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:01:21.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:01:21.338 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:01:21.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:01:21.478 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:01:21.478 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:01:21.492 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:01:21.492 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:01:21.588 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:01:21.589 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:01:21.589 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:01:21.601 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:01:21.601 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:01:21.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:01:21.645 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:01:21.646 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:01:21.657 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:01:21.658 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:01:21.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:01:21.755 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:01:21.821 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:01:21.834 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:01:21.875 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-09-21T06:01:21.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-09-21T06:01:21.889 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-09-21T06:01:21.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-09-21T06:01:22.141 INFO:teuthology.orchestra.run.smithi118.stdout:45 files removed 2024-09-21T06:01:22.173 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:01:22.197 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-09-21T06:01:22.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:01:22.852 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 294 kB/s | 84 kB 00:00 2024-09-21T06:01:22.915 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 294 kB/s | 84 kB 00:00 2024-09-21T06:01:23.153 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T06:01:23.199 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T06:01:23.437 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T06:01:23.483 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T06:01:23.950 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-21T06:01:23.995 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T06:01:25.735 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-21T06:01:31.369 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-21T06:01:32.788 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-21T06:01:33.870 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 19 kB 00:01 2024-09-21T06:01:37.547 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.5 MB 00:00 2024-09-21T06:01:39.339 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-21T06:01:40.552 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-21T06:01:46.356 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 1.8 MB/s | 23 MB 00:12 2024-09-21T06:01:46.882 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T06:01:49.231 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:01:49.232 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:01:49.246 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:01:49.247 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:01:49.248 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:01:49.249 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:01:49.251 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:01:49.254 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:01:49.255 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:01:49.322 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-21T06:01:49.338 INFO:teuthology.orchestra.run.smithi118.stdout:======================================================================================= 2024-09-21T06:01:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-21T06:01:49.338 INFO:teuthology.orchestra.run.smithi118.stdout:======================================================================================= 2024-09-21T06:01:49.338 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-21T06:01:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:01:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:01:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:01:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:01:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:01:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:01:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:01:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:01:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:01:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:01:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:01:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:01:49.343 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-09-21T06:01:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:01:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:01:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:01:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:01:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:01:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:01:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:01:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:01:49.344 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:01:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:01:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:01:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:01:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:01:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:01:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:01:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:01:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:01:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:01:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:01:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:01:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:01:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:01:49.348 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:01:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:01:49.350 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:01:49.350 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:01:49.350 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:01:49.350 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:01:49.350 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:01:49.350 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:01:49.350 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:01:49.351 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:01:49.351 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:01:49.351 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:01:49.351 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:01:49.351 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:01:49.351 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:01:49.353 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:01:49.353 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:01:49.353 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:01:49.353 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:01:49.353 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:01:49.353 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:01:49.354 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:01:49.354 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:01:49.354 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:01:49.354 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:01:49.354 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:01:49.354 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:01:49.355 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:01:49.356 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:01:49.357 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:01:49.358 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:01:49.358 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:01:49.358 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:01:49.358 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:01:49.358 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:01:49.358 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:01:49.358 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:01:49.359 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:01:49.359 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:01:49.359 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:01:49.359 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:01:49.359 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:01:49.359 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:01:49.359 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:01:49.360 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:01:49.360 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:01:49.360 INFO:teuthology.orchestra.run.smithi118.stdout:Installing weak dependencies: 2024-09-21T06:01:49.360 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:01:49.360 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:01:49.360 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-21T06:01:49.360 INFO:teuthology.orchestra.run.smithi118.stdout:======================================================================================= 2024-09-21T06:01:49.361 INFO:teuthology.orchestra.run.smithi118.stdout:Install 149 Packages 2024-09-21T06:01:49.361 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 8 Packages 2024-09-21T06:01:49.361 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:01:49.362 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 228 M 2024-09-21T06:01:49.362 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-21T06:01:50.301 INFO:teuthology.orchestra.run.smithi118.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T06:01:50.468 INFO:teuthology.orchestra.run.smithi118.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 5.1 MB/s | 873 kB 00:00 2024-09-21T06:01:50.551 INFO:teuthology.orchestra.run.smithi118.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T06:01:50.736 INFO:teuthology.orchestra.run.smithi118.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 9.8 MB/s | 5.5 MB 00:00 2024-09-21T06:01:50.827 INFO:teuthology.orchestra.run.smithi118.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-21T06:01:50.885 INFO:teuthology.orchestra.run.smithi118.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 6.9 MB/s | 2.3 MB 00:00 2024-09-21T06:01:51.061 INFO:teuthology.orchestra.run.smithi118.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 21 MB/s | 5.0 MB 00:00 2024-09-21T06:01:51.595 INFO:teuthology.orchestra.run.smithi118.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 14 MB/s | 20 MB 00:01 2024-09-21T06:01:51.745 INFO:teuthology.orchestra.run.smithi118.stdout:(9/157): ceph-radosgw-19.3.0-5120.g18432218.el9 15 MB/s | 10 MB 00:00 2024-09-21T06:01:51.762 INFO:teuthology.orchestra.run.smithi118.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 151 kB/s | 25 kB 00:00 2024-09-21T06:01:51.893 INFO:teuthology.orchestra.run.smithi118.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.7 MB/s | 226 kB 00:00 2024-09-21T06:01:51.945 INFO:teuthology.orchestra.run.smithi118.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 522 kB/s | 27 kB 00:00 2024-09-21T06:01:52.021 INFO:teuthology.orchestra.run.smithi118.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 424 kB/s | 32 kB 00:00 2024-09-21T06:01:52.329 INFO:teuthology.orchestra.run.smithi118.stdout:(14/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T06:01:52.363 INFO:teuthology.orchestra.run.smithi118.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 2.2 MB/s | 766 kB 00:00 2024-09-21T06:01:52.388 INFO:teuthology.orchestra.run.smithi118.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T06:01:52.414 INFO:teuthology.orchestra.run.smithi118.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:01:52.489 INFO:teuthology.orchestra.run.smithi118.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 4.9 MB/s | 507 kB 00:00 2024-09-21T06:01:52.531 INFO:teuthology.orchestra.run.smithi118.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.1 MB/s | 45 kB 00:00 2024-09-21T06:01:52.606 INFO:teuthology.orchestra.run.smithi118.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T06:01:52.681 INFO:teuthology.orchestra.run.smithi118.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T06:01:52.757 INFO:teuthology.orchestra.run.smithi118.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T06:01:52.786 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T06:01:52.832 INFO:teuthology.orchestra.run.smithi118.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T06:01:53.266 INFO:teuthology.orchestra.run.smithi118.stdout:(24/157): ceph-test-19.3.0-5120.g18432218.el9.x 26 MB/s | 40 MB 00:01 2024-09-21T06:01:53.291 INFO:teuthology.orchestra.run.smithi118.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 217 kB/s | 99 kB 00:00 2024-09-21T06:01:53.316 INFO:teuthology.orchestra.run.smithi118.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:01:53.417 INFO:teuthology.orchestra.run.smithi118.stdout:(27/157): librgw2-19.3.0-5120.g18432218.el9.x86 5.3 MB/s | 5.3 MB 00:01 2024-09-21T06:01:53.442 INFO:teuthology.orchestra.run.smithi118.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.3 MB/s | 170 kB 00:00 2024-09-21T06:01:53.467 INFO:teuthology.orchestra.run.smithi118.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 685 kB/s | 34 kB 00:00 2024-09-21T06:01:53.493 INFO:teuthology.orchestra.run.smithi118.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:01:53.568 INFO:teuthology.orchestra.run.smithi118.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 11 MB/s | 3.1 MB 00:00 2024-09-21T06:01:53.635 INFO:teuthology.orchestra.run.smithi118.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T06:01:53.710 INFO:teuthology.orchestra.run.smithi118.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 660 kB/s | 49 kB 00:00 2024-09-21T06:01:53.837 INFO:teuthology.orchestra.run.smithi118.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 21 MB/s | 7.4 MB 00:00 2024-09-21T06:01:53.861 INFO:teuthology.orchestra.run.smithi118.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 109 kB/s | 16 kB 00:00 2024-09-21T06:01:53.886 INFO:teuthology.orchestra.run.smithi118.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.7 MB/s | 285 kB 00:00 2024-09-21T06:01:53.919 INFO:teuthology.orchestra.run.smithi118.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 13 MB/s | 784 kB 00:00 2024-09-21T06:01:53.936 INFO:teuthology.orchestra.run.smithi118.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 368 kB/s | 18 kB 00:00 2024-09-21T06:01:54.037 INFO:teuthology.orchestra.run.smithi118.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 683 kB/s | 80 kB 00:00 2024-09-21T06:01:54.112 INFO:teuthology.orchestra.run.smithi118.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-21T06:01:54.137 INFO:teuthology.orchestra.run.smithi118.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-21T06:01:54.163 INFO:teuthology.orchestra.run.smithi118.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-21T06:01:54.205 INFO:teuthology.orchestra.run.smithi118.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T06:01:54.247 INFO:teuthology.orchestra.run.smithi118.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-21T06:01:54.272 INFO:teuthology.orchestra.run.smithi118.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T06:01:54.297 INFO:teuthology.orchestra.run.smithi118.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T06:01:54.323 INFO:teuthology.orchestra.run.smithi118.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T06:01:54.523 INFO:teuthology.orchestra.run.smithi118.stdout:(48/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T06:01:54.623 INFO:teuthology.orchestra.run.smithi118.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-21T06:01:54.649 INFO:teuthology.orchestra.run.smithi118.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 853 kB/s | 107 kB 00:00 2024-09-21T06:01:54.674 INFO:teuthology.orchestra.run.smithi118.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-21T06:01:54.708 INFO:teuthology.orchestra.run.smithi118.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-21T06:01:54.733 INFO:teuthology.orchestra.run.smithi118.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T06:01:54.758 INFO:teuthology.orchestra.run.smithi118.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T06:01:54.783 INFO:teuthology.orchestra.run.smithi118.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-21T06:01:54.809 INFO:teuthology.orchestra.run.smithi118.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T06:01:54.834 INFO:teuthology.orchestra.run.smithi118.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T06:01:54.859 INFO:teuthology.orchestra.run.smithi118.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:01:54.885 INFO:teuthology.orchestra.run.smithi118.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-21T06:01:54.952 INFO:teuthology.orchestra.run.smithi118.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-21T06:01:54.986 INFO:teuthology.orchestra.run.smithi118.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-21T06:01:55.028 INFO:teuthology.orchestra.run.smithi118.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-09-21T06:01:55.061 INFO:teuthology.orchestra.run.smithi118.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 633 kB/s | 47 kB 00:00 2024-09-21T06:01:55.095 INFO:teuthology.orchestra.run.smithi118.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-21T06:01:55.120 INFO:teuthology.orchestra.run.smithi118.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T06:01:55.145 INFO:teuthology.orchestra.run.smithi118.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-21T06:01:55.159 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:01:55.160 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:01:55.170 INFO:teuthology.orchestra.run.smithi118.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T06:01:55.174 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:01:55.175 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:01:55.176 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:01:55.177 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:01:55.179 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:01:55.182 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:01:55.183 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:01:55.249 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:01:55.271 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:01:55.272 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:01:55.273 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:01:55.274 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:01:55.275 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:01:55.276 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:01:55.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:01:55.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:01:55.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:01:55.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:01:55.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:01:55.282 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================= 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout:Install 149 Packages 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 8 Packages 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 228 M 2024-09-21T06:01:55.283 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-21T06:01:55.296 INFO:teuthology.orchestra.run.smithi118.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-21T06:01:55.338 INFO:teuthology.orchestra.run.smithi118.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-21T06:01:55.371 INFO:teuthology.orchestra.run.smithi118.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T06:01:55.396 INFO:teuthology.orchestra.run.smithi118.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T06:01:55.489 INFO:teuthology.orchestra.run.smithi118.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T06:01:55.530 INFO:teuthology.orchestra.run.smithi118.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-21T06:01:55.556 INFO:teuthology.orchestra.run.smithi118.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T06:01:55.664 INFO:teuthology.orchestra.run.smithi118.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T06:01:55.681 INFO:teuthology.orchestra.run.smithi118.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 489 kB/s | 61 kB 00:00 2024-09-21T06:01:55.707 INFO:teuthology.orchestra.run.smithi118.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 5.7 MB/s | 245 kB 00:00 2024-09-21T06:01:55.732 INFO:teuthology.orchestra.run.smithi118.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T06:01:55.749 INFO:teuthology.orchestra.run.smithi118.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 609 kB/s | 26 kB 00:00 2024-09-21T06:01:55.766 INFO:teuthology.orchestra.run.smithi118.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-09-21T06:01:55.791 INFO:teuthology.orchestra.run.smithi118.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-21T06:01:55.816 INFO:teuthology.orchestra.run.smithi118.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-21T06:01:55.925 INFO:teuthology.orchestra.run.smithi118.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T06:01:55.950 INFO:teuthology.orchestra.run.smithi118.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-21T06:01:55.976 INFO:teuthology.orchestra.run.smithi118.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T06:01:56.001 INFO:teuthology.orchestra.run.smithi118.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:01:56.018 INFO:teuthology.orchestra.run.smithi118.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T06:01:56.022 INFO:teuthology.orchestra.run.smithi149.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-21T06:01:56.043 INFO:teuthology.orchestra.run.smithi118.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-21T06:01:56.069 INFO:teuthology.orchestra.run.smithi118.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T06:01:56.094 INFO:teuthology.orchestra.run.smithi118.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T06:01:56.119 INFO:teuthology.orchestra.run.smithi118.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T06:01:56.145 INFO:teuthology.orchestra.run.smithi118.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:01:56.197 INFO:teuthology.orchestra.run.smithi149.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-21T06:01:56.237 INFO:teuthology.orchestra.run.smithi118.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-21T06:01:56.255 INFO:teuthology.orchestra.run.smithi149.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T06:01:56.262 INFO:teuthology.orchestra.run.smithi118.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-21T06:01:56.287 INFO:teuthology.orchestra.run.smithi118.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-09-21T06:01:56.312 INFO:teuthology.orchestra.run.smithi118.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T06:01:56.337 INFO:teuthology.orchestra.run.smithi118.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 721 kB/s | 36 kB 00:00 2024-09-21T06:01:56.363 INFO:teuthology.orchestra.run.smithi118.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-21T06:01:56.388 INFO:teuthology.orchestra.run.smithi118.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T06:01:56.413 INFO:teuthology.orchestra.run.smithi118.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T06:01:56.430 INFO:teuthology.orchestra.run.smithi118.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-21T06:01:56.456 INFO:teuthology.orchestra.run.smithi118.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-21T06:01:56.481 INFO:teuthology.orchestra.run.smithi118.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-21T06:01:56.514 INFO:teuthology.orchestra.run.smithi149.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 8.9 MB/s | 5.5 MB 00:00 2024-09-21T06:01:56.581 INFO:teuthology.orchestra.run.smithi149.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 2.3 MB 00:00 2024-09-21T06:01:56.640 INFO:teuthology.orchestra.run.smithi149.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-21T06:01:56.805 INFO:teuthology.orchestra.run.smithi118.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-21T06:01:56.865 INFO:teuthology.orchestra.run.smithi118.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.0 MB/s | 548 kB 00:00 2024-09-21T06:01:56.899 INFO:teuthology.orchestra.run.smithi118.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:01:56.941 INFO:teuthology.orchestra.run.smithi118.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 870 kB/s | 19 kB 00:00 2024-09-21T06:01:57.065 INFO:teuthology.orchestra.run.smithi149.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T06:01:57.066 INFO:teuthology.orchestra.run.smithi118.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T06:01:57.083 INFO:teuthology.orchestra.run.smithi118.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.7 MB/s | 26 kB 00:00 2024-09-21T06:01:57.100 INFO:teuthology.orchestra.run.smithi118.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-21T06:01:57.125 INFO:teuthology.orchestra.run.smithi118.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:01:57.149 INFO:teuthology.orchestra.run.smithi149.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 8.8 MB/s | 5.0 MB 00:00 2024-09-21T06:01:57.159 INFO:teuthology.orchestra.run.smithi118.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T06:01:57.209 INFO:teuthology.orchestra.run.smithi118.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 17 MB/s | 839 kB 00:00 2024-09-21T06:01:57.215 INFO:teuthology.orchestra.run.smithi149.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 379 kB/s | 25 kB 00:00 2024-09-21T06:01:57.242 INFO:teuthology.orchestra.run.smithi118.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T06:01:57.260 INFO:teuthology.orchestra.run.smithi118.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-21T06:01:57.276 INFO:teuthology.orchestra.run.smithi118.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T06:01:57.294 INFO:teuthology.orchestra.run.smithi118.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 844 kB/s | 14 kB 00:00 2024-09-21T06:01:57.319 INFO:teuthology.orchestra.run.smithi118.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:01:57.336 INFO:teuthology.orchestra.run.smithi118.stdout:(119/157): lua-devel-5.4.4-4.el9.x86_64.rpm 25 kB/s | 22 kB 00:00 2024-09-21T06:01:57.400 INFO:teuthology.orchestra.run.smithi118.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.4 MB/s | 358 kB 00:00 2024-09-21T06:01:57.436 INFO:teuthology.orchestra.run.smithi118.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.3 MB/s | 220 kB 00:00 2024-09-21T06:01:57.470 INFO:teuthology.orchestra.run.smithi118.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-21T06:01:57.504 INFO:teuthology.orchestra.run.smithi118.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-21T06:01:57.521 INFO:teuthology.orchestra.run.smithi118.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-21T06:01:57.538 INFO:teuthology.orchestra.run.smithi118.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T06:01:57.555 INFO:teuthology.orchestra.run.smithi118.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T06:01:57.572 INFO:teuthology.orchestra.run.smithi118.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T06:01:57.589 INFO:teuthology.orchestra.run.smithi118.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T06:01:57.641 INFO:teuthology.orchestra.run.smithi149.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 18 MB/s | 18 MB 00:01 2024-09-21T06:01:57.647 INFO:teuthology.orchestra.run.smithi118.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-09-21T06:01:57.664 INFO:teuthology.orchestra.run.smithi118.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T06:01:57.698 INFO:teuthology.orchestra.run.smithi118.stdout:(131/157): protobuf-compiler-3.14.0-13.el9.x86_ 710 kB/s | 863 kB 00:01 2024-09-21T06:01:57.723 INFO:teuthology.orchestra.run.smithi118.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T06:01:57.773 INFO:teuthology.orchestra.run.smithi118.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-21T06:01:57.774 INFO:teuthology.orchestra.run.smithi149.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 15 MB/s | 10 MB 00:00 2024-09-21T06:01:57.799 INFO:teuthology.orchestra.run.smithi118.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 706 kB/s | 16 kB 00:00 2024-09-21T06:01:57.799 INFO:teuthology.orchestra.run.smithi149.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.4 MB/s | 226 kB 00:00 2024-09-21T06:01:57.824 INFO:teuthology.orchestra.run.smithi118.stdout:(135/157): python3-natsort-7.1.1-5.el9.noarch.r 458 kB/s | 58 kB 00:00 2024-09-21T06:01:57.825 INFO:teuthology.orchestra.run.smithi149.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T06:01:57.849 INFO:teuthology.orchestra.run.smithi118.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T06:01:57.850 INFO:teuthology.orchestra.run.smithi149.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 632 kB/s | 32 kB 00:00 2024-09-21T06:01:57.941 INFO:teuthology.orchestra.run.smithi118.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 634 kB/s | 90 kB 00:00 2024-09-21T06:01:58.000 INFO:teuthology.orchestra.run.smithi118.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 204 kB/s | 31 kB 00:00 2024-09-21T06:01:58.001 INFO:teuthology.orchestra.run.smithi149.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 4.3 MB/s | 766 kB 00:00 2024-09-21T06:01:58.025 INFO:teuthology.orchestra.run.smithi118.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 931 kB/s | 272 kB 00:00 2024-09-21T06:01:58.026 INFO:teuthology.orchestra.run.smithi149.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 905 kB/s | 158 kB 00:00 2024-09-21T06:01:58.051 INFO:teuthology.orchestra.run.smithi118.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T06:01:58.051 INFO:teuthology.orchestra.run.smithi149.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:01:58.076 INFO:teuthology.orchestra.run.smithi118.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-21T06:01:58.101 INFO:teuthology.orchestra.run.smithi118.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T06:01:58.102 INFO:teuthology.orchestra.run.smithi149.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.5 MB/s | 507 kB 00:00 2024-09-21T06:01:58.126 INFO:teuthology.orchestra.run.smithi118.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-21T06:01:58.157 INFO:teuthology.orchestra.run.smithi118.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 3.0 MB/s | 90 kB 00:00 2024-09-21T06:01:58.169 INFO:teuthology.orchestra.run.smithi149.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 688 kB/s | 45 kB 00:00 2024-09-21T06:01:58.182 INFO:teuthology.orchestra.run.smithi118.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T06:01:58.207 INFO:teuthology.orchestra.run.smithi118.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T06:01:58.233 INFO:teuthology.orchestra.run.smithi118.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:01:58.235 INFO:teuthology.orchestra.run.smithi149.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T06:01:58.266 INFO:teuthology.orchestra.run.smithi118.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.0 MB/s | 427 kB 00:00 2024-09-21T06:01:58.316 INFO:teuthology.orchestra.run.smithi118.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T06:01:58.319 INFO:teuthology.orchestra.run.smithi149.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-21T06:01:58.344 INFO:teuthology.orchestra.run.smithi149.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T06:01:58.378 INFO:teuthology.orchestra.run.smithi149.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T06:01:58.403 INFO:teuthology.orchestra.run.smithi149.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T06:01:58.437 INFO:teuthology.orchestra.run.smithi149.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T06:01:58.470 INFO:teuthology.orchestra.run.smithi149.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.3 MB/s | 86 kB 00:00 2024-09-21T06:01:58.509 INFO:teuthology.orchestra.run.smithi118.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T06:01:58.537 INFO:teuthology.orchestra.run.smithi149.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T06:01:58.592 INFO:teuthology.orchestra.run.smithi118.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 9.4 MB/s | 3.4 MB 00:00 2024-09-21T06:01:58.621 INFO:teuthology.orchestra.run.smithi149.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 17 MB/s | 3.1 MB 00:00 2024-09-21T06:01:58.646 INFO:teuthology.orchestra.run.smithi149.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 316 kB/s | 34 kB 00:00 2024-09-21T06:01:58.651 INFO:teuthology.orchestra.run.smithi118.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-09-21T06:01:58.671 INFO:teuthology.orchestra.run.smithi149.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:01:58.676 INFO:teuthology.orchestra.run.smithi118.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 488 kB/s | 41 kB 00:00 2024-09-21T06:01:58.702 INFO:teuthology.orchestra.run.smithi118.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.8 MB/s | 249 kB 00:00 2024-09-21T06:01:58.777 INFO:teuthology.orchestra.run.smithi118.stdout:(155/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.2 MB/s | 3.2 MB 00:00 2024-09-21T06:01:58.835 INFO:teuthology.orchestra.run.smithi118.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-21T06:01:58.886 INFO:teuthology.orchestra.run.smithi118.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-21T06:01:58.891 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:01:58.891 INFO:teuthology.orchestra.run.smithi118.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T06:01:59.114 INFO:teuthology.orchestra.run.smithi149.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-21T06:01:59.172 INFO:teuthology.orchestra.run.smithi149.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T06:01:59.350 INFO:teuthology.orchestra.run.smithi149.stdout:(33/157): ceph-mgr-dashboard-19.3.0-5120.g18432 20 MB/s | 14 MB 00:00 2024-09-21T06:01:59.373 INFO:teuthology.orchestra.run.smithi149.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 246 kB/s | 49 kB 00:00 2024-09-21T06:01:59.398 INFO:teuthology.orchestra.run.smithi149.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 331 kB/s | 16 kB 00:00 2024-09-21T06:01:59.423 INFO:teuthology.orchestra.run.smithi149.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:01:59.458 INFO:teuthology.orchestra.run.smithi149.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 13 MB/s | 784 kB 00:00 2024-09-21T06:01:59.482 INFO:teuthology.orchestra.run.smithi149.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 314 kB/s | 18 kB 00:00 2024-09-21T06:01:59.568 INFO:teuthology.orchestra.run.smithi149.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 737 kB/s | 80 kB 00:00 2024-09-21T06:01:59.625 INFO:teuthology.orchestra.run.smithi149.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 5.5 MB/s | 801 kB 00:00 2024-09-21T06:01:59.651 INFO:teuthology.orchestra.run.smithi149.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-21T06:01:59.678 INFO:teuthology.orchestra.run.smithi149.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-21T06:01:59.717 INFO:teuthology.orchestra.run.smithi149.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T06:02:00.110 INFO:teuthology.orchestra.run.smithi149.stdout:(44/157): ceph-test-19.3.0-5120.g18432218.el9.x 14 MB/s | 40 MB 00:02 2024-09-21T06:02:00.135 INFO:teuthology.orchestra.run.smithi149.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 324 kB/s | 135 kB 00:00 2024-09-21T06:02:00.176 INFO:teuthology.orchestra.run.smithi149.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-09-21T06:02:00.202 INFO:teuthology.orchestra.run.smithi149.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T06:02:00.236 INFO:teuthology.orchestra.run.smithi149.stdout:(48/157): python3-requests-2.25.1-8.el9.noarch. 998 kB/s | 125 kB 00:00 2024-09-21T06:02:00.369 INFO:teuthology.orchestra.run.smithi149.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 804 kB/s | 107 kB 00:00 2024-09-21T06:02:00.403 INFO:teuthology.orchestra.run.smithi149.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-21T06:02:00.419 INFO:teuthology.orchestra.run.smithi149.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T06:02:00.453 INFO:teuthology.orchestra.run.smithi149.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-21T06:02:00.470 INFO:teuthology.orchestra.run.smithi149.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-21T06:02:00.520 INFO:teuthology.orchestra.run.smithi149.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T06:02:00.538 INFO:teuthology.orchestra.run.smithi149.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 271 kB/s | 18 kB 00:00 2024-09-21T06:02:00.563 INFO:teuthology.orchestra.run.smithi149.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-21T06:02:00.605 INFO:teuthology.orchestra.run.smithi149.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-21T06:02:00.663 INFO:teuthology.orchestra.run.smithi149.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-21T06:02:00.689 INFO:teuthology.orchestra.run.smithi149.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-21T06:02:00.714 INFO:teuthology.orchestra.run.smithi149.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-21T06:02:00.756 INFO:teuthology.orchestra.run.smithi149.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-21T06:02:00.781 INFO:teuthology.orchestra.run.smithi149.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 368 kB/s | 24 kB 00:00 2024-09-21T06:02:00.806 INFO:teuthology.orchestra.run.smithi149.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-21T06:02:00.832 INFO:teuthology.orchestra.run.smithi149.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-21T06:02:00.857 INFO:teuthology.orchestra.run.smithi149.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T06:02:00.882 INFO:teuthology.orchestra.run.smithi149.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 775 kB/s | 38 kB 00:00 2024-09-21T06:02:00.916 INFO:teuthology.orchestra.run.smithi149.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-21T06:02:00.956 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-21T06:02:01.033 INFO:teuthology.orchestra.run.smithi149.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-21T06:02:01.083 INFO:teuthology.orchestra.run.smithi149.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-21T06:02:01.140 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-21T06:02:01.140 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-21T06:02:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-21T06:02:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-21T06:02:01.209 INFO:teuthology.orchestra.run.smithi149.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T06:02:01.251 INFO:teuthology.orchestra.run.smithi149.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-21T06:02:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T06:02:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T06:02:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-21T06:02:01.427 INFO:teuthology.orchestra.run.smithi149.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T06:02:01.452 INFO:teuthology.orchestra.run.smithi149.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-21T06:02:01.469 INFO:teuthology.orchestra.run.smithi149.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-09-21T06:02:01.486 INFO:teuthology.orchestra.run.smithi149.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 575 kB/s | 19 kB 00:00 2024-09-21T06:02:01.519 INFO:teuthology.orchestra.run.smithi149.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T06:02:01.536 INFO:teuthology.orchestra.run.smithi149.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-21T06:02:01.629 INFO:teuthology.orchestra.run.smithi149.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T06:02:01.654 INFO:teuthology.orchestra.run.smithi149.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T06:02:01.679 INFO:teuthology.orchestra.run.smithi149.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-21T06:02:01.705 INFO:teuthology.orchestra.run.smithi149.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:02:01.730 INFO:teuthology.orchestra.run.smithi149.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-21T06:02:01.755 INFO:teuthology.orchestra.run.smithi149.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T06:02:01.780 INFO:teuthology.orchestra.run.smithi149.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T06:02:01.806 INFO:teuthology.orchestra.run.smithi149.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-09-21T06:02:01.822 INFO:teuthology.orchestra.run.smithi149.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T06:02:01.839 INFO:teuthology.orchestra.run.smithi149.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-21T06:02:01.890 INFO:teuthology.orchestra.run.smithi149.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-21T06:02:01.965 INFO:teuthology.orchestra.run.smithi149.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-21T06:02:01.990 INFO:teuthology.orchestra.run.smithi149.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 443 kB/s | 44 kB 00:00 2024-09-21T06:02:02.024 INFO:teuthology.orchestra.run.smithi149.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T06:02:02.049 INFO:teuthology.orchestra.run.smithi149.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-21T06:02:02.074 INFO:teuthology.orchestra.run.smithi149.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-21T06:02:02.100 INFO:teuthology.orchestra.run.smithi149.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T06:02:02.125 INFO:teuthology.orchestra.run.smithi149.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T06:02:02.150 INFO:teuthology.orchestra.run.smithi149.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T06:02:02.192 INFO:teuthology.orchestra.run.smithi149.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 955 kB/s | 64 kB 00:00 2024-09-21T06:02:02.218 INFO:teuthology.orchestra.run.smithi149.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 672 kB/s | 45 kB 00:00 2024-09-21T06:02:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-09-21T06:02:02.293 INFO:teuthology.orchestra.run.smithi149.stdout:(105/157): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-09-21T06:02:02.360 INFO:teuthology.orchestra.run.smithi149.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-09-21T06:02:02.385 INFO:teuthology.orchestra.run.smithi149.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 794 kB/s | 19 kB 00:00 2024-09-21T06:02:02.411 INFO:teuthology.orchestra.run.smithi149.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-21T06:02:02.436 INFO:teuthology.orchestra.run.smithi149.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:02:02.461 INFO:teuthology.orchestra.run.smithi149.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:02:02.486 INFO:teuthology.orchestra.run.smithi149.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:02:02.570 INFO:teuthology.orchestra.run.smithi149.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-21T06:02:02.629 INFO:teuthology.orchestra.run.smithi149.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T06:02:02.671 INFO:teuthology.orchestra.run.smithi149.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T06:02:02.688 INFO:teuthology.orchestra.run.smithi149.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T06:02:02.705 INFO:teuthology.orchestra.run.smithi149.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T06:02:02.716 INFO:teuthology.orchestra.run.smithi149.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 1.3 MB/s | 14 kB 00:00 2024-09-21T06:02:02.767 INFO:teuthology.orchestra.run.smithi149.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T06:02:02.809 INFO:teuthology.orchestra.run.smithi149.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.6 MB/s | 358 kB 00:00 2024-09-21T06:02:02.842 INFO:teuthology.orchestra.run.smithi149.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T06:02:02.876 INFO:teuthology.orchestra.run.smithi149.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-21T06:02:03.251 INFO:teuthology.orchestra.run.smithi149.stdout:(122/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T06:02:03.343 INFO:teuthology.orchestra.run.smithi149.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-09-21T06:02:03.368 INFO:teuthology.orchestra.run.smithi149.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 469 kB/s | 11 kB 00:00 2024-09-21T06:02:03.394 INFO:teuthology.orchestra.run.smithi149.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-21T06:02:03.419 INFO:teuthology.orchestra.run.smithi149.stdout:(126/157): python3-grpcio-tools-1.46.7-10.el9.x 865 kB/s | 144 kB 00:00 2024-09-21T06:02:03.444 INFO:teuthology.orchestra.run.smithi149.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-21T06:02:03.469 INFO:teuthology.orchestra.run.smithi149.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-21T06:02:03.479 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-21T06:02:03.480 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-21T06:02:03.495 INFO:teuthology.orchestra.run.smithi149.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-21T06:02:03.520 INFO:teuthology.orchestra.run.smithi149.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:02:03.545 INFO:teuthology.orchestra.run.smithi149.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:02:03.570 INFO:teuthology.orchestra.run.smithi149.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:02:03.621 INFO:teuthology.orchestra.run.smithi149.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.7 MB/s | 2.0 MB 00:00 2024-09-21T06:02:03.670 INFO:teuthology.orchestra.run.smithi149.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-09-21T06:02:03.696 INFO:teuthology.orchestra.run.smithi149.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2024-09-21T06:02:03.714 INFO:teuthology.orchestra.run.smithi149.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.6 MB/s | 28 kB 00:00 2024-09-21T06:02:03.739 INFO:teuthology.orchestra.run.smithi149.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T06:02:03.756 INFO:teuthology.orchestra.run.smithi149.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 741 kB/s | 31 kB 00:00 2024-09-21T06:02:03.781 INFO:teuthology.orchestra.run.smithi149.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:02:03.799 INFO:teuthology.orchestra.run.smithi149.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-21T06:02:03.823 INFO:teuthology.orchestra.run.smithi149.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-21T06:02:03.849 INFO:teuthology.orchestra.run.smithi149.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T06:02:03.883 INFO:teuthology.orchestra.run.smithi149.stdout:(143/157): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-09-21T06:02:03.908 INFO:teuthology.orchestra.run.smithi149.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-21T06:02:03.933 INFO:teuthology.orchestra.run.smithi149.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 809 kB/s | 20 kB 00:00 2024-09-21T06:02:03.966 INFO:teuthology.orchestra.run.smithi149.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-21T06:02:04.000 INFO:teuthology.orchestra.run.smithi149.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T06:02:04.025 INFO:teuthology.orchestra.run.smithi149.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T06:02:04.084 INFO:teuthology.orchestra.run.smithi149.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T06:02:04.268 INFO:teuthology.orchestra.run.smithi149.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T06:02:04.318 INFO:teuthology.orchestra.run.smithi149.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 9.9 MB/s | 2.3 MB 00:00 2024-09-21T06:02:04.385 INFO:teuthology.orchestra.run.smithi149.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.8 MB/s | 3.2 MB 00:00 2024-09-21T06:02:04.410 INFO:teuthology.orchestra.run.smithi149.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 446 kB/s | 41 kB 00:00 2024-09-21T06:02:04.477 INFO:teuthology.orchestra.run.smithi149.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T06:02:04.519 INFO:teuthology.orchestra.run.smithi149.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.2 MB/s | 1.8 MB 00:00 2024-09-21T06:02:04.564 INFO:teuthology.orchestra.run.smithi149.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.4 MB/s | 249 kB 00:00 2024-09-21T06:02:04.619 INFO:teuthology.orchestra.run.smithi149.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-21T06:02:04.626 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:02:04.626 INFO:teuthology.orchestra.run.smithi149.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T06:02:06.706 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-21T06:02:06.888 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-21T06:02:06.888 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-21T06:02:09.219 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-21T06:02:09.220 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-21T06:02:10.235 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-21T06:02:10.424 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:02:10.474 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:02:10.539 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:02:10.584 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:02:10.616 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:02:10.697 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:02:11.227 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:02:11.350 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:02:11.501 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:02:11.535 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:02:11.622 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:02:11.648 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:02:11.689 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:02:11.898 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:02:11.955 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:02:11.990 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:02:12.119 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:02:12.150 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:02:12.215 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:02:12.242 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:02:12.288 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:02:12.550 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:02:12.720 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:02:12.916 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:02:13.041 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:02:13.168 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:02:13.464 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:02:13.613 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:02:13.651 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:02:13.693 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:02:13.776 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:02:13.838 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:02:13.876 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:02:13.930 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:02:13.969 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:02:14.012 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:02:14.100 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:02:14.164 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:02:14.199 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:02:14.245 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:02:14.334 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:02:14.370 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:02:14.413 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:02:14.441 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:02:14.530 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:02:14.585 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:02:14.675 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:02:14.832 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:02:14.897 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:02:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:02:15.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:02:15.659 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:02:15.707 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:02:15.741 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:02:15.777 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-21T06:02:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:02:15.924 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:02:15.991 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:02:16.065 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:02:16.110 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:02:16.141 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:02:16.242 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:02:16.277 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:02:16.361 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:02:16.487 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:02:16.556 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:02:16.626 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:02:16.641 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:02:16.680 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:02:16.716 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:02:16.734 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:02:16.791 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:02:16.833 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:02:16.878 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:02:16.933 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:02:16.936 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:02:16.960 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:02:17.065 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:02:17.107 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:02:17.122 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:02:17.147 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:02:17.178 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:02:17.221 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:02:17.336 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:02:17.371 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:02:17.379 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:02:17.425 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:02:17.430 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:02:17.455 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:02:17.456 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:02:17.480 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:02:17.586 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:02:17.605 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:02:17.641 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:02:17.730 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:02:17.758 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:02:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:02:17.799 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:02:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:02:17.850 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:02:17.893 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:02:17.933 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:02:17.972 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:02:17.986 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:02:18.010 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:02:18.044 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:02:18.078 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:02:18.154 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:02:18.187 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:02:18.192 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:02:18.285 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:02:18.345 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:02:18.359 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:02:18.467 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:02:18.492 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:02:18.618 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:02:18.898 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:02:19.038 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:02:19.045 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:02:19.078 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:02:19.104 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:02:19.118 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:02:19.201 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:02:19.254 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:02:19.293 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:02:19.346 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:02:19.385 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:02:19.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:02:19.507 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:02:19.565 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:02:19.598 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:02:19.644 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:02:19.742 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:02:19.776 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:02:19.846 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:02:19.873 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:02:19.955 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:02:19.976 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:02:20.017 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:02:20.083 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:02:20.107 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:02:20.120 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:02:20.231 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:02:20.266 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:02:20.295 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:02:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:02:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:02:20.443 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:02:20.490 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:02:20.721 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:02:20.754 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:02:20.849 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:02:20.966 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:02:21.071 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:02:21.124 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:02:21.168 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:02:21.206 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:02:21.260 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:02:21.435 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:02:21.692 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:02:21.717 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:02:21.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:02:21.868 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:02:21.920 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:02:22.005 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:02:22.045 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:02:22.080 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:02:22.143 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:02:22.184 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:02:22.229 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:02:22.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:02:22.450 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:02:22.495 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:02:22.569 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:02:22.690 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:02:22.738 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:02:22.781 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:02:22.819 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:02:22.843 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:02:22.963 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:02:23.122 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:02:23.167 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:02:23.215 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:02:23.247 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:02:23.287 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:02:23.327 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:02:23.364 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:02:23.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:02:23.399 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:02:23.451 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:02:23.478 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:02:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:02:23.539 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:02:23.543 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:02:23.573 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:02:23.643 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:02:23.703 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:02:23.740 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:02:23.863 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:02:23.936 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:02:23.937 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:02:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:02:24.133 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:02:24.165 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:02:24.215 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:02:24.771 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:02:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:02:24.827 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:02:24.895 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:02:24.904 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:02:24.923 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:02:24.938 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:02:25.052 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:02:25.105 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:02:25.157 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:02:25.254 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:02:25.306 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:02:25.547 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:02:25.579 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:02:25.674 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:02:26.484 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:02:26.619 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:02:27.377 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:02:27.411 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:02:28.070 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:02:28.157 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:02:28.276 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:02:28.276 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:02:28.276 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:02:28.276 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:28.278 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:02:28.316 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:02:28.392 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:02:28.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:02:28.453 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:02:28.807 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:02:28.858 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:02:28.970 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:02:29.006 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:02:29.054 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:02:29.620 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:02:29.653 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:02:29.761 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:02:29.780 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:02:32.427 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:02:32.468 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:02:33.130 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:02:33.171 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:02:33.313 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:02:33.313 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:02:33.314 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:02:33.314 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:33.348 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:02:42.077 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:02:42.077 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-09-21T06:02:42.077 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-09-21T06:02:42.077 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-09-21T06:02:42.077 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-09-21T06:02:42.078 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-09-21T06:02:42.078 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-09-21T06:02:42.078 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-09-21T06:02:42.078 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:42.290 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:02:42.327 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:02:42.327 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:42.327 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:02:42.327 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:02:44.123 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:02:44.123 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:44.124 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:02:44.124 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:02:44.124 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:02:44.124 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:44.377 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:02:44.428 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:02:44.428 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:44.428 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:02:44.428 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:02:44.428 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:02:44.428 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:02:44.987 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:02:44.987 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:44.987 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:02:44.987 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:02:44.987 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:02:44.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:45.120 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:02:45.179 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:02:45.269 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:02:45.493 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:02:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:02:45.642 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:02:45.751 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:02:45.934 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:02:45.982 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:02:46.030 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:02:46.065 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:02:46.179 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:02:46.179 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-09-21T06:02:46.180 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-09-21T06:02:46.180 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-09-21T06:02:46.180 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-09-21T06:02:46.180 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-09-21T06:02:46.180 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-09-21T06:02:46.180 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-09-21T06:02:46.180 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:46.394 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:02:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:02:46.432 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:46.432 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:02:46.432 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:46.561 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:02:46.598 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:02:46.632 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:02:46.712 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:02:46.754 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:02:48.122 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:02:48.180 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:02:48.180 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:48.180 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:02:48.180 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:02:48.180 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:02:48.180 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:48.431 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:02:48.481 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:02:48.481 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:48.481 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:02:48.482 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:02:48.482 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:02:48.482 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:48.998 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:02:49.049 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:02:49.049 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:49.049 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:02:49.049 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:02:49.049 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:02:49.049 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:49.190 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:02:49.251 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:02:49.543 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:02:49.602 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:02:49.689 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:02:49.805 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:02:49.992 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:02:50.036 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:02:50.075 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:02:50.101 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:02:50.350 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:02:50.419 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:02:50.764 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:02:50.792 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:02:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:02:50.907 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:02:50.948 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:02:51.502 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:02:51.569 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:02:51.720 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:02:51.905 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:02:51.938 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:02:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:02:51.989 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:51.989 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:02:51.989 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:02:51.989 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:02:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:52.047 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:02:52.073 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:02:52.180 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:02:52.261 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:02:53.326 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:02:53.366 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:02:53.418 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:02:53.418 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:53.418 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:02:53.418 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:02:53.418 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:02:53.418 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:53.467 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:02:53.516 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:02:53.516 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:53.516 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:02:53.516 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:53.576 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:02:53.627 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:02:53.627 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:53.627 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:02:53.627 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:02:53.627 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:02:53.627 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:53.985 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:02:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:02:54.036 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:54.036 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:02:54.036 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:02:54.037 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:02:54.037 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:02:54.618 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:02:54.696 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:02:55.795 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:02:55.829 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:02:55.983 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:02:56.160 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:02:56.190 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:02:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:02:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:02:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:02:56.242 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:02:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:56.299 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:02:56.325 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:02:56.434 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:02:56.507 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:02:57.559 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:02:57.610 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:02:57.661 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:02:57.661 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:57.661 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:02:57.661 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:02:57.662 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:02:57.662 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:57.710 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:02:57.760 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:02:57.760 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:57.760 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:02:57.760 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:57.827 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:02:57.878 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:02:57.879 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:58.236 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:02:58.287 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:02:58.287 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:02:58.287 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:02:58.288 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:02:58.288 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:02:58.288 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:02:58.374 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:02:58.415 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:02:58.458 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:02:58.487 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:02:58.540 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:02:58.815 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:02:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:02:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:02:58.964 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:02:59.008 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:02:59.808 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:02:59.857 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:02:59.899 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:03:01.169 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:03:01.282 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:03:01.341 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:03:01.486 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:03:01.519 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:03:01.543 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:03:01.580 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:03:01.580 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:03:01.688 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:03:01.688 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:03:01.805 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:03:01.830 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:03:01.845 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:03:01.845 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:03:02.091 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:03:02.091 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:03:02.192 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:03:02.265 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:03:02.476 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:03:02.476 INFO:teuthology.orchestra.run.smithi118.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T06:03:02.476 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:02.654 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:03:02.700 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:03:02.752 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:03:02.781 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:03:02.816 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:03:03.103 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:03:03.146 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:03:03.175 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:03:03.207 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:03:03.251 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:03:03.978 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:03:04.032 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:03:04.075 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:03:05.384 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:03:05.482 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:03:05.541 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:03:05.682 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:03:05.717 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:03:05.742 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:03:05.779 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:03:05.779 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:03:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:03:05.879 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:03:05.979 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:03:06.003 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:03:06.019 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:03:06.019 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:03:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:03:06.264 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:03:06.424 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:03:06.514 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:03:06.769 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:03:06.769 INFO:teuthology.orchestra.run.smithi149.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T06:03:06.769 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:09.318 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:03:09.318 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:03:09.318 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:03:09.318 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:03:09.318 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:03:09.319 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:03:09.320 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:03:09.334 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:03:09.335 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:03:09.336 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:03:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:03:09.338 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:03:09.339 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:03:09.340 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:03:09.341 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:03:09.342 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:03:09.343 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:03:09.344 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:03:09.344 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:03:09.344 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:03:09.344 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:03:09.344 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:03:09.344 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:03:09.344 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:03:11.549 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:03:11.549 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:11.549 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-09-21T06:03:11.549 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:11.549 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:11.549 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.550 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.551 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:03:11.552 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:03:11.553 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:03:11.554 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:03:11.555 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:03:11.556 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:03:11.557 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:03:11.558 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:03:11.559 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:03:11.560 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:03:11.561 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:03:11.562 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:03:11.563 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:03:11.563 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:03:11.563 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:03:11.563 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:11.563 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-21T06:03:12.204 DEBUG:teuthology.parallel:result is None 2024-09-21T06:03:13.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:03:13.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:03:13.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:03:13.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:03:13.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:03:13.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:03:13.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:03:13.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:03:13.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:03:13.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:03:13.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:03:13.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:03:13.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:03:13.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:03:13.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:03:13.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:03:13.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:03:13.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:03:13.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:03:13.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:03:13.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:03:13.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:03:13.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:03:13.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:03:13.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:03:13.159 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:03:13.159 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:03:13.159 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:03:13.159 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:03:13.159 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:03:13.159 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:03:13.160 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:03:13.161 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:03:13.162 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:03:13.163 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:03:13.164 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:03:13.165 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:03:13.166 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:03:13.169 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:03:13.169 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:03:13.170 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:03:13.171 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:03:13.172 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:03:13.173 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:03:13.174 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:03:13.174 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:03:15.299 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:03:15.299 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:15.299 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-21T06:03:15.299 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:15.300 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:15.300 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:15.300 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:03:15.300 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.300 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.300 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.301 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.302 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:03:15.303 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.304 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:03:15.305 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:03:15.307 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:03:15.308 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:03:15.309 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:03:15.310 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:03:15.311 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:03:15.312 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:03:15.313 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:15.313 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-21T06:03:15.912 DEBUG:teuthology.parallel:result is None 2024-09-21T06:03:15.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:03:16.052 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:03:16.104 INFO:teuthology.orchestra.run.smithi118.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:03:16.105 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:03:16.105 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:03:16.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:03:16.241 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:03:16.288 INFO:teuthology.orchestra.run.smithi149.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:03:16.288 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:03:16.288 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:03:16.290 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:03:16.290 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:16.290 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:03:16.353 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:16.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:03:16.416 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:03:16.416 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:16.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:03:16.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:03:16.568 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:16.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:03:16.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:03:16.728 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:03:16.729 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:16.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:03:16.784 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:03:16.879 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:16.880 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:03:16.939 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:03:17.038 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:03:17.038 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:17.039 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:03:17.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:03:17.188 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:17.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:03:17.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:03:17.409 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T06:03:17.484 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T06:03:17.484 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2024-09-21T06:03:17.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-09-21T06:03:17.545 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T06:03:17.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T06:03:17.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T06:03:17.609 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T06:03:17.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T06:03:17.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T06:03:17.677 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T06:03:17.678 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T06:03:17.678 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T06:03:17.678 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:17.678 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T06:03:17.712 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:17.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:17.934 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:17.934 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T06:03:17.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:18.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:18.212 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T06:03:18.213 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T06:03:18.213 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913522', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM3vJfDnPP83P4tqcsFXjcV+NSV3jJKU7qw8BdgChgV6qrQK/r7Xp8hYCZvEoDb/iYJnsEiIi3gEUIMyds2hb2w=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/ulJPm7YVXYCYPZJg7ZnhgNt6jkTHy6jwFBRVikkz+0XaWv2rHilUBW9dILxKYr2N0Lbm14D+EvJHjfaEckzw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T06:03:18.213 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T06:03:18.218 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T06:03:18.252 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T06:03:18.293 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T06:03:18.351 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:18.352 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:03:18.387 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:03:18.387 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 06:03:02.823375015 +0000 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 06:00:48.284404318 +0000 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 06:00:48.284404318 +0000 2024-09-21T06:03:18.462 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 06:00:48.284404318 +0000 2024-09-21T06:03:18.463 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:03:18.554 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T06:03:18.555 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T06:03:18.555 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000179561 s, 2.9 MB/s 2024-09-21T06:03:18.557 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:03:18.593 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 656 Links: 1 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 06:03:02.824374993 +0000 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 06:00:48.741394246 +0000 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 06:00:48.741394246 +0000 2024-09-21T06:03:18.669 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 06:00:48.741394246 +0000 2024-09-21T06:03:18.669 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:03:18.761 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T06:03:18.761 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T06:03:18.761 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000190375 s, 2.7 MB/s 2024-09-21T06:03:18.763 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:03:18.800 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 06:03:02.824374993 +0000 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 06:00:49.214383842 +0000 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 06:00:49.214383842 +0000 2024-09-21T06:03:18.875 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 06:00:49.214383842 +0000 2024-09-21T06:03:18.876 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:03:18.967 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T06:03:18.967 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T06:03:18.967 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000192392 s, 2.7 MB/s 2024-09-21T06:03:18.970 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:03:19.006 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-09-21T06:03:19.080 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:03:19.080 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-09-21T06:03:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-21 06:03:02.825374971 +0000 2024-09-21T06:03:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-21 06:00:49.656374119 +0000 2024-09-21T06:03:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-21 06:00:49.656374119 +0000 2024-09-21T06:03:19.081 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-21 06:00:49.656374119 +0000 2024-09-21T06:03:19.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:03:19.172 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-21T06:03:19.172 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-21T06:03:19.172 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000187613 s, 2.7 MB/s 2024-09-21T06:03:19.175 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:03:19.211 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:19.211 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:19.211 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:03:19.247 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:03:19.247 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 755 Links: 1 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 06:03:07.109479368 +0000 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 06:00:56.002892462 +0000 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 06:00:56.002892462 +0000 2024-09-21T06:03:19.323 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 06:00:56.002892462 +0000 2024-09-21T06:03:19.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:03:19.417 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T06:03:19.417 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T06:03:19.417 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000374292 s, 1.4 MB/s 2024-09-21T06:03:19.419 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:03:19.456 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-21T06:03:19.532 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:03:19.532 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:19.532 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 775 Links: 1 2024-09-21T06:03:19.532 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:19.532 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:19.533 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 06:03:07.110479348 +0000 2024-09-21T06:03:19.533 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 06:00:56.491882902 +0000 2024-09-21T06:03:19.533 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 06:00:56.491882902 +0000 2024-09-21T06:03:19.533 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 06:00:56.491882902 +0000 2024-09-21T06:03:19.533 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:03:19.626 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T06:03:19.626 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T06:03:19.626 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000290755 s, 1.8 MB/s 2024-09-21T06:03:19.629 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:03:19.665 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 793 Links: 1 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 06:03:07.111479329 +0000 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 06:00:56.954873851 +0000 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 06:00:56.954873851 +0000 2024-09-21T06:03:19.743 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 06:00:56.954873851 +0000 2024-09-21T06:03:19.744 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:03:19.837 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T06:03:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T06:03:19.838 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000301324 s, 1.7 MB/s 2024-09-21T06:03:19.840 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:03:19.877 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-21T06:03:19.952 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 814 Links: 1 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-21 06:03:07.111479329 +0000 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-21 06:00:57.426864624 +0000 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-21 06:00:57.426864624 +0000 2024-09-21T06:03:19.953 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-21 06:00:57.426864624 +0000 2024-09-21T06:03:19.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:03:20.047 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-21T06:03:20.047 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-21T06:03:20.047 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000281302 s, 1.8 MB/s 2024-09-21T06:03:20.050 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:03:20.086 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:20.086 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T06:03:20.086 INFO:tasks.ceph:Generating config... 2024-09-21T06:03:20.087 INFO:tasks.ceph:[client] pid file = 2024-09-21T06:03:20.087 INFO:tasks.ceph:[client.0] debug client = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[client.1] debug client = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[client.1] debug objecter = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2024-09-21T06:03:20.088 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2024-09-21T06:03:20.089 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:03:20.089 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T06:03:20.090 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T06:03:20.090 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2024-09-21T06:03:20.090 INFO:tasks.ceph:[osd] osd mon report interval = 5 2024-09-21T06:03:20.090 INFO:tasks.ceph:[osd] osd objectstore = memstore 2024-09-21T06:03:20.090 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T06:03:20.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T06:03:20.243 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T06:03:20.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T06:03:20.407 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:03:20.461 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.118'), ('mon.b', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]')] 2024-09-21T06:03:20.462 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.118,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}} 2024-09-21T06:03:20.463 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:20.463 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T06:03:20.497 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.118 --add b 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:20.677 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: generated fsid dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:setting min_mon_release = quincy 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 0 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:fsid dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:last_changed 2024-09-21T06:03:20.676849+0000 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-09-21T06:03:20.676849+0000 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:min_mon_release 17 (quincy) 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:election_strategy: 1 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.a 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2024-09-21T06:03:20.678 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T06:03:20.686 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T06:03:20.720 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e... 2024-09-21T06:03:20.721 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T06:03:20.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.856 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T06:03:20.857 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T06:03:20.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.118,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-09-21T06:03:20.859 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on skipped message = False 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2024-09-21T06:03:20.860 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug trim objects = true 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2024-09-21T06:03:20.861 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 1/20 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 1/20 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 4/10 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: memstore device bytes = 200000000 2024-09-21T06:03:20.862 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 1.0 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: osd mon report interval = 5 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = memstore 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:03:20.863 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T06:03:20.864 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: mon down mkfs grace = 300 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull ratio = 0.6 2024-09-21T06:03:20.865 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.7 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.6 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = "" 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2024-09-21T06:03:20.866 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout: debug objectcacher = 20 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout: debug objecter = 20 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout: debug objectcacher = 20 2024-09-21T06:03:20.867 INFO:teuthology.orchestra.run.smithi118.stdout: debug objecter = 20 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.868 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.869 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.870 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.118,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-09-21T06:03:20.871 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-09-21T06:03:20.872 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2024-09-21T06:03:20.874 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: memstore device bytes = 200000000 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 1.0 2024-09-21T06:03:20.875 INFO:teuthology.orchestra.run.smithi149.stdout: osd mon report interval = 5 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = memstore 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:03:20.876 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-21T06:03:20.877 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T06:03:20.878 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-09-21T06:03:20.879 INFO:teuthology.orchestra.run.smithi149.stdout: mon down mkfs grace = 300 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull ratio = 0.6 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.7 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.6 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T06:03:20.880 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: debug objectcacher = 20 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: debug objecter = 20 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-09-21T06:03:20.881 INFO:teuthology.orchestra.run.smithi149.stdout: debug objectcacher = 20 2024-09-21T06:03:20.882 INFO:teuthology.orchestra.run.smithi149.stdout: debug objecter = 20 2024-09-21T06:03:20.889 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T06:03:20.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T06:03:21.055 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T06:03:21.056 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:21.056 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T06:03:21.090 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:21.090 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T06:03:21.164 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:03:21.165 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:21.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T06:03:21.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:03:21.281 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:21.281 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:21.356 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:03:21.356 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:21.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T06:03:21.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:03:21.434 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:21.434 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:21.511 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T06:03:21.511 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T06:03:21.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T06:03:21.676 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T06:03:21.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T06:03:21.860 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T06:03:21.874 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T06:03:21.874 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T06:03:22.042 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T06:03:22.053 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T06:03:22.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T06:03:22.273 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T06:03:22.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T06:03:22.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T06:03:22.504 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T06:03:22.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T06:03:22.571 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T06:03:22.736 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T06:03:22.748 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T06:03:22.803 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T06:03:22.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:03:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T06:03:22.982 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T06:03:23.122 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T06:03:23.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T06:03:23.301 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T06:03:23.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T06:03:23.480 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T06:03:23.513 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T06:03:23.513 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T06:03:23.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T06:03:23.569 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:23.569 INFO:tasks.ceph:role: osd.0 2024-09-21T06:03:23.569 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:03:23.569 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T06:03:23.623 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:23.623 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:23.623 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:23.623 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:23.623 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:23.624 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:23.624 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:23.624 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:23.624 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:23.624 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:23.656 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-21T06:03:23.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-21T06:03:23.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T06:03:23.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T06:03:23.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T06:03:23.859 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:23.859 INFO:tasks.ceph:role: osd.1 2024-09-21T06:03:23.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:03:23.859 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T06:03:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:23.913 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:23.913 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:23.913 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:23.913 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:23.913 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:23.914 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:23.914 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-21T06:03:23.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-21T06:03:23.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T06:03:24.030 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T06:03:24.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T06:03:24.145 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:24.146 INFO:tasks.ceph:role: osd.2 2024-09-21T06:03:24.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:03:24.146 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T06:03:24.200 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:24.200 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:24.200 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:24.200 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:24.200 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:24.201 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:24.201 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:24.201 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:24.201 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:24.201 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:24.234 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-21T06:03:24.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-21T06:03:24.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T06:03:24.317 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T06:03:24.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T06:03:24.431 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:24.431 INFO:tasks.ceph:role: osd.3 2024-09-21T06:03:24.432 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:03:24.432 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T06:03:24.485 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:24.486 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:24.519 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-09-21T06:03:24.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-09-21T06:03:24.522 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T06:03:24.600 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T06:03:24.661 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:24.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:24.818+0000 7fb9364e0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T06:03:24.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:24.818+0000 7fb9364e0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T06:03:24.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:24.821+0000 7fb9364e0640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2024-09-21T06:03:24.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T06:03:24.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:25.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.051+0000 7fc204818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T06:03:25.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.051+0000 7fc204818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T06:03:25.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.053+0000 7fc204818640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2024-09-21T06:03:25.077 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T06:03:25.132 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:25.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.285+0000 7efe50811640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T06:03:25.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.285+0000 7efe50811640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T06:03:25.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.287+0000 7efe50811640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2024-09-21T06:03:25.310 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T06:03:25.366 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:25.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.517+0000 7f401e21a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T06:03:25.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.517+0000 7f401e21a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T06:03:25.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:25.519+0000 7f401e21a640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2024-09-21T06:03:25.544 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T06:03:25.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T06:03:25.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:25.662 INFO:tasks.ceph:role: osd.4 2024-09-21T06:03:25.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:03:25.662 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T06:03:25.727 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:25.728 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:26.134 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T06:03:26.138 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T06:03:26.138 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T06:03:26.281 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T06:03:26.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T06:03:26.406 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:26.406 INFO:tasks.ceph:role: osd.5 2024-09-21T06:03:26.406 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:03:26.407 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T06:03:26.470 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:26.470 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:26.470 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:26.470 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:26.470 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:26.470 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:26.471 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:26.471 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:26.471 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:26.471 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:26.828 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T06:03:26.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T06:03:26.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T06:03:26.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T06:03:26.983 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T06:03:27.040 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:27.040 INFO:tasks.ceph:role: osd.6 2024-09-21T06:03:27.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:03:27.040 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T06:03:27.107 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:27.107 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:27.107 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:27.107 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:27.108 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:27.108 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:27.108 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:27.108 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:27.108 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:27.108 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:27.498 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T06:03:27.502 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T06:03:27.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T06:03:27.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T06:03:27.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T06:03:27.721 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:03:27.721 INFO:tasks.ceph:role: osd.7 2024-09-21T06:03:27.721 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:03:27.722 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T06:03:27.785 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:03:27.785 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:03:27.785 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:03:27.786 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:03:27.786 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:03:27.786 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:03:27.786 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:03:27.786 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:03:27.786 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:03:27.786 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:03:28.200 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-21T06:03:28.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-21T06:03:28.204 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T06:03:28.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T06:03:28.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:28.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:28.571+0000 7fde83a18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T06:03:28.576 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:28.574+0000 7fde83a18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T06:03:28.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:28.585+0000 7fde83a18640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2024-09-21T06:03:28.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T06:03:28.681 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:28.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:28.836+0000 7f341b119640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T06:03:28.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:28.836+0000 7f341b119640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T06:03:28.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:28.838+0000 7f341b119640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2024-09-21T06:03:28.862 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T06:03:28.918 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:29.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:29.071+0000 7f8cfa614640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T06:03:29.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:29.071+0000 7f8cfa614640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T06:03:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:29.073+0000 7f8cfa614640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2024-09-21T06:03:29.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T06:03:29.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:29.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:29.311+0000 7fd7dafdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T06:03:29.313 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:29.311+0000 7fd7dafdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T06:03:29.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:29.313+0000 7fd7dafdd640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2024-09-21T06:03:29.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T06:03:29.396 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T06:03:29.396 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:29.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T06:03:29.458 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:29.458 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T06:03:29.556 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:29.556 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T06:03:29.652 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:29.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T06:03:29.748 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:29.748 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T06:03:29.844 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:29.844 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T06:03:29.939 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:29.939 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T06:03:30.034 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T06:03:30.093 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T06:03:30.190 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T06:03:30.288 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.288 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T06:03:30.384 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T06:03:30.480 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.480 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T06:03:30.575 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T06:03:30.671 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:30.671 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T06:03:30.707 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:30.708 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T06:03:30.783 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.783 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T06:03:30.818 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:30.818 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T06:03:30.895 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T06:03:30.895 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T06:03:30.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg== 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw== 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg== 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2024-09-21T06:03:30.948 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA== 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q== 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ== 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q== 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw== 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-09-21T06:03:30.949 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg== 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ== 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ== 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw== 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA== 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA== 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:03:30.950 INFO:teuthology.orchestra.run.smithi118.stdout:[client.2] 2024-09-21T06:03:30.951 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg== 2024-09-21T06:03:30.951 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2024-09-21T06:03:30.951 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ== 2024-09-21T06:03:30.951 INFO:teuthology.orchestra.run.smithi118.stdout:[client.3] 2024-09-21T06:03:30.951 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA== 2024-09-21T06:03:30.988 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-09-21T06:03:30.989 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg== 2024-09-21T06:03:30.989 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-09-21T06:03:30.989 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw== 2024-09-21T06:03:30.989 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-09-21T06:03:30.989 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg== 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA== 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q== 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ== 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q== 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw== 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg== 2024-09-21T06:03:30.990 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ== 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ== 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw== 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA== 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA== 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2024-09-21T06:03:30.991 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg== 2024-09-21T06:03:30.992 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-21T06:03:30.992 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ== 2024-09-21T06:03:30.992 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2024-09-21T06:03:30.992 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA== 2024-09-21T06:03:30.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:03:30.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:03:31.197 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:31.201 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:31.366 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:31.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:31.534 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:31.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:31.700 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:31.703 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:31.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:31.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:32.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:32.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:32.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:03:32.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:03:32.371 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:32.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:32.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:32.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:03:32.710 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:32.714 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:32.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:32.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:33.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:33.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:33.206 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:33.210 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:03:33.372 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:33.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:33.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:33.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:33.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:33.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:33.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:33.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:03:34.046 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T06:03:34.046 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T06:03:34.101 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:03:34.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T06:03:34.333 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T06:03:34.390 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:03:34.567 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T06:03:34.623 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T06:03:34.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:03:34.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T06:03:34.912 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:34.917 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:03:34.952 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T06:03:34.952 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T06:03:34.953 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T06:03:34.993 INFO:tasks.ceph.mon.a:Started 2024-09-21T06:03:34.993 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T06:03:34.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T06:03:34.997 INFO:tasks.ceph.mon.b:Started 2024-09-21T06:03:34.997 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T06:03:34.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T06:03:35.001 INFO:tasks.ceph.mon.c:Started 2024-09-21T06:03:35.001 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T06:03:35.001 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T06:03:35.001 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T06:03:35.005 INFO:tasks.ceph.mgr.y:Started 2024-09-21T06:03:35.005 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T06:03:35.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T06:03:35.009 INFO:tasks.ceph.mgr.x:Started 2024-09-21T06:03:35.009 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T06:03:35.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T06:03:35.013 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T06:03:35.013 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T06:03:35.060 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T06:03:35.060 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T06:03:35.107 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:03:35.107 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T06:03:35.152 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:03:35.152 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T06:03:35.199 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T06:03:35.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T06:03:35.246 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:03:35.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T06:03:35.292 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T06:03:35.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T06:03:35.340 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T06:03:35.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T06:03:35.396 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:03:35.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T06:03:35.446 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:03:35.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T06:03:35.496 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T06:03:35.496 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T06:03:35.549 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:03:35.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T06:03:35.600 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:03:35.600 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:03:35.656 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:03:35.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:03:35.683 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:03:35.683 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T06:03:35.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.693+0000 7f1abf200640 1 -- 172.21.15.118:0/4037146958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ac015f380 msgr2=0x7f1ac013e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.693+0000 7f1abf200640 1 --2- 172.21.15.118:0/4037146958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ac015f380 0x7f1ac013e600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009cd0 tx=0x7f1ab8004a40 comp rx=0 tx=0).stop 2024-09-21T06:03:35.706 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T06:03:35.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T06:03:35.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.700+0000 7f1abf200640 1 -- 172.21.15.118:0/4037146958 shutdown_connections 2024-09-21T06:03:35.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.700+0000 7f1abf200640 1 --2- 172.21.15.118:0/4037146958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac0160540 0x7f1ac015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.700+0000 7f1abf200640 1 --2- 172.21.15.118:0/4037146958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ac015f380 0x7f1ac013e600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.700+0000 7f1abf200640 1 --2- 172.21.15.118:0/4037146958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac00cfae0 0x7f1ac015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.700+0000 7f1abf200640 1 -- 172.21.15.118:0/4037146958 >> 172.21.15.118:0/4037146958 conn(0x7f1ac006d320 msgr2=0x7f1ac0159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:35.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.701+0000 7f1abf200640 1 -- 172.21.15.118:0/4037146958 shutdown_connections 2024-09-21T06:03:35.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.701+0000 7f1abf200640 1 -- 172.21.15.118:0/4037146958 wait complete. 2024-09-21T06:03:35.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.724+0000 7f4bd7e00640 1 -- 172.21.15.118:0/642494453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f4bc00050e0 con 0x7f4bec1543a0 2024-09-21T06:03:35.738 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T06:03:35.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T06:03:35.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.741+0000 7fe78a000640 1 -- 172.21.15.118:0/1375894653 <== mon.1 v2:172.21.15.149:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fe780010640 con 0x7fe7940b3fc0 2024-09-21T06:03:35.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.743+0000 7fbee9800640 1 -- 172.21.15.118:0/607877142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b21c0 msgr2=0x7fbee40cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.743+0000 7fbee9800640 1 --2- 172.21.15.118:0/607877142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b21c0 0x7fbee40cf7f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbee40b6480 tx=0x7fbedc02aa30 comp rx=0 tx=0).stop 2024-09-21T06:03:35.761 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T06:03:35.761 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T06:03:35.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.748+0000 7f38ebe00640 1 -- 172.21.15.118:0/571547730 <== mon.1 v2:172.21.15.149:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f38ec0065a0 con 0x7f38f406cf00 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.747+0000 7f4be2a00640 1 -- 172.21.15.118:0/642494453 <== mon.2 v2:172.21.15.149:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f4be403e760 con 0x7f4bec1543a0 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.747+0000 7f4be2a00640 1 -- 172.21.15.118:0/642494453 <== mon.2 v2:172.21.15.149:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v4)=0 v4) ==== 114+0+0 (secure 0 0 0) 0x7f4be4033dd0 con 0x7f4bec1543a0 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.755+0000 7f4bd7e00640 1 -- 172.21.15.118:0/642494453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bec1543a0 msgr2=0x7f4bec0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.755+0000 7f4bd7e00640 1 --2- 172.21.15.118:0/642494453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bec1543a0 0x7f4bec0b08c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0ccea0 tx=0x7f4be4004ab0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.755+0000 7f4bd7e00640 1 -- 172.21.15.118:0/642494453 shutdown_connections 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.756+0000 7f4bd7e00640 1 --2- 172.21.15.118:0/642494453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bec1543a0 0x7f4bec0b08c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.756+0000 7f4bd7e00640 1 --2- 172.21.15.118:0/642494453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bec1548f0 0x7f4bec0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.756+0000 7f4bd7e00640 1 --2- 172.21.15.118:0/642494453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bd00051c0 0x7f4bec1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.756+0000 7f4bd7e00640 1 -- 172.21.15.118:0/642494453 >> 172.21.15.118:0/642494453 conn(0x7f4bec0d0800 msgr2=0x7f4bec06f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.756+0000 7f4bd7e00640 1 -- 172.21.15.118:0/642494453 shutdown_connections 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.756+0000 7f4bd7e00640 1 -- 172.21.15.118:0/642494453 wait complete. 2024-09-21T06:03:35.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.757+0000 7fbee9800640 1 -- 172.21.15.118:0/607877142 shutdown_connections 2024-09-21T06:03:35.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.757+0000 7fbee9800640 1 --2- 172.21.15.118:0/607877142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b21c0 0x7fbee40cf7f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.757+0000 7fbee9800640 1 --2- 172.21.15.118:0/607877142 >> v2:172.21.15.118:3300/0 conn(0x7fbee40b1870 0x7fbee40b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.757+0000 7fbee9800640 1 -- 172.21.15.118:0/607877142 >> 172.21.15.118:0/607877142 conn(0x7fbee40d1780 msgr2=0x7fbee40d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:35.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.761+0000 7fbee9800640 1 -- 172.21.15.118:0/607877142 shutdown_connections 2024-09-21T06:03:35.784 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:03:35.784 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:03:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.766+0000 7fbee9800640 1 -- 172.21.15.118:0/607877142 wait complete. 2024-09-21T06:03:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.779+0000 7fbee9800640 1 Processor -- start 2024-09-21T06:03:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.786+0000 7fbee9800640 1 -- start start 2024-09-21T06:03:35.805 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:03:35.805 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T06:03:35.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.824+0000 7feed0c00640 1 -- 172.21.15.118:0/4173952624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeb0004800 msgr2=0x7feeb0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.824+0000 7feed0c00640 1 --2- 172.21.15.118:0/4173952624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeb0004800 0x7feeb0004c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feebc009b50 tx=0x7feeb0005830 comp rx=0 tx=0).stop 2024-09-21T06:03:35.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.824+0000 7feeca800640 1 -- 172.21.15.118:0/4173952624 reap_dead start 2024-09-21T06:03:35.840 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:03:35.841 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T06:03:35.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.827+0000 7fbee9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b1870 0x7fbee40ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.827+0000 7fbee9800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbee40b21c0 0x7fbee4151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.827+0000 7fbee9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbee40d2b20 0x7fbee414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.830+0000 7fbee9800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbee408ed10 con 0x7fbee40b21c0 2024-09-21T06:03:35.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.830+0000 7fbee9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbee408e450 con 0x7fbee40b1870 2024-09-21T06:03:35.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.830+0000 7fbee9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbee40d24b0 con 0x7fbee40d2b20 2024-09-21T06:03:35.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.831+0000 7feed0c00640 1 -- 172.21.15.118:0/4173952624 shutdown_connections 2024-09-21T06:03:35.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.831+0000 7feed0c00640 1 -- 172.21.15.118:0/4173952624 >> 172.21.15.118:0/4173952624 conn(0x7feecc0b2940 msgr2=0x7feecc0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:35.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.832+0000 7feed0c00640 1 -- 172.21.15.118:0/4173952624 shutdown_connections 2024-09-21T06:03:35.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.832+0000 7feed0c00640 1 -- 172.21.15.118:0/4173952624 wait complete. 2024-09-21T06:03:35.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.839+0000 7fbee3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbee40d2b20 0x7fbee414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.839+0000 7fbee3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbee40d2b20 0x7fbee414de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:55564/0 (socket says 172.21.15.118:55564) 2024-09-21T06:03:35.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.839+0000 7fbee2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbee40b21c0 0x7fbee4151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.839+0000 7fbee2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbee40b21c0 0x7fbee4151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56164/0 (socket says 172.21.15.118:56164) 2024-09-21T06:03:35.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.839+0000 7fbee2000640 1 -- 172.21.15.118:0/3517226762 learned_addr learned my addr 172.21.15.118:0/3517226762 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:35.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.839+0000 7fbee2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b1870 0x7fbee40ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.840+0000 7fbee2000640 1 -- 172.21.15.118:0/3517226762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbee40d2b20 msgr2=0x7fbee414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.840+0000 7fbee2000640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbee40d2b20 0x7fbee414de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.840+0000 7fbee2000640 1 -- 172.21.15.118:0/3517226762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b1870 msgr2=0x7fbee40ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.840+0000 7fbee2000640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b1870 0x7fbee40ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.840+0000 7fbee2000640 1 -- 172.21.15.118:0/3517226762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee41f94a0 con 0x7fbee40b21c0 2024-09-21T06:03:35.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.841+0000 7fbee3400640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbee40d2b20 0x7fbee414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:35.857 DEBUG:tasks.ceph:set 22 configs 2024-09-21T06:03:35.857 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi118') 2024-09-21T06:03:35.858 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi118') 2024-09-21T06:03:35.858 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi118') 2024-09-21T06:03:35.859 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.853+0000 7fbee2000640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbee40b21c0 0x7fbee4151360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbed000b440 tx=0x7fbed000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.853+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0015020 con 0x7fbee40b21c0 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.854+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fbed0011830 con 0x7fbee40b21c0 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.854+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee41f9780 con 0x7fbee40b21c0 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.854+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee41f9d40 con 0x7fbee40b21c0 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.843+0000 7feed0c00640 1 Processor -- start 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.844+0000 7feed0c00640 1 -- start start 2024-09-21T06:03:35.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.851+0000 7feed0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb0004800 0x7feecc1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.852+0000 7feed0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc1508a0 0x7feecc0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.853+0000 7feed0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feecc0cca40 0x7feecc1f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.855+0000 7feed0c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feecc072e50 con 0x7feecc0cca40 2024-09-21T06:03:35.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.855+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0011c40 con 0x7fbee40b21c0 2024-09-21T06:03:35.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.858+0000 7feed0c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feecc072cd0 con 0x7feecc1508a0 2024-09-21T06:03:35.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.858+0000 7feed0c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feecc0b50e0 con 0x7feeb0004800 2024-09-21T06:03:35.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.856+0000 7feec9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb0004800 0x7feecc1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.855+0000 7feec9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc1508a0 0x7feecc0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.858+0000 7feec9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc1508a0 0x7feecc0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53534/0 (socket says 172.21.15.118:53534) 2024-09-21T06:03:35.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.858+0000 7feec9400640 1 -- 172.21.15.118:0/2709916252 learned_addr learned my addr 172.21.15.118:0/2709916252 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:35.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.858+0000 7feeca800640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feecc0cca40 0x7feecc1f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.860+0000 7feec9400640 1 -- 172.21.15.118:0/2709916252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb0004800 msgr2=0x7feecc1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.860+0000 7feec9400640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb0004800 0x7feecc1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.860+0000 7feec9400640 1 -- 172.21.15.118:0/2709916252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feecc0cca40 msgr2=0x7feecc1f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.861+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbebc005080 con 0x7fbee40b21c0 2024-09-21T06:03:35.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.860+0000 7feec9400640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feecc0cca40 0x7feecc1f6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.860+0000 7feec9400640 1 -- 172.21.15.118:0/2709916252 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc1573e0 con 0x7feecc1508a0 2024-09-21T06:03:35.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.864+0000 7feeca800640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feecc0cca40 0x7feecc1f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:35.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.864+0000 7feec9400640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc1508a0 0x7feecc0cc500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feebc02d750 tx=0x7feebc010700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:35.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.876+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbed0018020 con 0x7fbee40b21c0 2024-09-21T06:03:35.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.882+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc03a040 con 0x7feecc1508a0 2024-09-21T06:03:35.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.882+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7feebc043070 con 0x7feecc1508a0 2024-09-21T06:03:35.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.883+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc010b30 con 0x7feecc1508a0 2024-09-21T06:03:35.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.883+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbed0019890 con 0x7fbee40b21c0 2024-09-21T06:03:35.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.883+0000 7feed0c00640 1 -- 172.21.15.118:0/2709916252 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc1576c0 con 0x7feecc1508a0 2024-09-21T06:03:35.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.883+0000 7feed0c00640 1 -- 172.21.15.118:0/2709916252 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc1f7640 con 0x7feecc1508a0 2024-09-21T06:03:35.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.890+0000 7feeb7400640 1 -- 172.21.15.118:0/2709916252 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea0005080 con 0x7feecc1508a0 2024-09-21T06:03:35.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.890+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbed001f020 con 0x7fbee40b21c0 2024-09-21T06:03:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.898+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feebc010cd0 con 0x7feecc1508a0 2024-09-21T06:03:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.899+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feebc035440 con 0x7feecc1508a0 2024-09-21T06:03:35.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.901+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7feebc048460 con 0x7feecc1508a0 2024-09-21T06:03:35.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.926+0000 7f4fb3200640 1 -- 172.21.15.118:0/4245506433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 msgr2=0x7f4f940060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.926+0000 7f4fb3200640 1 --2- 172.21.15.118:0/4245506433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4f940060f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c260 tx=0x7f4f94003810 comp rx=0 tx=0).stop 2024-09-21T06:03:35.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.934+0000 7f4fb3200640 1 -- 172.21.15.118:0/4245506433 shutdown_connections 2024-09-21T06:03:35.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.934+0000 7f4fb3200640 1 --2- 172.21.15.118:0/4245506433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4f940060f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.934+0000 7f4fb3200640 1 -- 172.21.15.118:0/4245506433 >> 172.21.15.118:0/4245506433 conn(0x7f4fac06d320 msgr2=0x7f4fac0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:35.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.938+0000 7f4fb3200640 1 -- 172.21.15.118:0/4245506433 shutdown_connections 2024-09-21T06:03:35.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.938+0000 7f4fb3200640 1 -- 172.21.15.118:0/4245506433 wait complete. 2024-09-21T06:03:35.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.960+0000 7f4fb3200640 1 Processor -- start 2024-09-21T06:03:35.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.960+0000 7f4fb3200640 1 -- start start 2024-09-21T06:03:35.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.966+0000 7f4fb3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4fac14a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.969+0000 7f4fb1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4fac14a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.971+0000 7f4fb3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fac149c90 0x7f4fac14f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.971+0000 7f4fb1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4fac14a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:55602/0 (socket says 172.21.15.118:55602) 2024-09-21T06:03:35.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.971+0000 7f4fb1e00640 1 -- 172.21.15.118:0/1882039012 learned_addr learned my addr 172.21.15.118:0/1882039012 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:35.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.971+0000 7f4fb3200640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fac14c6f0 0x7f4fac1f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:35.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.972+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac0749d0 con 0x7f4fac14c6f0 2024-09-21T06:03:35.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.972+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac06ff00 con 0x7f4fac149c90 2024-09-21T06:03:35.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.972+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac074b50 con 0x7f4f94003c70 2024-09-21T06:03:35.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.973+0000 7f4fb1400640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fac149c90 0x7f4fac14f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.973+0000 7f4fb2800640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fac14c6f0 0x7f4fac1f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:35.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.973+0000 7f4fb1e00640 1 -- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fac149c90 msgr2=0x7f4fac14f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.973+0000 7f4fb1e00640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fac149c90 0x7f4fac14f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.973+0000 7f4fb1e00640 1 -- 172.21.15.118:0/1882039012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fac14c6f0 msgr2=0x7f4fac1f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:35.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.973+0000 7f4fb1e00640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fac14c6f0 0x7f4fac1f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:35.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.973+0000 7f4fb1e00640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac15a510 con 0x7f4f94003c70 2024-09-21T06:03:35.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:35.974+0000 7f4fb1e00640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4fac14a180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0000c00 tx=0x7f4fa0004dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.047+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0031050 con 0x7f4f94003c70 2024-09-21T06:03:36.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.047+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f4fa0006070 con 0x7f4f94003c70 2024-09-21T06:03:36.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.047+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa002c660 con 0x7f4f94003c70 2024-09-21T06:03:36.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.047+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac15a7f0 con 0x7f4f94003c70 2024-09-21T06:03:36.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.047+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac14a9b0 con 0x7f4f94003c70 2024-09-21T06:03:36.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.053+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4fa003f030 con 0x7f4f94003c70 2024-09-21T06:03:36.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.053+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4fa0036790 con 0x7f4f94003c70 2024-09-21T06:03:36.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.055+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac14ac10 con 0x7f4f94003c70 2024-09-21T06:03:36.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.060+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4fa0006220 con 0x7f4f94003c70 2024-09-21T06:03:36.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.073+0000 7fe77f400640 1 -- 172.21.15.118:0/1375894653 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe76c000e30 con 0x7fe7940b3fc0 2024-09-21T06:03:36.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.093+0000 7f38ebe00640 1 -- 172.21.15.118:0/571547730 <== mon.1 v2:172.21.15.149:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f38ec00f3e0 con 0x7f38f406cf00 2024-09-21T06:03:36.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.093+0000 7fe78a000640 1 -- 172.21.15.118:0/1375894653 <== mon.1 v2:172.21.15.149:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fe7800107f0 con 0x7fe7940b3fc0 2024-09-21T06:03:36.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.093+0000 7fe78a000640 1 -- 172.21.15.118:0/1375894653 <== mon.1 v2:172.21.15.149:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7fe780010460 con 0x7fe7940b3fc0 2024-09-21T06:03:36.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.098+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7feebc012510 con 0x7feecc1508a0 2024-09-21T06:03:36.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.104+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fbed0011de0 con 0x7fbee40b21c0 2024-09-21T06:03:36.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.106+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f4fa00064b0 con 0x7f4f94003c70 2024-09-21T06:03:36.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.111+0000 7fe77f400640 1 -- 172.21.15.118:0/1375894653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7940b3fc0 msgr2=0x7fe7941fcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.111+0000 7fe77f400640 1 --2- 172.21.15.118:0/1375894653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7940b3fc0 0x7fe7941fcd20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe78000d740 tx=0x7fe78000dc00 comp rx=0 tx=0).stop 2024-09-21T06:03:36.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.107+0000 7f38f9800640 1 -- 172.21.15.118:0/571547730 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f38c8005100 con 0x7f38f406cf00 2024-09-21T06:03:36.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.122+0000 7fe77f400640 1 -- 172.21.15.118:0/1375894653 shutdown_connections 2024-09-21T06:03:36.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.122+0000 7fe77f400640 1 --2- 172.21.15.118:0/1375894653 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe794160540 0x7fe79406ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.122+0000 7fe77f400640 1 --2- 172.21.15.118:0/1375894653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79415f8c0 0x7fe7940ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.122+0000 7fe77f400640 1 --2- 172.21.15.118:0/1375894653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7940b3fc0 0x7fe7941fcd20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.122+0000 7fe77f400640 1 -- 172.21.15.118:0/1375894653 >> 172.21.15.118:0/1375894653 conn(0x7fe79406d320 msgr2=0x7fe79415dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.119+0000 7ffbf7200640 1 -- 172.21.15.118:0/861666554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf00d04d0 msgr2=0x7ffbf0073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.119+0000 7ffbf7200640 1 --2- 172.21.15.118:0/861666554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf00d04d0 0x7ffbf0073dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0071ff0 tx=0x7ffbe402a640 comp rx=0 tx=0).stop 2024-09-21T06:03:36.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.124+0000 7ffbf7200640 1 -- 172.21.15.118:0/861666554 shutdown_connections 2024-09-21T06:03:36.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.124+0000 7ffbf7200640 1 --2- 172.21.15.118:0/861666554 >> v2:172.21.15.149:3300/0 conn(0x7ffbf0074300 0x7ffbf006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.124+0000 7ffbf7200640 1 --2- 172.21.15.118:0/861666554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf00d04d0 0x7ffbf0073dc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.124+0000 7ffbf7200640 1 -- 172.21.15.118:0/861666554 >> 172.21.15.118:0/861666554 conn(0x7ffbf00b26f0 msgr2=0x7ffbf00b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.124+0000 7ffbf7200640 1 -- 172.21.15.118:0/861666554 shutdown_connections 2024-09-21T06:03:36.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.124+0000 7ffbf7200640 1 -- 172.21.15.118:0/861666554 wait complete. 2024-09-21T06:03:36.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.118+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feebc048640 con 0x7feecc1508a0 2024-09-21T06:03:36.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.118+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fa002c800 con 0x7f4f94003c70 2024-09-21T06:03:36.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.130+0000 7f38ebe00640 1 -- 172.21.15.118:0/571547730 <== mon.1 v2:172.21.15.149:3300/0 10 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38ec01b670 con 0x7f38f406cf00 2024-09-21T06:03:36.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.130+0000 7f38ebe00640 1 -- 172.21.15.118:0/571547730 <== mon.1 v2:172.21.15.149:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f38ec01ba70 con 0x7f38f406cf00 2024-09-21T06:03:36.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.132+0000 7fe77f400640 1 -- 172.21.15.118:0/1375894653 shutdown_connections 2024-09-21T06:03:36.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.132+0000 7fe77f400640 1 -- 172.21.15.118:0/1375894653 wait complete. 2024-09-21T06:03:36.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.134+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbed00193b0 con 0x7fbee40b21c0 2024-09-21T06:03:36.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.143+0000 7ffbf7200640 1 Processor -- start 2024-09-21T06:03:36.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.143+0000 7ffbf7200640 1 -- start start 2024-09-21T06:03:36.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.147+0000 7f38f9800640 1 -- 172.21.15.118:0/571547730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38f406cf00 msgr2=0x7f38f40cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.147+0000 7f38f9800640 1 --2- 172.21.15.118:0/571547730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38f406cf00 0x7f38f40cdfd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c6b0 tx=0x7f38ec00cb70 comp rx=0 tx=0).stop 2024-09-21T06:03:36.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.147+0000 7f38f9800640 1 -- 172.21.15.118:0/571547730 shutdown_connections 2024-09-21T06:03:36.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.147+0000 7f38f9800640 1 --2- 172.21.15.118:0/571547730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38f40d27e0 0x7f38f415a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.147+0000 7f38f9800640 1 --2- 172.21.15.118:0/571547730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38f40cfe10 0x7f38f41fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.147+0000 7f38f9800640 1 --2- 172.21.15.118:0/571547730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38f406cf00 0x7f38f40cdfd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.147+0000 7f38f9800640 1 -- 172.21.15.118:0/571547730 >> 172.21.15.118:0/571547730 conn(0x7f38f40d4c10 msgr2=0x7f38f415b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.150+0000 7ffbf7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf006f200 0x7ffbf01e1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.151+0000 7f38f9800640 1 -- 172.21.15.118:0/571547730 shutdown_connections 2024-09-21T06:03:36.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.151+0000 7f38f9800640 1 -- 172.21.15.118:0/571547730 wait complete. 2024-09-21T06:03:36.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.151+0000 7ffbefe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf006f200 0x7ffbf01e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.151+0000 7ffbf7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbf0074300 0x7ffbf0143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.152+0000 7ffbefe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf006f200 0x7ffbf01e1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56204/0 (socket says 172.21.15.118:56204) 2024-09-21T06:03:36.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.152+0000 7ffbefe00640 1 -- 172.21.15.118:0/1392950994 learned_addr learned my addr 172.21.15.118:0/1392950994 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.153+0000 7ffbef400640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbf0074300 0x7ffbf0143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.156+0000 7ffbf7200640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbf00d04d0 0x7ffbf01fd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.156+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf00b4c40 con 0x7ffbf006f200 2024-09-21T06:03:36.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.156+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0070e00 con 0x7ffbf0074300 2024-09-21T06:03:36.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.156+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf00b4dc0 con 0x7ffbf00d04d0 2024-09-21T06:03:36.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.156+0000 7ffbf5c00640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbf00d04d0 0x7ffbf01fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.157+0000 7ffbf5c00640 1 -- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbf0074300 msgr2=0x7ffbf0143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.157+0000 7ffbf5c00640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbf0074300 0x7ffbf0143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.157+0000 7ffbf5c00640 1 -- 172.21.15.118:0/1392950994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf006f200 msgr2=0x7ffbf01e1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.157+0000 7ffbf5c00640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf006f200 0x7ffbf01e1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.157+0000 7ffbf5c00640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf01e09f0 con 0x7ffbf00d04d0 2024-09-21T06:03:36.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.158+0000 7ffbef400640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbf0074300 0x7ffbf0143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:36.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.159+0000 7ffbf5c00640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbf00d04d0 0x7ffbf01fd6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800c730 tx=0x7ffbe800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.160+0000 7ffbe3e00640 1 -- 172.21.15.118:0/1392950994 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8003ba0 con 0x7ffbf00d04d0 2024-09-21T06:03:36.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.160+0000 7ffbe3e00640 1 -- 172.21.15.118:0/1392950994 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbe8003d40 con 0x7ffbf00d04d0 2024-09-21T06:03:36.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.160+0000 7ffbe3e00640 1 -- 172.21.15.118:0/1392950994 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8005330 con 0x7ffbf00d04d0 2024-09-21T06:03:36.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.161+0000 7f076b400640 1 -- 172.21.15.118:0/1777337309 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764006070 con 0x7f0754005350 2024-09-21T06:03:36.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.163+0000 7f0772600640 1 -- 172.21.15.118:0/1777337309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 msgr2=0x7f07540079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.163+0000 7f0772600640 1 --2- 172.21.15.118:0/1777337309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 0x7f07540079c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0764001d70 tx=0x7f0754005830 comp rx=0 tx=0).stop 2024-09-21T06:03:36.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.165+0000 7f0772600640 1 -- 172.21.15.118:0/1777337309 shutdown_connections 2024-09-21T06:03:36.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.165+0000 7f0772600640 1 --2- 172.21.15.118:0/1777337309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 0x7f07540079c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.165+0000 7f0772600640 1 -- 172.21.15.118:0/1777337309 >> 172.21.15.118:0/1777337309 conn(0x7f076c06d6e0 msgr2=0x7f076c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.165+0000 7f0772600640 1 -- 172.21.15.118:0/1777337309 shutdown_connections 2024-09-21T06:03:36.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.164+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf01e0ef0 con 0x7ffbf00d04d0 2024-09-21T06:03:36.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.164+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf00b08f0 con 0x7ffbf00d04d0 2024-09-21T06:03:36.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.166+0000 7ffbe3e00640 1 -- 172.21.15.118:0/1392950994 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffbe800a640 con 0x7ffbf00d04d0 2024-09-21T06:03:36.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.166+0000 7ffbe3e00640 1 -- 172.21.15.118:0/1392950994 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffbe8012900 con 0x7ffbf00d04d0 2024-09-21T06:03:36.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.165+0000 7f0772600640 1 -- 172.21.15.118:0/1777337309 wait complete. 2024-09-21T06:03:36.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.171+0000 7ffbe1600640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc4005290 con 0x7ffbf00d04d0 2024-09-21T06:03:36.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.179+0000 7ffbe3e00640 1 -- 172.21.15.118:0/1392950994 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ffbe8012e20 con 0x7ffbf00d04d0 2024-09-21T06:03:36.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.190+0000 7f0772600640 1 Processor -- start 2024-09-21T06:03:36.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.190+0000 7f0772600640 1 -- start start 2024-09-21T06:03:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.218+0000 7f0772600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 0x7f076c1f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.218+0000 7f0772600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076c14fc30 0x7f076c1f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.219+0000 7f0772600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076c150040 0x7f076c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.219+0000 7f0771200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 0x7f076c1f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.219+0000 7f0771200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 0x7f076c1f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53600/0 (socket says 172.21.15.118:53600) 2024-09-21T06:03:36.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.219+0000 7f0771200640 1 -- 172.21.15.118:0/1512987678 learned_addr learned my addr 172.21.15.118:0/1512987678 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.224+0000 7f076be00640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076c14fc30 0x7f076c1f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.227+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f076c070d30 con 0x7f076c14fc30 2024-09-21T06:03:36.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.227+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f076c070bb0 con 0x7f0754005350 2024-09-21T06:03:36.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.227+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f076c0749d0 con 0x7f076c150040 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.227+0000 7f0771c00640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076c150040 0x7f076c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.228+0000 7f0771c00640 1 -- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 msgr2=0x7f076c1f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.228+0000 7f0771c00640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 0x7f076c1f1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.228+0000 7f0771c00640 1 -- 172.21.15.118:0/1512987678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076c14fc30 msgr2=0x7f076c1f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.228+0000 7f0771c00640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076c14fc30 0x7f076c1f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.228+0000 7f0771c00640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076c152d50 con 0x7f076c150040 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.236+0000 7f076be00640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076c14fc30 0x7f076c1f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.236+0000 7f0771c00640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076c150040 0x7f076c1510a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f076c0cd970 tx=0x7f0764004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.236+0000 7f0768c00640 1 -- 172.21.15.118:0/1512987678 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764037040 con 0x7f076c150040 2024-09-21T06:03:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.237+0000 7f0768c00640 1 -- 172.21.15.118:0/1512987678 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07640062f0 con 0x7f076c150040 2024-09-21T06:03:36.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.237+0000 7f0768c00640 1 -- 172.21.15.118:0/1512987678 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764006720 con 0x7f076c150040 2024-09-21T06:03:36.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.238+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076c1f5220 con 0x7f076c150040 2024-09-21T06:03:36.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.238+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f076c153530 con 0x7f076c150040 2024-09-21T06:03:36.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.244+0000 7f0768c00640 1 -- 172.21.15.118:0/1512987678 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f07640327c0 con 0x7f076c150040 2024-09-21T06:03:36.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.244+0000 7f0768c00640 1 -- 172.21.15.118:0/1512987678 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f076403dba0 con 0x7f076c150040 2024-09-21T06:03:36.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.244+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076c0cd420 con 0x7f076c150040 2024-09-21T06:03:36.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.253+0000 7f0768c00640 1 -- 172.21.15.118:0/1512987678 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f076c0cd420 con 0x7f076c150040 2024-09-21T06:03:36.277 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.277 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.325+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fbeb80052f0 con 0x7fbee40b21c0 2024-09-21T06:03:36.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.355+0000 7fbedaa00640 1 -- 172.21.15.118:0/3517226762 <== mon.0 v2:172.21.15.118:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7fbed0019e20 con 0x7fbee40b21c0 2024-09-21T06:03:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.360+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbee40b21c0 msgr2=0x7fbee4151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.360+0000 7fbee9800640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbee40b21c0 0x7fbee4151360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbed000b440 tx=0x7fbed000b900 comp rx=0 tx=0).stop 2024-09-21T06:03:36.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.360+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 shutdown_connections 2024-09-21T06:03:36.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.360+0000 7fbee9800640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbee40d2b20 0x7fbee414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.360+0000 7fbee9800640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbee40b21c0 0x7fbee4151360 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.360+0000 7fbee9800640 1 --2- 172.21.15.118:0/3517226762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbee40b1870 0x7fbee40ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.360+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 >> 172.21.15.118:0/3517226762 conn(0x7fbee40d1780 msgr2=0x7fbee40b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.361+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 shutdown_connections 2024-09-21T06:03:36.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.361+0000 7fbee9800640 1 -- 172.21.15.118:0/3517226762 wait complete. 2024-09-21T06:03:36.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.363+0000 7fb27a600640 1 -- 172.21.15.118:0/1169073208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740b21c0 msgr2=0x7fb2740cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.364+0000 7fb272000640 1 -- 172.21.15.118:0/1169073208 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264031600 con 0x7fb2740b21c0 2024-09-21T06:03:36.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.364+0000 7fb27a600640 1 --2- 172.21.15.118:0/1169073208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740b21c0 0x7fb2740cf7f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2740ba360 tx=0x7fb26402a560 comp rx=0 tx=0).stop 2024-09-21T06:03:36.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.364+0000 7fb27a600640 1 -- 172.21.15.118:0/1169073208 shutdown_connections 2024-09-21T06:03:36.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.364+0000 7fb27a600640 1 --2- 172.21.15.118:0/1169073208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740b21c0 0x7fb2740cf7f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.364+0000 7fb27a600640 1 --2- 172.21.15.118:0/1169073208 >> v2:172.21.15.118:3300/0 conn(0x7fb2740b1870 0x7fb2740b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.364+0000 7fb27a600640 1 -- 172.21.15.118:0/1169073208 >> 172.21.15.118:0/1169073208 conn(0x7fb2740d1780 msgr2=0x7fb2740d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.371+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f4f840052f0 con 0x7f4f94003c70 2024-09-21T06:03:36.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.381+0000 7feeb7400640 1 -- 172.21.15.118:0/2709916252 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7feecc072fd0 con 0x7feecc1508a0 2024-09-21T06:03:36.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.392+0000 7fb27a600640 1 -- 172.21.15.118:0/1169073208 shutdown_connections 2024-09-21T06:03:36.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.392+0000 7fb27a600640 1 -- 172.21.15.118:0/1169073208 wait complete. 2024-09-21T06:03:36.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.400+0000 7f4087e00640 1 -- 172.21.15.118:0/3582459344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 msgr2=0x7f408013de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.400+0000 7f4087e00640 1 --2- 172.21.15.118:0/3582459344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 0x7f408013de80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4074005fd0 tx=0x7f407402a560 comp rx=0 tx=0).stop 2024-09-21T06:03:36.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.401+0000 7f4087e00640 1 -- 172.21.15.118:0/3582459344 shutdown_connections 2024-09-21T06:03:36.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.401+0000 7f4087e00640 1 --2- 172.21.15.118:0/3582459344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408006f110 0x7f408006f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.401+0000 7f4087e00640 1 --2- 172.21.15.118:0/3582459344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 0x7f408013de80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.401+0000 7f4087e00640 1 -- 172.21.15.118:0/3582459344 >> 172.21.15.118:0/3582459344 conn(0x7f40800b26f0 msgr2=0x7f40800b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.402+0000 7f4087e00640 1 -- 172.21.15.118:0/3582459344 shutdown_connections 2024-09-21T06:03:36.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.402+0000 7f4087e00640 1 -- 172.21.15.118:0/3582459344 wait complete. 2024-09-21T06:03:36.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.403+0000 7f4fa6000640 1 -- 172.21.15.118:0/1882039012 <== mon.2 v2:172.21.15.149:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) ==== 106+0+0 (secure 0 0 0) 0x7f4fa0036990 con 0x7f4f94003c70 2024-09-21T06:03:36.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.412+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 msgr2=0x7f4fac14a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.412+0000 7f4fb3200640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4fac14a180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0000c00 tx=0x7f4fa0004dc0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.412+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 shutdown_connections 2024-09-21T06:03:36.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.412+0000 7f4fb3200640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fac14c6f0 0x7f4fac1f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.412+0000 7f4fb3200640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fac149c90 0x7f4fac14f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.412+0000 7f4fb3200640 1 --2- 172.21.15.118:0/1882039012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f94003c70 0x7f4fac14a180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.412+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 >> 172.21.15.118:0/1882039012 conn(0x7f4fac06d320 msgr2=0x7f4fac15b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.413+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 shutdown_connections 2024-09-21T06:03:36.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.413+0000 7f4fb3200640 1 -- 172.21.15.118:0/1882039012 wait complete. 2024-09-21T06:03:36.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.417+0000 7f4087e00640 1 Processor -- start 2024-09-21T06:03:36.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.418+0000 7f4087e00640 1 -- start start 2024-09-21T06:03:36.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.419+0000 7fb27a600640 1 Processor -- start 2024-09-21T06:03:36.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.419+0000 7fb27a600640 1 -- start start 2024-09-21T06:03:36.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.425+0000 7f4087e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408006f110 0x7f40801fa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.426+0000 7f4087e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 0x7f4080152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.426+0000 7f4087e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408015bf50 0x7f4080153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.426+0000 7f4087e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f408006ee40 con 0x7f408006f110 2024-09-21T06:03:36.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.426+0000 7f4087e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f408006ecc0 con 0x7f40801405e0 2024-09-21T06:03:36.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.426+0000 7f4086800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408015bf50 0x7f4080153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.427+0000 7feec2000640 1 -- 172.21.15.118:0/2709916252 <== mon.1 v2:172.21.15.149:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) ==== 117+0+0 (secure 0 0 0) 0x7feebc0488a0 con 0x7feecc1508a0 2024-09-21T06:03:36.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.426+0000 7f4086800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408015bf50 0x7f4080153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:55650/0 (socket says 172.21.15.118:55650) 2024-09-21T06:03:36.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.426+0000 7f4086800640 1 -- 172.21.15.118:0/3975649561 learned_addr learned my addr 172.21.15.118:0/3975649561 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.427+0000 7f4084a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 0x7f4080152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.428+0000 7f4087e00640 1 -- 172.21.15.118:0/3975649561 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f40800b3fb0 con 0x7f408015bf50 2024-09-21T06:03:36.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.428+0000 7f4085400640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408006f110 0x7f40801fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.429+0000 7feeb7400640 1 -- 172.21.15.118:0/2709916252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc1508a0 msgr2=0x7feecc0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.429+0000 7feeb7400640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc1508a0 0x7feecc0cc500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feebc02d750 tx=0x7feebc010700 comp rx=0 tx=0).stop 2024-09-21T06:03:36.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.432+0000 7feeb7400640 1 -- 172.21.15.118:0/2709916252 shutdown_connections 2024-09-21T06:03:36.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.432+0000 7feeb7400640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feecc0cca40 0x7feecc1f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.432+0000 7feeb7400640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc1508a0 0x7feecc0cc500 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.432+0000 7feeb7400640 1 --2- 172.21.15.118:0/2709916252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb0004800 0x7feecc1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.432+0000 7feeb7400640 1 -- 172.21.15.118:0/2709916252 >> 172.21.15.118:0/2709916252 conn(0x7feecc0b2940 msgr2=0x7feecc0cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.436+0000 7f4084a00640 1 -- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408015bf50 msgr2=0x7f4080153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.436+0000 7f4084a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408015bf50 0x7f4080153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.436+0000 7f4084a00640 1 -- 172.21.15.118:0/3975649561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408006f110 msgr2=0x7f40801fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.436+0000 7f4084a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408006f110 0x7f40801fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.436+0000 7f4084a00640 1 -- 172.21.15.118:0/3975649561 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4080159d60 con 0x7f40801405e0 2024-09-21T06:03:36.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.438+0000 7f4084a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 0x7f4080152b20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f406c00b440 tx=0x7f406c00b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.433+0000 7fb27a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2740b1870 0x7fb2740c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.439+0000 7fb27a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2740b21c0 0x7fb274158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.439+0000 7f407d600640 1 -- 172.21.15.118:0/3975649561 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c011830 con 0x7f40801405e0 2024-09-21T06:03:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.439+0000 7f407d600640 1 -- 172.21.15.118:0/3975649561 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f406c016070 con 0x7f40801405e0 2024-09-21T06:03:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.439+0000 7f407d600640 1 -- 172.21.15.118:0/3975649561 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c011d60 con 0x7f40801405e0 2024-09-21T06:03:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.439+0000 7fb27a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740d2b20 0x7fb274158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.440+0000 7feeb7400640 1 -- 172.21.15.118:0/2709916252 shutdown_connections 2024-09-21T06:03:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.441+0000 7feeb7400640 1 -- 172.21.15.118:0/2709916252 wait complete. 2024-09-21T06:03:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.441+0000 7fb27a600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740d24b0 con 0x7fb2740b21c0 2024-09-21T06:03:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.441+0000 7fb273400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2740b1870 0x7fb2740c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.441+0000 7fb273400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2740b1870 0x7fb2740c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:55662/0 (socket says 172.21.15.118:55662) 2024-09-21T06:03:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.441+0000 7fb273400640 1 -- 172.21.15.118:0/3674739331 learned_addr learned my addr 172.21.15.118:0/3674739331 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.443+0000 7fb273e00640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740d2b20 0x7fb274158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.443+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb27408dd70 con 0x7fb2740d2b20 2024-09-21T06:03:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.446+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb2740d2630 con 0x7fb2740b1870 2024-09-21T06:03:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.448+0000 7fb272a00640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2740b21c0 0x7fb274158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.439+0000 7f4087e00640 1 -- 172.21.15.118:0/3975649561 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408014e6e0 con 0x7f40801405e0 2024-09-21T06:03:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.447+0000 7f4087e00640 1 -- 172.21.15.118:0/3975649561 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4080154d70 con 0x7f40801405e0 2024-09-21T06:03:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.453+0000 7f407d600640 1 -- 172.21.15.118:0/3975649561 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f406c0035f0 con 0x7f40801405e0 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.450+0000 7fb273400640 1 -- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740d2b20 msgr2=0x7fb274158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.450+0000 7fb273400640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740d2b20 0x7fb274158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.451+0000 7fb273400640 1 -- 172.21.15.118:0/3674739331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2740b21c0 msgr2=0x7fb274158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.451+0000 7fb273400640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2740b21c0 0x7fb274158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.451+0000 7fb273400640 1 -- 172.21.15.118:0/3674739331 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb274158130 con 0x7fb2740b1870 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.453+0000 7fb273400640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2740b1870 0x7fb2740c7e20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb26000c3a0 tx=0x7fb26000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.454+0000 7fb26b400640 1 -- 172.21.15.118:0/3674739331 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260017070 con 0x7fb2740b1870 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.454+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2740ce850 con 0x7fb2740b1870 2024-09-21T06:03:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.455+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb274162580 con 0x7fb2740b1870 2024-09-21T06:03:36.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.455+0000 7fb26b400640 1 -- 172.21.15.118:0/3674739331 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2600052d0 con 0x7fb2740b1870 2024-09-21T06:03:36.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.455+0000 7fb26b400640 1 -- 172.21.15.118:0/3674739331 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260003850 con 0x7fb2740b1870 2024-09-21T06:03:36.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.454+0000 7f4072a00640 1 -- 172.21.15.118:0/3975649561 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40800752c0 con 0x7f40801405e0 2024-09-21T06:03:36.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.459+0000 7f407d600640 1 -- 172.21.15.118:0/3975649561 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f406c01a8d0 con 0x7f40801405e0 2024-09-21T06:03:36.466 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.464+0000 7fb26b400640 1 -- 172.21.15.118:0/3674739331 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb26001a070 con 0x7fb2740b1870 2024-09-21T06:03:36.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.464+0000 7fb26b400640 1 -- 172.21.15.118:0/3674739331 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb26001c440 con 0x7fb2740b1870 2024-09-21T06:03:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.465+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24c005290 con 0x7fb2740b1870 2024-09-21T06:03:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.467+0000 7fdffe200640 1 -- 172.21.15.118:0/3982730600 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff813de80 msgr2=0x7fdff813e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.467+0000 7fdffe200640 1 --2- 172.21.15.118:0/3982730600 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff813de80 0x7fdff813e4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdff00074e0 tx=0x7fdff002b290 comp rx=0 tx=0).stop 2024-09-21T06:03:36.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.467+0000 7fdffe200640 1 -- 172.21.15.118:0/3982730600 shutdown_connections 2024-09-21T06:03:36.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.467+0000 7fdffe200640 1 --2- 172.21.15.118:0/3982730600 >> v2:172.21.15.149:3300/0 conn(0x7fdff806f110 0x7fdff806f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.467+0000 7fdffe200640 1 --2- 172.21.15.118:0/3982730600 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff813de80 0x7fdff813e4d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.467+0000 7fdffe200640 1 -- 172.21.15.118:0/3982730600 >> 172.21.15.118:0/3982730600 conn(0x7fdff80b26f0 msgr2=0x7fdff80b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.468+0000 7fdffe200640 1 -- 172.21.15.118:0/3982730600 shutdown_connections 2024-09-21T06:03:36.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.468+0000 7fdffe200640 1 -- 172.21.15.118:0/3982730600 wait complete. 2024-09-21T06:03:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.470+0000 7fb26b400640 1 -- 172.21.15.118:0/3674739331 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb260021020 con 0x7fb2740b1870 2024-09-21T06:03:36.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.476+0000 7fdffe200640 1 Processor -- start 2024-09-21T06:03:36.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.476+0000 7fdffe200640 1 -- start start 2024-09-21T06:03:36.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.480+0000 7fdffe200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff806f110 0x7fdff815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.480+0000 7fdffe200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdff813de80 0x7fdff813d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.480+0000 7fdff6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff806f110 0x7fdff815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.481+0000 7fdff6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff806f110 0x7fdff815c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:55670/0 (socket says 172.21.15.118:55670) 2024-09-21T06:03:36.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.481+0000 7fdff6a00640 1 -- 172.21.15.118:0/1921865097 learned_addr learned my addr 172.21.15.118:0/1921865097 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.481+0000 7fdffe200640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff81406b0 0x7fdff815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.485+0000 7fdffe200640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80b49d0 con 0x7fdff813de80 2024-09-21T06:03:36.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.485+0000 7fdffe200640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80b4850 con 0x7fdff81406b0 2024-09-21T06:03:36.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.485+0000 7fdffe200640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdff80b4b50 con 0x7fdff806f110 2024-09-21T06:03:36.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.485+0000 7fdff6000640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdff813de80 0x7fdff813d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.486+0000 7fdff7400640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff81406b0 0x7fdff815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.487+0000 7fdff6a00640 1 -- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff81406b0 msgr2=0x7fdff815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.487+0000 7fdff6a00640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff81406b0 0x7fdff815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.487+0000 7fdff6a00640 1 -- 172.21.15.118:0/1921865097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdff813de80 msgr2=0x7fdff813d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.487+0000 7fdff6a00640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdff813de80 0x7fdff813d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.487+0000 7fdff6a00640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff815cce0 con 0x7fdff806f110 2024-09-21T06:03:36.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.488+0000 7fdff6a00640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff806f110 0x7fdff815c7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdff0007600 tx=0x7fdff0003bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.489+0000 7fdfeb400640 1 -- 172.21.15.118:0/1921865097 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0040020 con 0x7fdff806f110 2024-09-21T06:03:36.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.489+0000 7fdffe200640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81f1ef0 con 0x7fdff806f110 2024-09-21T06:03:36.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.490+0000 7fdfeb400640 1 -- 172.21.15.118:0/1921865097 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff000a2d0 con 0x7fdff806f110 2024-09-21T06:03:36.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.490+0000 7fdffe200640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff81f24b0 con 0x7fdff806f110 2024-09-21T06:03:36.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.495+0000 7fdfeb400640 1 -- 172.21.15.118:0/1921865097 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0008b60 con 0x7fdff806f110 2024-09-21T06:03:36.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.483+0000 7f407d600640 1 -- 172.21.15.118:0/3975649561 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f40800752c0 con 0x7f40801405e0 2024-09-21T06:03:36.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.497+0000 7fdfe8c00640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd4005290 con 0x7fdff806f110 2024-09-21T06:03:36.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.497+0000 7fdfeb400640 1 -- 172.21.15.118:0/1921865097 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdff0043020 con 0x7fdff806f110 2024-09-21T06:03:36.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.497+0000 7fdfeb400640 1 -- 172.21.15.118:0/1921865097 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdff0045400 con 0x7fdff806f110 2024-09-21T06:03:36.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.500+0000 7fdfeb400640 1 -- 172.21.15.118:0/1921865097 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdff004a030 con 0x7fdff806f110 2024-09-21T06:03:36.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.520+0000 7ffbe1600640 1 -- 172.21.15.118:0/1392950994 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7ffbc4005580 con 0x7ffbf00d04d0 2024-09-21T06:03:36.527 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.527 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.537+0000 7feca2000640 1 -- 172.21.15.118:0/2225112094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec80003a00 msgr2=0x7fec80003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.537+0000 7feca2000640 1 --2- 172.21.15.118:0/2225112094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec80003a00 0x7fec80003e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec8c008550 tx=0x7fec80005830 comp rx=0 tx=0).stop 2024-09-21T06:03:36.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7feca1600640 1 -- 172.21.15.118:0/2225112094 reap_dead start 2024-09-21T06:03:36.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7ff5e4600640 1 -- 172.21.15.118:0/3298351159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d40504d0 msgr2=0x7ff5d40508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7ff5e4600640 1 --2- 172.21.15.118:0/3298351159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d40504d0 0x7ff5d40508e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40372d0 tx=0x7ff5c802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7feca2000640 1 -- 172.21.15.118:0/2225112094 shutdown_connections 2024-09-21T06:03:36.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7feca2000640 1 -- 172.21.15.118:0/2225112094 >> 172.21.15.118:0/2225112094 conn(0x7fec9c06d320 msgr2=0x7fec9c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7feca2000640 1 -- 172.21.15.118:0/2225112094 shutdown_connections 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7ff5e4600640 1 -- 172.21.15.118:0/3298351159 shutdown_connections 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7ff5e4600640 1 --2- 172.21.15.118:0/3298351159 >> v2:172.21.15.118:3300/0 conn(0x7ff5d40312b0 0x7ff5d40316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7ff5e4600640 1 --2- 172.21.15.118:0/3298351159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d40504d0 0x7ff5d40508e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.540+0000 7ff5e4600640 1 --2- 172.21.15.118:0/3298351159 >> v2:172.21.15.149:3300/0 conn(0x7ff5d40df3d0 0x7ff5d4034420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.541+0000 7ff5e4600640 1 -- 172.21.15.118:0/3298351159 >> 172.21.15.118:0/3298351159 conn(0x7ff5d401d9c0 msgr2=0x7ff5d4039680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.541+0000 7ff5e4600640 1 -- 172.21.15.118:0/3298351159 shutdown_connections 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.541+0000 7ff5e4600640 1 -- 172.21.15.118:0/3298351159 wait complete. 2024-09-21T06:03:36.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.541+0000 7feca2000640 1 -- 172.21.15.118:0/2225112094 wait complete. 2024-09-21T06:03:36.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.547+0000 7ffbe3e00640 1 -- 172.21.15.118:0/1392950994 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7ffbe8020060 con 0x7ffbf00d04d0 2024-09-21T06:03:36.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.549+0000 7ff5e4600640 1 Processor -- start 2024-09-21T06:03:36.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.549+0000 7ff5e4600640 1 -- start start 2024-09-21T06:03:36.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbf00d04d0 msgr2=0x7ffbf01fd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbf00d04d0 0x7ffbf01fd6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800c730 tx=0x7ffbe800cbf0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 shutdown_connections 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbf00d04d0 0x7ffbf01fd6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbf0074300 0x7ffbf0143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 --2- 172.21.15.118:0/1392950994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbf006f200 0x7ffbf01e1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 >> 172.21.15.118:0/1392950994 conn(0x7ffbf00b26f0 msgr2=0x7ffbf01599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7fd77a600640 1 -- 172.21.15.118:0/426043092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7740d0520 msgr2=0x7fd77415f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7fd77a600640 1 --2- 172.21.15.118:0/426043092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7740d0520 0x7fd77415f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd76c005fd0 tx=0x7fd76c02a940 comp rx=0 tx=0).stop 2024-09-21T06:03:36.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 shutdown_connections 2024-09-21T06:03:36.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.550+0000 7ffbf7200640 1 -- 172.21.15.118:0/1392950994 wait complete. 2024-09-21T06:03:36.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.551+0000 7feca2000640 1 Processor -- start 2024-09-21T06:03:36.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.551+0000 7feca2000640 1 -- start start 2024-09-21T06:03:36.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.552+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f076c074e20 con 0x7f076c150040 2024-09-21T06:03:36.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.561+0000 7fd77a600640 1 -- 172.21.15.118:0/426043092 shutdown_connections 2024-09-21T06:03:36.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.561+0000 7fd77a600640 1 --2- 172.21.15.118:0/426043092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7740d0520 0x7fd77415f250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.561+0000 7fd77a600640 1 -- 172.21.15.118:0/426043092 >> 172.21.15.118:0/426043092 conn(0x7fd7740d4c10 msgr2=0x7fd7740d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.561+0000 7fd77a600640 1 -- 172.21.15.118:0/426043092 shutdown_connections 2024-09-21T06:03:36.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.561+0000 7fd77a600640 1 -- 172.21.15.118:0/426043092 wait complete. 2024-09-21T06:03:36.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.565+0000 7ff5e4600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d40312b0 0x7ff5d40c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.566+0000 7ff5e4600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d40504d0 0x7ff5d4049fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.566+0000 7ff5e4600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d40df3d0 0x7ff5d40d3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.566+0000 7ff5e4600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d4005c20 con 0x7ff5d40df3d0 2024-09-21T06:03:36.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.566+0000 7ff5e4600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d4039fa0 con 0x7ff5d40504d0 2024-09-21T06:03:36.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.566+0000 7ff5e4600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d4005da0 con 0x7ff5d40312b0 2024-09-21T06:03:36.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.567+0000 7f160b400640 1 -- 172.21.15.118:0/981586097 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604031660 con 0x7f160c15f610 2024-09-21T06:03:36.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.569+0000 7f1613800640 1 -- 172.21.15.118:0/981586097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 msgr2=0x7f160c15fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.569+0000 7f1613800640 1 --2- 172.21.15.118:0/981586097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 0x7f160c15fa20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1604005fd0 tx=0x7f160402a8d0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.567+0000 7feca2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec80003a00 0x7fec9c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.568+0000 7feca2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c14c330 0x7fec9c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.568+0000 7feca2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec9c0cf680 0x7fec9c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.568+0000 7feca2000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c15f850 con 0x7fec80003a00 2024-09-21T06:03:36.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.568+0000 7feca2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c06ff00 con 0x7fec9c14c330 2024-09-21T06:03:36.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.570+0000 7fd77a600640 1 Processor -- start 2024-09-21T06:03:36.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.570+0000 7fd77a600640 1 -- start start 2024-09-21T06:03:36.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.571+0000 7fec9be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c14c330 0x7fec9c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.571+0000 7fec9be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c14c330 0x7fec9c0cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53722/0 (socket says 172.21.15.118:53722) 2024-09-21T06:03:36.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.571+0000 7fec9be00640 1 -- 172.21.15.118:0/2423350587 learned_addr learned my addr 172.21.15.118:0/2423350587 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.571+0000 7feca1600640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec9c0cf680 0x7fec9c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.571+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec9c073590 con 0x7fec9c0cf680 2024-09-21T06:03:36.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.572+0000 7f0768c00640 1 -- 172.21.15.118:0/1512987678 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f076c0cd420 con 0x7f076c150040 2024-09-21T06:03:36.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.572+0000 7feca0c00640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec80003a00 0x7fec9c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.572+0000 7ff5e1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d40504d0 0x7ff5d4049fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.572+0000 7ff5e1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d40504d0 0x7ff5d4049fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53712/0 (socket says 172.21.15.118:53712) 2024-09-21T06:03:36.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.572+0000 7ff5e1200640 1 -- 172.21.15.118:0/4073556848 learned_addr learned my addr 172.21.15.118:0/4073556848 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.572+0000 7ff5e2600640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d40df3d0 0x7ff5d40d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.573+0000 7ff5e1200640 1 -- 172.21.15.118:0/4073556848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d40312b0 msgr2=0x7ff5d40c9670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:03:36.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.573+0000 7ff5e1200640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d40312b0 0x7ff5d40c9670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.573+0000 7ff5e1200640 1 -- 172.21.15.118:0/4073556848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d40df3d0 msgr2=0x7ff5d40d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.573+0000 7ff5e1200640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d40df3d0 0x7ff5d40d3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.573+0000 7ff5e1200640 1 -- 172.21.15.118:0/4073556848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d404b000 con 0x7ff5d40504d0 2024-09-21T06:03:36.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.573+0000 7ff5e2600640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d40df3d0 0x7ff5d40d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:36.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.574+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076c150040 msgr2=0x7f076c1510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.574+0000 7f0772600640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076c150040 0x7f076c1510a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f076c0cd970 tx=0x7f0764004a30 comp rx=0 tx=0).stop 2024-09-21T06:03:36.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.574+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 shutdown_connections 2024-09-21T06:03:36.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.575+0000 7f0772600640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076c150040 0x7f076c1510a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.575+0000 7f0772600640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076c14fc30 0x7f076c1f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.575+0000 7f0772600640 1 --2- 172.21.15.118:0/1512987678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0754005350 0x7f076c1f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.576+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 >> 172.21.15.118:0/1512987678 conn(0x7f076c06d6e0 msgr2=0x7f076c0b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.577+0000 7feca1600640 1 -- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c14c330 msgr2=0x7fec9c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.577+0000 7feca1600640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c14c330 0x7fec9c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.577+0000 7feca1600640 1 -- 172.21.15.118:0/2423350587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec80003a00 msgr2=0x7fec9c14e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.577+0000 7feca1600640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec80003a00 0x7fec9c14e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.577+0000 7feca1600640 1 -- 172.21.15.118:0/2423350587 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c159300 con 0x7fec9c0cf680 2024-09-21T06:03:36.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.578+0000 7fec9be00640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c14c330 0x7fec9c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:36.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.578+0000 7fd77a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77406cf00 0x7fd7740c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.578+0000 7ff5e1200640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d40504d0 0x7ff5d4049fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c940 tx=0x7ff5d000ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7fd77a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7740d27e0 0x7fd77414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7feca1600640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec9c0cf680 0x7fec9c153a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec80004780 tx=0x7fec9400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7feca0c00640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec80003a00 0x7fec9c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 shutdown_connections 2024-09-21T06:03:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7f0772600640 1 -- 172.21.15.118:0/1512987678 wait complete. 2024-09-21T06:03:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7fd77a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77414d140 0x7fd7740ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7fd77a600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7740d4190 con 0x7fd77406cf00 2024-09-21T06:03:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7fd779200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77406cf00 0x7fd7740c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7fd779200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77406cf00 0x7fd7740c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56328/0 (socket says 172.21.15.118:56328) 2024-09-21T06:03:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7fd77a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd7740d4010 con 0x7fd77414d140 2024-09-21T06:03:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7fd77a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd7740d4310 con 0x7fd7740d27e0 2024-09-21T06:03:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.579+0000 7fec98c00640 1 -- 172.21.15.118:0/2423350587 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94004b20 con 0x7fec9c0cf680 2024-09-21T06:03:36.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7fd779200640 1 -- 172.21.15.118:0/474923904 learned_addr learned my addr 172.21.15.118:0/474923904 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9c14db40 con 0x7fec9c0cf680 2024-09-21T06:03:36.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9c14e100 con 0x7fec9c0cf680 2024-09-21T06:03:36.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7fec98c00640 1 -- 172.21.15.118:0/2423350587 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec94004db0 con 0x7fec9c0cf680 2024-09-21T06:03:36.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7fec98c00640 1 -- 172.21.15.118:0/2423350587 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9400cd90 con 0x7fec9c0cf680 2024-09-21T06:03:36.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7fd773e00640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7740d27e0 0x7fd77414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.581+0000 7fd779c00640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77414d140 0x7fd7740ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.583+0000 7fd779c00640 1 -- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7740d27e0 msgr2=0x7fd77414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.583+0000 7fd779c00640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7740d27e0 0x7fd77414cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.580+0000 7ff5d9600640 1 -- 172.21.15.118:0/4073556848 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0007bb0 con 0x7ff5d40504d0 2024-09-21T06:03:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.583+0000 7fd779c00640 1 -- 172.21.15.118:0/474923904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77406cf00 msgr2=0x7fd7740c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.584+0000 7ff5d9600640 1 -- 172.21.15.118:0/4073556848 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5d0007e40 con 0x7ff5d40504d0 2024-09-21T06:03:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.584+0000 7ff5d9600640 1 -- 172.21.15.118:0/4073556848 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000f670 con 0x7ff5d40504d0 2024-09-21T06:03:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.584+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d40d4dd0 con 0x7ff5d40504d0 2024-09-21T06:03:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.584+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d4053e20 con 0x7ff5d40504d0 2024-09-21T06:03:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.584+0000 7fd779c00640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77406cf00 0x7fd7740c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.584+0000 7fd779c00640 1 -- 172.21.15.118:0/474923904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7740c98f0 con 0x7fd77414d140 2024-09-21T06:03:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.582+0000 7fec98c00640 1 -- 172.21.15.118:0/2423350587 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fec9401b020 con 0x7fec9c0cf680 2024-09-21T06:03:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.585+0000 7fec98c00640 1 -- 172.21.15.118:0/2423350587 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fec9401da20 con 0x7fec9c0cf680 2024-09-21T06:03:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.584+0000 7fd779200640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77406cf00 0x7fd7740c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.585+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec74005290 con 0x7fec9c0cf680 2024-09-21T06:03:36.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.585+0000 7fd779c00640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77414d140 0x7fd7740ca910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009000 tx=0x7fd76c0045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.586+0000 7fd770c00640 1 -- 172.21.15.118:0/474923904 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c03e070 con 0x7fd77414d140 2024-09-21T06:03:36.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.586+0000 7fd770c00640 1 -- 172.21.15.118:0/474923904 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd76c043750 con 0x7fd77414d140 2024-09-21T06:03:36.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.588+0000 7f1613800640 1 -- 172.21.15.118:0/981586097 shutdown_connections 2024-09-21T06:03:36.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.588+0000 7f1613800640 1 --2- 172.21.15.118:0/981586097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 0x7f160c15fa20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.588+0000 7f1613800640 1 -- 172.21.15.118:0/981586097 >> 172.21.15.118:0/981586097 conn(0x7f160c071070 msgr2=0x7f160c071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.586+0000 7fd770c00640 1 -- 172.21.15.118:0/474923904 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c043b80 con 0x7fd77414d140 2024-09-21T06:03:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.591+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7740c9bd0 con 0x7fd77414d140 2024-09-21T06:03:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.591+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77414d550 con 0x7fd77414d140 2024-09-21T06:03:36.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.592+0000 7fec98c00640 1 -- 172.21.15.118:0/2423350587 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fec9401d410 con 0x7fec9c0cf680 2024-09-21T06:03:36.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.593+0000 7ff5d9600640 1 -- 172.21.15.118:0/4073556848 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff5d000f810 con 0x7ff5d40504d0 2024-09-21T06:03:36.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.593+0000 7ff5d9600640 1 -- 172.21.15.118:0/4073556848 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff5d0021730 con 0x7ff5d40504d0 2024-09-21T06:03:36.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.593+0000 7f1613800640 1 -- 172.21.15.118:0/981586097 shutdown_connections 2024-09-21T06:03:36.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.593+0000 7f1613800640 1 -- 172.21.15.118:0/981586097 wait complete. 2024-09-21T06:03:36.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.597+0000 7fd770c00640 1 -- 172.21.15.118:0/474923904 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd76c03a440 con 0x7fd77414d140 2024-09-21T06:03:36.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.594+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d40508e0 con 0x7ff5d40504d0 2024-09-21T06:03:36.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.598+0000 7fd770c00640 1 -- 172.21.15.118:0/474923904 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd76c0308b0 con 0x7fd77414d140 2024-09-21T06:03:36.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.599+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7740ca0f0 con 0x7fd77414d140 2024-09-21T06:03:36.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.601+0000 7ff5d9600640 1 -- 172.21.15.118:0/4073556848 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff5d0026020 con 0x7ff5d40504d0 2024-09-21T06:03:36.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.602+0000 7fe40e400640 1 -- 172.21.15.118:0/2061091914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408070b60 msgr2=0x7fe4080af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.603+0000 7fe40e400640 1 --2- 172.21.15.118:0/2061091914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408070b60 0x7fe4080af890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8005fd0 tx=0x7fe3f802a820 comp rx=0 tx=0).stop 2024-09-21T06:03:36.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.603+0000 7fd770c00640 1 -- 172.21.15.118:0/474923904 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd7740ca0f0 con 0x7fd77414d140 2024-09-21T06:03:36.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.608+0000 7f1613800640 1 Processor -- start 2024-09-21T06:03:36.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.610+0000 7fe40e400640 1 -- 172.21.15.118:0/2061091914 shutdown_connections 2024-09-21T06:03:36.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.610+0000 7fe40e400640 1 --2- 172.21.15.118:0/2061091914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4080afdd0 0x7fe40806ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.610+0000 7fe40e400640 1 --2- 172.21.15.118:0/2061091914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408070b60 0x7fe4080af890 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8005fd0 tx=0x7fe3f802a820 comp rx=0 tx=0).stop 2024-09-21T06:03:36.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.610+0000 7fe40e400640 1 -- 172.21.15.118:0/2061091914 >> 172.21.15.118:0/2061091914 conn(0x7fe4080d07b0 msgr2=0x7fe4080d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.610+0000 7f1613800640 1 -- start start 2024-09-21T06:03:36.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.616+0000 7fe40e400640 1 -- 172.21.15.118:0/2061091914 shutdown_connections 2024-09-21T06:03:36.625 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.625 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.623+0000 7f1613800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160c0b4830 0x7f160c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.623+0000 7f1613800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f160c0ccb20 0x7f160c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.623+0000 7f1610e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160c0b4830 0x7f160c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.623+0000 7f1610e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160c0b4830 0x7f160c1413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53754/0 (socket says 172.21.15.118:53754) 2024-09-21T06:03:36.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.624+0000 7f1610e00640 1 -- 172.21.15.118:0/1089580870 learned_addr learned my addr 172.21.15.118:0/1089580870 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.624+0000 7f160be00640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f160c0ccb20 0x7f160c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.624+0000 7f1613800640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 0x7f160c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.616+0000 7fe40e400640 1 -- 172.21.15.118:0/2061091914 wait complete. 2024-09-21T06:03:36.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.626+0000 7fe40e400640 1 Processor -- start 2024-09-21T06:03:36.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.626+0000 7f1611800640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 0x7f160c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.626+0000 7f5496400640 1 -- 172.21.15.118:0/3210256746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f548800b580 msgr2=0x7f54880364f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.626+0000 7f5496400640 1 --2- 172.21.15.118:0/3210256746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f548800b580 0x7f54880364f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f549006b950 tx=0x7f54900aac70 comp rx=0 tx=0).stop 2024-09-21T06:03:36.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.627+0000 7fe40e400640 1 -- start start 2024-09-21T06:03:36.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f5496400640 1 -- 172.21.15.118:0/3210256746 shutdown_connections 2024-09-21T06:03:36.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f5496400640 1 --2- 172.21.15.118:0/3210256746 >> v2:172.21.15.118:3300/0 conn(0x7f5488036a30 0x7f5488006cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f5496400640 1 --2- 172.21.15.118:0/3210256746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f548800b580 0x7f54880364f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f5496400640 1 -- 172.21.15.118:0/3210256746 >> 172.21.15.118:0/3210256746 conn(0x7f5488051450 msgr2=0x7f5488051890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f160c147210 con 0x7f160c15f610 2024-09-21T06:03:36.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f160c147090 con 0x7f160c0b4830 2024-09-21T06:03:36.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f160c147390 con 0x7f160c0ccb20 2024-09-21T06:03:36.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f160be00640 1 -- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160c0b4830 msgr2=0x7f160c1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f160be00640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160c0b4830 0x7f160c1413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f160be00640 1 -- 172.21.15.118:0/1089580870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 msgr2=0x7f160c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f160be00640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 0x7f160c0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.629+0000 7f160be00640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c1fb2f0 con 0x7f160c0ccb20 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.630+0000 7f160be00640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f160c0ccb20 0x7f160c15c980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f15f800b460 tx=0x7f15f800b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.630+0000 7f1608c00640 1 -- 172.21.15.118:0/1089580870 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8015020 con 0x7f160c0ccb20 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.630+0000 7f1608c00640 1 -- 172.21.15.118:0/1089580870 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15f8011940 con 0x7f160c0ccb20 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.630+0000 7f1608c00640 1 -- 172.21.15.118:0/1089580870 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8011d90 con 0x7f160c0ccb20 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.630+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c15cec0 con 0x7f160c0ccb20 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.630+0000 7f1611800640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 0x7f160c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:36.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.630+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c142000 con 0x7f160c0ccb20 2024-09-21T06:03:36.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.633+0000 7f5496400640 1 -- 172.21.15.118:0/3210256746 shutdown_connections 2024-09-21T06:03:36.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.633+0000 7f5496400640 1 -- 172.21.15.118:0/3210256746 wait complete. 2024-09-21T06:03:36.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.637+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e4005290 con 0x7f160c0ccb20 2024-09-21T06:03:36.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.637+0000 7f1608c00640 1 -- 172.21.15.118:0/1089580870 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f15f8018020 con 0x7f160c0ccb20 2024-09-21T06:03:36.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.637+0000 7f1608c00640 1 -- 172.21.15.118:0/1089580870 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f15f8019840 con 0x7f160c0ccb20 2024-09-21T06:03:36.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.641+0000 7f1608c00640 1 -- 172.21.15.118:0/1089580870 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f15f801f020 con 0x7f160c0ccb20 2024-09-21T06:03:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.641+0000 7fe40e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4080afdd0 0x7fe4081ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.646+0000 7fe40e400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe408151f10 0x7fe408202760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.646+0000 7fe40e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408202ca0 0x7fe408150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fe40e400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe40806f3a0 con 0x7fe408151f10 2024-09-21T06:03:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fe40e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe40806f220 con 0x7fe408202ca0 2024-09-21T06:03:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fe40e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe40815b590 con 0x7fe4080afdd0 2024-09-21T06:03:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fe40da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408202ca0 0x7fe408150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fe40da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408202ca0 0x7fe408150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53772/0 (socket says 172.21.15.118:53772) 2024-09-21T06:03:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fe40da00640 1 -- 172.21.15.118:0/896505453 learned_addr learned my addr 172.21.15.118:0/896505453 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fe40d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4080afdd0 0x7fe4081ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fde01e00640 1 -- 172.21.15.118:0/191688804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde0004800 msgr2=0x7fdde0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fde01e00640 1 --2- 172.21.15.118:0/191688804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdde0004800 0x7fdde0004c10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0d09c0 tx=0x7fdde0005830 comp rx=0 tx=0).stop 2024-09-21T06:03:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.647+0000 7fddfb400640 1 -- 172.21.15.118:0/191688804 reap_dead start 2024-09-21T06:03:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.648+0000 7fde01e00640 1 -- 172.21.15.118:0/191688804 shutdown_connections 2024-09-21T06:03:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.648+0000 7fde01e00640 1 -- 172.21.15.118:0/191688804 >> 172.21.15.118:0/191688804 conn(0x7fddfc0b2940 msgr2=0x7fddfc0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.648+0000 7fde01e00640 1 -- 172.21.15.118:0/191688804 shutdown_connections 2024-09-21T06:03:36.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.652+0000 7fde01e00640 1 -- 172.21.15.118:0/191688804 wait complete. 2024-09-21T06:03:36.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.652+0000 7f5496400640 1 Processor -- start 2024-09-21T06:03:36.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.652+0000 7f5496400640 1 -- start start 2024-09-21T06:03:36.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.652+0000 7fe407e00640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe408151f10 0x7fe408202760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.653+0000 7fe407e00640 1 -- 172.21.15.118:0/896505453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4080afdd0 msgr2=0x7fe4081ffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.653+0000 7fe407e00640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4080afdd0 0x7fe4081ffc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.653+0000 7fe407e00640 1 -- 172.21.15.118:0/896505453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408202ca0 msgr2=0x7fe408150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.653+0000 7fe407e00640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408202ca0 0x7fe408150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.653+0000 7fe407e00640 1 -- 172.21.15.118:0/896505453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe408203aa0 con 0x7fe408151f10 2024-09-21T06:03:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.653+0000 7fe40d000640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4080afdd0 0x7fe4081ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:36.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.653+0000 7fe407e00640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe408151f10 0x7fe408202760 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009000 tx=0x7fe3f8032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.654+0000 7fe404c00640 1 -- 172.21.15.118:0/896505453 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8042020 con 0x7fe408151f10 2024-09-21T06:03:36.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.654+0000 7fe404c00640 1 -- 172.21.15.118:0/896505453 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3f8004250 con 0x7fe408151f10 2024-09-21T06:03:36.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.654+0000 7fe404c00640 1 -- 172.21.15.118:0/896505453 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8042020 con 0x7fe408151f10 2024-09-21T06:03:36.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.659+0000 7fe40e400640 1 -- 172.21.15.118:0/896505453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe408203500 con 0x7fe408151f10 2024-09-21T06:03:36.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.659+0000 7fe40e400640 1 -- 172.21.15.118:0/896505453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4082055e0 con 0x7fe408151f10 2024-09-21T06:03:36.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.661+0000 7fde01e00640 1 Processor -- start 2024-09-21T06:03:36.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.664+0000 7fe404c00640 1 -- 172.21.15.118:0/896505453 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe3f8045020 con 0x7fe408151f10 2024-09-21T06:03:36.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.664+0000 7fe404c00640 1 -- 172.21.15.118:0/896505453 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe3f802f070 con 0x7fe408151f10 2024-09-21T06:03:36.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.661+0000 7fde01e00640 1 -- start start 2024-09-21T06:03:36.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.665+0000 7f5496400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f548800b580 0x7f54880db950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.665+0000 7f5496400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5488036a30 0x7f5488179060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.665+0000 7fde01e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdde0004800 0x7fddfc1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.666+0000 7f5496400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54880dc130 0x7f54881795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.666+0000 7fde01e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc158a00 0x7fddfc0aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.667+0000 7fddfa000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc158a00 0x7fddfc0aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.667+0000 7fddfa000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc158a00 0x7fddfc0aa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56370/0 (socket says 172.21.15.118:56370) 2024-09-21T06:03:36.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.666+0000 7f548f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f548800b580 0x7f54880db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.667+0000 7fdfe8c00640 1 -- 172.21.15.118:0/1921865097 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fdfd4005580 con 0x7fdff806f110 2024-09-21T06:03:36.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.666+0000 7f548f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f548800b580 0x7f54880db950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:55786/0 (socket says 172.21.15.118:55786) 2024-09-21T06:03:36.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.666+0000 7f548fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54880dc130 0x7f54881795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.666+0000 7f548ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5488036a30 0x7f5488179060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.666+0000 7f548ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5488036a30 0x7f5488179060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56358/0 (socket says 172.21.15.118:56358) 2024-09-21T06:03:36.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.667+0000 7f548fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54880dc130 0x7f54881795a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53802/0 (socket says 172.21.15.118:53802) 2024-09-21T06:03:36.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.668+0000 7f548f400640 1 -- 172.21.15.118:0/1815195713 learned_addr learned my addr 172.21.15.118:0/1815195713 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.668+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f54880073b0 con 0x7f5488036a30 2024-09-21T06:03:36.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.669+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5488007230 con 0x7f54880dc130 2024-09-21T06:03:36.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.669+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5488007530 con 0x7f548800b580 2024-09-21T06:03:36.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7fddfa000640 1 -- 172.21.15.118:0/1040215951 learned_addr learned my addr 172.21.15.118:0/1040215951 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7fde01e00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddfc157b20 0x7fddfc0aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7fddfaa00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdde0004800 0x7fddfc1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc073b30 con 0x7fddfc158a00 2024-09-21T06:03:36.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc0739b0 con 0x7fdde0004800 2024-09-21T06:03:36.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fddfc073cb0 con 0x7fddfc157b20 2024-09-21T06:03:36.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.671+0000 7fddfb400640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddfc157b20 0x7fddfc0aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.667+0000 7fe3fe000640 1 -- 172.21.15.118:0/896505453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe408203270 con 0x7fe408151f10 2024-09-21T06:03:36.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.669+0000 7f548fe00640 1 -- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f548800b580 msgr2=0x7f54880db950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.669+0000 7f548fe00640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f548800b580 0x7f54880db950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.669+0000 7f548fe00640 1 -- 172.21.15.118:0/1815195713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5488036a30 msgr2=0x7f5488179060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.669+0000 7f548fe00640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5488036a30 0x7f5488179060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.669+0000 7f548fe00640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54880df370 con 0x7f54880dc130 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7f548ea00640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5488036a30 0x7f5488179060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7f548fe00640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54880dc130 0x7f54881795a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548400b360 tx=0x7f548400b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.670+0000 7f548f400640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f548800b580 0x7f54880db950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.671+0000 7fddfaa00640 1 -- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddfc157b20 msgr2=0x7fddfc0aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.671+0000 7fddfaa00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddfc157b20 0x7fddfc0aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.671+0000 7fddfaa00640 1 -- 172.21.15.118:0/1040215951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc158a00 msgr2=0x7fddfc0aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.672+0000 7fddfaa00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc158a00 0x7fddfc0aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.672+0000 7fddfaa00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc159490 con 0x7fdde0004800 2024-09-21T06:03:36.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.674+0000 7f5483400640 1 -- 172.21.15.118:0/1815195713 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484015020 con 0x7f54880dc130 2024-09-21T06:03:36.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.674+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548804cb30 con 0x7f54880dc130 2024-09-21T06:03:36.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.674+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548804cdd0 con 0x7f54880dc130 2024-09-21T06:03:36.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.676+0000 7fddfaa00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdde0004800 0x7fddfc1434e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0721c0 tx=0x7fddec00b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.676+0000 7fddf3400640 1 -- 172.21.15.118:0/1040215951 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec003d80 con 0x7fdde0004800 2024-09-21T06:03:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.676+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc1f1380 con 0x7fdde0004800 2024-09-21T06:03:36.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.677+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddfc159e80 con 0x7fdde0004800 2024-09-21T06:03:36.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.677+0000 7fe404c00640 1 -- 172.21.15.118:0/896505453 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe3f804c030 con 0x7fe408151f10 2024-09-21T06:03:36.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.678+0000 7fddf3400640 1 -- 172.21.15.118:0/1040215951 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddec01d070 con 0x7fdde0004800 2024-09-21T06:03:36.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.678+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddfc1f1550 con 0x7fdde0004800 2024-09-21T06:03:36.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.678+0000 7fddf3400640 1 -- 172.21.15.118:0/1040215951 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec003d80 con 0x7fdde0004800 2024-09-21T06:03:36.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.677+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5488179e70 con 0x7f54880dc130 2024-09-21T06:03:36.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.680+0000 7f5483400640 1 -- 172.21.15.118:0/1815195713 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54840119e0 con 0x7f54880dc130 2024-09-21T06:03:36.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.680+0000 7f5483400640 1 -- 172.21.15.118:0/1815195713 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484015020 con 0x7f54880dc130 2024-09-21T06:03:36.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.680+0000 7f5483400640 1 -- 172.21.15.118:0/1815195713 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5484018020 con 0x7f54880dc130 2024-09-21T06:03:36.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.680+0000 7f5483400640 1 -- 172.21.15.118:0/1815195713 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f548401a6b0 con 0x7f54880dc130 2024-09-21T06:03:36.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.683+0000 7fddf3400640 1 -- 172.21.15.118:0/1040215951 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fddec017070 con 0x7fdde0004800 2024-09-21T06:03:36.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.683+0000 7fddf3400640 1 -- 172.21.15.118:0/1040215951 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fddec022590 con 0x7fdde0004800 2024-09-21T06:03:36.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.683+0000 7f5483400640 1 -- 172.21.15.118:0/1815195713 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f548401f020 con 0x7f54880dc130 2024-09-21T06:03:36.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.685+0000 7fddf3400640 1 -- 172.21.15.118:0/1040215951 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fddec015040 con 0x7fdde0004800 2024-09-21T06:03:36.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.688+0000 7f4072a00640 1 -- 172.21.15.118:0/3975649561 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f408006f520 con 0x7f40801405e0 2024-09-21T06:03:36.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.696+0000 7fdfeb400640 1 -- 172.21.15.118:0/1921865097 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v12)=0 v12) ==== 106+0+0 (secure 0 0 0) 0x7fdff0008df0 con 0x7fdff806f110 2024-09-21T06:03:36.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fb24c005580 con 0x7fb2740b1870 2024-09-21T06:03:36.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 -- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff806f110 msgr2=0x7fdff815c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff806f110 0x7fdff815c7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdff0007600 tx=0x7fdff0003bc0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 -- 172.21.15.118:0/1921865097 shutdown_connections 2024-09-21T06:03:36.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff81406b0 0x7fdff815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdff813de80 0x7fdff813d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 --2- 172.21.15.118:0/1921865097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdff806f110 0x7fdff815c7a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 -- 172.21.15.118:0/1921865097 >> 172.21.15.118:0/1921865097 conn(0x7fdff80b26f0 msgr2=0x7fdff8155260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 -- 172.21.15.118:0/1921865097 shutdown_connections 2024-09-21T06:03:36.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.699+0000 7fdfe8c00640 1 -- 172.21.15.118:0/1921865097 wait complete. 2024-09-21T06:03:36.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.704+0000 7f407d600640 1 -- 172.21.15.118:0/3975649561 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f40800752c0 con 0x7f40801405e0 2024-09-21T06:03:36.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.708+0000 7f4072a00640 1 -- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 msgr2=0x7f4080152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.708+0000 7f4072a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 0x7f4080152b20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f406c00b440 tx=0x7f406c00b900 comp rx=0 tx=0).stop 2024-09-21T06:03:36.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.709+0000 7f16e9600640 1 -- 172.21.15.118:0/1447262017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c8004800 msgr2=0x7f16c8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.709+0000 7f16e9600640 1 --2- 172.21.15.118:0/1447262017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c8004800 0x7f16c8004c10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009a20 tx=0x7f16c8005830 comp rx=0 tx=0).stop 2024-09-21T06:03:36.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.709+0000 7f4072a00640 1 -- 172.21.15.118:0/3975649561 shutdown_connections 2024-09-21T06:03:36.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.710+0000 7f4072a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408015bf50 0x7f4080153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.710+0000 7f4072a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40801405e0 0x7f4080152b20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.710+0000 7f4072a00640 1 --2- 172.21.15.118:0/3975649561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408006f110 0x7f40801fa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.710+0000 7f4072a00640 1 -- 172.21.15.118:0/3975649561 >> 172.21.15.118:0/3975649561 conn(0x7f40800b26f0 msgr2=0x7f4080141700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.710+0000 7f4072a00640 1 -- 172.21.15.118:0/3975649561 shutdown_connections 2024-09-21T06:03:36.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.710+0000 7f4072a00640 1 -- 172.21.15.118:0/3975649561 wait complete. 2024-09-21T06:03:36.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.722+0000 7f16e9600640 1 -- 172.21.15.118:0/1447262017 shutdown_connections 2024-09-21T06:03:36.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.722+0000 7f16e9600640 1 --2- 172.21.15.118:0/1447262017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16c8004800 0x7f16c8004c10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.722+0000 7f16e9600640 1 -- 172.21.15.118:0/1447262017 >> 172.21.15.118:0/1447262017 conn(0x7f16e40b2940 msgr2=0x7f16e40b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.722+0000 7fb26b400640 1 -- 172.21.15.118:0/3674739331 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7fb274158130 con 0x7fb2740b1870 2024-09-21T06:03:36.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.730+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2740b1870 msgr2=0x7fb2740c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.730+0000 7fb27a600640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2740b1870 0x7fb2740c7e20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb26000c3a0 tx=0x7fb26000c860 comp rx=0 tx=0).stop 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.722+0000 7f16e9600640 1 -- 172.21.15.118:0/1447262017 shutdown_connections 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.722+0000 7f16e9600640 1 -- 172.21.15.118:0/1447262017 wait complete. 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.727+0000 7f16e9600640 1 Processor -- start 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.731+0000 7f16e9600640 1 -- start start 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.733+0000 7f16e9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16c8004800 0x7f16e4158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.733+0000 7f16e9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e41594f0 0x7f16e40ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.734+0000 7f16e2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e41594f0 0x7f16e40ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.734+0000 7f16e2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e41594f0 0x7f16e40ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53820/0 (socket says 172.21.15.118:53820) 2024-09-21T06:03:36.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.734+0000 7f16e2000640 1 -- 172.21.15.118:0/691143611 learned_addr learned my addr 172.21.15.118:0/691143611 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.734+0000 7f16e9600640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e40aef00 0x7f16e40ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.734+0000 7f16e2a00640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16c8004800 0x7f16e4158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.735+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4073bb0 con 0x7f16e40aef00 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.735+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4162f60 con 0x7f16e41594f0 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.735+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16e4073d30 con 0x7f16c8004800 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.735+0000 7f16e3400640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e40aef00 0x7f16e40ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.736+0000 7f16e2000640 1 -- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16c8004800 msgr2=0x7f16e4158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.736+0000 7f16e2000640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16c8004800 0x7f16e4158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.736+0000 7f16e2000640 1 -- 172.21.15.118:0/691143611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e40aef00 msgr2=0x7f16e40ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.738+0000 7f16e2000640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e40aef00 0x7f16e40ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.738+0000 7f16e2000640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e415e030 con 0x7f16e41594f0 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.738+0000 7f16e3400640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e40aef00 0x7f16e40ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.739+0000 7f16e2000640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e41594f0 0x7f16e40ad500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000c00 tx=0x7f16d0033a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.740+0000 7fe9c2000640 1 -- 172.21.15.118:0/180163562 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0035020 con 0x7fe9c4159760 2024-09-21T06:03:36.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.742+0000 7fe9c8c00640 1 -- 172.21.15.118:0/180163562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159760 msgr2=0x7fe9c40d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.742+0000 7fe9c8c00640 1 --2- 172.21.15.118:0/180163562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159760 0x7fe9c40d1440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0005fd0 tx=0x7fe9b002a4a0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.742+0000 7fe9c8c00640 1 -- 172.21.15.118:0/180163562 shutdown_connections 2024-09-21T06:03:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.742+0000 7fe9c8c00640 1 --2- 172.21.15.118:0/180163562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c4159760 0x7fe9c40d1440 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.743+0000 7fe9c8c00640 1 -- 172.21.15.118:0/180163562 >> 172.21.15.118:0/180163562 conn(0x7fe9c406d310 msgr2=0x7fe9c406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.744+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 shutdown_connections 2024-09-21T06:03:36.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.744+0000 7fb27a600640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2740d2b20 0x7fb274158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.744+0000 7fb27a600640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2740b21c0 0x7fb274158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.744+0000 7fb27a600640 1 --2- 172.21.15.118:0/3674739331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2740b1870 0x7fb2740c7e20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.744+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 >> 172.21.15.118:0/3674739331 conn(0x7fb2740d1780 msgr2=0x7fb27415ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.744+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 shutdown_connections 2024-09-21T06:03:36.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.744+0000 7fb27a600640 1 -- 172.21.15.118:0/3674739331 wait complete. 2024-09-21T06:03:36.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.747+0000 7fe9c8c00640 1 -- 172.21.15.118:0/180163562 shutdown_connections 2024-09-21T06:03:36.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.747+0000 7fe9c8c00640 1 -- 172.21.15.118:0/180163562 wait complete. 2024-09-21T06:03:36.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.743+0000 7f16daa00640 1 -- 172.21.15.118:0/691143611 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0033d80 con 0x7f16e41594f0 2024-09-21T06:03:36.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.743+0000 7f16daa00640 1 -- 172.21.15.118:0/691143611 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d0033070 con 0x7f16e41594f0 2024-09-21T06:03:36.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.748+0000 7f16daa00640 1 -- 172.21.15.118:0/691143611 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d00334a0 con 0x7f16e41594f0 2024-09-21T06:03:36.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.748+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e415e310 con 0x7f16e41594f0 2024-09-21T06:03:36.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.748+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e415e8d0 con 0x7f16e41594f0 2024-09-21T06:03:36.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.751+0000 7f16daa00640 1 -- 172.21.15.118:0/691143611 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f16d0031600 con 0x7f16e41594f0 2024-09-21T06:03:36.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.751+0000 7f16daa00640 1 -- 172.21.15.118:0/691143611 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16d0003de0 con 0x7f16e41594f0 2024-09-21T06:03:36.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.756+0000 7fe9c8c00640 1 Processor -- start 2024-09-21T06:03:36.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.760+0000 7fe9c8c00640 1 -- start start 2024-09-21T06:03:36.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.754+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e40b3a60 con 0x7f16e41594f0 2024-09-21T06:03:36.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.765+0000 7fe9c8c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c40cfc20 0x7fe9c414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.765+0000 7fe9c8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c40d05a0 0x7fe9c40b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.765+0000 7f16daa00640 1 -- 172.21.15.118:0/691143611 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f16d003f030 con 0x7f16e41594f0 2024-09-21T06:03:36.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.769+0000 7fe9c8c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159760 0x7fe9c40b9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:36.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.769+0000 7fe9c3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c40cfc20 0x7fe9c414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.769+0000 7fe9c3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c40cfc20 0x7fe9c414dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53836/0 (socket says 172.21.15.118:53836) 2024-09-21T06:03:36.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159760 0x7fe9c40b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159760 0x7fe9c40b9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:55828/0 (socket says 172.21.15.118:55828) 2024-09-21T06:03:36.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c8c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40d1d00 con 0x7fe9c40d05a0 2024-09-21T06:03:36.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c8c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40d39a0 con 0x7fe9c40cfc20 2024-09-21T06:03:36.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c8c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c40ceb20 con 0x7fe9c4159760 2024-09-21T06:03:36.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c40d05a0 0x7fe9c40b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:36.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c40d05a0 0x7fe9c40b90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56396/0 (socket says 172.21.15.118:56396) 2024-09-21T06:03:36.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.770+0000 7fe9c3400640 1 -- 172.21.15.118:0/3772616867 learned_addr learned my addr 172.21.15.118:0/3772616867 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:36.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.775+0000 7fe9c3400640 1 -- 172.21.15.118:0/3772616867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159760 msgr2=0x7fe9c40b9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.775+0000 7fe9c3400640 1 --2- 172.21.15.118:0/3772616867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159760 0x7fe9c40b9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.775+0000 7fe9c3400640 1 -- 172.21.15.118:0/3772616867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c40d05a0 msgr2=0x7fe9c40b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.775+0000 7fe9c3400640 1 --2- 172.21.15.118:0/3772616867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c40d05a0 0x7fe9c40b90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.775+0000 7fe9c3400640 1 -- 172.21.15.118:0/3772616867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c40b8630 con 0x7fe9c40cfc20 2024-09-21T06:03:36.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.777+0000 7fe9c3400640 1 --2- 172.21.15.118:0/3772616867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c40cfc20 0x7fe9c414dac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00ba50 tx=0x7fe9bc00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:36.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.777+0000 7fe9bb400640 1 -- 172.21.15.118:0/3772616867 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc019070 con 0x7fe9c40cfc20 2024-09-21T06:03:36.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.777+0000 7fe9bb400640 1 -- 172.21.15.118:0/3772616867 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9bc00cd00 con 0x7fe9c40cfc20 2024-09-21T06:03:36.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.777+0000 7fe9bb400640 1 -- 172.21.15.118:0/3772616867 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0146a0 con 0x7fe9c40cfc20 2024-09-21T06:03:36.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.777+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c41535a0 con 0x7fe9c40cfc20 2024-09-21T06:03:36.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.778+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c40c8420 con 0x7fe9c40cfc20 2024-09-21T06:03:36.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.784+0000 7fe9bb400640 1 -- 172.21.15.118:0/3772616867 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe9bc003970 con 0x7fe9c40cfc20 2024-09-21T06:03:36.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.784+0000 7fe9bb400640 1 -- 172.21.15.118:0/3772616867 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe9bc003c60 con 0x7fe9c40cfc20 2024-09-21T06:03:36.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.789+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c40d1440 con 0x7fe9c40cfc20 2024-09-21T06:03:36.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.794+0000 7fe9bb400640 1 -- 172.21.15.118:0/3772616867 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe9bc0043c0 con 0x7fe9c40cfc20 2024-09-21T06:03:36.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.797+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f15e4005850 con 0x7f160c0ccb20 2024-09-21T06:03:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.801+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7ff5d4049d40 con 0x7ff5d40504d0 2024-09-21T06:03:36.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.808+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fd77415f250 con 0x7fd77414d140 2024-09-21T06:03:36.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.808+0000 7f1608c00640 1 -- 172.21.15.118:0/1089580870 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f15f801f020 con 0x7f160c0ccb20 2024-09-21T06:03:36.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.811+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f160c0ccb20 msgr2=0x7f160c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.811+0000 7f1613800640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f160c0ccb20 0x7f160c15c980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f15f800b460 tx=0x7f15f800b920 comp rx=0 tx=0).stop 2024-09-21T06:03:36.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.812+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 shutdown_connections 2024-09-21T06:03:36.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.812+0000 7f1613800640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f160c15f610 0x7f160c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.812+0000 7f1613800640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f160c0ccb20 0x7f160c15c980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.812+0000 7f1613800640 1 --2- 172.21.15.118:0/1089580870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f160c0b4830 0x7f160c1413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.812+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 >> 172.21.15.118:0/1089580870 conn(0x7f160c071070 msgr2=0x7f160c0cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.812+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 shutdown_connections 2024-09-21T06:03:36.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.812+0000 7f1613800640 1 -- 172.21.15.118:0/1089580870 wait complete. 2024-09-21T06:03:36.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.816+0000 7ff5d9600640 1 -- 172.21.15.118:0/4073556848 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7ff5d0014030 con 0x7ff5d40504d0 2024-09-21T06:03:36.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.824+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d40504d0 msgr2=0x7ff5d4049fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.824+0000 7ff5e4600640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d40504d0 0x7ff5d4049fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c940 tx=0x7ff5d000ce00 comp rx=0 tx=0).stop 2024-09-21T06:03:36.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.824+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fec74005580 con 0x7fec9c0cf680 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.825+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 shutdown_connections 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.825+0000 7ff5e4600640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d40df3d0 0x7ff5d40d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.825+0000 7ff5e4600640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d40504d0 0x7ff5d4049fe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.825+0000 7ff5e4600640 1 --2- 172.21.15.118:0/4073556848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d40312b0 0x7ff5d40c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.825+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 >> 172.21.15.118:0/4073556848 conn(0x7ff5d401d9c0 msgr2=0x7ff5d4039680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.825+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 shutdown_connections 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.825+0000 7ff5e4600640 1 -- 172.21.15.118:0/4073556848 wait complete. 2024-09-21T06:03:36.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.826+0000 7fd770c00640 1 -- 172.21.15.118:0/474923904 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7fd76c051020 con 0x7fd77414d140 2024-09-21T06:03:36.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.828+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77414d140 msgr2=0x7fd7740ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.828+0000 7fd77a600640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77414d140 0x7fd7740ca910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009000 tx=0x7fd76c0045c0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.828+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 shutdown_connections 2024-09-21T06:03:36.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.828+0000 7fd77a600640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77414d140 0x7fd7740ca910 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.828+0000 7fd77a600640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7740d27e0 0x7fd77414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.828+0000 7fd77a600640 1 --2- 172.21.15.118:0/474923904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77406cf00 0x7fd7740c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.828+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 >> 172.21.15.118:0/474923904 conn(0x7fd7740d4c10 msgr2=0x7fd7741611e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.829+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 shutdown_connections 2024-09-21T06:03:36.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.829+0000 7fd77a600640 1 -- 172.21.15.118:0/474923904 wait complete. 2024-09-21T06:03:36.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.838+0000 7fec98c00640 1 -- 172.21.15.118:0/2423350587 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fec94003970 con 0x7fec9c0cf680 2024-09-21T06:03:36.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.843+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f54880364f0 con 0x7f54880dc130 2024-09-21T06:03:36.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.846+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec9c0cf680 msgr2=0x7fec9c153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.846+0000 7feca2000640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec9c0cf680 0x7fec9c153a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec80004780 tx=0x7fec9400eec0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.846+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 shutdown_connections 2024-09-21T06:03:36.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.846+0000 7feca2000640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec9c0cf680 0x7fec9c153a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.846+0000 7feca2000640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c14c330 0x7fec9c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.846+0000 7feca2000640 1 --2- 172.21.15.118:0/2423350587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec80003a00 0x7fec9c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.846+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 >> 172.21.15.118:0/2423350587 conn(0x7fec9c06d320 msgr2=0x7fec9c15b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.849+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 shutdown_connections 2024-09-21T06:03:36.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.849+0000 7feca2000640 1 -- 172.21.15.118:0/2423350587 wait complete. 2024-09-21T06:03:36.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.853+0000 7f5483400640 1 -- 172.21.15.118:0/1815195713 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7f5484005a40 con 0x7f54880dc130 2024-09-21T06:03:36.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.857+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54880dc130 msgr2=0x7f54881795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.857+0000 7f5496400640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54880dc130 0x7f54881795a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548400b360 tx=0x7f548400b820 comp rx=0 tx=0).stop 2024-09-21T06:03:36.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.857+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 shutdown_connections 2024-09-21T06:03:36.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.857+0000 7f5496400640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54880dc130 0x7f54881795a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.857+0000 7f5496400640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5488036a30 0x7f5488179060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.857+0000 7f5496400640 1 --2- 172.21.15.118:0/1815195713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f548800b580 0x7f54880db950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.857+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 >> 172.21.15.118:0/1815195713 conn(0x7f5488051450 msgr2=0x7f548804fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.860+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 shutdown_connections 2024-09-21T06:03:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.860+0000 7f5496400640 1 -- 172.21.15.118:0/1815195713 wait complete. 2024-09-21T06:03:36.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.861+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fddfc15ca00 con 0x7fdde0004800 2024-09-21T06:03:36.868 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.869 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.869 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.877+0000 7fddf3400640 1 -- 172.21.15.118:0/1040215951 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7fddec015040 con 0x7fdde0004800 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdde0004800 msgr2=0x7fddfc1434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdde0004800 0x7fddfc1434e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0721c0 tx=0x7fddec00b730 comp rx=0 tx=0).stop 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 shutdown_connections 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddfc157b20 0x7fddfc0aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc158a00 0x7fddfc0aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 --2- 172.21.15.118:0/1040215951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdde0004800 0x7fddfc1434e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 >> 172.21.15.118:0/1040215951 conn(0x7fddfc0b2940 msgr2=0x7fddfc0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 shutdown_connections 2024-09-21T06:03:36.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.879+0000 7fde01e00640 1 -- 172.21.15.118:0/1040215951 wait complete. 2024-09-21T06:03:36.901 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.903+0000 7fe3fe000640 1 -- 172.21.15.118:0/896505453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fe4080af890 con 0x7fe408151f10 2024-09-21T06:03:36.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.907+0000 7fe404c00640 1 -- 172.21.15.118:0/896505453 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v21)=0 v21) ==== 111+0+0 (secure 0 0 0) 0x7fe3f8032540 con 0x7fe408151f10 2024-09-21T06:03:36.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.908+0000 7fe3fe000640 1 -- 172.21.15.118:0/896505453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe408151f10 msgr2=0x7fe408202760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.908+0000 7fe3fe000640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe408151f10 0x7fe408202760 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009000 tx=0x7fe3f8032d90 comp rx=0 tx=0).stop 2024-09-21T06:03:36.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.909+0000 7fe3fe000640 1 -- 172.21.15.118:0/896505453 shutdown_connections 2024-09-21T06:03:36.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.909+0000 7fe3fe000640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe408202ca0 0x7fe408150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.909+0000 7fe3fe000640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe408151f10 0x7fe408202760 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.909+0000 7fe3fe000640 1 --2- 172.21.15.118:0/896505453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4080afdd0 0x7fe4081ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.909+0000 7fe3fe000640 1 -- 172.21.15.118:0/896505453 >> 172.21.15.118:0/896505453 conn(0x7fe4080d07b0 msgr2=0x7fe4080b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.909+0000 7fe3fe000640 1 -- 172.21.15.118:0/896505453 shutdown_connections 2024-09-21T06:03:36.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.909+0000 7fe3fe000640 1 -- 172.21.15.118:0/896505453 wait complete. 2024-09-21T06:03:36.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.917+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fe9c406d9d0 con 0x7fe9c40cfc20 2024-09-21T06:03:36.922 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.921+0000 7fe9bb400640 1 -- 172.21.15.118:0/3772616867 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fe9bc0045a0 con 0x7fe9c40cfc20 2024-09-21T06:03:36.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c40cfc20 msgr2=0x7fe9c414dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 --2- 172.21.15.118:0/3772616867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c40cfc20 0x7fe9c414dac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00ba50 tx=0x7fe9bc00bf10 comp rx=0 tx=0).stop 2024-09-21T06:03:36.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 shutdown_connections 2024-09-21T06:03:36.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 --2- 172.21.15.118:0/3772616867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9c4159760 0x7fe9c40b9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 --2- 172.21.15.118:0/3772616867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9c40d05a0 0x7fe9c40b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 --2- 172.21.15.118:0/3772616867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9c40cfc20 0x7fe9c414dac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 >> 172.21.15.118:0/3772616867 conn(0x7fe9c406d310 msgr2=0x7fe9c4161470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 shutdown_connections 2024-09-21T06:03:36.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.923+0000 7fe9c8c00640 1 -- 172.21.15.118:0/3772616867 wait complete. 2024-09-21T06:03:36.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.924+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f16e415bf00 con 0x7f16e41594f0 2024-09-21T06:03:36.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.927+0000 7f16daa00640 1 -- 172.21.15.118:0/691143611 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f16d003f030 con 0x7f16e41594f0 2024-09-21T06:03:36.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.928+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e41594f0 msgr2=0x7f16e40ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:36.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.928+0000 7f16e9600640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e41594f0 0x7f16e40ad500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000c00 tx=0x7f16d0033a00 comp rx=0 tx=0).stop 2024-09-21T06:03:36.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.929+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 shutdown_connections 2024-09-21T06:03:36.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.929+0000 7f16e9600640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e40aef00 0x7f16e40ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.929+0000 7f16e9600640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e41594f0 0x7f16e40ad500 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.929+0000 7f16e9600640 1 --2- 172.21.15.118:0/691143611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16c8004800 0x7f16e4158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:36.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.929+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 >> 172.21.15.118:0/691143611 conn(0x7f16e40b2940 msgr2=0x7f16e40b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:36.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.929+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 shutdown_connections 2024-09-21T06:03:36.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:36.929+0000 7f16e9600640 1 -- 172.21.15.118:0/691143611 wait complete. 2024-09-21T06:03:36.940 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.940 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.940 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.960 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.960 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi118') 2024-09-21T06:03:36.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config dump 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 -- 172.21.15.118:0/2270322901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 msgr2=0x7f34800d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 --2- 172.21.15.118:0/2270322901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800d02e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3470005fd0 tx=0x7f347002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 -- 172.21.15.118:0/2270322901 shutdown_connections 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 --2- 172.21.15.118:0/2270322901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3480163900 0x7f348015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 --2- 172.21.15.118:0/2270322901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800d02e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 -- 172.21.15.118:0/2270322901 >> 172.21.15.118:0/2270322901 conn(0x7f348006d1c0 msgr2=0x7f348006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 -- 172.21.15.118:0/2270322901 shutdown_connections 2024-09-21T06:03:37.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.209+0000 7f3485000640 1 -- 172.21.15.118:0/2270322901 wait complete. 2024-09-21T06:03:37.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.212+0000 7f3485000640 1 Processor -- start 2024-09-21T06:03:37.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.212+0000 7f3485000640 1 -- start start 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f3485000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f348015fba0 0x7f34801f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f3485000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f3485000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3480163900 0x7f34800caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f3485000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f34800d3aa0 con 0x7f34801634f0 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f3485000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34800d3920 con 0x7f3480163900 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f3485000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34800d3c20 con 0x7f348015fba0 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f347ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f347ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56416/0 (socket says 172.21.15.118:56416) 2024-09-21T06:03:37.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.213+0000 7f347ea00640 1 -- 172.21.15.118:0/1257688582 learned_addr learned my addr 172.21.15.118:0/1257688582 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:37.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.214+0000 7f347ea00640 1 -- 172.21.15.118:0/1257688582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f348015fba0 msgr2=0x7f34801f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.214+0000 7f347ea00640 1 --2- 172.21.15.118:0/1257688582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f348015fba0 0x7f34801f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.214+0000 7f347ea00640 1 -- 172.21.15.118:0/1257688582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3480163900 msgr2=0x7f34800caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.214+0000 7f347ea00640 1 --2- 172.21.15.118:0/1257688582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3480163900 0x7f34800caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.214+0000 7f347ea00640 1 -- 172.21.15.118:0/1257688582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34800c87c0 con 0x7f34801634f0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.214+0000 7f347ea00640 1 --2- 172.21.15.118:0/1257688582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800c79d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e7c0 tx=0x7f346c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.215+0000 7f3477400640 1 -- 172.21.15.118:0/1257688582 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c00ccc0 con 0x7f34801634f0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.215+0000 7f3477400640 1 -- 172.21.15.118:0/1257688582 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f346c010430 con 0x7f34801634f0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.215+0000 7f3477400640 1 -- 172.21.15.118:0/1257688582 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c010860 con 0x7f34801634f0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.215+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34800c7f10 con 0x7f34801634f0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.215+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34801f6dc0 con 0x7f34801634f0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.215+0000 7f3477400640 1 -- 172.21.15.118:0/1257688582 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f346c010a00 con 0x7f34801634f0 2024-09-21T06:03:37.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.215+0000 7f3477400640 1 -- 172.21.15.118:0/1257688582 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f346c018cc0 con 0x7f34801634f0 2024-09-21T06:03:37.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.216+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34800d5b20 con 0x7f34801634f0 2024-09-21T06:03:37.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.218+0000 7f3477400640 1 -- 172.21.15.118:0/1257688582 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f34800d5b20 con 0x7f34801634f0 2024-09-21T06:03:37.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.281+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f34800d02e0 con 0x7f34801634f0 2024-09-21T06:03:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.281+0000 7f3477400640 1 -- 172.21.15.118:0/1257688582 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f346c018420 con 0x7f34801634f0 2024-09-21T06:03:37.284 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:03:37.284 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:03:37.284 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:03:37.284 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:03:37.284 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:03:37.285 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:03:37.286 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:03:37.286 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:03:37.286 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:03:37.286 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.282+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 msgr2=0x7f34800c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.282+0000 7f3485000640 1 --2- 172.21.15.118:0/1257688582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800c79d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e7c0 tx=0x7f346c00ec80 comp rx=0 tx=0).stop 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.282+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 shutdown_connections 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.282+0000 7f3485000640 1 --2- 172.21.15.118:0/1257688582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3480163900 0x7f34800caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.282+0000 7f3485000640 1 --2- 172.21.15.118:0/1257688582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34801634f0 0x7f34800c79d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.282+0000 7f3485000640 1 --2- 172.21.15.118:0/1257688582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f348015fba0 0x7f34801f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.283+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 >> 172.21.15.118:0/1257688582 conn(0x7f348006d1c0 msgr2=0x7f348015e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.283+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 shutdown_connections 2024-09-21T06:03:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.283+0000 7f3485000640 1 -- 172.21.15.118:0/1257688582 wait complete. 2024-09-21T06:03:37.309 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T06:03:37.309 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 -- 172.21.15.118:0/546718785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c15fba0 msgr2=0x7f882c0d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 --2- 172.21.15.118:0/546718785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c15fba0 0x7f882c0d1330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8824005fd0 tx=0x7f882402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 -- 172.21.15.118:0/546718785 shutdown_connections 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 --2- 172.21.15.118:0/546718785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c15fba0 0x7f882c0d1330 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 --2- 172.21.15.118:0/546718785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882c163900 0x7f882c15f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 -- 172.21.15.118:0/546718785 >> 172.21.15.118:0/546718785 conn(0x7f882c06d1c0 msgr2=0x7f882c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 -- 172.21.15.118:0/546718785 shutdown_connections 2024-09-21T06:03:37.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.521+0000 7f882b200640 1 -- 172.21.15.118:0/546718785 wait complete. 2024-09-21T06:03:37.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.523+0000 7f882b200640 1 Processor -- start 2024-09-21T06:03:37.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.523+0000 7f882b200640 1 -- start start 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882c15fba0 0x7f882c1eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882c1634f0 0x7f882c151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c163900 0x7f882c0b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f882c0d3920 con 0x7f882c163900 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f882c0d1d80 con 0x7f882c1634f0 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f882c0d3aa0 con 0x7f882c15fba0 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c163900 0x7f882c0b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c163900 0x7f882c0b91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56440/0 (socket says 172.21.15.118:56440) 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882a800640 1 -- 172.21.15.118:0/383951730 learned_addr learned my addr 172.21.15.118:0/383951730 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f8829e00640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882c15fba0 0x7f882c1eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f8823e00640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882c1634f0 0x7f882c151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.525+0000 7f882a800640 1 -- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882c15fba0 msgr2=0x7f882c1eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f882a800640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882c15fba0 0x7f882c1eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f882a800640 1 -- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882c1634f0 msgr2=0x7f882c151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f882a800640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882c1634f0 0x7f882c151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f882a800640 1 -- 172.21.15.118:0/383951730 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c1f6c10 con 0x7f882c163900 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f8829e00640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882c15fba0 0x7f882c1eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f882a800640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c163900 0x7f882c0b91f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8824006010 tx=0x7f8824003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f8822000640 1 -- 172.21.15.118:0/383951730 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824031990 con 0x7f882c163900 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f8822000640 1 -- 172.21.15.118:0/383951730 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8824031c20 con 0x7f882c163900 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f8822000640 1 -- 172.21.15.118:0/383951730 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88240330d0 con 0x7f882c163900 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c1e8e40 con 0x7f882c163900 2024-09-21T06:03:37.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c1e9400 con 0x7f882c163900 2024-09-21T06:03:37.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.526+0000 7f8822000640 1 -- 172.21.15.118:0/383951730 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8824033270 con 0x7f882c163900 2024-09-21T06:03:37.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.527+0000 7f8822000640 1 -- 172.21.15.118:0/383951730 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f882403b410 con 0x7f882c163900 2024-09-21T06:03:37.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.527+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c15aea0 con 0x7f882c163900 2024-09-21T06:03:37.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.530+0000 7f8822000640 1 -- 172.21.15.118:0/383951730 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f882404a030 con 0x7f882c163900 2024-09-21T06:03:37.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.595+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f882c0d1330 con 0x7f882c163900 2024-09-21T06:03:37.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.598+0000 7f8822000640 1 -- 172.21.15.118:0/383951730 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f882403f030 con 0x7f882c163900 2024-09-21T06:03:37.600 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2024-09-21T06:03:37.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c163900 msgr2=0x7f882c0b91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:37.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c163900 0x7f882c0b91f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8824006010 tx=0x7f8824003970 comp rx=0 tx=0).stop 2024-09-21T06:03:37.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 shutdown_connections 2024-09-21T06:03:37.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f882c163900 0x7f882c0b91f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882c1634f0 0x7f882c151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 --2- 172.21.15.118:0/383951730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882c15fba0 0x7f882c1eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:37.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 >> 172.21.15.118:0/383951730 conn(0x7f882c06d1c0 msgr2=0x7f882c159190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:37.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 shutdown_connections 2024-09-21T06:03:37.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:37.599+0000 7f882b200640 1 -- 172.21.15.118:0/383951730 wait complete. 2024-09-21T06:03:37.622 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T06:03:37.622 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T06:03:37.622 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:37.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T06:03:37.678 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:37.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T06:03:37.774 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:37.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T06:03:37.870 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:03:37.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T06:03:37.966 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:37.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T06:03:38.024 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:38.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T06:03:38.123 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:38.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T06:03:38.219 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:03:38.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T06:03:38.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2024-09-21T06:03:38.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 -- 172.21.15.149:0/2096362880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80d1d40 msgr2=0x7f21d80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:38.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 --2- 172.21.15.149:0/2096362880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80d1d40 0x7f21d80b34c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f21d80d0d70 tx=0x7f21d002aa30 comp rx=0 tx=0).stop 2024-09-21T06:03:38.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 -- 172.21.15.149:0/2096362880 shutdown_connections 2024-09-21T06:03:38.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 --2- 172.21.15.149:0/2096362880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80d1d40 0x7f21d80b34c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 --2- 172.21.15.149:0/2096362880 >> v2:172.21.15.118:3300/0 conn(0x7f21d81607a0 0x7f21d815cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 -- 172.21.15.149:0/2096362880 >> 172.21.15.149:0/2096362880 conn(0x7f21d806d1c0 msgr2=0x7f21d806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:38.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 -- 172.21.15.149:0/2096362880 shutdown_connections 2024-09-21T06:03:38.578 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.575+0000 7f21dee00640 1 -- 172.21.15.149:0/2096362880 wait complete. 2024-09-21T06:03:38.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.577+0000 7f21dee00640 1 Processor -- start 2024-09-21T06:03:38.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.577+0000 7f21dee00640 1 -- start start 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80cfd10 0x7f21d80ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21d81607a0 0x7f21d815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80abdc0 0x7f21d81f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80b3a00 con 0x7f21d80cfd10 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80d03b0 con 0x7f21d80abdc0 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f21d80b3b80 con 0x7f21d81607a0 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80abdc0 0x7f21d81f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21d81607a0 0x7f21d815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dda00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80cfd10 0x7f21d80ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:38.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80abdc0 0x7f21d81f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33218/0 (socket says 172.21.15.149:33218) 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 -- 172.21.15.149:0/1854022372 learned_addr learned my addr 172.21.15.149:0/1854022372 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 -- 172.21.15.149:0/1854022372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21d81607a0 msgr2=0x7f21d815b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21d81607a0 0x7f21d815b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 -- 172.21.15.149:0/1854022372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80cfd10 msgr2=0x7f21d80ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80cfd10 0x7f21d80ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21de400640 1 -- 172.21.15.149:0/1854022372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d80ab6e0 con 0x7f21d80abdc0 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.579+0000 7f21dda00640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80cfd10 0x7f21d80ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:38.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21de400640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80abdc0 0x7f21d81f95f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009d60 tx=0x7f21d0003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21d5600640 1 -- 172.21.15.149:0/1854022372 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0033050 con 0x7f21d80abdc0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21d5600640 1 -- 172.21.15.149:0/1854022372 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21d0004450 con 0x7f21d80abdc0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d80ab9c0 con 0x7f21d80abdc0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21d5600640 1 -- 172.21.15.149:0/1854022372 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0038450 con 0x7f21d80abdc0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d80cdb30 con 0x7f21d80abdc0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21d5600640 1 -- 172.21.15.149:0/1854022372 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f21d0036070 con 0x7f21d80abdc0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.580+0000 7f21d5600640 1 -- 172.21.15.149:0/1854022372 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f21d004b780 con 0x7f21d80abdc0 2024-09-21T06:03:38.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.581+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d80b7c60 con 0x7f21d80abdc0 2024-09-21T06:03:38.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.584+0000 7f21d5600640 1 -- 172.21.15.149:0/1854022372 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f21d0062860 con 0x7f21d80abdc0 2024-09-21T06:03:38.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.657+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) -- 0x7f21d80b40a0 con 0x7f21d80abdc0 2024-09-21T06:03:38.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.667+0000 7f21d5600640 1 -- 172.21.15.149:0/1854022372 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f21d0050030 con 0x7f21d80abdc0 2024-09-21T06:03:38.669 INFO:teuthology.orchestra.run.smithi149.stdout:0 2024-09-21T06:03:38.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80abdc0 msgr2=0x7f21d81f95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80abdc0 0x7f21d81f95f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009d60 tx=0x7f21d0003f10 comp rx=0 tx=0).stop 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 shutdown_connections 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21d80abdc0 0x7f21d81f95f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21d81607a0 0x7f21d815b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 --2- 172.21.15.149:0/1854022372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d80cfd10 0x7f21d80ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 >> 172.21.15.149:0/1854022372 conn(0x7f21d806d1c0 msgr2=0x7f21d815bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 shutdown_connections 2024-09-21T06:03:38.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.668+0000 7f21dee00640 1 -- 172.21.15.149:0/1854022372 wait complete. 2024-09-21T06:03:38.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2024-09-21T06:03:38.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 -- 172.21.15.149:0/3417435618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 msgr2=0x7ff6ec15f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:38.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 --2- 172.21.15.149:0/3417435618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 0x7ff6ec15f660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009830 tx=0x7ff6d402a510 comp rx=0 tx=0).stop 2024-09-21T06:03:38.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 -- 172.21.15.149:0/3417435618 shutdown_connections 2024-09-21T06:03:38.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 --2- 172.21.15.149:0/3417435618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec15fba0 0x7ff6ec0d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 --2- 172.21.15.149:0/3417435618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 0x7ff6ec15f660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 -- 172.21.15.149:0/3417435618 >> 172.21.15.149:0/3417435618 conn(0x7ff6ec06d1c0 msgr2=0x7ff6ec06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:38.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 -- 172.21.15.149:0/3417435618 shutdown_connections 2024-09-21T06:03:38.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.911+0000 7ff6f0a00640 1 -- 172.21.15.149:0/3417435618 wait complete. 2024-09-21T06:03:38.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.913+0000 7ff6f0a00640 1 Processor -- start 2024-09-21T06:03:38.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.913+0000 7ff6f0a00640 1 -- start start 2024-09-21T06:03:38.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6f0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ec15fba0 0x7ff6ec1f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:38.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6f0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec1634f0 0x7ff6ec156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:38.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6f0a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 0x7ff6ec1f9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:38.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6f0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0d3aa0 con 0x7ff6ec15fba0 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6f0a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0d3920 con 0x7ff6ec163900 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6f0a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ec0d3c20 con 0x7ff6ec1634f0 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6e3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec1634f0 0x7ff6ec156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6e3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec1634f0 0x7ff6ec156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:57540/0 (socket says 172.21.15.149:57540) 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6e3e00640 1 -- 172.21.15.149:0/1901795766 learned_addr learned my addr 172.21.15.149:0/1901795766 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6ebe00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 0x7ff6ec1f9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.915+0000 7ff6eb400640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ec15fba0 0x7ff6ec1f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6ebe00640 1 -- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec1634f0 msgr2=0x7ff6ec156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6ebe00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec1634f0 0x7ff6ec156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6ebe00640 1 -- 172.21.15.149:0/1901795766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ec15fba0 msgr2=0x7ff6ec1f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6ebe00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ec15fba0 0x7ff6ec1f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6ebe00640 1 -- 172.21.15.149:0/1901795766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec1f9270 con 0x7ff6ec163900 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6e3e00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec1634f0 0x7ff6ec156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6ebe00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 0x7ff6ec1f9a10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400eb80 tx=0x7ff6e400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:38.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6e3400640 1 -- 172.21.15.149:0/1901795766 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4003b70 con 0x7ff6ec163900 2024-09-21T06:03:38.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6e3400640 1 -- 172.21.15.149:0/1901795766 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6e4003d10 con 0x7ff6ec163900 2024-09-21T06:03:38.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec1f7320 con 0x7ff6ec163900 2024-09-21T06:03:38.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.916+0000 7ff6e3400640 1 -- 172.21.15.149:0/1901795766 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4004280 con 0x7ff6ec163900 2024-09-21T06:03:38.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.917+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec159da0 con 0x7ff6ec163900 2024-09-21T06:03:38.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.917+0000 7ff6e3400640 1 -- 172.21.15.149:0/1901795766 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff6e4004420 con 0x7ff6ec163900 2024-09-21T06:03:38.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.917+0000 7ff6e3400640 1 -- 172.21.15.149:0/1901795766 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff6e40059b0 con 0x7ff6ec163900 2024-09-21T06:03:38.921 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.918+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec0d4140 con 0x7ff6ec163900 2024-09-21T06:03:38.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.920+0000 7ff6e3400640 1 -- 172.21.15.149:0/1901795766 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff6ec1f9270 con 0x7ff6ec163900 2024-09-21T06:03:38.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.994+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) -- 0x7ff6ec156660 con 0x7ff6ec163900 2024-09-21T06:03:39.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:38.998+0000 7ff6e3400640 1 -- 172.21.15.149:0/1901795766 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff6e4005020 con 0x7ff6ec163900 2024-09-21T06:03:39.001 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:03:39.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 msgr2=0x7ff6ec1f9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 0x7ff6ec1f9a10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400eb80 tx=0x7ff6e400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 shutdown_connections 2024-09-21T06:03:39.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6ec163900 0x7ff6ec1f9a10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6ec1634f0 0x7ff6ec156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 --2- 172.21.15.149:0/1901795766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6ec15fba0 0x7ff6ec1f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 >> 172.21.15.149:0/1901795766 conn(0x7ff6ec06d1c0 msgr2=0x7ff6ec06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:39.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 shutdown_connections 2024-09-21T06:03:39.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.000+0000 7ff6f0a00640 1 -- 172.21.15.149:0/1901795766 wait complete. 2024-09-21T06:03:39.023 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2024-09-21T06:03:39.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.243+0000 7f95ee000640 1 -- 172.21.15.149:0/1342925505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80d0120 msgr2=0x7f95e80d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.243+0000 7f95ee000640 1 --2- 172.21.15.149:0/1342925505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80d0120 0x7f95e80d1b70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f95e0005fd0 tx=0x7f95e002aa10 comp rx=0 tx=0).stop 2024-09-21T06:03:39.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.244+0000 7f95ee000640 1 -- 172.21.15.149:0/1342925505 shutdown_connections 2024-09-21T06:03:39.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.244+0000 7f95ee000640 1 --2- 172.21.15.149:0/1342925505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80d0120 0x7f95e80d1b70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.244+0000 7f95ee000640 1 --2- 172.21.15.149:0/1342925505 >> v2:172.21.15.149:3300/0 conn(0x7f95e80cfd10 0x7f95e80d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.244+0000 7f95ee000640 1 -- 172.21.15.149:0/1342925505 >> 172.21.15.149:0/1342925505 conn(0x7f95e806d1c0 msgr2=0x7f95e806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:39.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.244+0000 7f95ee000640 1 -- 172.21.15.149:0/1342925505 shutdown_connections 2024-09-21T06:03:39.247 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.244+0000 7f95ee000640 1 -- 172.21.15.149:0/1342925505 wait complete. 2024-09-21T06:03:39.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.246+0000 7f95ee000640 1 Processor -- start 2024-09-21T06:03:39.248 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.246+0000 7f95ee000640 1 -- start start 2024-09-21T06:03:39.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.247+0000 7f95ee000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80cfd10 0x7f95e814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.251 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.247+0000 7f95ee000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95e80d0120 0x7f95e80b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ee000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e81607a0 0x7f95e80cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ee000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80b39c0 con 0x7f95e80d0120 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ee000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80b3840 con 0x7f95e81607a0 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ee000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95e80b3b40 con 0x7f95e80cfd10 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ecc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80cfd10 0x7f95e814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ecc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80cfd10 0x7f95e814d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:57560/0 (socket says 172.21.15.149:57560) 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ed600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e81607a0 0x7f95e80cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ecc00640 1 -- 172.21.15.149:0/3484585869 learned_addr learned my addr 172.21.15.149:0/3484585869 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95e7e00640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95e80d0120 0x7f95e80b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ed600640 1 -- 172.21.15.149:0/3484585869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80cfd10 msgr2=0x7f95e814d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ed600640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80cfd10 0x7f95e814d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ed600640 1 -- 172.21.15.149:0/3484585869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95e80d0120 msgr2=0x7f95e80b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.252 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ed600640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95e80d0120 0x7f95e80b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.248+0000 7f95ed600640 1 -- 172.21.15.149:0/3484585869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e80b4870 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95ed600640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e81607a0 0x7f95e80cc710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95e80d0880 tx=0x7f95e0003ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95e4c00640 1 -- 172.21.15.149:0/3484585869 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0033050 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95e4c00640 1 -- 172.21.15.149:0/3484585869 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95e0004450 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e80b4b50 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95e4c00640 1 -- 172.21.15.149:0/3484585869 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0038450 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e80b5110 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95e4c00640 1 -- 172.21.15.149:0/3484585869 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95e0036070 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.249+0000 7f95e4c00640 1 -- 172.21.15.149:0/3484585869 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f95e0038a10 con 0x7f95e81607a0 2024-09-21T06:03:39.253 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.250+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e80b4060 con 0x7f95e81607a0 2024-09-21T06:03:39.254 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.252+0000 7f95e4c00640 1 -- 172.21.15.149:0/3484585869 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f95e00385f0 con 0x7f95e81607a0 2024-09-21T06:03:39.329 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.326+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) -- 0x7f95e80b4590 con 0x7f95e81607a0 2024-09-21T06:03:39.334 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.332+0000 7f95e4c00640 1 -- 172.21.15.149:0/3484585869 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f95e002f960 con 0x7f95e81607a0 2024-09-21T06:03:39.334 INFO:teuthology.orchestra.run.smithi149.stdout:2 2024-09-21T06:03:39.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e81607a0 msgr2=0x7f95e80cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e81607a0 0x7f95e80cc710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95e80d0880 tx=0x7f95e0003ef0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 shutdown_connections 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95e81607a0 0x7f95e80cc710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95e80d0120 0x7f95e80b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 --2- 172.21.15.149:0/3484585869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95e80cfd10 0x7f95e814d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 >> 172.21.15.149:0/3484585869 conn(0x7f95e806d1c0 msgr2=0x7f95e80d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 shutdown_connections 2024-09-21T06:03:39.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.333+0000 7f95ee000640 1 -- 172.21.15.149:0/3484585869 wait complete. 2024-09-21T06:03:39.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2024-09-21T06:03:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.574+0000 7fa8ce000640 1 -- 172.21.15.149:0/2420154895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80d1d40 msgr2=0x7fa8c80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.574+0000 7fa8ce000640 1 --2- 172.21.15.149:0/2420154895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80d1d40 0x7fa8c80b34c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0005fd0 tx=0x7fa8c002aaa0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.574+0000 7fa8ce000640 1 -- 172.21.15.149:0/2420154895 shutdown_connections 2024-09-21T06:03:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.574+0000 7fa8ce000640 1 --2- 172.21.15.149:0/2420154895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80d1d40 0x7fa8c80b34c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.574+0000 7fa8ce000640 1 -- 172.21.15.149:0/2420154895 >> 172.21.15.149:0/2420154895 conn(0x7fa8c806d1c0 msgr2=0x7fa8c806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.575+0000 7fa8ce000640 1 -- 172.21.15.149:0/2420154895 shutdown_connections 2024-09-21T06:03:39.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.575+0000 7fa8ce000640 1 -- 172.21.15.149:0/2420154895 wait complete. 2024-09-21T06:03:39.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.577+0000 7fa8ce000640 1 Processor -- start 2024-09-21T06:03:39.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.577+0000 7fa8ce000640 1 -- start start 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.578+0000 7fa8ce000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c80cfd10 0x7fa8c80b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.578+0000 7fa8ce000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8c81607a0 0x7fa8c80abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.578+0000 7fa8ce000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80ab8e0 0x7fa8c8160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.578+0000 7fa8ce000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c80b3b80 con 0x7fa8c80cfd10 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.578+0000 7fa8ce000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c80b3a00 con 0x7fa8c80ab8e0 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.578+0000 7fa8ce000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c80b3d00 con 0x7fa8c81607a0 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8c81607a0 0x7fa8c80abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8cd600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80ab8e0 0x7fa8c8160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8ccc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c80cfd10 0x7fa8c80b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8c81607a0 0x7fa8c80abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:57576/0 (socket says 172.21.15.149:57576) 2024-09-21T06:03:39.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 -- 172.21.15.149:0/4051664413 learned_addr learned my addr 172.21.15.149:0/4051664413 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 -- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80ab8e0 msgr2=0x7fa8c8160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80ab8e0 0x7fa8c8160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 -- 172.21.15.149:0/4051664413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c80cfd10 msgr2=0x7fa8c80b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c80cfd10 0x7fa8c80b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 -- 172.21.15.149:0/4051664413 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c81f6890 con 0x7fa8c81607a0 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8cd600640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80ab8e0 0x7fa8c8160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.579+0000 7fa8c7e00640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8c81607a0 0x7fa8c80abe50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c400 tx=0x7fa8b400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:39.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.580+0000 7fa8c4c00640 1 -- 172.21.15.149:0/4051664413 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4017070 con 0x7fa8c81607a0 2024-09-21T06:03:39.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.580+0000 7fa8c4c00640 1 -- 172.21.15.149:0/4051664413 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8b40053c0 con 0x7fa8c81607a0 2024-09-21T06:03:39.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.580+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c81f6b70 con 0x7fa8c81607a0 2024-09-21T06:03:39.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.580+0000 7fa8c4c00640 1 -- 172.21.15.149:0/4051664413 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4003850 con 0x7fa8c81607a0 2024-09-21T06:03:39.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.580+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c81f71b0 con 0x7fa8c81607a0 2024-09-21T06:03:39.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.580+0000 7fa8c4c00640 1 -- 172.21.15.149:0/4051664413 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa8b401a070 con 0x7fa8c81607a0 2024-09-21T06:03:39.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.580+0000 7fa8c4c00640 1 -- 172.21.15.149:0/4051664413 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa8b4011c70 con 0x7fa8c81607a0 2024-09-21T06:03:39.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.581+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c80b34c0 con 0x7fa8c81607a0 2024-09-21T06:03:39.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.583+0000 7fa8c4c00640 1 -- 172.21.15.149:0/4051664413 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa8b4021070 con 0x7fa8c81607a0 2024-09-21T06:03:39.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.656+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) -- 0x7fa8c80ba630 con 0x7fa8c81607a0 2024-09-21T06:03:39.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.660+0000 7fa8c4c00640 1 -- 172.21.15.149:0/4051664413 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa8c80d0990 con 0x7fa8c81607a0 2024-09-21T06:03:39.663 INFO:teuthology.orchestra.run.smithi149.stdout:3 2024-09-21T06:03:39.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.661+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8c81607a0 msgr2=0x7fa8c80abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.661+0000 7fa8ce000640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8c81607a0 0x7fa8c80abe50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c400 tx=0x7fa8b400c8c0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.662+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 shutdown_connections 2024-09-21T06:03:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.662+0000 7fa8ce000640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80ab8e0 0x7fa8c8160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.662+0000 7fa8ce000640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8c81607a0 0x7fa8c80abe50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.662+0000 7fa8ce000640 1 --2- 172.21.15.149:0/4051664413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c80cfd10 0x7fa8c80b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.662+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 >> 172.21.15.149:0/4051664413 conn(0x7fa8c806d1c0 msgr2=0x7fa8c815c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.662+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 shutdown_connections 2024-09-21T06:03:39.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.662+0000 7fa8ce000640 1 -- 172.21.15.149:0/4051664413 wait complete. 2024-09-21T06:03:39.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2024-09-21T06:03:39.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 -- 172.21.15.149:0/4148503074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440d3930 msgr2=0x7f58440b9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 --2- 172.21.15.149:0/4148503074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440d3930 0x7f58440b9570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f584408d530 tx=0x7f583402a5f0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 -- 172.21.15.149:0/4148503074 shutdown_connections 2024-09-21T06:03:39.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 --2- 172.21.15.149:0/4148503074 >> v2:172.21.15.118:3300/0 conn(0x7f58440ba050 0x7f58440b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.906 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 --2- 172.21.15.149:0/4148503074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440d3930 0x7f58440b9570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 -- 172.21.15.149:0/4148503074 >> 172.21.15.149:0/4148503074 conn(0x7f58440d4d40 msgr2=0x7f58440d5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:39.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 -- 172.21.15.149:0/4148503074 shutdown_connections 2024-09-21T06:03:39.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.903+0000 7f584a000640 1 -- 172.21.15.149:0/4148503074 wait complete. 2024-09-21T06:03:39.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.906+0000 7f584a000640 1 Processor -- start 2024-09-21T06:03:39.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.906+0000 7f584a000640 1 -- start start 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.907+0000 7f584a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58440b62b0 0x7f58441e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.907+0000 7f584a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440ba050 0x7f58441f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.907+0000 7f584a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58440d3930 0x7f58441f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.907+0000 7f584a000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58440b59c0 con 0x7f58440d3930 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.907+0000 7f584a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58440b5840 con 0x7f58440ba050 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.907+0000 7f584a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58440b4bd0 con 0x7f58440b62b0 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440ba050 0x7f58441f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5843400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58440b62b0 0x7f58441e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440ba050 0x7f58441f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33290/0 (socket says 172.21.15.149:33290) 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 -- 172.21.15.149:0/1122652790 learned_addr learned my addr 172.21.15.149:0/1122652790 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5843e00640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58440d3930 0x7f58441f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 -- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58440b62b0 msgr2=0x7f58441e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58440b62b0 0x7f58441e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 -- 172.21.15.149:0/1122652790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58440d3930 msgr2=0x7f58441f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58440d3930 0x7f58441f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 -- 172.21.15.149:0/1122652790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58441fa500 con 0x7f58440ba050 2024-09-21T06:03:39.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5843400640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58440b62b0 0x7f58441e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:39.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.908+0000 7f5842a00640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440ba050 0x7f58441f9a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f583000e7c0 tx=0x7f583000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.909+0000 7f583b400640 1 -- 172.21.15.149:0/1122652790 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583000ccc0 con 0x7f58440ba050 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.909+0000 7f583b400640 1 -- 172.21.15.149:0/1122652790 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f583000ee70 con 0x7f58440ba050 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.909+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58441f65b0 con 0x7f58440ba050 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.909+0000 7f583b400640 1 -- 172.21.15.149:0/1122652790 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830010690 con 0x7f58440ba050 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.909+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58441f6b70 con 0x7f58440ba050 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.909+0000 7f583b400640 1 -- 172.21.15.149:0/1122652790 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5830010830 con 0x7f58440ba050 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.909+0000 7f583b400640 1 -- 172.21.15.149:0/1122652790 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5830018ba0 con 0x7f58440ba050 2024-09-21T06:03:39.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.910+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58441e6f70 con 0x7f58440ba050 2024-09-21T06:03:39.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.912+0000 7f583b400640 1 -- 172.21.15.149:0/1122652790 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f58441e6f70 con 0x7f58440ba050 2024-09-21T06:03:39.988 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.986+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) -- 0x7f58440d5480 con 0x7f58440ba050 2024-09-21T06:03:39.993 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.991+0000 7f583b400640 1 -- 172.21.15.149:0/1122652790 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f58441fa500 con 0x7f58440ba050 2024-09-21T06:03:39.994 INFO:teuthology.orchestra.run.smithi149.stdout:4 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440ba050 msgr2=0x7f58441f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440ba050 0x7f58441f9a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f583000e7c0 tx=0x7f583000ec80 comp rx=0 tx=0).stop 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 shutdown_connections 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58440d3930 0x7f58441f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58440ba050 0x7f58441f9a80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 --2- 172.21.15.149:0/1122652790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58440b62b0 0x7f58441e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 >> 172.21.15.149:0/1122652790 conn(0x7f58440d4d40 msgr2=0x7f58440d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:39.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 shutdown_connections 2024-09-21T06:03:39.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:39.992+0000 7f584a000640 1 -- 172.21.15.149:0/1122652790 wait complete. 2024-09-21T06:03:40.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 -- 172.21.15.149:0/3233532622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 msgr2=0x7fc5400b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 --2- 172.21.15.149:0/3233532622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc5400b6990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc52c005fd0 tx=0x7fc52c02a5d0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 -- 172.21.15.149:0/3233532622 shutdown_connections 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 --2- 172.21.15.149:0/3233532622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc5400b6990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 --2- 172.21.15.149:0/3233532622 >> v2:172.21.15.118:3300/0 conn(0x7fc54015ee10 0x7fc5400d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 -- 172.21.15.149:0/3233532622 >> 172.21.15.149:0/3233532622 conn(0x7fc5400d1760 msgr2=0x7fc5400d1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 -- 172.21.15.149:0/3233532622 shutdown_connections 2024-09-21T06:03:40.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.235+0000 7fc546200640 1 -- 172.21.15.149:0/3233532622 wait complete. 2024-09-21T06:03:40.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.237+0000 7fc546200640 1 Processor -- start 2024-09-21T06:03:40.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.237+0000 7fc546200640 1 -- start start 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc546200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc54014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc546200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5400cf780 0x7fc5401f9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc546200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc54015ee10 0x7fc5401f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc546200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc5400b83d0 con 0x7fc54015ee10 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc546200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5400b8250 con 0x7fc5400cf780 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc546200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5400b8550 con 0x7fc5400b6580 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc544e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc54014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc53fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5400cf780 0x7fc5401f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc544e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc54014cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:57612/0 (socket says 172.21.15.149:57612) 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc53fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5400cf780 0x7fc5401f9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33298/0 (socket says 172.21.15.149:33298) 2024-09-21T06:03:40.244 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc544e00640 1 -- 172.21.15.149:0/3403279337 learned_addr learned my addr 172.21.15.149:0/3403279337 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.239+0000 7fc545800640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc54015ee10 0x7fc5401f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc544e00640 1 -- 172.21.15.149:0/3403279337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5400cf780 msgr2=0x7fc5401f9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc544e00640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5400cf780 0x7fc5401f9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc544e00640 1 -- 172.21.15.149:0/3403279337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc54015ee10 msgr2=0x7fc5401f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc544e00640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc54015ee10 0x7fc5401f9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc544e00640 1 -- 172.21.15.149:0/3403279337 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54015a1b0 con 0x7fc5400b6580 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc545800640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc54015ee10 0x7fc5401f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc544e00640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc54014cd60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc53400e790 tx=0x7fc53400ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc53cc00640 1 -- 172.21.15.149:0/3403279337 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53400eea0 con 0x7fc5400b6580 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc53cc00640 1 -- 172.21.15.149:0/3403279337 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc53400cdb0 con 0x7fc5400b6580 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc540158ba0 con 0x7fc5400b6580 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc53cc00640 1 -- 172.21.15.149:0/3403279337 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534010690 con 0x7fc5400b6580 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.240+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc540158e80 con 0x7fc5400b6580 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.241+0000 7fc53cc00640 1 -- 172.21.15.149:0/3403279337 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc534010830 con 0x7fc5400b6580 2024-09-21T06:03:40.245 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.241+0000 7fc53cc00640 1 -- 172.21.15.149:0/3403279337 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc534018c40 con 0x7fc5400b6580 2024-09-21T06:03:40.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.242+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5400b7bf0 con 0x7fc5400b6580 2024-09-21T06:03:40.246 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.244+0000 7fc53cc00640 1 -- 172.21.15.149:0/3403279337 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc5400b7bf0 con 0x7fc5400b6580 2024-09-21T06:03:40.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.318+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) -- 0x7fc5400b9c20 con 0x7fc5400b6580 2024-09-21T06:03:40.326 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.323+0000 7fc53cc00640 1 -- 172.21.15.149:0/3403279337 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc534010b20 con 0x7fc5400b6580 2024-09-21T06:03:40.326 INFO:teuthology.orchestra.run.smithi149.stdout:5 2024-09-21T06:03:40.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 msgr2=0x7fc54014cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc54014cd60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc53400e790 tx=0x7fc53400ec50 comp rx=0 tx=0).stop 2024-09-21T06:03:40.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 shutdown_connections 2024-09-21T06:03:40.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc54015ee10 0x7fc5401f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5400cf780 0x7fc5401f9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 --2- 172.21.15.149:0/3403279337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5400b6580 0x7fc54014cd60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.327 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 >> 172.21.15.149:0/3403279337 conn(0x7fc5400d1760 msgr2=0x7fc54015f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:40.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 shutdown_connections 2024-09-21T06:03:40.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.325+0000 7fc546200640 1 -- 172.21.15.149:0/3403279337 wait complete. 2024-09-21T06:03:40.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2024-09-21T06:03:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 -- 172.21.15.149:0/4129879234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cf720 msgr2=0x7f7e1c0cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 --2- 172.21.15.149:0/4129879234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cf720 0x7f7e1c0cd360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c074e20 tx=0x7f7e0c02a560 comp rx=0 tx=0).stop 2024-09-21T06:03:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 -- 172.21.15.149:0/4129879234 shutdown_connections 2024-09-21T06:03:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 --2- 172.21.15.149:0/4129879234 >> v2:172.21.15.118:3300/0 conn(0x7f7e1c160f20 0x7f7e1c15d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 --2- 172.21.15.149:0/4129879234 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e1c0cd8a0 0x7f7e1c1609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 --2- 172.21.15.149:0/4129879234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cf720 0x7f7e1c0cd360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 -- 172.21.15.149:0/4129879234 >> 172.21.15.149:0/4129879234 conn(0x7f7e1c0b2860 msgr2=0x7f7e1c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:40.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 -- 172.21.15.149:0/4129879234 shutdown_connections 2024-09-21T06:03:40.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.581+0000 7f7e22600640 1 -- 172.21.15.149:0/4129879234 wait complete. 2024-09-21T06:03:40.586 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.583+0000 7f7e22600640 1 Processor -- start 2024-09-21T06:03:40.587 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.583+0000 7f7e22600640 1 -- start start 2024-09-21T06:03:40.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e22600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cd8a0 0x7f7e1c146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e22600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e1c0cf720 0x7f7e1c1f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e22600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e1c160f20 0x7f7e1c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.588 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e22600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c15dcc0 con 0x7f7e1c0cf720 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e22600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c15db40 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e22600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1c15de40 con 0x7f7e1c160f20 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cd8a0 0x7f7e1c146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cd8a0 0x7f7e1c146260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33392/0 (socket says 172.21.15.149:33392) 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 -- 172.21.15.149:0/2503715028 learned_addr learned my addr 172.21.15.149:0/2503715028 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1be00640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e1c160f20 0x7f7e1c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 -- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e1c160f20 msgr2=0x7f7e1c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e1c160f20 0x7f7e1c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 -- 172.21.15.149:0/2503715028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e1c0cf720 msgr2=0x7f7e1c1f96c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e1c0cf720 0x7f7e1c1f96c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.585+0000 7f7e1b400640 1 -- 172.21.15.149:0/2503715028 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c13b310 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.586+0000 7f7e1b400640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cd8a0 0x7f7e1c146260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c034040 tx=0x7f7e0c0038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:40.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.586+0000 7f7e13400640 1 -- 172.21.15.149:0/2503715028 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c03e030 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.586+0000 7f7e13400640 1 -- 172.21.15.149:0/2503715028 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e0c003ca0 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.586+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1c1fa3f0 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.586+0000 7f7e13400640 1 -- 172.21.15.149:0/2503715028 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c035040 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.586+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1c13b890 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.587+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e1c0b31a0 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.587+0000 7f7e13400640 1 -- 172.21.15.149:0/2503715028 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f7e0c041030 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.588+0000 7f7e13400640 1 -- 172.21.15.149:0/2503715028 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7e0c0728b0 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.590+0000 7f7e13400640 1 -- 172.21.15.149:0/2503715028 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7e1c0b31a0 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.662+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) -- 0x7f7e1c146850 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.668+0000 7f7e13400640 1 -- 172.21.15.149:0/2503715028 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7e0c004d80 con 0x7f7e1c0cd8a0 2024-09-21T06:03:40.671 INFO:teuthology.orchestra.run.smithi149.stdout:6 2024-09-21T06:03:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.669+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cd8a0 msgr2=0x7f7e1c146260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.669+0000 7f7e22600640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cd8a0 0x7f7e1c146260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c034040 tx=0x7f7e0c0038a0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.669+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 shutdown_connections 2024-09-21T06:03:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.669+0000 7f7e22600640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e1c160f20 0x7f7e1c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.669+0000 7f7e22600640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e1c0cf720 0x7f7e1c1f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.669+0000 7f7e22600640 1 --2- 172.21.15.149:0/2503715028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e1c0cd8a0 0x7f7e1c146260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.670+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 >> 172.21.15.149:0/2503715028 conn(0x7f7e1c0b2860 msgr2=0x7f7e1c15ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:40.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.670+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 shutdown_connections 2024-09-21T06:03:40.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.670+0000 7f7e22600640 1 -- 172.21.15.149:0/2503715028 wait complete. 2024-09-21T06:03:40.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2024-09-21T06:03:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.904+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1019527262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 msgr2=0x7fa7dc0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.904+0000 7fa7e2c00640 1 --2- 172.21.15.149:0/1019527262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 0x7fa7dc0d0e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009830 tx=0x7fa7cc02a520 comp rx=0 tx=0).stop 2024-09-21T06:03:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.904+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1019527262 shutdown_connections 2024-09-21T06:03:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.904+0000 7fa7e2c00640 1 --2- 172.21.15.149:0/1019527262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 0x7fa7dc0d0e80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.904+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1019527262 >> 172.21.15.149:0/1019527262 conn(0x7fa7dc06d110 msgr2=0x7fa7dc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.904+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1019527262 shutdown_connections 2024-09-21T06:03:40.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.904+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1019527262 wait complete. 2024-09-21T06:03:40.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.906+0000 7fa7e2c00640 1 Processor -- start 2024-09-21T06:03:40.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.906+0000 7fa7e2c00640 1 -- start start 2024-09-21T06:03:40.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.907+0000 7fa7e2c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 0x7fa7dc130160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e2c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7dc13fef0 0x7fa7dc0b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7dc142e40 0x7fa7dc0b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:40.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e2c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0cfce0 con 0x7fa7dc13fae0 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e2c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0cfb60 con 0x7fa7dc13fef0 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa7dc0cfe60 con 0x7fa7dc142e40 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7dc13fef0 0x7fa7dc0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7dc142e40 0x7fa7dc0b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7dc13fef0 0x7fa7dc0b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33404/0 (socket says 172.21.15.149:33404) 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7dc142e40 0x7fa7dc0b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:57694/0 (socket says 172.21.15.149:57694) 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 -- 172.21.15.149:0/1147883128 learned_addr learned my addr 172.21.15.149:0/1147883128 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7dbe00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 0x7fa7dc130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 -- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7dc142e40 msgr2=0x7fa7dc0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7dc142e40 0x7fa7dc0b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 -- 172.21.15.149:0/1147883128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 msgr2=0x7fa7dc130160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 0x7fa7dc130160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7d3e00640 1 -- 172.21.15.149:0/1147883128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc1306a0 con 0x7fa7dc13fef0 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.908+0000 7fa7e0c00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7dc142e40 0x7fa7dc0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.909+0000 7fa7d3e00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7dc13fef0 0x7fa7dc0b4ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c390 tx=0x7fa7c400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.909+0000 7fa7d8c00640 1 -- 172.21.15.149:0/1147883128 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4011790 con 0x7fa7dc13fef0 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.909+0000 7fa7d8c00640 1 -- 172.21.15.149:0/1147883128 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7c4017070 con 0x7fa7dc13fef0 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.909+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc1588d0 con 0x7fa7dc13fef0 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.909+0000 7fa7d8c00640 1 -- 172.21.15.149:0/1147883128 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4011ce0 con 0x7fa7dc13fef0 2024-09-21T06:03:40.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.909+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc158e90 con 0x7fa7dc13fef0 2024-09-21T06:03:40.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.910+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7dc0d0310 con 0x7fa7dc13fef0 2024-09-21T06:03:40.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.910+0000 7fa7d8c00640 1 -- 172.21.15.149:0/1147883128 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fa7c401c460 con 0x7fa7dc13fef0 2024-09-21T06:03:40.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.911+0000 7fa7d8c00640 1 -- 172.21.15.149:0/1147883128 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa7c4052000 con 0x7fa7dc13fef0 2024-09-21T06:03:40.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.912+0000 7fa7d8c00640 1 -- 172.21.15.149:0/1147883128 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa7c4012420 con 0x7fa7dc13fef0 2024-09-21T06:03:40.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.983+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) -- 0x7fa7dc142940 con 0x7fa7dc13fef0 2024-09-21T06:03:40.994 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.990+0000 7fa7d8c00640 1 -- 172.21.15.149:0/1147883128 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa7c401cb70 con 0x7fa7dc13fef0 2024-09-21T06:03:40.994 INFO:teuthology.orchestra.run.smithi149.stdout:7 2024-09-21T06:03:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.991+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7dc13fef0 msgr2=0x7fa7dc0b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.991+0000 7fa7e2c00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7dc13fef0 0x7fa7dc0b4ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c390 tx=0x7fa7c400c850 comp rx=0 tx=0).stop 2024-09-21T06:03:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.992+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 shutdown_connections 2024-09-21T06:03:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.992+0000 7fa7e2c00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7dc142e40 0x7fa7dc0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.992+0000 7fa7e2c00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7dc13fef0 0x7fa7dc0b4ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.992+0000 7fa7e2c00640 1 --2- 172.21.15.149:0/1147883128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7dc13fae0 0x7fa7dc130160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.992+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 >> 172.21.15.149:0/1147883128 conn(0x7fa7dc06d110 msgr2=0x7fa7dc1609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.992+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 shutdown_connections 2024-09-21T06:03:40.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:03:40.992+0000 7fa7e2c00640 1 -- 172.21.15.149:0/1147883128 wait complete. 2024-09-21T06:03:41.014 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T06:03:41.014 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T06:03:41.018 INFO:tasks.ceph.osd.0:Started 2024-09-21T06:03:41.018 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T06:03:41.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T06:03:41.022 INFO:tasks.ceph.osd.1:Started 2024-09-21T06:03:41.022 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T06:03:41.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T06:03:41.026 INFO:tasks.ceph.osd.2:Started 2024-09-21T06:03:41.026 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T06:03:41.027 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T06:03:41.031 INFO:tasks.ceph.osd.3:Started 2024-09-21T06:03:41.031 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T06:03:41.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T06:03:41.036 INFO:tasks.ceph.osd.4:Started 2024-09-21T06:03:41.036 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T06:03:41.036 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T06:03:41.040 INFO:tasks.ceph.osd.5:Started 2024-09-21T06:03:41.040 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T06:03:41.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T06:03:41.043 INFO:tasks.ceph.osd.6:Started 2024-09-21T06:03:41.044 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T06:03:41.044 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T06:03:41.048 INFO:tasks.ceph.osd.7:Started 2024-09-21T06:03:41.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:03:41.240 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T06:03:41.238+0000 7f068d02a640 -1 Falling back to public interface 2024-09-21T06:03:41.241 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T06:03:41.239+0000 7f44e9e0c640 -1 Falling back to public interface 2024-09-21T06:03:41.242 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T06:03:41.240+0000 7fb0020b6640 -1 Falling back to public interface 2024-09-21T06:03:41.253 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T06:03:41.251+0000 7f33db816640 -1 Falling back to public interface 2024-09-21T06:03:41.260 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-09-21T06:03:41.258+0000 7f5a2d614640 -1 Falling back to public interface 2024-09-21T06:03:41.263 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T06:03:41.261+0000 7f068d02a640 -1 osd.5 0 log_to_monitors true 2024-09-21T06:03:41.269 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T06:03:41.267+0000 7f44e9e0c640 -1 osd.4 0 log_to_monitors true 2024-09-21T06:03:41.271 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T06:03:41.269+0000 7fb0020b6640 -1 osd.6 0 log_to_monitors true 2024-09-21T06:03:41.277 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-09-21T06:03:41.274+0000 7f5a2d614640 -1 osd.3 0 log_to_monitors true 2024-09-21T06:03:41.286 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T06:03:41.284+0000 7f33db816640 -1 osd.7 0 log_to_monitors true 2024-09-21T06:03:41.293 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-09-21T06:03:41.291+0000 7f1899c1a640 -1 Falling back to public interface 2024-09-21T06:03:41.295 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-09-21T06:03:41.293+0000 7fa420a10640 -1 Falling back to public interface 2024-09-21T06:03:41.317 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-09-21T06:03:41.315+0000 7f1899c1a640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:03:41.319 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-09-21T06:03:41.317+0000 7fa420a10640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:03:41.335 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-09-21T06:03:41.333+0000 7f28d7a0b640 -1 Falling back to public interface 2024-09-21T06:03:41.358 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-09-21T06:03:41.356+0000 7f28d7a0b640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:03:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.380+0000 7f0e18e00640 1 -- 172.21.15.118:0/2523003288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e141634f0 msgr2=0x7f0e140d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.380+0000 7f0e18e00640 1 --2- 172.21.15.118:0/2523003288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e141634f0 0x7f0e140d02e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009830 tx=0x7f0e0402a540 comp rx=0 tx=0).stop 2024-09-21T06:03:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.380+0000 7f0e18e00640 1 -- 172.21.15.118:0/2523003288 shutdown_connections 2024-09-21T06:03:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.380+0000 7f0e18e00640 1 --2- 172.21.15.118:0/2523003288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e141634f0 0x7f0e140d02e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.380+0000 7f0e18e00640 1 -- 172.21.15.118:0/2523003288 >> 172.21.15.118:0/2523003288 conn(0x7f0e1406d1c0 msgr2=0x7f0e1406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.380+0000 7f0e18e00640 1 -- 172.21.15.118:0/2523003288 shutdown_connections 2024-09-21T06:03:41.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.380+0000 7f0e18e00640 1 -- 172.21.15.118:0/2523003288 wait complete. 2024-09-21T06:03:41.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.382+0000 7f0e18e00640 1 Processor -- start 2024-09-21T06:03:41.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.382+0000 7f0e18e00640 1 -- start start 2024-09-21T06:03:41.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e18e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e140d1330 0x7f0e1415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e18e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e141634f0 0x7f0e1414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e18e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e14163900 0x7f0e140ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e18e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0e140d3cb0 con 0x7f0e14163900 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e18e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0e140d3b30 con 0x7f0e140d1330 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e18e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0e140d3e30 con 0x7f0e141634f0 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e13e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e14163900 0x7f0e140ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e13400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e140d1330 0x7f0e1415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e0aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e141634f0 0x7f0e1414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e13400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e140d1330 0x7f0e1415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53932/0 (socket says 172.21.15.118:53932) 2024-09-21T06:03:41.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.384+0000 7f0e13400640 1 -- 172.21.15.118:0/3902316171 learned_addr learned my addr 172.21.15.118:0/3902316171 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:41.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e13e00640 1 -- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e141634f0 msgr2=0x7f0e1414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:41.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e13e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e141634f0 0x7f0e1414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:41.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e13e00640 1 -- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e140d1330 msgr2=0x7f0e1415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e13e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e140d1330 0x7f0e1415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e13e00640 1 -- 172.21.15.118:0/3902316171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1415ae30 con 0x7f0e14163900 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e13400640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e140d1330 0x7f0e1415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e13e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e14163900 0x7f0e140ce010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c001350 tx=0x7f0e0c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c016020 con 0x7f0e14163900 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e0c00ae00 con 0x7f0e14163900 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1415b110 con 0x7f0e14163900 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c012680 con 0x7f0e14163900 2024-09-21T06:03:41.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.385+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1415b6d0 con 0x7f0e14163900 2024-09-21T06:03:41.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.386+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1415aba0 con 0x7f0e14163900 2024-09-21T06:03:41.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.387+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f0e0c019020 con 0x7f0e14163900 2024-09-21T06:03:41.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.387+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0e0c052a50 con 0x7f0e14163900 2024-09-21T06:03:41.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.389+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0e0c020020 con 0x7f0e14163900 2024-09-21T06:03:41.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.453+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e140d4340 con 0x7f0e14163900 2024-09-21T06:03:41.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.453+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mgrmap(e 3) ==== 101279+0+0 (secure 0 0 0) 0x7f0e0c01b400 con 0x7f0e14163900 2024-09-21T06:03:41.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.454+0000 7f0e0be00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0df0078f20 0x7f0df007b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:41.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.455+0000 7f0e13400640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0df0078f20 0x7f0df007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:41.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.457+0000 7f0e0be00640 1 -- 172.21.15.118:0/3902316171 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0e0c066040 con 0x7f0e14163900 2024-09-21T06:03:41.459 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:41.459 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:40.985886+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:03:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e13400640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0df0078f20 0x7f0df007b340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0e04031580 tx=0x7f0e04004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0df0078f20 msgr2=0x7f0df007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0df0078f20 0x7f0df007b340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0e04031580 tx=0x7f0e04004730 comp rx=0 tx=0).stop 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e14163900 msgr2=0x7f0e140ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e14163900 0x7f0e140ce010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c001350 tx=0x7f0e0c00cf70 comp rx=0 tx=0).stop 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 shutdown_connections 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e14163900 0x7f0e140ce010 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0df0078f20 0x7f0df007b340 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e141634f0 0x7f0e1414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 --2- 172.21.15.118:0/3902316171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e140d1330 0x7f0e1415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 >> 172.21.15.118:0/3902316171 conn(0x7f0e1406d1c0 msgr2=0x7f0e14159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 shutdown_connections 2024-09-21T06:03:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:41.458+0000 7f0e18e00640 1 -- 172.21.15.118:0/3902316171 wait complete. 2024-09-21T06:03:41.464 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T06:03:41.462+0000 7f7f1ac00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T06:03:41.464 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-21T06:03:41.462+0000 7f7f1ac00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T06:03:41.480 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T06:03:41.481 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T06:03:42.285 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T06:03:42.500 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 -- 172.21.15.118:0/2513445556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 msgr2=0x7fe924142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:42.500 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 --2- 172.21.15.118:0/2513445556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe924142c70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005fd0 tx=0x7fe91c02aa10 comp rx=0 tx=0).stop 2024-09-21T06:03:42.501 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 -- 172.21.15.118:0/2513445556 shutdown_connections 2024-09-21T06:03:42.501 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 --2- 172.21.15.118:0/2513445556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe924142c70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.501 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 --2- 172.21.15.118:0/2513445556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9240d1590 0x7fe924142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.501 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 -- 172.21.15.118:0/2513445556 >> 172.21.15.118:0/2513445556 conn(0x7fe92406d110 msgr2=0x7fe92406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:42.501 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 -- 172.21.15.118:0/2513445556 shutdown_connections 2024-09-21T06:03:42.501 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.497+0000 7fe929a00640 1 -- 172.21.15.118:0/2513445556 wait complete. 2024-09-21T06:03:42.502 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.499+0000 7fe929a00640 1 Processor -- start 2024-09-21T06:03:42.502 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.500+0000 7fe929a00640 1 -- start start 2024-09-21T06:03:42.506 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe929a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe92413fae0 0x7fe924130200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:42.506 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe929a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe92415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:42.506 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe929a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe92415bb20 0x7fe924159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:42.506 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe929a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240cfb10 con 0x7fe92413fef0 2024-09-21T06:03:42.506 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe929a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240cf990 con 0x7fe92415bb20 2024-09-21T06:03:42.506 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe929a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9240cfc90 con 0x7fe92413fae0 2024-09-21T06:03:42.507 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe91a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe92415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:42.507 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe91a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe92415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56534/0 (socket says 172.21.15.118:56534) 2024-09-21T06:03:42.507 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe91a000640 1 -- 172.21.15.118:0/3923398079 learned_addr learned my addr 172.21.15.118:0/3923398079 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:42.507 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.501+0000 7fe922a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe92413fae0 0x7fe924130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:42.507 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe923400640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe92415bb20 0x7fe924159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:42.507 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91a000640 1 -- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe92413fae0 msgr2=0x7fe924130200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:42.507 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91a000640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe92413fae0 0x7fe924130200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91a000640 1 -- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe92415bb20 msgr2=0x7fe924159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91a000640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe92415bb20 0x7fe924159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91a000640 1 -- 172.21.15.118:0/3923398079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92415bf30 con 0x7fe92413fef0 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91a000640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe92415b5e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00e790 tx=0x7fe90c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91b400640 1 -- 172.21.15.118:0/3923398079 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c00eea0 con 0x7fe92413fef0 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91b400640 1 -- 172.21.15.118:0/3923398079 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe90c00cc60 con 0x7fe92413fef0 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe91b400640 1 -- 172.21.15.118:0/3923398079 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c005280 con 0x7fe92413fef0 2024-09-21T06:03:42.508 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.502+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe924139180 con 0x7fe92413fef0 2024-09-21T06:03:42.509 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.503+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe924140370 con 0x7fe92413fef0 2024-09-21T06:03:42.510 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.504+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92406fb90 con 0x7fe92413fef0 2024-09-21T06:03:42.510 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.505+0000 7fe91b400640 1 -- 172.21.15.118:0/3923398079 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 3) ==== 101279+0+0 (secure 0 0 0) 0x7fe90c005420 con 0x7fe92413fef0 2024-09-21T06:03:42.510 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.505+0000 7fe91b400640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe900078a10 0x7fe90007af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:42.511 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.506+0000 7fe91b400640 1 -- 172.21.15.118:0/3923398079 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1883+0+0 (secure 0 0 0) 0x7fe90c09a200 con 0x7fe92413fef0 2024-09-21T06:03:42.511 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.506+0000 7fe922a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe900078a10 0x7fe90007af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:42.511 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.506+0000 7fe922a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe900078a10 0x7fe90007af20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe914000f60 tx=0x7fe914009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:42.513 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.511+0000 7fe91b400640 1 -- 172.21.15.118:0/3923398079 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe92406fb90 con 0x7fe92413fef0 2024-09-21T06:03:42.696 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.693+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9240d0140 con 0x7fe92413fef0 2024-09-21T06:03:42.696 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.694+0000 7fe91b400640 1 -- 172.21.15.118:0/3923398079 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+7058 (secure 0 0 0) 0x7fe92415bf30 con 0x7fe92413fef0 2024-09-21T06:03:42.696 INFO:teuthology.misc.health.smithi118.stdout: 2024-09-21T06:03:42.697 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":11,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:41.987853+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:03:42.699 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe900078a10 msgr2=0x7fe90007af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:42.699 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe900078a10 0x7fe90007af20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe914000f60 tx=0x7fe914009040 comp rx=0 tx=0).stop 2024-09-21T06:03:42.699 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 msgr2=0x7fe92415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:42.699 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe92415b5e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00e790 tx=0x7fe90c00ec50 comp rx=0 tx=0).stop 2024-09-21T06:03:42.699 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 shutdown_connections 2024-09-21T06:03:42.699 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe92415bb20 0x7fe924159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.700 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe92413fef0 0x7fe92415b5e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.700 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe900078a10 0x7fe90007af20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.700 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 --2- 172.21.15.118:0/3923398079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe92413fae0 0x7fe924130200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:42.700 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 >> 172.21.15.118:0/3923398079 conn(0x7fe92406d110 msgr2=0x7fe9241539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:42.700 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 shutdown_connections 2024-09-21T06:03:42.700 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:42.696+0000 7fe929a00640 1 -- 172.21.15.118:0/3923398079 wait complete. 2024-09-21T06:03:42.718 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T06:03:43.001 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-09-21T06:03:42.998+0000 7f5a27e00640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T06:03:43.002 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-09-21T06:03:43.000+0000 7f1894600640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:03:43.002 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-09-21T06:03:43.000+0000 7fa41b200640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:03:43.003 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-09-21T06:03:43.001+0000 7f5a1fc00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:43.004 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T06:03:43.002+0000 7f33d6000640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T06:03:43.005 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-09-21T06:03:43.002+0000 7f188c400640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:43.005 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-09-21T06:03:43.002+0000 7f28d2c00640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:03:43.005 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-09-21T06:03:43.003+0000 7fa413000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:43.006 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T06:03:43.004+0000 7faffd000640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T06:03:43.006 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T06:03:43.004+0000 7f44e4600640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T06:03:43.007 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T06:03:43.004+0000 7f0688800640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T06:03:43.007 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-09-21T06:03:43.005+0000 7f28ca000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:43.008 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-21T06:03:43.006+0000 7f33cde00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:43.010 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-21T06:03:43.008+0000 7faff4e00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:43.010 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-21T06:03:43.008+0000 7f067fc00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:43.011 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-21T06:03:43.008+0000 7f44dc400640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:03:48.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:48.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:49.524 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 -- 172.21.15.118:0/4088474145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f00cfe30 msgr2=0x7f94f00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 --2- 172.21.15.118:0/4088474145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f00cfe30 0x7f94f00d0240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cd9f0 tx=0x7f94d802a4a0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 -- 172.21.15.118:0/4088474145 shutdown_connections 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 --2- 172.21.15.118:0/4088474145 >> v2:172.21.15.149:3300/0 conn(0x7f94f00b5bb0 0x7f94f00b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 --2- 172.21.15.118:0/4088474145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f00cfe30 0x7f94f00d0240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 -- 172.21.15.118:0/4088474145 >> 172.21.15.118:0/4088474145 conn(0x7f94f006d6e0 msgr2=0x7f94f00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 -- 172.21.15.118:0/4088474145 shutdown_connections 2024-09-21T06:03:49.744 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.742+0000 7f94efe00640 1 -- 172.21.15.118:0/4088474145 wait complete. 2024-09-21T06:03:49.746 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.744+0000 7f94efe00640 1 Processor -- start 2024-09-21T06:03:49.746 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.744+0000 7f94efe00640 1 -- start start 2024-09-21T06:03:49.748 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94efe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f0073fa0 0x7f94f00c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94efe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f00b5bb0 0x7f94f0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f00cfe30 0x7f94f01f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94efe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f94f015d9c0 con 0x7f94f0073fa0 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94efe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94f015d840 con 0x7f94f00cfe30 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94efe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94f015db40 con 0x7f94f00b5bb0 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94eea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f0073fa0 0x7f94f00c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94eea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f0073fa0 0x7f94f00c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43582/0 (socket says 172.21.15.118:43582) 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94eea00640 1 -- 172.21.15.118:0/3805569958 learned_addr learned my addr 172.21.15.118:0/3805569958 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94e6000640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f00b5bb0 0x7f94f0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.746+0000 7f94ef400640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f00cfe30 0x7f94f01f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94eea00640 1 -- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f00b5bb0 msgr2=0x7f94f0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.749 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94eea00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f00b5bb0 0x7f94f0156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94eea00640 1 -- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f00cfe30 msgr2=0x7f94f01f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94eea00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f00cfe30 0x7f94f01f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94eea00640 1 -- 172.21.15.118:0/3805569958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f01ec0d0 con 0x7f94f0073fa0 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94ef400640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f00cfe30 0x7f94f01f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94eea00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f0073fa0 0x7f94f00c5810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94e000c760 tx=0x7f94e000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94e7400640 1 -- 172.21.15.118:0/3805569958 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0016020 con 0x7f94f0073fa0 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94e7400640 1 -- 172.21.15.118:0/3805569958 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94e000a950 con 0x7f94f0073fa0 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f01565d0 con 0x7f94f0073fa0 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94e7400640 1 -- 172.21.15.118:0/3805569958 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e000ada0 con 0x7f94f0073fa0 2024-09-21T06:03:49.750 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.747+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f01e9cf0 con 0x7f94f0073fa0 2024-09-21T06:03:49.751 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.748+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f015e060 con 0x7f94f0073fa0 2024-09-21T06:03:49.751 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.750+0000 7f94e7400640 1 -- 172.21.15.118:0/3805569958 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94e0019020 con 0x7f94f0073fa0 2024-09-21T06:03:49.752 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.751+0000 7f94e7400640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f94cc078bc0 0x7f94cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.752 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.751+0000 7f94e7400640 1 -- 172.21.15.118:0/3805569958 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f94e009a8c0 con 0x7f94f0073fa0 2024-09-21T06:03:49.753 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.752+0000 7f94e6000640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f94cc078bc0 0x7f94cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.754 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.753+0000 7f94e6000640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f94cc078bc0 0x7f94cc07b0d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f94d8034000 tx=0x7f94d8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:49.757 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.756+0000 7f94e7400640 1 -- 172.21.15.118:0/3805569958 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f94e0020020 con 0x7f94f0073fa0 2024-09-21T06:03:49.946 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.944+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94f0156a50 con 0x7f94f0073fa0 2024-09-21T06:03:49.946 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.945+0000 7f94e7400640 1 -- 172.21.15.118:0/3805569958 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12968 (secure 0 0 0) 0x7f94f00b6500 con 0x7f94f0073fa0 2024-09-21T06:03:49.946 INFO:teuthology.misc.health.smithi118.stdout: 2024-09-21T06:03:49.947 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":16,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:47.376923+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:03:49.949 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f94cc078bc0 msgr2=0x7f94cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.949 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f94cc078bc0 0x7f94cc07b0d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f94d8034000 tx=0x7f94d8004730 comp rx=0 tx=0).stop 2024-09-21T06:03:49.949 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f0073fa0 msgr2=0x7f94f00c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f0073fa0 0x7f94f00c5810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94e000c760 tx=0x7f94e000cc20 comp rx=0 tx=0).stop 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 shutdown_connections 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f00cfe30 0x7f94f01f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f94cc078bc0 0x7f94cc07b0d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f00b5bb0 0x7f94f0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 --2- 172.21.15.118:0/3805569958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94f0073fa0 0x7f94f00c5810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 >> 172.21.15.118:0/3805569958 conn(0x7f94f006d6e0 msgr2=0x7f94f00749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.947+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 shutdown_connections 2024-09-21T06:03:49.950 INFO:teuthology.misc.health.smithi118.stderr:2024-09-21T06:03:49.948+0000 7f94efe00640 1 -- 172.21.15.118:0/3805569958 wait complete. 2024-09-21T06:03:49.967 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T06:03:49.967 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T06:03:49.967 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:03:49.968 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:03:49.971 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:03:49.971 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:03:49.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:03:49.975 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:03:49.975 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:03:49.975 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:03:49.980 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:03:49.980 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:03:49.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:03:49.984 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:03:49.984 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T06:03:49.984 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:03:50.166 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:03:50.166 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:03:50.183 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:03:50.185 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:03:50.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 -- 172.21.15.118:0/1507635784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4830 msgr2=0x7f592c0cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 --2- 172.21.15.118:0/1507635784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4830 0x7f592c0cf600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f592c0b5940 tx=0x7f591802a5a0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 -- 172.21.15.118:0/1507635784 shutdown_connections 2024-09-21T06:03:50.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 --2- 172.21.15.118:0/1507635784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4830 0x7f592c0cf600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 --2- 172.21.15.118:0/1507635784 >> v2:172.21.15.149:3300/0 conn(0x7f592c148a00 0x7f592c163600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 -- 172.21.15.118:0/1507635784 >> 172.21.15.118:0/1507635784 conn(0x7f592c071070 msgr2=0x7f592c071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:50.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 -- 172.21.15.118:0/1507635784 shutdown_connections 2024-09-21T06:03:50.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.213+0000 7f5932200640 1 -- 172.21.15.118:0/1507635784 wait complete. 2024-09-21T06:03:50.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.215+0000 7f5932200640 1 Processor -- start 2024-09-21T06:03:50.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.215+0000 7f5932200640 1 -- start start 2024-09-21T06:03:50.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f5932200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592c0b4830 0x7f592c142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f5932200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4c40 0x7f592c1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f5932200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f592c148a00 0x7f592c15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f5932200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0cfed0 con 0x7f592c0b4c40 2024-09-21T06:03:50.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f5932200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0cfd50 con 0x7f592c148a00 2024-09-21T06:03:50.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f5932200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f592c0b7930 con 0x7f592c0b4830 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f592aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4c40 0x7f592c1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f592aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4c40 0x7f592c1f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43644/0 (socket says 172.21.15.118:43644) 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f592aa00640 1 -- 172.21.15.118:0/1120199672 learned_addr learned my addr 172.21.15.118:0/1120199672 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.217+0000 7f592be00640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f592c148a00 0x7f592c15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f592aa00640 1 -- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592c0b4830 msgr2=0x7f592c142150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f592aa00640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592c0b4830 0x7f592c142150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f592aa00640 1 -- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f592c148a00 msgr2=0x7f592c15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f592aa00640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f592c148a00 0x7f592c15ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f592aa00640 1 -- 172.21.15.118:0/1120199672 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c1fa380 con 0x7f592c0b4c40 2024-09-21T06:03:50.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f592aa00640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4c40 0x7f592c1f6da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5918034040 tx=0x7f59180039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:50.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f5923400640 1 -- 172.21.15.118:0/1120199672 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591803e030 con 0x7f592c0b4c40 2024-09-21T06:03:50.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f5923400640 1 -- 172.21.15.118:0/1120199672 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59180047a0 con 0x7f592c0b4c40 2024-09-21T06:03:50.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f5923400640 1 -- 172.21.15.118:0/1120199672 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918035040 con 0x7f592c0b4c40 2024-09-21T06:03:50.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592c1fa660 con 0x7f592c0b4c40 2024-09-21T06:03:50.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.218+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592c0b7670 con 0x7f592c0b4c40 2024-09-21T06:03:50.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.219+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592c142fb0 con 0x7f592c0b4c40 2024-09-21T06:03:50.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.221+0000 7f5923400640 1 -- 172.21.15.118:0/1120199672 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5918041030 con 0x7f592c0b4c40 2024-09-21T06:03:50.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.222+0000 7f5923400640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f590c078b90 0x7f590c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.222+0000 7f5923400640 1 -- 172.21.15.118:0/1120199672 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f59180bb1c0 con 0x7f592c0b4c40 2024-09-21T06:03:50.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.223+0000 7f592b400640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f590c078b90 0x7f590c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.226+0000 7f5923400640 1 -- 172.21.15.118:0/1120199672 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f59180832f0 con 0x7f592c0b4c40 2024-09-21T06:03:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.226+0000 7f592b400640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f590c078b90 0x7f590c07b0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f591c0095d0 tx=0x7f591c006b30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:50.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.450+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f592c160060 con 0x7f592c0b4c40 2024-09-21T06:03:50.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.451+0000 7f5923400640 1 -- 172.21.15.118:0/1120199672 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f5918087d20 con 0x7f592c0b4c40 2024-09-21T06:03:50.453 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:50.453 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":2,"btime":"2024-09-21T06:03:50:172647+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:03:50.453 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 2 2024-09-21T06:03:50.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f590c078b90 msgr2=0x7f590c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f590c078b90 0x7f590c07b0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f591c0095d0 tx=0x7f591c006b30 comp rx=0 tx=0).stop 2024-09-21T06:03:50.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4c40 msgr2=0x7f592c1f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4c40 0x7f592c1f6da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5918034040 tx=0x7f59180039e0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 shutdown_connections 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f592c148a00 0x7f592c15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c0b4c40 0x7f592c1f6da0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f590c078b90 0x7f590c07b0a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 --2- 172.21.15.118:0/1120199672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592c0b4830 0x7f592c142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 >> 172.21.15.118:0/1120199672 conn(0x7f592c071070 msgr2=0x7f592c0cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.453+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 shutdown_connections 2024-09-21T06:03:50.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:50.454+0000 7f5932200640 1 -- 172.21.15.118:0/1120199672 wait complete. 2024-09-21T06:03:52.477 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:03:52.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.720+0000 7f6e47a00640 1 -- 172.21.15.118:0/3515483270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400b3a60 msgr2=0x7f6e400cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.720+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3515483270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400b3a60 0x7f6e400cca40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005fd0 tx=0x7f6e2802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.720+0000 7f6e47a00640 1 -- 172.21.15.118:0/3515483270 shutdown_connections 2024-09-21T06:03:52.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.720+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3515483270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400b3a60 0x7f6e400cca40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.720+0000 7f6e47a00640 1 -- 172.21.15.118:0/3515483270 >> 172.21.15.118:0/3515483270 conn(0x7f6e4006d110 msgr2=0x7f6e4006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:52.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.720+0000 7f6e47a00640 1 -- 172.21.15.118:0/3515483270 shutdown_connections 2024-09-21T06:03:52.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.720+0000 7f6e47a00640 1 -- 172.21.15.118:0/3515483270 wait complete. 2024-09-21T06:03:52.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.722+0000 7f6e47a00640 1 Processor -- start 2024-09-21T06:03:52.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.723+0000 7f6e47a00640 1 -- start start 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e47a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e400b3a60 0x7f6e400b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e47a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400ccf80 0x7f6e401f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e47a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4015cfd0 0x7f6e401f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e47a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6e40073ec0 con 0x7f6e400ccf80 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e47a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e40073d40 con 0x7f6e4015cfd0 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e47a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e40074040 con 0x7f6e400b3a60 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400ccf80 0x7f6e401f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400ccf80 0x7f6e401f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43672/0 (socket says 172.21.15.118:43672) 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.724+0000 7f6e37e00640 1 -- 172.21.15.118:0/3506374847 learned_addr learned my addr 172.21.15.118:0/3506374847 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e37e00640 1 -- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e400b3a60 msgr2=0x7f6e400b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e37e00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e400b3a60 0x7f6e400b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e37e00640 1 -- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4015cfd0 msgr2=0x7f6e401f7ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:03:52.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e37e00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4015cfd0 0x7f6e401f7ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e37e00640 1 -- 172.21.15.118:0/3506374847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e400b30a0 con 0x7f6e400ccf80 2024-09-21T06:03:52.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e37e00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400ccf80 0x7f6e401f7570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e28034040 tx=0x7f6e280038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:52.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e3d600640 1 -- 172.21.15.118:0/3506374847 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2803e030 con 0x7f6e400ccf80 2024-09-21T06:03:52.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e3d600640 1 -- 172.21.15.118:0/3506374847 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e28003ca0 con 0x7f6e400ccf80 2024-09-21T06:03:52.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e401f8310 con 0x7f6e400ccf80 2024-09-21T06:03:52.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e3d600640 1 -- 172.21.15.118:0/3506374847 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28035040 con 0x7f6e400ccf80 2024-09-21T06:03:52.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.725+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e400c5cb0 con 0x7f6e400ccf80 2024-09-21T06:03:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.726+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e401f8080 con 0x7f6e400ccf80 2024-09-21T06:03:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.728+0000 7f6e3d600640 1 -- 172.21.15.118:0/3506374847 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e28041030 con 0x7f6e400ccf80 2024-09-21T06:03:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.729+0000 7f6e3d600640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e1c078bc0 0x7f6e1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.729+0000 7f6e3d600640 1 -- 172.21.15.118:0/3506374847 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6e280bb0b0 con 0x7f6e400ccf80 2024-09-21T06:03:52.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.729+0000 7f6e45000640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e1c078bc0 0x7f6e1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:52.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.730+0000 7f6e45000640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e1c078bc0 0x7f6e1c07b0d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000f60 tx=0x7f6e300079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:52.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.734+0000 7f6e3d600640 1 -- 172.21.15.118:0/3506374847 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6e400b30a0 con 0x7f6e400ccf80 2024-09-21T06:03:52.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.956+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e40074510 con 0x7f6e400ccf80 2024-09-21T06:03:52.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.957+0000 7f6e3d600640 1 -- 172.21.15.118:0/3506374847 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7f6e28083830 con 0x7f6e400ccf80 2024-09-21T06:03:52.958 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:52.958 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"btime":"2024-09-21T06:03:51:174120+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4411,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T06:03:52.959 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 3 2024-09-21T06:03:52.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e1c078bc0 msgr2=0x7f6e1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e1c078bc0 0x7f6e1c07b0d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000f60 tx=0x7f6e300079b0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400ccf80 msgr2=0x7f6e401f7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400ccf80 0x7f6e401f7570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e28034040 tx=0x7f6e280038a0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 shutdown_connections 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e4015cfd0 0x7f6e401f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e400ccf80 0x7f6e401f7570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e1c078bc0 0x7f6e1c07b0d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 --2- 172.21.15.118:0/3506374847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e400b3a60 0x7f6e400b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 >> 172.21.15.118:0/3506374847 conn(0x7f6e4006d110 msgr2=0x7f6e40157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 shutdown_connections 2024-09-21T06:03:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:52.959+0000 7f6e47a00640 1 -- 172.21.15.118:0/3506374847 wait complete. 2024-09-21T06:03:52.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:03:53.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.201+0000 7f92ed800640 1 -- 172.21.15.118:0/2859174986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc003a00 msgr2=0x7f92cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.201+0000 7f92ed800640 1 --2- 172.21.15.118:0/2859174986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc003a00 0x7f92cc003e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009b50 tx=0x7f92cc005830 comp rx=0 tx=0).stop 2024-09-21T06:03:53.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.201+0000 7f92e7400640 1 -- 172.21.15.118:0/2859174986 reap_dead start 2024-09-21T06:03:53.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.201+0000 7f92ed800640 1 -- 172.21.15.118:0/2859174986 shutdown_connections 2024-09-21T06:03:53.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.201+0000 7f92ed800640 1 -- 172.21.15.118:0/2859174986 >> 172.21.15.118:0/2859174986 conn(0x7f92e806d110 msgr2=0x7f92e806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:53.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.201+0000 7f92ed800640 1 -- 172.21.15.118:0/2859174986 shutdown_connections 2024-09-21T06:03:53.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.201+0000 7f92ed800640 1 -- 172.21.15.118:0/2859174986 wait complete. 2024-09-21T06:03:53.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.204+0000 7f92ed800640 1 Processor -- start 2024-09-21T06:03:53.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.204+0000 7f92ed800640 1 -- start start 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92ed800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc003a00 0x7f92e813a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92ed800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92e815c4a0 0x7f92e815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92ed800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e815fb50 0x7f92e80c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92ed800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f92e80cf5d0 con 0x7f92e815fb50 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92ed800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f92e80cf450 con 0x7f92e815c4a0 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92ed800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92e80cf750 con 0x7f92cc003a00 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92e7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e815fb50 0x7f92e80c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92e7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e815fb50 0x7f92e80c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43694/0 (socket says 172.21.15.118:43694) 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.205+0000 7f92e7400640 1 -- 172.21.15.118:0/470883823 learned_addr learned my addr 172.21.15.118:0/470883823 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e6a00640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc003a00 0x7f92e813a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e6000640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92e815c4a0 0x7f92e815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e7400640 1 -- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc003a00 msgr2=0x7f92e813a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e7400640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc003a00 0x7f92e813a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e7400640 1 -- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92e815c4a0 msgr2=0x7f92e815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e7400640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92e815c4a0 0x7f92e815f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e7400640 1 -- 172.21.15.118:0/470883823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e813a8f0 con 0x7f92e815fb50 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92e7400640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e815fb50 0x7f92e80c59d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92e80ceb10 tx=0x7f92e0011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92dea00640 1 -- 172.21.15.118:0/470883823 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0004b20 con 0x7f92e815fb50 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92dea00640 1 -- 172.21.15.118:0/470883823 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e0004cc0 con 0x7f92e815fb50 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e815ff60 con 0x7f92e815fb50 2024-09-21T06:03:53.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.206+0000 7f92dea00640 1 -- 172.21.15.118:0/470883823 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0003bd0 con 0x7f92e815fb50 2024-09-21T06:03:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.207+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e8155330 con 0x7f92e815fb50 2024-09-21T06:03:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.207+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e80d12f0 con 0x7f92e815fb50 2024-09-21T06:03:53.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.209+0000 7f92dea00640 1 -- 172.21.15.118:0/470883823 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92e0004030 con 0x7f92e815fb50 2024-09-21T06:03:53.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.210+0000 7f92dea00640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92c8078b90 0x7f92c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.210+0000 7f92dea00640 1 -- 172.21.15.118:0/470883823 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f92e009b600 con 0x7f92e815fb50 2024-09-21T06:03:53.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.210+0000 7f92e6a00640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92c8078b90 0x7f92c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.211+0000 7f92e6a00640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92c8078b90 0x7f92c807b0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92d8035000 tx=0x7f92d802d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:53.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.213+0000 7f92dea00640 1 -- 172.21.15.118:0/470883823 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92e815ff60 con 0x7f92e815fb50 2024-09-21T06:03:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.402+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f92e81f9220 con 0x7f92e815fb50 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.404+0000 7f92dea00640 1 -- 172.21.15.118:0/470883823 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f92e001f060 con 0x7f92e815fb50 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:03:53.406 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:03:53.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92c8078b90 msgr2=0x7f92c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92c8078b90 0x7f92c807b0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92d8035000 tx=0x7f92d802d040 comp rx=0 tx=0).stop 2024-09-21T06:03:53.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e815fb50 msgr2=0x7f92e80c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e815fb50 0x7f92e80c59d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92e80ceb10 tx=0x7f92e0011ef0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 shutdown_connections 2024-09-21T06:03:53.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92e815fb50 0x7f92e80c59d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92e815c4a0 0x7f92e815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92c8078b90 0x7f92c807b0a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 --2- 172.21.15.118:0/470883823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc003a00 0x7f92e813a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.407+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 >> 172.21.15.118:0/470883823 conn(0x7f92e806d110 msgr2=0x7f92e8157260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:53.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.408+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 shutdown_connections 2024-09-21T06:03:53.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.408+0000 7f92ed800640 1 -- 172.21.15.118:0/470883823 wait complete. 2024-09-21T06:03:53.431 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:03:53.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:03:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.657+0000 7ffbdae00640 1 -- 172.21.15.118:0/3273435518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 msgr2=0x7ffbb8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.657+0000 7ffbdae00640 1 --2- 172.21.15.118:0/3273435518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 0x7ffbb8004800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009b50 tx=0x7ffbb8005830 comp rx=0 tx=0).stop 2024-09-21T06:03:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.657+0000 7ffbd8e00640 1 -- 172.21.15.118:0/3273435518 reap_dead start 2024-09-21T06:03:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.657+0000 7ffbdae00640 1 -- 172.21.15.118:0/3273435518 shutdown_connections 2024-09-21T06:03:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.657+0000 7ffbdae00640 1 -- 172.21.15.118:0/3273435518 >> 172.21.15.118:0/3273435518 conn(0x7ffbd406cf30 msgr2=0x7ffbd406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.657+0000 7ffbdae00640 1 -- 172.21.15.118:0/3273435518 shutdown_connections 2024-09-21T06:03:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.657+0000 7ffbdae00640 1 -- 172.21.15.118:0/3273435518 wait complete. 2024-09-21T06:03:53.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.659+0000 7ffbdae00640 1 Processor -- start 2024-09-21T06:03:53.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.660+0000 7ffbdae00640 1 -- start start 2024-09-21T06:03:53.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbdae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 0x7ffbd41438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbdae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd41402d0 0x7ffbd413faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbdae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd415b500 0x7ffbd415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbdae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd40703c0 con 0x7ffbb8003fd0 2024-09-21T06:03:53.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbdae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4070240 con 0x7ffbd41402d0 2024-09-21T06:03:53.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbdae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd4070540 con 0x7ffbd415b500 2024-09-21T06:03:53.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbd3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 0x7ffbd41438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbd3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 0x7ffbd41438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43716/0 (socket says 172.21.15.118:43716) 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbd3e00640 1 -- 172.21.15.118:0/672144803 learned_addr learned my addr 172.21.15.118:0/672144803 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbd8e00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd415b500 0x7ffbd415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.661+0000 7ffbcb400640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd41402d0 0x7ffbd413faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd3e00640 1 -- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd415b500 msgr2=0x7ffbd415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd3e00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd415b500 0x7ffbd415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd3e00640 1 -- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd41402d0 msgr2=0x7ffbd413faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd3e00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd41402d0 0x7ffbd413faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd3e00640 1 -- 172.21.15.118:0/672144803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd415be50 con 0x7ffbb8003fd0 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd8e00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd415b500 0x7ffbd415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbcb400640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd41402d0 0x7ffbd413faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd3e00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 0x7ffbd41438b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4011b10 tx=0x7ffbc4009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd0c00640 1 -- 172.21.15.118:0/672144803 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc401e070 con 0x7ffbb8003fd0 2024-09-21T06:03:53.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd0c00640 1 -- 172.21.15.118:0/672144803 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbc4004050 con 0x7ffbb8003fd0 2024-09-21T06:03:53.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd4141c50 con 0x7ffbb8003fd0 2024-09-21T06:03:53.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbd0c00640 1 -- 172.21.15.118:0/672144803 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400fea0 con 0x7ffbb8003fd0 2024-09-21T06:03:53.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.662+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd4142210 con 0x7ffbb8003fd0 2024-09-21T06:03:53.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.663+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd40b3650 con 0x7ffbb8003fd0 2024-09-21T06:03:53.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.664+0000 7ffbd0c00640 1 -- 172.21.15.118:0/672144803 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffbc4021070 con 0x7ffbb8003fd0 2024-09-21T06:03:53.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.665+0000 7ffbd0c00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffbb0078b90 0x7ffbb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.665+0000 7ffbd0c00640 1 -- 172.21.15.118:0/672144803 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ffbc409b440 con 0x7ffbb8003fd0 2024-09-21T06:03:53.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.666+0000 7ffbcb400640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffbb0078b90 0x7ffbb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.667+0000 7ffbcb400640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffbb0078b90 0x7ffbb007b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc035000 tx=0x7ffbbc0046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:53.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.670+0000 7ffbd0c00640 1 -- 172.21.15.118:0/672144803 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffbd40b3650 con 0x7ffbb8003fd0 2024-09-21T06:03:53.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:53.857+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffbd40b57e0 con 0x7ffbb8003fd0 2024-09-21T06:03:54.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.413+0000 7ffbd0c00640 1 -- 172.21.15.118:0/672144803 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7ffbd40b57e0 con 0x7ffbb8003fd0 2024-09-21T06:03:54.415 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffbb0078b90 msgr2=0x7ffbb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffbb0078b90 0x7ffbb007b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc035000 tx=0x7ffbbc0046c0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 msgr2=0x7ffbd41438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 0x7ffbd41438b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4011b10 tx=0x7ffbc4009e90 comp rx=0 tx=0).stop 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 shutdown_connections 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffbb0078b90 0x7ffbb007b0a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd415b500 0x7ffbd415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd41402d0 0x7ffbd413faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 --2- 172.21.15.118:0/672144803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbb8003fd0 0x7ffbd41438b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.416+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 >> 172.21.15.118:0/672144803 conn(0x7ffbd406cf30 msgr2=0x7ffbd415fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:54.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.417+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 shutdown_connections 2024-09-21T06:03:54.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.418+0000 7ffbdae00640 1 -- 172.21.15.118:0/672144803 wait complete. 2024-09-21T06:03:54.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:03:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.674+0000 7eff08400640 1 -- 172.21.15.118:0/4204457120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff000d1590 msgr2=0x7eff00142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.674+0000 7eff08400640 1 --2- 172.21.15.118:0/4204457120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff000d1590 0x7eff00142730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efeec009830 tx=0x7efeec02a4b0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.674+0000 7eff08400640 1 -- 172.21.15.118:0/4204457120 shutdown_connections 2024-09-21T06:03:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.674+0000 7eff08400640 1 --2- 172.21.15.118:0/4204457120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff000d1590 0x7eff00142730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.674+0000 7eff08400640 1 -- 172.21.15.118:0/4204457120 >> 172.21.15.118:0/4204457120 conn(0x7eff0006d110 msgr2=0x7eff0006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.674+0000 7eff08400640 1 -- 172.21.15.118:0/4204457120 shutdown_connections 2024-09-21T06:03:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.674+0000 7eff08400640 1 -- 172.21.15.118:0/4204457120 wait complete. 2024-09-21T06:03:54.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.676+0000 7eff08400640 1 Processor -- start 2024-09-21T06:03:54.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.677+0000 7eff08400640 1 -- start start 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff08400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff0013fae0 0x7eff001f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff08400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff0013fef0 0x7eff001f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff08400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0013a030 0x7eff00138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff08400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7eff00168280 con 0x7eff0013fae0 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff08400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff00168100 con 0x7eff0013a030 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff08400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff00168400 con 0x7eff0013fef0 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff05a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff0013fae0 0x7eff001f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff05a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff0013fae0 0x7eff001f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43718/0 (socket says 172.21.15.118:43718) 2024-09-21T06:03:54.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.678+0000 7eff05a00640 1 -- 172.21.15.118:0/3844812187 learned_addr learned my addr 172.21.15.118:0/3844812187 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff06400640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0013a030 0x7eff00138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff05000640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff0013fef0 0x7eff001f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff05a00640 1 -- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff0013fef0 msgr2=0x7eff001f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff05a00640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff0013fef0 0x7eff001f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff05a00640 1 -- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0013a030 msgr2=0x7eff00138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff05a00640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0013a030 0x7eff00138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff05a00640 1 -- 172.21.15.118:0/3844812187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff001f6ed0 con 0x7eff0013fae0 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff05a00640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff0013fae0 0x7eff001f7970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efef400c4b0 tx=0x7efef400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7efefd600640 1 -- 172.21.15.118:0/3844812187 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4016020 con 0x7eff0013fae0 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7efefd600640 1 -- 172.21.15.118:0/3844812187 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef4012920 con 0x7eff0013fae0 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0013a6d0 con 0x7eff0013fae0 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.679+0000 7efefd600640 1 -- 172.21.15.118:0/3844812187 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4012d70 con 0x7eff0013fae0 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.680+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff001f7170 con 0x7eff0013fae0 2024-09-21T06:03:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.680+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff000d0e80 con 0x7eff0013fae0 2024-09-21T06:03:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.682+0000 7efefd600640 1 -- 172.21.15.118:0/3844812187 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efef4019020 con 0x7eff0013fae0 2024-09-21T06:03:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.683+0000 7efefd600640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efee0078bc0 0x7efee007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.683+0000 7efefd600640 1 -- 172.21.15.118:0/3844812187 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7efef409a610 con 0x7eff0013fae0 2024-09-21T06:03:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.684+0000 7eff05000640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efee0078bc0 0x7efee007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.685+0000 7eff05000640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efee0078bc0 0x7efee007b0d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efeec034000 tx=0x7efeec004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:54.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.688+0000 7efefd600640 1 -- 172.21.15.118:0/3844812187 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efef4020070 con 0x7eff0013fae0 2024-09-21T06:03:54.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:54.873+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7eff001613c0 con 0x7eff0013fae0 2024-09-21T06:03:55.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.420+0000 7efefd600640 1 -- 172.21.15.118:0/3844812187 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7efef4062cc0 con 0x7eff0013fae0 2024-09-21T06:03:55.422 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:03:55.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.423+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efee0078bc0 msgr2=0x7efee007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:55.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.423+0000 7eff08400640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efee0078bc0 0x7efee007b0d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efeec034000 tx=0x7efeec004730 comp rx=0 tx=0).stop 2024-09-21T06:03:55.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.423+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff0013fae0 msgr2=0x7eff001f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:55.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.423+0000 7eff08400640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff0013fae0 0x7eff001f7970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efef400c4b0 tx=0x7efef400c970 comp rx=0 tx=0).stop 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 shutdown_connections 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff0013a030 0x7eff00138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efee0078bc0 0x7efee007b0d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff0013fef0 0x7eff001f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 --2- 172.21.15.118:0/3844812187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff0013fae0 0x7eff001f7970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 >> 172.21.15.118:0/3844812187 conn(0x7eff0006d110 msgr2=0x7eff0014f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 shutdown_connections 2024-09-21T06:03:55.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.424+0000 7eff08400640 1 -- 172.21.15.118:0/3844812187 wait complete. 2024-09-21T06:03:55.458 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:03:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 -- 172.21.15.118:0/3501083441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca700d1590 msgr2=0x7fca70142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 --2- 172.21.15.118:0/3501083441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca700d1590 0x7fca70142730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca58009830 tx=0x7fca5802a510 comp rx=0 tx=0).stop 2024-09-21T06:03:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 -- 172.21.15.118:0/3501083441 shutdown_connections 2024-09-21T06:03:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 --2- 172.21.15.118:0/3501083441 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca7013fef0 0x7fca70142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 --2- 172.21.15.118:0/3501083441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca700d1590 0x7fca70142730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 -- 172.21.15.118:0/3501083441 >> 172.21.15.118:0/3501083441 conn(0x7fca7006d110 msgr2=0x7fca7006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:55.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 -- 172.21.15.118:0/3501083441 shutdown_connections 2024-09-21T06:03:55.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.680+0000 7fca76800640 1 -- 172.21.15.118:0/3501083441 wait complete. 2024-09-21T06:03:55.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.683+0000 7fca76800640 1 Processor -- start 2024-09-21T06:03:55.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.683+0000 7fca76800640 1 -- start start 2024-09-21T06:03:55.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.684+0000 7fca76800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca7013fae0 0x7fca7013b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:55.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.684+0000 7fca76800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7013fef0 0x7fca70142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.684+0000 7fca76800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca701f9f30 0x7fca70073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.684+0000 7fca76800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca700cfac0 con 0x7fca7013fef0 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.684+0000 7fca76800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca700cf940 con 0x7fca7013fae0 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.684+0000 7fca76800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fca700cfc40 con 0x7fca701f9f30 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7013fef0 0x7fca70142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7013fef0 0x7fca70142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43724/0 (socket says 172.21.15.118:43724) 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 -- 172.21.15.118:0/2532448764 learned_addr learned my addr 172.21.15.118:0/2532448764 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca6fe00640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca701f9f30 0x7fca70073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca6f400640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca7013fae0 0x7fca7013b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 -- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca701f9f30 msgr2=0x7fca70073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca701f9f30 0x7fca70073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 -- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca7013fae0 msgr2=0x7fca7013b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca7013fae0 0x7fca7013b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:55.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 -- 172.21.15.118:0/2532448764 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7013bae0 con 0x7fca7013fef0 2024-09-21T06:03:55.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.685+0000 7fca66a00640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7013fef0 0x7fca70142020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca58000c00 tx=0x7fca58033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:55.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.686+0000 7fca67e00640 1 -- 172.21.15.118:0/2532448764 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58031d60 con 0x7fca7013fef0 2024-09-21T06:03:55.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.686+0000 7fca67e00640 1 -- 172.21.15.118:0/2532448764 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca580330d0 con 0x7fca7013fef0 2024-09-21T06:03:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.686+0000 7fca67e00640 1 -- 172.21.15.118:0/2532448764 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58033520 con 0x7fca7013fef0 2024-09-21T06:03:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.686+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca701f9450 con 0x7fca7013fef0 2024-09-21T06:03:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.686+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca701f9a10 con 0x7fca7013fef0 2024-09-21T06:03:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.687+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7013b850 con 0x7fca7013fef0 2024-09-21T06:03:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.688+0000 7fca67e00640 1 -- 172.21.15.118:0/2532448764 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca580035f0 con 0x7fca7013fef0 2024-09-21T06:03:55.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.689+0000 7fca67e00640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca4c078b90 0x7fca4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:55.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.689+0000 7fca67e00640 1 -- 172.21.15.118:0/2532448764 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fca580bc140 con 0x7fca7013fef0 2024-09-21T06:03:55.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.690+0000 7fca6f400640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca4c078b90 0x7fca4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:55.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.690+0000 7fca6f400640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca4c078b90 0x7fca4c07b0a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca60001720 tx=0x7fca60007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:55.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.694+0000 7fca67e00640 1 -- 172.21.15.118:0/2532448764 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fca5803f030 con 0x7fca7013fef0 2024-09-21T06:03:55.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:55.914+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fca700d0130 con 0x7fca7013fef0 2024-09-21T06:03:56.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.423+0000 7fca67e00640 1 -- 172.21.15.118:0/2532448764 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fca58083f80 con 0x7fca7013fef0 2024-09-21T06:03:56.425 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T06:03:56.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.427+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca4c078b90 msgr2=0x7fca4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.427+0000 7fca76800640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca4c078b90 0x7fca4c07b0a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fca60001720 tx=0x7fca60007e90 comp rx=0 tx=0).stop 2024-09-21T06:03:56.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.427+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7013fef0 msgr2=0x7fca70142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.427+0000 7fca76800640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7013fef0 0x7fca70142020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca58000c00 tx=0x7fca58033d60 comp rx=0 tx=0).stop 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 shutdown_connections 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca4c078b90 0x7fca4c07b0a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca701f9f30 0x7fca70073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7013fef0 0x7fca70142020 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 --2- 172.21.15.118:0/2532448764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca7013fae0 0x7fca7013b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 >> 172.21.15.118:0/2532448764 conn(0x7fca7006d110 msgr2=0x7fca7015fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 shutdown_connections 2024-09-21T06:03:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.428+0000 7fca76800640 1 -- 172.21.15.118:0/2532448764 wait complete. 2024-09-21T06:03:56.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:03:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.689+0000 7fcb0c400640 1 -- 172.21.15.118:0/740259779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 msgr2=0x7fcaec004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.689+0000 7fcb0c400640 1 --2- 172.21.15.118:0/740259779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 0x7fcaec004c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009b50 tx=0x7fcaec005830 comp rx=0 tx=0).stop 2024-09-21T06:03:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.689+0000 7fcb0a400640 1 -- 172.21.15.118:0/740259779 reap_dead start 2024-09-21T06:03:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.689+0000 7fcb0c400640 1 -- 172.21.15.118:0/740259779 shutdown_connections 2024-09-21T06:03:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.689+0000 7fcb0c400640 1 -- 172.21.15.118:0/740259779 >> 172.21.15.118:0/740259779 conn(0x7fcb0406d110 msgr2=0x7fcb0406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.689+0000 7fcb0c400640 1 -- 172.21.15.118:0/740259779 shutdown_connections 2024-09-21T06:03:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.689+0000 7fcb0c400640 1 -- 172.21.15.118:0/740259779 wait complete. 2024-09-21T06:03:56.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.691+0000 7fcb0c400640 1 Processor -- start 2024-09-21T06:03:56.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.692+0000 7fcb0c400640 1 -- start start 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb0c400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 0x7fcb04139430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb0c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb0415f740 0x7fcb0415fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb0c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0413ea20 0x7fcb0413ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb0c400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcb040cf5d0 con 0x7fcaec004800 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb0c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb040cf450 con 0x7fcb0413ea20 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb0c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcb040cf750 con 0x7fcb0415f740 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb09a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 0x7fcb04139430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb09a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 0x7fcb04139430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53444/0 (socket says 172.21.15.118:53444) 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.693+0000 7fcb09a00640 1 -- 172.21.15.118:0/1138342089 learned_addr learned my addr 172.21.15.118:0/1138342089 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb09a00640 1 -- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb0415f740 msgr2=0x7fcb0415fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb0a400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0413ea20 0x7fcb0413ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb09a00640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb0415f740 0x7fcb0415fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb09a00640 1 -- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0413ea20 msgr2=0x7fcb0413ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb09a00640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0413ea20 0x7fcb0413ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb09a00640 1 -- 172.21.15.118:0/1138342089 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0413f370 con 0x7fcaec004800 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb0a400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0413ea20 0x7fcb0413ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb09a00640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 0x7fcb04139430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800e5c0 tx=0x7fcaf800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb01600640 1 -- 172.21.15.118:0/1138342089 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8015070 con 0x7fcaec004800 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb01600640 1 -- 172.21.15.118:0/1138342089 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcaf8010980 con 0x7fcaec004800 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb041601c0 con 0x7fcaec004800 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb01600640 1 -- 172.21.15.118:0/1138342089 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8010d70 con 0x7fcaec004800 2024-09-21T06:03:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.694+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb041f8c80 con 0x7fcaec004800 2024-09-21T06:03:56.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.695+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb041430e0 con 0x7fcaec004800 2024-09-21T06:03:56.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.697+0000 7fcb01600640 1 -- 172.21.15.118:0/1138342089 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcaf8018070 con 0x7fcaec004800 2024-09-21T06:03:56.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.698+0000 7fcb01600640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcae4078bc0 0x7fcae407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.698+0000 7fcb01600640 1 -- 172.21.15.118:0/1138342089 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fcaf809b050 con 0x7fcaec004800 2024-09-21T06:03:56.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.698+0000 7fcb09000640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcae4078bc0 0x7fcae407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:56.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.699+0000 7fcb09000640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcae4078bc0 0x7fcae407b0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009b50 tx=0x7fcaf002d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:56.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.703+0000 7fcb01600640 1 -- 172.21.15.118:0/1138342089 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcb0413f370 con 0x7fcaec004800 2024-09-21T06:03:56.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.890+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb0406dd00 con 0x7fcaec004800 2024-09-21T06:03:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.892+0000 7fcb01600640 1 -- 172.21.15.118:0/1138342089 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16750 (secure 0 0 0) 0x7fcaf8063530 con 0x7fcaec004800 2024-09-21T06:03:56.893 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:56.894 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":19,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:55.915509+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcae4078bc0 msgr2=0x7fcae407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcae4078bc0 0x7fcae407b0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009b50 tx=0x7fcaf002d040 comp rx=0 tx=0).stop 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 msgr2=0x7fcb04139430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 0x7fcb04139430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800e5c0 tx=0x7fcaf800e9c0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 shutdown_connections 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0413ea20 0x7fcb0413ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcae4078bc0 0x7fcae407b0d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb0415f740 0x7fcb0415fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 --2- 172.21.15.118:0/1138342089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaec004800 0x7fcb04139430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 >> 172.21.15.118:0/1138342089 conn(0x7fcb0406d110 msgr2=0x7fcb0415ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:56.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 shutdown_connections 2024-09-21T06:03:56.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:56.894+0000 7fcb0c400640 1 -- 172.21.15.118:0/1138342089 wait complete. 2024-09-21T06:03:56.917 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:03:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 -- 172.21.15.118:0/2613453021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae013fe10 msgr2=0x7ffae00d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 --2- 172.21.15.118:0/2613453021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae013fe10 0x7ffae00d0ec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffad4005fd0 tx=0x7ffad402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 -- 172.21.15.118:0/2613453021 shutdown_connections 2024-09-21T06:03:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 --2- 172.21.15.118:0/2613453021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffae00d1400 0x7ffae01426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 --2- 172.21.15.118:0/2613453021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae013fe10 0x7ffae00d0ec0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 -- 172.21.15.118:0/2613453021 >> 172.21.15.118:0/2613453021 conn(0x7ffae006d110 msgr2=0x7ffae006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 -- 172.21.15.118:0/2613453021 shutdown_connections 2024-09-21T06:03:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.135+0000 7ffae8600640 1 -- 172.21.15.118:0/2613453021 wait complete. 2024-09-21T06:03:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.137+0000 7ffae8600640 1 Processor -- start 2024-09-21T06:03:57.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.137+0000 7ffae8600640 1 -- start start 2024-09-21T06:03:57.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae8600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae00d1400 0x7ffae01313d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae8600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae013fe10 0x7ffae0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae8600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffae0142c00 0x7ffae0143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae8600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffae00d03d0 con 0x7ffae00d1400 2024-09-21T06:03:57.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae8600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffae00d0250 con 0x7ffae013fe10 2024-09-21T06:03:57.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae8600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffae006f3e0 con 0x7ffae0142c00 2024-09-21T06:03:57.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae5c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae00d1400 0x7ffae01313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae5c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae00d1400 0x7ffae01313d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53458/0 (socket says 172.21.15.118:53458) 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae5c00640 1 -- 172.21.15.118:0/994450922 learned_addr learned my addr 172.21.15.118:0/994450922 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae5200640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae013fe10 0x7ffae0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.139+0000 7ffae6600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffae0142c00 0x7ffae0143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae5c00640 1 -- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffae0142c00 msgr2=0x7ffae0143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae5c00640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffae0142c00 0x7ffae0143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae5c00640 1 -- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae013fe10 msgr2=0x7ffae0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae5c00640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae013fe10 0x7ffae0155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae5c00640 1 -- 172.21.15.118:0/994450922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae0131cd0 con 0x7ffae00d1400 2024-09-21T06:03:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae6600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffae0142c00 0x7ffae0143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae5c00640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae00d1400 0x7ffae01313d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffad4000c00 tx=0x7ffad40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffadd600640 1 -- 172.21.15.118:0/994450922 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad403e030 con 0x7ffae00d1400 2024-09-21T06:03:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffadd600640 1 -- 172.21.15.118:0/994450922 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffad4003ca0 con 0x7ffae00d1400 2024-09-21T06:03:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffadd600640 1 -- 172.21.15.118:0/994450922 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad4035040 con 0x7ffae00d1400 2024-09-21T06:03:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae0131fb0 con 0x7ffae00d1400 2024-09-21T06:03:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.140+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae01f93b0 con 0x7ffae00d1400 2024-09-21T06:03:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.141+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffae006f7d0 con 0x7ffae00d1400 2024-09-21T06:03:57.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.143+0000 7ffadd600640 1 -- 172.21.15.118:0/994450922 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffad4041030 con 0x7ffae00d1400 2024-09-21T06:03:57.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.143+0000 7ffadd600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffac0078b90 0x7ffac007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.144+0000 7ffadd600640 1 -- 172.21.15.118:0/994450922 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7ffad40bb250 con 0x7ffae00d1400 2024-09-21T06:03:57.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.144+0000 7ffae5200640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffac0078b90 0x7ffac007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:57.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.145+0000 7ffae5200640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffac0078b90 0x7ffac007b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffae013bb20 tx=0x7ffacc00b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:57.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.148+0000 7ffadd600640 1 -- 172.21.15.118:0/994450922 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffad4083030 con 0x7ffae00d1400 2024-09-21T06:03:57.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.336+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffae0142310 con 0x7ffae00d1400 2024-09-21T06:03:57.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.337+0000 7ffadd600640 1 -- 172.21.15.118:0/994450922 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16750 (secure 0 0 0) 0x7ffad4087a60 con 0x7ffae00d1400 2024-09-21T06:03:57.339 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:57.339 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":19,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:55.915509+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:03:57.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffac0078b90 msgr2=0x7ffac007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffac0078b90 0x7ffac007b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffae013bb20 tx=0x7ffacc00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae00d1400 msgr2=0x7ffae01313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae00d1400 0x7ffae01313d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffad4000c00 tx=0x7ffad40038a0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 shutdown_connections 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffac0078b90 0x7ffac007b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffae0142c00 0x7ffae0143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffae013fe10 0x7ffae0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 --2- 172.21.15.118:0/994450922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae00d1400 0x7ffae01313d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.340+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 >> 172.21.15.118:0/994450922 conn(0x7ffae006d110 msgr2=0x7ffae00b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.341+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 shutdown_connections 2024-09-21T06:03:57.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.341+0000 7ffae8600640 1 -- 172.21.15.118:0/994450922 wait complete. 2024-09-21T06:03:57.363 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:03:57.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.588+0000 7fda73e00640 1 -- 172.21.15.118:0/3200442334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda58004d40 msgr2=0x7fda580051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.588+0000 7fda73e00640 1 --2- 172.21.15.118:0/3200442334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda58004d40 0x7fda580051f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda6c001dc0 tx=0x7fda58005830 comp rx=0 tx=0).stop 2024-09-21T06:03:57.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.588+0000 7fda73400640 1 -- 172.21.15.118:0/3200442334 reap_dead start 2024-09-21T06:03:57.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.588+0000 7fda73e00640 1 -- 172.21.15.118:0/3200442334 shutdown_connections 2024-09-21T06:03:57.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.588+0000 7fda73e00640 1 -- 172.21.15.118:0/3200442334 >> 172.21.15.118:0/3200442334 conn(0x7fda7406d1c0 msgr2=0x7fda7406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:57.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.588+0000 7fda73e00640 1 -- 172.21.15.118:0/3200442334 shutdown_connections 2024-09-21T06:03:57.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.588+0000 7fda73e00640 1 -- 172.21.15.118:0/3200442334 wait complete. 2024-09-21T06:03:57.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.591+0000 7fda73e00640 1 Processor -- start 2024-09-21T06:03:57.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.591+0000 7fda73e00640 1 -- start start 2024-09-21T06:03:57.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda58004d40 0x7fda741548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda741529d0 0x7fda741f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda741f97e0 0x7fda7415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fda7415f9f0 con 0x7fda741f97e0 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda7415f870 con 0x7fda741529d0 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fda740d1d10 con 0x7fda58004d40 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda741f97e0 0x7fda7415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda741f97e0 0x7fda7415c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53488/0 (socket says 172.21.15.118:53488) 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.592+0000 7fda73400640 1 -- 172.21.15.118:0/1892857118 learned_addr learned my addr 172.21.15.118:0/1892857118 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda72000640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda741529d0 0x7fda741f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73400640 1 -- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda58004d40 msgr2=0x7fda741548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73400640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda58004d40 0x7fda741548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73400640 1 -- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda741529d0 msgr2=0x7fda741f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73400640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda741529d0 0x7fda741f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73400640 1 -- 172.21.15.118:0/1892857118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda741f9bf0 con 0x7fda741f97e0 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda72000640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda741529d0 0x7fda741f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:57.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73400640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda741f97e0 0x7fda7415c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02acc0 tx=0x7fda6c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:57.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda6aa00640 1 -- 172.21.15.118:0/1892857118 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0062b0 con 0x7fda741f97e0 2024-09-21T06:03:57.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda6aa00640 1 -- 172.21.15.118:0/1892857118 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda6c006450 con 0x7fda741f97e0 2024-09-21T06:03:57.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7415b4b0 con 0x7fda741f97e0 2024-09-21T06:03:57.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda6aa00640 1 -- 172.21.15.118:0/1892857118 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c006860 con 0x7fda741f97e0 2024-09-21T06:03:57.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.593+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7415ba70 con 0x7fda741f97e0 2024-09-21T06:03:57.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.595+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda740d1330 con 0x7fda741f97e0 2024-09-21T06:03:57.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.596+0000 7fda6aa00640 1 -- 172.21.15.118:0/1892857118 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda6c003a30 con 0x7fda741f97e0 2024-09-21T06:03:57.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.597+0000 7fda6aa00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda54078b90 0x7fda5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:57.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.597+0000 7fda6aa00640 1 -- 172.21.15.118:0/1892857118 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fda6c0ba950 con 0x7fda741f97e0 2024-09-21T06:03:57.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.598+0000 7fda72a00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda54078b90 0x7fda5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:57.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.598+0000 7fda72a00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda54078b90 0x7fda5407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda64001c40 tx=0x7fda64001bd0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:57.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.602+0000 7fda6aa00640 1 -- 172.21.15.118:0/1892857118 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fda741f9bf0 con 0x7fda741f97e0 2024-09-21T06:03:57.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:57.824+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fda74153020 con 0x7fda741f97e0 2024-09-21T06:03:58.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.451+0000 7fda6aa00640 1 -- 172.21.15.118:0/1892857118 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fda6c082d90 con 0x7fda741f97e0 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda54078b90 msgr2=0x7fda5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda54078b90 0x7fda5407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda64001c40 tx=0x7fda64001bd0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda741f97e0 msgr2=0x7fda7415c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda741f97e0 0x7fda7415c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02acc0 tx=0x7fda6c001b10 comp rx=0 tx=0).stop 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 shutdown_connections 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda741f97e0 0x7fda7415c270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda741529d0 0x7fda741f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda54078b90 0x7fda5407b0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 --2- 172.21.15.118:0/1892857118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda58004d40 0x7fda741548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 >> 172.21.15.118:0/1892857118 conn(0x7fda7406d1c0 msgr2=0x7fda740b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:58.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 shutdown_connections 2024-09-21T06:03:58.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.455+0000 7fda73e00640 1 -- 172.21.15.118:0/1892857118 wait complete. 2024-09-21T06:03:58.481 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2024-09-21T06:03:58.481 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:03:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.705+0000 7fe4da000640 1 -- 172.21.15.118:0/1269983366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d4148a00 msgr2=0x7fe4d4163600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.705+0000 7fe4da000640 1 --2- 172.21.15.118:0/1269983366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d4148a00 0x7fe4d4163600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009860 tx=0x7fe4c402a5c0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.705+0000 7fe4da000640 1 -- 172.21.15.118:0/1269983366 shutdown_connections 2024-09-21T06:03:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.705+0000 7fe4da000640 1 --2- 172.21.15.118:0/1269983366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d4148a00 0x7fe4d4163600 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.705+0000 7fe4da000640 1 -- 172.21.15.118:0/1269983366 >> 172.21.15.118:0/1269983366 conn(0x7fe4d4071070 msgr2=0x7fe4d4071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.705+0000 7fe4da000640 1 -- 172.21.15.118:0/1269983366 shutdown_connections 2024-09-21T06:03:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.705+0000 7fe4da000640 1 -- 172.21.15.118:0/1269983366 wait complete. 2024-09-21T06:03:58.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.707+0000 7fe4da000640 1 Processor -- start 2024-09-21T06:03:58.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.707+0000 7fe4da000640 1 -- start start 2024-09-21T06:03:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4da000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40b4830 0x7fe4d415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4da000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4d4148a00 0x7fe4d41eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4da000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d41f6160 0x7fe4d41f9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4da000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d415fd80 con 0x7fe4d40b4830 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4da000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d40b4ed0 con 0x7fe4d4148a00 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4da000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d415ff00 con 0x7fe4d41f6160 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40b4830 0x7fe4d415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40b4830 0x7fe4d415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53498/0 (socket says 172.21.15.118:53498) 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 -- 172.21.15.118:0/2013377950 learned_addr learned my addr 172.21.15.118:0/2013377950 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d2a00640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4d4148a00 0x7fe4d41eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3e00640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d41f6160 0x7fe4d41f9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 -- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d41f6160 msgr2=0x7fe4d41f9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d41f6160 0x7fe4d41f9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 -- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4d4148a00 msgr2=0x7fe4d41eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4d4148a00 0x7fe4d41eb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3400640 1 -- 172.21.15.118:0/2013377950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d41e9450 con 0x7fe4d40b4830 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d2a00640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4d4148a00 0x7fe4d41eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.709+0000 7fe4d3e00640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d41f6160 0x7fe4d41f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.710+0000 7fe4d3400640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40b4830 0x7fe4d415cc20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009980 tx=0x7fe4c4033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.710+0000 7fe4cb400640 1 -- 172.21.15.118:0/2013377950 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4031b50 con 0x7fe4d40b4830 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.710+0000 7fe4cb400640 1 -- 172.21.15.118:0/2013377950 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4c4031de0 con 0x7fe4d40b4830 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.710+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d41f97f0 con 0x7fe4d40b4830 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.710+0000 7fe4cb400640 1 -- 172.21.15.118:0/2013377950 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4033310 con 0x7fe4d40b4830 2024-09-21T06:03:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.710+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d41e99f0 con 0x7fe4d40b4830 2024-09-21T06:03:58.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.711+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d4163600 con 0x7fe4d40b4830 2024-09-21T06:03:58.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.712+0000 7fe4cb400640 1 -- 172.21.15.118:0/2013377950 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4c40334b0 con 0x7fe4d40b4830 2024-09-21T06:03:58.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.713+0000 7fe4cb400640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe4b4078b90 0x7fe4b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.713+0000 7fe4cb400640 1 -- 172.21.15.118:0/2013377950 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe4c40bc050 con 0x7fe4d40b4830 2024-09-21T06:03:58.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.714+0000 7fe4d2a00640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe4b4078b90 0x7fe4b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.715+0000 7fe4d2a00640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe4b4078b90 0x7fe4b407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0001120 tx=0x7fe4c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:58.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.718+0000 7fe4cb400640 1 -- 172.21.15.118:0/2013377950 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe4c403f030 con 0x7fe4d40b4830 2024-09-21T06:03:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:58.938+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe4d406a980 con 0x7fe4d40b4830 2024-09-21T06:03:59.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.459+0000 7fe4cb400640 1 -- 172.21.15.118:0/2013377950 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fe4c4084490 con 0x7fe4d40b4830 2024-09-21T06:03:59.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe4b4078b90 msgr2=0x7fe4b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe4b4078b90 0x7fe4b407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0001120 tx=0x7fe4c0009040 comp rx=0 tx=0).stop 2024-09-21T06:03:59.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40b4830 msgr2=0x7fe4d415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40b4830 0x7fe4d415cc20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009980 tx=0x7fe4c4033ba0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 shutdown_connections 2024-09-21T06:03:59.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe4b4078b90 0x7fe4b407b0a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4d41f6160 0x7fe4d41f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4d4148a00 0x7fe4d41eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 --2- 172.21.15.118:0/2013377950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4d40b4830 0x7fe4d415cc20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 >> 172.21.15.118:0/2013377950 conn(0x7fe4d4071070 msgr2=0x7fe4d4148030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:59.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.461+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 shutdown_connections 2024-09-21T06:03:59.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.462+0000 7fe4da000640 1 -- 172.21.15.118:0/2013377950 wait complete. 2024-09-21T06:03:59.485 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:03:59.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 -- 172.21.15.118:0/3052207181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 msgr2=0x7f3adc0ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 --2- 172.21.15.118:0/3052207181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc0ccf80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0b46a0 tx=0x7f3ad402a970 comp rx=0 tx=0).stop 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 -- 172.21.15.118:0/3052207181 shutdown_connections 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 --2- 172.21.15.118:0/3052207181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc0ccf80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 --2- 172.21.15.118:0/3052207181 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3adc0b5040 0x7f3adc0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 --2- 172.21.15.118:0/3052207181 >> v2:172.21.15.149:3300/0 conn(0x7f3adc15cfd0 0x7f3adc0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 -- 172.21.15.118:0/3052207181 >> 172.21.15.118:0/3052207181 conn(0x7f3adc06d110 msgr2=0x7f3adc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 -- 172.21.15.118:0/3052207181 shutdown_connections 2024-09-21T06:03:59.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.702+0000 7f3ae3400640 1 -- 172.21.15.118:0/3052207181 wait complete. 2024-09-21T06:03:59.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.704+0000 7f3ae3400640 1 Processor -- start 2024-09-21T06:03:59.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.705+0000 7f3ae3400640 1 -- start start 2024-09-21T06:03:59.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3adc0b5040 0x7f3adc1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3adc15cfd0 0x7f3adc0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae3400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1601a0 con 0x7f3adc0b5450 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae3400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc160020 con 0x7f3adc15cfd0 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae3400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3adc160320 con 0x7f3adc0b5040 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc1449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53524/0 (socket says 172.21.15.118:53524) 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ad3e00640 1 -- 172.21.15.118:0/2445303419 learned_addr learned my addr 172.21.15.118:0/2445303419 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae1400640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3adc15cfd0 0x7f3adc0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.706+0000 7f3ae0a00640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3adc0b5040 0x7f3adc1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad3e00640 1 -- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3adc0b5040 msgr2=0x7f3adc1f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad3e00640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3adc0b5040 0x7f3adc1f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad3e00640 1 -- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3adc15cfd0 msgr2=0x7f3adc0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad3e00640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3adc15cfd0 0x7f3adc0c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad3e00640 1 -- 172.21.15.118:0/2445303419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc0c6060 con 0x7f3adc0b5450 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ae0a00640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3adc0b5040 0x7f3adc1f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad3e00640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc1449a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400b410 tx=0x7f3ac400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad9600640 1 -- 172.21.15.118:0/2445303419 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4015020 con 0x7f3adc0b5450 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad9600640 1 -- 172.21.15.118:0/2445303419 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ac4011940 con 0x7f3adc0b5450 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ad9600640 1 -- 172.21.15.118:0/2445303419 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4011d90 con 0x7f3adc0b5450 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc0c6340 con 0x7f3adc0b5450 2024-09-21T06:03:59.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.707+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc0c6900 con 0x7f3adc0b5450 2024-09-21T06:03:59.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.708+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3adc0c5dd0 con 0x7f3adc0b5450 2024-09-21T06:03:59.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.710+0000 7f3ad9600640 1 -- 172.21.15.118:0/2445303419 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ac4018020 con 0x7f3adc0b5450 2024-09-21T06:03:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.710+0000 7f3ad9600640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ab8078bc0 0x7f3ab807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.711+0000 7f3ad9600640 1 -- 172.21.15.118:0/2445303419 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ac409ac50 con 0x7f3adc0b5450 2024-09-21T06:03:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.711+0000 7f3ae0a00640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ab8078bc0 0x7f3ab807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.711+0000 7f3ae0a00640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ab8078bc0 0x7f3ab807b0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009890 tx=0x7f3acc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:59.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.715+0000 7f3ad9600640 1 -- 172.21.15.118:0/2445303419 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ac401f020 con 0x7f3adc0b5450 2024-09-21T06:03:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.933+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3adc1608c0 con 0x7f3adc0b5450 2024-09-21T06:03:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.934+0000 7f3ad9600640 1 -- 172.21.15.118:0/2445303419 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f3ac4063080 con 0x7f3adc0b5450 2024-09-21T06:03:59.936 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:03:59.936 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:03:59.936 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:03:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ab8078bc0 msgr2=0x7f3ab807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ab8078bc0 0x7f3ab807b0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009890 tx=0x7f3acc008040 comp rx=0 tx=0).stop 2024-09-21T06:03:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 msgr2=0x7f3adc1449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc1449a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400b410 tx=0x7f3ac400b8d0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 shutdown_connections 2024-09-21T06:03:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3adc15cfd0 0x7f3adc0c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3adc0b5450 0x7f3adc1449a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ab8078bc0 0x7f3ab807b0d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 --2- 172.21.15.118:0/2445303419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3adc0b5040 0x7f3adc1f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 >> 172.21.15.118:0/2445303419 conn(0x7f3adc06d110 msgr2=0x7f3adc15af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.936+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 shutdown_connections 2024-09-21T06:03:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:03:59.937+0000 7f3ae3400640 1 -- 172.21.15.118:0/2445303419 wait complete. 2024-09-21T06:03:59.959 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:00.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.178+0000 7fef81c00640 1 -- 172.21.15.118:0/3413290710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef60003a00 msgr2=0x7fef60003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.178+0000 7fef81c00640 1 --2- 172.21.15.118:0/3413290710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef60003a00 0x7fef60003e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c260 tx=0x7fef60005830 comp rx=0 tx=0).stop 2024-09-21T06:04:00.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.179+0000 7fef81200640 1 -- 172.21.15.118:0/3413290710 reap_dead start 2024-09-21T06:04:00.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.179+0000 7fef81c00640 1 -- 172.21.15.118:0/3413290710 shutdown_connections 2024-09-21T06:04:00.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.179+0000 7fef81c00640 1 -- 172.21.15.118:0/3413290710 >> 172.21.15.118:0/3413290710 conn(0x7fef7c06d1c0 msgr2=0x7fef7c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.179+0000 7fef81c00640 1 -- 172.21.15.118:0/3413290710 shutdown_connections 2024-09-21T06:04:00.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.179+0000 7fef81c00640 1 -- 172.21.15.118:0/3413290710 wait complete. 2024-09-21T06:04:00.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.181+0000 7fef81c00640 1 Processor -- start 2024-09-21T06:04:00.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.181+0000 7fef81c00640 1 -- start start 2024-09-21T06:04:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.182+0000 7fef81c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef60003a00 0x7fef7c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.182+0000 7fef81c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef7c1535a0 0x7fef7c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.182+0000 7fef81c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef7c1f96c0 0x7fef7c1f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef81c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0d19f0 con 0x7fef7c1535a0 2024-09-21T06:04:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef81c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0d1870 con 0x7fef60003a00 2024-09-21T06:04:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef81c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c0d1b70 con 0x7fef7c1f96c0 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef7c1535a0 0x7fef7c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef7c1535a0 0x7fef7c1539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53538/0 (socket says 172.21.15.118:53538) 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 -- 172.21.15.118:0/2402627264 learned_addr learned my addr 172.21.15.118:0/2402627264 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef7be00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef60003a00 0x7fef7c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef81200640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef7c1f96c0 0x7fef7c1f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 -- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef7c1f96c0 msgr2=0x7fef7c1f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef7c1f96c0 0x7fef7c1f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 -- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef60003a00 msgr2=0x7fef7c1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef60003a00 0x7fef7c1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 -- 172.21.15.118:0/2402627264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c1ec600 con 0x7fef7c1535a0 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef81200640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef7c1f96c0 0x7fef7c1f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.183+0000 7fef73400640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef7c1535a0 0x7fef7c1539b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef64011ab0 tx=0x7fef64011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.184+0000 7fef78c00640 1 -- 172.21.15.118:0/2402627264 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6401e070 con 0x7fef7c1535a0 2024-09-21T06:04:00.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.184+0000 7fef78c00640 1 -- 172.21.15.118:0/2402627264 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef6400fe70 con 0x7fef7c1535a0 2024-09-21T06:04:00.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.184+0000 7fef78c00640 1 -- 172.21.15.118:0/2402627264 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef640042b0 con 0x7fef7c1535a0 2024-09-21T06:04:00.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.184+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c1ec8e0 con 0x7fef7c1535a0 2024-09-21T06:04:00.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.184+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c1ecea0 con 0x7fef7c1535a0 2024-09-21T06:04:00.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.185+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7c1ec370 con 0x7fef7c1535a0 2024-09-21T06:04:00.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.186+0000 7fef78c00640 1 -- 172.21.15.118:0/2402627264 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef64021070 con 0x7fef7c1535a0 2024-09-21T06:04:00.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.187+0000 7fef78c00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef58078b90 0x7fef5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.187+0000 7fef78c00640 1 -- 172.21.15.118:0/2402627264 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fef6409b810 con 0x7fef7c1535a0 2024-09-21T06:04:00.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.187+0000 7fef7be00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef58078b90 0x7fef5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.188+0000 7fef7be00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef58078b90 0x7fef5807b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c260 tx=0x7fef7c160360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.191+0000 7fef78c00640 1 -- 172.21.15.118:0/2402627264 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fef64063560 con 0x7fef7c1535a0 2024-09-21T06:04:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.377+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef7c152ef0 con 0x7fef7c1535a0 2024-09-21T06:04:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.379+0000 7fef78c00640 1 -- 172.21.15.118:0/2402627264 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16737 (secure 0 0 0) 0x7fef64067f90 con 0x7fef7c1535a0 2024-09-21T06:04:00.380 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:00.381 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:57.424251+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef58078b90 msgr2=0x7fef5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef58078b90 0x7fef5807b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c260 tx=0x7fef7c160360 comp rx=0 tx=0).stop 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef7c1535a0 msgr2=0x7fef7c1539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef7c1535a0 0x7fef7c1539b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef64011ab0 tx=0x7fef64011f70 comp rx=0 tx=0).stop 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 shutdown_connections 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef58078b90 0x7fef5807b0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef7c1f96c0 0x7fef7c1f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef7c1535a0 0x7fef7c1539b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 --2- 172.21.15.118:0/2402627264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef60003a00 0x7fef7c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 >> 172.21.15.118:0/2402627264 conn(0x7fef7c06d1c0 msgr2=0x7fef7c14f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 shutdown_connections 2024-09-21T06:04:00.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.381+0000 7fef81c00640 1 -- 172.21.15.118:0/2402627264 wait complete. 2024-09-21T06:04:00.407 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:04:00.407 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:00.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 -- 172.21.15.118:0/1646001476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 msgr2=0x7f6a340d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 --2- 172.21.15.118:0/1646001476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a340d0e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a340ceaa0 tx=0x7f6a2402a560 comp rx=0 tx=0).stop 2024-09-21T06:04:00.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 -- 172.21.15.118:0/1646001476 shutdown_connections 2024-09-21T06:04:00.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 --2- 172.21.15.118:0/1646001476 >> v2:172.21.15.149:3300/0 conn(0x7f6a34142730 0x7f6a34142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 --2- 172.21.15.118:0/1646001476 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a3413fef0 0x7f6a340d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 --2- 172.21.15.118:0/1646001476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a340d0e80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 -- 172.21.15.118:0/1646001476 >> 172.21.15.118:0/1646001476 conn(0x7f6a3406d110 msgr2=0x7f6a3406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 -- 172.21.15.118:0/1646001476 shutdown_connections 2024-09-21T06:04:00.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.624+0000 7f6a38c00640 1 -- 172.21.15.118:0/1646001476 wait complete. 2024-09-21T06:04:00.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.626+0000 7f6a38c00640 1 Processor -- start 2024-09-21T06:04:00.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.626+0000 7f6a38c00640 1 -- start start 2024-09-21T06:04:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a38c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a341f9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a38c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3413fef0 0x7f6a34153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a38c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a34142730 0x7f6a34156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a38c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3406f330 con 0x7f6a3413fae0 2024-09-21T06:04:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a38c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3406f1b0 con 0x7f6a3413fef0 2024-09-21T06:04:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a38c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3406f4b0 con 0x7f6a34142730 2024-09-21T06:04:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a31e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a341f9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a31e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a341f9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53556/0 (socket says 172.21.15.118:53556) 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a31e00640 1 -- 172.21.15.118:0/108291232 learned_addr learned my addr 172.21.15.118:0/108291232 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a29400640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3413fef0 0x7f6a34153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.628+0000 7f6a32800640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a34142730 0x7f6a34156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a31e00640 1 -- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a34142730 msgr2=0x7f6a34156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a31e00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a34142730 0x7f6a34156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a31e00640 1 -- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3413fef0 msgr2=0x7f6a34153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a31e00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3413fef0 0x7f6a34153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a31e00640 1 -- 172.21.15.118:0/108291232 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a34153570 con 0x7f6a3413fae0 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a31e00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a341f9ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a24034040 tx=0x7f6a24003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a2aa00640 1 -- 172.21.15.118:0/108291232 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2403e030 con 0x7f6a3413fae0 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a2aa00640 1 -- 172.21.15.118:0/108291232 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a24003e00 con 0x7f6a3413fae0 2024-09-21T06:04:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3413db50 con 0x7f6a3413fae0 2024-09-21T06:04:00.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a2aa00640 1 -- 172.21.15.118:0/108291232 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24035040 con 0x7f6a3413fae0 2024-09-21T06:04:00.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.629+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a341f93f0 con 0x7f6a3413fae0 2024-09-21T06:04:00.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.630+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3406f9d0 con 0x7f6a3413fae0 2024-09-21T06:04:00.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.632+0000 7f6a2aa00640 1 -- 172.21.15.118:0/108291232 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a24041030 con 0x7f6a3413fae0 2024-09-21T06:04:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.632+0000 7f6a2aa00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a10078b90 0x7f6a1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.633+0000 7f6a2aa00640 1 -- 172.21.15.118:0/108291232 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a240bb500 con 0x7f6a3413fae0 2024-09-21T06:04:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.633+0000 7f6a29400640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a10078b90 0x7f6a1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.633+0000 7f6a29400640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a10078b90 0x7f6a1007b0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a3415d160 tx=0x7f6a1c00b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.637+0000 7f6a2aa00640 1 -- 172.21.15.118:0/108291232 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6a24083250 con 0x7f6a3413fae0 2024-09-21T06:04:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.822+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a340cf410 con 0x7f6a10078b90 2024-09-21T06:04:00.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.830+0000 7f6a2aa00640 1 -- 172.21.15.118:0/108291232 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247474 (secure 0 0 0) 0x7f6a340cf410 con 0x7f6a10078b90 2024-09-21T06:04:00.834 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:00.835 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a10078b90 msgr2=0x7f6a1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a10078b90 0x7f6a1007b0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a3415d160 tx=0x7f6a1c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 msgr2=0x7f6a341f9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a341f9ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a24034040 tx=0x7f6a24003910 comp rx=0 tx=0).stop 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 shutdown_connections 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a10078b90 0x7f6a1007b0a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a34142730 0x7f6a34156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3413fef0 0x7f6a34153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 --2- 172.21.15.118:0/108291232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a3413fae0 0x7f6a341f9ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.833+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 >> 172.21.15.118:0/108291232 conn(0x7f6a3406d110 msgr2=0x7f6a341609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.834+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 shutdown_connections 2024-09-21T06:04:00.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:00.834+0000 7f6a38c00640 1 -- 172.21.15.118:0/108291232 wait complete. 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T06:04:00.456320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001330"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692022+0000","last_change":"2024-09-21T06:03:56.442024+0000","last_active":"2024-09-21T06:03:57.692022+0000","last_peered":"2024-09-21T06:03:57.692022+0000","last_clean":"2024-09-21T06:03:57.692022+0000","last_became_active":"2024-09-21T06:03:56.441182+0000","last_became_peered":"2024-09-21T06:03:56.441182+0000","last_unstale":"2024-09-21T06:03:57.692022+0000","last_undegraded":"2024-09-21T06:03:57.692022+0000","last_fullsized":"2024-09-21T06:03:57.692022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:02.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430908+0000","last_change":"2024-09-21T06:03:56.442846+0000","last_active":"2024-09-21T06:03:57.430908+0000","last_peered":"2024-09-21T06:03:57.430908+0000","last_clean":"2024-09-21T06:03:57.430908+0000","last_became_active":"2024-09-21T06:03:56.442596+0000","last_became_peered":"2024-09-21T06:03:56.442596+0000","last_unstale":"2024-09-21T06:03:57.430908+0000","last_undegraded":"2024-09-21T06:03:57.430908+0000","last_fullsized":"2024-09-21T06:03:57.430908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:31.907433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571265+0000","last_change":"2024-09-21T06:03:56.444128+0000","last_active":"2024-09-21T06:03:57.571265+0000","last_peered":"2024-09-21T06:03:57.571265+0000","last_clean":"2024-09-21T06:03:57.571265+0000","last_became_active":"2024-09-21T06:03:56.443902+0000","last_became_peered":"2024-09-21T06:03:56.443902+0000","last_unstale":"2024-09-21T06:03:57.571265+0000","last_undegraded":"2024-09-21T06:03:57.571265+0000","last_fullsized":"2024-09-21T06:03:57.571265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:52.321248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570718+0000","last_change":"2024-09-21T06:03:56.463130+0000","last_active":"2024-09-21T06:03:57.570718+0000","last_peered":"2024-09-21T06:03:57.570718+0000","last_clean":"2024-09-21T06:03:57.570718+0000","last_became_active":"2024-09-21T06:03:56.459929+0000","last_became_peered":"2024-09-21T06:03:56.459929+0000","last_unstale":"2024-09-21T06:03:57.570718+0000","last_undegraded":"2024-09-21T06:03:57.570718+0000","last_fullsized":"2024-09-21T06:03:57.570718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:15.532700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691768+0000","last_change":"2024-09-21T06:03:56.433208+0000","last_active":"2024-09-21T06:03:57.691768+0000","last_peered":"2024-09-21T06:03:57.691768+0000","last_clean":"2024-09-21T06:03:57.691768+0000","last_became_active":"2024-09-21T06:03:56.432871+0000","last_became_peered":"2024-09-21T06:03:56.432871+0000","last_unstale":"2024-09-21T06:03:57.691768+0000","last_undegraded":"2024-09-21T06:03:57.691768+0000","last_fullsized":"2024-09-21T06:03:57.691768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:39.265454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571368+0000","last_change":"2024-09-21T06:03:56.461789+0000","last_active":"2024-09-21T06:03:57.571368+0000","last_peered":"2024-09-21T06:03:57.571368+0000","last_clean":"2024-09-21T06:03:57.571368+0000","last_became_active":"2024-09-21T06:03:56.453393+0000","last_became_peered":"2024-09-21T06:03:56.453393+0000","last_unstale":"2024-09-21T06:03:57.571368+0000","last_undegraded":"2024-09-21T06:03:57.571368+0000","last_fullsized":"2024-09-21T06:03:57.571368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:34.596911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691851+0000","last_change":"2024-09-21T06:03:56.443005+0000","last_active":"2024-09-21T06:03:57.691851+0000","last_peered":"2024-09-21T06:03:57.691851+0000","last_clean":"2024-09-21T06:03:57.691851+0000","last_became_active":"2024-09-21T06:03:56.442706+0000","last_became_peered":"2024-09-21T06:03:56.442706+0000","last_unstale":"2024-09-21T06:03:57.691851+0000","last_undegraded":"2024-09-21T06:03:57.691851+0000","last_fullsized":"2024-09-21T06:03:57.691851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:08.249768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.427461+0000","last_change":"2024-09-21T06:03:56.448982+0000","last_active":"2024-09-21T06:03:57.427461+0000","last_peered":"2024-09-21T06:03:57.427461+0000","last_clean":"2024-09-21T06:03:57.427461+0000","last_became_active":"2024-09-21T06:03:56.448820+0000","last_became_peered":"2024-09-21T06:03:56.448820+0000","last_unstale":"2024-09-21T06:03:57.427461+0000","last_undegraded":"2024-09-21T06:03:57.427461+0000","last_fullsized":"2024-09-21T06:03:57.427461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.481108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691597+0000","last_change":"2024-09-21T06:03:56.460943+0000","last_active":"2024-09-21T06:03:57.691597+0000","last_peered":"2024-09-21T06:03:57.691597+0000","last_clean":"2024-09-21T06:03:57.691597+0000","last_became_active":"2024-09-21T06:03:56.460670+0000","last_became_peered":"2024-09-21T06:03:56.460670+0000","last_unstale":"2024-09-21T06:03:57.691597+0000","last_undegraded":"2024-09-21T06:03:57.691597+0000","last_fullsized":"2024-09-21T06:03:57.691597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:12.691864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692240+0000","last_change":"2024-09-21T06:03:56.457591+0000","last_active":"2024-09-21T06:03:57.692240+0000","last_peered":"2024-09-21T06:03:57.692240+0000","last_clean":"2024-09-21T06:03:57.692240+0000","last_became_active":"2024-09-21T06:03:56.456896+0000","last_became_peered":"2024-09-21T06:03:56.456896+0000","last_unstale":"2024-09-21T06:03:57.692240+0000","last_undegraded":"2024-09-21T06:03:57.692240+0000","last_fullsized":"2024-09-21T06:03:57.692240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:34.214902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693012+0000","last_change":"2024-09-21T06:03:56.456857+0000","last_active":"2024-09-21T06:03:57.693012+0000","last_peered":"2024-09-21T06:03:57.693012+0000","last_clean":"2024-09-21T06:03:57.693012+0000","last_became_active":"2024-09-21T06:03:56.456586+0000","last_became_peered":"2024-09-21T06:03:56.456586+0000","last_unstale":"2024-09-21T06:03:57.693012+0000","last_undegraded":"2024-09-21T06:03:57.693012+0000","last_fullsized":"2024-09-21T06:03:57.693012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:11.249451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027408+0000","last_change":"2024-09-21T06:03:56.454728+0000","last_active":"2024-09-21T06:03:58.027408+0000","last_peered":"2024-09-21T06:03:58.027408+0000","last_clean":"2024-09-21T06:03:58.027408+0000","last_became_active":"2024-09-21T06:03:56.449234+0000","last_became_peered":"2024-09-21T06:03:56.449234+0000","last_unstale":"2024-09-21T06:03:58.027408+0000","last_undegraded":"2024-09-21T06:03:58.027408+0000","last_fullsized":"2024-09-21T06:03:58.027408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:36.324424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428253+0000","last_change":"2024-09-21T06:03:56.447603+0000","last_active":"2024-09-21T06:03:57.428253+0000","last_peered":"2024-09-21T06:03:57.428253+0000","last_clean":"2024-09-21T06:03:57.428253+0000","last_became_active":"2024-09-21T06:03:56.445542+0000","last_became_peered":"2024-09-21T06:03:56.445542+0000","last_unstale":"2024-09-21T06:03:57.428253+0000","last_undegraded":"2024-09-21T06:03:57.428253+0000","last_fullsized":"2024-09-21T06:03:57.428253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:14.197545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571130+0000","last_change":"2024-09-21T06:03:56.447157+0000","last_active":"2024-09-21T06:03:57.571130+0000","last_peered":"2024-09-21T06:03:57.571130+0000","last_clean":"2024-09-21T06:03:57.571130+0000","last_became_active":"2024-09-21T06:03:56.446899+0000","last_became_peered":"2024-09-21T06:03:56.446899+0000","last_unstale":"2024-09-21T06:03:57.571130+0000","last_undegraded":"2024-09-21T06:03:57.571130+0000","last_fullsized":"2024-09-21T06:03:57.571130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:21.929659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432008+0000","last_change":"2024-09-21T06:03:56.451274+0000","last_active":"2024-09-21T06:03:57.432008+0000","last_peered":"2024-09-21T06:03:57.432008+0000","last_clean":"2024-09-21T06:03:57.432008+0000","last_became_active":"2024-09-21T06:03:56.451026+0000","last_became_peered":"2024-09-21T06:03:56.451026+0000","last_unstale":"2024-09-21T06:03:57.432008+0000","last_undegraded":"2024-09-21T06:03:57.432008+0000","last_fullsized":"2024-09-21T06:03:57.432008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:11.805171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571094+0000","last_change":"2024-09-21T06:03:56.464377+0000","last_active":"2024-09-21T06:03:57.571094+0000","last_peered":"2024-09-21T06:03:57.571094+0000","last_clean":"2024-09-21T06:03:57.571094+0000","last_became_active":"2024-09-21T06:03:56.460141+0000","last_became_peered":"2024-09-21T06:03:56.460141+0000","last_unstale":"2024-09-21T06:03:57.571094+0000","last_undegraded":"2024-09-21T06:03:57.571094+0000","last_fullsized":"2024-09-21T06:03:57.571094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:56.645338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570565+0000","last_change":"2024-09-21T06:03:56.466078+0000","last_active":"2024-09-21T06:03:57.570565+0000","last_peered":"2024-09-21T06:03:57.570565+0000","last_clean":"2024-09-21T06:03:57.570565+0000","last_became_active":"2024-09-21T06:03:56.464162+0000","last_became_peered":"2024-09-21T06:03:56.464162+0000","last_unstale":"2024-09-21T06:03:57.570565+0000","last_undegraded":"2024-09-21T06:03:57.570565+0000","last_fullsized":"2024-09-21T06:03:57.570565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.386202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430970+0000","last_change":"2024-09-21T06:03:56.443916+0000","last_active":"2024-09-21T06:03:57.430970+0000","last_peered":"2024-09-21T06:03:57.430970+0000","last_clean":"2024-09-21T06:03:57.430970+0000","last_became_active":"2024-09-21T06:03:56.443657+0000","last_became_peered":"2024-09-21T06:03:56.443657+0000","last_unstale":"2024-09-21T06:03:57.430970+0000","last_undegraded":"2024-09-21T06:03:57.430970+0000","last_fullsized":"2024-09-21T06:03:57.430970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:32.402546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692175+0000","last_change":"2024-09-21T06:03:56.434639+0000","last_active":"2024-09-21T06:03:57.692175+0000","last_peered":"2024-09-21T06:03:57.692175+0000","last_clean":"2024-09-21T06:03:57.692175+0000","last_became_active":"2024-09-21T06:03:56.432602+0000","last_became_peered":"2024-09-21T06:03:56.432602+0000","last_unstale":"2024-09-21T06:03:57.692175+0000","last_undegraded":"2024-09-21T06:03:57.692175+0000","last_fullsized":"2024-09-21T06:03:57.692175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:04.651473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692503+0000","last_change":"2024-09-21T06:03:56.457155+0000","last_active":"2024-09-21T06:03:57.692503+0000","last_peered":"2024-09-21T06:03:57.692503+0000","last_clean":"2024-09-21T06:03:57.692503+0000","last_became_active":"2024-09-21T06:03:56.456533+0000","last_became_peered":"2024-09-21T06:03:56.456533+0000","last_unstale":"2024-09-21T06:03:57.692503+0000","last_undegraded":"2024-09-21T06:03:57.692503+0000","last_fullsized":"2024-09-21T06:03:57.692503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:42.680780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571470+0000","last_change":"2024-09-21T06:03:56.443324+0000","last_active":"2024-09-21T06:03:57.571470+0000","last_peered":"2024-09-21T06:03:57.571470+0000","last_clean":"2024-09-21T06:03:57.571470+0000","last_became_active":"2024-09-21T06:03:56.442687+0000","last_became_peered":"2024-09-21T06:03:56.442687+0000","last_unstale":"2024-09-21T06:03:57.571470+0000","last_undegraded":"2024-09-21T06:03:57.571470+0000","last_fullsized":"2024-09-21T06:03:57.571470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:14.217033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570979+0000","last_change":"2024-09-21T06:03:56.465305+0000","last_active":"2024-09-21T06:03:57.570979+0000","last_peered":"2024-09-21T06:03:57.570979+0000","last_clean":"2024-09-21T06:03:57.570979+0000","last_became_active":"2024-09-21T06:03:56.462815+0000","last_became_peered":"2024-09-21T06:03:56.462815+0000","last_unstale":"2024-09-21T06:03:57.570979+0000","last_undegraded":"2024-09-21T06:03:57.570979+0000","last_fullsized":"2024-09-21T06:03:57.570979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:20.595134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429169+0000","last_change":"2024-09-21T06:03:56.446140+0000","last_active":"2024-09-21T06:03:57.429169+0000","last_peered":"2024-09-21T06:03:57.429169+0000","last_clean":"2024-09-21T06:03:57.429169+0000","last_became_active":"2024-09-21T06:03:56.445168+0000","last_became_peered":"2024-09-21T06:03:56.445168+0000","last_unstale":"2024-09-21T06:03:57.429169+0000","last_undegraded":"2024-09-21T06:03:57.429169+0000","last_fullsized":"2024-09-21T06:03:57.429169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:21.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570914+0000","last_change":"2024-09-21T06:03:56.459360+0000","last_active":"2024-09-21T06:03:57.570914+0000","last_peered":"2024-09-21T06:03:57.570914+0000","last_clean":"2024-09-21T06:03:57.570914+0000","last_became_active":"2024-09-21T06:03:56.454061+0000","last_became_peered":"2024-09-21T06:03:56.454061+0000","last_unstale":"2024-09-21T06:03:57.570914+0000","last_undegraded":"2024-09-21T06:03:57.570914+0000","last_fullsized":"2024-09-21T06:03:57.570914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:17.873003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428166+0000","last_change":"2024-09-21T06:03:56.446835+0000","last_active":"2024-09-21T06:03:57.428166+0000","last_peered":"2024-09-21T06:03:57.428166+0000","last_clean":"2024-09-21T06:03:57.428166+0000","last_became_active":"2024-09-21T06:03:56.443977+0000","last_became_peered":"2024-09-21T06:03:56.443977+0000","last_unstale":"2024-09-21T06:03:57.428166+0000","last_undegraded":"2024-09-21T06:03:57.428166+0000","last_fullsized":"2024-09-21T06:03:57.428166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:56.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693255+0000","last_change":"2024-09-21T06:03:56.444059+0000","last_active":"2024-09-21T06:03:57.693255+0000","last_peered":"2024-09-21T06:03:57.693255+0000","last_clean":"2024-09-21T06:03:57.693255+0000","last_became_active":"2024-09-21T06:03:56.443559+0000","last_became_peered":"2024-09-21T06:03:56.443559+0000","last_unstale":"2024-09-21T06:03:57.693255+0000","last_undegraded":"2024-09-21T06:03:57.693255+0000","last_fullsized":"2024-09-21T06:03:57.693255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:56.781422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431122+0000","last_change":"2024-09-21T06:03:56.437143+0000","last_active":"2024-09-21T06:03:57.431122+0000","last_peered":"2024-09-21T06:03:57.431122+0000","last_clean":"2024-09-21T06:03:57.431122+0000","last_became_active":"2024-09-21T06:03:56.436876+0000","last_became_peered":"2024-09-21T06:03:56.436876+0000","last_unstale":"2024-09-21T06:03:57.431122+0000","last_undegraded":"2024-09-21T06:03:57.431122+0000","last_fullsized":"2024-09-21T06:03:57.431122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:10.953250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429282+0000","last_change":"2024-09-21T06:03:56.445860+0000","last_active":"2024-09-21T06:03:57.429282+0000","last_peered":"2024-09-21T06:03:57.429282+0000","last_clean":"2024-09-21T06:03:57.429282+0000","last_became_active":"2024-09-21T06:03:56.444840+0000","last_became_peered":"2024-09-21T06:03:56.444840+0000","last_unstale":"2024-09-21T06:03:57.429282+0000","last_undegraded":"2024-09-21T06:03:57.429282+0000","last_fullsized":"2024-09-21T06:03:57.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:15.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571424+0000","last_change":"2024-09-21T06:03:56.440512+0000","last_active":"2024-09-21T06:03:57.571424+0000","last_peered":"2024-09-21T06:03:57.571424+0000","last_clean":"2024-09-21T06:03:57.571424+0000","last_became_active":"2024-09-21T06:03:56.440184+0000","last_became_peered":"2024-09-21T06:03:56.440184+0000","last_unstale":"2024-09-21T06:03:57.571424+0000","last_undegraded":"2024-09-21T06:03:57.571424+0000","last_fullsized":"2024-09-21T06:03:57.571424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:37.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570758+0000","last_change":"2024-09-21T06:03:56.454324+0000","last_active":"2024-09-21T06:03:57.570758+0000","last_peered":"2024-09-21T06:03:57.570758+0000","last_clean":"2024-09-21T06:03:57.570758+0000","last_became_active":"2024-09-21T06:03:56.452517+0000","last_became_peered":"2024-09-21T06:03:56.452517+0000","last_unstale":"2024-09-21T06:03:57.570758+0000","last_undegraded":"2024-09-21T06:03:57.570758+0000","last_fullsized":"2024-09-21T06:03:57.570758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:46.960104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431260+0000","last_change":"2024-09-21T06:03:56.451719+0000","last_active":"2024-09-21T06:03:57.431260+0000","last_peered":"2024-09-21T06:03:57.431260+0000","last_clean":"2024-09-21T06:03:57.431260+0000","last_became_active":"2024-09-21T06:03:56.451322+0000","last_became_peered":"2024-09-21T06:03:56.451322+0000","last_unstale":"2024-09-21T06:03:57.431260+0000","last_undegraded":"2024-09-21T06:03:57.431260+0000","last_fullsized":"2024-09-21T06:03:57.431260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:51.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692712+0000","last_change":"2024-09-21T06:03:56.444250+0000","last_active":"2024-09-21T06:03:57.692712+0000","last_peered":"2024-09-21T06:03:57.692712+0000","last_clean":"2024-09-21T06:03:57.692712+0000","last_became_active":"2024-09-21T06:03:56.443994+0000","last_became_peered":"2024-09-21T06:03:56.443994+0000","last_unstale":"2024-09-21T06:03:57.692712+0000","last_undegraded":"2024-09-21T06:03:57.692712+0000","last_fullsized":"2024-09-21T06:03:57.692712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:37.243068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027410+0000","last_change":"2024-09-21T06:03:56.455067+0000","last_active":"2024-09-21T06:03:58.027410+0000","last_peered":"2024-09-21T06:03:58.027410+0000","last_clean":"2024-09-21T06:03:58.027410+0000","last_became_active":"2024-09-21T06:03:56.454652+0000","last_became_peered":"2024-09-21T06:03:56.454652+0000","last_unstale":"2024-09-21T06:03:58.027410+0000","last_undegraded":"2024-09-21T06:03:58.027410+0000","last_fullsized":"2024-09-21T06:03:58.027410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429070+0000","last_change":"2024-09-21T06:03:55.428741+0000","last_active":"2024-09-21T06:03:57.429070+0000","last_peered":"2024-09-21T06:03:57.429070+0000","last_clean":"2024-09-21T06:03:57.429070+0000","last_became_active":"2024-09-21T06:03:55.428445+0000","last_became_peered":"2024-09-21T06:03:55.428445+0000","last_unstale":"2024-09-21T06:03:57.429070+0000","last_undegraded":"2024-09-21T06:03:57.429070+0000","last_fullsized":"2024-09-21T06:03:57.429070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:05.972426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571364+0000","last_change":"2024-09-21T06:03:56.451202+0000","last_active":"2024-09-21T06:03:57.571364+0000","last_peered":"2024-09-21T06:03:57.571364+0000","last_clean":"2024-09-21T06:03:57.571364+0000","last_became_active":"2024-09-21T06:03:56.450849+0000","last_became_peered":"2024-09-21T06:03:56.450849+0000","last_unstale":"2024-09-21T06:03:57.571364+0000","last_undegraded":"2024-09-21T06:03:57.571364+0000","last_fullsized":"2024-09-21T06:03:57.571364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:26.599500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692515+0000","last_change":"2024-09-21T06:03:55.441570+0000","last_active":"2024-09-21T06:03:57.692515+0000","last_peered":"2024-09-21T06:03:57.692515+0000","last_clean":"2024-09-21T06:03:57.692515+0000","last_became_active":"2024-09-21T06:03:55.439655+0000","last_became_peered":"2024-09-21T06:03:55.439655+0000","last_unstale":"2024-09-21T06:03:57.692515+0000","last_undegraded":"2024-09-21T06:03:57.692515+0000","last_fullsized":"2024-09-21T06:03:57.692515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429197+0000","last_change":"2024-09-21T06:03:55.440025+0000","last_active":"2024-09-21T06:03:57.429197+0000","last_peered":"2024-09-21T06:03:57.429197+0000","last_clean":"2024-09-21T06:03:57.429197+0000","last_became_active":"2024-09-21T06:03:55.439756+0000","last_became_peered":"2024-09-21T06:03:55.439756+0000","last_unstale":"2024-09-21T06:03:57.429197+0000","last_undegraded":"2024-09-21T06:03:57.429197+0000","last_fullsized":"2024-09-21T06:03:57.429197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:47.917575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429016+0000","last_change":"2024-09-21T06:03:56.445658+0000","last_active":"2024-09-21T06:03:57.429016+0000","last_peered":"2024-09-21T06:03:57.429016+0000","last_clean":"2024-09-21T06:03:57.429016+0000","last_became_active":"2024-09-21T06:03:56.443258+0000","last_became_peered":"2024-09-21T06:03:56.443258+0000","last_unstale":"2024-09-21T06:03:57.429016+0000","last_undegraded":"2024-09-21T06:03:57.429016+0000","last_fullsized":"2024-09-21T06:03:57.429016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:20.336729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571029+0000","last_change":"2024-09-21T06:03:55.443370+0000","last_active":"2024-09-21T06:03:57.571029+0000","last_peered":"2024-09-21T06:03:57.571029+0000","last_clean":"2024-09-21T06:03:57.571029+0000","last_became_active":"2024-09-21T06:03:55.443031+0000","last_became_peered":"2024-09-21T06:03:55.443031+0000","last_unstale":"2024-09-21T06:03:57.571029+0000","last_undegraded":"2024-09-21T06:03:57.571029+0000","last_fullsized":"2024-09-21T06:03:57.571029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:07.343031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430722+0000","last_change":"2024-09-21T06:03:56.445492+0000","last_active":"2024-09-21T06:03:57.430722+0000","last_peered":"2024-09-21T06:03:57.430722+0000","last_clean":"2024-09-21T06:03:57.430722+0000","last_became_active":"2024-09-21T06:03:56.444784+0000","last_became_peered":"2024-09-21T06:03:56.444784+0000","last_unstale":"2024-09-21T06:03:57.430722+0000","last_undegraded":"2024-09-21T06:03:57.430722+0000","last_fullsized":"2024-09-21T06:03:57.430722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:00.134737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693497+0000","last_change":"2024-09-21T06:03:55.443534+0000","last_active":"2024-09-21T06:03:57.693497+0000","last_peered":"2024-09-21T06:03:57.693497+0000","last_clean":"2024-09-21T06:03:57.693497+0000","last_became_active":"2024-09-21T06:03:55.443258+0000","last_became_peered":"2024-09-21T06:03:55.443258+0000","last_unstale":"2024-09-21T06:03:57.693497+0000","last_undegraded":"2024-09-21T06:03:57.693497+0000","last_fullsized":"2024-09-21T06:03:57.693497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:45.626155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570802+0000","last_change":"2024-09-21T06:03:56.465786+0000","last_active":"2024-09-21T06:03:57.570802+0000","last_peered":"2024-09-21T06:03:57.570802+0000","last_clean":"2024-09-21T06:03:57.570802+0000","last_became_active":"2024-09-21T06:03:56.463763+0000","last_became_peered":"2024-09-21T06:03:56.463763+0000","last_unstale":"2024-09-21T06:03:57.570802+0000","last_undegraded":"2024-09-21T06:03:57.570802+0000","last_fullsized":"2024-09-21T06:03:57.570802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:31.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571314+0000","last_change":"2024-09-21T06:03:55.446658+0000","last_active":"2024-09-21T06:03:57.571314+0000","last_peered":"2024-09-21T06:03:57.571314+0000","last_clean":"2024-09-21T06:03:57.571314+0000","last_became_active":"2024-09-21T06:03:55.445408+0000","last_became_peered":"2024-09-21T06:03:55.445408+0000","last_unstale":"2024-09-21T06:03:57.571314+0000","last_undegraded":"2024-09-21T06:03:57.571314+0000","last_fullsized":"2024-09-21T06:03:57.571314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:37.191794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571700+0000","last_change":"2024-09-21T06:03:56.455772+0000","last_active":"2024-09-21T06:03:57.571700+0000","last_peered":"2024-09-21T06:03:57.571700+0000","last_clean":"2024-09-21T06:03:57.571700+0000","last_became_active":"2024-09-21T06:03:56.455305+0000","last_became_peered":"2024-09-21T06:03:56.455305+0000","last_unstale":"2024-09-21T06:03:57.571700+0000","last_undegraded":"2024-09-21T06:03:57.571700+0000","last_fullsized":"2024-09-21T06:03:57.571700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:14.217724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430824+0000","last_change":"2024-09-21T06:03:55.444884+0000","last_active":"2024-09-21T06:03:57.430824+0000","last_peered":"2024-09-21T06:03:57.430824+0000","last_clean":"2024-09-21T06:03:57.430824+0000","last_became_active":"2024-09-21T06:03:55.444597+0000","last_became_peered":"2024-09-21T06:03:55.444597+0000","last_unstale":"2024-09-21T06:03:57.430824+0000","last_undegraded":"2024-09-21T06:03:57.430824+0000","last_fullsized":"2024-09-21T06:03:57.430824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:18.685851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.026989+0000","last_change":"2024-09-21T06:03:56.441599+0000","last_active":"2024-09-21T06:03:58.026989+0000","last_peered":"2024-09-21T06:03:58.026989+0000","last_clean":"2024-09-21T06:03:58.026989+0000","last_became_active":"2024-09-21T06:03:56.441290+0000","last_became_peered":"2024-09-21T06:03:56.441290+0000","last_unstale":"2024-09-21T06:03:58.026989+0000","last_undegraded":"2024-09-21T06:03:58.026989+0000","last_fullsized":"2024-09-21T06:03:58.026989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:07.953606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692871+0000","last_change":"2024-09-21T06:03:55.440241+0000","last_active":"2024-09-21T06:03:57.692871+0000","last_peered":"2024-09-21T06:03:57.692871+0000","last_clean":"2024-09-21T06:03:57.692871+0000","last_became_active":"2024-09-21T06:03:55.436212+0000","last_became_peered":"2024-09-21T06:03:55.436212+0000","last_unstale":"2024-09-21T06:03:57.692871+0000","last_undegraded":"2024-09-21T06:03:57.692871+0000","last_fullsized":"2024-09-21T06:03:57.692871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.627418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691579+0000","last_change":"2024-09-21T06:03:56.431047+0000","last_active":"2024-09-21T06:03:57.691579+0000","last_peered":"2024-09-21T06:03:57.691579+0000","last_clean":"2024-09-21T06:03:57.691579+0000","last_became_active":"2024-09-21T06:03:56.430746+0000","last_became_peered":"2024-09-21T06:03:56.430746+0000","last_unstale":"2024-09-21T06:03:57.691579+0000","last_undegraded":"2024-09-21T06:03:57.691579+0000","last_fullsized":"2024-09-21T06:03:57.691579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.405861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571330+0000","last_change":"2024-09-21T06:03:55.443000+0000","last_active":"2024-09-21T06:03:57.571330+0000","last_peered":"2024-09-21T06:03:57.571330+0000","last_clean":"2024-09-21T06:03:57.571330+0000","last_became_active":"2024-09-21T06:03:55.442415+0000","last_became_peered":"2024-09-21T06:03:55.442415+0000","last_unstale":"2024-09-21T06:03:57.571330+0000","last_undegraded":"2024-09-21T06:03:57.571330+0000","last_fullsized":"2024-09-21T06:03:57.571330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:36.859832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572227+0000","last_change":"2024-09-21T06:03:56.443035+0000","last_active":"2024-09-21T06:03:57.572227+0000","last_peered":"2024-09-21T06:03:57.572227+0000","last_clean":"2024-09-21T06:03:57.572227+0000","last_became_active":"2024-09-21T06:03:56.441291+0000","last_became_peered":"2024-09-21T06:03:56.441291+0000","last_unstale":"2024-09-21T06:03:57.572227+0000","last_undegraded":"2024-09-21T06:03:57.572227+0000","last_fullsized":"2024-09-21T06:03:57.572227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:06.406548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571792+0000","last_change":"2024-09-21T06:03:55.445677+0000","last_active":"2024-09-21T06:03:57.571792+0000","last_peered":"2024-09-21T06:03:57.571792+0000","last_clean":"2024-09-21T06:03:57.571792+0000","last_became_active":"2024-09-21T06:03:55.444586+0000","last_became_peered":"2024-09-21T06:03:55.444586+0000","last_unstale":"2024-09-21T06:03:57.571792+0000","last_undegraded":"2024-09-21T06:03:57.571792+0000","last_fullsized":"2024-09-21T06:03:57.571792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.379145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692475+0000","last_change":"2024-09-21T06:03:56.452229+0000","last_active":"2024-09-21T06:03:57.692475+0000","last_peered":"2024-09-21T06:03:57.692475+0000","last_clean":"2024-09-21T06:03:57.692475+0000","last_became_active":"2024-09-21T06:03:56.451579+0000","last_became_peered":"2024-09-21T06:03:56.451579+0000","last_unstale":"2024-09-21T06:03:57.692475+0000","last_undegraded":"2024-09-21T06:03:57.692475+0000","last_fullsized":"2024-09-21T06:03:57.692475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:25.086776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692856+0000","last_change":"2024-09-21T06:03:55.441373+0000","last_active":"2024-09-21T06:03:57.692856+0000","last_peered":"2024-09-21T06:03:57.692856+0000","last_clean":"2024-09-21T06:03:57.692856+0000","last_became_active":"2024-09-21T06:03:55.440162+0000","last_became_peered":"2024-09-21T06:03:55.440162+0000","last_unstale":"2024-09-21T06:03:57.692856+0000","last_undegraded":"2024-09-21T06:03:57.692856+0000","last_fullsized":"2024-09-21T06:03:57.692856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:19.491867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692254+0000","last_change":"2024-09-21T06:03:56.444391+0000","last_active":"2024-09-21T06:03:57.692254+0000","last_peered":"2024-09-21T06:03:57.692254+0000","last_clean":"2024-09-21T06:03:57.692254+0000","last_became_active":"2024-09-21T06:03:56.444025+0000","last_became_peered":"2024-09-21T06:03:56.444025+0000","last_unstale":"2024-09-21T06:03:57.692254+0000","last_undegraded":"2024-09-21T06:03:57.692254+0000","last_fullsized":"2024-09-21T06:03:57.692254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:12.791221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431110+0000","last_change":"2024-09-21T06:03:55.441644+0000","last_active":"2024-09-21T06:03:57.431110+0000","last_peered":"2024-09-21T06:03:57.431110+0000","last_clean":"2024-09-21T06:03:57.431110+0000","last_became_active":"2024-09-21T06:03:55.440433+0000","last_became_peered":"2024-09-21T06:03:55.440433+0000","last_unstale":"2024-09-21T06:03:57.431110+0000","last_undegraded":"2024-09-21T06:03:57.431110+0000","last_fullsized":"2024-09-21T06:03:57.431110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:12.049159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692441+0000","last_change":"2024-09-21T06:03:56.447048+0000","last_active":"2024-09-21T06:03:57.692441+0000","last_peered":"2024-09-21T06:03:57.692441+0000","last_clean":"2024-09-21T06:03:57.692441+0000","last_became_active":"2024-09-21T06:03:56.446772+0000","last_became_peered":"2024-09-21T06:03:56.446772+0000","last_unstale":"2024-09-21T06:03:57.692441+0000","last_undegraded":"2024-09-21T06:03:57.692441+0000","last_fullsized":"2024-09-21T06:03:57.692441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:15.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027332+0000","last_change":"2024-09-21T06:03:55.447010+0000","last_active":"2024-09-21T06:03:58.027332+0000","last_peered":"2024-09-21T06:03:58.027332+0000","last_clean":"2024-09-21T06:03:58.027332+0000","last_became_active":"2024-09-21T06:03:55.446667+0000","last_became_peered":"2024-09-21T06:03:55.446667+0000","last_unstale":"2024-09-21T06:03:58.027332+0000","last_undegraded":"2024-09-21T06:03:58.027332+0000","last_fullsized":"2024-09-21T06:03:58.027332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:22.336856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692706+0000","last_change":"2024-09-21T06:03:56.451848+0000","last_active":"2024-09-21T06:03:57.692706+0000","last_peered":"2024-09-21T06:03:57.692706+0000","last_clean":"2024-09-21T06:03:57.692706+0000","last_became_active":"2024-09-21T06:03:56.451238+0000","last_became_peered":"2024-09-21T06:03:56.451238+0000","last_unstale":"2024-09-21T06:03:57.692706+0000","last_undegraded":"2024-09-21T06:03:57.692706+0000","last_fullsized":"2024-09-21T06:03:57.692706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:55.150988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431545+0000","last_change":"2024-09-21T06:03:55.439453+0000","last_active":"2024-09-21T06:03:57.431545+0000","last_peered":"2024-09-21T06:03:57.431545+0000","last_clean":"2024-09-21T06:03:57.431545+0000","last_became_active":"2024-09-21T06:03:55.439099+0000","last_became_peered":"2024-09-21T06:03:55.439099+0000","last_unstale":"2024-09-21T06:03:57.431545+0000","last_undegraded":"2024-09-21T06:03:57.431545+0000","last_fullsized":"2024-09-21T06:03:57.431545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:33.962342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691929+0000","last_change":"2024-09-21T06:03:56.439335+0000","last_active":"2024-09-21T06:03:57.691929+0000","last_peered":"2024-09-21T06:03:57.691929+0000","last_clean":"2024-09-21T06:03:57.691929+0000","last_became_active":"2024-09-21T06:03:56.439022+0000","last_became_peered":"2024-09-21T06:03:56.439022+0000","last_unstale":"2024-09-21T06:03:57.691929+0000","last_undegraded":"2024-09-21T06:03:57.691929+0000","last_fullsized":"2024-09-21T06:03:57.691929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:06.816584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430748+0000","last_change":"2024-09-21T06:03:55.439612+0000","last_active":"2024-09-21T06:03:57.430748+0000","last_peered":"2024-09-21T06:03:57.430748+0000","last_clean":"2024-09-21T06:03:57.430748+0000","last_became_active":"2024-09-21T06:03:55.439290+0000","last_became_peered":"2024-09-21T06:03:55.439290+0000","last_unstale":"2024-09-21T06:03:57.430748+0000","last_undegraded":"2024-09-21T06:03:57.430748+0000","last_fullsized":"2024-09-21T06:03:57.430748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:52.664481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571145+0000","last_change":"2024-09-21T06:03:56.464441+0000","last_active":"2024-09-21T06:03:57.571145+0000","last_peered":"2024-09-21T06:03:57.571145+0000","last_clean":"2024-09-21T06:03:57.571145+0000","last_became_active":"2024-09-21T06:03:56.461438+0000","last_became_peered":"2024-09-21T06:03:56.461438+0000","last_unstale":"2024-09-21T06:03:57.571145+0000","last_undegraded":"2024-09-21T06:03:57.571145+0000","last_fullsized":"2024-09-21T06:03:57.571145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:12.479477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431105+0000","last_change":"2024-09-21T06:03:55.447015+0000","last_active":"2024-09-21T06:03:57.431105+0000","last_peered":"2024-09-21T06:03:57.431105+0000","last_clean":"2024-09-21T06:03:57.431105+0000","last_became_active":"2024-09-21T06:03:55.446715+0000","last_became_peered":"2024-09-21T06:03:55.446715+0000","last_unstale":"2024-09-21T06:03:57.431105+0000","last_undegraded":"2024-09-21T06:03:57.431105+0000","last_fullsized":"2024-09-21T06:03:57.431105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:19.312399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692668+0000","last_change":"2024-09-21T06:03:56.449362+0000","last_active":"2024-09-21T06:03:57.692668+0000","last_peered":"2024-09-21T06:03:57.692668+0000","last_clean":"2024-09-21T06:03:57.692668+0000","last_became_active":"2024-09-21T06:03:56.449043+0000","last_became_peered":"2024-09-21T06:03:56.449043+0000","last_unstale":"2024-09-21T06:03:57.692668+0000","last_undegraded":"2024-09-21T06:03:57.692668+0000","last_fullsized":"2024-09-21T06:03:57.692668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:32.456389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693159+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:03:57.693159+0000","last_peered":"2024-09-21T06:03:57.693159+0000","last_clean":"2024-09-21T06:03:57.693159+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:03:57.693159+0000","last_undegraded":"2024-09-21T06:03:57.693159+0000","last_fullsized":"2024-09-21T06:03:57.693159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571983+0000","last_change":"2024-09-21T06:03:55.447917+0000","last_active":"2024-09-21T06:03:57.571983+0000","last_peered":"2024-09-21T06:03:57.571983+0000","last_clean":"2024-09-21T06:03:57.571983+0000","last_became_active":"2024-09-21T06:03:55.446149+0000","last_became_peered":"2024-09-21T06:03:55.446149+0000","last_unstale":"2024-09-21T06:03:57.571983+0000","last_undegraded":"2024-09-21T06:03:57.571983+0000","last_fullsized":"2024-09-21T06:03:57.571983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:20.975259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428275+0000","last_change":"2024-09-21T06:03:56.463166+0000","last_active":"2024-09-21T06:03:57.428275+0000","last_peered":"2024-09-21T06:03:57.428275+0000","last_clean":"2024-09-21T06:03:57.428275+0000","last_became_active":"2024-09-21T06:03:56.462743+0000","last_became_peered":"2024-09-21T06:03:56.462743+0000","last_unstale":"2024-09-21T06:03:57.428275+0000","last_undegraded":"2024-09-21T06:03:57.428275+0000","last_fullsized":"2024-09-21T06:03:57.428275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:31.142964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693123+0000","last_change":"2024-09-21T06:03:55.435300+0000","last_active":"2024-09-21T06:03:57.693123+0000","last_peered":"2024-09-21T06:03:57.693123+0000","last_clean":"2024-09-21T06:03:57.693123+0000","last_became_active":"2024-09-21T06:03:55.435036+0000","last_became_peered":"2024-09-21T06:03:55.435036+0000","last_unstale":"2024-09-21T06:03:57.693123+0000","last_undegraded":"2024-09-21T06:03:57.693123+0000","last_fullsized":"2024-09-21T06:03:57.693123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:04.591456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572289+0000","last_change":"2024-09-21T06:03:56.451414+0000","last_active":"2024-09-21T06:03:57.572289+0000","last_peered":"2024-09-21T06:03:57.572289+0000","last_clean":"2024-09-21T06:03:57.572289+0000","last_became_active":"2024-09-21T06:03:56.450889+0000","last_became_peered":"2024-09-21T06:03:56.450889+0000","last_unstale":"2024-09-21T06:03:57.572289+0000","last_undegraded":"2024-09-21T06:03:57.572289+0000","last_fullsized":"2024-09-21T06:03:57.572289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:03.401533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431179+0000","last_change":"2024-09-21T06:03:55.438892+0000","last_active":"2024-09-21T06:03:57.431179+0000","last_peered":"2024-09-21T06:03:57.431179+0000","last_clean":"2024-09-21T06:03:57.431179+0000","last_became_active":"2024-09-21T06:03:55.438536+0000","last_became_peered":"2024-09-21T06:03:55.438536+0000","last_unstale":"2024-09-21T06:03:57.431179+0000","last_undegraded":"2024-09-21T06:03:57.431179+0000","last_fullsized":"2024-09-21T06:03:57.431179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:21.430043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430892+0000","last_change":"2024-09-21T06:03:56.445133+0000","last_active":"2024-09-21T06:03:57.430892+0000","last_peered":"2024-09-21T06:03:57.430892+0000","last_clean":"2024-09-21T06:03:57.430892+0000","last_became_active":"2024-09-21T06:03:56.438602+0000","last_became_peered":"2024-09-21T06:03:56.438602+0000","last_unstale":"2024-09-21T06:03:57.430892+0000","last_undegraded":"2024-09-21T06:03:57.430892+0000","last_fullsized":"2024-09-21T06:03:57.430892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:28.789594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571386+0000","last_change":"2024-09-21T06:03:55.446975+0000","last_active":"2024-09-21T06:03:57.571386+0000","last_peered":"2024-09-21T06:03:57.571386+0000","last_clean":"2024-09-21T06:03:57.571386+0000","last_became_active":"2024-09-21T06:03:55.445827+0000","last_became_peered":"2024-09-21T06:03:55.445827+0000","last_unstale":"2024-09-21T06:03:57.571386+0000","last_undegraded":"2024-09-21T06:03:57.571386+0000","last_fullsized":"2024-09-21T06:03:57.571386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.888141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027398+0000","last_change":"2024-09-21T06:03:56.444147+0000","last_active":"2024-09-21T06:03:58.027398+0000","last_peered":"2024-09-21T06:03:58.027398+0000","last_clean":"2024-09-21T06:03:58.027398+0000","last_became_active":"2024-09-21T06:03:56.443876+0000","last_became_peered":"2024-09-21T06:03:56.443876+0000","last_unstale":"2024-09-21T06:03:58.027398+0000","last_undegraded":"2024-09-21T06:03:58.027398+0000","last_fullsized":"2024-09-21T06:03:58.027398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:08.226479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432211+0000","last_change":"2024-09-21T06:03:55.445091+0000","last_active":"2024-09-21T06:03:57.432211+0000","last_peered":"2024-09-21T06:03:57.432211+0000","last_clean":"2024-09-21T06:03:57.432211+0000","last_became_active":"2024-09-21T06:03:55.444251+0000","last_became_peered":"2024-09-21T06:03:55.444251+0000","last_unstale":"2024-09-21T06:03:57.432211+0000","last_undegraded":"2024-09-21T06:03:57.432211+0000","last_fullsized":"2024-09-21T06:03:57.432211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:22.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571084+0000","last_change":"2024-09-21T06:03:56.454434+0000","last_active":"2024-09-21T06:03:57.571084+0000","last_peered":"2024-09-21T06:03:57.571084+0000","last_clean":"2024-09-21T06:03:57.571084+0000","last_became_active":"2024-09-21T06:03:56.446663+0000","last_became_peered":"2024-09-21T06:03:56.446663+0000","last_unstale":"2024-09-21T06:03:57.571084+0000","last_undegraded":"2024-09-21T06:03:57.571084+0000","last_fullsized":"2024-09-21T06:03:57.571084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:52.560532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693027+0000","last_change":"2024-09-21T06:03:55.447110+0000","last_active":"2024-09-21T06:03:57.693027+0000","last_peered":"2024-09-21T06:03:57.693027+0000","last_clean":"2024-09-21T06:03:57.693027+0000","last_became_active":"2024-09-21T06:03:55.446798+0000","last_became_peered":"2024-09-21T06:03:55.446798+0000","last_unstale":"2024-09-21T06:03:57.693027+0000","last_undegraded":"2024-09-21T06:03:57.693027+0000","last_fullsized":"2024-09-21T06:03:57.693027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:21.152044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431800+0000","last_change":"2024-09-21T06:03:56.445987+0000","last_active":"2024-09-21T06:03:57.431800+0000","last_peered":"2024-09-21T06:03:57.431800+0000","last_clean":"2024-09-21T06:03:57.431800+0000","last_became_active":"2024-09-21T06:03:56.438083+0000","last_became_peered":"2024-09-21T06:03:56.438083+0000","last_unstale":"2024-09-21T06:03:57.431800+0000","last_undegraded":"2024-09-21T06:03:57.431800+0000","last_fullsized":"2024-09-21T06:03:57.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:27.608201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.434918+0000","last_change":"2024-09-21T06:03:55.443082+0000","last_active":"2024-09-21T06:03:58.434918+0000","last_peered":"2024-09-21T06:03:58.434918+0000","last_clean":"2024-09-21T06:03:58.434918+0000","last_became_active":"2024-09-21T06:03:55.442723+0000","last_became_peered":"2024-09-21T06:03:55.442723+0000","last_unstale":"2024-09-21T06:03:58.434918+0000","last_undegraded":"2024-09-21T06:03:58.434918+0000","last_fullsized":"2024-09-21T06:03:58.434918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:51.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428053+0000","last_change":"2024-09-21T06:03:56.431180+0000","last_active":"2024-09-21T06:03:57.428053+0000","last_peered":"2024-09-21T06:03:57.428053+0000","last_clean":"2024-09-21T06:03:57.428053+0000","last_became_active":"2024-09-21T06:03:56.430949+0000","last_became_peered":"2024-09-21T06:03:56.430949+0000","last_unstale":"2024-09-21T06:03:57.428053+0000","last_undegraded":"2024-09-21T06:03:57.428053+0000","last_fullsized":"2024-09-21T06:03:57.428053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:47.246368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692989+0000","last_change":"2024-09-21T06:03:55.438578+0000","last_active":"2024-09-21T06:03:57.692989+0000","last_peered":"2024-09-21T06:03:57.692989+0000","last_clean":"2024-09-21T06:03:57.692989+0000","last_became_active":"2024-09-21T06:03:55.438188+0000","last_became_peered":"2024-09-21T06:03:55.438188+0000","last_unstale":"2024-09-21T06:03:57.692989+0000","last_undegraded":"2024-09-21T06:03:57.692989+0000","last_fullsized":"2024-09-21T06:03:57.692989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:29.047291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571542+0000","last_change":"2024-09-21T06:03:56.447972+0000","last_active":"2024-09-21T06:03:57.571542+0000","last_peered":"2024-09-21T06:03:57.571542+0000","last_clean":"2024-09-21T06:03:57.571542+0000","last_became_active":"2024-09-21T06:03:56.447293+0000","last_became_peered":"2024-09-21T06:03:56.447293+0000","last_unstale":"2024-09-21T06:03:57.571542+0000","last_undegraded":"2024-09-21T06:03:57.571542+0000","last_fullsized":"2024-09-21T06:03:57.571542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.728982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693026+0000","last_change":"2024-09-21T06:03:55.447845+0000","last_active":"2024-09-21T06:03:57.693026+0000","last_peered":"2024-09-21T06:03:57.693026+0000","last_clean":"2024-09-21T06:03:57.693026+0000","last_became_active":"2024-09-21T06:03:55.447506+0000","last_became_peered":"2024-09-21T06:03:55.447506+0000","last_unstale":"2024-09-21T06:03:57.693026+0000","last_undegraded":"2024-09-21T06:03:57.693026+0000","last_fullsized":"2024-09-21T06:03:57.693026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:52.083074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027604+0000","last_change":"2024-09-21T06:03:56.454202+0000","last_active":"2024-09-21T06:03:58.027604+0000","last_peered":"2024-09-21T06:03:58.027604+0000","last_clean":"2024-09-21T06:03:58.027604+0000","last_became_active":"2024-09-21T06:03:56.449314+0000","last_became_peered":"2024-09-21T06:03:56.449314+0000","last_unstale":"2024-09-21T06:03:58.027604+0000","last_undegraded":"2024-09-21T06:03:58.027604+0000","last_fullsized":"2024-09-21T06:03:58.027604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:22.137665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432116+0000","last_change":"2024-09-21T06:03:55.444591+0000","last_active":"2024-09-21T06:03:57.432116+0000","last_peered":"2024-09-21T06:03:57.432116+0000","last_clean":"2024-09-21T06:03:57.432116+0000","last_became_active":"2024-09-21T06:03:55.443824+0000","last_became_peered":"2024-09-21T06:03:55.443824+0000","last_unstale":"2024-09-21T06:03:57.432116+0000","last_undegraded":"2024-09-21T06:03:57.432116+0000","last_fullsized":"2024-09-21T06:03:57.432116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:56.287832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428014+0000","last_change":"2024-09-21T06:03:56.440655+0000","last_active":"2024-09-21T06:03:57.428014+0000","last_peered":"2024-09-21T06:03:57.428014+0000","last_clean":"2024-09-21T06:03:57.428014+0000","last_became_active":"2024-09-21T06:03:56.438045+0000","last_became_peered":"2024-09-21T06:03:56.438045+0000","last_unstale":"2024-09-21T06:03:57.428014+0000","last_undegraded":"2024-09-21T06:03:57.428014+0000","last_fullsized":"2024-09-21T06:03:57.428014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:43.265975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430996+0000","last_change":"2024-09-21T06:03:55.436206+0000","last_active":"2024-09-21T06:03:57.430996+0000","last_peered":"2024-09-21T06:03:57.430996+0000","last_clean":"2024-09-21T06:03:57.430996+0000","last_became_active":"2024-09-21T06:03:55.435520+0000","last_became_peered":"2024-09-21T06:03:55.435520+0000","last_unstale":"2024-09-21T06:03:57.430996+0000","last_undegraded":"2024-09-21T06:03:57.430996+0000","last_fullsized":"2024-09-21T06:03:57.430996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:51.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429387+0000","last_change":"2024-09-21T06:03:56.441695+0000","last_active":"2024-09-21T06:03:57.429387+0000","last_peered":"2024-09-21T06:03:57.429387+0000","last_clean":"2024-09-21T06:03:57.429387+0000","last_became_active":"2024-09-21T06:03:56.441424+0000","last_became_peered":"2024-09-21T06:03:56.441424+0000","last_unstale":"2024-09-21T06:03:57.429387+0000","last_undegraded":"2024-09-21T06:03:57.429387+0000","last_fullsized":"2024-09-21T06:03:57.429387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:23.032354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691770+0000","last_change":"2024-09-21T06:03:55.432494+0000","last_active":"2024-09-21T06:03:57.691770+0000","last_peered":"2024-09-21T06:03:57.691770+0000","last_clean":"2024-09-21T06:03:57.691770+0000","last_became_active":"2024-09-21T06:03:55.432188+0000","last_became_peered":"2024-09-21T06:03:55.432188+0000","last_unstale":"2024-09-21T06:03:57.691770+0000","last_undegraded":"2024-09-21T06:03:57.691770+0000","last_fullsized":"2024-09-21T06:03:57.691770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.607214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692723+0000","last_change":"2024-09-21T06:03:56.453311+0000","last_active":"2024-09-21T06:03:57.692723+0000","last_peered":"2024-09-21T06:03:57.692723+0000","last_clean":"2024-09-21T06:03:57.692723+0000","last_became_active":"2024-09-21T06:03:56.452981+0000","last_became_peered":"2024-09-21T06:03:56.452981+0000","last_unstale":"2024-09-21T06:03:57.692723+0000","last_undegraded":"2024-09-21T06:03:57.692723+0000","last_fullsized":"2024-09-21T06:03:57.692723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:51.310034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570928+0000","last_change":"2024-09-21T06:03:56.462364+0000","last_active":"2024-09-21T06:03:57.570928+0000","last_peered":"2024-09-21T06:03:57.570928+0000","last_clean":"2024-09-21T06:03:57.570928+0000","last_became_active":"2024-09-21T06:03:56.462055+0000","last_became_peered":"2024-09-21T06:03:56.462055+0000","last_unstale":"2024-09-21T06:03:57.570928+0000","last_undegraded":"2024-09-21T06:03:57.570928+0000","last_fullsized":"2024-09-21T06:03:57.570928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:02.173067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692888+0000","last_change":"2024-09-21T06:03:55.444782+0000","last_active":"2024-09-21T06:03:57.692888+0000","last_peered":"2024-09-21T06:03:57.692888+0000","last_clean":"2024-09-21T06:03:57.692888+0000","last_became_active":"2024-09-21T06:03:55.444479+0000","last_became_peered":"2024-09-21T06:03:55.444479+0000","last_unstale":"2024-09-21T06:03:57.692888+0000","last_undegraded":"2024-09-21T06:03:57.692888+0000","last_fullsized":"2024-09-21T06:03:57.692888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:26.302369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571593+0000","last_change":"2024-09-21T06:03:56.465626+0000","last_active":"2024-09-21T06:03:57.571593+0000","last_peered":"2024-09-21T06:03:57.571593+0000","last_clean":"2024-09-21T06:03:57.571593+0000","last_became_active":"2024-09-21T06:03:56.464090+0000","last_became_peered":"2024-09-21T06:03:56.464090+0000","last_unstale":"2024-09-21T06:03:57.571593+0000","last_undegraded":"2024-09-21T06:03:57.571593+0000","last_fullsized":"2024-09-21T06:03:57.571593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:07.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692830+0000","last_change":"2024-09-21T06:03:55.443192+0000","last_active":"2024-09-21T06:03:57.692830+0000","last_peered":"2024-09-21T06:03:57.692830+0000","last_clean":"2024-09-21T06:03:57.692830+0000","last_became_active":"2024-09-21T06:03:55.442119+0000","last_became_peered":"2024-09-21T06:03:55.442119+0000","last_unstale":"2024-09-21T06:03:57.692830+0000","last_undegraded":"2024-09-21T06:03:57.692830+0000","last_fullsized":"2024-09-21T06:03:57.692830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:28.597367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572088+0000","last_change":"2024-09-21T06:03:56.448267+0000","last_active":"2024-09-21T06:03:57.572088+0000","last_peered":"2024-09-21T06:03:57.572088+0000","last_clean":"2024-09-21T06:03:57.572088+0000","last_became_active":"2024-09-21T06:03:56.447661+0000","last_became_peered":"2024-09-21T06:03:56.447661+0000","last_unstale":"2024-09-21T06:03:57.572088+0000","last_undegraded":"2024-09-21T06:03:57.572088+0000","last_fullsized":"2024-09-21T06:03:57.572088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:21.491787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429111+0000","last_change":"2024-09-21T06:03:55.447256+0000","last_active":"2024-09-21T06:03:57.429111+0000","last_peered":"2024-09-21T06:03:57.429111+0000","last_clean":"2024-09-21T06:03:57.429111+0000","last_became_active":"2024-09-21T06:03:55.446690+0000","last_became_peered":"2024-09-21T06:03:55.446690+0000","last_unstale":"2024-09-21T06:03:57.429111+0000","last_undegraded":"2024-09-21T06:03:57.429111+0000","last_fullsized":"2024-09-21T06:03:57.429111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:23.968841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429064+0000","last_change":"2024-09-21T06:03:56.441427+0000","last_active":"2024-09-21T06:03:57.429064+0000","last_peered":"2024-09-21T06:03:57.429064+0000","last_clean":"2024-09-21T06:03:57.429064+0000","last_became_active":"2024-09-21T06:03:56.441006+0000","last_became_peered":"2024-09-21T06:03:56.441006+0000","last_unstale":"2024-09-21T06:03:57.429064+0000","last_undegraded":"2024-09-21T06:03:57.429064+0000","last_fullsized":"2024-09-21T06:03:57.429064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:22.240365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572345+0000","last_change":"2024-09-21T06:03:55.444048+0000","last_active":"2024-09-21T06:03:57.572345+0000","last_peered":"2024-09-21T06:03:57.572345+0000","last_clean":"2024-09-21T06:03:57.572345+0000","last_became_active":"2024-09-21T06:03:55.443780+0000","last_became_peered":"2024-09-21T06:03:55.443780+0000","last_unstale":"2024-09-21T06:03:57.572345+0000","last_undegraded":"2024-09-21T06:03:57.572345+0000","last_fullsized":"2024-09-21T06:03:57.572345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:22.074462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:00.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 -- 172.21.15.118:0/1877917417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 msgr2=0x7fe0e8142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 --2- 172.21.15.118:0/1877917417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e8142b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80d1af0 tx=0x7fe0e002a980 comp rx=0 tx=0).stop 2024-09-21T06:04:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 -- 172.21.15.118:0/1877917417 shutdown_connections 2024-09-21T06:04:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 --2- 172.21.15.118:0/1877917417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e8142b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 --2- 172.21.15.118:0/1877917417 >> v2:172.21.15.149:3300/0 conn(0x7fe0e813fef0 0x7fe0e80d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 --2- 172.21.15.118:0/1877917417 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e813fae0 0x7fe0e80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 -- 172.21.15.118:0/1877917417 >> 172.21.15.118:0/1877917417 conn(0x7fe0e806d110 msgr2=0x7fe0e806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:01.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 -- 172.21.15.118:0/1877917417 shutdown_connections 2024-09-21T06:04:01.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.115+0000 7fe0ee800640 1 -- 172.21.15.118:0/1877917417 wait complete. 2024-09-21T06:04:01.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.117+0000 7fe0ee800640 1 Processor -- start 2024-09-21T06:04:01.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.118+0000 7fe0ee800640 1 -- start start 2024-09-21T06:04:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0ee800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e813fae0 0x7fe0e81f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0ee800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e813fef0 0x7fe0e813d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0ee800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e81f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0ee800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e806f330 con 0x7fe0e8142730 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0ee800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e806f1b0 con 0x7fe0e813fae0 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0ee800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e806f4b0 con 0x7fe0e813fef0 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e81f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e81f2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53576/0 (socket says 172.21.15.118:53576) 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0e7e00640 1 -- 172.21.15.118:0/2994274326 learned_addr learned my addr 172.21.15.118:0/2994274326 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.119+0000 7fe0e7400640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e813fae0 0x7fe0e81f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0dea00640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e813fef0 0x7fe0e813d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0e7e00640 1 -- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e813fef0 msgr2=0x7fe0e813d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0e7e00640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e813fef0 0x7fe0e813d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0e7e00640 1 -- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e813fae0 msgr2=0x7fe0e81f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0e7e00640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e813fae0 0x7fe0e81f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0e7e00640 1 -- 172.21.15.118:0/2994274326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e815aab0 con 0x7fe0e8142730 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0dea00640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e813fef0 0x7fe0e813d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0e7e00640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e81f2cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0033040 tx=0x7fe0e0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0dfe00640 1 -- 172.21.15.118:0/2994274326 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0034040 con 0x7fe0e8142730 2024-09-21T06:04:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0dfe00640 1 -- 172.21.15.118:0/2994274326 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0e0004540 con 0x7fe0e8142730 2024-09-21T06:04:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e8141a80 con 0x7fe0e8142730 2024-09-21T06:04:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0dfe00640 1 -- 172.21.15.118:0/2994274326 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0045480 con 0x7fe0e8142730 2024-09-21T06:04:01.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.120+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e81f7050 con 0x7fe0e8142730 2024-09-21T06:04:01.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.121+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e806f960 con 0x7fe0e8142730 2024-09-21T06:04:01.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.123+0000 7fe0dfe00640 1 -- 172.21.15.118:0/2994274326 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0e0037020 con 0x7fe0e8142730 2024-09-21T06:04:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.124+0000 7fe0dfe00640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe0c4078bc0 0x7fe0c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.124+0000 7fe0dfe00640 1 -- 172.21.15.118:0/2994274326 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0e00bc640 con 0x7fe0e8142730 2024-09-21T06:04:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.124+0000 7fe0e7400640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe0c4078bc0 0x7fe0c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.125+0000 7fe0e7400640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe0c4078bc0 0x7fe0c407b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8004630 tx=0x7fe0d800b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:01.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.128+0000 7fe0dfe00640 1 -- 172.21.15.118:0/2994274326 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe0e00849f0 con 0x7fe0e8142730 2024-09-21T06:04:01.187 INFO:tasks.ceph.mds.d.smithi149.stderr:2024-09-21T06:04:01.185+0000 7f3d60600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:04:01.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.311+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0e8141810 con 0x7fe0c4078bc0 2024-09-21T06:04:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.316+0000 7fe0dfe00640 1 -- 172.21.15.118:0/2994274326 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247474 (secure 0 0 0) 0x7fe0e8141810 con 0x7fe0c4078bc0 2024-09-21T06:04:01.321 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe0c4078bc0 msgr2=0x7fe0c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe0c4078bc0 0x7fe0c407b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8004630 tx=0x7fe0d800b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 msgr2=0x7fe0e81f2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e81f2cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0033040 tx=0x7fe0e0003f10 comp rx=0 tx=0).stop 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 shutdown_connections 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0e8142730 0x7fe0e81f2cd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe0c4078bc0 0x7fe0c407b0d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e813fef0 0x7fe0e813d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 --2- 172.21.15.118:0/2994274326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e813fae0 0x7fe0e81f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.320+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 >> 172.21.15.118:0/2994274326 conn(0x7fe0e806d110 msgr2=0x7fe0e80b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.321+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 shutdown_connections 2024-09-21T06:04:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.321+0000 7fe0ee800640 1 -- 172.21.15.118:0/2994274326 wait complete. 2024-09-21T06:04:01.346 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T06:04:00.456320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001330"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692022+0000","last_change":"2024-09-21T06:03:56.442024+0000","last_active":"2024-09-21T06:03:57.692022+0000","last_peered":"2024-09-21T06:03:57.692022+0000","last_clean":"2024-09-21T06:03:57.692022+0000","last_became_active":"2024-09-21T06:03:56.441182+0000","last_became_peered":"2024-09-21T06:03:56.441182+0000","last_unstale":"2024-09-21T06:03:57.692022+0000","last_undegraded":"2024-09-21T06:03:57.692022+0000","last_fullsized":"2024-09-21T06:03:57.692022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:02.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430908+0000","last_change":"2024-09-21T06:03:56.442846+0000","last_active":"2024-09-21T06:03:57.430908+0000","last_peered":"2024-09-21T06:03:57.430908+0000","last_clean":"2024-09-21T06:03:57.430908+0000","last_became_active":"2024-09-21T06:03:56.442596+0000","last_became_peered":"2024-09-21T06:03:56.442596+0000","last_unstale":"2024-09-21T06:03:57.430908+0000","last_undegraded":"2024-09-21T06:03:57.430908+0000","last_fullsized":"2024-09-21T06:03:57.430908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:31.907433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571265+0000","last_change":"2024-09-21T06:03:56.444128+0000","last_active":"2024-09-21T06:03:57.571265+0000","last_peered":"2024-09-21T06:03:57.571265+0000","last_clean":"2024-09-21T06:03:57.571265+0000","last_became_active":"2024-09-21T06:03:56.443902+0000","last_became_peered":"2024-09-21T06:03:56.443902+0000","last_unstale":"2024-09-21T06:03:57.571265+0000","last_undegraded":"2024-09-21T06:03:57.571265+0000","last_fullsized":"2024-09-21T06:03:57.571265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:52.321248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570718+0000","last_change":"2024-09-21T06:03:56.463130+0000","last_active":"2024-09-21T06:03:57.570718+0000","last_peered":"2024-09-21T06:03:57.570718+0000","last_clean":"2024-09-21T06:03:57.570718+0000","last_became_active":"2024-09-21T06:03:56.459929+0000","last_became_peered":"2024-09-21T06:03:56.459929+0000","last_unstale":"2024-09-21T06:03:57.570718+0000","last_undegraded":"2024-09-21T06:03:57.570718+0000","last_fullsized":"2024-09-21T06:03:57.570718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:15.532700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691768+0000","last_change":"2024-09-21T06:03:56.433208+0000","last_active":"2024-09-21T06:03:57.691768+0000","last_peered":"2024-09-21T06:03:57.691768+0000","last_clean":"2024-09-21T06:03:57.691768+0000","last_became_active":"2024-09-21T06:03:56.432871+0000","last_became_peered":"2024-09-21T06:03:56.432871+0000","last_unstale":"2024-09-21T06:03:57.691768+0000","last_undegraded":"2024-09-21T06:03:57.691768+0000","last_fullsized":"2024-09-21T06:03:57.691768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:39.265454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571368+0000","last_change":"2024-09-21T06:03:56.461789+0000","last_active":"2024-09-21T06:03:57.571368+0000","last_peered":"2024-09-21T06:03:57.571368+0000","last_clean":"2024-09-21T06:03:57.571368+0000","last_became_active":"2024-09-21T06:03:56.453393+0000","last_became_peered":"2024-09-21T06:03:56.453393+0000","last_unstale":"2024-09-21T06:03:57.571368+0000","last_undegraded":"2024-09-21T06:03:57.571368+0000","last_fullsized":"2024-09-21T06:03:57.571368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:34.596911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691851+0000","last_change":"2024-09-21T06:03:56.443005+0000","last_active":"2024-09-21T06:03:57.691851+0000","last_peered":"2024-09-21T06:03:57.691851+0000","last_clean":"2024-09-21T06:03:57.691851+0000","last_became_active":"2024-09-21T06:03:56.442706+0000","last_became_peered":"2024-09-21T06:03:56.442706+0000","last_unstale":"2024-09-21T06:03:57.691851+0000","last_undegraded":"2024-09-21T06:03:57.691851+0000","last_fullsized":"2024-09-21T06:03:57.691851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:08.249768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.427461+0000","last_change":"2024-09-21T06:03:56.448982+0000","last_active":"2024-09-21T06:03:57.427461+0000","last_peered":"2024-09-21T06:03:57.427461+0000","last_clean":"2024-09-21T06:03:57.427461+0000","last_became_active":"2024-09-21T06:03:56.448820+0000","last_became_peered":"2024-09-21T06:03:56.448820+0000","last_unstale":"2024-09-21T06:03:57.427461+0000","last_undegraded":"2024-09-21T06:03:57.427461+0000","last_fullsized":"2024-09-21T06:03:57.427461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.481108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691597+0000","last_change":"2024-09-21T06:03:56.460943+0000","last_active":"2024-09-21T06:03:57.691597+0000","last_peered":"2024-09-21T06:03:57.691597+0000","last_clean":"2024-09-21T06:03:57.691597+0000","last_became_active":"2024-09-21T06:03:56.460670+0000","last_became_peered":"2024-09-21T06:03:56.460670+0000","last_unstale":"2024-09-21T06:03:57.691597+0000","last_undegraded":"2024-09-21T06:03:57.691597+0000","last_fullsized":"2024-09-21T06:03:57.691597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:12.691864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692240+0000","last_change":"2024-09-21T06:03:56.457591+0000","last_active":"2024-09-21T06:03:57.692240+0000","last_peered":"2024-09-21T06:03:57.692240+0000","last_clean":"2024-09-21T06:03:57.692240+0000","last_became_active":"2024-09-21T06:03:56.456896+0000","last_became_peered":"2024-09-21T06:03:56.456896+0000","last_unstale":"2024-09-21T06:03:57.692240+0000","last_undegraded":"2024-09-21T06:03:57.692240+0000","last_fullsized":"2024-09-21T06:03:57.692240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:34.214902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693012+0000","last_change":"2024-09-21T06:03:56.456857+0000","last_active":"2024-09-21T06:03:57.693012+0000","last_peered":"2024-09-21T06:03:57.693012+0000","last_clean":"2024-09-21T06:03:57.693012+0000","last_became_active":"2024-09-21T06:03:56.456586+0000","last_became_peered":"2024-09-21T06:03:56.456586+0000","last_unstale":"2024-09-21T06:03:57.693012+0000","last_undegraded":"2024-09-21T06:03:57.693012+0000","last_fullsized":"2024-09-21T06:03:57.693012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:11.249451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027408+0000","last_change":"2024-09-21T06:03:56.454728+0000","last_active":"2024-09-21T06:03:58.027408+0000","last_peered":"2024-09-21T06:03:58.027408+0000","last_clean":"2024-09-21T06:03:58.027408+0000","last_became_active":"2024-09-21T06:03:56.449234+0000","last_became_peered":"2024-09-21T06:03:56.449234+0000","last_unstale":"2024-09-21T06:03:58.027408+0000","last_undegraded":"2024-09-21T06:03:58.027408+0000","last_fullsized":"2024-09-21T06:03:58.027408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:36.324424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428253+0000","last_change":"2024-09-21T06:03:56.447603+0000","last_active":"2024-09-21T06:03:57.428253+0000","last_peered":"2024-09-21T06:03:57.428253+0000","last_clean":"2024-09-21T06:03:57.428253+0000","last_became_active":"2024-09-21T06:03:56.445542+0000","last_became_peered":"2024-09-21T06:03:56.445542+0000","last_unstale":"2024-09-21T06:03:57.428253+0000","last_undegraded":"2024-09-21T06:03:57.428253+0000","last_fullsized":"2024-09-21T06:03:57.428253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:14.197545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571130+0000","last_change":"2024-09-21T06:03:56.447157+0000","last_active":"2024-09-21T06:03:57.571130+0000","last_peered":"2024-09-21T06:03:57.571130+0000","last_clean":"2024-09-21T06:03:57.571130+0000","last_became_active":"2024-09-21T06:03:56.446899+0000","last_became_peered":"2024-09-21T06:03:56.446899+0000","last_unstale":"2024-09-21T06:03:57.571130+0000","last_undegraded":"2024-09-21T06:03:57.571130+0000","last_fullsized":"2024-09-21T06:03:57.571130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:21.929659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432008+0000","last_change":"2024-09-21T06:03:56.451274+0000","last_active":"2024-09-21T06:03:57.432008+0000","last_peered":"2024-09-21T06:03:57.432008+0000","last_clean":"2024-09-21T06:03:57.432008+0000","last_became_active":"2024-09-21T06:03:56.451026+0000","last_became_peered":"2024-09-21T06:03:56.451026+0000","last_unstale":"2024-09-21T06:03:57.432008+0000","last_undegraded":"2024-09-21T06:03:57.432008+0000","last_fullsized":"2024-09-21T06:03:57.432008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:11.805171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571094+0000","last_change":"2024-09-21T06:03:56.464377+0000","last_active":"2024-09-21T06:03:57.571094+0000","last_peered":"2024-09-21T06:03:57.571094+0000","last_clean":"2024-09-21T06:03:57.571094+0000","last_became_active":"2024-09-21T06:03:56.460141+0000","last_became_peered":"2024-09-21T06:03:56.460141+0000","last_unstale":"2024-09-21T06:03:57.571094+0000","last_undegraded":"2024-09-21T06:03:57.571094+0000","last_fullsized":"2024-09-21T06:03:57.571094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:56.645338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570565+0000","last_change":"2024-09-21T06:03:56.466078+0000","last_active":"2024-09-21T06:03:57.570565+0000","last_peered":"2024-09-21T06:03:57.570565+0000","last_clean":"2024-09-21T06:03:57.570565+0000","last_became_active":"2024-09-21T06:03:56.464162+0000","last_became_peered":"2024-09-21T06:03:56.464162+0000","last_unstale":"2024-09-21T06:03:57.570565+0000","last_undegraded":"2024-09-21T06:03:57.570565+0000","last_fullsized":"2024-09-21T06:03:57.570565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.386202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430970+0000","last_change":"2024-09-21T06:03:56.443916+0000","last_active":"2024-09-21T06:03:57.430970+0000","last_peered":"2024-09-21T06:03:57.430970+0000","last_clean":"2024-09-21T06:03:57.430970+0000","last_became_active":"2024-09-21T06:03:56.443657+0000","last_became_peered":"2024-09-21T06:03:56.443657+0000","last_unstale":"2024-09-21T06:03:57.430970+0000","last_undegraded":"2024-09-21T06:03:57.430970+0000","last_fullsized":"2024-09-21T06:03:57.430970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:32.402546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692175+0000","last_change":"2024-09-21T06:03:56.434639+0000","last_active":"2024-09-21T06:03:57.692175+0000","last_peered":"2024-09-21T06:03:57.692175+0000","last_clean":"2024-09-21T06:03:57.692175+0000","last_became_active":"2024-09-21T06:03:56.432602+0000","last_became_peered":"2024-09-21T06:03:56.432602+0000","last_unstale":"2024-09-21T06:03:57.692175+0000","last_undegraded":"2024-09-21T06:03:57.692175+0000","last_fullsized":"2024-09-21T06:03:57.692175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:04.651473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692503+0000","last_change":"2024-09-21T06:03:56.457155+0000","last_active":"2024-09-21T06:03:57.692503+0000","last_peered":"2024-09-21T06:03:57.692503+0000","last_clean":"2024-09-21T06:03:57.692503+0000","last_became_active":"2024-09-21T06:03:56.456533+0000","last_became_peered":"2024-09-21T06:03:56.456533+0000","last_unstale":"2024-09-21T06:03:57.692503+0000","last_undegraded":"2024-09-21T06:03:57.692503+0000","last_fullsized":"2024-09-21T06:03:57.692503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:42.680780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571470+0000","last_change":"2024-09-21T06:03:56.443324+0000","last_active":"2024-09-21T06:03:57.571470+0000","last_peered":"2024-09-21T06:03:57.571470+0000","last_clean":"2024-09-21T06:03:57.571470+0000","last_became_active":"2024-09-21T06:03:56.442687+0000","last_became_peered":"2024-09-21T06:03:56.442687+0000","last_unstale":"2024-09-21T06:03:57.571470+0000","last_undegraded":"2024-09-21T06:03:57.571470+0000","last_fullsized":"2024-09-21T06:03:57.571470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:14.217033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570979+0000","last_change":"2024-09-21T06:03:56.465305+0000","last_active":"2024-09-21T06:03:57.570979+0000","last_peered":"2024-09-21T06:03:57.570979+0000","last_clean":"2024-09-21T06:03:57.570979+0000","last_became_active":"2024-09-21T06:03:56.462815+0000","last_became_peered":"2024-09-21T06:03:56.462815+0000","last_unstale":"2024-09-21T06:03:57.570979+0000","last_undegraded":"2024-09-21T06:03:57.570979+0000","last_fullsized":"2024-09-21T06:03:57.570979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:20.595134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429169+0000","last_change":"2024-09-21T06:03:56.446140+0000","last_active":"2024-09-21T06:03:57.429169+0000","last_peered":"2024-09-21T06:03:57.429169+0000","last_clean":"2024-09-21T06:03:57.429169+0000","last_became_active":"2024-09-21T06:03:56.445168+0000","last_became_peered":"2024-09-21T06:03:56.445168+0000","last_unstale":"2024-09-21T06:03:57.429169+0000","last_undegraded":"2024-09-21T06:03:57.429169+0000","last_fullsized":"2024-09-21T06:03:57.429169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:21.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570914+0000","last_change":"2024-09-21T06:03:56.459360+0000","last_active":"2024-09-21T06:03:57.570914+0000","last_peered":"2024-09-21T06:03:57.570914+0000","last_clean":"2024-09-21T06:03:57.570914+0000","last_became_active":"2024-09-21T06:03:56.454061+0000","last_became_peered":"2024-09-21T06:03:56.454061+0000","last_unstale":"2024-09-21T06:03:57.570914+0000","last_undegraded":"2024-09-21T06:03:57.570914+0000","last_fullsized":"2024-09-21T06:03:57.570914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:17.873003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428166+0000","last_change":"2024-09-21T06:03:56.446835+0000","last_active":"2024-09-21T06:03:57.428166+0000","last_peered":"2024-09-21T06:03:57.428166+0000","last_clean":"2024-09-21T06:03:57.428166+0000","last_became_active":"2024-09-21T06:03:56.443977+0000","last_became_peered":"2024-09-21T06:03:56.443977+0000","last_unstale":"2024-09-21T06:03:57.428166+0000","last_undegraded":"2024-09-21T06:03:57.428166+0000","last_fullsized":"2024-09-21T06:03:57.428166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:56.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693255+0000","last_change":"2024-09-21T06:03:56.444059+0000","last_active":"2024-09-21T06:03:57.693255+0000","last_peered":"2024-09-21T06:03:57.693255+0000","last_clean":"2024-09-21T06:03:57.693255+0000","last_became_active":"2024-09-21T06:03:56.443559+0000","last_became_peered":"2024-09-21T06:03:56.443559+0000","last_unstale":"2024-09-21T06:03:57.693255+0000","last_undegraded":"2024-09-21T06:03:57.693255+0000","last_fullsized":"2024-09-21T06:03:57.693255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:56.781422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431122+0000","last_change":"2024-09-21T06:03:56.437143+0000","last_active":"2024-09-21T06:03:57.431122+0000","last_peered":"2024-09-21T06:03:57.431122+0000","last_clean":"2024-09-21T06:03:57.431122+0000","last_became_active":"2024-09-21T06:03:56.436876+0000","last_became_peered":"2024-09-21T06:03:56.436876+0000","last_unstale":"2024-09-21T06:03:57.431122+0000","last_undegraded":"2024-09-21T06:03:57.431122+0000","last_fullsized":"2024-09-21T06:03:57.431122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:10.953250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429282+0000","last_change":"2024-09-21T06:03:56.445860+0000","last_active":"2024-09-21T06:03:57.429282+0000","last_peered":"2024-09-21T06:03:57.429282+0000","last_clean":"2024-09-21T06:03:57.429282+0000","last_became_active":"2024-09-21T06:03:56.444840+0000","last_became_peered":"2024-09-21T06:03:56.444840+0000","last_unstale":"2024-09-21T06:03:57.429282+0000","last_undegraded":"2024-09-21T06:03:57.429282+0000","last_fullsized":"2024-09-21T06:03:57.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:15.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571424+0000","last_change":"2024-09-21T06:03:56.440512+0000","last_active":"2024-09-21T06:03:57.571424+0000","last_peered":"2024-09-21T06:03:57.571424+0000","last_clean":"2024-09-21T06:03:57.571424+0000","last_became_active":"2024-09-21T06:03:56.440184+0000","last_became_peered":"2024-09-21T06:03:56.440184+0000","last_unstale":"2024-09-21T06:03:57.571424+0000","last_undegraded":"2024-09-21T06:03:57.571424+0000","last_fullsized":"2024-09-21T06:03:57.571424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:37.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570758+0000","last_change":"2024-09-21T06:03:56.454324+0000","last_active":"2024-09-21T06:03:57.570758+0000","last_peered":"2024-09-21T06:03:57.570758+0000","last_clean":"2024-09-21T06:03:57.570758+0000","last_became_active":"2024-09-21T06:03:56.452517+0000","last_became_peered":"2024-09-21T06:03:56.452517+0000","last_unstale":"2024-09-21T06:03:57.570758+0000","last_undegraded":"2024-09-21T06:03:57.570758+0000","last_fullsized":"2024-09-21T06:03:57.570758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:46.960104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431260+0000","last_change":"2024-09-21T06:03:56.451719+0000","last_active":"2024-09-21T06:03:57.431260+0000","last_peered":"2024-09-21T06:03:57.431260+0000","last_clean":"2024-09-21T06:03:57.431260+0000","last_became_active":"2024-09-21T06:03:56.451322+0000","last_became_peered":"2024-09-21T06:03:56.451322+0000","last_unstale":"2024-09-21T06:03:57.431260+0000","last_undegraded":"2024-09-21T06:03:57.431260+0000","last_fullsized":"2024-09-21T06:03:57.431260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:51.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692712+0000","last_change":"2024-09-21T06:03:56.444250+0000","last_active":"2024-09-21T06:03:57.692712+0000","last_peered":"2024-09-21T06:03:57.692712+0000","last_clean":"2024-09-21T06:03:57.692712+0000","last_became_active":"2024-09-21T06:03:56.443994+0000","last_became_peered":"2024-09-21T06:03:56.443994+0000","last_unstale":"2024-09-21T06:03:57.692712+0000","last_undegraded":"2024-09-21T06:03:57.692712+0000","last_fullsized":"2024-09-21T06:03:57.692712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:37.243068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027410+0000","last_change":"2024-09-21T06:03:56.455067+0000","last_active":"2024-09-21T06:03:58.027410+0000","last_peered":"2024-09-21T06:03:58.027410+0000","last_clean":"2024-09-21T06:03:58.027410+0000","last_became_active":"2024-09-21T06:03:56.454652+0000","last_became_peered":"2024-09-21T06:03:56.454652+0000","last_unstale":"2024-09-21T06:03:58.027410+0000","last_undegraded":"2024-09-21T06:03:58.027410+0000","last_fullsized":"2024-09-21T06:03:58.027410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429070+0000","last_change":"2024-09-21T06:03:55.428741+0000","last_active":"2024-09-21T06:03:57.429070+0000","last_peered":"2024-09-21T06:03:57.429070+0000","last_clean":"2024-09-21T06:03:57.429070+0000","last_became_active":"2024-09-21T06:03:55.428445+0000","last_became_peered":"2024-09-21T06:03:55.428445+0000","last_unstale":"2024-09-21T06:03:57.429070+0000","last_undegraded":"2024-09-21T06:03:57.429070+0000","last_fullsized":"2024-09-21T06:03:57.429070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:05.972426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571364+0000","last_change":"2024-09-21T06:03:56.451202+0000","last_active":"2024-09-21T06:03:57.571364+0000","last_peered":"2024-09-21T06:03:57.571364+0000","last_clean":"2024-09-21T06:03:57.571364+0000","last_became_active":"2024-09-21T06:03:56.450849+0000","last_became_peered":"2024-09-21T06:03:56.450849+0000","last_unstale":"2024-09-21T06:03:57.571364+0000","last_undegraded":"2024-09-21T06:03:57.571364+0000","last_fullsized":"2024-09-21T06:03:57.571364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:26.599500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692515+0000","last_change":"2024-09-21T06:03:55.441570+0000","last_active":"2024-09-21T06:03:57.692515+0000","last_peered":"2024-09-21T06:03:57.692515+0000","last_clean":"2024-09-21T06:03:57.692515+0000","last_became_active":"2024-09-21T06:03:55.439655+0000","last_became_peered":"2024-09-21T06:03:55.439655+0000","last_unstale":"2024-09-21T06:03:57.692515+0000","last_undegraded":"2024-09-21T06:03:57.692515+0000","last_fullsized":"2024-09-21T06:03:57.692515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429197+0000","last_change":"2024-09-21T06:03:55.440025+0000","last_active":"2024-09-21T06:03:57.429197+0000","last_peered":"2024-09-21T06:03:57.429197+0000","last_clean":"2024-09-21T06:03:57.429197+0000","last_became_active":"2024-09-21T06:03:55.439756+0000","last_became_peered":"2024-09-21T06:03:55.439756+0000","last_unstale":"2024-09-21T06:03:57.429197+0000","last_undegraded":"2024-09-21T06:03:57.429197+0000","last_fullsized":"2024-09-21T06:03:57.429197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:47.917575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429016+0000","last_change":"2024-09-21T06:03:56.445658+0000","last_active":"2024-09-21T06:03:57.429016+0000","last_peered":"2024-09-21T06:03:57.429016+0000","last_clean":"2024-09-21T06:03:57.429016+0000","last_became_active":"2024-09-21T06:03:56.443258+0000","last_became_peered":"2024-09-21T06:03:56.443258+0000","last_unstale":"2024-09-21T06:03:57.429016+0000","last_undegraded":"2024-09-21T06:03:57.429016+0000","last_fullsized":"2024-09-21T06:03:57.429016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:20.336729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571029+0000","last_change":"2024-09-21T06:03:55.443370+0000","last_active":"2024-09-21T06:03:57.571029+0000","last_peered":"2024-09-21T06:03:57.571029+0000","last_clean":"2024-09-21T06:03:57.571029+0000","last_became_active":"2024-09-21T06:03:55.443031+0000","last_became_peered":"2024-09-21T06:03:55.443031+0000","last_unstale":"2024-09-21T06:03:57.571029+0000","last_undegraded":"2024-09-21T06:03:57.571029+0000","last_fullsized":"2024-09-21T06:03:57.571029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:07.343031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430722+0000","last_change":"2024-09-21T06:03:56.445492+0000","last_active":"2024-09-21T06:03:57.430722+0000","last_peered":"2024-09-21T06:03:57.430722+0000","last_clean":"2024-09-21T06:03:57.430722+0000","last_became_active":"2024-09-21T06:03:56.444784+0000","last_became_peered":"2024-09-21T06:03:56.444784+0000","last_unstale":"2024-09-21T06:03:57.430722+0000","last_undegraded":"2024-09-21T06:03:57.430722+0000","last_fullsized":"2024-09-21T06:03:57.430722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:00.134737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693497+0000","last_change":"2024-09-21T06:03:55.443534+0000","last_active":"2024-09-21T06:03:57.693497+0000","last_peered":"2024-09-21T06:03:57.693497+0000","last_clean":"2024-09-21T06:03:57.693497+0000","last_became_active":"2024-09-21T06:03:55.443258+0000","last_became_peered":"2024-09-21T06:03:55.443258+0000","last_unstale":"2024-09-21T06:03:57.693497+0000","last_undegraded":"2024-09-21T06:03:57.693497+0000","last_fullsized":"2024-09-21T06:03:57.693497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:45.626155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570802+0000","last_change":"2024-09-21T06:03:56.465786+0000","last_active":"2024-09-21T06:03:57.570802+0000","last_peered":"2024-09-21T06:03:57.570802+0000","last_clean":"2024-09-21T06:03:57.570802+0000","last_became_active":"2024-09-21T06:03:56.463763+0000","last_became_peered":"2024-09-21T06:03:56.463763+0000","last_unstale":"2024-09-21T06:03:57.570802+0000","last_undegraded":"2024-09-21T06:03:57.570802+0000","last_fullsized":"2024-09-21T06:03:57.570802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:31.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571314+0000","last_change":"2024-09-21T06:03:55.446658+0000","last_active":"2024-09-21T06:03:57.571314+0000","last_peered":"2024-09-21T06:03:57.571314+0000","last_clean":"2024-09-21T06:03:57.571314+0000","last_became_active":"2024-09-21T06:03:55.445408+0000","last_became_peered":"2024-09-21T06:03:55.445408+0000","last_unstale":"2024-09-21T06:03:57.571314+0000","last_undegraded":"2024-09-21T06:03:57.571314+0000","last_fullsized":"2024-09-21T06:03:57.571314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:37.191794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571700+0000","last_change":"2024-09-21T06:03:56.455772+0000","last_active":"2024-09-21T06:03:57.571700+0000","last_peered":"2024-09-21T06:03:57.571700+0000","last_clean":"2024-09-21T06:03:57.571700+0000","last_became_active":"2024-09-21T06:03:56.455305+0000","last_became_peered":"2024-09-21T06:03:56.455305+0000","last_unstale":"2024-09-21T06:03:57.571700+0000","last_undegraded":"2024-09-21T06:03:57.571700+0000","last_fullsized":"2024-09-21T06:03:57.571700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:14.217724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430824+0000","last_change":"2024-09-21T06:03:55.444884+0000","last_active":"2024-09-21T06:03:57.430824+0000","last_peered":"2024-09-21T06:03:57.430824+0000","last_clean":"2024-09-21T06:03:57.430824+0000","last_became_active":"2024-09-21T06:03:55.444597+0000","last_became_peered":"2024-09-21T06:03:55.444597+0000","last_unstale":"2024-09-21T06:03:57.430824+0000","last_undegraded":"2024-09-21T06:03:57.430824+0000","last_fullsized":"2024-09-21T06:03:57.430824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:18.685851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.026989+0000","last_change":"2024-09-21T06:03:56.441599+0000","last_active":"2024-09-21T06:03:58.026989+0000","last_peered":"2024-09-21T06:03:58.026989+0000","last_clean":"2024-09-21T06:03:58.026989+0000","last_became_active":"2024-09-21T06:03:56.441290+0000","last_became_peered":"2024-09-21T06:03:56.441290+0000","last_unstale":"2024-09-21T06:03:58.026989+0000","last_undegraded":"2024-09-21T06:03:58.026989+0000","last_fullsized":"2024-09-21T06:03:58.026989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:07.953606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692871+0000","last_change":"2024-09-21T06:03:55.440241+0000","last_active":"2024-09-21T06:03:57.692871+0000","last_peered":"2024-09-21T06:03:57.692871+0000","last_clean":"2024-09-21T06:03:57.692871+0000","last_became_active":"2024-09-21T06:03:55.436212+0000","last_became_peered":"2024-09-21T06:03:55.436212+0000","last_unstale":"2024-09-21T06:03:57.692871+0000","last_undegraded":"2024-09-21T06:03:57.692871+0000","last_fullsized":"2024-09-21T06:03:57.692871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.627418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691579+0000","last_change":"2024-09-21T06:03:56.431047+0000","last_active":"2024-09-21T06:03:57.691579+0000","last_peered":"2024-09-21T06:03:57.691579+0000","last_clean":"2024-09-21T06:03:57.691579+0000","last_became_active":"2024-09-21T06:03:56.430746+0000","last_became_peered":"2024-09-21T06:03:56.430746+0000","last_unstale":"2024-09-21T06:03:57.691579+0000","last_undegraded":"2024-09-21T06:03:57.691579+0000","last_fullsized":"2024-09-21T06:03:57.691579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.405861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571330+0000","last_change":"2024-09-21T06:03:55.443000+0000","last_active":"2024-09-21T06:03:57.571330+0000","last_peered":"2024-09-21T06:03:57.571330+0000","last_clean":"2024-09-21T06:03:57.571330+0000","last_became_active":"2024-09-21T06:03:55.442415+0000","last_became_peered":"2024-09-21T06:03:55.442415+0000","last_unstale":"2024-09-21T06:03:57.571330+0000","last_undegraded":"2024-09-21T06:03:57.571330+0000","last_fullsized":"2024-09-21T06:03:57.571330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:36.859832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572227+0000","last_change":"2024-09-21T06:03:56.443035+0000","last_active":"2024-09-21T06:03:57.572227+0000","last_peered":"2024-09-21T06:03:57.572227+0000","last_clean":"2024-09-21T06:03:57.572227+0000","last_became_active":"2024-09-21T06:03:56.441291+0000","last_became_peered":"2024-09-21T06:03:56.441291+0000","last_unstale":"2024-09-21T06:03:57.572227+0000","last_undegraded":"2024-09-21T06:03:57.572227+0000","last_fullsized":"2024-09-21T06:03:57.572227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:06.406548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571792+0000","last_change":"2024-09-21T06:03:55.445677+0000","last_active":"2024-09-21T06:03:57.571792+0000","last_peered":"2024-09-21T06:03:57.571792+0000","last_clean":"2024-09-21T06:03:57.571792+0000","last_became_active":"2024-09-21T06:03:55.444586+0000","last_became_peered":"2024-09-21T06:03:55.444586+0000","last_unstale":"2024-09-21T06:03:57.571792+0000","last_undegraded":"2024-09-21T06:03:57.571792+0000","last_fullsized":"2024-09-21T06:03:57.571792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.379145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692475+0000","last_change":"2024-09-21T06:03:56.452229+0000","last_active":"2024-09-21T06:03:57.692475+0000","last_peered":"2024-09-21T06:03:57.692475+0000","last_clean":"2024-09-21T06:03:57.692475+0000","last_became_active":"2024-09-21T06:03:56.451579+0000","last_became_peered":"2024-09-21T06:03:56.451579+0000","last_unstale":"2024-09-21T06:03:57.692475+0000","last_undegraded":"2024-09-21T06:03:57.692475+0000","last_fullsized":"2024-09-21T06:03:57.692475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:25.086776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692856+0000","last_change":"2024-09-21T06:03:55.441373+0000","last_active":"2024-09-21T06:03:57.692856+0000","last_peered":"2024-09-21T06:03:57.692856+0000","last_clean":"2024-09-21T06:03:57.692856+0000","last_became_active":"2024-09-21T06:03:55.440162+0000","last_became_peered":"2024-09-21T06:03:55.440162+0000","last_unstale":"2024-09-21T06:03:57.692856+0000","last_undegraded":"2024-09-21T06:03:57.692856+0000","last_fullsized":"2024-09-21T06:03:57.692856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:19.491867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692254+0000","last_change":"2024-09-21T06:03:56.444391+0000","last_active":"2024-09-21T06:03:57.692254+0000","last_peered":"2024-09-21T06:03:57.692254+0000","last_clean":"2024-09-21T06:03:57.692254+0000","last_became_active":"2024-09-21T06:03:56.444025+0000","last_became_peered":"2024-09-21T06:03:56.444025+0000","last_unstale":"2024-09-21T06:03:57.692254+0000","last_undegraded":"2024-09-21T06:03:57.692254+0000","last_fullsized":"2024-09-21T06:03:57.692254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:12.791221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431110+0000","last_change":"2024-09-21T06:03:55.441644+0000","last_active":"2024-09-21T06:03:57.431110+0000","last_peered":"2024-09-21T06:03:57.431110+0000","last_clean":"2024-09-21T06:03:57.431110+0000","last_became_active":"2024-09-21T06:03:55.440433+0000","last_became_peered":"2024-09-21T06:03:55.440433+0000","last_unstale":"2024-09-21T06:03:57.431110+0000","last_undegraded":"2024-09-21T06:03:57.431110+0000","last_fullsized":"2024-09-21T06:03:57.431110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:12.049159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692441+0000","last_change":"2024-09-21T06:03:56.447048+0000","last_active":"2024-09-21T06:03:57.692441+0000","last_peered":"2024-09-21T06:03:57.692441+0000","last_clean":"2024-09-21T06:03:57.692441+0000","last_became_active":"2024-09-21T06:03:56.446772+0000","last_became_peered":"2024-09-21T06:03:56.446772+0000","last_unstale":"2024-09-21T06:03:57.692441+0000","last_undegraded":"2024-09-21T06:03:57.692441+0000","last_fullsized":"2024-09-21T06:03:57.692441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:15.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027332+0000","last_change":"2024-09-21T06:03:55.447010+0000","last_active":"2024-09-21T06:03:58.027332+0000","last_peered":"2024-09-21T06:03:58.027332+0000","last_clean":"2024-09-21T06:03:58.027332+0000","last_became_active":"2024-09-21T06:03:55.446667+0000","last_became_peered":"2024-09-21T06:03:55.446667+0000","last_unstale":"2024-09-21T06:03:58.027332+0000","last_undegraded":"2024-09-21T06:03:58.027332+0000","last_fullsized":"2024-09-21T06:03:58.027332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:22.336856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692706+0000","last_change":"2024-09-21T06:03:56.451848+0000","last_active":"2024-09-21T06:03:57.692706+0000","last_peered":"2024-09-21T06:03:57.692706+0000","last_clean":"2024-09-21T06:03:57.692706+0000","last_became_active":"2024-09-21T06:03:56.451238+0000","last_became_peered":"2024-09-21T06:03:56.451238+0000","last_unstale":"2024-09-21T06:03:57.692706+0000","last_undegraded":"2024-09-21T06:03:57.692706+0000","last_fullsized":"2024-09-21T06:03:57.692706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:55.150988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431545+0000","last_change":"2024-09-21T06:03:55.439453+0000","last_active":"2024-09-21T06:03:57.431545+0000","last_peered":"2024-09-21T06:03:57.431545+0000","last_clean":"2024-09-21T06:03:57.431545+0000","last_became_active":"2024-09-21T06:03:55.439099+0000","last_became_peered":"2024-09-21T06:03:55.439099+0000","last_unstale":"2024-09-21T06:03:57.431545+0000","last_undegraded":"2024-09-21T06:03:57.431545+0000","last_fullsized":"2024-09-21T06:03:57.431545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:33.962342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691929+0000","last_change":"2024-09-21T06:03:56.439335+0000","last_active":"2024-09-21T06:03:57.691929+0000","last_peered":"2024-09-21T06:03:57.691929+0000","last_clean":"2024-09-21T06:03:57.691929+0000","last_became_active":"2024-09-21T06:03:56.439022+0000","last_became_peered":"2024-09-21T06:03:56.439022+0000","last_unstale":"2024-09-21T06:03:57.691929+0000","last_undegraded":"2024-09-21T06:03:57.691929+0000","last_fullsized":"2024-09-21T06:03:57.691929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:06.816584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430748+0000","last_change":"2024-09-21T06:03:55.439612+0000","last_active":"2024-09-21T06:03:57.430748+0000","last_peered":"2024-09-21T06:03:57.430748+0000","last_clean":"2024-09-21T06:03:57.430748+0000","last_became_active":"2024-09-21T06:03:55.439290+0000","last_became_peered":"2024-09-21T06:03:55.439290+0000","last_unstale":"2024-09-21T06:03:57.430748+0000","last_undegraded":"2024-09-21T06:03:57.430748+0000","last_fullsized":"2024-09-21T06:03:57.430748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:52.664481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571145+0000","last_change":"2024-09-21T06:03:56.464441+0000","last_active":"2024-09-21T06:03:57.571145+0000","last_peered":"2024-09-21T06:03:57.571145+0000","last_clean":"2024-09-21T06:03:57.571145+0000","last_became_active":"2024-09-21T06:03:56.461438+0000","last_became_peered":"2024-09-21T06:03:56.461438+0000","last_unstale":"2024-09-21T06:03:57.571145+0000","last_undegraded":"2024-09-21T06:03:57.571145+0000","last_fullsized":"2024-09-21T06:03:57.571145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:12.479477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431105+0000","last_change":"2024-09-21T06:03:55.447015+0000","last_active":"2024-09-21T06:03:57.431105+0000","last_peered":"2024-09-21T06:03:57.431105+0000","last_clean":"2024-09-21T06:03:57.431105+0000","last_became_active":"2024-09-21T06:03:55.446715+0000","last_became_peered":"2024-09-21T06:03:55.446715+0000","last_unstale":"2024-09-21T06:03:57.431105+0000","last_undegraded":"2024-09-21T06:03:57.431105+0000","last_fullsized":"2024-09-21T06:03:57.431105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:19.312399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692668+0000","last_change":"2024-09-21T06:03:56.449362+0000","last_active":"2024-09-21T06:03:57.692668+0000","last_peered":"2024-09-21T06:03:57.692668+0000","last_clean":"2024-09-21T06:03:57.692668+0000","last_became_active":"2024-09-21T06:03:56.449043+0000","last_became_peered":"2024-09-21T06:03:56.449043+0000","last_unstale":"2024-09-21T06:03:57.692668+0000","last_undegraded":"2024-09-21T06:03:57.692668+0000","last_fullsized":"2024-09-21T06:03:57.692668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:32.456389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693159+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:03:57.693159+0000","last_peered":"2024-09-21T06:03:57.693159+0000","last_clean":"2024-09-21T06:03:57.693159+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:03:57.693159+0000","last_undegraded":"2024-09-21T06:03:57.693159+0000","last_fullsized":"2024-09-21T06:03:57.693159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571983+0000","last_change":"2024-09-21T06:03:55.447917+0000","last_active":"2024-09-21T06:03:57.571983+0000","last_peered":"2024-09-21T06:03:57.571983+0000","last_clean":"2024-09-21T06:03:57.571983+0000","last_became_active":"2024-09-21T06:03:55.446149+0000","last_became_peered":"2024-09-21T06:03:55.446149+0000","last_unstale":"2024-09-21T06:03:57.571983+0000","last_undegraded":"2024-09-21T06:03:57.571983+0000","last_fullsized":"2024-09-21T06:03:57.571983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:20.975259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428275+0000","last_change":"2024-09-21T06:03:56.463166+0000","last_active":"2024-09-21T06:03:57.428275+0000","last_peered":"2024-09-21T06:03:57.428275+0000","last_clean":"2024-09-21T06:03:57.428275+0000","last_became_active":"2024-09-21T06:03:56.462743+0000","last_became_peered":"2024-09-21T06:03:56.462743+0000","last_unstale":"2024-09-21T06:03:57.428275+0000","last_undegraded":"2024-09-21T06:03:57.428275+0000","last_fullsized":"2024-09-21T06:03:57.428275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:31.142964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693123+0000","last_change":"2024-09-21T06:03:55.435300+0000","last_active":"2024-09-21T06:03:57.693123+0000","last_peered":"2024-09-21T06:03:57.693123+0000","last_clean":"2024-09-21T06:03:57.693123+0000","last_became_active":"2024-09-21T06:03:55.435036+0000","last_became_peered":"2024-09-21T06:03:55.435036+0000","last_unstale":"2024-09-21T06:03:57.693123+0000","last_undegraded":"2024-09-21T06:03:57.693123+0000","last_fullsized":"2024-09-21T06:03:57.693123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:04.591456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572289+0000","last_change":"2024-09-21T06:03:56.451414+0000","last_active":"2024-09-21T06:03:57.572289+0000","last_peered":"2024-09-21T06:03:57.572289+0000","last_clean":"2024-09-21T06:03:57.572289+0000","last_became_active":"2024-09-21T06:03:56.450889+0000","last_became_peered":"2024-09-21T06:03:56.450889+0000","last_unstale":"2024-09-21T06:03:57.572289+0000","last_undegraded":"2024-09-21T06:03:57.572289+0000","last_fullsized":"2024-09-21T06:03:57.572289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:03.401533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431179+0000","last_change":"2024-09-21T06:03:55.438892+0000","last_active":"2024-09-21T06:03:57.431179+0000","last_peered":"2024-09-21T06:03:57.431179+0000","last_clean":"2024-09-21T06:03:57.431179+0000","last_became_active":"2024-09-21T06:03:55.438536+0000","last_became_peered":"2024-09-21T06:03:55.438536+0000","last_unstale":"2024-09-21T06:03:57.431179+0000","last_undegraded":"2024-09-21T06:03:57.431179+0000","last_fullsized":"2024-09-21T06:03:57.431179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:21.430043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430892+0000","last_change":"2024-09-21T06:03:56.445133+0000","last_active":"2024-09-21T06:03:57.430892+0000","last_peered":"2024-09-21T06:03:57.430892+0000","last_clean":"2024-09-21T06:03:57.430892+0000","last_became_active":"2024-09-21T06:03:56.438602+0000","last_became_peered":"2024-09-21T06:03:56.438602+0000","last_unstale":"2024-09-21T06:03:57.430892+0000","last_undegraded":"2024-09-21T06:03:57.430892+0000","last_fullsized":"2024-09-21T06:03:57.430892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:28.789594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571386+0000","last_change":"2024-09-21T06:03:55.446975+0000","last_active":"2024-09-21T06:03:57.571386+0000","last_peered":"2024-09-21T06:03:57.571386+0000","last_clean":"2024-09-21T06:03:57.571386+0000","last_became_active":"2024-09-21T06:03:55.445827+0000","last_became_peered":"2024-09-21T06:03:55.445827+0000","last_unstale":"2024-09-21T06:03:57.571386+0000","last_undegraded":"2024-09-21T06:03:57.571386+0000","last_fullsized":"2024-09-21T06:03:57.571386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.888141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027398+0000","last_change":"2024-09-21T06:03:56.444147+0000","last_active":"2024-09-21T06:03:58.027398+0000","last_peered":"2024-09-21T06:03:58.027398+0000","last_clean":"2024-09-21T06:03:58.027398+0000","last_became_active":"2024-09-21T06:03:56.443876+0000","last_became_peered":"2024-09-21T06:03:56.443876+0000","last_unstale":"2024-09-21T06:03:58.027398+0000","last_undegraded":"2024-09-21T06:03:58.027398+0000","last_fullsized":"2024-09-21T06:03:58.027398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:08.226479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432211+0000","last_change":"2024-09-21T06:03:55.445091+0000","last_active":"2024-09-21T06:03:57.432211+0000","last_peered":"2024-09-21T06:03:57.432211+0000","last_clean":"2024-09-21T06:03:57.432211+0000","last_became_active":"2024-09-21T06:03:55.444251+0000","last_became_peered":"2024-09-21T06:03:55.444251+0000","last_unstale":"2024-09-21T06:03:57.432211+0000","last_undegraded":"2024-09-21T06:03:57.432211+0000","last_fullsized":"2024-09-21T06:03:57.432211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:22.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571084+0000","last_change":"2024-09-21T06:03:56.454434+0000","last_active":"2024-09-21T06:03:57.571084+0000","last_peered":"2024-09-21T06:03:57.571084+0000","last_clean":"2024-09-21T06:03:57.571084+0000","last_became_active":"2024-09-21T06:03:56.446663+0000","last_became_peered":"2024-09-21T06:03:56.446663+0000","last_unstale":"2024-09-21T06:03:57.571084+0000","last_undegraded":"2024-09-21T06:03:57.571084+0000","last_fullsized":"2024-09-21T06:03:57.571084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:52.560532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693027+0000","last_change":"2024-09-21T06:03:55.447110+0000","last_active":"2024-09-21T06:03:57.693027+0000","last_peered":"2024-09-21T06:03:57.693027+0000","last_clean":"2024-09-21T06:03:57.693027+0000","last_became_active":"2024-09-21T06:03:55.446798+0000","last_became_peered":"2024-09-21T06:03:55.446798+0000","last_unstale":"2024-09-21T06:03:57.693027+0000","last_undegraded":"2024-09-21T06:03:57.693027+0000","last_fullsized":"2024-09-21T06:03:57.693027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:21.152044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431800+0000","last_change":"2024-09-21T06:03:56.445987+0000","last_active":"2024-09-21T06:03:57.431800+0000","last_peered":"2024-09-21T06:03:57.431800+0000","last_clean":"2024-09-21T06:03:57.431800+0000","last_became_active":"2024-09-21T06:03:56.438083+0000","last_became_peered":"2024-09-21T06:03:56.438083+0000","last_unstale":"2024-09-21T06:03:57.431800+0000","last_undegraded":"2024-09-21T06:03:57.431800+0000","last_fullsized":"2024-09-21T06:03:57.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:27.608201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.434918+0000","last_change":"2024-09-21T06:03:55.443082+0000","last_active":"2024-09-21T06:03:58.434918+0000","last_peered":"2024-09-21T06:03:58.434918+0000","last_clean":"2024-09-21T06:03:58.434918+0000","last_became_active":"2024-09-21T06:03:55.442723+0000","last_became_peered":"2024-09-21T06:03:55.442723+0000","last_unstale":"2024-09-21T06:03:58.434918+0000","last_undegraded":"2024-09-21T06:03:58.434918+0000","last_fullsized":"2024-09-21T06:03:58.434918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:51.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428053+0000","last_change":"2024-09-21T06:03:56.431180+0000","last_active":"2024-09-21T06:03:57.428053+0000","last_peered":"2024-09-21T06:03:57.428053+0000","last_clean":"2024-09-21T06:03:57.428053+0000","last_became_active":"2024-09-21T06:03:56.430949+0000","last_became_peered":"2024-09-21T06:03:56.430949+0000","last_unstale":"2024-09-21T06:03:57.428053+0000","last_undegraded":"2024-09-21T06:03:57.428053+0000","last_fullsized":"2024-09-21T06:03:57.428053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:47.246368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692989+0000","last_change":"2024-09-21T06:03:55.438578+0000","last_active":"2024-09-21T06:03:57.692989+0000","last_peered":"2024-09-21T06:03:57.692989+0000","last_clean":"2024-09-21T06:03:57.692989+0000","last_became_active":"2024-09-21T06:03:55.438188+0000","last_became_peered":"2024-09-21T06:03:55.438188+0000","last_unstale":"2024-09-21T06:03:57.692989+0000","last_undegraded":"2024-09-21T06:03:57.692989+0000","last_fullsized":"2024-09-21T06:03:57.692989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:29.047291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571542+0000","last_change":"2024-09-21T06:03:56.447972+0000","last_active":"2024-09-21T06:03:57.571542+0000","last_peered":"2024-09-21T06:03:57.571542+0000","last_clean":"2024-09-21T06:03:57.571542+0000","last_became_active":"2024-09-21T06:03:56.447293+0000","last_became_peered":"2024-09-21T06:03:56.447293+0000","last_unstale":"2024-09-21T06:03:57.571542+0000","last_undegraded":"2024-09-21T06:03:57.571542+0000","last_fullsized":"2024-09-21T06:03:57.571542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.728982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693026+0000","last_change":"2024-09-21T06:03:55.447845+0000","last_active":"2024-09-21T06:03:57.693026+0000","last_peered":"2024-09-21T06:03:57.693026+0000","last_clean":"2024-09-21T06:03:57.693026+0000","last_became_active":"2024-09-21T06:03:55.447506+0000","last_became_peered":"2024-09-21T06:03:55.447506+0000","last_unstale":"2024-09-21T06:03:57.693026+0000","last_undegraded":"2024-09-21T06:03:57.693026+0000","last_fullsized":"2024-09-21T06:03:57.693026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:52.083074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027604+0000","last_change":"2024-09-21T06:03:56.454202+0000","last_active":"2024-09-21T06:03:58.027604+0000","last_peered":"2024-09-21T06:03:58.027604+0000","last_clean":"2024-09-21T06:03:58.027604+0000","last_became_active":"2024-09-21T06:03:56.449314+0000","last_became_peered":"2024-09-21T06:03:56.449314+0000","last_unstale":"2024-09-21T06:03:58.027604+0000","last_undegraded":"2024-09-21T06:03:58.027604+0000","last_fullsized":"2024-09-21T06:03:58.027604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:22.137665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432116+0000","last_change":"2024-09-21T06:03:55.444591+0000","last_active":"2024-09-21T06:03:57.432116+0000","last_peered":"2024-09-21T06:03:57.432116+0000","last_clean":"2024-09-21T06:03:57.432116+0000","last_became_active":"2024-09-21T06:03:55.443824+0000","last_became_peered":"2024-09-21T06:03:55.443824+0000","last_unstale":"2024-09-21T06:03:57.432116+0000","last_undegraded":"2024-09-21T06:03:57.432116+0000","last_fullsized":"2024-09-21T06:03:57.432116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:56.287832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428014+0000","last_change":"2024-09-21T06:03:56.440655+0000","last_active":"2024-09-21T06:03:57.428014+0000","last_peered":"2024-09-21T06:03:57.428014+0000","last_clean":"2024-09-21T06:03:57.428014+0000","last_became_active":"2024-09-21T06:03:56.438045+0000","last_became_peered":"2024-09-21T06:03:56.438045+0000","last_unstale":"2024-09-21T06:03:57.428014+0000","last_undegraded":"2024-09-21T06:03:57.428014+0000","last_fullsized":"2024-09-21T06:03:57.428014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:43.265975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430996+0000","last_change":"2024-09-21T06:03:55.436206+0000","last_active":"2024-09-21T06:03:57.430996+0000","last_peered":"2024-09-21T06:03:57.430996+0000","last_clean":"2024-09-21T06:03:57.430996+0000","last_became_active":"2024-09-21T06:03:55.435520+0000","last_became_peered":"2024-09-21T06:03:55.435520+0000","last_unstale":"2024-09-21T06:03:57.430996+0000","last_undegraded":"2024-09-21T06:03:57.430996+0000","last_fullsized":"2024-09-21T06:03:57.430996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:51.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429387+0000","last_change":"2024-09-21T06:03:56.441695+0000","last_active":"2024-09-21T06:03:57.429387+0000","last_peered":"2024-09-21T06:03:57.429387+0000","last_clean":"2024-09-21T06:03:57.429387+0000","last_became_active":"2024-09-21T06:03:56.441424+0000","last_became_peered":"2024-09-21T06:03:56.441424+0000","last_unstale":"2024-09-21T06:03:57.429387+0000","last_undegraded":"2024-09-21T06:03:57.429387+0000","last_fullsized":"2024-09-21T06:03:57.429387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:23.032354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691770+0000","last_change":"2024-09-21T06:03:55.432494+0000","last_active":"2024-09-21T06:03:57.691770+0000","last_peered":"2024-09-21T06:03:57.691770+0000","last_clean":"2024-09-21T06:03:57.691770+0000","last_became_active":"2024-09-21T06:03:55.432188+0000","last_became_peered":"2024-09-21T06:03:55.432188+0000","last_unstale":"2024-09-21T06:03:57.691770+0000","last_undegraded":"2024-09-21T06:03:57.691770+0000","last_fullsized":"2024-09-21T06:03:57.691770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.607214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692723+0000","last_change":"2024-09-21T06:03:56.453311+0000","last_active":"2024-09-21T06:03:57.692723+0000","last_peered":"2024-09-21T06:03:57.692723+0000","last_clean":"2024-09-21T06:03:57.692723+0000","last_became_active":"2024-09-21T06:03:56.452981+0000","last_became_peered":"2024-09-21T06:03:56.452981+0000","last_unstale":"2024-09-21T06:03:57.692723+0000","last_undegraded":"2024-09-21T06:03:57.692723+0000","last_fullsized":"2024-09-21T06:03:57.692723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:51.310034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570928+0000","last_change":"2024-09-21T06:03:56.462364+0000","last_active":"2024-09-21T06:03:57.570928+0000","last_peered":"2024-09-21T06:03:57.570928+0000","last_clean":"2024-09-21T06:03:57.570928+0000","last_became_active":"2024-09-21T06:03:56.462055+0000","last_became_peered":"2024-09-21T06:03:56.462055+0000","last_unstale":"2024-09-21T06:03:57.570928+0000","last_undegraded":"2024-09-21T06:03:57.570928+0000","last_fullsized":"2024-09-21T06:03:57.570928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:02.173067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692888+0000","last_change":"2024-09-21T06:03:55.444782+0000","last_active":"2024-09-21T06:03:57.692888+0000","last_peered":"2024-09-21T06:03:57.692888+0000","last_clean":"2024-09-21T06:03:57.692888+0000","last_became_active":"2024-09-21T06:03:55.444479+0000","last_became_peered":"2024-09-21T06:03:55.444479+0000","last_unstale":"2024-09-21T06:03:57.692888+0000","last_undegraded":"2024-09-21T06:03:57.692888+0000","last_fullsized":"2024-09-21T06:03:57.692888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:26.302369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571593+0000","last_change":"2024-09-21T06:03:56.465626+0000","last_active":"2024-09-21T06:03:57.571593+0000","last_peered":"2024-09-21T06:03:57.571593+0000","last_clean":"2024-09-21T06:03:57.571593+0000","last_became_active":"2024-09-21T06:03:56.464090+0000","last_became_peered":"2024-09-21T06:03:56.464090+0000","last_unstale":"2024-09-21T06:03:57.571593+0000","last_undegraded":"2024-09-21T06:03:57.571593+0000","last_fullsized":"2024-09-21T06:03:57.571593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:07.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692830+0000","last_change":"2024-09-21T06:03:55.443192+0000","last_active":"2024-09-21T06:03:57.692830+0000","last_peered":"2024-09-21T06:03:57.692830+0000","last_clean":"2024-09-21T06:03:57.692830+0000","last_became_active":"2024-09-21T06:03:55.442119+0000","last_became_peered":"2024-09-21T06:03:55.442119+0000","last_unstale":"2024-09-21T06:03:57.692830+0000","last_undegraded":"2024-09-21T06:03:57.692830+0000","last_fullsized":"2024-09-21T06:03:57.692830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:28.597367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572088+0000","last_change":"2024-09-21T06:03:56.448267+0000","last_active":"2024-09-21T06:03:57.572088+0000","last_peered":"2024-09-21T06:03:57.572088+0000","last_clean":"2024-09-21T06:03:57.572088+0000","last_became_active":"2024-09-21T06:03:56.447661+0000","last_became_peered":"2024-09-21T06:03:56.447661+0000","last_unstale":"2024-09-21T06:03:57.572088+0000","last_undegraded":"2024-09-21T06:03:57.572088+0000","last_fullsized":"2024-09-21T06:03:57.572088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:21.491787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429111+0000","last_change":"2024-09-21T06:03:55.447256+0000","last_active":"2024-09-21T06:03:57.429111+0000","last_peered":"2024-09-21T06:03:57.429111+0000","last_clean":"2024-09-21T06:03:57.429111+0000","last_became_active":"2024-09-21T06:03:55.446690+0000","last_became_peered":"2024-09-21T06:03:55.446690+0000","last_unstale":"2024-09-21T06:03:57.429111+0000","last_undegraded":"2024-09-21T06:03:57.429111+0000","last_fullsized":"2024-09-21T06:03:57.429111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:23.968841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429064+0000","last_change":"2024-09-21T06:03:56.441427+0000","last_active":"2024-09-21T06:03:57.429064+0000","last_peered":"2024-09-21T06:03:57.429064+0000","last_clean":"2024-09-21T06:03:57.429064+0000","last_became_active":"2024-09-21T06:03:56.441006+0000","last_became_peered":"2024-09-21T06:03:56.441006+0000","last_unstale":"2024-09-21T06:03:57.429064+0000","last_undegraded":"2024-09-21T06:03:57.429064+0000","last_fullsized":"2024-09-21T06:03:57.429064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:22.240365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572345+0000","last_change":"2024-09-21T06:03:55.444048+0000","last_active":"2024-09-21T06:03:57.572345+0000","last_peered":"2024-09-21T06:03:57.572345+0000","last_clean":"2024-09-21T06:03:57.572345+0000","last_became_active":"2024-09-21T06:03:55.443780+0000","last_became_peered":"2024-09-21T06:03:55.443780+0000","last_unstale":"2024-09-21T06:03:57.572345+0000","last_undegraded":"2024-09-21T06:03:57.572345+0000","last_fullsized":"2024-09-21T06:03:57.572345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:22.074462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:01.350 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:04:01.350 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T06:04:01.351 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T06:04:01.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 -- 172.21.15.118:0/4022912422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0cedb0 msgr2=0x7f1d4c0cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 --2- 172.21.15.118:0/4022912422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0cedb0 0x7f1d4c0cf1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1d34005fd0 tx=0x7f1d3402a520 comp rx=0 tx=0).stop 2024-09-21T06:04:01.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 -- 172.21.15.118:0/4022912422 shutdown_connections 2024-09-21T06:04:01.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 --2- 172.21.15.118:0/4022912422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0cedb0 0x7f1d4c0cf1c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 --2- 172.21.15.118:0/4022912422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d4c144dc0 0x7f1d4c144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 -- 172.21.15.118:0/4022912422 >> 172.21.15.118:0/4022912422 conn(0x7f1d4c06d6e0 msgr2=0x7f1d4c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:01.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 -- 172.21.15.118:0/4022912422 shutdown_connections 2024-09-21T06:04:01.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.608+0000 7f1d4b200640 1 -- 172.21.15.118:0/4022912422 wait complete. 2024-09-21T06:04:01.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.610+0000 7f1d4b200640 1 Processor -- start 2024-09-21T06:04:01.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.610+0000 7f1d4b200640 1 -- start start 2024-09-21T06:04:01.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.611+0000 7f1d4b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d4c0cedb0 0x7f1d4c0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d4c0cf700 0x7f1d4c1f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c144dc0 0x7f1d4c0b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c15fe40 con 0x7f1d4c144dc0 2024-09-21T06:04:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c0b5270 con 0x7f1d4c0cedb0 2024-09-21T06:04:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c15ffc0 con 0x7f1d4c0cf700 2024-09-21T06:04:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d49e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d4c0cedb0 0x7f1d4c0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c144dc0 0x7f1d4c0b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d49e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d4c0cedb0 0x7f1d4c0af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56248/0 (socket says 172.21.15.118:56248) 2024-09-21T06:04:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d49e00640 1 -- 172.21.15.118:0/2768041452 learned_addr learned my addr 172.21.15.118:0/2768041452 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d41400640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d4c0cf700 0x7f1d4c1f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4a800640 1 -- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d4c0cf700 msgr2=0x7f1d4c1f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4a800640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d4c0cf700 0x7f1d4c1f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4a800640 1 -- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d4c0cedb0 msgr2=0x7f1d4c0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4a800640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d4c0cedb0 0x7f1d4c0af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.612+0000 7f1d4a800640 1 -- 172.21.15.118:0/2768041452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c1f6850 con 0x7f1d4c144dc0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.613+0000 7f1d4a800640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c144dc0 0x7f1d4c0b5ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400be00 tx=0x7f1d4400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.613+0000 7f1d42a00640 1 -- 172.21.15.118:0/2768041452 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44003970 con 0x7f1d4c144dc0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.613+0000 7f1d42a00640 1 -- 172.21.15.118:0/2768041452 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d44003c00 con 0x7f1d4c144dc0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.613+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c0abc80 con 0x7f1d4c144dc0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.613+0000 7f1d42a00640 1 -- 172.21.15.118:0/2768041452 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44004020 con 0x7f1d4c144dc0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.613+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c0aabe0 con 0x7f1d4c144dc0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.614+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d4c0aa920 con 0x7f1d4c144dc0 2024-09-21T06:04:01.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.615+0000 7f1d42a00640 1 -- 172.21.15.118:0/2768041452 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d440041c0 con 0x7f1d4c144dc0 2024-09-21T06:04:01.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.616+0000 7f1d42a00640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d28078b90 0x7f1d2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:01.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.616+0000 7f1d42a00640 1 -- 172.21.15.118:0/2768041452 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d4409ade0 con 0x7f1d4c144dc0 2024-09-21T06:04:01.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.617+0000 7f1d49e00640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d28078b90 0x7f1d2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.618+0000 7f1d49e00640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d28078b90 0x7f1d2807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00bc00 tx=0x7f1d3c00b390 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:01.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.621+0000 7f1d42a00640 1 -- 172.21.15.118:0/2768041452 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1d4c1f6850 con 0x7f1d4c144dc0 2024-09-21T06:04:01.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.808+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f1d4c160470 con 0x7f1d4c144dc0 2024-09-21T06:04:01.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.808+0000 7f1d42a00640 1 -- 172.21.15.118:0/2768041452 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v23) ==== 86+0+143 (secure 0 0 0) 0x7f1d44062be0 con 0x7f1d4c144dc0 2024-09-21T06:04:01.810 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:01.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d28078b90 msgr2=0x7f1d2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d28078b90 0x7f1d2807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00bc00 tx=0x7f1d3c00b390 comp rx=0 tx=0).stop 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c144dc0 msgr2=0x7f1d4c0b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c144dc0 0x7f1d4c0b5ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400be00 tx=0x7f1d4400bef0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 shutdown_connections 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c144dc0 0x7f1d4c0b5ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d28078b90 0x7f1d2807b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d4c0cf700 0x7f1d4c1f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 --2- 172.21.15.118:0/2768041452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d4c0cedb0 0x7f1d4c0af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 >> 172.21.15.118:0/2768041452 conn(0x7f1d4c06d6e0 msgr2=0x7f1d4c0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 shutdown_connections 2024-09-21T06:04:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:01.811+0000 7f1d4b200640 1 -- 172.21.15.118:0/2768041452 wait complete. 2024-09-21T06:04:01.837 INFO:teuthology.orchestra.run.smithi118.stdout:[{"version":23,"timestamp":"2024-09-21T06:03:36.925773+0000","name":"","changes":[{"name":"mgr/mon_warn_on_pool_no_app","new_value":"false"}]}] 2024-09-21T06:04:01.837 INFO:tasks.ceph_manager:config epoch is 23 2024-09-21T06:04:01.837 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T06:04:01.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T06:04:01.837 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T06:04:02.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 -- 172.21.15.118:0/1202199121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8a00d1590 msgr2=0x7fb8a0142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1202199121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8a00d1590 0x7fb8a0142730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009830 tx=0x7fb88c02a480 comp rx=0 tx=0).stop 2024-09-21T06:04:02.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 -- 172.21.15.118:0/1202199121 shutdown_connections 2024-09-21T06:04:02.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1202199121 >> v2:172.21.15.149:3300/0 conn(0x7fb8a013fef0 0x7fb8a0142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1202199121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8a00d1590 0x7fb8a0142730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 -- 172.21.15.118:0/1202199121 >> 172.21.15.118:0/1202199121 conn(0x7fb8a006d110 msgr2=0x7fb8a006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:02.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 -- 172.21.15.118:0/1202199121 shutdown_connections 2024-09-21T06:04:02.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.056+0000 7fb8a8200640 1 -- 172.21.15.118:0/1202199121 wait complete. 2024-09-21T06:04:02.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.059+0000 7fb8a8200640 1 Processor -- start 2024-09-21T06:04:02.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.059+0000 7fb8a8200640 1 -- start start 2024-09-21T06:04:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.060+0000 7fb8a8200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a013fae0 0x7fb8a01529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.060+0000 7fb8a8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a013fef0 0x7fb8a0138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.060+0000 7fb8a8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8a01f5560 0x7fb8a01f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.060+0000 7fb8a8200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00cfb10 con 0x7fb8a013fae0 2024-09-21T06:04:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.060+0000 7fb8a8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00cf990 con 0x7fb8a013fef0 2024-09-21T06:04:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.060+0000 7fb8a8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a00cfc90 con 0x7fb8a01f5560 2024-09-21T06:04:02.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a013fae0 0x7fb8a01529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:02.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a013fae0 0x7fb8a01529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53614/0 (socket says 172.21.15.118:53614) 2024-09-21T06:04:02.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 -- 172.21.15.118:0/1786085574 learned_addr learned my addr 172.21.15.118:0/1786085574 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:02.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a4e00640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a013fef0 0x7fb8a0138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 -- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8a01f5560 msgr2=0x7fb8a01f5970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8a01f5560 0x7fb8a01f5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 -- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a013fef0 msgr2=0x7fb8a0138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a013fef0 0x7fb8a0138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 -- 172.21.15.118:0/1786085574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a01398f0 con 0x7fb8a013fae0 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb8a5800640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a013fae0 0x7fb8a01529a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c430 tx=0x7fb89400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.061+0000 7fb89d600640 1 -- 172.21.15.118:0/1786085574 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894011790 con 0x7fb8a013fae0 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.062+0000 7fb89d600640 1 -- 172.21.15.118:0/1786085574 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb894017070 con 0x7fb8a013fae0 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.062+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a01f61b0 con 0x7fb8a013fae0 2024-09-21T06:04:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.062+0000 7fb89d600640 1 -- 172.21.15.118:0/1786085574 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894011ce0 con 0x7fb8a013fae0 2024-09-21T06:04:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.062+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a01521a0 con 0x7fb8a013fae0 2024-09-21T06:04:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.063+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a00d0140 con 0x7fb8a013fae0 2024-09-21T06:04:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.064+0000 7fb89d600640 1 -- 172.21.15.118:0/1786085574 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb89401c460 con 0x7fb8a013fae0 2024-09-21T06:04:02.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.065+0000 7fb89d600640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb880078b90 0x7fb88007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.065+0000 7fb89d600640 1 -- 172.21.15.118:0/1786085574 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb89409aab0 con 0x7fb8a013fae0 2024-09-21T06:04:02.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.065+0000 7fb8a4e00640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb880078b90 0x7fb88007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:02.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.066+0000 7fb8a4e00640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb880078b90 0x7fb88007b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb88c034000 tx=0x7fb88c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:02.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.069+0000 7fb89d600640 1 -- 172.21.15.118:0/1786085574 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb894062ef0 con 0x7fb8a013fae0 2024-09-21T06:04:02.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.302+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb8a0142f10 con 0x7fb8a013fae0 2024-09-21T06:04:02.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.305+0000 7fb89d600640 1 -- 172.21.15.118:0/1786085574 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194717 (secure 0 0 0) 0x7fb8940627f0 con 0x7fb8a013fae0 2024-09-21T06:04:02.309 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:02.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb880078b90 msgr2=0x7fb88007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb880078b90 0x7fb88007b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb88c034000 tx=0x7fb88c004730 comp rx=0 tx=0).stop 2024-09-21T06:04:02.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a013fae0 msgr2=0x7fb8a01529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a013fae0 0x7fb8a01529a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c430 tx=0x7fb89400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 shutdown_connections 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb880078b90 0x7fb88007b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8a01f5560 0x7fb8a01f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8a013fef0 0x7fb8a0138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 --2- 172.21.15.118:0/1786085574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8a013fae0 0x7fb8a01529a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.308+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 >> 172.21.15.118:0/1786085574 conn(0x7fb8a006d110 msgr2=0x7fb8a015b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.309+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 shutdown_connections 2024-09-21T06:04:02.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.309+0000 7fb8a8200640 1 -- 172.21.15.118:0/1786085574 wait complete. 2024-09-21T06:04:02.331 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":952547634},{"type":"v1","addr":"172.21.15.149:6801","nonce":952547634}]},"active_addr":"172.21.15.149:6801/952547634","active_change":"2024-09-21T06:03:40.442530+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":1779524058}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2891958912}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":392668072}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":273127916}]}]} 2024-09-21T06:04:02.336 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T06:04:02.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T06:04:02.336 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 -- 172.21.15.118:0/3170211845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 msgr2=0x7f8824142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 --2- 172.21.15.118:0/3170211845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824142b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88240d1af0 tx=0x7f881c02a9a0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 -- 172.21.15.118:0/3170211845 shutdown_connections 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 --2- 172.21.15.118:0/3170211845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824142b40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 --2- 172.21.15.118:0/3170211845 >> v2:172.21.15.149:3300/0 conn(0x7f882413fef0 0x7f88240d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 --2- 172.21.15.118:0/3170211845 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882413fae0 0x7f88240d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 -- 172.21.15.118:0/3170211845 >> 172.21.15.118:0/3170211845 conn(0x7f882406d110 msgr2=0x7f882406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:02.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 -- 172.21.15.118:0/3170211845 shutdown_connections 2024-09-21T06:04:02.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.555+0000 7f882b000640 1 -- 172.21.15.118:0/3170211845 wait complete. 2024-09-21T06:04:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.557+0000 7f882b000640 1 Processor -- start 2024-09-21T06:04:02.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.558+0000 7f882b000640 1 -- start start 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f882b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882413fae0 0x7f882413ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f882b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882413fef0 0x7f88241f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f882b000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f882b000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f882406f370 con 0x7f8824142730 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f882b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f882406f1f0 con 0x7f882413fae0 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f882b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f882406f4f0 con 0x7f882413fef0 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f8829000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f8829000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53626/0 (socket says 172.21.15.118:53626) 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.559+0000 7f8829000640 1 -- 172.21.15.118:0/549921586 learned_addr learned my addr 172.21.15.118:0/549921586 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8823400640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882413fef0 0x7f88241f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:02.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8823e00640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882413fae0 0x7f882413ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8829000640 1 -- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882413fef0 msgr2=0x7f88241f9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8829000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882413fef0 0x7f88241f9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8829000640 1 -- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882413fae0 msgr2=0x7f882413ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8829000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882413fae0 0x7f882413ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8829000640 1 -- 172.21.15.118:0/549921586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8824074770 con 0x7f8824142730 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8823400640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882413fef0 0x7f88241f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8823e00640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882413fae0 0x7f882413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f8829000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824139530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f881c009d60 tx=0x7f881c003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f881be00640 1 -- 172.21.15.118:0/549921586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c033050 con 0x7f8824142730 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f881be00640 1 -- 172.21.15.118:0/549921586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f881c004450 con 0x7f8824142730 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8824074a50 con 0x7f8824142730 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f881be00640 1 -- 172.21.15.118:0/549921586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c004840 con 0x7f8824142730 2024-09-21T06:04:02.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.560+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882413d690 con 0x7f8824142730 2024-09-21T06:04:02.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.562+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882406f9a0 con 0x7f8824142730 2024-09-21T06:04:02.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.562+0000 7f881be00640 1 -- 172.21.15.118:0/549921586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f881c036070 con 0x7f8824142730 2024-09-21T06:04:02.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.564+0000 7f881be00640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8804078b90 0x7f880407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:02.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.564+0000 7f881be00640 1 -- 172.21.15.118:0/549921586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f881c0bbf20 con 0x7f8824142730 2024-09-21T06:04:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.565+0000 7f8823e00640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8804078b90 0x7f880407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:02.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.565+0000 7f8823e00640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8804078b90 0x7f880407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f881400a810 tx=0x7f8814008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:02.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.569+0000 7f881be00640 1 -- 172.21.15.118:0/549921586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f881c084360 con 0x7f8824142730 2024-09-21T06:04:02.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.755+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8824142470 con 0x7f8824142730 2024-09-21T06:04:02.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.756+0000 7f881be00640 1 -- 172.21.15.118:0/549921586 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16737 (secure 0 0 0) 0x7f881c083c60 con 0x7f8824142730 2024-09-21T06:04:02.758 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:02.758 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:57.424251+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8804078b90 msgr2=0x7f880407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8804078b90 0x7f880407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f881400a810 tx=0x7f8814008040 comp rx=0 tx=0).stop 2024-09-21T06:04:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 msgr2=0x7f8824139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824139530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f881c009d60 tx=0x7f881c003ef0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 shutdown_connections 2024-09-21T06:04:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8824142730 0x7f8824139530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8804078b90 0x7f880407b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f882413fef0 0x7f88241f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 --2- 172.21.15.118:0/549921586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f882413fae0 0x7f882413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:02.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 >> 172.21.15.118:0/549921586 conn(0x7f882406d110 msgr2=0x7f882415efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:02.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 shutdown_connections 2024-09-21T06:04:02.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:02.758+0000 7f882b000640 1 -- 172.21.15.118:0/549921586 wait complete. 2024-09-21T06:04:02.782 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T06:04:02.782 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:03.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.004+0000 7f9ba4a00640 1 -- 172.21.15.118:0/3994799040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144860 msgr2=0x7f9ba00cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.004+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/3994799040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144860 0x7f9ba00cf4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009830 tx=0x7f9b8c02a5c0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.004+0000 7f9ba4a00640 1 -- 172.21.15.118:0/3994799040 shutdown_connections 2024-09-21T06:04:03.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.004+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/3994799040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144860 0x7f9ba00cf4c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.004+0000 7f9ba4a00640 1 -- 172.21.15.118:0/3994799040 >> 172.21.15.118:0/3994799040 conn(0x7f9ba006d6e0 msgr2=0x7f9ba00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.004+0000 7f9ba4a00640 1 -- 172.21.15.118:0/3994799040 shutdown_connections 2024-09-21T06:04:03.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.004+0000 7f9ba4a00640 1 -- 172.21.15.118:0/3994799040 wait complete. 2024-09-21T06:04:03.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.006+0000 7f9ba4a00640 1 Processor -- start 2024-09-21T06:04:03.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.007+0000 7f9ba4a00640 1 -- start start 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ba00cfa00 0x7f9ba00b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba0144860 0x7f9ba013d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144dc0 0x7f9ba00b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9ba4a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba00b4bf0 con 0x7f9ba0144dc0 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9ba4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba00b4a70 con 0x7f9ba0144860 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9ba4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba00b4d70 con 0x7f9ba00cfa00 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9b9f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144dc0 0x7f9ba00b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9b9f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144dc0 0x7f9ba00b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53648/0 (socket says 172.21.15.118:53648) 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9b9f200640 1 -- 172.21.15.118:0/1361342017 learned_addr learned my addr 172.21.15.118:0/1361342017 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9b9de00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba0144860 0x7f9ba013d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.008+0000 7f9b9e800640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ba00cfa00 0x7f9ba00b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b9f200640 1 -- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ba00cfa00 msgr2=0x7f9ba00b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b9f200640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ba00cfa00 0x7f9ba00b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b9f200640 1 -- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba0144860 msgr2=0x7f9ba013d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b9f200640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba0144860 0x7f9ba013d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b9f200640 1 -- 172.21.15.118:0/1361342017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba00b25c0 con 0x7f9ba0144dc0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b9f200640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144dc0 0x7f9ba00b5f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800cae0 tx=0x7f9b9800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b96a00640 1 -- 172.21.15.118:0/1361342017 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98016020 con 0x7f9ba0144dc0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b96a00640 1 -- 172.21.15.118:0/1361342017 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b9800ad30 con 0x7f9ba0144dc0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba00b2ad0 con 0x7f9ba0144dc0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9b96a00640 1 -- 172.21.15.118:0/1361342017 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98012680 con 0x7f9ba0144dc0 2024-09-21T06:04:03.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.009+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba0150ed0 con 0x7f9ba0144dc0 2024-09-21T06:04:03.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.010+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba00b2840 con 0x7f9ba0144dc0 2024-09-21T06:04:03.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.012+0000 7f9b96a00640 1 -- 172.21.15.118:0/1361342017 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b98019020 con 0x7f9ba0144dc0 2024-09-21T06:04:03.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.012+0000 7f9b96a00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b80078b90 0x7f9b8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.013+0000 7f9b96a00640 1 -- 172.21.15.118:0/1361342017 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9b9809ae30 con 0x7f9ba0144dc0 2024-09-21T06:04:03.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.013+0000 7f9b9e800640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b80078b90 0x7f9b8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.015+0000 7f9b9e800640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b80078b90 0x7f9b8007b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001720 tx=0x7f9b90009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.017+0000 7f9b96a00640 1 -- 172.21.15.118:0/1361342017 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9b98020030 con 0x7f9ba0144dc0 2024-09-21T06:04:03.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.204+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ba00774b0 con 0x7f9ba0144dc0 2024-09-21T06:04:03.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.206+0000 7f9b96a00640 1 -- 172.21.15.118:0/1361342017 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16737 (secure 0 0 0) 0x7f9ba00774b0 con 0x7f9ba0144dc0 2024-09-21T06:04:03.208 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:03.208 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:57.424251+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b80078b90 msgr2=0x7f9b8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b80078b90 0x7f9b8007b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001720 tx=0x7f9b90009040 comp rx=0 tx=0).stop 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144dc0 msgr2=0x7f9ba00b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144dc0 0x7f9ba00b5f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800cae0 tx=0x7f9b9800a060 comp rx=0 tx=0).stop 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 shutdown_connections 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ba0144dc0 0x7f9ba00b5f60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ba0144860 0x7f9ba013d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b80078b90 0x7f9b8007b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 --2- 172.21.15.118:0/1361342017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ba00cfa00 0x7f9ba00b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 >> 172.21.15.118:0/1361342017 conn(0x7f9ba006d6e0 msgr2=0x7f9ba0073510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 shutdown_connections 2024-09-21T06:04:03.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.208+0000 7f9ba4a00640 1 -- 172.21.15.118:0/1361342017 wait complete. 2024-09-21T06:04:03.231 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T06:04:03.231 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T06:04:03.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T06:04:03.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T06:04:03.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T06:04:03.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T06:04:03.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T06:04:03.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T06:04:03.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.626+0000 7f1fcb400640 1 -- 172.21.15.118:0/3844306284 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc02e870 con 0x7f1fcc0ce8b0 2024-09-21T06:04:03.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.627+0000 7f1fd3800640 1 -- 172.21.15.118:0/3844306284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0ce8b0 msgr2=0x7f1fcc0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.627+0000 7f1fd3800640 1 --2- 172.21.15.118:0/3844306284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0ce8b0 0x7f1fcc0b4140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc071380 tx=0x7f1fbc02aab0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.627+0000 7f1fd3800640 1 -- 172.21.15.118:0/3844306284 shutdown_connections 2024-09-21T06:04:03.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.627+0000 7f1fd3800640 1 --2- 172.21.15.118:0/3844306284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0ce8b0 0x7f1fcc0b4140 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.627+0000 7f1fd3800640 1 --2- 172.21.15.118:0/3844306284 >> v2:172.21.15.118:3300/0 conn(0x7f1fcc0aff50 0x7f1fcc0d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.627+0000 7f1fd3800640 1 -- 172.21.15.118:0/3844306284 >> 172.21.15.118:0/3844306284 conn(0x7f1fcc06d740 msgr2=0x7f1fcc0b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.628+0000 7f1fd3800640 1 -- 172.21.15.118:0/3844306284 shutdown_connections 2024-09-21T06:04:03.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.628+0000 7f1fd3800640 1 -- 172.21.15.118:0/3844306284 wait complete. 2024-09-21T06:04:03.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.629+0000 7fc0cd400640 1 -- 172.21.15.118:0/324808891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ac005910 msgr2=0x7fc0ac005d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.629+0000 7fc0cd400640 1 --2- 172.21.15.118:0/324808891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ac005910 0x7fc0ac005d20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000aca0 tx=0x7fc0ac006940 comp rx=0 tx=0).stop 2024-09-21T06:04:03.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.630+0000 7fc0cd400640 1 -- 172.21.15.118:0/324808891 shutdown_connections 2024-09-21T06:04:03.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.630+0000 7fc0cd400640 1 --2- 172.21.15.118:0/324808891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ac005910 0x7fc0ac005d20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.630+0000 7fc0cd400640 1 -- 172.21.15.118:0/324808891 >> 172.21.15.118:0/324808891 conn(0x7fc0c806d6e0 msgr2=0x7fc0c80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.631+0000 7f6dcbe00640 1 -- 172.21.15.118:0/1551099674 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0032870 con 0x7f6dc4054360 2024-09-21T06:04:03.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.631+0000 7fc0cd400640 1 -- 172.21.15.118:0/324808891 shutdown_connections 2024-09-21T06:04:03.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.632+0000 7fc0cd400640 1 -- 172.21.15.118:0/324808891 wait complete. 2024-09-21T06:04:03.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.632+0000 7f6dd3e00640 1 -- 172.21.15.118:0/1551099674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc4054360 msgr2=0x7f6dc4057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.632+0000 7f6dd3e00640 1 --2- 172.21.15.118:0/1551099674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc4054360 0x7f6dc4057c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4010e80 tx=0x7f6dc002a3b0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.633+0000 7f6dd3e00640 1 -- 172.21.15.118:0/1551099674 shutdown_connections 2024-09-21T06:04:03.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.633+0000 7f6dd3e00640 1 --2- 172.21.15.118:0/1551099674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc4054360 0x7f6dc4057c80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.633+0000 7f6dd3e00640 1 -- 172.21.15.118:0/1551099674 >> 172.21.15.118:0/1551099674 conn(0x7f6dc403a5f0 msgr2=0x7f6dc403aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.633+0000 7f1fd3800640 1 Processor -- start 2024-09-21T06:04:03.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.633+0000 7f6dd3e00640 1 -- 172.21.15.118:0/1551099674 shutdown_connections 2024-09-21T06:04:03.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.633+0000 7f6dd3e00640 1 -- 172.21.15.118:0/1551099674 wait complete. 2024-09-21T06:04:03.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.634+0000 7f1fd3800640 1 -- start start 2024-09-21T06:04:03.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.634+0000 7f011d200640 1 -- 172.21.15.118:0/1931715284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 msgr2=0x7f01180b3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.634+0000 7f011d200640 1 --2- 172.21.15.118:0/1931715284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 0x7f01180b3fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0118072570 tx=0x7f010402a2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.635+0000 7f011d200640 1 -- 172.21.15.118:0/1931715284 shutdown_connections 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.635+0000 7f011d200640 1 --2- 172.21.15.118:0/1931715284 >> v2:172.21.15.118:3300/0 conn(0x7f011815ea10 0x7f011815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.635+0000 7f011d200640 1 --2- 172.21.15.118:0/1931715284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 0x7f01180b3fc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.635+0000 7f011d200640 1 --2- 172.21.15.118:0/1931715284 >> v2:172.21.15.149:3300/0 conn(0x7f011815ae10 0x7f01180749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.635+0000 7f011d200640 1 -- 172.21.15.118:0/1931715284 >> 172.21.15.118:0/1931715284 conn(0x7f011806d6e0 msgr2=0x7f01180b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.635+0000 7f011d200640 1 -- 172.21.15.118:0/1931715284 shutdown_connections 2024-09-21T06:04:03.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7fc0cd400640 1 Processor -- start 2024-09-21T06:04:03.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7fc0cd400640 1 -- start start 2024-09-21T06:04:03.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.635+0000 7f011d200640 1 -- 172.21.15.118:0/1931715284 wait complete. 2024-09-21T06:04:03.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7f1fd3800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0aff50 0x7f1fcc1fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7f1fd3800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fcc15d240 0x7f1fcc158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7f1fd3800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fcc1578e0 0x7f1fcc158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7f1fd3800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc0b4bd0 con 0x7f1fcc1578e0 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7f1fd3800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc0b4a50 con 0x7f1fcc0aff50 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.636+0000 7f1fd3800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1fcc0b4d50 con 0x7f1fcc15d240 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fcc1578e0 0x7f1fcc158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0aff50 0x7f1fcc1fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0aff50 0x7f1fcc1fa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56374/0 (socket says 172.21.15.118:56374) 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd0e00640 1 -- 172.21.15.118:0/57020783 learned_addr learned my addr 172.21.15.118:0/57020783 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fcc1578e0 0x7f1fcc158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53720/0 (socket says 172.21.15.118:53720) 2024-09-21T06:04:03.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f6dd3e00640 1 Processor -- start 2024-09-21T06:04:03.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd1800640 1 -- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fcc15d240 msgr2=0x7f1fcc158630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:04:03.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.638+0000 7f6dd3e00640 1 -- start start 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd1800640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fcc15d240 0x7f1fcc158630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd1800640 1 -- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0aff50 msgr2=0x7f1fcc1fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd1800640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fcc0aff50 0x7f1fcc1fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.637+0000 7f1fd1800640 1 -- 172.21.15.118:0/57020783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc158010 con 0x7f1fcc1578e0 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.638+0000 7f1fd1800640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fcc1578e0 0x7f1fcc158b70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0749f0 tx=0x7f1fbc030f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.638+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc044070 con 0x7f1fcc1578e0 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fbc004250 con 0x7f1fcc1578e0 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc004640 con 0x7f1fcc1578e0 2024-09-21T06:04:03.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7f1fd3800640 1 -- 172.21.15.118:0/57020783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc0ad9f0 con 0x7f1fcc1578e0 2024-09-21T06:04:03.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0cd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ac005910 0x7fc0c814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0cd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0c8150be0 0x7fc0c81f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7f1fd3800640 1 -- 172.21.15.118:0/57020783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc0adfb0 con 0x7f1fcc1578e0 2024-09-21T06:04:03.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0cd400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c815d180 0x7fc0c815d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7f1a5d400640 1 -- 172.21.15.118:0/81413386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580d2b20 msgr2=0x7f1a580d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7f1a5d400640 1 --2- 172.21.15.118:0/81413386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580d2b20 0x7f1a580d3330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009830 tx=0x7f1a4802a510 comp rx=0 tx=0).stop 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0cd400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8070bb0 con 0x7fc0c815d180 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0cd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c815f870 con 0x7fc0ac005910 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0cd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c8070d30 con 0x7fc0c8150be0 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0bf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0c8150be0 0x7fc0c81f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0bf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0c8150be0 0x7fc0c81f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:59836/0 (socket says 172.21.15.118:59836) 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0bf400640 1 -- 172.21.15.118:0/2008796002 learned_addr learned my addr 172.21.15.118:0/2008796002 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7fc0c7e00640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ac005910 0x7fc0c814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7fc0bf400640 1 -- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ac005910 msgr2=0x7fc0c814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7fc0bf400640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ac005910 0x7fc0c814ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7fc0bf400640 1 -- 172.21.15.118:0/2008796002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c815d180 msgr2=0x7fc0c815d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7fc0bf400640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0c815d180 0x7fc0c815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.639+0000 7f011d200640 1 Processor -- start 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f011d200640 1 -- start start 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f1a5d400640 1 -- 172.21.15.118:0/81413386 shutdown_connections 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f1a5d400640 1 --2- 172.21.15.118:0/81413386 >> v2:172.21.15.118:3300/0 conn(0x7f1a580d3870 0x7f1a580b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f1a5d400640 1 --2- 172.21.15.118:0/81413386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580d2b20 0x7f1a580d3330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f1a5d400640 1 -- 172.21.15.118:0/81413386 >> 172.21.15.118:0/81413386 conn(0x7f1a580d1780 msgr2=0x7f1a580d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7fc0bf400640 1 -- 172.21.15.118:0/2008796002 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c814cfd0 con 0x7fc0c8150be0 2024-09-21T06:04:03.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1fa0001030 con 0x7f1fcc1578e0 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f6dd3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc4054360 0x7f6dc404fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f6dd3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6dc4056da0 0x7f6dc4050b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.640+0000 7f6dd3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dc40e2f40 0x7f6dc404da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f6dd0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6dc4056da0 0x7f6dc4050b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f6dd0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6dc4056da0 0x7f6dc4050b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:59846/0 (socket says 172.21.15.118:59846) 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f6dd3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc4007420 con 0x7f6dc40e2f40 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f6dd3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40072a0 con 0x7f6dc4054360 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f6dd3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc40075a0 con 0x7f6dc4056da0 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f6dd0a00640 1 -- 172.21.15.118:0/373180440 learned_addr learned my addr 172.21.15.118:0/373180440 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f6dd1e00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dc40e2f40 0x7f6dc404da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.641+0000 7f1a5d400640 1 -- 172.21.15.118:0/81413386 shutdown_connections 2024-09-21T06:04:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f6dd0a00640 1 -- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc4054360 msgr2=0x7f6dc404fbb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:04:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f6dd0a00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6dc4054360 0x7f6dc404fbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f6dd0a00640 1 -- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dc40e2f40 msgr2=0x7f6dc404da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f1a5d400640 1 -- 172.21.15.118:0/81413386 wait complete. 2024-09-21T06:04:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7fc0bf400640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0c8150be0 0x7fc0c81f2510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000abc0 tx=0x7fc0b0003e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f6dd0a00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dc40e2f40 0x7f6dc404da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f6dd0a00640 1 -- 172.21.15.118:0/373180440 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc417ec60 con 0x7f6dc4056da0 2024-09-21T06:04:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f6dd1e00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6dc40e2f40 0x7f6dc404da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0040030 con 0x7fc0c8150be0 2024-09-21T06:04:03.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7f011d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 0x7f01181f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f011d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f011815ae10 0x7f01181f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f011d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f011815ea10 0x7f01180ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0b003c560 con 0x7fc0c8150be0 2024-09-21T06:04:03.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.642+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000a580 con 0x7fc0c8150be0 2024-09-21T06:04:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f011d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0118070bb0 con 0x7f011815ae10 2024-09-21T06:04:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f011d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f011815f8a0 con 0x7f011815ea10 2024-09-21T06:04:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f011d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0118070d30 con 0x7f01180b3bb0 2024-09-21T06:04:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c815dad0 con 0x7fc0c8150be0 2024-09-21T06:04:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c8151560 con 0x7fc0c8150be0 2024-09-21T06:04:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f0117400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 0x7f01181f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f0116a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f011815ae10 0x7f01181f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f0117400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 0x7f01181f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:59852/0 (socket says 172.21.15.118:59852) 2024-09-21T06:04:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.643+0000 7f0117400640 1 -- 172.21.15.118:0/476333962 learned_addr learned my addr 172.21.15.118:0/476333962 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f0117e00640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f011815ea10 0x7f01180ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f6dd0a00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6dc4056da0 0x7f6dc4050b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009920 tx=0x7f6dc00338a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0040030 con 0x7f6dc4056da0 2024-09-21T06:04:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dc0033e50 con 0x7f6dc4056da0 2024-09-21T06:04:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0037040 con 0x7f6dc4056da0 2024-09-21T06:04:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fbc03f410 con 0x7f1fcc1578e0 2024-09-21T06:04:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc417ef40 con 0x7f6dc4056da0 2024-09-21T06:04:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.644+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc417f500 con 0x7f6dc4056da0 2024-09-21T06:04:03.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.645+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0c8074c00 con 0x7fc0c8150be0 2024-09-21T06:04:03.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.645+0000 7f0117400640 1 -- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f011815ea10 msgr2=0x7f01180ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.645+0000 7f0117400640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f011815ea10 0x7f01180ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.645+0000 7f0117400640 1 -- 172.21.15.118:0/476333962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f011815ae10 msgr2=0x7f01181f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.645+0000 7f0117400640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f011815ae10 0x7f01181f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.645+0000 7f0117400640 1 -- 172.21.15.118:0/476333962 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01181f2880 con 0x7f01180b3bb0 2024-09-21T06:04:03.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.645+0000 7f0117e00640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f011815ea10 0x7f01180ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:03.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.646+0000 7f0117400640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 0x7f01181f47d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f011000bde0 tx=0x7f01100114a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.646+0000 7f1a5d400640 1 Processor -- start 2024-09-21T06:04:03.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.646+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100173f0 con 0x7f01180b3bb0 2024-09-21T06:04:03.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.646+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f011001c070 con 0x7f01180b3bb0 2024-09-21T06:04:03.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.646+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100178e0 con 0x7f01180b3bb0 2024-09-21T06:04:03.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.646+0000 7f1a5d400640 1 -- start start 2024-09-21T06:04:03.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.646+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6da8001030 con 0x7f6dc4056da0 2024-09-21T06:04:03.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011815c750 con 0x7f01180b3bb0 2024-09-21T06:04:03.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7f1fc8c00640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fac078bc0 0x7f1fac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0b0043030 con 0x7fc0c8150be0 2024-09-21T06:04:03.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1fbc0bc550 con 0x7f1fcc1578e0 2024-09-21T06:04:03.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7f1fc8c00640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f1fac080db0 0x7f1fac083200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 --> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fbc009360 con 0x7f1fac080db0 2024-09-21T06:04:03.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1fbc0bc9e0 con 0x7f1fcc1578e0 2024-09-21T06:04:03.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.647+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01180b0fe0 con 0x7f01180b3bb0 2024-09-21T06:04:03.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.648+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01180749d0 con 0x7f01180b3bb0 2024-09-21T06:04:03.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.648+0000 7f1a5d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580b1db0 0x7f1a581ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.648+0000 7f211d400640 1 -- 172.21.15.118:0/1059676965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21180d27e0 msgr2=0x7f211815f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.648+0000 7f211d400640 1 --2- 172.21.15.118:0/1059676965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21180d27e0 0x7f211815f250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2108005fd0 tx=0x7f210802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1fd0e00640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fac078bc0 0x7f1fac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1a5d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a580d2b20 0x7f1a5815f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6dc0043070 con 0x7f6dc4056da0 2024-09-21T06:04:03.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1a56800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580b1db0 0x7f1a581ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1a56800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580b1db0 0x7f1a581ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:59868/0 (socket says 172.21.15.118:59868) 2024-09-21T06:04:03.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1a56800640 1 -- 172.21.15.118:0/4158922965 learned_addr learned my addr 172.21.15.118:0/4158922965 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f211d400640 1 -- 172.21.15.118:0/1059676965 shutdown_connections 2024-09-21T06:04:03.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f211d400640 1 --2- 172.21.15.118:0/1059676965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21180d27e0 0x7f211815f250 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f211d400640 1 -- 172.21.15.118:0/1059676965 >> 172.21.15.118:0/1059676965 conn(0x7f21180d4c10 msgr2=0x7f21180d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1a5d400640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a580d3870 0x7f1a58162170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7fc0c4c00640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0a4078c30 0x7fc0a407b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f211d400640 1 -- 172.21.15.118:0/1059676965 shutdown_connections 2024-09-21T06:04:03.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1fcbe00640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f1fac080db0 0x7f1fac083200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1a55e00640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a580d2b20 0x7f1a5815f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a580d2630 con 0x7f1a580d2b20 2024-09-21T06:04:03.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.649+0000 7f211d400640 1 -- 172.21.15.118:0/1059676965 wait complete. 2024-09-21T06:04:03.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a580d24b0 con 0x7f1a580d3870 2024-09-21T06:04:03.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1a580ba450 con 0x7f1a580b1db0 2024-09-21T06:04:03.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7f1a57200640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a580d3870 0x7f1a58162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc0b00bb610 con 0x7fc0c8150be0 2024-09-21T06:04:03.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7fc0c7e00640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0a4078c30 0x7fc0a407b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7fc0c4c00640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7fc0a4080f00 0x7fc0a4083350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7f1fd0e00640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fac078bc0 0x7f1fac07b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009bf0 tx=0x7f1fc4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 --> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0b0039e50 con 0x7fc0a4080f00 2024-09-21T06:04:03.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.650+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc0b00c2050 con 0x7fc0c8150be0 2024-09-21T06:04:03.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.651+0000 7fc0cca00640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7fc0a4080f00 0x7fc0a4083350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.651+0000 7f6dc9600640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6db0078b90 0x7f6db007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.651+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6dc00badc0 con 0x7f6dc4056da0 2024-09-21T06:04:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.651+0000 7f6dd1400640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6db0078b90 0x7f6db007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.651+0000 7f6dc9600640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f6db0080de0 0x7f6db0083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.651+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 --> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6db0083900 con 0x7f6db0080de0 2024-09-21T06:04:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.651+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6dc00bb250 con 0x7f6dc4056da0 2024-09-21T06:04:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7fc0c7e00640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0a4078c30 0x7fc0a407b140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8005fd0 tx=0x7fc0b8009e50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7f1a56800640 1 -- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a580d3870 msgr2=0x7f1a58162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7f6dd1e00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f6db0080de0 0x7f6db0083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7f1fcbe00640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f1fac080db0 0x7f1fac083200 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7f1a56800640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a580d3870 0x7f1a58162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7fc0cca00640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7fc0a4080f00 0x7fc0a4083350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0110017a80 con 0x7f01180b3bb0 2024-09-21T06:04:03.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7f6dd1400640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6db0078b90 0x7f6db007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4038530 tx=0x7f6dbc006b50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.652+0000 7f1a56800640 1 -- 172.21.15.118:0/4158922965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a580d2b20 msgr2=0x7f1a5815f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.653+0000 7f6dd1e00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f6db0080de0 0x7f6db0083230 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.654+0000 7f211d400640 1 Processor -- start 2024-09-21T06:04:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.653+0000 7f1a56800640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a580d2b20 0x7f1a5815f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.654+0000 7f1a56800640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a581eddb0 con 0x7f1a580b1db0 2024-09-21T06:04:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.654+0000 7f211d400640 1 -- start start 2024-09-21T06:04:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.654+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== osd.2 v2:172.21.15.118:6824/2733819645 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f6db0083900 con 0x7f6db0080de0 2024-09-21T06:04:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.654+0000 7f1a55e00640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a580d2b20 0x7f1a5815f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.655+0000 7f1a57200640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a580d3870 0x7f1a58162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.655+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== osd.0 v2:172.21.15.118:6811/3230871877 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f1fbc009360 con 0x7f1fac080db0 2024-09-21T06:04:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.655+0000 7f1a56800640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580b1db0 0x7f1a581ed440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009950 tx=0x7f1a48033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.656+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== osd.1 v2:172.21.15.118:6808/3649321090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fc0b0039e50 con 0x7fc0a4080f00 2024-09-21T06:04:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.656+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48031d60 con 0x7f1a580b1db0 2024-09-21T06:04:03.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f211d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f211806cf00 0x7f21181f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f211d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21180cfe10 0x7f211814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f211d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21180d27e0 0x7f21180c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f010f400640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f00f8078c60 0x7f00f807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f011009fe50 con 0x7f01180b3bb0 2024-09-21T06:04:03.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f010f400640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f00f8080f30 0x7f00f8083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a48033e10 con 0x7f1a580b1db0 2024-09-21T06:04:03.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a480332d0 con 0x7f1a580b1db0 2024-09-21T06:04:03.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a581ee090 con 0x7f1a580b1db0 2024-09-21T06:04:03.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 --> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00f8083a50 con 0x7f00f8080f30 2024-09-21T06:04:03.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01100a0240 con 0x7f01180b3bb0 2024-09-21T06:04:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f4484a00640 1 -- 172.21.15.118:0/3397116078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478054360 msgr2=0x7f447803c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f4484a00640 1 --2- 172.21.15.118:0/3397116078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478054360 0x7f447803c1f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f448006b950 tx=0x7f44800a6d90 comp rx=0 tx=0).stop 2024-09-21T06:04:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.657+0000 7f211ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21180d27e0 0x7f21180c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f211ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21180d27e0 0x7f21180c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56416/0 (socket says 172.21.15.118:56416) 2024-09-21T06:04:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f2117e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f211806cf00 0x7f21181f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f211d400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21180d4190 con 0x7f21180cfe10 2024-09-21T06:04:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f4484a00640 1 -- 172.21.15.118:0/3397116078 shutdown_connections 2024-09-21T06:04:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f4484a00640 1 --2- 172.21.15.118:0/3397116078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478054360 0x7f447803c1f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f4484a00640 1 --2- 172.21.15.118:0/3397116078 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4478056da0 0x7f4478057c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f4484a00640 1 -- 172.21.15.118:0/3397116078 >> 172.21.15.118:0/3397116078 conn(0x7f447803a5f0 msgr2=0x7f447803aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f211d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f21180d4010 con 0x7f21180d27e0 2024-09-21T06:04:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f211d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f21180d4310 con 0x7f211806cf00 2024-09-21T06:04:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f211ca00640 1 -- 172.21.15.118:0/272359895 learned_addr learned my addr 172.21.15.118:0/272359895 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f2117400640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21180cfe10 0x7f211814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f0116a00640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f00f8078c60 0x7f00f807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f4484a00640 1 -- 172.21.15.118:0/3397116078 shutdown_connections 2024-09-21T06:04:03.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.658+0000 7f4484a00640 1 -- 172.21.15.118:0/3397116078 wait complete. 2024-09-21T06:04:03.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f211ca00640 1 -- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f211806cf00 msgr2=0x7f21181f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f211ca00640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f211806cf00 0x7f21181f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f211ca00640 1 -- 172.21.15.118:0/272359895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21180cfe10 msgr2=0x7f211814cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f211ca00640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21180cfe10 0x7f211814cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f211ca00640 1 -- 172.21.15.118:0/272359895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21181e86f0 con 0x7f21180d27e0 2024-09-21T06:04:03.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f0117e00640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f00f8080f30 0x7f00f8083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f0116a00640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f00f8078c60 0x7f00f807b170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0108005fd0 tx=0x7f010800d4b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.659+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a581ee650 con 0x7f1a580b1db0 2024-09-21T06:04:03.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.660+0000 7f0117e00640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f00f8080f30 0x7f00f8083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.661+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a581eea30 con 0x7f1a580b1db0 2024-09-21T06:04:03.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.661+0000 7f211ca00640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21180d27e0 0x7f21180c9c60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21100139f0 tx=0x7f2110013ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.661+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== osd.3 v2:172.21.15.118:6800/2396738504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f00f8083a50 con 0x7f00f8080f30 2024-09-21T06:04:03.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.661+0000 7fe0a4000640 1 -- 172.21.15.118:0/3969239120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe084004b60 msgr2=0x7fe084004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.661+0000 7fe0a4000640 1 --2- 172.21.15.118:0/3969239120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe084004b60 0x7fe084004fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe09000aa40 tx=0x7fe084006940 comp rx=0 tx=0).stop 2024-09-21T06:04:03.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.662+0000 7fe0a2000640 1 -- 172.21.15.118:0/3969239120 reap_dead start 2024-09-21T06:04:03.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.662+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110021070 con 0x7f21180d27e0 2024-09-21T06:04:03.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.662+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f211000fe50 con 0x7f21180d27e0 2024-09-21T06:04:03.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.662+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110011330 con 0x7f21180d27e0 2024-09-21T06:04:03.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.663+0000 7f4484a00640 1 Processor -- start 2024-09-21T06:04:03.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.662+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a48033470 con 0x7f1a580b1db0 2024-09-21T06:04:03.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.663+0000 7f4484a00640 1 -- start start 2024-09-21T06:04:03.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.662+0000 7f211d400640 1 -- 172.21.15.118:0/272359895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21181f7b30 con 0x7f21180d27e0 2024-09-21T06:04:03.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.662+0000 7f211d400640 1 -- 172.21.15.118:0/272359895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21181f80f0 con 0x7f21180d27e0 2024-09-21T06:04:03.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.663+0000 7f211d400640 1 -- 172.21.15.118:0/272359895 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20f0001030 con 0x7f21180d27e0 2024-09-21T06:04:03.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.664+0000 7fe0a4000640 1 -- 172.21.15.118:0/3969239120 shutdown_connections 2024-09-21T06:04:03.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.664+0000 7fe0a4000640 1 -- 172.21.15.118:0/3969239120 >> 172.21.15.118:0/3969239120 conn(0x7fe09c0b2c30 msgr2=0x7fe09c0b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.664+0000 7fe0a4000640 1 -- 172.21.15.118:0/3969239120 shutdown_connections 2024-09-21T06:04:03.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.664+0000 7fe0a4000640 1 -- 172.21.15.118:0/3969239120 wait complete. 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.664+0000 7f1a4ea00640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.664+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a480bb800 con 0x7f1a580b1db0 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.665+0000 7f1a4ea00640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f1a38080e00 0x7f1a38083250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.665+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a4802fec0 con 0x7f1a38080e00 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.665+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1a480c2050 con 0x7f1a580b1db0 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.665+0000 7f1a57200640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f1a38080e00 0x7f1a38083250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.666+0000 7f1a55e00640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.666+0000 7f4484a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4478054360 0x7f4478052280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.666+0000 7f1a57200640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f1a38080e00 0x7f1a38083250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.666+0000 7f4484a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478056da0 0x7f44781748b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f4484a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44780e2f40 0x7f44780e1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f4484a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f44780070b0 con 0x7f4478056da0 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f4484a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4478006f30 con 0x7f44780e2f40 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f4484a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4478007230 con 0x7f4478054360 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f447fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44780e2f40 0x7f44780e1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f447fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44780e2f40 0x7f44780e1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56420/0 (socket says 172.21.15.118:56420) 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f447fe00640 1 -- 172.21.15.118:0/728982846 learned_addr learned my addr 172.21.15.118:0/728982846 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f447f400640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4478054360 0x7f4478052280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.667+0000 7f447ea00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478056da0 0x7f44781748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== osd.4 v2:172.21.15.149:6805/2084856893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f1a4802fec0 con 0x7f1a38080e00 2024-09-21T06:04:03.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f447fe00640 1 -- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4478054360 msgr2=0x7f4478052280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f447fe00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4478054360 0x7f4478052280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f447fe00640 1 -- 172.21.15.118:0/728982846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478056da0 msgr2=0x7f44781748b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f447fe00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478056da0 0x7f44781748b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f447fe00640 1 -- 172.21.15.118:0/728982846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44780517e0 con 0x7f44780e2f40 2024-09-21T06:04:03.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f447ea00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4478056da0 0x7f44781748b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:03.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21100114d0 con 0x7f21180d27e0 2024-09-21T06:04:03.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7f447fe00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44780e2f40 0x7f44780e1170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f448006b530 tx=0x7f44800afdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.668+0000 7fe0a4000640 1 Processor -- start 2024-09-21T06:04:03.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.669+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44800b4050 con 0x7f44780e2f40 2024-09-21T06:04:03.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.669+0000 7fe0a4000640 1 -- start start 2024-09-21T06:04:03.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.669+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44800b5040 con 0x7f44780e2f40 2024-09-21T06:04:03.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.669+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44800b9810 con 0x7f44780e2f40 2024-09-21T06:04:03.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.669+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447804efb0 con 0x7f44780e2f40 2024-09-21T06:04:03.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.669+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4478051d60 con 0x7f44780e2f40 2024-09-21T06:04:03.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.669+0000 7f1a55e00640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1a38078b90 0x7f1a3807b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a580c7f90 tx=0x7f1a4400b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.670+0000 7f210fe00640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20f8078c90 0x7f20f807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.670+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f21100a3040 con 0x7f21180d27e0 2024-09-21T06:04:03.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.670+0000 7f210fe00640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f20f8080f00 0x7f20f8083350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.670+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 --> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2110026e50 con 0x7f20f8080f00 2024-09-21T06:04:03.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.670+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f21100a3430 con 0x7f21180d27e0 2024-09-21T06:04:03.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7f2117e00640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20f8078c90 0x7f20f807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe09c143ae0 0x7fe09c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7f2117400640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f20f8080f00 0x7f20f8083350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe09c15ce70 0x7fe09c1ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44780077a0 con 0x7f44780e2f40 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a4000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe09c1ef810 0x7fe09c1efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a4000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c15b9d0 con 0x7fe09c1ef810 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c15b850 con 0x7fe09c15ce70 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c15e050 con 0x7fe09c143ae0 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe09c143ae0 0x7fe09c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe09c143ae0 0x7fe09c15c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:59932/0 (socket says 172.21.15.118:59932) 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a1600640 1 -- 172.21.15.118:0/245476431 learned_addr learned my addr 172.21.15.118:0/245476431 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.672+0000 7fe0a0c00640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe09c15ce70 0x7fe09c1ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7fe0a2000640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe09c1ef810 0x7fe09c1efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7fe0a1600640 1 -- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe09c15ce70 msgr2=0x7fe09c1ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7fe0a1600640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe09c15ce70 0x7fe09c1ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7fe0a1600640 1 -- 172.21.15.118:0/245476431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe09c1ef810 msgr2=0x7fe09c1efc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7fe0a1600640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe09c1ef810 0x7fe09c1efc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7fe0a1600640 1 -- 172.21.15.118:0/245476431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c15d440 con 0x7fe09c143ae0 2024-09-21T06:04:03.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7fe0a2000640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe09c1ef810 0x7fe09c1efc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:03.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.674+0000 7fe0a1600640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe09c143ae0 0x7fe09c15c930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe09000aa40 tx=0x7fe090031e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.674+0000 7f2117400640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f20f8080f00 0x7f20f8083350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.674+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090035070 con 0x7fe09c143ae0 2024-09-21T06:04:03.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f2117e00640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20f8078c90 0x7f20f807b1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2108033000 tx=0x7f2108004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c15d720 con 0x7fe09c143ae0 2024-09-21T06:04:03.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.673+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44800c2030 con 0x7f44780e2f40 2024-09-21T06:04:03.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f4473400640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4460078bc0 0x7f446007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4480137a80 con 0x7f44780e2f40 2024-09-21T06:04:03.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f4473400640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7f4460080e90 0x7f44600832e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 --> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44800c1e80 con 0x7f4460080e90 2024-09-21T06:04:03.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4480139e60 con 0x7f44780e2f40 2024-09-21T06:04:03.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f447ea00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7f4460080e90 0x7f44600832e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c15dce0 con 0x7fe09c143ae0 2024-09-21T06:04:03.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe090042070 con 0x7fe09c143ae0 2024-09-21T06:04:03.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.676+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09003c9e0 con 0x7fe09c143ae0 2024-09-21T06:04:03.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.675+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== osd.5 v2:172.21.15.149:6802/1726198958 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f2110026e50 con 0x7f20f8080f00 2024-09-21T06:04:03.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.676+0000 7f447f400640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4460078bc0 0x7f446007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.677+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe078001030 con 0x7fe09c143ae0 2024-09-21T06:04:03.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.678+0000 7f447ea00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7f4460080e90 0x7f44600832e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.679+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== osd.6 v2:172.21.15.149:6811/3763347027 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f44800c1e80 con 0x7f4460080e90 2024-09-21T06:04:03.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.679+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 --> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0c8151010 con 0x7fc0a4080f00 2024-09-21T06:04:03.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.680+0000 7f447f400640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4460078bc0 0x7f446007b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4478038530 tx=0x7f4474008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.681+0000 7fc0c4c00640 1 -- 172.21.15.118:0/2008796002 <== osd.1 v2:172.21.15.118:6808/3649321090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc0c8151010 con 0x7fc0a4080f00 2024-09-21T06:04:03.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.681+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7fc0a4080f00 msgr2=0x7fc0a4083350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.681+0000 7fc0cd400640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7fc0a4080f00 0x7fc0a4083350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.679+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe09003cb80 con 0x7fe09c143ae0 2024-09-21T06:04:03.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.681+0000 7fe099600640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe07c078b90 0x7fe07c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.681+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0900bbd10 con 0x7fe09c143ae0 2024-09-21T06:04:03.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fe099600640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fe07c080d80 0x7fe07c0831d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 --> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe09002fec0 con 0x7fe07c080d80 2024-09-21T06:04:03.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe090080090 con 0x7fe09c143ae0 2024-09-21T06:04:03.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 --> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6da8002dd0 con 0x7f6db0080de0 2024-09-21T06:04:03.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fe0a0c00640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe07c078b90 0x7fe07c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0a4078c30 msgr2=0x7fc0a407b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fc0cd400640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0a4078c30 0x7fc0a407b140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8005fd0 tx=0x7fc0b8009e50 comp rx=0 tx=0).stop 2024-09-21T06:04:03.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fe0a2000640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fe07c080d80 0x7fe07c0831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0c8150be0 msgr2=0x7fc0c81f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fc0cd400640 1 --2- 172.21.15.118:0/2008796002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0c8150be0 0x7fc0c81f2510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000abc0 tx=0x7fc0b0003e80 comp rx=0 tx=0).stop 2024-09-21T06:04:03.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fc0cca00640 1 -- 172.21.15.118:0/2008796002 reap_dead start 2024-09-21T06:04:03.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 shutdown_connections 2024-09-21T06:04:03.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.682+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 >> 172.21.15.118:0/2008796002 conn(0x7fc0c806d6e0 msgr2=0x7fc0c8076270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.683+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 shutdown_connections 2024-09-21T06:04:03.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.683+0000 7fc0cd400640 1 -- 172.21.15.118:0/2008796002 wait complete. 2024-09-21T06:04:03.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.683+0000 7f6dc9600640 1 -- 172.21.15.118:0/373180440 <== osd.2 v2:172.21.15.118:6824/2733819645 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6da8002dd0 con 0x7f6db0080de0 2024-09-21T06:04:03.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.683+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f6db0080de0 msgr2=0x7f6db0083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.683+0000 7f6dd3e00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f6db0080de0 0x7f6db0083230 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.683+0000 7fe0a0c00640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe07c078b90 0x7fe07c07b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe084005890 tx=0x7fe088005f60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6db0078b90 msgr2=0x7f6db007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6db0078b90 0x7f6db007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4038530 tx=0x7f6dbc006b50 comp rx=0 tx=0).stop 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6dc4056da0 msgr2=0x7f6dc4050b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 --2- 172.21.15.118:0/373180440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6dc4056da0 0x7f6dc4050b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009920 tx=0x7f6dc00338a0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd1e00640 1 -- 172.21.15.118:0/373180440 reap_dead start 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 shutdown_connections 2024-09-21T06:04:03.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 >> 172.21.15.118:0/373180440 conn(0x7f6dc403a5f0 msgr2=0x7f6dc403dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7fe0a2000640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fe07c080d80 0x7fe07c0831d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 shutdown_connections 2024-09-21T06:04:03.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.684+0000 7f6dd3e00640 1 -- 172.21.15.118:0/373180440 wait complete. 2024-09-21T06:04:03.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.685+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== osd.7 v2:172.21.15.149:6826/2881805415 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fe09002fec0 con 0x7fe07c080d80 2024-09-21T06:04:03.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.690+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 --> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1fa0002dd0 con 0x7f1fac080db0 2024-09-21T06:04:03.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.690+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 --> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0118073590 con 0x7f00f8080f30 2024-09-21T06:04:03.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.691+0000 7f1fc8c00640 1 -- 172.21.15.118:0/57020783 <== osd.0 v2:172.21.15.118:6811/3230871877 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1fa0002dd0 con 0x7f1fac080db0 2024-09-21T06:04:03.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.691+0000 7f010f400640 1 -- 172.21.15.118:0/476333962 <== osd.3 v2:172.21.15.118:6800/2396738504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0118073590 con 0x7f00f8080f30 2024-09-21T06:04:03.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.691+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f1fac080db0 msgr2=0x7f1fac083200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.691+0000 7f1fc2000640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f1fac080db0 0x7f1fac083200 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f00f8080f30 msgr2=0x7f00f8083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f011d200640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f00f8080f30 0x7f00f8083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fac078bc0 msgr2=0x7f1fac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fc2000640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fac078bc0 0x7f1fac07b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009bf0 tx=0x7f1fc4005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fcc1578e0 msgr2=0x7f1fcc158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fc2000640 1 --2- 172.21.15.118:0/57020783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fcc1578e0 0x7f1fcc158b70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0749f0 tx=0x7f1fbc030f00 comp rx=0 tx=0).stop 2024-09-21T06:04:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fd1800640 1 -- 172.21.15.118:0/57020783 reap_dead start 2024-09-21T06:04:03.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f00f8078c60 msgr2=0x7f00f807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 shutdown_connections 2024-09-21T06:04:03.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 >> 172.21.15.118:0/57020783 conn(0x7f1fcc06d740 msgr2=0x7f1fcc145440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.692+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 shutdown_connections 2024-09-21T06:04:03.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.693+0000 7f1fc2000640 1 -- 172.21.15.118:0/57020783 wait complete. 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.693+0000 7f011d200640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f00f8078c60 0x7f00f807b170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0108005fd0 tx=0x7f010800d4b0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.693+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 msgr2=0x7f01181f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.693+0000 7f011d200640 1 --2- 172.21.15.118:0/476333962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01180b3bb0 0x7f01181f47d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f011000bde0 tx=0x7f01100114a0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.693+0000 7f0117e00640 1 -- 172.21.15.118:0/476333962 reap_dead start 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.693+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 shutdown_connections 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.693+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 >> 172.21.15.118:0/476333962 conn(0x7f011806d6e0 msgr2=0x7f0118150d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.694+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 shutdown_connections 2024-09-21T06:04:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.694+0000 7f011d200640 1 -- 172.21.15.118:0/476333962 wait complete. 2024-09-21T06:04:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.702+0000 7f211d400640 1 -- 172.21.15.118:0/272359895 --> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20f0002dd0 con 0x7f20f8080f00 2024-09-21T06:04:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.702+0000 7f210fe00640 1 -- 172.21.15.118:0/272359895 <== osd.5 v2:172.21.15.149:6802/1726198958 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f20f0002dd0 con 0x7f20f8080f00 2024-09-21T06:04:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.702+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 --> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a580d0e30 con 0x7f1a38080e00 2024-09-21T06:04:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.703+0000 7f210d600640 1 -- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f20f8080f00 msgr2=0x7f20f8083350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.703+0000 7f210d600640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f20f8080f00 0x7f20f8083350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 -- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20f8078c90 msgr2=0x7f20f807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20f8078c90 0x7f20f807b1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2108033000 tx=0x7f2108004730 comp rx=0 tx=0).stop 2024-09-21T06:04:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 -- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21180d27e0 msgr2=0x7f21180c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 --2- 172.21.15.118:0/272359895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21180d27e0 0x7f21180c9c60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21100139f0 tx=0x7f2110013ae0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f211ca00640 1 -- 172.21.15.118:0/272359895 reap_dead start 2024-09-21T06:04:03.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f1a4ea00640 1 -- 172.21.15.118:0/4158922965 <== osd.4 v2:172.21.15.149:6805/2084856893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a580d0e30 con 0x7f1a38080e00 2024-09-21T06:04:03.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 -- 172.21.15.118:0/272359895 shutdown_connections 2024-09-21T06:04:03.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 -- 172.21.15.118:0/272359895 >> 172.21.15.118:0/272359895 conn(0x7f21180d4c10 msgr2=0x7f21180b9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 -- 172.21.15.118:0/272359895 shutdown_connections 2024-09-21T06:04:03.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.704+0000 7f210d600640 1 -- 172.21.15.118:0/272359895 wait complete. 2024-09-21T06:04:03.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.706+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 --> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f447803c440 con 0x7f4460080e90 2024-09-21T06:04:03.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.706+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f1a38080e00 msgr2=0x7f1a38083250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.706+0000 7f1a5d400640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f1a38080e00 0x7f1a38083250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.706+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1a38078b90 msgr2=0x7f1a3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.706+0000 7f1a5d400640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1a38078b90 0x7f1a3807b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a580c7f90 tx=0x7f1a4400b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.706+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580b1db0 msgr2=0x7f1a581ed440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.706+0000 7f1a5d400640 1 --2- 172.21.15.118:0/4158922965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a580b1db0 0x7f1a581ed440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009950 tx=0x7f1a48033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.707+0000 7f4473400640 1 -- 172.21.15.118:0/728982846 <== osd.6 v2:172.21.15.149:6811/3763347027 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f447803c440 con 0x7f4460080e90 2024-09-21T06:04:03.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.707+0000 7f1a57200640 1 -- 172.21.15.118:0/4158922965 reap_dead start 2024-09-21T06:04:03.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7f4460080e90 msgr2=0x7f44600832e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f4484a00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7f4460080e90 0x7f44600832e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 shutdown_connections 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 >> 172.21.15.118:0/4158922965 conn(0x7f1a580d1780 msgr2=0x7f1a580b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4460078bc0 msgr2=0x7f446007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f4484a00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4460078bc0 0x7f446007b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4478038530 tx=0x7f4474008040 comp rx=0 tx=0).stop 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44780e2f40 msgr2=0x7f44780e1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.708+0000 7f4484a00640 1 --2- 172.21.15.118:0/728982846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44780e2f40 0x7f44780e1170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f448006b530 tx=0x7f44800afdb0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.709+0000 7f447fe00640 1 -- 172.21.15.118:0/728982846 reap_dead start 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.709+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 shutdown_connections 2024-09-21T06:04:03.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.709+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 shutdown_connections 2024-09-21T06:04:03.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.709+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 >> 172.21.15.118:0/728982846 conn(0x7f447803a5f0 msgr2=0x7f447803c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.709+0000 7f1a5d400640 1 -- 172.21.15.118:0/4158922965 wait complete. 2024-09-21T06:04:03.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.709+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 shutdown_connections 2024-09-21T06:04:03.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.710+0000 7f4484a00640 1 -- 172.21.15.118:0/728982846 wait complete. 2024-09-21T06:04:03.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.712+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 --> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe078002dd0 con 0x7fe07c080d80 2024-09-21T06:04:03.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.713+0000 7fe099600640 1 -- 172.21.15.118:0/245476431 <== osd.7 v2:172.21.15.149:6826/2881805415 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe078002dd0 con 0x7fe07c080d80 2024-09-21T06:04:03.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.714+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fe07c080d80 msgr2=0x7fe07c0831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.714+0000 7fe0a4000640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fe07c080d80 0x7fe07c0831d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.715+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe07c078b90 msgr2=0x7fe07c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.715+0000 7fe0a4000640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe07c078b90 0x7fe07c07b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe084005890 tx=0x7fe088005f60 comp rx=0 tx=0).stop 2024-09-21T06:04:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.715+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe09c143ae0 msgr2=0x7fe09c15c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.715+0000 7fe0a4000640 1 --2- 172.21.15.118:0/245476431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe09c143ae0 0x7fe09c15c930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe09000aa40 tx=0x7fe090031e20 comp rx=0 tx=0).stop 2024-09-21T06:04:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.716+0000 7fe0a2000640 1 -- 172.21.15.118:0/245476431 reap_dead start 2024-09-21T06:04:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.716+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 shutdown_connections 2024-09-21T06:04:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.716+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 >> 172.21.15.118:0/245476431 conn(0x7fe09c0b2c30 msgr2=0x7fe09c15f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.717+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 shutdown_connections 2024-09-21T06:04:03.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:03.717+0000 7fe0a4000640 1 -- 172.21.15.118:0/245476431 wait complete. 2024-09-21T06:04:03.722 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.722 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T06:04:03.723 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T06:04:03.730 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T06:04:03.733 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T06:04:03.740 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T06:04:03.741 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.742 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T06:04:03.746 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.746 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T06:04:03.755 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:03.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T06:04:04.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.116+0000 7f731ca00640 1 -- 172.21.15.118:0/4042032448 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c031bf0 con 0x7f73200b5800 2024-09-21T06:04:04.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.116+0000 7f7324c00640 1 -- 172.21.15.118:0/4042032448 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73200b5800 msgr2=0x7f7320162940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.116+0000 7f7324c00640 1 --2- 172.21.15.118:0/4042032448 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73200b5800 0x7f7320162940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f730c009860 tx=0x7f730c02a4e0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.116+0000 7f7324c00640 1 -- 172.21.15.118:0/4042032448 shutdown_connections 2024-09-21T06:04:04.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.116+0000 7f7324c00640 1 --2- 172.21.15.118:0/4042032448 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73200b5800 0x7f7320162940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.116+0000 7f7324c00640 1 -- 172.21.15.118:0/4042032448 >> 172.21.15.118:0/4042032448 conn(0x7f73200b2550 msgr2=0x7f73200b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.117+0000 7f7324c00640 1 -- 172.21.15.118:0/4042032448 shutdown_connections 2024-09-21T06:04:04.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.118+0000 7f7324c00640 1 -- 172.21.15.118:0/4042032448 wait complete. 2024-09-21T06:04:04.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.121+0000 7f7324c00640 1 Processor -- start 2024-09-21T06:04:04.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.121+0000 7f7324c00640 1 -- start start 2024-09-21T06:04:04.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.123+0000 7f29cfe00640 1 -- 172.21.15.118:0/3902816252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c8036a00 msgr2=0x7f29c8006cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.123+0000 7f29cfe00640 1 --2- 172.21.15.118:0/3902816252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c8036a00 0x7f29c8006cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29c0005fd0 tx=0x7f29c002a560 comp rx=0 tx=0).stop 2024-09-21T06:04:04.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.124+0000 7f29cfe00640 1 -- 172.21.15.118:0/3902816252 shutdown_connections 2024-09-21T06:04:04.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.124+0000 7f29cfe00640 1 --2- 172.21.15.118:0/3902816252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c8036a00 0x7f29c8006cc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.124+0000 7f29cfe00640 1 --2- 172.21.15.118:0/3902816252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c800b550 0x7f29c80364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.124+0000 7f29cfe00640 1 -- 172.21.15.118:0/3902816252 >> 172.21.15.118:0/3902816252 conn(0x7f29c8051420 msgr2=0x7f29c8051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.124+0000 7f29cfe00640 1 -- 172.21.15.118:0/3902816252 shutdown_connections 2024-09-21T06:04:04.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.124+0000 7f7324c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7320073f70 0x7f73201418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.124+0000 7f29cfe00640 1 -- 172.21.15.118:0/3902816252 wait complete. 2024-09-21T06:04:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.125+0000 7f7324c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7320155e20 0x7f7320144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.125+0000 7f7324c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7320161490 0x7f73201618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.125+0000 7f731de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7320073f70 0x7f73201418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.126+0000 7f731de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7320073f70 0x7f73201418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53798/0 (socket says 172.21.15.118:53798) 2024-09-21T06:04:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.126+0000 7f731de00640 1 -- 172.21.15.118:0/4275356326 learned_addr learned my addr 172.21.15.118:0/4275356326 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.126+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f73200b3be0 con 0x7f7320073f70 2024-09-21T06:04:04.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.126+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f73200b3a60 con 0x7f7320155e20 2024-09-21T06:04:04.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.126+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f73200b3d60 con 0x7f7320161490 2024-09-21T06:04:04.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.127+0000 7f731e800640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7320161490 0x7f73201618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.127+0000 7f731d400640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7320155e20 0x7f7320144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.127+0000 7f731d400640 1 -- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7320161490 msgr2=0x7f73201618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.127+0000 7f731d400640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7320161490 0x7f73201618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.127+0000 7f731d400640 1 -- 172.21.15.118:0/4275356326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7320073f70 msgr2=0x7f73201418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.128+0000 7f731d400640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7320073f70 0x7f73201418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.128+0000 7f731d400640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7320161de0 con 0x7f7320155e20 2024-09-21T06:04:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.128+0000 7f731de00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7320073f70 0x7f73201418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f991b200640 1 -- 172.21.15.118:0/3113781372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914057c80 msgr2=0x7f99140e2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f991b200640 1 --2- 172.21.15.118:0/3113781372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914057c80 0x7f99140e2f40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f991c06c120 tx=0x7f991c0a6b30 comp rx=0 tx=0).stop 2024-09-21T06:04:04.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f731d400640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7320155e20 0x7f7320144090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f731000c3f0 tx=0x7f731000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f29cfe00640 1 Processor -- start 2024-09-21T06:04:04.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f29cfe00640 1 -- start start 2024-09-21T06:04:04.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f7316000640 1 -- 172.21.15.118:0/4275356326 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310011790 con 0x7f7320155e20 2024-09-21T06:04:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f7316000640 1 -- 172.21.15.118:0/4275356326 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7310017070 con 0x7f7320155e20 2024-09-21T06:04:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f7316000640 1 -- 172.21.15.118:0/4275356326 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310011ce0 con 0x7f7320155e20 2024-09-21T06:04:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7320144b10 con 0x7f7320155e20 2024-09-21T06:04:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.129+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7320142250 con 0x7f7320155e20 2024-09-21T06:04:04.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.132+0000 7f29cfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c800b070 0x7f29c80df4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.132+0000 7f29cfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c800b550 0x7f29c804dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.133+0000 7f29cfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c8036a00 0x7f29c817b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.131+0000 7f991b200640 1 -- 172.21.15.118:0/3113781372 shutdown_connections 2024-09-21T06:04:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.131+0000 7f991b200640 1 --2- 172.21.15.118:0/3113781372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914057c80 0x7f99140e2f40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.131+0000 7f991b200640 1 -- 172.21.15.118:0/3113781372 >> 172.21.15.118:0/3113781372 conn(0x7f991403a5f0 msgr2=0x7f991403aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.131+0000 7f991b200640 1 -- 172.21.15.118:0/3113781372 shutdown_connections 2024-09-21T06:04:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.131+0000 7f991b200640 1 -- 172.21.15.118:0/3113781372 wait complete. 2024-09-21T06:04:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.133+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f8005290 con 0x7f7320155e20 2024-09-21T06:04:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.133+0000 7f29cea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c800b070 0x7f29c80df4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.133+0000 7f29ce000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c800b550 0x7f29c804dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.133+0000 7f29ce000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c800b550 0x7f29c804dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:59974/0 (socket says 172.21.15.118:59974) 2024-09-21T06:04:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.133+0000 7f29cea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c800b070 0x7f29c80df4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56466/0 (socket says 172.21.15.118:56466) 2024-09-21T06:04:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.133+0000 7f29cf400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c8036a00 0x7f29c817b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cf400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c8036a00 0x7f29c817b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53808/0 (socket says 172.21.15.118:53808) 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cf400640 1 -- 172.21.15.118:0/951804618 learned_addr learned my addr 172.21.15.118:0/951804618 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8007590 con 0x7f29c8036a00 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8007410 con 0x7f29c800b070 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29c801c5b0 con 0x7f29c800b550 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cf400640 1 -- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c800b550 msgr2=0x7f29c804dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cf400640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c800b550 0x7f29c804dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f29cf400640 1 -- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c800b070 msgr2=0x7f29c80df4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.134+0000 7f7316000640 1 -- 172.21.15.118:0/4275356326 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f731001c460 con 0x7f7320155e20 2024-09-21T06:04:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.135+0000 7f29cf400640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c800b070 0x7f29c80df4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.135+0000 7f29cf400640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c801f250 con 0x7f29c8036a00 2024-09-21T06:04:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.135+0000 7f29cea00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c800b070 0x7f29c80df4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.135+0000 7f991b200640 1 Processor -- start 2024-09-21T06:04:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.136+0000 7f29cf400640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c8036a00 0x7f29c817b400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f29c0033040 tx=0x7f29c0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.136+0000 7f991b200640 1 -- start start 2024-09-21T06:04:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.136+0000 7f7316000640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7300078bc0 0x7f730007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.136+0000 7f7316000640 1 -- 172.21.15.118:0/4275356326 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f731009a910 con 0x7f7320155e20 2024-09-21T06:04:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.137+0000 7f29c6a00640 1 -- 172.21.15.118:0/951804618 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0041070 con 0x7f29c8036a00 2024-09-21T06:04:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.137+0000 7f29c6a00640 1 -- 172.21.15.118:0/951804618 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29c0005220 con 0x7f29c8036a00 2024-09-21T06:04:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.137+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c804b840 con 0x7f29c8036a00 2024-09-21T06:04:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.137+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c8021c90 con 0x7f29c8036a00 2024-09-21T06:04:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.137+0000 7f29c6a00640 1 -- 172.21.15.118:0/951804618 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c00047a0 con 0x7f29c8036a00 2024-09-21T06:04:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.138+0000 7f731de00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7300078bc0 0x7f730007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.139+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c8021aa0 con 0x7f29c8036a00 2024-09-21T06:04:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.139+0000 7f991b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914054360 0x7f99140d7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.140+0000 7f991b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9914056da0 0x7f9914051440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.140+0000 7f991b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9914057c80 0x7f9914051980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.140+0000 7f991b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9914007420 con 0x7f9914057c80 2024-09-21T06:04:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.140+0000 7f991b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f99140072a0 con 0x7f9914054360 2024-09-21T06:04:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.140+0000 7f991b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f99140075a0 con 0x7f9914056da0 2024-09-21T06:04:04.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.140+0000 7f9919400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9914056da0 0x7f9914051440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.140+0000 7f9919400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9914056da0 0x7f9914051440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:60006/0 (socket says 172.21.15.118:60006) 2024-09-21T06:04:04.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.141+0000 7f9919400640 1 -- 172.21.15.118:0/2698266190 learned_addr learned my addr 172.21.15.118:0/2698266190 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.141+0000 7f9919e00640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914054360 0x7f99140d7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.141+0000 7f991a800640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9914057c80 0x7f9914051980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.141+0000 7f2416e00640 1 -- 172.21.15.118:0/257721159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410074a40 msgr2=0x7f241006f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.141+0000 7f2416e00640 1 --2- 172.21.15.118:0/257721159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410074a40 0x7f241006f640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2410073730 tx=0x7f240002a580 comp rx=0 tx=0).stop 2024-09-21T06:04:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f9919400640 1 -- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914054360 msgr2=0x7f99140d7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f9919400640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914054360 0x7f99140d7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f9919400640 1 -- 172.21.15.118:0/2698266190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9914057c80 msgr2=0x7f9914051980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f2416e00640 1 -- 172.21.15.118:0/257721159 shutdown_connections 2024-09-21T06:04:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f29c6a00640 1 -- 172.21.15.118:0/951804618 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29c0004940 con 0x7f29c8036a00 2024-09-21T06:04:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f2416e00640 1 --2- 172.21.15.118:0/257721159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2410156270 0x7f2410163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f2416e00640 1 --2- 172.21.15.118:0/257721159 >> v2:172.21.15.149:3300/0 conn(0x7f2410155e60 0x7f2410162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f2416e00640 1 --2- 172.21.15.118:0/257721159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410074a40 0x7f241006f640 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2410073730 tx=0x7f240002a580 comp rx=0 tx=0).stop 2024-09-21T06:04:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f2416e00640 1 -- 172.21.15.118:0/257721159 >> 172.21.15.118:0/257721159 conn(0x7f24100b2940 msgr2=0x7f24100b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f2416e00640 1 -- 172.21.15.118:0/257721159 shutdown_connections 2024-09-21T06:04:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.142+0000 7f2416e00640 1 -- 172.21.15.118:0/257721159 wait complete. 2024-09-21T06:04:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.143+0000 7f731de00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7300078bc0 0x7f730007b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f731800c570 tx=0x7f731800b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.143+0000 7f9919400640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9914057c80 0x7f9914051980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.143+0000 7f9919400640 1 -- 172.21.15.118:0/2698266190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99140d8210 con 0x7f9914056da0 2024-09-21T06:04:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.143+0000 7f991a800640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9914057c80 0x7f9914051980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.143+0000 7f7316000640 1 -- 172.21.15.118:0/4275356326 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7320161de0 con 0x7f7320155e20 2024-09-21T06:04:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.144+0000 7f9919400640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9914056da0 0x7f9914051440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f990800c4c0 tx=0x7f990800c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.144+0000 7f29c6a00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29b0078c90 0x7f29b007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.144+0000 7f29c6a00640 1 -- 172.21.15.118:0/951804618 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f29c00bbb10 con 0x7f29c8036a00 2024-09-21T06:04:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.145+0000 7f9912000640 1 -- 172.21.15.118:0/2698266190 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908017070 con 0x7f9914056da0 2024-09-21T06:04:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.145+0000 7f9912000640 1 -- 172.21.15.118:0/2698266190 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99080035f0 con 0x7f9914056da0 2024-09-21T06:04:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.145+0000 7f9912000640 1 -- 172.21.15.118:0/2698266190 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908003a40 con 0x7f9914056da0 2024-09-21T06:04:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.145+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99140e5de0 con 0x7f9914056da0 2024-09-21T06:04:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.145+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f991404da10 con 0x7f9914056da0 2024-09-21T06:04:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.145+0000 7fdbbac00640 1 -- 172.21.15.118:0/940450805 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb4146650 msgr2=0x7fdbb40d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.145+0000 7fdbbac00640 1 --2- 172.21.15.118:0/940450805 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb4146650 0x7fdbb40d23d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdba4005fd0 tx=0x7fdba402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7efff0a00640 1 -- 172.21.15.118:0/1868242947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effec1687c0 msgr2=0x7effec16abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7efff0a00640 1 --2- 172.21.15.118:0/1868242947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effec1687c0 0x7effec16abe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7effe4009be0 tx=0x7effe402a960 comp rx=0 tx=0).stop 2024-09-21T06:04:04.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7fdbbac00640 1 -- 172.21.15.118:0/940450805 shutdown_connections 2024-09-21T06:04:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7fdbbac00640 1 --2- 172.21.15.118:0/940450805 >> v2:172.21.15.118:3300/0 conn(0x7fdbb40b4f40 0x7fdbb40cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7fdbbac00640 1 --2- 172.21.15.118:0/940450805 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb4146650 0x7fdbb40d23d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7fdbbac00640 1 -- 172.21.15.118:0/940450805 >> 172.21.15.118:0/940450805 conn(0x7fdbb4071070 msgr2=0x7fdbb4071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7fdbbac00640 1 -- 172.21.15.118:0/940450805 shutdown_connections 2024-09-21T06:04:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7efff0a00640 1 -- 172.21.15.118:0/1868242947 shutdown_connections 2024-09-21T06:04:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7efff0a00640 1 --2- 172.21.15.118:0/1868242947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effec1687c0 0x7effec16abe0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7efff0a00640 1 -- 172.21.15.118:0/1868242947 >> 172.21.15.118:0/1868242947 conn(0x7effec0d1780 msgr2=0x7effec0d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7f29cea00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29b0078c90 0x7f29b007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7f2416e00640 1 Processor -- start 2024-09-21T06:04:04.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7f2416e00640 1 -- start start 2024-09-21T06:04:04.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.147+0000 7efff0a00640 1 -- 172.21.15.118:0/1868242947 shutdown_connections 2024-09-21T06:04:04.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.147+0000 7efff0a00640 1 -- 172.21.15.118:0/1868242947 wait complete. 2024-09-21T06:04:04.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.148+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99140e2f40 con 0x7f9914056da0 2024-09-21T06:04:04.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.148+0000 7f2416e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2410155e60 0x7f24101fe500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.148+0000 7f2416e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2410156270 0x7f2410148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.148+0000 7f2416e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410156770 0x7f2410161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.148+0000 7f2416e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f24100b4e00 con 0x7f2410156770 2024-09-21T06:04:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.148+0000 7f2416e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24100b4c80 con 0x7f2410156270 2024-09-21T06:04:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.148+0000 7f2416e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24100b4f80 con 0x7f2410155e60 2024-09-21T06:04:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.146+0000 7fdbbac00640 1 -- 172.21.15.118:0/940450805 wait complete. 2024-09-21T06:04:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f6f24000640 1 -- 172.21.15.118:0/3772258381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c0b44c0 msgr2=0x7f6f1c15f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f6f24000640 1 --2- 172.21.15.118:0/3772258381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c0b44c0 0x7f6f1c15f660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009370 tx=0x7f6f0802b7f0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f6f24000640 1 -- 172.21.15.118:0/3772258381 shutdown_connections 2024-09-21T06:04:04.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f2414e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410156770 0x7f2410161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f2414e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410156770 0x7f2410161ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53842/0 (socket says 172.21.15.118:53842) 2024-09-21T06:04:04.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f2414e00640 1 -- 172.21.15.118:0/1823300501 learned_addr learned my addr 172.21.15.118:0/1823300501 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f6f24000640 1 --2- 172.21.15.118:0/3772258381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c0b44c0 0x7f6f1c15f660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.149+0000 7f6f24000640 1 -- 172.21.15.118:0/3772258381 >> 172.21.15.118:0/3772258381 conn(0x7f6f1c06d110 msgr2=0x7f6f1c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f6f24000640 1 -- 172.21.15.118:0/3772258381 shutdown_connections 2024-09-21T06:04:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f2414e00640 1 -- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2410155e60 msgr2=0x7f24101fe500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f2407400640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2410156270 0x7f2410148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f2414e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2410155e60 0x7f24101fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f2414e00640 1 -- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2410156270 msgr2=0x7f2410148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f2414e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2410156270 0x7f2410148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f2414e00640 1 -- 172.21.15.118:0/1823300501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241014b970 con 0x7f2410156770 2024-09-21T06:04:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7fdbbac00640 1 Processor -- start 2024-09-21T06:04:04.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f6f24000640 1 -- 172.21.15.118:0/3772258381 wait complete. 2024-09-21T06:04:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.151+0000 7fdbbac00640 1 -- start start 2024-09-21T06:04:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.151+0000 7f2414e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410156770 0x7f2410161ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f240800b9e0 tx=0x7f240800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.150+0000 7f29cea00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29b0078c90 0x7f29b007b1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29d006c480 tx=0x7f29d006f040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.151+0000 7f9912000640 1 -- 172.21.15.118:0/2698266190 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f990801a070 con 0x7f9914056da0 2024-09-21T06:04:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.151+0000 7efff0a00640 1 Processor -- start 2024-09-21T06:04:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.151+0000 7f2407400640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2410156270 0x7f2410148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:04.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.152+0000 7efff0a00640 1 -- start start 2024-09-21T06:04:04.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.153+0000 7f9912000640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98fc078c90 0x7f98fc07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.153+0000 7f9912000640 1 -- 172.21.15.118:0/2698266190 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f990809a280 con 0x7f9914056da0 2024-09-21T06:04:04.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.153+0000 7efff0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effec0b1870 0x7effec161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.153+0000 7efff0a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec0d2b20 0x7effec14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7f240cc00640 1 -- 172.21.15.118:0/1823300501 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408019070 con 0x7f2410156770 2024-09-21T06:04:04.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7f240cc00640 1 -- 172.21.15.118:0/1823300501 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f240800cc10 con 0x7f2410156770 2024-09-21T06:04:04.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7f240cc00640 1 -- 172.21.15.118:0/1823300501 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408014440 con 0x7f2410156770 2024-09-21T06:04:04.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7efff0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effec1687c0 0x7effec14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241014bc50 con 0x7f2410156770 2024-09-21T06:04:04.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7fdbbac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb40ceb40 0x7fdbb42072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7efff0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effec0d2630 con 0x7effec0b1870 2024-09-21T06:04:04.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7efff0a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7effec0d24b0 con 0x7effec0d2b20 2024-09-21T06:04:04.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7efff0a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7effec0ba450 con 0x7effec1687c0 2024-09-21T06:04:04.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7effe9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effec0b1870 0x7effec161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7effe1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec0d2b20 0x7effec14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7effe1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec0d2b20 0x7effec14e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56518/0 (socket says 172.21.15.118:56518) 2024-09-21T06:04:04.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7effe9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effec0b1870 0x7effec161da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53852/0 (socket says 172.21.15.118:53852) 2024-09-21T06:04:04.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7effe1400640 1 -- 172.21.15.118:0/2327151148 learned_addr learned my addr 172.21.15.118:0/2327151148 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7fdbbac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb4146650 0x7fdbb406df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7fdbbac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb406e4c0 0x7fdbb42037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7fdbbac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb40d1570 con 0x7fdbb4146650 2024-09-21T06:04:04.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7fdbbac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb40d13f0 con 0x7fdbb406e4c0 2024-09-21T06:04:04.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7fdbbac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb40d16f0 con 0x7fdbb40ceb40 2024-09-21T06:04:04.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7fdbb3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb40ceb40 0x7fdbb42072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7f9919e00640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98fc078c90 0x7f98fc07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb40ceb40 0x7fdbb42072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:60046/0 (socket says 172.21.15.118:60046) 2024-09-21T06:04:04.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3e00640 1 -- 172.21.15.118:0/3694005736 learned_addr learned my addr 172.21.15.118:0/3694005736 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7effe1400640 1 -- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effec1687c0 msgr2=0x7effec14ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7effe1400640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effec1687c0 0x7effec14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7effe1400640 1 -- 172.21.15.118:0/2327151148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effec0b1870 msgr2=0x7effec161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7effe1400640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effec0b1870 0x7effec161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7effe1400640 1 -- 172.21.15.118:0/2327151148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec1fdc50 con 0x7effec0d2b20 2024-09-21T06:04:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7f29c6a00640 1 -- 172.21.15.118:0/951804618 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f29c0083fc0 con 0x7f29c8036a00 2024-09-21T06:04:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3400640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb4146650 0x7fdbb406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb8c00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb406e4c0 0x7fdbb42037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3e00640 1 -- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb406e4c0 msgr2=0x7fdbb42037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3e00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb406e4c0 0x7fdbb42037a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3e00640 1 -- 172.21.15.118:0/3694005736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb4146650 msgr2=0x7fdbb406df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3e00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb4146650 0x7fdbb406df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.155+0000 7fdbb3e00640 1 -- 172.21.15.118:0/3694005736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb42077e0 con 0x7fdbb40ceb40 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7effe1400640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec0d2b20 0x7effec14e9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7effd400c3f0 tx=0x7effd400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7fdbb3400640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb4146650 0x7fdbb406df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7effe2a00640 1 -- 172.21.15.118:0/2327151148 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4017070 con 0x7effec0d2b20 2024-09-21T06:04:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7effe2a00640 1 -- 172.21.15.118:0/2327151148 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effd40053c0 con 0x7effec0d2b20 2024-09-21T06:04:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7effe2a00640 1 -- 172.21.15.118:0/2327151148 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4003850 con 0x7effec0d2b20 2024-09-21T06:04:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.154+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241014c210 con 0x7f2410156770 2024-09-21T06:04:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2410156c10 con 0x7f2410156770 2024-09-21T06:04:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7f6f24000640 1 Processor -- start 2024-09-21T06:04:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7fdbb3e00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb40ceb40 0x7fdbb42072a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdba4034040 tx=0x7fdba4003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7f9919e00640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98fc078c90 0x7f98fc07b1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9914038530 tx=0x7f990c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.156+0000 7f9912000640 1 -- 172.21.15.118:0/2698266190 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9908062170 con 0x7f9914056da0 2024-09-21T06:04:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.157+0000 7ff4b9400640 1 -- 172.21.15.118:0/1100986494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40b57a0 msgr2=0x7ff4b40b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.157+0000 7ff4b9400640 1 --2- 172.21.15.118:0/1100986494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40b57a0 0x7ff4b40b3bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00098e0 tx=0x7ff4a002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.157+0000 7f6f24000640 1 -- start start 2024-09-21T06:04:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.158+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effec1fdf30 con 0x7effec0d2b20 2024-09-21T06:04:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.158+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effec1fe4f0 con 0x7effec0d2b20 2024-09-21T06:04:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.158+0000 7ff4b9400640 1 -- 172.21.15.118:0/1100986494 shutdown_connections 2024-09-21T06:04:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.158+0000 7ff4b9400640 1 --2- 172.21.15.118:0/1100986494 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4b40cf9f0 0x7ff4b40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.158+0000 7ff4b9400640 1 --2- 172.21.15.118:0/1100986494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40b57a0 0x7ff4b40b3bf0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00098e0 tx=0x7ff4a002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.158+0000 7ff4b9400640 1 -- 172.21.15.118:0/1100986494 >> 172.21.15.118:0/1100986494 conn(0x7ff4b40d4e90 msgr2=0x7ff4b40d52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.159+0000 7f6f24000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f1c0b44c0 0x7f6f1c13f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.159+0000 7f6f24000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f1c152050 0x7f6f1c13d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.159+0000 7f6f24000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c15bd00 0x7f6f1c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.159+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effec14f4f0 con 0x7effec0d2b20 2024-09-21T06:04:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.159+0000 7f6f24000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c070dc0 con 0x7f6f1c0b44c0 2024-09-21T06:04:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.159+0000 7f6f24000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c0d07a0 con 0x7f6f1c152050 2024-09-21T06:04:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.159+0000 7f6f24000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1c070f40 con 0x7f6f1c15bd00 2024-09-21T06:04:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7ff4b9400640 1 -- 172.21.15.118:0/1100986494 shutdown_connections 2024-09-21T06:04:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.158+0000 7f240cc00640 1 -- 172.21.15.118:0/1823300501 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f240801c070 con 0x7f2410156770 2024-09-21T06:04:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7f240cc00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23ec078c90 0x7f23ec07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7f240cc00640 1 -- 172.21.15.118:0/1823300501 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f240809a910 con 0x7f2410156770 2024-09-21T06:04:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7ff4b9400640 1 -- 172.21.15.118:0/1100986494 wait complete. 2024-09-21T06:04:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7f6f20c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f1c152050 0x7f6f1c13d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7f6f20c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f1c152050 0x7f6f1c13d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56536/0 (socket says 172.21.15.118:56536) 2024-09-21T06:04:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7f6f20c00640 1 -- 172.21.15.118:0/4276779773 learned_addr learned my addr 172.21.15.118:0/4276779773 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7f6f22000640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c15bd00 0x7f6f1c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.160+0000 7f6f21600640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f1c0b44c0 0x7f6f1c13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7fdbabe00640 1 -- 172.21.15.118:0/3694005736 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba403e030 con 0x7fdbb40ceb40 2024-09-21T06:04:04.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7fdbabe00640 1 -- 172.21.15.118:0/3694005736 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdba4003c20 con 0x7fdbb40ceb40 2024-09-21T06:04:04.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7fdbabe00640 1 -- 172.21.15.118:0/3694005736 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4035040 con 0x7fdbb40ceb40 2024-09-21T06:04:04.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7f240fe00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23ec078c90 0x7f23ec07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7f6f20c00640 1 -- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c15bd00 msgr2=0x7f6f1c0cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7f6f20c00640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c15bd00 0x7f6f1c0cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7f6f20c00640 1 -- 172.21.15.118:0/4276779773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f1c0b44c0 msgr2=0x7f6f1c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7f6f20c00640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f1c0b44c0 0x7f6f1c13f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7f6f20c00640 1 -- 172.21.15.118:0/4276779773 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c13fc90 con 0x7f6f1c152050 2024-09-21T06:04:04.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.162+0000 7effe2a00640 1 -- 172.21.15.118:0/2327151148 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effd401a070 con 0x7effec0d2b20 2024-09-21T06:04:04.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7f6f20c00640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f1c152050 0x7f6f1c13d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c7a0 tx=0x7f6f1400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.162+0000 7f6f19600640 1 -- 172.21.15.118:0/4276779773 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14017070 con 0x7f6f1c152050 2024-09-21T06:04:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.163+0000 7f6f19600640 1 -- 172.21.15.118:0/4276779773 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f14003da0 con 0x7f6f1c152050 2024-09-21T06:04:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.163+0000 7f6f19600640 1 -- 172.21.15.118:0/4276779773 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f140052d0 con 0x7f6f1c152050 2024-09-21T06:04:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.163+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c13ff70 con 0x7f6f1c152050 2024-09-21T06:04:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.163+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c0c6bf0 con 0x7f6f1c152050 2024-09-21T06:04:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.161+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb41418c0 con 0x7fdbb40ceb40 2024-09-21T06:04:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.162+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb414a690 con 0x7fdbb40ceb40 2024-09-21T06:04:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.163+0000 7f240fe00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23ec078c90 0x7f23ec07b1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2400033000 tx=0x7f24000046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.163+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb40d1ba0 con 0x7fdbb40ceb40 2024-09-21T06:04:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.163+0000 7ff4b9400640 1 Processor -- start 2024-09-21T06:04:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.164+0000 7ff4b9400640 1 -- start start 2024-09-21T06:04:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.164+0000 7effe2a00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc8078c60 0x7effc807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.164+0000 7effe2a00640 1 -- 172.21.15.118:0/2327151148 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7effd409a130 con 0x7effec0d2b20 2024-09-21T06:04:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.165+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1c13fa00 con 0x7f6f1c152050 2024-09-21T06:04:04.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7effe9e00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc8078c60 0x7effc807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40cf9f0 0x7ff4b40b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40d3ac0 0x7ff4b415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4b4167760 0x7ff4b4165410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b9400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b40d06d0 con 0x7ff4b40cf9f0 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b9400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b40d0550 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b40d0850 con 0x7ff4b4167760 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40d3ac0 0x7ff4b415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40cf9f0 0x7ff4b40b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4b4167760 0x7ff4b4165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40d3ac0 0x7ff4b415b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:56544/0 (socket says 172.21.15.118:56544) 2024-09-21T06:04:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.166+0000 7ff4b1e00640 1 -- 172.21.15.118:0/979215228 learned_addr learned my addr 172.21.15.118:0/979215228 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7effe9e00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc8078c60 0x7effc807b170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effdc0015e0 tx=0x7effdc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7fdbabe00640 1 -- 172.21.15.118:0/3694005736 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdba4041030 con 0x7fdbb40ceb40 2024-09-21T06:04:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7ff4b1e00640 1 -- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4b4167760 msgr2=0x7ff4b4165410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7ff4b1e00640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4b4167760 0x7ff4b4165410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7ff4b1e00640 1 -- 172.21.15.118:0/979215228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40cf9f0 msgr2=0x7ff4b40b95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7ff4b1e00640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40cf9f0 0x7ff4b40b95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7ff4b1e00640 1 -- 172.21.15.118:0/979215228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b4167f40 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.167+0000 7ff4b3200640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4b4167760 0x7ff4b4165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.169+0000 7ff4b1e00640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40d3ac0 0x7ff4b415b050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400b3c0 tx=0x7ff4a400b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.168+0000 7fdbabe00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb94078c60 0x7fdb9407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.169+0000 7effe2a00640 1 -- 172.21.15.118:0/2327151148 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7effd4062550 con 0x7effec0d2b20 2024-09-21T06:04:04.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.169+0000 7f240cc00640 1 -- 172.21.15.118:0/1823300501 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2408062770 con 0x7f2410156770 2024-09-21T06:04:04.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.169+0000 7fdbb3400640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb94078c60 0x7fdb9407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.169+0000 7fdbabe00640 1 -- 172.21.15.118:0/3694005736 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdba40bb7f0 con 0x7fdbb40ceb40 2024-09-21T06:04:04.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.170+0000 7fdbb3400640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb94078c60 0x7fdb9407b170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4148010 tx=0x7fdba0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.171+0000 7fdbabe00640 1 -- 172.21.15.118:0/3694005736 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdbb42077e0 con 0x7fdbb40ceb40 2024-09-21T06:04:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.173+0000 7f6f19600640 1 -- 172.21.15.118:0/4276779773 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f1401a070 con 0x7f6f1c152050 2024-09-21T06:04:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.174+0000 7f6f19600640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6efc078c60 0x7f6efc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.174+0000 7f6f19600640 1 -- 172.21.15.118:0/4276779773 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6f1409a650 con 0x7f6f1c152050 2024-09-21T06:04:04.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.175+0000 7ff4aaa00640 1 -- 172.21.15.118:0/979215228 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011830 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.175+0000 7ff4aaa00640 1 -- 172.21.15.118:0/979215228 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4a4016070 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.175+0000 7ff4aaa00640 1 -- 172.21.15.118:0/979215228 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011d60 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.175+0000 7f6f19600640 1 -- 172.21.15.118:0/4276779773 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6f14021020 con 0x7f6f1c152050 2024-09-21T06:04:04.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.175+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b4168220 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.175+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b41687e0 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.177+0000 7f6f21600640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6efc078c60 0x7f6efc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.177+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b4167cb0 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.181+0000 7f6f21600640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6efc078c60 0x7f6efc07b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0d1110 tx=0x7f6f080046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.181+0000 7ff4aaa00640 1 -- 172.21.15.118:0/979215228 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4a4004020 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.183+0000 7ff4aaa00640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff494078be0 0x7ff49407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.183+0000 7ff4aaa00640 1 -- 172.21.15.118:0/979215228 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff4a409a8b0 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.185+0000 7ff4aaa00640 1 -- 172.21.15.118:0/979215228 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff4a4020020 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.185+0000 7ff4b2800640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff494078be0 0x7ff49407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.190+0000 7ff4b2800640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff494078be0 0x7ff49407b0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0034000 tx=0x7ff4a0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.588+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f72f8005580 con 0x7f7320155e20 2024-09-21T06:04:04.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.589+0000 7f7316000640 1 -- 172.21.15.118:0/4275356326 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7310062e40 con 0x7f7320155e20 2024-09-21T06:04:04.594 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-09-21T06:04:04.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.593+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7300078bc0 msgr2=0x7f730007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.593+0000 7f7324c00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7300078bc0 0x7f730007b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f731800c570 tx=0x7f731800b040 comp rx=0 tx=0).stop 2024-09-21T06:04:04.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.593+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7320155e20 msgr2=0x7f7320144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.593+0000 7f7324c00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7320155e20 0x7f7320144090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f731000c3f0 tx=0x7f731000c8b0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.594+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 shutdown_connections 2024-09-21T06:04:04.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.594+0000 7f7324c00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7300078bc0 0x7f730007b0d0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f731800c570 tx=0x7f731800b040 comp rx=0 tx=0).stop 2024-09-21T06:04:04.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.594+0000 7f7324c00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7320161490 0x7f73201618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.594+0000 7f7324c00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7320155e20 0x7f7320144090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.594+0000 7f7324c00640 1 --2- 172.21.15.118:0/4275356326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7320073f70 0x7f73201418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.594+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 >> 172.21.15.118:0/4275356326 conn(0x7f73200b2550 msgr2=0x7f73200b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.595+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 shutdown_connections 2024-09-21T06:04:04.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.595+0000 7f7324c00640 1 -- 172.21.15.118:0/4275356326 wait complete. 2024-09-21T06:04:04.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.605+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f29c80364c0 con 0x7f29c8036a00 2024-09-21T06:04:04.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.606+0000 7f29c6a00640 1 -- 172.21.15.118:0/951804618 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29c0005670 con 0x7f29c8036a00 2024-09-21T06:04:04.608 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-09-21T06:04:04.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.610+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29b0078c90 msgr2=0x7f29b007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.610+0000 7f29cfe00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29b0078c90 0x7f29b007b1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29d006c480 tx=0x7f29d006f040 comp rx=0 tx=0).stop 2024-09-21T06:04:04.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.610+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c8036a00 msgr2=0x7f29c817b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.610+0000 7f29cfe00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c8036a00 0x7f29c817b400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f29c0033040 tx=0x7f29c0004260 comp rx=0 tx=0).stop 2024-09-21T06:04:04.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 shutdown_connections 2024-09-21T06:04:04.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c8036a00 0x7f29c817b400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29b0078c90 0x7f29b007b1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c800b550 0x7f29c804dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 --2- 172.21.15.118:0/951804618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c800b070 0x7f29c80df4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 >> 172.21.15.118:0/951804618 conn(0x7f29c8051420 msgr2=0x7f29c8051830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 shutdown_connections 2024-09-21T06:04:04.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.611+0000 7f29cfe00640 1 -- 172.21.15.118:0/951804618 wait complete. 2024-09-21T06:04:04.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.612+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f991404c3d0 con 0x7f9914056da0 2024-09-21T06:04:04.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.613+0000 7f9912000640 1 -- 172.21.15.118:0/2698266190 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9908066ba0 con 0x7f9914056da0 2024-09-21T06:04:04.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.614+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f24100b5500 con 0x7f2410156770 2024-09-21T06:04:04.616 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:04.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.615+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7effec0b6b10 con 0x7effec0d2b20 2024-09-21T06:04:04.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.615+0000 7f240cc00640 1 -- 172.21.15.118:0/1823300501 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24080671a0 con 0x7f2410156770 2024-09-21T06:04:04.618 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-09-21T06:04:04.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.617+0000 7effe2a00640 1 -- 172.21.15.118:0/2327151148 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7effec0b6b10 con 0x7effec0d2b20 2024-09-21T06:04:04.619 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-09-21T06:04:04.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.617+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98fc078c90 msgr2=0x7f98fc07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.617+0000 7f991b200640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98fc078c90 0x7f98fc07b1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9914038530 tx=0x7f990c009040 comp rx=0 tx=0).stop 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.617+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9914056da0 msgr2=0x7f9914051440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.617+0000 7f991b200640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9914056da0 0x7f9914051440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f990800c4c0 tx=0x7f990800c980 comp rx=0 tx=0).stop 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 shutdown_connections 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9914057c80 0x7f9914051980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98fc078c90 0x7f98fc07b1a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9914056da0 0x7f9914051440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 --2- 172.21.15.118:0/2698266190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9914054360 0x7f99140d7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 >> 172.21.15.118:0/2698266190 conn(0x7f991403a5f0 msgr2=0x7f99140e14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 shutdown_connections 2024-09-21T06:04:04.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.618+0000 7f991b200640 1 -- 172.21.15.118:0/2698266190 wait complete. 2024-09-21T06:04:04.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23ec078c90 msgr2=0x7f23ec07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23ec078c90 0x7f23ec07b1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2400033000 tx=0x7f24000046c0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410156770 msgr2=0x7f2410161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410156770 0x7f2410161ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f240800b9e0 tx=0x7f240800bea0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 shutdown_connections 2024-09-21T06:04:04.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2410156770 0x7f2410161ed0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2410156270 0x7f2410148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23ec078c90 0x7f23ec07b1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 --2- 172.21.15.118:0/1823300501 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2410155e60 0x7f24101fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.620+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 >> 172.21.15.118:0/1823300501 conn(0x7f24100b2940 msgr2=0x7f24100d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc8078c60 msgr2=0x7effc807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc8078c60 0x7effc807b170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effdc0015e0 tx=0x7effdc009040 comp rx=0 tx=0).stop 2024-09-21T06:04:04.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 shutdown_connections 2024-09-21T06:04:04.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec0d2b20 msgr2=0x7effec14e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec0d2b20 0x7effec14e9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7effd400c3f0 tx=0x7effd400c8b0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7f2416e00640 1 -- 172.21.15.118:0/1823300501 wait complete. 2024-09-21T06:04:04.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 shutdown_connections 2024-09-21T06:04:04.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc8078c60 0x7effc807b170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effec1687c0 0x7effec14ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effec0d2b20 0x7effec14e9e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 --2- 172.21.15.118:0/2327151148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effec0b1870 0x7effec161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 >> 172.21.15.118:0/2327151148 conn(0x7effec0d1780 msgr2=0x7effec06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 shutdown_connections 2024-09-21T06:04:04.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.621+0000 7efff0a00640 1 -- 172.21.15.118:0/2327151148 wait complete. 2024-09-21T06:04:04.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.622+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdbb40b2520 con 0x7fdbb40ceb40 2024-09-21T06:04:04.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.623+0000 7fdbabe00640 1 -- 172.21.15.118:0/3694005736 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdba4083d30 con 0x7fdbb40ceb40 2024-09-21T06:04:04.628 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-09-21T06:04:04.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.627+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb94078c60 msgr2=0x7fdb9407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb94078c60 0x7fdb9407b170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4148010 tx=0x7fdba0009040 comp rx=0 tx=0).stop 2024-09-21T06:04:04.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb40ceb40 msgr2=0x7fdbb42072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb40ceb40 0x7fdbb42072a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdba4034040 tx=0x7fdba4003820 comp rx=0 tx=0).stop 2024-09-21T06:04:04.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff4b40b3bf0 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 shutdown_connections 2024-09-21T06:04:04.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb406e4c0 0x7fdbb42037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb4146650 0x7fdbb406df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb94078c60 0x7fdb9407b170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 --2- 172.21.15.118:0/3694005736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb40ceb40 0x7fdbb42072a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 >> 172.21.15.118:0/3694005736 conn(0x7fdbb4071070 msgr2=0x7fdbb406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 shutdown_connections 2024-09-21T06:04:04.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.628+0000 7fdbbac00640 1 -- 172.21.15.118:0/3694005736 wait complete. 2024-09-21T06:04:04.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.629+0000 7ff4aaa00640 1 -- 172.21.15.118:0/979215228 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4a4062790 con 0x7ff4b40d3ac0 2024-09-21T06:04:04.631 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-09-21T06:04:04.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2024-09-21T06:04:04.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.631+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6f1c074f10 con 0x7f6f1c152050 2024-09-21T06:04:04.633 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.632+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff494078be0 msgr2=0x7ff49407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.632+0000 7ff4b9400640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff494078be0 0x7ff49407b0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0034000 tx=0x7ff4a0004730 comp rx=0 tx=0).stop 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.632+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40d3ac0 msgr2=0x7ff4b415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.632+0000 7ff4b9400640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40d3ac0 0x7ff4b415b050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400b3c0 tx=0x7ff4a400b880 comp rx=0 tx=0).stop 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 shutdown_connections 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff494078be0 0x7ff49407b0f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4b4167760 0x7ff4b4165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b40d3ac0 0x7ff4b415b050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 --2- 172.21.15.118:0/979215228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40cf9f0 0x7ff4b40b95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 >> 172.21.15.118:0/979215228 conn(0x7ff4b40d4e90 msgr2=0x7ff4b40b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 shutdown_connections 2024-09-21T06:04:04.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.633+0000 7ff4b9400640 1 -- 172.21.15.118:0/979215228 wait complete. 2024-09-21T06:04:04.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.635+0000 7f6f19600640 1 -- 172.21.15.118:0/4276779773 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f140624b0 con 0x7f6f1c152050 2024-09-21T06:04:04.637 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-09-21T06:04:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6efc078c60 msgr2=0x7f6efc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6efc078c60 0x7f6efc07b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0d1110 tx=0x7f6f080046c0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f1c152050 msgr2=0x7f6f1c13d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f1c152050 0x7f6f1c13d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c7a0 tx=0x7f6f1400cc60 comp rx=0 tx=0).stop 2024-09-21T06:04:04.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 shutdown_connections 2024-09-21T06:04:04.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6efc078c60 0x7f6efc07b170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f1c15bd00 0x7f6f1c0cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f1c152050 0x7f6f1c13d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 --2- 172.21.15.118:0/4276779773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f1c0b44c0 0x7f6f1c13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.638+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 >> 172.21.15.118:0/4276779773 conn(0x7f6f1c06d110 msgr2=0x7f6f1c150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.639+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 shutdown_connections 2024-09-21T06:04:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.639+0000 7f6f24000640 1 -- 172.21.15.118:0/4276779773 wait complete. 2024-09-21T06:04:04.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2024-09-21T06:04:04.658 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-09-21T06:04:04.665 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2024-09-21T06:04:04.666 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-21T06:04:04.667 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2024-09-21T06:04:04.667 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2024-09-21T06:04:04.668 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-09-21T06:04:04.671 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:04.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:04:04.671 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:04.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.929+0000 7f551d200640 1 -- 172.21.15.118:0/2671897696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 msgr2=0x7f55180d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.929+0000 7f551d200640 1 --2- 172.21.15.118:0/2671897696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 0x7f55180d0e80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5508009830 tx=0x7f550802a510 comp rx=0 tx=0).stop 2024-09-21T06:04:04.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.930+0000 7f551d200640 1 -- 172.21.15.118:0/2671897696 shutdown_connections 2024-09-21T06:04:04.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.930+0000 7f551d200640 1 --2- 172.21.15.118:0/2671897696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5518142e40 0x7f55180d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.930+0000 7f551d200640 1 --2- 172.21.15.118:0/2671897696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 0x7f55180d0e80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.930+0000 7f551d200640 1 -- 172.21.15.118:0/2671897696 >> 172.21.15.118:0/2671897696 conn(0x7f551806d110 msgr2=0x7f551806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.930+0000 7f551d200640 1 -- 172.21.15.118:0/2671897696 shutdown_connections 2024-09-21T06:04:04.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.930+0000 7f551d200640 1 -- 172.21.15.118:0/2671897696 wait complete. 2024-09-21T06:04:04.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.932+0000 7f551d200640 1 Processor -- start 2024-09-21T06:04:04.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.932+0000 7f551d200640 1 -- start start 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.933+0000 7f551d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 0x7f551813aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.933+0000 7f551d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f551813fef0 0x7f551815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.933+0000 7f551d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5518142e40 0x7f5518154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.933+0000 7f551d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f55180cfa90 con 0x7f5518142e40 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.933+0000 7f551d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f55180cf910 con 0x7f551813fae0 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.933+0000 7f551d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f55180cfc10 con 0x7f551813fef0 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5518142e40 0x7f5518154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5518142e40 0x7f5518154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53890/0 (socket says 172.21.15.118:53890) 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 -- 172.21.15.118:0/2760419144 learned_addr learned my addr 172.21.15.118:0/2760419144 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5515e00640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 0x7f551813aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f550d400640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f551813fef0 0x7f551815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 -- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f551813fef0 msgr2=0x7f551815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f551813fef0 0x7f551815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 -- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 msgr2=0x7f551813aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 0x7f551813aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 -- 172.21.15.118:0/2760419144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55181f8090 con 0x7f5518142e40 2024-09-21T06:04:04.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.934+0000 7f5516800640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5518142e40 0x7f5518154540 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f551000c3a0 tx=0x7f551000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.935+0000 7f550ea00640 1 -- 172.21.15.118:0/2760419144 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510003970 con 0x7f5518142e40 2024-09-21T06:04:04.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.935+0000 7f550ea00640 1 -- 172.21.15.118:0/2760419144 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5510003c00 con 0x7f5518142e40 2024-09-21T06:04:04.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.935+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5518157b80 con 0x7f5518142e40 2024-09-21T06:04:04.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.935+0000 7f550ea00640 1 -- 172.21.15.118:0/2760419144 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510004020 con 0x7f5518142e40 2024-09-21T06:04:04.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.935+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5518158140 con 0x7f5518142e40 2024-09-21T06:04:04.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.936+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55180d0130 con 0x7f5518142e40 2024-09-21T06:04:04.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.937+0000 7f550ea00640 1 -- 172.21.15.118:0/2760419144 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55100041c0 con 0x7f5518142e40 2024-09-21T06:04:04.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.938+0000 7f550ea00640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54f4078bc0 0x7f54f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.938+0000 7f550ea00640 1 -- 172.21.15.118:0/2760419144 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f551009b560 con 0x7f5518142e40 2024-09-21T06:04:04.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.939+0000 7f5515e00640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54f4078bc0 0x7f54f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.939+0000 7f5515e00640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54f4078bc0 0x7f54f407b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5508034000 tx=0x7f5508004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:04.943+0000 7f550ea00640 1 -- 172.21.15.118:0/2760419144 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5510063340 con 0x7f5518142e40 2024-09-21T06:04:05.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.126+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5518160260 con 0x7f54f4078bc0 2024-09-21T06:04:05.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.130+0000 7f550ea00640 1 -- 172.21.15.118:0/2760419144 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247474 (secure 0 0 0) 0x7f5518160260 con 0x7f54f4078bc0 2024-09-21T06:04:05.135 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:05.136 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:05.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.134+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54f4078bc0 msgr2=0x7f54f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.134+0000 7f551d200640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54f4078bc0 0x7f54f407b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5508034000 tx=0x7f5508004730 comp rx=0 tx=0).stop 2024-09-21T06:04:05.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5518142e40 msgr2=0x7f5518154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5518142e40 0x7f5518154540 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f551000c3a0 tx=0x7f551000c860 comp rx=0 tx=0).stop 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 shutdown_connections 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5518142e40 0x7f5518154540 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54f4078bc0 0x7f54f407b0d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f551813fef0 0x7f551815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 --2- 172.21.15.118:0/2760419144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f551813fae0 0x7f551813aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 >> 172.21.15.118:0/2760419144 conn(0x7f551806d110 msgr2=0x7f551813c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 shutdown_connections 2024-09-21T06:04:05.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.135+0000 7f551d200640 1 -- 172.21.15.118:0/2760419144 wait complete. 2024-09-21T06:04:05.157 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-21T06:04:04.457264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.030960"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692022+0000","last_change":"2024-09-21T06:03:56.442024+0000","last_active":"2024-09-21T06:03:57.692022+0000","last_peered":"2024-09-21T06:03:57.692022+0000","last_clean":"2024-09-21T06:03:57.692022+0000","last_became_active":"2024-09-21T06:03:56.441182+0000","last_became_peered":"2024-09-21T06:03:56.441182+0000","last_unstale":"2024-09-21T06:03:57.692022+0000","last_undegraded":"2024-09-21T06:03:57.692022+0000","last_fullsized":"2024-09-21T06:03:57.692022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:02.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430908+0000","last_change":"2024-09-21T06:03:56.442846+0000","last_active":"2024-09-21T06:03:57.430908+0000","last_peered":"2024-09-21T06:03:57.430908+0000","last_clean":"2024-09-21T06:03:57.430908+0000","last_became_active":"2024-09-21T06:03:56.442596+0000","last_became_peered":"2024-09-21T06:03:56.442596+0000","last_unstale":"2024-09-21T06:03:57.430908+0000","last_undegraded":"2024-09-21T06:03:57.430908+0000","last_fullsized":"2024-09-21T06:03:57.430908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:31.907433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571265+0000","last_change":"2024-09-21T06:03:56.444128+0000","last_active":"2024-09-21T06:03:57.571265+0000","last_peered":"2024-09-21T06:03:57.571265+0000","last_clean":"2024-09-21T06:03:57.571265+0000","last_became_active":"2024-09-21T06:03:56.443902+0000","last_became_peered":"2024-09-21T06:03:56.443902+0000","last_unstale":"2024-09-21T06:03:57.571265+0000","last_undegraded":"2024-09-21T06:03:57.571265+0000","last_fullsized":"2024-09-21T06:03:57.571265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:52.321248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570718+0000","last_change":"2024-09-21T06:03:56.463130+0000","last_active":"2024-09-21T06:03:57.570718+0000","last_peered":"2024-09-21T06:03:57.570718+0000","last_clean":"2024-09-21T06:03:57.570718+0000","last_became_active":"2024-09-21T06:03:56.459929+0000","last_became_peered":"2024-09-21T06:03:56.459929+0000","last_unstale":"2024-09-21T06:03:57.570718+0000","last_undegraded":"2024-09-21T06:03:57.570718+0000","last_fullsized":"2024-09-21T06:03:57.570718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:15.532700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691768+0000","last_change":"2024-09-21T06:03:56.433208+0000","last_active":"2024-09-21T06:03:57.691768+0000","last_peered":"2024-09-21T06:03:57.691768+0000","last_clean":"2024-09-21T06:03:57.691768+0000","last_became_active":"2024-09-21T06:03:56.432871+0000","last_became_peered":"2024-09-21T06:03:56.432871+0000","last_unstale":"2024-09-21T06:03:57.691768+0000","last_undegraded":"2024-09-21T06:03:57.691768+0000","last_fullsized":"2024-09-21T06:03:57.691768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:39.265454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571368+0000","last_change":"2024-09-21T06:03:56.461789+0000","last_active":"2024-09-21T06:03:57.571368+0000","last_peered":"2024-09-21T06:03:57.571368+0000","last_clean":"2024-09-21T06:03:57.571368+0000","last_became_active":"2024-09-21T06:03:56.453393+0000","last_became_peered":"2024-09-21T06:03:56.453393+0000","last_unstale":"2024-09-21T06:03:57.571368+0000","last_undegraded":"2024-09-21T06:03:57.571368+0000","last_fullsized":"2024-09-21T06:03:57.571368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:34.596911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691851+0000","last_change":"2024-09-21T06:03:56.443005+0000","last_active":"2024-09-21T06:03:57.691851+0000","last_peered":"2024-09-21T06:03:57.691851+0000","last_clean":"2024-09-21T06:03:57.691851+0000","last_became_active":"2024-09-21T06:03:56.442706+0000","last_became_peered":"2024-09-21T06:03:56.442706+0000","last_unstale":"2024-09-21T06:03:57.691851+0000","last_undegraded":"2024-09-21T06:03:57.691851+0000","last_fullsized":"2024-09-21T06:03:57.691851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:08.249768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.427461+0000","last_change":"2024-09-21T06:03:56.448982+0000","last_active":"2024-09-21T06:03:57.427461+0000","last_peered":"2024-09-21T06:03:57.427461+0000","last_clean":"2024-09-21T06:03:57.427461+0000","last_became_active":"2024-09-21T06:03:56.448820+0000","last_became_peered":"2024-09-21T06:03:56.448820+0000","last_unstale":"2024-09-21T06:03:57.427461+0000","last_undegraded":"2024-09-21T06:03:57.427461+0000","last_fullsized":"2024-09-21T06:03:57.427461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.481108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691597+0000","last_change":"2024-09-21T06:03:56.460943+0000","last_active":"2024-09-21T06:03:57.691597+0000","last_peered":"2024-09-21T06:03:57.691597+0000","last_clean":"2024-09-21T06:03:57.691597+0000","last_became_active":"2024-09-21T06:03:56.460670+0000","last_became_peered":"2024-09-21T06:03:56.460670+0000","last_unstale":"2024-09-21T06:03:57.691597+0000","last_undegraded":"2024-09-21T06:03:57.691597+0000","last_fullsized":"2024-09-21T06:03:57.691597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:12.691864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692240+0000","last_change":"2024-09-21T06:03:56.457591+0000","last_active":"2024-09-21T06:03:57.692240+0000","last_peered":"2024-09-21T06:03:57.692240+0000","last_clean":"2024-09-21T06:03:57.692240+0000","last_became_active":"2024-09-21T06:03:56.456896+0000","last_became_peered":"2024-09-21T06:03:56.456896+0000","last_unstale":"2024-09-21T06:03:57.692240+0000","last_undegraded":"2024-09-21T06:03:57.692240+0000","last_fullsized":"2024-09-21T06:03:57.692240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:34.214902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693012+0000","last_change":"2024-09-21T06:03:56.456857+0000","last_active":"2024-09-21T06:03:57.693012+0000","last_peered":"2024-09-21T06:03:57.693012+0000","last_clean":"2024-09-21T06:03:57.693012+0000","last_became_active":"2024-09-21T06:03:56.456586+0000","last_became_peered":"2024-09-21T06:03:56.456586+0000","last_unstale":"2024-09-21T06:03:57.693012+0000","last_undegraded":"2024-09-21T06:03:57.693012+0000","last_fullsized":"2024-09-21T06:03:57.693012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:11.249451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027408+0000","last_change":"2024-09-21T06:03:56.454728+0000","last_active":"2024-09-21T06:03:58.027408+0000","last_peered":"2024-09-21T06:03:58.027408+0000","last_clean":"2024-09-21T06:03:58.027408+0000","last_became_active":"2024-09-21T06:03:56.449234+0000","last_became_peered":"2024-09-21T06:03:56.449234+0000","last_unstale":"2024-09-21T06:03:58.027408+0000","last_undegraded":"2024-09-21T06:03:58.027408+0000","last_fullsized":"2024-09-21T06:03:58.027408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:36.324424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428253+0000","last_change":"2024-09-21T06:03:56.447603+0000","last_active":"2024-09-21T06:03:57.428253+0000","last_peered":"2024-09-21T06:03:57.428253+0000","last_clean":"2024-09-21T06:03:57.428253+0000","last_became_active":"2024-09-21T06:03:56.445542+0000","last_became_peered":"2024-09-21T06:03:56.445542+0000","last_unstale":"2024-09-21T06:03:57.428253+0000","last_undegraded":"2024-09-21T06:03:57.428253+0000","last_fullsized":"2024-09-21T06:03:57.428253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:14.197545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571130+0000","last_change":"2024-09-21T06:03:56.447157+0000","last_active":"2024-09-21T06:03:57.571130+0000","last_peered":"2024-09-21T06:03:57.571130+0000","last_clean":"2024-09-21T06:03:57.571130+0000","last_became_active":"2024-09-21T06:03:56.446899+0000","last_became_peered":"2024-09-21T06:03:56.446899+0000","last_unstale":"2024-09-21T06:03:57.571130+0000","last_undegraded":"2024-09-21T06:03:57.571130+0000","last_fullsized":"2024-09-21T06:03:57.571130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:21.929659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432008+0000","last_change":"2024-09-21T06:03:56.451274+0000","last_active":"2024-09-21T06:03:57.432008+0000","last_peered":"2024-09-21T06:03:57.432008+0000","last_clean":"2024-09-21T06:03:57.432008+0000","last_became_active":"2024-09-21T06:03:56.451026+0000","last_became_peered":"2024-09-21T06:03:56.451026+0000","last_unstale":"2024-09-21T06:03:57.432008+0000","last_undegraded":"2024-09-21T06:03:57.432008+0000","last_fullsized":"2024-09-21T06:03:57.432008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:11.805171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571094+0000","last_change":"2024-09-21T06:03:56.464377+0000","last_active":"2024-09-21T06:03:57.571094+0000","last_peered":"2024-09-21T06:03:57.571094+0000","last_clean":"2024-09-21T06:03:57.571094+0000","last_became_active":"2024-09-21T06:03:56.460141+0000","last_became_peered":"2024-09-21T06:03:56.460141+0000","last_unstale":"2024-09-21T06:03:57.571094+0000","last_undegraded":"2024-09-21T06:03:57.571094+0000","last_fullsized":"2024-09-21T06:03:57.571094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:56.645338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570565+0000","last_change":"2024-09-21T06:03:56.466078+0000","last_active":"2024-09-21T06:03:57.570565+0000","last_peered":"2024-09-21T06:03:57.570565+0000","last_clean":"2024-09-21T06:03:57.570565+0000","last_became_active":"2024-09-21T06:03:56.464162+0000","last_became_peered":"2024-09-21T06:03:56.464162+0000","last_unstale":"2024-09-21T06:03:57.570565+0000","last_undegraded":"2024-09-21T06:03:57.570565+0000","last_fullsized":"2024-09-21T06:03:57.570565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.386202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430970+0000","last_change":"2024-09-21T06:03:56.443916+0000","last_active":"2024-09-21T06:03:57.430970+0000","last_peered":"2024-09-21T06:03:57.430970+0000","last_clean":"2024-09-21T06:03:57.430970+0000","last_became_active":"2024-09-21T06:03:56.443657+0000","last_became_peered":"2024-09-21T06:03:56.443657+0000","last_unstale":"2024-09-21T06:03:57.430970+0000","last_undegraded":"2024-09-21T06:03:57.430970+0000","last_fullsized":"2024-09-21T06:03:57.430970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:32.402546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692175+0000","last_change":"2024-09-21T06:03:56.434639+0000","last_active":"2024-09-21T06:03:57.692175+0000","last_peered":"2024-09-21T06:03:57.692175+0000","last_clean":"2024-09-21T06:03:57.692175+0000","last_became_active":"2024-09-21T06:03:56.432602+0000","last_became_peered":"2024-09-21T06:03:56.432602+0000","last_unstale":"2024-09-21T06:03:57.692175+0000","last_undegraded":"2024-09-21T06:03:57.692175+0000","last_fullsized":"2024-09-21T06:03:57.692175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:04.651473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692503+0000","last_change":"2024-09-21T06:03:56.457155+0000","last_active":"2024-09-21T06:03:57.692503+0000","last_peered":"2024-09-21T06:03:57.692503+0000","last_clean":"2024-09-21T06:03:57.692503+0000","last_became_active":"2024-09-21T06:03:56.456533+0000","last_became_peered":"2024-09-21T06:03:56.456533+0000","last_unstale":"2024-09-21T06:03:57.692503+0000","last_undegraded":"2024-09-21T06:03:57.692503+0000","last_fullsized":"2024-09-21T06:03:57.692503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:42.680780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571470+0000","last_change":"2024-09-21T06:03:56.443324+0000","last_active":"2024-09-21T06:03:57.571470+0000","last_peered":"2024-09-21T06:03:57.571470+0000","last_clean":"2024-09-21T06:03:57.571470+0000","last_became_active":"2024-09-21T06:03:56.442687+0000","last_became_peered":"2024-09-21T06:03:56.442687+0000","last_unstale":"2024-09-21T06:03:57.571470+0000","last_undegraded":"2024-09-21T06:03:57.571470+0000","last_fullsized":"2024-09-21T06:03:57.571470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:14.217033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570979+0000","last_change":"2024-09-21T06:03:56.465305+0000","last_active":"2024-09-21T06:03:57.570979+0000","last_peered":"2024-09-21T06:03:57.570979+0000","last_clean":"2024-09-21T06:03:57.570979+0000","last_became_active":"2024-09-21T06:03:56.462815+0000","last_became_peered":"2024-09-21T06:03:56.462815+0000","last_unstale":"2024-09-21T06:03:57.570979+0000","last_undegraded":"2024-09-21T06:03:57.570979+0000","last_fullsized":"2024-09-21T06:03:57.570979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:20.595134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429169+0000","last_change":"2024-09-21T06:03:56.446140+0000","last_active":"2024-09-21T06:03:57.429169+0000","last_peered":"2024-09-21T06:03:57.429169+0000","last_clean":"2024-09-21T06:03:57.429169+0000","last_became_active":"2024-09-21T06:03:56.445168+0000","last_became_peered":"2024-09-21T06:03:56.445168+0000","last_unstale":"2024-09-21T06:03:57.429169+0000","last_undegraded":"2024-09-21T06:03:57.429169+0000","last_fullsized":"2024-09-21T06:03:57.429169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:21.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570914+0000","last_change":"2024-09-21T06:03:56.459360+0000","last_active":"2024-09-21T06:03:57.570914+0000","last_peered":"2024-09-21T06:03:57.570914+0000","last_clean":"2024-09-21T06:03:57.570914+0000","last_became_active":"2024-09-21T06:03:56.454061+0000","last_became_peered":"2024-09-21T06:03:56.454061+0000","last_unstale":"2024-09-21T06:03:57.570914+0000","last_undegraded":"2024-09-21T06:03:57.570914+0000","last_fullsized":"2024-09-21T06:03:57.570914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:17.873003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428166+0000","last_change":"2024-09-21T06:03:56.446835+0000","last_active":"2024-09-21T06:03:57.428166+0000","last_peered":"2024-09-21T06:03:57.428166+0000","last_clean":"2024-09-21T06:03:57.428166+0000","last_became_active":"2024-09-21T06:03:56.443977+0000","last_became_peered":"2024-09-21T06:03:56.443977+0000","last_unstale":"2024-09-21T06:03:57.428166+0000","last_undegraded":"2024-09-21T06:03:57.428166+0000","last_fullsized":"2024-09-21T06:03:57.428166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:56.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693255+0000","last_change":"2024-09-21T06:03:56.444059+0000","last_active":"2024-09-21T06:03:57.693255+0000","last_peered":"2024-09-21T06:03:57.693255+0000","last_clean":"2024-09-21T06:03:57.693255+0000","last_became_active":"2024-09-21T06:03:56.443559+0000","last_became_peered":"2024-09-21T06:03:56.443559+0000","last_unstale":"2024-09-21T06:03:57.693255+0000","last_undegraded":"2024-09-21T06:03:57.693255+0000","last_fullsized":"2024-09-21T06:03:57.693255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:56.781422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431122+0000","last_change":"2024-09-21T06:03:56.437143+0000","last_active":"2024-09-21T06:03:57.431122+0000","last_peered":"2024-09-21T06:03:57.431122+0000","last_clean":"2024-09-21T06:03:57.431122+0000","last_became_active":"2024-09-21T06:03:56.436876+0000","last_became_peered":"2024-09-21T06:03:56.436876+0000","last_unstale":"2024-09-21T06:03:57.431122+0000","last_undegraded":"2024-09-21T06:03:57.431122+0000","last_fullsized":"2024-09-21T06:03:57.431122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:10.953250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429282+0000","last_change":"2024-09-21T06:03:56.445860+0000","last_active":"2024-09-21T06:03:57.429282+0000","last_peered":"2024-09-21T06:03:57.429282+0000","last_clean":"2024-09-21T06:03:57.429282+0000","last_became_active":"2024-09-21T06:03:56.444840+0000","last_became_peered":"2024-09-21T06:03:56.444840+0000","last_unstale":"2024-09-21T06:03:57.429282+0000","last_undegraded":"2024-09-21T06:03:57.429282+0000","last_fullsized":"2024-09-21T06:03:57.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:15.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571424+0000","last_change":"2024-09-21T06:03:56.440512+0000","last_active":"2024-09-21T06:03:57.571424+0000","last_peered":"2024-09-21T06:03:57.571424+0000","last_clean":"2024-09-21T06:03:57.571424+0000","last_became_active":"2024-09-21T06:03:56.440184+0000","last_became_peered":"2024-09-21T06:03:56.440184+0000","last_unstale":"2024-09-21T06:03:57.571424+0000","last_undegraded":"2024-09-21T06:03:57.571424+0000","last_fullsized":"2024-09-21T06:03:57.571424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:37.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570758+0000","last_change":"2024-09-21T06:03:56.454324+0000","last_active":"2024-09-21T06:03:57.570758+0000","last_peered":"2024-09-21T06:03:57.570758+0000","last_clean":"2024-09-21T06:03:57.570758+0000","last_became_active":"2024-09-21T06:03:56.452517+0000","last_became_peered":"2024-09-21T06:03:56.452517+0000","last_unstale":"2024-09-21T06:03:57.570758+0000","last_undegraded":"2024-09-21T06:03:57.570758+0000","last_fullsized":"2024-09-21T06:03:57.570758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:46.960104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431260+0000","last_change":"2024-09-21T06:03:56.451719+0000","last_active":"2024-09-21T06:03:57.431260+0000","last_peered":"2024-09-21T06:03:57.431260+0000","last_clean":"2024-09-21T06:03:57.431260+0000","last_became_active":"2024-09-21T06:03:56.451322+0000","last_became_peered":"2024-09-21T06:03:56.451322+0000","last_unstale":"2024-09-21T06:03:57.431260+0000","last_undegraded":"2024-09-21T06:03:57.431260+0000","last_fullsized":"2024-09-21T06:03:57.431260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:51.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692712+0000","last_change":"2024-09-21T06:03:56.444250+0000","last_active":"2024-09-21T06:03:57.692712+0000","last_peered":"2024-09-21T06:03:57.692712+0000","last_clean":"2024-09-21T06:03:57.692712+0000","last_became_active":"2024-09-21T06:03:56.443994+0000","last_became_peered":"2024-09-21T06:03:56.443994+0000","last_unstale":"2024-09-21T06:03:57.692712+0000","last_undegraded":"2024-09-21T06:03:57.692712+0000","last_fullsized":"2024-09-21T06:03:57.692712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:37.243068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027410+0000","last_change":"2024-09-21T06:03:56.455067+0000","last_active":"2024-09-21T06:03:58.027410+0000","last_peered":"2024-09-21T06:03:58.027410+0000","last_clean":"2024-09-21T06:03:58.027410+0000","last_became_active":"2024-09-21T06:03:56.454652+0000","last_became_peered":"2024-09-21T06:03:56.454652+0000","last_unstale":"2024-09-21T06:03:58.027410+0000","last_undegraded":"2024-09-21T06:03:58.027410+0000","last_fullsized":"2024-09-21T06:03:58.027410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429070+0000","last_change":"2024-09-21T06:03:55.428741+0000","last_active":"2024-09-21T06:03:57.429070+0000","last_peered":"2024-09-21T06:03:57.429070+0000","last_clean":"2024-09-21T06:03:57.429070+0000","last_became_active":"2024-09-21T06:03:55.428445+0000","last_became_peered":"2024-09-21T06:03:55.428445+0000","last_unstale":"2024-09-21T06:03:57.429070+0000","last_undegraded":"2024-09-21T06:03:57.429070+0000","last_fullsized":"2024-09-21T06:03:57.429070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:05.972426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571364+0000","last_change":"2024-09-21T06:03:56.451202+0000","last_active":"2024-09-21T06:03:57.571364+0000","last_peered":"2024-09-21T06:03:57.571364+0000","last_clean":"2024-09-21T06:03:57.571364+0000","last_became_active":"2024-09-21T06:03:56.450849+0000","last_became_peered":"2024-09-21T06:03:56.450849+0000","last_unstale":"2024-09-21T06:03:57.571364+0000","last_undegraded":"2024-09-21T06:03:57.571364+0000","last_fullsized":"2024-09-21T06:03:57.571364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:26.599500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692515+0000","last_change":"2024-09-21T06:03:55.441570+0000","last_active":"2024-09-21T06:03:57.692515+0000","last_peered":"2024-09-21T06:03:57.692515+0000","last_clean":"2024-09-21T06:03:57.692515+0000","last_became_active":"2024-09-21T06:03:55.439655+0000","last_became_peered":"2024-09-21T06:03:55.439655+0000","last_unstale":"2024-09-21T06:03:57.692515+0000","last_undegraded":"2024-09-21T06:03:57.692515+0000","last_fullsized":"2024-09-21T06:03:57.692515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429197+0000","last_change":"2024-09-21T06:03:55.440025+0000","last_active":"2024-09-21T06:03:57.429197+0000","last_peered":"2024-09-21T06:03:57.429197+0000","last_clean":"2024-09-21T06:03:57.429197+0000","last_became_active":"2024-09-21T06:03:55.439756+0000","last_became_peered":"2024-09-21T06:03:55.439756+0000","last_unstale":"2024-09-21T06:03:57.429197+0000","last_undegraded":"2024-09-21T06:03:57.429197+0000","last_fullsized":"2024-09-21T06:03:57.429197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:47.917575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429016+0000","last_change":"2024-09-21T06:03:56.445658+0000","last_active":"2024-09-21T06:03:57.429016+0000","last_peered":"2024-09-21T06:03:57.429016+0000","last_clean":"2024-09-21T06:03:57.429016+0000","last_became_active":"2024-09-21T06:03:56.443258+0000","last_became_peered":"2024-09-21T06:03:56.443258+0000","last_unstale":"2024-09-21T06:03:57.429016+0000","last_undegraded":"2024-09-21T06:03:57.429016+0000","last_fullsized":"2024-09-21T06:03:57.429016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:20.336729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571029+0000","last_change":"2024-09-21T06:03:55.443370+0000","last_active":"2024-09-21T06:03:57.571029+0000","last_peered":"2024-09-21T06:03:57.571029+0000","last_clean":"2024-09-21T06:03:57.571029+0000","last_became_active":"2024-09-21T06:03:55.443031+0000","last_became_peered":"2024-09-21T06:03:55.443031+0000","last_unstale":"2024-09-21T06:03:57.571029+0000","last_undegraded":"2024-09-21T06:03:57.571029+0000","last_fullsized":"2024-09-21T06:03:57.571029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:07.343031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430722+0000","last_change":"2024-09-21T06:03:56.445492+0000","last_active":"2024-09-21T06:03:57.430722+0000","last_peered":"2024-09-21T06:03:57.430722+0000","last_clean":"2024-09-21T06:03:57.430722+0000","last_became_active":"2024-09-21T06:03:56.444784+0000","last_became_peered":"2024-09-21T06:03:56.444784+0000","last_unstale":"2024-09-21T06:03:57.430722+0000","last_undegraded":"2024-09-21T06:03:57.430722+0000","last_fullsized":"2024-09-21T06:03:57.430722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:00.134737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693497+0000","last_change":"2024-09-21T06:03:55.443534+0000","last_active":"2024-09-21T06:03:57.693497+0000","last_peered":"2024-09-21T06:03:57.693497+0000","last_clean":"2024-09-21T06:03:57.693497+0000","last_became_active":"2024-09-21T06:03:55.443258+0000","last_became_peered":"2024-09-21T06:03:55.443258+0000","last_unstale":"2024-09-21T06:03:57.693497+0000","last_undegraded":"2024-09-21T06:03:57.693497+0000","last_fullsized":"2024-09-21T06:03:57.693497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:45.626155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570802+0000","last_change":"2024-09-21T06:03:56.465786+0000","last_active":"2024-09-21T06:03:57.570802+0000","last_peered":"2024-09-21T06:03:57.570802+0000","last_clean":"2024-09-21T06:03:57.570802+0000","last_became_active":"2024-09-21T06:03:56.463763+0000","last_became_peered":"2024-09-21T06:03:56.463763+0000","last_unstale":"2024-09-21T06:03:57.570802+0000","last_undegraded":"2024-09-21T06:03:57.570802+0000","last_fullsized":"2024-09-21T06:03:57.570802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:31.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571314+0000","last_change":"2024-09-21T06:03:55.446658+0000","last_active":"2024-09-21T06:03:57.571314+0000","last_peered":"2024-09-21T06:03:57.571314+0000","last_clean":"2024-09-21T06:03:57.571314+0000","last_became_active":"2024-09-21T06:03:55.445408+0000","last_became_peered":"2024-09-21T06:03:55.445408+0000","last_unstale":"2024-09-21T06:03:57.571314+0000","last_undegraded":"2024-09-21T06:03:57.571314+0000","last_fullsized":"2024-09-21T06:03:57.571314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:37.191794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571700+0000","last_change":"2024-09-21T06:03:56.455772+0000","last_active":"2024-09-21T06:03:57.571700+0000","last_peered":"2024-09-21T06:03:57.571700+0000","last_clean":"2024-09-21T06:03:57.571700+0000","last_became_active":"2024-09-21T06:03:56.455305+0000","last_became_peered":"2024-09-21T06:03:56.455305+0000","last_unstale":"2024-09-21T06:03:57.571700+0000","last_undegraded":"2024-09-21T06:03:57.571700+0000","last_fullsized":"2024-09-21T06:03:57.571700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:14.217724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430824+0000","last_change":"2024-09-21T06:03:55.444884+0000","last_active":"2024-09-21T06:03:57.430824+0000","last_peered":"2024-09-21T06:03:57.430824+0000","last_clean":"2024-09-21T06:03:57.430824+0000","last_became_active":"2024-09-21T06:03:55.444597+0000","last_became_peered":"2024-09-21T06:03:55.444597+0000","last_unstale":"2024-09-21T06:03:57.430824+0000","last_undegraded":"2024-09-21T06:03:57.430824+0000","last_fullsized":"2024-09-21T06:03:57.430824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:18.685851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.026989+0000","last_change":"2024-09-21T06:03:56.441599+0000","last_active":"2024-09-21T06:03:58.026989+0000","last_peered":"2024-09-21T06:03:58.026989+0000","last_clean":"2024-09-21T06:03:58.026989+0000","last_became_active":"2024-09-21T06:03:56.441290+0000","last_became_peered":"2024-09-21T06:03:56.441290+0000","last_unstale":"2024-09-21T06:03:58.026989+0000","last_undegraded":"2024-09-21T06:03:58.026989+0000","last_fullsized":"2024-09-21T06:03:58.026989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:07.953606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692871+0000","last_change":"2024-09-21T06:03:55.440241+0000","last_active":"2024-09-21T06:03:57.692871+0000","last_peered":"2024-09-21T06:03:57.692871+0000","last_clean":"2024-09-21T06:03:57.692871+0000","last_became_active":"2024-09-21T06:03:55.436212+0000","last_became_peered":"2024-09-21T06:03:55.436212+0000","last_unstale":"2024-09-21T06:03:57.692871+0000","last_undegraded":"2024-09-21T06:03:57.692871+0000","last_fullsized":"2024-09-21T06:03:57.692871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.627418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691579+0000","last_change":"2024-09-21T06:03:56.431047+0000","last_active":"2024-09-21T06:03:57.691579+0000","last_peered":"2024-09-21T06:03:57.691579+0000","last_clean":"2024-09-21T06:03:57.691579+0000","last_became_active":"2024-09-21T06:03:56.430746+0000","last_became_peered":"2024-09-21T06:03:56.430746+0000","last_unstale":"2024-09-21T06:03:57.691579+0000","last_undegraded":"2024-09-21T06:03:57.691579+0000","last_fullsized":"2024-09-21T06:03:57.691579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.405861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571330+0000","last_change":"2024-09-21T06:03:55.443000+0000","last_active":"2024-09-21T06:03:57.571330+0000","last_peered":"2024-09-21T06:03:57.571330+0000","last_clean":"2024-09-21T06:03:57.571330+0000","last_became_active":"2024-09-21T06:03:55.442415+0000","last_became_peered":"2024-09-21T06:03:55.442415+0000","last_unstale":"2024-09-21T06:03:57.571330+0000","last_undegraded":"2024-09-21T06:03:57.571330+0000","last_fullsized":"2024-09-21T06:03:57.571330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:36.859832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572227+0000","last_change":"2024-09-21T06:03:56.443035+0000","last_active":"2024-09-21T06:03:57.572227+0000","last_peered":"2024-09-21T06:03:57.572227+0000","last_clean":"2024-09-21T06:03:57.572227+0000","last_became_active":"2024-09-21T06:03:56.441291+0000","last_became_peered":"2024-09-21T06:03:56.441291+0000","last_unstale":"2024-09-21T06:03:57.572227+0000","last_undegraded":"2024-09-21T06:03:57.572227+0000","last_fullsized":"2024-09-21T06:03:57.572227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:06.406548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571792+0000","last_change":"2024-09-21T06:03:55.445677+0000","last_active":"2024-09-21T06:03:57.571792+0000","last_peered":"2024-09-21T06:03:57.571792+0000","last_clean":"2024-09-21T06:03:57.571792+0000","last_became_active":"2024-09-21T06:03:55.444586+0000","last_became_peered":"2024-09-21T06:03:55.444586+0000","last_unstale":"2024-09-21T06:03:57.571792+0000","last_undegraded":"2024-09-21T06:03:57.571792+0000","last_fullsized":"2024-09-21T06:03:57.571792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.379145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692475+0000","last_change":"2024-09-21T06:03:56.452229+0000","last_active":"2024-09-21T06:03:57.692475+0000","last_peered":"2024-09-21T06:03:57.692475+0000","last_clean":"2024-09-21T06:03:57.692475+0000","last_became_active":"2024-09-21T06:03:56.451579+0000","last_became_peered":"2024-09-21T06:03:56.451579+0000","last_unstale":"2024-09-21T06:03:57.692475+0000","last_undegraded":"2024-09-21T06:03:57.692475+0000","last_fullsized":"2024-09-21T06:03:57.692475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:25.086776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692856+0000","last_change":"2024-09-21T06:03:55.441373+0000","last_active":"2024-09-21T06:03:57.692856+0000","last_peered":"2024-09-21T06:03:57.692856+0000","last_clean":"2024-09-21T06:03:57.692856+0000","last_became_active":"2024-09-21T06:03:55.440162+0000","last_became_peered":"2024-09-21T06:03:55.440162+0000","last_unstale":"2024-09-21T06:03:57.692856+0000","last_undegraded":"2024-09-21T06:03:57.692856+0000","last_fullsized":"2024-09-21T06:03:57.692856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:19.491867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692254+0000","last_change":"2024-09-21T06:03:56.444391+0000","last_active":"2024-09-21T06:03:57.692254+0000","last_peered":"2024-09-21T06:03:57.692254+0000","last_clean":"2024-09-21T06:03:57.692254+0000","last_became_active":"2024-09-21T06:03:56.444025+0000","last_became_peered":"2024-09-21T06:03:56.444025+0000","last_unstale":"2024-09-21T06:03:57.692254+0000","last_undegraded":"2024-09-21T06:03:57.692254+0000","last_fullsized":"2024-09-21T06:03:57.692254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:12.791221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431110+0000","last_change":"2024-09-21T06:03:55.441644+0000","last_active":"2024-09-21T06:03:57.431110+0000","last_peered":"2024-09-21T06:03:57.431110+0000","last_clean":"2024-09-21T06:03:57.431110+0000","last_became_active":"2024-09-21T06:03:55.440433+0000","last_became_peered":"2024-09-21T06:03:55.440433+0000","last_unstale":"2024-09-21T06:03:57.431110+0000","last_undegraded":"2024-09-21T06:03:57.431110+0000","last_fullsized":"2024-09-21T06:03:57.431110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:12.049159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692441+0000","last_change":"2024-09-21T06:03:56.447048+0000","last_active":"2024-09-21T06:03:57.692441+0000","last_peered":"2024-09-21T06:03:57.692441+0000","last_clean":"2024-09-21T06:03:57.692441+0000","last_became_active":"2024-09-21T06:03:56.446772+0000","last_became_peered":"2024-09-21T06:03:56.446772+0000","last_unstale":"2024-09-21T06:03:57.692441+0000","last_undegraded":"2024-09-21T06:03:57.692441+0000","last_fullsized":"2024-09-21T06:03:57.692441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:15.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027332+0000","last_change":"2024-09-21T06:03:55.447010+0000","last_active":"2024-09-21T06:03:58.027332+0000","last_peered":"2024-09-21T06:03:58.027332+0000","last_clean":"2024-09-21T06:03:58.027332+0000","last_became_active":"2024-09-21T06:03:55.446667+0000","last_became_peered":"2024-09-21T06:03:55.446667+0000","last_unstale":"2024-09-21T06:03:58.027332+0000","last_undegraded":"2024-09-21T06:03:58.027332+0000","last_fullsized":"2024-09-21T06:03:58.027332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:22.336856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692706+0000","last_change":"2024-09-21T06:03:56.451848+0000","last_active":"2024-09-21T06:03:57.692706+0000","last_peered":"2024-09-21T06:03:57.692706+0000","last_clean":"2024-09-21T06:03:57.692706+0000","last_became_active":"2024-09-21T06:03:56.451238+0000","last_became_peered":"2024-09-21T06:03:56.451238+0000","last_unstale":"2024-09-21T06:03:57.692706+0000","last_undegraded":"2024-09-21T06:03:57.692706+0000","last_fullsized":"2024-09-21T06:03:57.692706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:55.150988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431545+0000","last_change":"2024-09-21T06:03:55.439453+0000","last_active":"2024-09-21T06:03:57.431545+0000","last_peered":"2024-09-21T06:03:57.431545+0000","last_clean":"2024-09-21T06:03:57.431545+0000","last_became_active":"2024-09-21T06:03:55.439099+0000","last_became_peered":"2024-09-21T06:03:55.439099+0000","last_unstale":"2024-09-21T06:03:57.431545+0000","last_undegraded":"2024-09-21T06:03:57.431545+0000","last_fullsized":"2024-09-21T06:03:57.431545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:33.962342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691929+0000","last_change":"2024-09-21T06:03:56.439335+0000","last_active":"2024-09-21T06:03:57.691929+0000","last_peered":"2024-09-21T06:03:57.691929+0000","last_clean":"2024-09-21T06:03:57.691929+0000","last_became_active":"2024-09-21T06:03:56.439022+0000","last_became_peered":"2024-09-21T06:03:56.439022+0000","last_unstale":"2024-09-21T06:03:57.691929+0000","last_undegraded":"2024-09-21T06:03:57.691929+0000","last_fullsized":"2024-09-21T06:03:57.691929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:06.816584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430748+0000","last_change":"2024-09-21T06:03:55.439612+0000","last_active":"2024-09-21T06:03:57.430748+0000","last_peered":"2024-09-21T06:03:57.430748+0000","last_clean":"2024-09-21T06:03:57.430748+0000","last_became_active":"2024-09-21T06:03:55.439290+0000","last_became_peered":"2024-09-21T06:03:55.439290+0000","last_unstale":"2024-09-21T06:03:57.430748+0000","last_undegraded":"2024-09-21T06:03:57.430748+0000","last_fullsized":"2024-09-21T06:03:57.430748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:52.664481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571145+0000","last_change":"2024-09-21T06:03:56.464441+0000","last_active":"2024-09-21T06:03:57.571145+0000","last_peered":"2024-09-21T06:03:57.571145+0000","last_clean":"2024-09-21T06:03:57.571145+0000","last_became_active":"2024-09-21T06:03:56.461438+0000","last_became_peered":"2024-09-21T06:03:56.461438+0000","last_unstale":"2024-09-21T06:03:57.571145+0000","last_undegraded":"2024-09-21T06:03:57.571145+0000","last_fullsized":"2024-09-21T06:03:57.571145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:12.479477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431105+0000","last_change":"2024-09-21T06:03:55.447015+0000","last_active":"2024-09-21T06:03:57.431105+0000","last_peered":"2024-09-21T06:03:57.431105+0000","last_clean":"2024-09-21T06:03:57.431105+0000","last_became_active":"2024-09-21T06:03:55.446715+0000","last_became_peered":"2024-09-21T06:03:55.446715+0000","last_unstale":"2024-09-21T06:03:57.431105+0000","last_undegraded":"2024-09-21T06:03:57.431105+0000","last_fullsized":"2024-09-21T06:03:57.431105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:19.312399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692668+0000","last_change":"2024-09-21T06:03:56.449362+0000","last_active":"2024-09-21T06:03:57.692668+0000","last_peered":"2024-09-21T06:03:57.692668+0000","last_clean":"2024-09-21T06:03:57.692668+0000","last_became_active":"2024-09-21T06:03:56.449043+0000","last_became_peered":"2024-09-21T06:03:56.449043+0000","last_unstale":"2024-09-21T06:03:57.692668+0000","last_undegraded":"2024-09-21T06:03:57.692668+0000","last_fullsized":"2024-09-21T06:03:57.692668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:32.456389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693159+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:03:57.693159+0000","last_peered":"2024-09-21T06:03:57.693159+0000","last_clean":"2024-09-21T06:03:57.693159+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:03:57.693159+0000","last_undegraded":"2024-09-21T06:03:57.693159+0000","last_fullsized":"2024-09-21T06:03:57.693159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571983+0000","last_change":"2024-09-21T06:03:55.447917+0000","last_active":"2024-09-21T06:03:57.571983+0000","last_peered":"2024-09-21T06:03:57.571983+0000","last_clean":"2024-09-21T06:03:57.571983+0000","last_became_active":"2024-09-21T06:03:55.446149+0000","last_became_peered":"2024-09-21T06:03:55.446149+0000","last_unstale":"2024-09-21T06:03:57.571983+0000","last_undegraded":"2024-09-21T06:03:57.571983+0000","last_fullsized":"2024-09-21T06:03:57.571983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:20.975259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428275+0000","last_change":"2024-09-21T06:03:56.463166+0000","last_active":"2024-09-21T06:03:57.428275+0000","last_peered":"2024-09-21T06:03:57.428275+0000","last_clean":"2024-09-21T06:03:57.428275+0000","last_became_active":"2024-09-21T06:03:56.462743+0000","last_became_peered":"2024-09-21T06:03:56.462743+0000","last_unstale":"2024-09-21T06:03:57.428275+0000","last_undegraded":"2024-09-21T06:03:57.428275+0000","last_fullsized":"2024-09-21T06:03:57.428275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:31.142964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693123+0000","last_change":"2024-09-21T06:03:55.435300+0000","last_active":"2024-09-21T06:03:57.693123+0000","last_peered":"2024-09-21T06:03:57.693123+0000","last_clean":"2024-09-21T06:03:57.693123+0000","last_became_active":"2024-09-21T06:03:55.435036+0000","last_became_peered":"2024-09-21T06:03:55.435036+0000","last_unstale":"2024-09-21T06:03:57.693123+0000","last_undegraded":"2024-09-21T06:03:57.693123+0000","last_fullsized":"2024-09-21T06:03:57.693123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:04.591456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572289+0000","last_change":"2024-09-21T06:03:56.451414+0000","last_active":"2024-09-21T06:03:57.572289+0000","last_peered":"2024-09-21T06:03:57.572289+0000","last_clean":"2024-09-21T06:03:57.572289+0000","last_became_active":"2024-09-21T06:03:56.450889+0000","last_became_peered":"2024-09-21T06:03:56.450889+0000","last_unstale":"2024-09-21T06:03:57.572289+0000","last_undegraded":"2024-09-21T06:03:57.572289+0000","last_fullsized":"2024-09-21T06:03:57.572289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:03.401533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431179+0000","last_change":"2024-09-21T06:03:55.438892+0000","last_active":"2024-09-21T06:03:57.431179+0000","last_peered":"2024-09-21T06:03:57.431179+0000","last_clean":"2024-09-21T06:03:57.431179+0000","last_became_active":"2024-09-21T06:03:55.438536+0000","last_became_peered":"2024-09-21T06:03:55.438536+0000","last_unstale":"2024-09-21T06:03:57.431179+0000","last_undegraded":"2024-09-21T06:03:57.431179+0000","last_fullsized":"2024-09-21T06:03:57.431179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:21.430043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430892+0000","last_change":"2024-09-21T06:03:56.445133+0000","last_active":"2024-09-21T06:03:57.430892+0000","last_peered":"2024-09-21T06:03:57.430892+0000","last_clean":"2024-09-21T06:03:57.430892+0000","last_became_active":"2024-09-21T06:03:56.438602+0000","last_became_peered":"2024-09-21T06:03:56.438602+0000","last_unstale":"2024-09-21T06:03:57.430892+0000","last_undegraded":"2024-09-21T06:03:57.430892+0000","last_fullsized":"2024-09-21T06:03:57.430892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:28.789594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571386+0000","last_change":"2024-09-21T06:03:55.446975+0000","last_active":"2024-09-21T06:03:57.571386+0000","last_peered":"2024-09-21T06:03:57.571386+0000","last_clean":"2024-09-21T06:03:57.571386+0000","last_became_active":"2024-09-21T06:03:55.445827+0000","last_became_peered":"2024-09-21T06:03:55.445827+0000","last_unstale":"2024-09-21T06:03:57.571386+0000","last_undegraded":"2024-09-21T06:03:57.571386+0000","last_fullsized":"2024-09-21T06:03:57.571386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.888141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027398+0000","last_change":"2024-09-21T06:03:56.444147+0000","last_active":"2024-09-21T06:03:58.027398+0000","last_peered":"2024-09-21T06:03:58.027398+0000","last_clean":"2024-09-21T06:03:58.027398+0000","last_became_active":"2024-09-21T06:03:56.443876+0000","last_became_peered":"2024-09-21T06:03:56.443876+0000","last_unstale":"2024-09-21T06:03:58.027398+0000","last_undegraded":"2024-09-21T06:03:58.027398+0000","last_fullsized":"2024-09-21T06:03:58.027398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:08.226479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432211+0000","last_change":"2024-09-21T06:03:55.445091+0000","last_active":"2024-09-21T06:03:57.432211+0000","last_peered":"2024-09-21T06:03:57.432211+0000","last_clean":"2024-09-21T06:03:57.432211+0000","last_became_active":"2024-09-21T06:03:55.444251+0000","last_became_peered":"2024-09-21T06:03:55.444251+0000","last_unstale":"2024-09-21T06:03:57.432211+0000","last_undegraded":"2024-09-21T06:03:57.432211+0000","last_fullsized":"2024-09-21T06:03:57.432211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:22.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571084+0000","last_change":"2024-09-21T06:03:56.454434+0000","last_active":"2024-09-21T06:03:57.571084+0000","last_peered":"2024-09-21T06:03:57.571084+0000","last_clean":"2024-09-21T06:03:57.571084+0000","last_became_active":"2024-09-21T06:03:56.446663+0000","last_became_peered":"2024-09-21T06:03:56.446663+0000","last_unstale":"2024-09-21T06:03:57.571084+0000","last_undegraded":"2024-09-21T06:03:57.571084+0000","last_fullsized":"2024-09-21T06:03:57.571084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:52.560532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693027+0000","last_change":"2024-09-21T06:03:55.447110+0000","last_active":"2024-09-21T06:03:57.693027+0000","last_peered":"2024-09-21T06:03:57.693027+0000","last_clean":"2024-09-21T06:03:57.693027+0000","last_became_active":"2024-09-21T06:03:55.446798+0000","last_became_peered":"2024-09-21T06:03:55.446798+0000","last_unstale":"2024-09-21T06:03:57.693027+0000","last_undegraded":"2024-09-21T06:03:57.693027+0000","last_fullsized":"2024-09-21T06:03:57.693027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:21.152044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431800+0000","last_change":"2024-09-21T06:03:56.445987+0000","last_active":"2024-09-21T06:03:57.431800+0000","last_peered":"2024-09-21T06:03:57.431800+0000","last_clean":"2024-09-21T06:03:57.431800+0000","last_became_active":"2024-09-21T06:03:56.438083+0000","last_became_peered":"2024-09-21T06:03:56.438083+0000","last_unstale":"2024-09-21T06:03:57.431800+0000","last_undegraded":"2024-09-21T06:03:57.431800+0000","last_fullsized":"2024-09-21T06:03:57.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:27.608201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.434918+0000","last_change":"2024-09-21T06:03:55.443082+0000","last_active":"2024-09-21T06:03:58.434918+0000","last_peered":"2024-09-21T06:03:58.434918+0000","last_clean":"2024-09-21T06:03:58.434918+0000","last_became_active":"2024-09-21T06:03:55.442723+0000","last_became_peered":"2024-09-21T06:03:55.442723+0000","last_unstale":"2024-09-21T06:03:58.434918+0000","last_undegraded":"2024-09-21T06:03:58.434918+0000","last_fullsized":"2024-09-21T06:03:58.434918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:51.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428053+0000","last_change":"2024-09-21T06:03:56.431180+0000","last_active":"2024-09-21T06:03:57.428053+0000","last_peered":"2024-09-21T06:03:57.428053+0000","last_clean":"2024-09-21T06:03:57.428053+0000","last_became_active":"2024-09-21T06:03:56.430949+0000","last_became_peered":"2024-09-21T06:03:56.430949+0000","last_unstale":"2024-09-21T06:03:57.428053+0000","last_undegraded":"2024-09-21T06:03:57.428053+0000","last_fullsized":"2024-09-21T06:03:57.428053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:47.246368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692989+0000","last_change":"2024-09-21T06:03:55.438578+0000","last_active":"2024-09-21T06:03:57.692989+0000","last_peered":"2024-09-21T06:03:57.692989+0000","last_clean":"2024-09-21T06:03:57.692989+0000","last_became_active":"2024-09-21T06:03:55.438188+0000","last_became_peered":"2024-09-21T06:03:55.438188+0000","last_unstale":"2024-09-21T06:03:57.692989+0000","last_undegraded":"2024-09-21T06:03:57.692989+0000","last_fullsized":"2024-09-21T06:03:57.692989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:29.047291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571542+0000","last_change":"2024-09-21T06:03:56.447972+0000","last_active":"2024-09-21T06:03:57.571542+0000","last_peered":"2024-09-21T06:03:57.571542+0000","last_clean":"2024-09-21T06:03:57.571542+0000","last_became_active":"2024-09-21T06:03:56.447293+0000","last_became_peered":"2024-09-21T06:03:56.447293+0000","last_unstale":"2024-09-21T06:03:57.571542+0000","last_undegraded":"2024-09-21T06:03:57.571542+0000","last_fullsized":"2024-09-21T06:03:57.571542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.728982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693026+0000","last_change":"2024-09-21T06:03:55.447845+0000","last_active":"2024-09-21T06:03:57.693026+0000","last_peered":"2024-09-21T06:03:57.693026+0000","last_clean":"2024-09-21T06:03:57.693026+0000","last_became_active":"2024-09-21T06:03:55.447506+0000","last_became_peered":"2024-09-21T06:03:55.447506+0000","last_unstale":"2024-09-21T06:03:57.693026+0000","last_undegraded":"2024-09-21T06:03:57.693026+0000","last_fullsized":"2024-09-21T06:03:57.693026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:52.083074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027604+0000","last_change":"2024-09-21T06:03:56.454202+0000","last_active":"2024-09-21T06:03:58.027604+0000","last_peered":"2024-09-21T06:03:58.027604+0000","last_clean":"2024-09-21T06:03:58.027604+0000","last_became_active":"2024-09-21T06:03:56.449314+0000","last_became_peered":"2024-09-21T06:03:56.449314+0000","last_unstale":"2024-09-21T06:03:58.027604+0000","last_undegraded":"2024-09-21T06:03:58.027604+0000","last_fullsized":"2024-09-21T06:03:58.027604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:22.137665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432116+0000","last_change":"2024-09-21T06:03:55.444591+0000","last_active":"2024-09-21T06:03:57.432116+0000","last_peered":"2024-09-21T06:03:57.432116+0000","last_clean":"2024-09-21T06:03:57.432116+0000","last_became_active":"2024-09-21T06:03:55.443824+0000","last_became_peered":"2024-09-21T06:03:55.443824+0000","last_unstale":"2024-09-21T06:03:57.432116+0000","last_undegraded":"2024-09-21T06:03:57.432116+0000","last_fullsized":"2024-09-21T06:03:57.432116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:56.287832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428014+0000","last_change":"2024-09-21T06:03:56.440655+0000","last_active":"2024-09-21T06:03:57.428014+0000","last_peered":"2024-09-21T06:03:57.428014+0000","last_clean":"2024-09-21T06:03:57.428014+0000","last_became_active":"2024-09-21T06:03:56.438045+0000","last_became_peered":"2024-09-21T06:03:56.438045+0000","last_unstale":"2024-09-21T06:03:57.428014+0000","last_undegraded":"2024-09-21T06:03:57.428014+0000","last_fullsized":"2024-09-21T06:03:57.428014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:43.265975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430996+0000","last_change":"2024-09-21T06:03:55.436206+0000","last_active":"2024-09-21T06:03:57.430996+0000","last_peered":"2024-09-21T06:03:57.430996+0000","last_clean":"2024-09-21T06:03:57.430996+0000","last_became_active":"2024-09-21T06:03:55.435520+0000","last_became_peered":"2024-09-21T06:03:55.435520+0000","last_unstale":"2024-09-21T06:03:57.430996+0000","last_undegraded":"2024-09-21T06:03:57.430996+0000","last_fullsized":"2024-09-21T06:03:57.430996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:51.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429387+0000","last_change":"2024-09-21T06:03:56.441695+0000","last_active":"2024-09-21T06:03:57.429387+0000","last_peered":"2024-09-21T06:03:57.429387+0000","last_clean":"2024-09-21T06:03:57.429387+0000","last_became_active":"2024-09-21T06:03:56.441424+0000","last_became_peered":"2024-09-21T06:03:56.441424+0000","last_unstale":"2024-09-21T06:03:57.429387+0000","last_undegraded":"2024-09-21T06:03:57.429387+0000","last_fullsized":"2024-09-21T06:03:57.429387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:23.032354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691770+0000","last_change":"2024-09-21T06:03:55.432494+0000","last_active":"2024-09-21T06:03:57.691770+0000","last_peered":"2024-09-21T06:03:57.691770+0000","last_clean":"2024-09-21T06:03:57.691770+0000","last_became_active":"2024-09-21T06:03:55.432188+0000","last_became_peered":"2024-09-21T06:03:55.432188+0000","last_unstale":"2024-09-21T06:03:57.691770+0000","last_undegraded":"2024-09-21T06:03:57.691770+0000","last_fullsized":"2024-09-21T06:03:57.691770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.607214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692723+0000","last_change":"2024-09-21T06:03:56.453311+0000","last_active":"2024-09-21T06:03:57.692723+0000","last_peered":"2024-09-21T06:03:57.692723+0000","last_clean":"2024-09-21T06:03:57.692723+0000","last_became_active":"2024-09-21T06:03:56.452981+0000","last_became_peered":"2024-09-21T06:03:56.452981+0000","last_unstale":"2024-09-21T06:03:57.692723+0000","last_undegraded":"2024-09-21T06:03:57.692723+0000","last_fullsized":"2024-09-21T06:03:57.692723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:51.310034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570928+0000","last_change":"2024-09-21T06:03:56.462364+0000","last_active":"2024-09-21T06:03:57.570928+0000","last_peered":"2024-09-21T06:03:57.570928+0000","last_clean":"2024-09-21T06:03:57.570928+0000","last_became_active":"2024-09-21T06:03:56.462055+0000","last_became_peered":"2024-09-21T06:03:56.462055+0000","last_unstale":"2024-09-21T06:03:57.570928+0000","last_undegraded":"2024-09-21T06:03:57.570928+0000","last_fullsized":"2024-09-21T06:03:57.570928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:02.173067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692888+0000","last_change":"2024-09-21T06:03:55.444782+0000","last_active":"2024-09-21T06:03:57.692888+0000","last_peered":"2024-09-21T06:03:57.692888+0000","last_clean":"2024-09-21T06:03:57.692888+0000","last_became_active":"2024-09-21T06:03:55.444479+0000","last_became_peered":"2024-09-21T06:03:55.444479+0000","last_unstale":"2024-09-21T06:03:57.692888+0000","last_undegraded":"2024-09-21T06:03:57.692888+0000","last_fullsized":"2024-09-21T06:03:57.692888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:26.302369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571593+0000","last_change":"2024-09-21T06:03:56.465626+0000","last_active":"2024-09-21T06:03:57.571593+0000","last_peered":"2024-09-21T06:03:57.571593+0000","last_clean":"2024-09-21T06:03:57.571593+0000","last_became_active":"2024-09-21T06:03:56.464090+0000","last_became_peered":"2024-09-21T06:03:56.464090+0000","last_unstale":"2024-09-21T06:03:57.571593+0000","last_undegraded":"2024-09-21T06:03:57.571593+0000","last_fullsized":"2024-09-21T06:03:57.571593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:07.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692830+0000","last_change":"2024-09-21T06:03:55.443192+0000","last_active":"2024-09-21T06:03:57.692830+0000","last_peered":"2024-09-21T06:03:57.692830+0000","last_clean":"2024-09-21T06:03:57.692830+0000","last_became_active":"2024-09-21T06:03:55.442119+0000","last_became_peered":"2024-09-21T06:03:55.442119+0000","last_unstale":"2024-09-21T06:03:57.692830+0000","last_undegraded":"2024-09-21T06:03:57.692830+0000","last_fullsized":"2024-09-21T06:03:57.692830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:28.597367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572088+0000","last_change":"2024-09-21T06:03:56.448267+0000","last_active":"2024-09-21T06:03:57.572088+0000","last_peered":"2024-09-21T06:03:57.572088+0000","last_clean":"2024-09-21T06:03:57.572088+0000","last_became_active":"2024-09-21T06:03:56.447661+0000","last_became_peered":"2024-09-21T06:03:56.447661+0000","last_unstale":"2024-09-21T06:03:57.572088+0000","last_undegraded":"2024-09-21T06:03:57.572088+0000","last_fullsized":"2024-09-21T06:03:57.572088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:21.491787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429111+0000","last_change":"2024-09-21T06:03:55.447256+0000","last_active":"2024-09-21T06:03:57.429111+0000","last_peered":"2024-09-21T06:03:57.429111+0000","last_clean":"2024-09-21T06:03:57.429111+0000","last_became_active":"2024-09-21T06:03:55.446690+0000","last_became_peered":"2024-09-21T06:03:55.446690+0000","last_unstale":"2024-09-21T06:03:57.429111+0000","last_undegraded":"2024-09-21T06:03:57.429111+0000","last_fullsized":"2024-09-21T06:03:57.429111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:23.968841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429064+0000","last_change":"2024-09-21T06:03:56.441427+0000","last_active":"2024-09-21T06:03:57.429064+0000","last_peered":"2024-09-21T06:03:57.429064+0000","last_clean":"2024-09-21T06:03:57.429064+0000","last_became_active":"2024-09-21T06:03:56.441006+0000","last_became_peered":"2024-09-21T06:03:56.441006+0000","last_unstale":"2024-09-21T06:03:57.429064+0000","last_undegraded":"2024-09-21T06:03:57.429064+0000","last_fullsized":"2024-09-21T06:03:57.429064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:22.240365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572345+0000","last_change":"2024-09-21T06:03:55.444048+0000","last_active":"2024-09-21T06:03:57.572345+0000","last_peered":"2024-09-21T06:03:57.572345+0000","last_clean":"2024-09-21T06:03:57.572345+0000","last_became_active":"2024-09-21T06:03:55.443780+0000","last_became_peered":"2024-09-21T06:03:55.443780+0000","last_unstale":"2024-09-21T06:03:57.572345+0000","last_undegraded":"2024-09-21T06:03:57.572345+0000","last_fullsized":"2024-09-21T06:03:57.572345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:22.074462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:05.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 -- 172.21.15.118:0/979032354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c13fef0 msgr2=0x7f376c142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 --2- 172.21.15.118:0/979032354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c13fef0 0x7f376c142c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3764005fd0 tx=0x7f376402aa10 comp rx=0 tx=0).stop 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 -- 172.21.15.118:0/979032354 shutdown_connections 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 --2- 172.21.15.118:0/979032354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c13fef0 0x7f376c142c70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 --2- 172.21.15.118:0/979032354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f376c0d1590 0x7f376c142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 -- 172.21.15.118:0/979032354 >> 172.21.15.118:0/979032354 conn(0x7f376c06d110 msgr2=0x7f376c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 -- 172.21.15.118:0/979032354 shutdown_connections 2024-09-21T06:04:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.418+0000 7f3772a00640 1 -- 172.21.15.118:0/979032354 wait complete. 2024-09-21T06:04:05.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.420+0000 7f3772a00640 1 Processor -- start 2024-09-21T06:04:05.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.421+0000 7f3772a00640 1 -- start start 2024-09-21T06:04:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f3772a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f376c13fae0 0x7f376c13eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f3772a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f376c13fef0 0x7f376c0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f3772a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c15ca90 0x7f376c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f3772a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f376c0cfb10 con 0x7f376c13fae0 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f3772a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f376c0cf990 con 0x7f376c15ca90 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f3772a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f376c0cfc90 con 0x7f376c13fef0 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f376be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f376c13fae0 0x7f376c13eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f376be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f376c13fae0 0x7f376c13eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53902/0 (socket says 172.21.15.118:53902) 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.422+0000 7f376be00640 1 -- 172.21.15.118:0/1037414837 learned_addr learned my addr 172.21.15.118:0/1037414837 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f3770a00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c15ca90 0x7f376c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f376b400640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f376c13fef0 0x7f376c0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f376be00640 1 -- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f376c13fef0 msgr2=0x7f376c0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f376be00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f376c13fef0 0x7f376c0b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f376be00640 1 -- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c15ca90 msgr2=0x7f376c0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f376be00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c15ca90 0x7f376c0b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f376be00640 1 -- 172.21.15.118:0/1037414837 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c074cc0 con 0x7f376c13fae0 2024-09-21T06:04:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f376be00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f376c13fae0 0x7f376c13eab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c3d0 tx=0x7f375c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f3763e00640 1 -- 172.21.15.118:0/1037414837 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c017070 con 0x7f376c13fae0 2024-09-21T06:04:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f3763e00640 1 -- 172.21.15.118:0/1037414837 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f375c0053c0 con 0x7f376c13fae0 2024-09-21T06:04:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f3763e00640 1 -- 172.21.15.118:0/1037414837 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c003850 con 0x7f376c13fae0 2024-09-21T06:04:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.423+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376c0749e0 con 0x7f376c13fae0 2024-09-21T06:04:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.424+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376c1f92f0 con 0x7f376c13fae0 2024-09-21T06:04:05.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.425+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f376c0d0140 con 0x7f376c13fae0 2024-09-21T06:04:05.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.426+0000 7f3763e00640 1 -- 172.21.15.118:0/1037414837 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f375c01a070 con 0x7f376c13fae0 2024-09-21T06:04:05.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.427+0000 7f3763e00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f374c078b90 0x7f374c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.427+0000 7f3763e00640 1 -- 172.21.15.118:0/1037414837 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f375c099fe0 con 0x7f376c13fae0 2024-09-21T06:04:05.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.427+0000 7f376b400640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f374c078b90 0x7f374c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.428+0000 7f376b400640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f374c078b90 0x7f374c07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f376c13b5d0 tx=0x7f3758005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.431+0000 7f3763e00640 1 -- 172.21.15.118:0/1037414837 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f375c061e20 con 0x7f376c13fae0 2024-09-21T06:04:05.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.615+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f376c15b8c0 con 0x7f374c078b90 2024-09-21T06:04:05.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.621+0000 7f3763e00640 1 -- 172.21.15.118:0/1037414837 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247474 (secure 0 0 0) 0x7f376c15b8c0 con 0x7f374c078b90 2024-09-21T06:04:05.626 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:05.627 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:05.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f374c078b90 msgr2=0x7f374c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f374c078b90 0x7f374c07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f376c13b5d0 tx=0x7f3758005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f376c13fae0 msgr2=0x7f376c13eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f376c13fae0 0x7f376c13eab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c3d0 tx=0x7f375c00c890 comp rx=0 tx=0).stop 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 shutdown_connections 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f376c15ca90 0x7f376c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f374c078b90 0x7f374c07b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f376c13fef0 0x7f376c0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 --2- 172.21.15.118:0/1037414837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f376c13fae0 0x7f376c13eab0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 >> 172.21.15.118:0/1037414837 conn(0x7f376c06d110 msgr2=0x7f376c1427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 shutdown_connections 2024-09-21T06:04:05.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.625+0000 7f3772a00640 1 -- 172.21.15.118:0/1037414837 wait complete. 2024-09-21T06:04:05.649 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-21T06:04:04.457264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.030960"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692022+0000","last_change":"2024-09-21T06:03:56.442024+0000","last_active":"2024-09-21T06:03:57.692022+0000","last_peered":"2024-09-21T06:03:57.692022+0000","last_clean":"2024-09-21T06:03:57.692022+0000","last_became_active":"2024-09-21T06:03:56.441182+0000","last_became_peered":"2024-09-21T06:03:56.441182+0000","last_unstale":"2024-09-21T06:03:57.692022+0000","last_undegraded":"2024-09-21T06:03:57.692022+0000","last_fullsized":"2024-09-21T06:03:57.692022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:02.809521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430908+0000","last_change":"2024-09-21T06:03:56.442846+0000","last_active":"2024-09-21T06:03:57.430908+0000","last_peered":"2024-09-21T06:03:57.430908+0000","last_clean":"2024-09-21T06:03:57.430908+0000","last_became_active":"2024-09-21T06:03:56.442596+0000","last_became_peered":"2024-09-21T06:03:56.442596+0000","last_unstale":"2024-09-21T06:03:57.430908+0000","last_undegraded":"2024-09-21T06:03:57.430908+0000","last_fullsized":"2024-09-21T06:03:57.430908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:31.907433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571265+0000","last_change":"2024-09-21T06:03:56.444128+0000","last_active":"2024-09-21T06:03:57.571265+0000","last_peered":"2024-09-21T06:03:57.571265+0000","last_clean":"2024-09-21T06:03:57.571265+0000","last_became_active":"2024-09-21T06:03:56.443902+0000","last_became_peered":"2024-09-21T06:03:56.443902+0000","last_unstale":"2024-09-21T06:03:57.571265+0000","last_undegraded":"2024-09-21T06:03:57.571265+0000","last_fullsized":"2024-09-21T06:03:57.571265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:52.321248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570718+0000","last_change":"2024-09-21T06:03:56.463130+0000","last_active":"2024-09-21T06:03:57.570718+0000","last_peered":"2024-09-21T06:03:57.570718+0000","last_clean":"2024-09-21T06:03:57.570718+0000","last_became_active":"2024-09-21T06:03:56.459929+0000","last_became_peered":"2024-09-21T06:03:56.459929+0000","last_unstale":"2024-09-21T06:03:57.570718+0000","last_undegraded":"2024-09-21T06:03:57.570718+0000","last_fullsized":"2024-09-21T06:03:57.570718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:15.532700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691768+0000","last_change":"2024-09-21T06:03:56.433208+0000","last_active":"2024-09-21T06:03:57.691768+0000","last_peered":"2024-09-21T06:03:57.691768+0000","last_clean":"2024-09-21T06:03:57.691768+0000","last_became_active":"2024-09-21T06:03:56.432871+0000","last_became_peered":"2024-09-21T06:03:56.432871+0000","last_unstale":"2024-09-21T06:03:57.691768+0000","last_undegraded":"2024-09-21T06:03:57.691768+0000","last_fullsized":"2024-09-21T06:03:57.691768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:39.265454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571368+0000","last_change":"2024-09-21T06:03:56.461789+0000","last_active":"2024-09-21T06:03:57.571368+0000","last_peered":"2024-09-21T06:03:57.571368+0000","last_clean":"2024-09-21T06:03:57.571368+0000","last_became_active":"2024-09-21T06:03:56.453393+0000","last_became_peered":"2024-09-21T06:03:56.453393+0000","last_unstale":"2024-09-21T06:03:57.571368+0000","last_undegraded":"2024-09-21T06:03:57.571368+0000","last_fullsized":"2024-09-21T06:03:57.571368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:34.596911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691851+0000","last_change":"2024-09-21T06:03:56.443005+0000","last_active":"2024-09-21T06:03:57.691851+0000","last_peered":"2024-09-21T06:03:57.691851+0000","last_clean":"2024-09-21T06:03:57.691851+0000","last_became_active":"2024-09-21T06:03:56.442706+0000","last_became_peered":"2024-09-21T06:03:56.442706+0000","last_unstale":"2024-09-21T06:03:57.691851+0000","last_undegraded":"2024-09-21T06:03:57.691851+0000","last_fullsized":"2024-09-21T06:03:57.691851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:08.249768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.427461+0000","last_change":"2024-09-21T06:03:56.448982+0000","last_active":"2024-09-21T06:03:57.427461+0000","last_peered":"2024-09-21T06:03:57.427461+0000","last_clean":"2024-09-21T06:03:57.427461+0000","last_became_active":"2024-09-21T06:03:56.448820+0000","last_became_peered":"2024-09-21T06:03:56.448820+0000","last_unstale":"2024-09-21T06:03:57.427461+0000","last_undegraded":"2024-09-21T06:03:57.427461+0000","last_fullsized":"2024-09-21T06:03:57.427461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.481108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691597+0000","last_change":"2024-09-21T06:03:56.460943+0000","last_active":"2024-09-21T06:03:57.691597+0000","last_peered":"2024-09-21T06:03:57.691597+0000","last_clean":"2024-09-21T06:03:57.691597+0000","last_became_active":"2024-09-21T06:03:56.460670+0000","last_became_peered":"2024-09-21T06:03:56.460670+0000","last_unstale":"2024-09-21T06:03:57.691597+0000","last_undegraded":"2024-09-21T06:03:57.691597+0000","last_fullsized":"2024-09-21T06:03:57.691597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:12.691864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692240+0000","last_change":"2024-09-21T06:03:56.457591+0000","last_active":"2024-09-21T06:03:57.692240+0000","last_peered":"2024-09-21T06:03:57.692240+0000","last_clean":"2024-09-21T06:03:57.692240+0000","last_became_active":"2024-09-21T06:03:56.456896+0000","last_became_peered":"2024-09-21T06:03:56.456896+0000","last_unstale":"2024-09-21T06:03:57.692240+0000","last_undegraded":"2024-09-21T06:03:57.692240+0000","last_fullsized":"2024-09-21T06:03:57.692240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:34.214902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693012+0000","last_change":"2024-09-21T06:03:56.456857+0000","last_active":"2024-09-21T06:03:57.693012+0000","last_peered":"2024-09-21T06:03:57.693012+0000","last_clean":"2024-09-21T06:03:57.693012+0000","last_became_active":"2024-09-21T06:03:56.456586+0000","last_became_peered":"2024-09-21T06:03:56.456586+0000","last_unstale":"2024-09-21T06:03:57.693012+0000","last_undegraded":"2024-09-21T06:03:57.693012+0000","last_fullsized":"2024-09-21T06:03:57.693012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:11.249451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027408+0000","last_change":"2024-09-21T06:03:56.454728+0000","last_active":"2024-09-21T06:03:58.027408+0000","last_peered":"2024-09-21T06:03:58.027408+0000","last_clean":"2024-09-21T06:03:58.027408+0000","last_became_active":"2024-09-21T06:03:56.449234+0000","last_became_peered":"2024-09-21T06:03:56.449234+0000","last_unstale":"2024-09-21T06:03:58.027408+0000","last_undegraded":"2024-09-21T06:03:58.027408+0000","last_fullsized":"2024-09-21T06:03:58.027408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:36.324424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428253+0000","last_change":"2024-09-21T06:03:56.447603+0000","last_active":"2024-09-21T06:03:57.428253+0000","last_peered":"2024-09-21T06:03:57.428253+0000","last_clean":"2024-09-21T06:03:57.428253+0000","last_became_active":"2024-09-21T06:03:56.445542+0000","last_became_peered":"2024-09-21T06:03:56.445542+0000","last_unstale":"2024-09-21T06:03:57.428253+0000","last_undegraded":"2024-09-21T06:03:57.428253+0000","last_fullsized":"2024-09-21T06:03:57.428253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:14.197545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571130+0000","last_change":"2024-09-21T06:03:56.447157+0000","last_active":"2024-09-21T06:03:57.571130+0000","last_peered":"2024-09-21T06:03:57.571130+0000","last_clean":"2024-09-21T06:03:57.571130+0000","last_became_active":"2024-09-21T06:03:56.446899+0000","last_became_peered":"2024-09-21T06:03:56.446899+0000","last_unstale":"2024-09-21T06:03:57.571130+0000","last_undegraded":"2024-09-21T06:03:57.571130+0000","last_fullsized":"2024-09-21T06:03:57.571130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:21.929659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432008+0000","last_change":"2024-09-21T06:03:56.451274+0000","last_active":"2024-09-21T06:03:57.432008+0000","last_peered":"2024-09-21T06:03:57.432008+0000","last_clean":"2024-09-21T06:03:57.432008+0000","last_became_active":"2024-09-21T06:03:56.451026+0000","last_became_peered":"2024-09-21T06:03:56.451026+0000","last_unstale":"2024-09-21T06:03:57.432008+0000","last_undegraded":"2024-09-21T06:03:57.432008+0000","last_fullsized":"2024-09-21T06:03:57.432008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:11.805171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571094+0000","last_change":"2024-09-21T06:03:56.464377+0000","last_active":"2024-09-21T06:03:57.571094+0000","last_peered":"2024-09-21T06:03:57.571094+0000","last_clean":"2024-09-21T06:03:57.571094+0000","last_became_active":"2024-09-21T06:03:56.460141+0000","last_became_peered":"2024-09-21T06:03:56.460141+0000","last_unstale":"2024-09-21T06:03:57.571094+0000","last_undegraded":"2024-09-21T06:03:57.571094+0000","last_fullsized":"2024-09-21T06:03:57.571094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:56.645338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570565+0000","last_change":"2024-09-21T06:03:56.466078+0000","last_active":"2024-09-21T06:03:57.570565+0000","last_peered":"2024-09-21T06:03:57.570565+0000","last_clean":"2024-09-21T06:03:57.570565+0000","last_became_active":"2024-09-21T06:03:56.464162+0000","last_became_peered":"2024-09-21T06:03:56.464162+0000","last_unstale":"2024-09-21T06:03:57.570565+0000","last_undegraded":"2024-09-21T06:03:57.570565+0000","last_fullsized":"2024-09-21T06:03:57.570565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:07.386202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430970+0000","last_change":"2024-09-21T06:03:56.443916+0000","last_active":"2024-09-21T06:03:57.430970+0000","last_peered":"2024-09-21T06:03:57.430970+0000","last_clean":"2024-09-21T06:03:57.430970+0000","last_became_active":"2024-09-21T06:03:56.443657+0000","last_became_peered":"2024-09-21T06:03:56.443657+0000","last_unstale":"2024-09-21T06:03:57.430970+0000","last_undegraded":"2024-09-21T06:03:57.430970+0000","last_fullsized":"2024-09-21T06:03:57.430970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:32.402546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692175+0000","last_change":"2024-09-21T06:03:56.434639+0000","last_active":"2024-09-21T06:03:57.692175+0000","last_peered":"2024-09-21T06:03:57.692175+0000","last_clean":"2024-09-21T06:03:57.692175+0000","last_became_active":"2024-09-21T06:03:56.432602+0000","last_became_peered":"2024-09-21T06:03:56.432602+0000","last_unstale":"2024-09-21T06:03:57.692175+0000","last_undegraded":"2024-09-21T06:03:57.692175+0000","last_fullsized":"2024-09-21T06:03:57.692175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:04.651473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692503+0000","last_change":"2024-09-21T06:03:56.457155+0000","last_active":"2024-09-21T06:03:57.692503+0000","last_peered":"2024-09-21T06:03:57.692503+0000","last_clean":"2024-09-21T06:03:57.692503+0000","last_became_active":"2024-09-21T06:03:56.456533+0000","last_became_peered":"2024-09-21T06:03:56.456533+0000","last_unstale":"2024-09-21T06:03:57.692503+0000","last_undegraded":"2024-09-21T06:03:57.692503+0000","last_fullsized":"2024-09-21T06:03:57.692503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:42.680780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571470+0000","last_change":"2024-09-21T06:03:56.443324+0000","last_active":"2024-09-21T06:03:57.571470+0000","last_peered":"2024-09-21T06:03:57.571470+0000","last_clean":"2024-09-21T06:03:57.571470+0000","last_became_active":"2024-09-21T06:03:56.442687+0000","last_became_peered":"2024-09-21T06:03:56.442687+0000","last_unstale":"2024-09-21T06:03:57.571470+0000","last_undegraded":"2024-09-21T06:03:57.571470+0000","last_fullsized":"2024-09-21T06:03:57.571470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:14.217033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570979+0000","last_change":"2024-09-21T06:03:56.465305+0000","last_active":"2024-09-21T06:03:57.570979+0000","last_peered":"2024-09-21T06:03:57.570979+0000","last_clean":"2024-09-21T06:03:57.570979+0000","last_became_active":"2024-09-21T06:03:56.462815+0000","last_became_peered":"2024-09-21T06:03:56.462815+0000","last_unstale":"2024-09-21T06:03:57.570979+0000","last_undegraded":"2024-09-21T06:03:57.570979+0000","last_fullsized":"2024-09-21T06:03:57.570979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:20.595134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429169+0000","last_change":"2024-09-21T06:03:56.446140+0000","last_active":"2024-09-21T06:03:57.429169+0000","last_peered":"2024-09-21T06:03:57.429169+0000","last_clean":"2024-09-21T06:03:57.429169+0000","last_became_active":"2024-09-21T06:03:56.445168+0000","last_became_peered":"2024-09-21T06:03:56.445168+0000","last_unstale":"2024-09-21T06:03:57.429169+0000","last_undegraded":"2024-09-21T06:03:57.429169+0000","last_fullsized":"2024-09-21T06:03:57.429169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:21.949468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570914+0000","last_change":"2024-09-21T06:03:56.459360+0000","last_active":"2024-09-21T06:03:57.570914+0000","last_peered":"2024-09-21T06:03:57.570914+0000","last_clean":"2024-09-21T06:03:57.570914+0000","last_became_active":"2024-09-21T06:03:56.454061+0000","last_became_peered":"2024-09-21T06:03:56.454061+0000","last_unstale":"2024-09-21T06:03:57.570914+0000","last_undegraded":"2024-09-21T06:03:57.570914+0000","last_fullsized":"2024-09-21T06:03:57.570914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:17.873003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428166+0000","last_change":"2024-09-21T06:03:56.446835+0000","last_active":"2024-09-21T06:03:57.428166+0000","last_peered":"2024-09-21T06:03:57.428166+0000","last_clean":"2024-09-21T06:03:57.428166+0000","last_became_active":"2024-09-21T06:03:56.443977+0000","last_became_peered":"2024-09-21T06:03:56.443977+0000","last_unstale":"2024-09-21T06:03:57.428166+0000","last_undegraded":"2024-09-21T06:03:57.428166+0000","last_fullsized":"2024-09-21T06:03:57.428166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:56.640180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693255+0000","last_change":"2024-09-21T06:03:56.444059+0000","last_active":"2024-09-21T06:03:57.693255+0000","last_peered":"2024-09-21T06:03:57.693255+0000","last_clean":"2024-09-21T06:03:57.693255+0000","last_became_active":"2024-09-21T06:03:56.443559+0000","last_became_peered":"2024-09-21T06:03:56.443559+0000","last_unstale":"2024-09-21T06:03:57.693255+0000","last_undegraded":"2024-09-21T06:03:57.693255+0000","last_fullsized":"2024-09-21T06:03:57.693255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:56.781422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431122+0000","last_change":"2024-09-21T06:03:56.437143+0000","last_active":"2024-09-21T06:03:57.431122+0000","last_peered":"2024-09-21T06:03:57.431122+0000","last_clean":"2024-09-21T06:03:57.431122+0000","last_became_active":"2024-09-21T06:03:56.436876+0000","last_became_peered":"2024-09-21T06:03:56.436876+0000","last_unstale":"2024-09-21T06:03:57.431122+0000","last_undegraded":"2024-09-21T06:03:57.431122+0000","last_fullsized":"2024-09-21T06:03:57.431122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:10.953250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429282+0000","last_change":"2024-09-21T06:03:56.445860+0000","last_active":"2024-09-21T06:03:57.429282+0000","last_peered":"2024-09-21T06:03:57.429282+0000","last_clean":"2024-09-21T06:03:57.429282+0000","last_became_active":"2024-09-21T06:03:56.444840+0000","last_became_peered":"2024-09-21T06:03:56.444840+0000","last_unstale":"2024-09-21T06:03:57.429282+0000","last_undegraded":"2024-09-21T06:03:57.429282+0000","last_fullsized":"2024-09-21T06:03:57.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:15.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571424+0000","last_change":"2024-09-21T06:03:56.440512+0000","last_active":"2024-09-21T06:03:57.571424+0000","last_peered":"2024-09-21T06:03:57.571424+0000","last_clean":"2024-09-21T06:03:57.571424+0000","last_became_active":"2024-09-21T06:03:56.440184+0000","last_became_peered":"2024-09-21T06:03:56.440184+0000","last_unstale":"2024-09-21T06:03:57.571424+0000","last_undegraded":"2024-09-21T06:03:57.571424+0000","last_fullsized":"2024-09-21T06:03:57.571424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:37.096730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570758+0000","last_change":"2024-09-21T06:03:56.454324+0000","last_active":"2024-09-21T06:03:57.570758+0000","last_peered":"2024-09-21T06:03:57.570758+0000","last_clean":"2024-09-21T06:03:57.570758+0000","last_became_active":"2024-09-21T06:03:56.452517+0000","last_became_peered":"2024-09-21T06:03:56.452517+0000","last_unstale":"2024-09-21T06:03:57.570758+0000","last_undegraded":"2024-09-21T06:03:57.570758+0000","last_fullsized":"2024-09-21T06:03:57.570758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:46.960104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431260+0000","last_change":"2024-09-21T06:03:56.451719+0000","last_active":"2024-09-21T06:03:57.431260+0000","last_peered":"2024-09-21T06:03:57.431260+0000","last_clean":"2024-09-21T06:03:57.431260+0000","last_became_active":"2024-09-21T06:03:56.451322+0000","last_became_peered":"2024-09-21T06:03:56.451322+0000","last_unstale":"2024-09-21T06:03:57.431260+0000","last_undegraded":"2024-09-21T06:03:57.431260+0000","last_fullsized":"2024-09-21T06:03:57.431260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:51.600701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692712+0000","last_change":"2024-09-21T06:03:56.444250+0000","last_active":"2024-09-21T06:03:57.692712+0000","last_peered":"2024-09-21T06:03:57.692712+0000","last_clean":"2024-09-21T06:03:57.692712+0000","last_became_active":"2024-09-21T06:03:56.443994+0000","last_became_peered":"2024-09-21T06:03:56.443994+0000","last_unstale":"2024-09-21T06:03:57.692712+0000","last_undegraded":"2024-09-21T06:03:57.692712+0000","last_fullsized":"2024-09-21T06:03:57.692712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:37.243068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027410+0000","last_change":"2024-09-21T06:03:56.455067+0000","last_active":"2024-09-21T06:03:58.027410+0000","last_peered":"2024-09-21T06:03:58.027410+0000","last_clean":"2024-09-21T06:03:58.027410+0000","last_became_active":"2024-09-21T06:03:56.454652+0000","last_became_peered":"2024-09-21T06:03:56.454652+0000","last_unstale":"2024-09-21T06:03:58.027410+0000","last_undegraded":"2024-09-21T06:03:58.027410+0000","last_fullsized":"2024-09-21T06:03:58.027410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429070+0000","last_change":"2024-09-21T06:03:55.428741+0000","last_active":"2024-09-21T06:03:57.429070+0000","last_peered":"2024-09-21T06:03:57.429070+0000","last_clean":"2024-09-21T06:03:57.429070+0000","last_became_active":"2024-09-21T06:03:55.428445+0000","last_became_peered":"2024-09-21T06:03:55.428445+0000","last_unstale":"2024-09-21T06:03:57.429070+0000","last_undegraded":"2024-09-21T06:03:57.429070+0000","last_fullsized":"2024-09-21T06:03:57.429070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:05.972426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571364+0000","last_change":"2024-09-21T06:03:56.451202+0000","last_active":"2024-09-21T06:03:57.571364+0000","last_peered":"2024-09-21T06:03:57.571364+0000","last_clean":"2024-09-21T06:03:57.571364+0000","last_became_active":"2024-09-21T06:03:56.450849+0000","last_became_peered":"2024-09-21T06:03:56.450849+0000","last_unstale":"2024-09-21T06:03:57.571364+0000","last_undegraded":"2024-09-21T06:03:57.571364+0000","last_fullsized":"2024-09-21T06:03:57.571364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:26.599500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692515+0000","last_change":"2024-09-21T06:03:55.441570+0000","last_active":"2024-09-21T06:03:57.692515+0000","last_peered":"2024-09-21T06:03:57.692515+0000","last_clean":"2024-09-21T06:03:57.692515+0000","last_became_active":"2024-09-21T06:03:55.439655+0000","last_became_peered":"2024-09-21T06:03:55.439655+0000","last_unstale":"2024-09-21T06:03:57.692515+0000","last_undegraded":"2024-09-21T06:03:57.692515+0000","last_fullsized":"2024-09-21T06:03:57.692515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429197+0000","last_change":"2024-09-21T06:03:55.440025+0000","last_active":"2024-09-21T06:03:57.429197+0000","last_peered":"2024-09-21T06:03:57.429197+0000","last_clean":"2024-09-21T06:03:57.429197+0000","last_became_active":"2024-09-21T06:03:55.439756+0000","last_became_peered":"2024-09-21T06:03:55.439756+0000","last_unstale":"2024-09-21T06:03:57.429197+0000","last_undegraded":"2024-09-21T06:03:57.429197+0000","last_fullsized":"2024-09-21T06:03:57.429197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:47.917575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429016+0000","last_change":"2024-09-21T06:03:56.445658+0000","last_active":"2024-09-21T06:03:57.429016+0000","last_peered":"2024-09-21T06:03:57.429016+0000","last_clean":"2024-09-21T06:03:57.429016+0000","last_became_active":"2024-09-21T06:03:56.443258+0000","last_became_peered":"2024-09-21T06:03:56.443258+0000","last_unstale":"2024-09-21T06:03:57.429016+0000","last_undegraded":"2024-09-21T06:03:57.429016+0000","last_fullsized":"2024-09-21T06:03:57.429016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:20.336729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571029+0000","last_change":"2024-09-21T06:03:55.443370+0000","last_active":"2024-09-21T06:03:57.571029+0000","last_peered":"2024-09-21T06:03:57.571029+0000","last_clean":"2024-09-21T06:03:57.571029+0000","last_became_active":"2024-09-21T06:03:55.443031+0000","last_became_peered":"2024-09-21T06:03:55.443031+0000","last_unstale":"2024-09-21T06:03:57.571029+0000","last_undegraded":"2024-09-21T06:03:57.571029+0000","last_fullsized":"2024-09-21T06:03:57.571029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:07.343031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430722+0000","last_change":"2024-09-21T06:03:56.445492+0000","last_active":"2024-09-21T06:03:57.430722+0000","last_peered":"2024-09-21T06:03:57.430722+0000","last_clean":"2024-09-21T06:03:57.430722+0000","last_became_active":"2024-09-21T06:03:56.444784+0000","last_became_peered":"2024-09-21T06:03:56.444784+0000","last_unstale":"2024-09-21T06:03:57.430722+0000","last_undegraded":"2024-09-21T06:03:57.430722+0000","last_fullsized":"2024-09-21T06:03:57.430722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:00.134737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693497+0000","last_change":"2024-09-21T06:03:55.443534+0000","last_active":"2024-09-21T06:03:57.693497+0000","last_peered":"2024-09-21T06:03:57.693497+0000","last_clean":"2024-09-21T06:03:57.693497+0000","last_became_active":"2024-09-21T06:03:55.443258+0000","last_became_peered":"2024-09-21T06:03:55.443258+0000","last_unstale":"2024-09-21T06:03:57.693497+0000","last_undegraded":"2024-09-21T06:03:57.693497+0000","last_fullsized":"2024-09-21T06:03:57.693497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:45.626155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570802+0000","last_change":"2024-09-21T06:03:56.465786+0000","last_active":"2024-09-21T06:03:57.570802+0000","last_peered":"2024-09-21T06:03:57.570802+0000","last_clean":"2024-09-21T06:03:57.570802+0000","last_became_active":"2024-09-21T06:03:56.463763+0000","last_became_peered":"2024-09-21T06:03:56.463763+0000","last_unstale":"2024-09-21T06:03:57.570802+0000","last_undegraded":"2024-09-21T06:03:57.570802+0000","last_fullsized":"2024-09-21T06:03:57.570802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:31.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571314+0000","last_change":"2024-09-21T06:03:55.446658+0000","last_active":"2024-09-21T06:03:57.571314+0000","last_peered":"2024-09-21T06:03:57.571314+0000","last_clean":"2024-09-21T06:03:57.571314+0000","last_became_active":"2024-09-21T06:03:55.445408+0000","last_became_peered":"2024-09-21T06:03:55.445408+0000","last_unstale":"2024-09-21T06:03:57.571314+0000","last_undegraded":"2024-09-21T06:03:57.571314+0000","last_fullsized":"2024-09-21T06:03:57.571314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:37.191794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571700+0000","last_change":"2024-09-21T06:03:56.455772+0000","last_active":"2024-09-21T06:03:57.571700+0000","last_peered":"2024-09-21T06:03:57.571700+0000","last_clean":"2024-09-21T06:03:57.571700+0000","last_became_active":"2024-09-21T06:03:56.455305+0000","last_became_peered":"2024-09-21T06:03:56.455305+0000","last_unstale":"2024-09-21T06:03:57.571700+0000","last_undegraded":"2024-09-21T06:03:57.571700+0000","last_fullsized":"2024-09-21T06:03:57.571700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:14.217724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430824+0000","last_change":"2024-09-21T06:03:55.444884+0000","last_active":"2024-09-21T06:03:57.430824+0000","last_peered":"2024-09-21T06:03:57.430824+0000","last_clean":"2024-09-21T06:03:57.430824+0000","last_became_active":"2024-09-21T06:03:55.444597+0000","last_became_peered":"2024-09-21T06:03:55.444597+0000","last_unstale":"2024-09-21T06:03:57.430824+0000","last_undegraded":"2024-09-21T06:03:57.430824+0000","last_fullsized":"2024-09-21T06:03:57.430824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:18.685851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.026989+0000","last_change":"2024-09-21T06:03:56.441599+0000","last_active":"2024-09-21T06:03:58.026989+0000","last_peered":"2024-09-21T06:03:58.026989+0000","last_clean":"2024-09-21T06:03:58.026989+0000","last_became_active":"2024-09-21T06:03:56.441290+0000","last_became_peered":"2024-09-21T06:03:56.441290+0000","last_unstale":"2024-09-21T06:03:58.026989+0000","last_undegraded":"2024-09-21T06:03:58.026989+0000","last_fullsized":"2024-09-21T06:03:58.026989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:07.953606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692871+0000","last_change":"2024-09-21T06:03:55.440241+0000","last_active":"2024-09-21T06:03:57.692871+0000","last_peered":"2024-09-21T06:03:57.692871+0000","last_clean":"2024-09-21T06:03:57.692871+0000","last_became_active":"2024-09-21T06:03:55.436212+0000","last_became_peered":"2024-09-21T06:03:55.436212+0000","last_unstale":"2024-09-21T06:03:57.692871+0000","last_undegraded":"2024-09-21T06:03:57.692871+0000","last_fullsized":"2024-09-21T06:03:57.692871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.627418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691579+0000","last_change":"2024-09-21T06:03:56.431047+0000","last_active":"2024-09-21T06:03:57.691579+0000","last_peered":"2024-09-21T06:03:57.691579+0000","last_clean":"2024-09-21T06:03:57.691579+0000","last_became_active":"2024-09-21T06:03:56.430746+0000","last_became_peered":"2024-09-21T06:03:56.430746+0000","last_unstale":"2024-09-21T06:03:57.691579+0000","last_undegraded":"2024-09-21T06:03:57.691579+0000","last_fullsized":"2024-09-21T06:03:57.691579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.405861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571330+0000","last_change":"2024-09-21T06:03:55.443000+0000","last_active":"2024-09-21T06:03:57.571330+0000","last_peered":"2024-09-21T06:03:57.571330+0000","last_clean":"2024-09-21T06:03:57.571330+0000","last_became_active":"2024-09-21T06:03:55.442415+0000","last_became_peered":"2024-09-21T06:03:55.442415+0000","last_unstale":"2024-09-21T06:03:57.571330+0000","last_undegraded":"2024-09-21T06:03:57.571330+0000","last_fullsized":"2024-09-21T06:03:57.571330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:36.859832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572227+0000","last_change":"2024-09-21T06:03:56.443035+0000","last_active":"2024-09-21T06:03:57.572227+0000","last_peered":"2024-09-21T06:03:57.572227+0000","last_clean":"2024-09-21T06:03:57.572227+0000","last_became_active":"2024-09-21T06:03:56.441291+0000","last_became_peered":"2024-09-21T06:03:56.441291+0000","last_unstale":"2024-09-21T06:03:57.572227+0000","last_undegraded":"2024-09-21T06:03:57.572227+0000","last_fullsized":"2024-09-21T06:03:57.572227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:06.406548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571792+0000","last_change":"2024-09-21T06:03:55.445677+0000","last_active":"2024-09-21T06:03:57.571792+0000","last_peered":"2024-09-21T06:03:57.571792+0000","last_clean":"2024-09-21T06:03:57.571792+0000","last_became_active":"2024-09-21T06:03:55.444586+0000","last_became_peered":"2024-09-21T06:03:55.444586+0000","last_unstale":"2024-09-21T06:03:57.571792+0000","last_undegraded":"2024-09-21T06:03:57.571792+0000","last_fullsized":"2024-09-21T06:03:57.571792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.379145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692475+0000","last_change":"2024-09-21T06:03:56.452229+0000","last_active":"2024-09-21T06:03:57.692475+0000","last_peered":"2024-09-21T06:03:57.692475+0000","last_clean":"2024-09-21T06:03:57.692475+0000","last_became_active":"2024-09-21T06:03:56.451579+0000","last_became_peered":"2024-09-21T06:03:56.451579+0000","last_unstale":"2024-09-21T06:03:57.692475+0000","last_undegraded":"2024-09-21T06:03:57.692475+0000","last_fullsized":"2024-09-21T06:03:57.692475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:25.086776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692856+0000","last_change":"2024-09-21T06:03:55.441373+0000","last_active":"2024-09-21T06:03:57.692856+0000","last_peered":"2024-09-21T06:03:57.692856+0000","last_clean":"2024-09-21T06:03:57.692856+0000","last_became_active":"2024-09-21T06:03:55.440162+0000","last_became_peered":"2024-09-21T06:03:55.440162+0000","last_unstale":"2024-09-21T06:03:57.692856+0000","last_undegraded":"2024-09-21T06:03:57.692856+0000","last_fullsized":"2024-09-21T06:03:57.692856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:19.491867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692254+0000","last_change":"2024-09-21T06:03:56.444391+0000","last_active":"2024-09-21T06:03:57.692254+0000","last_peered":"2024-09-21T06:03:57.692254+0000","last_clean":"2024-09-21T06:03:57.692254+0000","last_became_active":"2024-09-21T06:03:56.444025+0000","last_became_peered":"2024-09-21T06:03:56.444025+0000","last_unstale":"2024-09-21T06:03:57.692254+0000","last_undegraded":"2024-09-21T06:03:57.692254+0000","last_fullsized":"2024-09-21T06:03:57.692254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:12.791221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431110+0000","last_change":"2024-09-21T06:03:55.441644+0000","last_active":"2024-09-21T06:03:57.431110+0000","last_peered":"2024-09-21T06:03:57.431110+0000","last_clean":"2024-09-21T06:03:57.431110+0000","last_became_active":"2024-09-21T06:03:55.440433+0000","last_became_peered":"2024-09-21T06:03:55.440433+0000","last_unstale":"2024-09-21T06:03:57.431110+0000","last_undegraded":"2024-09-21T06:03:57.431110+0000","last_fullsized":"2024-09-21T06:03:57.431110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:12.049159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692441+0000","last_change":"2024-09-21T06:03:56.447048+0000","last_active":"2024-09-21T06:03:57.692441+0000","last_peered":"2024-09-21T06:03:57.692441+0000","last_clean":"2024-09-21T06:03:57.692441+0000","last_became_active":"2024-09-21T06:03:56.446772+0000","last_became_peered":"2024-09-21T06:03:56.446772+0000","last_unstale":"2024-09-21T06:03:57.692441+0000","last_undegraded":"2024-09-21T06:03:57.692441+0000","last_fullsized":"2024-09-21T06:03:57.692441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:15.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027332+0000","last_change":"2024-09-21T06:03:55.447010+0000","last_active":"2024-09-21T06:03:58.027332+0000","last_peered":"2024-09-21T06:03:58.027332+0000","last_clean":"2024-09-21T06:03:58.027332+0000","last_became_active":"2024-09-21T06:03:55.446667+0000","last_became_peered":"2024-09-21T06:03:55.446667+0000","last_unstale":"2024-09-21T06:03:58.027332+0000","last_undegraded":"2024-09-21T06:03:58.027332+0000","last_fullsized":"2024-09-21T06:03:58.027332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:22.336856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692706+0000","last_change":"2024-09-21T06:03:56.451848+0000","last_active":"2024-09-21T06:03:57.692706+0000","last_peered":"2024-09-21T06:03:57.692706+0000","last_clean":"2024-09-21T06:03:57.692706+0000","last_became_active":"2024-09-21T06:03:56.451238+0000","last_became_peered":"2024-09-21T06:03:56.451238+0000","last_unstale":"2024-09-21T06:03:57.692706+0000","last_undegraded":"2024-09-21T06:03:57.692706+0000","last_fullsized":"2024-09-21T06:03:57.692706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:55.150988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431545+0000","last_change":"2024-09-21T06:03:55.439453+0000","last_active":"2024-09-21T06:03:57.431545+0000","last_peered":"2024-09-21T06:03:57.431545+0000","last_clean":"2024-09-21T06:03:57.431545+0000","last_became_active":"2024-09-21T06:03:55.439099+0000","last_became_peered":"2024-09-21T06:03:55.439099+0000","last_unstale":"2024-09-21T06:03:57.431545+0000","last_undegraded":"2024-09-21T06:03:57.431545+0000","last_fullsized":"2024-09-21T06:03:57.431545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:33.962342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691929+0000","last_change":"2024-09-21T06:03:56.439335+0000","last_active":"2024-09-21T06:03:57.691929+0000","last_peered":"2024-09-21T06:03:57.691929+0000","last_clean":"2024-09-21T06:03:57.691929+0000","last_became_active":"2024-09-21T06:03:56.439022+0000","last_became_peered":"2024-09-21T06:03:56.439022+0000","last_unstale":"2024-09-21T06:03:57.691929+0000","last_undegraded":"2024-09-21T06:03:57.691929+0000","last_fullsized":"2024-09-21T06:03:57.691929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:06.816584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430748+0000","last_change":"2024-09-21T06:03:55.439612+0000","last_active":"2024-09-21T06:03:57.430748+0000","last_peered":"2024-09-21T06:03:57.430748+0000","last_clean":"2024-09-21T06:03:57.430748+0000","last_became_active":"2024-09-21T06:03:55.439290+0000","last_became_peered":"2024-09-21T06:03:55.439290+0000","last_unstale":"2024-09-21T06:03:57.430748+0000","last_undegraded":"2024-09-21T06:03:57.430748+0000","last_fullsized":"2024-09-21T06:03:57.430748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:52.664481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571145+0000","last_change":"2024-09-21T06:03:56.464441+0000","last_active":"2024-09-21T06:03:57.571145+0000","last_peered":"2024-09-21T06:03:57.571145+0000","last_clean":"2024-09-21T06:03:57.571145+0000","last_became_active":"2024-09-21T06:03:56.461438+0000","last_became_peered":"2024-09-21T06:03:56.461438+0000","last_unstale":"2024-09-21T06:03:57.571145+0000","last_undegraded":"2024-09-21T06:03:57.571145+0000","last_fullsized":"2024-09-21T06:03:57.571145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:12.479477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431105+0000","last_change":"2024-09-21T06:03:55.447015+0000","last_active":"2024-09-21T06:03:57.431105+0000","last_peered":"2024-09-21T06:03:57.431105+0000","last_clean":"2024-09-21T06:03:57.431105+0000","last_became_active":"2024-09-21T06:03:55.446715+0000","last_became_peered":"2024-09-21T06:03:55.446715+0000","last_unstale":"2024-09-21T06:03:57.431105+0000","last_undegraded":"2024-09-21T06:03:57.431105+0000","last_fullsized":"2024-09-21T06:03:57.431105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:19.312399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692668+0000","last_change":"2024-09-21T06:03:56.449362+0000","last_active":"2024-09-21T06:03:57.692668+0000","last_peered":"2024-09-21T06:03:57.692668+0000","last_clean":"2024-09-21T06:03:57.692668+0000","last_became_active":"2024-09-21T06:03:56.449043+0000","last_became_peered":"2024-09-21T06:03:56.449043+0000","last_unstale":"2024-09-21T06:03:57.692668+0000","last_undegraded":"2024-09-21T06:03:57.692668+0000","last_fullsized":"2024-09-21T06:03:57.692668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:32.456389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693159+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:03:57.693159+0000","last_peered":"2024-09-21T06:03:57.693159+0000","last_clean":"2024-09-21T06:03:57.693159+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:03:57.693159+0000","last_undegraded":"2024-09-21T06:03:57.693159+0000","last_fullsized":"2024-09-21T06:03:57.693159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571983+0000","last_change":"2024-09-21T06:03:55.447917+0000","last_active":"2024-09-21T06:03:57.571983+0000","last_peered":"2024-09-21T06:03:57.571983+0000","last_clean":"2024-09-21T06:03:57.571983+0000","last_became_active":"2024-09-21T06:03:55.446149+0000","last_became_peered":"2024-09-21T06:03:55.446149+0000","last_unstale":"2024-09-21T06:03:57.571983+0000","last_undegraded":"2024-09-21T06:03:57.571983+0000","last_fullsized":"2024-09-21T06:03:57.571983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:20.975259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428275+0000","last_change":"2024-09-21T06:03:56.463166+0000","last_active":"2024-09-21T06:03:57.428275+0000","last_peered":"2024-09-21T06:03:57.428275+0000","last_clean":"2024-09-21T06:03:57.428275+0000","last_became_active":"2024-09-21T06:03:56.462743+0000","last_became_peered":"2024-09-21T06:03:56.462743+0000","last_unstale":"2024-09-21T06:03:57.428275+0000","last_undegraded":"2024-09-21T06:03:57.428275+0000","last_fullsized":"2024-09-21T06:03:57.428275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:31.142964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693123+0000","last_change":"2024-09-21T06:03:55.435300+0000","last_active":"2024-09-21T06:03:57.693123+0000","last_peered":"2024-09-21T06:03:57.693123+0000","last_clean":"2024-09-21T06:03:57.693123+0000","last_became_active":"2024-09-21T06:03:55.435036+0000","last_became_peered":"2024-09-21T06:03:55.435036+0000","last_unstale":"2024-09-21T06:03:57.693123+0000","last_undegraded":"2024-09-21T06:03:57.693123+0000","last_fullsized":"2024-09-21T06:03:57.693123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:04.591456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572289+0000","last_change":"2024-09-21T06:03:56.451414+0000","last_active":"2024-09-21T06:03:57.572289+0000","last_peered":"2024-09-21T06:03:57.572289+0000","last_clean":"2024-09-21T06:03:57.572289+0000","last_became_active":"2024-09-21T06:03:56.450889+0000","last_became_peered":"2024-09-21T06:03:56.450889+0000","last_unstale":"2024-09-21T06:03:57.572289+0000","last_undegraded":"2024-09-21T06:03:57.572289+0000","last_fullsized":"2024-09-21T06:03:57.572289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:03.401533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431179+0000","last_change":"2024-09-21T06:03:55.438892+0000","last_active":"2024-09-21T06:03:57.431179+0000","last_peered":"2024-09-21T06:03:57.431179+0000","last_clean":"2024-09-21T06:03:57.431179+0000","last_became_active":"2024-09-21T06:03:55.438536+0000","last_became_peered":"2024-09-21T06:03:55.438536+0000","last_unstale":"2024-09-21T06:03:57.431179+0000","last_undegraded":"2024-09-21T06:03:57.431179+0000","last_fullsized":"2024-09-21T06:03:57.431179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:21.430043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430892+0000","last_change":"2024-09-21T06:03:56.445133+0000","last_active":"2024-09-21T06:03:57.430892+0000","last_peered":"2024-09-21T06:03:57.430892+0000","last_clean":"2024-09-21T06:03:57.430892+0000","last_became_active":"2024-09-21T06:03:56.438602+0000","last_became_peered":"2024-09-21T06:03:56.438602+0000","last_unstale":"2024-09-21T06:03:57.430892+0000","last_undegraded":"2024-09-21T06:03:57.430892+0000","last_fullsized":"2024-09-21T06:03:57.430892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:28.789594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571386+0000","last_change":"2024-09-21T06:03:55.446975+0000","last_active":"2024-09-21T06:03:57.571386+0000","last_peered":"2024-09-21T06:03:57.571386+0000","last_clean":"2024-09-21T06:03:57.571386+0000","last_became_active":"2024-09-21T06:03:55.445827+0000","last_became_peered":"2024-09-21T06:03:55.445827+0000","last_unstale":"2024-09-21T06:03:57.571386+0000","last_undegraded":"2024-09-21T06:03:57.571386+0000","last_fullsized":"2024-09-21T06:03:57.571386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.888141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027398+0000","last_change":"2024-09-21T06:03:56.444147+0000","last_active":"2024-09-21T06:03:58.027398+0000","last_peered":"2024-09-21T06:03:58.027398+0000","last_clean":"2024-09-21T06:03:58.027398+0000","last_became_active":"2024-09-21T06:03:56.443876+0000","last_became_peered":"2024-09-21T06:03:56.443876+0000","last_unstale":"2024-09-21T06:03:58.027398+0000","last_undegraded":"2024-09-21T06:03:58.027398+0000","last_fullsized":"2024-09-21T06:03:58.027398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:08.226479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432211+0000","last_change":"2024-09-21T06:03:55.445091+0000","last_active":"2024-09-21T06:03:57.432211+0000","last_peered":"2024-09-21T06:03:57.432211+0000","last_clean":"2024-09-21T06:03:57.432211+0000","last_became_active":"2024-09-21T06:03:55.444251+0000","last_became_peered":"2024-09-21T06:03:55.444251+0000","last_unstale":"2024-09-21T06:03:57.432211+0000","last_undegraded":"2024-09-21T06:03:57.432211+0000","last_fullsized":"2024-09-21T06:03:57.432211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:22.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571084+0000","last_change":"2024-09-21T06:03:56.454434+0000","last_active":"2024-09-21T06:03:57.571084+0000","last_peered":"2024-09-21T06:03:57.571084+0000","last_clean":"2024-09-21T06:03:57.571084+0000","last_became_active":"2024-09-21T06:03:56.446663+0000","last_became_peered":"2024-09-21T06:03:56.446663+0000","last_unstale":"2024-09-21T06:03:57.571084+0000","last_undegraded":"2024-09-21T06:03:57.571084+0000","last_fullsized":"2024-09-21T06:03:57.571084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:52.560532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693027+0000","last_change":"2024-09-21T06:03:55.447110+0000","last_active":"2024-09-21T06:03:57.693027+0000","last_peered":"2024-09-21T06:03:57.693027+0000","last_clean":"2024-09-21T06:03:57.693027+0000","last_became_active":"2024-09-21T06:03:55.446798+0000","last_became_peered":"2024-09-21T06:03:55.446798+0000","last_unstale":"2024-09-21T06:03:57.693027+0000","last_undegraded":"2024-09-21T06:03:57.693027+0000","last_fullsized":"2024-09-21T06:03:57.693027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:21.152044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.431800+0000","last_change":"2024-09-21T06:03:56.445987+0000","last_active":"2024-09-21T06:03:57.431800+0000","last_peered":"2024-09-21T06:03:57.431800+0000","last_clean":"2024-09-21T06:03:57.431800+0000","last_became_active":"2024-09-21T06:03:56.438083+0000","last_became_peered":"2024-09-21T06:03:56.438083+0000","last_unstale":"2024-09-21T06:03:57.431800+0000","last_undegraded":"2024-09-21T06:03:57.431800+0000","last_fullsized":"2024-09-21T06:03:57.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:27.608201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.434918+0000","last_change":"2024-09-21T06:03:55.443082+0000","last_active":"2024-09-21T06:03:58.434918+0000","last_peered":"2024-09-21T06:03:58.434918+0000","last_clean":"2024-09-21T06:03:58.434918+0000","last_became_active":"2024-09-21T06:03:55.442723+0000","last_became_peered":"2024-09-21T06:03:55.442723+0000","last_unstale":"2024-09-21T06:03:58.434918+0000","last_undegraded":"2024-09-21T06:03:58.434918+0000","last_fullsized":"2024-09-21T06:03:58.434918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:51.896568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428053+0000","last_change":"2024-09-21T06:03:56.431180+0000","last_active":"2024-09-21T06:03:57.428053+0000","last_peered":"2024-09-21T06:03:57.428053+0000","last_clean":"2024-09-21T06:03:57.428053+0000","last_became_active":"2024-09-21T06:03:56.430949+0000","last_became_peered":"2024-09-21T06:03:56.430949+0000","last_unstale":"2024-09-21T06:03:57.428053+0000","last_undegraded":"2024-09-21T06:03:57.428053+0000","last_fullsized":"2024-09-21T06:03:57.428053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:47.246368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692989+0000","last_change":"2024-09-21T06:03:55.438578+0000","last_active":"2024-09-21T06:03:57.692989+0000","last_peered":"2024-09-21T06:03:57.692989+0000","last_clean":"2024-09-21T06:03:57.692989+0000","last_became_active":"2024-09-21T06:03:55.438188+0000","last_became_peered":"2024-09-21T06:03:55.438188+0000","last_unstale":"2024-09-21T06:03:57.692989+0000","last_undegraded":"2024-09-21T06:03:57.692989+0000","last_fullsized":"2024-09-21T06:03:57.692989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:29.047291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571542+0000","last_change":"2024-09-21T06:03:56.447972+0000","last_active":"2024-09-21T06:03:57.571542+0000","last_peered":"2024-09-21T06:03:57.571542+0000","last_clean":"2024-09-21T06:03:57.571542+0000","last_became_active":"2024-09-21T06:03:56.447293+0000","last_became_peered":"2024-09-21T06:03:56.447293+0000","last_unstale":"2024-09-21T06:03:57.571542+0000","last_undegraded":"2024-09-21T06:03:57.571542+0000","last_fullsized":"2024-09-21T06:03:57.571542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:12.728982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.693026+0000","last_change":"2024-09-21T06:03:55.447845+0000","last_active":"2024-09-21T06:03:57.693026+0000","last_peered":"2024-09-21T06:03:57.693026+0000","last_clean":"2024-09-21T06:03:57.693026+0000","last_became_active":"2024-09-21T06:03:55.447506+0000","last_became_peered":"2024-09-21T06:03:55.447506+0000","last_unstale":"2024-09-21T06:03:57.693026+0000","last_undegraded":"2024-09-21T06:03:57.693026+0000","last_fullsized":"2024-09-21T06:03:57.693026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:52.083074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:58.027604+0000","last_change":"2024-09-21T06:03:56.454202+0000","last_active":"2024-09-21T06:03:58.027604+0000","last_peered":"2024-09-21T06:03:58.027604+0000","last_clean":"2024-09-21T06:03:58.027604+0000","last_became_active":"2024-09-21T06:03:56.449314+0000","last_became_peered":"2024-09-21T06:03:56.449314+0000","last_unstale":"2024-09-21T06:03:58.027604+0000","last_undegraded":"2024-09-21T06:03:58.027604+0000","last_fullsized":"2024-09-21T06:03:58.027604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:22.137665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.432116+0000","last_change":"2024-09-21T06:03:55.444591+0000","last_active":"2024-09-21T06:03:57.432116+0000","last_peered":"2024-09-21T06:03:57.432116+0000","last_clean":"2024-09-21T06:03:57.432116+0000","last_became_active":"2024-09-21T06:03:55.443824+0000","last_became_peered":"2024-09-21T06:03:55.443824+0000","last_unstale":"2024-09-21T06:03:57.432116+0000","last_undegraded":"2024-09-21T06:03:57.432116+0000","last_fullsized":"2024-09-21T06:03:57.432116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:56.287832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.428014+0000","last_change":"2024-09-21T06:03:56.440655+0000","last_active":"2024-09-21T06:03:57.428014+0000","last_peered":"2024-09-21T06:03:57.428014+0000","last_clean":"2024-09-21T06:03:57.428014+0000","last_became_active":"2024-09-21T06:03:56.438045+0000","last_became_peered":"2024-09-21T06:03:56.438045+0000","last_unstale":"2024-09-21T06:03:57.428014+0000","last_undegraded":"2024-09-21T06:03:57.428014+0000","last_fullsized":"2024-09-21T06:03:57.428014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:43.265975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.430996+0000","last_change":"2024-09-21T06:03:55.436206+0000","last_active":"2024-09-21T06:03:57.430996+0000","last_peered":"2024-09-21T06:03:57.430996+0000","last_clean":"2024-09-21T06:03:57.430996+0000","last_became_active":"2024-09-21T06:03:55.435520+0000","last_became_peered":"2024-09-21T06:03:55.435520+0000","last_unstale":"2024-09-21T06:03:57.430996+0000","last_undegraded":"2024-09-21T06:03:57.430996+0000","last_fullsized":"2024-09-21T06:03:57.430996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:51.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429387+0000","last_change":"2024-09-21T06:03:56.441695+0000","last_active":"2024-09-21T06:03:57.429387+0000","last_peered":"2024-09-21T06:03:57.429387+0000","last_clean":"2024-09-21T06:03:57.429387+0000","last_became_active":"2024-09-21T06:03:56.441424+0000","last_became_peered":"2024-09-21T06:03:56.441424+0000","last_unstale":"2024-09-21T06:03:57.429387+0000","last_undegraded":"2024-09-21T06:03:57.429387+0000","last_fullsized":"2024-09-21T06:03:57.429387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:23.032354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.691770+0000","last_change":"2024-09-21T06:03:55.432494+0000","last_active":"2024-09-21T06:03:57.691770+0000","last_peered":"2024-09-21T06:03:57.691770+0000","last_clean":"2024-09-21T06:03:57.691770+0000","last_became_active":"2024-09-21T06:03:55.432188+0000","last_became_peered":"2024-09-21T06:03:55.432188+0000","last_unstale":"2024-09-21T06:03:57.691770+0000","last_undegraded":"2024-09-21T06:03:57.691770+0000","last_fullsized":"2024-09-21T06:03:57.691770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:45.607214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692723+0000","last_change":"2024-09-21T06:03:56.453311+0000","last_active":"2024-09-21T06:03:57.692723+0000","last_peered":"2024-09-21T06:03:57.692723+0000","last_clean":"2024-09-21T06:03:57.692723+0000","last_became_active":"2024-09-21T06:03:56.452981+0000","last_became_peered":"2024-09-21T06:03:56.452981+0000","last_unstale":"2024-09-21T06:03:57.692723+0000","last_undegraded":"2024-09-21T06:03:57.692723+0000","last_fullsized":"2024-09-21T06:03:57.692723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:51.310034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.570928+0000","last_change":"2024-09-21T06:03:56.462364+0000","last_active":"2024-09-21T06:03:57.570928+0000","last_peered":"2024-09-21T06:03:57.570928+0000","last_clean":"2024-09-21T06:03:57.570928+0000","last_became_active":"2024-09-21T06:03:56.462055+0000","last_became_peered":"2024-09-21T06:03:56.462055+0000","last_unstale":"2024-09-21T06:03:57.570928+0000","last_undegraded":"2024-09-21T06:03:57.570928+0000","last_fullsized":"2024-09-21T06:03:57.570928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:02.173067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692888+0000","last_change":"2024-09-21T06:03:55.444782+0000","last_active":"2024-09-21T06:03:57.692888+0000","last_peered":"2024-09-21T06:03:57.692888+0000","last_clean":"2024-09-21T06:03:57.692888+0000","last_became_active":"2024-09-21T06:03:55.444479+0000","last_became_peered":"2024-09-21T06:03:55.444479+0000","last_unstale":"2024-09-21T06:03:57.692888+0000","last_undegraded":"2024-09-21T06:03:57.692888+0000","last_fullsized":"2024-09-21T06:03:57.692888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:26.302369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.571593+0000","last_change":"2024-09-21T06:03:56.465626+0000","last_active":"2024-09-21T06:03:57.571593+0000","last_peered":"2024-09-21T06:03:57.571593+0000","last_clean":"2024-09-21T06:03:57.571593+0000","last_became_active":"2024-09-21T06:03:56.464090+0000","last_became_peered":"2024-09-21T06:03:56.464090+0000","last_unstale":"2024-09-21T06:03:57.571593+0000","last_undegraded":"2024-09-21T06:03:57.571593+0000","last_fullsized":"2024-09-21T06:03:57.571593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:07.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.692830+0000","last_change":"2024-09-21T06:03:55.443192+0000","last_active":"2024-09-21T06:03:57.692830+0000","last_peered":"2024-09-21T06:03:57.692830+0000","last_clean":"2024-09-21T06:03:57.692830+0000","last_became_active":"2024-09-21T06:03:55.442119+0000","last_became_peered":"2024-09-21T06:03:55.442119+0000","last_unstale":"2024-09-21T06:03:57.692830+0000","last_undegraded":"2024-09-21T06:03:57.692830+0000","last_fullsized":"2024-09-21T06:03:57.692830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:28.597367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572088+0000","last_change":"2024-09-21T06:03:56.448267+0000","last_active":"2024-09-21T06:03:57.572088+0000","last_peered":"2024-09-21T06:03:57.572088+0000","last_clean":"2024-09-21T06:03:57.572088+0000","last_became_active":"2024-09-21T06:03:56.447661+0000","last_became_peered":"2024-09-21T06:03:56.447661+0000","last_unstale":"2024-09-21T06:03:57.572088+0000","last_undegraded":"2024-09-21T06:03:57.572088+0000","last_fullsized":"2024-09-21T06:03:57.572088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:21.491787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429111+0000","last_change":"2024-09-21T06:03:55.447256+0000","last_active":"2024-09-21T06:03:57.429111+0000","last_peered":"2024-09-21T06:03:57.429111+0000","last_clean":"2024-09-21T06:03:57.429111+0000","last_became_active":"2024-09-21T06:03:55.446690+0000","last_became_peered":"2024-09-21T06:03:55.446690+0000","last_unstale":"2024-09-21T06:03:57.429111+0000","last_undegraded":"2024-09-21T06:03:57.429111+0000","last_fullsized":"2024-09-21T06:03:57.429111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:23.968841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.429064+0000","last_change":"2024-09-21T06:03:56.441427+0000","last_active":"2024-09-21T06:03:57.429064+0000","last_peered":"2024-09-21T06:03:57.429064+0000","last_clean":"2024-09-21T06:03:57.429064+0000","last_became_active":"2024-09-21T06:03:56.441006+0000","last_became_peered":"2024-09-21T06:03:56.441006+0000","last_unstale":"2024-09-21T06:03:57.429064+0000","last_undegraded":"2024-09-21T06:03:57.429064+0000","last_fullsized":"2024-09-21T06:03:57.429064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:55.414503+0000","last_clean_scrub_stamp":"2024-09-21T06:03:55.414503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:22.240365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T06:03:57.572345+0000","last_change":"2024-09-21T06:03:55.444048+0000","last_active":"2024-09-21T06:03:57.572345+0000","last_peered":"2024-09-21T06:03:57.572345+0000","last_clean":"2024-09-21T06:03:57.572345+0000","last_became_active":"2024-09-21T06:03:55.443780+0000","last_became_peered":"2024-09-21T06:03:55.443780+0000","last_unstale":"2024-09-21T06:03:57.572345+0000","last_undegraded":"2024-09-21T06:03:57.572345+0000","last_fullsized":"2024-09-21T06:03:57.572345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:54.407534+0000","last_clean_scrub_stamp":"2024-09-21T06:03:54.407534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:22.074462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:05.653 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:04:05.653 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T06:04:05.653 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T06:04:05.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 -- 172.21.15.118:0/1230213261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab880d1590 msgr2=0x7fab88142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 --2- 172.21.15.118:0/1230213261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab880d1590 0x7fab88142730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fab70005fd0 tx=0x7fab7002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 -- 172.21.15.118:0/1230213261 shutdown_connections 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 --2- 172.21.15.118:0/1230213261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8813fef0 0x7fab88142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 --2- 172.21.15.118:0/1230213261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab880d1590 0x7fab88142730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 -- 172.21.15.118:0/1230213261 >> 172.21.15.118:0/1230213261 conn(0x7fab8806d110 msgr2=0x7fab8806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 -- 172.21.15.118:0/1230213261 shutdown_connections 2024-09-21T06:04:05.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.905+0000 7fab8e800640 1 -- 172.21.15.118:0/1230213261 wait complete. 2024-09-21T06:04:05.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.907+0000 7fab8e800640 1 Processor -- start 2024-09-21T06:04:05.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.908+0000 7fab8e800640 1 -- start start 2024-09-21T06:04:05.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab8e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab8813fae0 0x7fab881419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab8e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8813fef0 0x7fab881f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab8e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab881e9140 0x7fab881f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab8e800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab880cfac0 con 0x7fab8813fae0 2024-09-21T06:04:05.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab8e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab880cf940 con 0x7fab881e9140 2024-09-21T06:04:05.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab8e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab880cfc40 con 0x7fab8813fef0 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab87400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab8813fae0 0x7fab881419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab87400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab8813fae0 0x7fab881419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53786/0 (socket says 172.21.15.118:53786) 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.909+0000 7fab87400640 1 -- 172.21.15.118:0/68815208 learned_addr learned my addr 172.21.15.118:0/68815208 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87e00640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab881e9140 0x7fab881f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab7ea00640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8813fef0 0x7fab881f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87400640 1 -- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8813fef0 msgr2=0x7fab881f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87400640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8813fef0 0x7fab881f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87400640 1 -- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab881e9140 msgr2=0x7fab881f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87400640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab881e9140 0x7fab881f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87400640 1 -- 172.21.15.118:0/68815208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab88141f00 con 0x7fab8813fae0 2024-09-21T06:04:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87e00640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab881e9140 0x7fab881f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:05.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab87400640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab8813fae0 0x7fab881419c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c3d0 tx=0x7fab7800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab7fe00640 1 -- 172.21.15.118:0/68815208 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78017070 con 0x7fab8813fae0 2024-09-21T06:04:05.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab7fe00640 1 -- 172.21.15.118:0/68815208 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab780053c0 con 0x7fab8813fae0 2024-09-21T06:04:05.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab7fe00640 1 -- 172.21.15.118:0/68815208 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78003850 con 0x7fab8813fae0 2024-09-21T06:04:05.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.910+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab88073970 con 0x7fab8813fae0 2024-09-21T06:04:05.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.911+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab880749d0 con 0x7fab8813fae0 2024-09-21T06:04:05.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.912+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab880d00f0 con 0x7fab8813fae0 2024-09-21T06:04:05.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.913+0000 7fab7fe00640 1 -- 172.21.15.118:0/68815208 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab7801a070 con 0x7fab8813fae0 2024-09-21T06:04:05.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.914+0000 7fab7fe00640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab64078bc0 0x7fab6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.914+0000 7fab7fe00640 1 -- 172.21.15.118:0/68815208 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fab78099fe0 con 0x7fab8813fae0 2024-09-21T06:04:05.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.914+0000 7fab7ea00640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab64078bc0 0x7fab6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.915+0000 7fab7ea00640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab64078bc0 0x7fab6407b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab70033000 tx=0x7fab70004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:05.918+0000 7fab7fe00640 1 -- 172.21.15.118:0/68815208 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fab88073970 con 0x7fab8813fae0 2024-09-21T06:04:06.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.142+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fab881542f0 con 0x7fab8813fae0 2024-09-21T06:04:06.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.142+0000 7fab7fe00640 1 -- 172.21.15.118:0/68815208 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fab78061e60 con 0x7fab8813fae0 2024-09-21T06:04:06.145 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:06.145 INFO:teuthology.orchestra.run.smithi118.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab64078bc0 msgr2=0x7fab6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab64078bc0 0x7fab6407b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab70033000 tx=0x7fab70004730 comp rx=0 tx=0).stop 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab8813fae0 msgr2=0x7fab881419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab8813fae0 0x7fab881419c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c3d0 tx=0x7fab7800c890 comp rx=0 tx=0).stop 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 shutdown_connections 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab881e9140 0x7fab881f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab64078bc0 0x7fab6407b0d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8813fef0 0x7fab881f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 --2- 172.21.15.118:0/68815208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab8813fae0 0x7fab881419c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 >> 172.21.15.118:0/68815208 conn(0x7fab8806d110 msgr2=0x7fab88153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:06.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 shutdown_connections 2024-09-21T06:04:06.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.144+0000 7fab8e800640 1 -- 172.21.15.118:0/68815208 wait complete. 2024-09-21T06:04:06.171 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T06:04:06.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:06.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.386+0000 7f7847200640 1 -- 172.21.15.118:0/311997334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7848163900 msgr2=0x7f784815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.386+0000 7f7847200640 1 --2- 172.21.15.118:0/311997334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7848163900 0x7f784815f660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7834005fd0 tx=0x7f783402a940 comp rx=0 tx=0).stop 2024-09-21T06:04:06.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.386+0000 7f7847200640 1 -- 172.21.15.118:0/311997334 shutdown_connections 2024-09-21T06:04:06.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.386+0000 7f7847200640 1 --2- 172.21.15.118:0/311997334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7848163900 0x7f784815f660 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.386+0000 7f7847200640 1 -- 172.21.15.118:0/311997334 >> 172.21.15.118:0/311997334 conn(0x7f784806d1c0 msgr2=0x7f784806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:06.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.387+0000 7f7847200640 1 -- 172.21.15.118:0/311997334 shutdown_connections 2024-09-21T06:04:06.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.387+0000 7f7847200640 1 -- 172.21.15.118:0/311997334 wait complete. 2024-09-21T06:04:06.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.389+0000 7f7847200640 1 Processor -- start 2024-09-21T06:04:06.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.389+0000 7f7847200640 1 -- start start 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.390+0000 7f7847200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784815fba0 0x7f7848155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.390+0000 7f7847200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78481634f0 0x7f7848149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.390+0000 7f7847200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848163900 0x7f78481e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.390+0000 7f7847200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f78480d3cb0 con 0x7f78481634f0 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.390+0000 7f7847200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f78480d3b30 con 0x7f7848163900 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.390+0000 7f7847200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f78480d3e30 con 0x7f784815fba0 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.390+0000 7f7845400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78481634f0 0x7f7848149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78481634f0 0x7f7848149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53810/0 (socket says 172.21.15.118:53810) 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 -- 172.21.15.118:0/2798245896 learned_addr learned my addr 172.21.15.118:0/2798245896 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7846800640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848163900 0x7f78481e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845e00640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784815fba0 0x7f7848155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 -- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784815fba0 msgr2=0x7f7848155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784815fba0 0x7f7848155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 -- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848163900 msgr2=0x7f78481e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848163900 0x7f78481e9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 -- 172.21.15.118:0/2798245896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78481eade0 con 0x7f78481634f0 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845e00640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784815fba0 0x7f7848155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7846800640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848163900 0x7f78481e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f7845400640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78481634f0 0x7f7848149050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f783402af30 tx=0x7f7834031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.391+0000 7f783e000640 1 -- 172.21.15.118:0/2798245896 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783403e070 con 0x7f78481634f0 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.392+0000 7f783e000640 1 -- 172.21.15.118:0/2798245896 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7834004540 con 0x7f78481634f0 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.392+0000 7f783e000640 1 -- 172.21.15.118:0/2798245896 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834043460 con 0x7f78481634f0 2024-09-21T06:04:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.392+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78481eb0c0 con 0x7f78481634f0 2024-09-21T06:04:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.392+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7848159e70 con 0x7f78481634f0 2024-09-21T06:04:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.393+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78480d42e0 con 0x7f78481634f0 2024-09-21T06:04:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.394+0000 7f783e000640 1 -- 172.21.15.118:0/2798245896 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7834043600 con 0x7f78481634f0 2024-09-21T06:04:06.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.395+0000 7f783e000640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.395+0000 7f783e000640 1 -- 172.21.15.118:0/2798245896 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f78340bc5f0 con 0x7f78481634f0 2024-09-21T06:04:06.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.395+0000 7f7845e00640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.396+0000 7f7845e00640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:06.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.399+0000 7f783e000640 1 -- 172.21.15.118:0/2798245896 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f783404a030 con 0x7f78481634f0 2024-09-21T06:04:06.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.626+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78481eab70 con 0x7f78481634f0 2024-09-21T06:04:06.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.627+0000 7f783e000640 1 -- 172.21.15.118:0/2798245896 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f7834084990 con 0x7f78481634f0 2024-09-21T06:04:06.630 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:06.630 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:04:06.630 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:04:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 msgr2=0x7f782807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).stop 2024-09-21T06:04:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78481634f0 msgr2=0x7f7848149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78481634f0 0x7f7848149050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f783402af30 tx=0x7f7834031e20 comp rx=0 tx=0).stop 2024-09-21T06:04:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 shutdown_connections 2024-09-21T06:04:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848163900 0x7f78481e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78481634f0 0x7f7848149050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 --2- 172.21.15.118:0/2798245896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784815fba0 0x7f7848155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 >> 172.21.15.118:0/2798245896 conn(0x7f784806d1c0 msgr2=0x7f7848158310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 shutdown_connections 2024-09-21T06:04:06.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.629+0000 7f7847200640 1 -- 172.21.15.118:0/2798245896 wait complete. 2024-09-21T06:04:06.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:06.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.873+0000 7f7d54a00640 1 -- 172.21.15.118:0/2452253504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d5013fae0 msgr2=0x7f7d500d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.873+0000 7f7d54a00640 1 --2- 172.21.15.118:0/2452253504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d5013fae0 0x7f7d500d0e80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d40005fd0 tx=0x7f7d4002aa90 comp rx=0 tx=0).stop 2024-09-21T06:04:06.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.873+0000 7f7d54a00640 1 -- 172.21.15.118:0/2452253504 shutdown_connections 2024-09-21T06:04:06.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.873+0000 7f7d54a00640 1 --2- 172.21.15.118:0/2452253504 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d5013fef0 0x7f7d500d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.873+0000 7f7d54a00640 1 --2- 172.21.15.118:0/2452253504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d5013fae0 0x7f7d500d0e80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.873+0000 7f7d54a00640 1 -- 172.21.15.118:0/2452253504 >> 172.21.15.118:0/2452253504 conn(0x7f7d5006d110 msgr2=0x7f7d5006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:06.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.874+0000 7f7d54a00640 1 -- 172.21.15.118:0/2452253504 shutdown_connections 2024-09-21T06:04:06.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.874+0000 7f7d54a00640 1 -- 172.21.15.118:0/2452253504 wait complete. 2024-09-21T06:04:06.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.876+0000 7f7d54a00640 1 Processor -- start 2024-09-21T06:04:06.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.876+0000 7f7d54a00640 1 -- start start 2024-09-21T06:04:06.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.877+0000 7f7d54a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d5013fae0 0x7f7d501f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.877+0000 7f7d54a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d5013fef0 0x7f7d500b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d54a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d50142730 0x7f7d500b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d54a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500cfb00 con 0x7f7d50142730 2024-09-21T06:04:06.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d54a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500cf980 con 0x7f7d5013fef0 2024-09-21T06:04:06.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d54a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d500cfc80 con 0x7f7d5013fae0 2024-09-21T06:04:06.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d50142730 0x7f7d500b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d50142730 0x7f7d500b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53836/0 (socket says 172.21.15.118:53836) 2024-09-21T06:04:06.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 -- 172.21.15.118:0/3612412522 learned_addr learned my addr 172.21.15.118:0/3612412522 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:06.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4de00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d5013fae0 0x7f7d501f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d45400640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d5013fef0 0x7f7d500b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 -- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d5013fae0 msgr2=0x7f7d501f9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d5013fae0 0x7f7d501f9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 -- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d5013fef0 msgr2=0x7f7d500b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d5013fef0 0x7f7d500b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 -- 172.21.15.118:0/3612412522 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d50142010 con 0x7f7d50142730 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d45400640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d5013fef0 0x7f7d500b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.878+0000 7f7d4e800640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d50142730 0x7f7d500b4ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800c390 tx=0x7f7d4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.879+0000 7f7d46a00640 1 -- 172.21.15.118:0/3612412522 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48017070 con 0x7f7d50142730 2024-09-21T06:04:06.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.879+0000 7f7d46a00640 1 -- 172.21.15.118:0/3612412522 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d480035f0 con 0x7f7d50142730 2024-09-21T06:04:06.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.879+0000 7f7d46a00640 1 -- 172.21.15.118:0/3612412522 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48003a40 con 0x7f7d50142730 2024-09-21T06:04:06.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.879+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d501422f0 con 0x7f7d50142730 2024-09-21T06:04:06.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.879+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d50156aa0 con 0x7f7d50142730 2024-09-21T06:04:06.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.880+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d500d01c0 con 0x7f7d50142730 2024-09-21T06:04:06.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.882+0000 7f7d46a00640 1 -- 172.21.15.118:0/3612412522 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d4801a070 con 0x7f7d50142730 2024-09-21T06:04:06.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.883+0000 7f7d46a00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d2c078bc0 0x7f7d2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:06.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.883+0000 7f7d46a00640 1 -- 172.21.15.118:0/3612412522 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7d48099d00 con 0x7f7d50142730 2024-09-21T06:04:06.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.884+0000 7f7d4de00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d2c078bc0 0x7f7d2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:06.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.884+0000 7f7d4de00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d2c078bc0 0x7f7d2c07b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d40035000 tx=0x7f7d40038040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:06.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:06.888+0000 7f7d46a00640 1 -- 172.21.15.118:0/3612412522 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d48061c10 con 0x7f7d50142730 2024-09-21T06:04:07.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.108+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d50142c70 con 0x7f7d50142730 2024-09-21T06:04:07.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.109+0000 7f7d46a00640 1 -- 172.21.15.118:0/3612412522 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f7d48066640 con 0x7f7d50142730 2024-09-21T06:04:07.111 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:07.111 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:04:07.112 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d2c078bc0 msgr2=0x7f7d2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d2c078bc0 0x7f7d2c07b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d40035000 tx=0x7f7d40038040 comp rx=0 tx=0).stop 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d50142730 msgr2=0x7f7d500b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d50142730 0x7f7d500b4ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800c390 tx=0x7f7d4800c850 comp rx=0 tx=0).stop 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 shutdown_connections 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d50142730 0x7f7d500b4ff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d5013fef0 0x7f7d500b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d2c078bc0 0x7f7d2c07b0d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 --2- 172.21.15.118:0/3612412522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d5013fae0 0x7f7d501f9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 >> 172.21.15.118:0/3612412522 conn(0x7f7d5006d110 msgr2=0x7f7d501609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 shutdown_connections 2024-09-21T06:04:07.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.111+0000 7f7d54a00640 1 -- 172.21.15.118:0/3612412522 wait complete. 2024-09-21T06:04:07.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:07.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.358+0000 7fb687a00640 1 -- 172.21.15.118:0/3962883112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68013fe10 msgr2=0x7fb6800d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.358+0000 7fb687a00640 1 --2- 172.21.15.118:0/3962883112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68013fe10 0x7fb6800d0ec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb670009860 tx=0x7fb67002a530 comp rx=0 tx=0).stop 2024-09-21T06:04:07.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.358+0000 7fb687a00640 1 -- 172.21.15.118:0/3962883112 shutdown_connections 2024-09-21T06:04:07.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.358+0000 7fb687a00640 1 --2- 172.21.15.118:0/3962883112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb68013fe10 0x7fb6800d0ec0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.358+0000 7fb687a00640 1 -- 172.21.15.118:0/3962883112 >> 172.21.15.118:0/3962883112 conn(0x7fb68006d110 msgr2=0x7fb68006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.358+0000 7fb687a00640 1 -- 172.21.15.118:0/3962883112 shutdown_connections 2024-09-21T06:04:07.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.358+0000 7fb687a00640 1 -- 172.21.15.118:0/3962883112 wait complete. 2024-09-21T06:04:07.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.360+0000 7fb687a00640 1 Processor -- start 2024-09-21T06:04:07.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.360+0000 7fb687a00640 1 -- start start 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb687a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6800d1400 0x7fb6801573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb687a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb68013fe10 0x7fb6801f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb687a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb680142dd0 0x7fb68013dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb687a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb6800cfce0 con 0x7fb68013fe10 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb687a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6800cfb60 con 0x7fb6800d1400 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb687a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6800cfe60 con 0x7fb680142dd0 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb677e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb68013fe10 0x7fb6801f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb677e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb68013fe10 0x7fb6801f7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53838/0 (socket says 172.21.15.118:53838) 2024-09-21T06:04:07.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb677e00640 1 -- 172.21.15.118:0/1281515336 learned_addr learned my addr 172.21.15.118:0/1281515336 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:07.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb677e00640 1 -- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb680142dd0 msgr2=0x7fb68013dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb677e00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb680142dd0 0x7fb68013dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.362+0000 7fb677e00640 1 -- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6800d1400 msgr2=0x7fb6801573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb677e00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6800d1400 0x7fb6801573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb677e00640 1 -- 172.21.15.118:0/1281515336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb680143cc0 con 0x7fb68013fe10 2024-09-21T06:04:07.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb677e00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb68013fe10 0x7fb6801f7bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c460 tx=0x7fb66800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb67d600640 1 -- 172.21.15.118:0/1281515336 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6680052d0 con 0x7fb68013fe10 2024-09-21T06:04:07.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb67d600640 1 -- 172.21.15.118:0/1281515336 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb668005490 con 0x7fb68013fe10 2024-09-21T06:04:07.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb680143fa0 con 0x7fb68013fe10 2024-09-21T06:04:07.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb67d600640 1 -- 172.21.15.118:0/1281515336 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668012870 con 0x7fb68013fe10 2024-09-21T06:04:07.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.363+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6801f76d0 con 0x7fb68013fe10 2024-09-21T06:04:07.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.364+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6800d05e0 con 0x7fb68013fe10 2024-09-21T06:04:07.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.365+0000 7fb67d600640 1 -- 172.21.15.118:0/1281515336 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb668012a10 con 0x7fb68013fe10 2024-09-21T06:04:07.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.366+0000 7fb67d600640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb65c078b90 0x7fb65c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.366+0000 7fb67d600640 1 -- 172.21.15.118:0/1281515336 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb66809a8e0 con 0x7fb68013fe10 2024-09-21T06:04:07.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.367+0000 7fb685000640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb65c078b90 0x7fb65c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.367+0000 7fb685000640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb65c078b90 0x7fb65c07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb670034000 tx=0x7fb6700046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.371+0000 7fb67d600640 1 -- 172.21.15.118:0/1281515336 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb6800d05e0 con 0x7fb68013fe10 2024-09-21T06:04:07.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.561+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6800d0380 con 0x7fb68013fe10 2024-09-21T06:04:07.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.562+0000 7fb67d600640 1 -- 172.21.15.118:0/1281515336 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16737 (secure 0 0 0) 0x7fb668062d10 con 0x7fb68013fe10 2024-09-21T06:04:07.565 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:07.565 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:57.424251+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb65c078b90 msgr2=0x7fb65c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb65c078b90 0x7fb65c07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb670034000 tx=0x7fb6700046c0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb68013fe10 msgr2=0x7fb6801f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb68013fe10 0x7fb6801f7bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c460 tx=0x7fb66800c920 comp rx=0 tx=0).stop 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 shutdown_connections 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb65c078b90 0x7fb65c07b0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb680142dd0 0x7fb68013dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb68013fe10 0x7fb6801f7bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 --2- 172.21.15.118:0/1281515336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6800d1400 0x7fb6801573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 >> 172.21.15.118:0/1281515336 conn(0x7fb68006d110 msgr2=0x7fb6801426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 shutdown_connections 2024-09-21T06:04:07.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.565+0000 7fb687a00640 1 -- 172.21.15.118:0/1281515336 wait complete. 2024-09-21T06:04:07.589 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:07.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 -- 172.21.15.118:0/2908915252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fae0 msgr2=0x7fd7740d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 --2- 172.21.15.118:0/2908915252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fae0 0x7fd7740d0e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd764009830 tx=0x7fd76402a510 comp rx=0 tx=0).stop 2024-09-21T06:04:07.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 -- 172.21.15.118:0/2908915252 shutdown_connections 2024-09-21T06:04:07.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 --2- 172.21.15.118:0/2908915252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd774142e40 0x7fd7740d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 --2- 172.21.15.118:0/2908915252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fae0 0x7fd7740d0e80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 -- 172.21.15.118:0/2908915252 >> 172.21.15.118:0/2908915252 conn(0x7fd77406d110 msgr2=0x7fd77406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 -- 172.21.15.118:0/2908915252 shutdown_connections 2024-09-21T06:04:07.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.807+0000 7fd77b800640 1 -- 172.21.15.118:0/2908915252 wait complete. 2024-09-21T06:04:07.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.809+0000 7fd77b800640 1 Processor -- start 2024-09-21T06:04:07.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.810+0000 7fd77b800640 1 -- start start 2024-09-21T06:04:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd77b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77413fae0 0x7fd7741f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd77b800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fef0 0x7fd77413e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd77b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd774142e40 0x7fd774141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd77b800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd7740cfa90 con 0x7fd77413fef0 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd77b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd7740cf910 con 0x7fd77413fae0 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd77b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd7740cfc10 con 0x7fd774142e40 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd76be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fef0 0x7fd77413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd76be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fef0 0x7fd77413e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53866/0 (socket says 172.21.15.118:53866) 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd76be00640 1 -- 172.21.15.118:0/1962473057 learned_addr learned my addr 172.21.15.118:0/1962473057 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd779800640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd774142e40 0x7fd774141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.811+0000 7fd778e00640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77413fae0 0x7fd7741f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd76be00640 1 -- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd774142e40 msgr2=0x7fd774141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd76be00640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd774142e40 0x7fd774141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd76be00640 1 -- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77413fae0 msgr2=0x7fd7741f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd76be00640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77413fae0 0x7fd7741f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd76be00640 1 -- 172.21.15.118:0/1962473057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd774157b80 con 0x7fd77413fef0 2024-09-21T06:04:07.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd778e00640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77413fae0 0x7fd7741f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:07.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd76be00640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fef0 0x7fd77413e030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00c3a0 tx=0x7fd75c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd771600640 1 -- 172.21.15.118:0/1962473057 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c017070 con 0x7fd77413fef0 2024-09-21T06:04:07.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd771600640 1 -- 172.21.15.118:0/1962473057 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd75c0035f0 con 0x7fd77413fef0 2024-09-21T06:04:07.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd771600640 1 -- 172.21.15.118:0/1962473057 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c003a40 con 0x7fd77413fef0 2024-09-21T06:04:07.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd774157df0 con 0x7fd77413fef0 2024-09-21T06:04:07.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.812+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7741583b0 con 0x7fd77413fef0 2024-09-21T06:04:07.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.813+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7740d0150 con 0x7fd77413fef0 2024-09-21T06:04:07.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.815+0000 7fd771600640 1 -- 172.21.15.118:0/1962473057 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd75c01a070 con 0x7fd77413fef0 2024-09-21T06:04:07.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.816+0000 7fd771600640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd750078b90 0x7fd75007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.816+0000 7fd771600640 1 -- 172.21.15.118:0/1962473057 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd75c099fc0 con 0x7fd77413fef0 2024-09-21T06:04:07.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.816+0000 7fd778e00640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd750078b90 0x7fd75007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.817+0000 7fd778e00640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd750078b90 0x7fd75007b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd764034000 tx=0x7fd764004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:07.820+0000 7fd771600640 1 -- 172.21.15.118:0/1962473057 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd75c061d10 con 0x7fd77413fef0 2024-09-21T06:04:08.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.038+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd774154140 con 0x7fd77413fef0 2024-09-21T06:04:08.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.038+0000 7fd771600640 1 -- 172.21.15.118:0/1962473057 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fd75c066740 con 0x7fd77413fef0 2024-09-21T06:04:08.041 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:08.041 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:04:08.041 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:04:08.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd750078b90 msgr2=0x7fd75007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd750078b90 0x7fd75007b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd764034000 tx=0x7fd764004730 comp rx=0 tx=0).stop 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fef0 msgr2=0x7fd77413e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fef0 0x7fd77413e030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00c3a0 tx=0x7fd75c00c860 comp rx=0 tx=0).stop 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 shutdown_connections 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd750078b90 0x7fd75007b0a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd774142e40 0x7fd774141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd77413fef0 0x7fd77413e030 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 --2- 172.21.15.118:0/1962473057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd77413fae0 0x7fd7741f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 >> 172.21.15.118:0/1962473057 conn(0x7fd77406d110 msgr2=0x7fd77413c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 shutdown_connections 2024-09-21T06:04:08.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.041+0000 7fd77b800640 1 -- 172.21.15.118:0/1962473057 wait complete. 2024-09-21T06:04:08.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:03:55.915450+0000', 'modified': '2024-09-21T06:03:58.939146+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4411': {'gid': 4411, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6837/3721420106', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 3721420106}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3721420106}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4411, 'qdb_cluster': [4411]} 2024-09-21T06:04:08.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:04:08.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T06:04:08.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.688+0000 7fbce8e00640 1 -- 172.21.15.118:0/3758668631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce40d1590 msgr2=0x7fbce4142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.688+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3758668631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce40d1590 0x7fbce4142730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009860 tx=0x7fbcd002a5a0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.688+0000 7fbce8e00640 1 -- 172.21.15.118:0/3758668631 shutdown_connections 2024-09-21T06:04:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.688+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3758668631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce40d1590 0x7fbce4142730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.688+0000 7fbce8e00640 1 -- 172.21.15.118:0/3758668631 >> 172.21.15.118:0/3758668631 conn(0x7fbce406d110 msgr2=0x7fbce406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.688+0000 7fbce8e00640 1 -- 172.21.15.118:0/3758668631 shutdown_connections 2024-09-21T06:04:08.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.688+0000 7fbce8e00640 1 -- 172.21.15.118:0/3758668631 wait complete. 2024-09-21T06:04:08.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.690+0000 7fbce8e00640 1 Processor -- start 2024-09-21T06:04:08.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.690+0000 7fbce8e00640 1 -- start start 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.691+0000 7fbce8e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce413fae0 0x7fbce413ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.691+0000 7fbce8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce413fef0 0x7fbce4140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce8e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbce413b350 0x7fbce41408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce8e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41682e0 con 0x7fbce413b350 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce8e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4168160 con 0x7fbce413fef0 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce8e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbce4168460 con 0x7fbce413fae0 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbce413b350 0x7fbce41408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbce413b350 0x7fbce41408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53874/0 (socket says 172.21.15.118:53874) 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 -- 172.21.15.118:0/3520715503 learned_addr learned my addr 172.21.15.118:0/3520715503 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce1400640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce413fef0 0x7fbce4140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce413fae0 0x7fbce413ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 -- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce413fae0 msgr2=0x7fbce413ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce413fae0 0x7fbce413ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 -- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce413fef0 msgr2=0x7fbce4140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce413fef0 0x7fbce4140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce2800640 1 -- 172.21.15.118:0/3520715503 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce4152810 con 0x7fbce413b350 2024-09-21T06:04:08.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.692+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce413fae0 0x7fbce413ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:08.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.693+0000 7fbce2800640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbce413b350 0x7fbce41408b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c760 tx=0x7fbcdc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.693+0000 7fbcda000640 1 -- 172.21.15.118:0/3520715503 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc003b70 con 0x7fbce413b350 2024-09-21T06:04:08.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.693+0000 7fbcda000640 1 -- 172.21.15.118:0/3520715503 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcdc003d10 con 0x7fbce413b350 2024-09-21T06:04:08.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.693+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce4152cc0 con 0x7fbce413b350 2024-09-21T06:04:08.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.693+0000 7fbcda000640 1 -- 172.21.15.118:0/3520715503 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00aab0 con 0x7fbce413b350 2024-09-21T06:04:08.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.693+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce413d3b0 con 0x7fbce413b350 2024-09-21T06:04:08.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.695+0000 7fbcda000640 1 -- 172.21.15.118:0/3520715503 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcdc00ac50 con 0x7fbce413b350 2024-09-21T06:04:08.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.696+0000 7fbcda000640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcc4078bc0 0x7fbcc407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.696+0000 7fbcda000640 1 -- 172.21.15.118:0/3520715503 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbcdc09ab70 con 0x7fbce413b350 2024-09-21T06:04:08.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.697+0000 7fbcefde4740 1 Processor -- start 2024-09-21T06:04:08.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.697+0000 7fbcefde4740 1 -- start start 2024-09-21T06:04:08.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.697+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcc4078bc0 0x7fbcc407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.697+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcc4078bc0 0x7fbcc407b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4001670 tx=0x7fbcd4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b625970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b625eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b234590 0x56237b5f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbcefde4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x56237b57f430 con 0x56237b234590 2024-09-21T06:04:08.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56237b56f5d0 con 0x56237b255270 2024-09-21T06:04:08.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56237b55ea00 con 0x56237b22c3b0 2024-09-21T06:04:08.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbce2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b234590 0x56237b5f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbce2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b234590 0x56237b5f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53880/0 (socket says 172.21.15.118:53880) 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbce2800640 1 -- 172.21.15.118:0/3193694475 learned_addr learned my addr 172.21.15.118:0/3193694475 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbce1400640 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b625eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.698+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b625970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbce2800640 1 -- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 msgr2=0x56237b625eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbce2800640 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b625eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbce2800640 1 -- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 msgr2=0x56237b625970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbce2800640 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b625970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbce2800640 1 -- 172.21.15.118:0/3193694475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237b527520 con 0x56237b234590 2024-09-21T06:04:08.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbce2800640 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b234590 0x56237b5f5f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00a430 tx=0x7fbcdc0627e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b4e4cb775eef4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbccea00640 1 -- 172.21.15.118:0/3193694475 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc063040 con 0x56237b234590 2024-09-21T06:04:08.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbccea00640 1 -- 172.21.15.118:0/3193694475 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcdc062940 con 0x56237b234590 2024-09-21T06:04:08.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.699+0000 7fbccea00640 1 -- 172.21.15.118:0/3193694475 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc067420 con 0x56237b234590 2024-09-21T06:04:08.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 -- 172.21.15.118:0/3193694475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b234590 msgr2=0x56237b5f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b234590 0x56237b5f5f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00a430 tx=0x7fbcdc0627e0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 -- 172.21.15.118:0/3193694475 shutdown_connections 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b234590 0x56237b5f5f60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b625eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3193694475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b625970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 -- 172.21.15.118:0/3193694475 >> 172.21.15.118:0/3193694475 conn(0x56237b2493c0 msgr2=0x56237b5fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 -- 172.21.15.118:0/3193694475 shutdown_connections 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.700+0000 7fbcefde4740 1 -- 172.21.15.118:0/3193694475 wait complete. 2024-09-21T06:04:08.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.701+0000 7fbcefde4740 1 -- start start 2024-09-21T06:04:08.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.701+0000 7fbcefde4740 1 Processor -- start 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b622b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b234590 0x56237b650270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b6507b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbcefde4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x56237b505330 con 0x56237b22c3b0 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56237b562810 con 0x56237b255270 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56237b2cf620 con 0x56237b234590 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbcefde4740 10 client.0 _ll_register_callbacks cb 0x56237b50a420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b622b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b622b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53896/0 (socket says 172.21.15.118:53896) 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.703+0000 7fbce1e00640 1 -- 172.21.15.118:0/3094078673 learned_addr learned my addr 172.21.15.118:0/3094078673 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:08.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce1e00640 1 -- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b234590 msgr2=0x56237b650270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b234590 0x56237b650270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce1e00640 1 -- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 msgr2=0x56237b6507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce2800640 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b6507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b6507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce1e00640 1 -- 172.21.15.118:0/3094078673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237b2c0850 con 0x56237b22c3b0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce2800640 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b6507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbce1e00640 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b622b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400ed70 tx=0x7fbcd4004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cc324036c0f1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbcc3400640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbcc3400640 1 -- 172.21.15.118:0/3094078673 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4025020 con 0x56237b22c3b0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbcc3400640 1 -- 172.21.15.118:0/3094078673 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbcd4010040 con 0x56237b22c3b0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcdc062940 con 0x56237b22c3b0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbcc3400640 1 -- 172.21.15.118:0/3094078673 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fbcd402f050 con 0x56237b22c3b0 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbcefde4740 10 client.4620 fetch_fsmap learned FSMap version 8 2024-09-21T06:04:08.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.704+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56237b3376b0 con 0x56237b22c3b0 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcc3400640 1 -- 172.21.15.118:0/3094078673 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcdc062940 con 0x56237b22c3b0 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcc3400640 1 -- 172.21.15.118:0/3094078673 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fbcd4032020 con 0x56237b22c3b0 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcefde4740 10 client.4620 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcefde4740 10 client.4620 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcefde4740 20 client.4620 populate_metadata read hostname 'smithi118' 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b213e40 0x56237b65dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcefde4740 4 client.4620 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 --> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56237b571520 con 0x56237b213e40 2024-09-21T06:04:08.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.705+0000 7fbce1400640 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b213e40 0x56237b65dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.706+0000 7fbce1400640 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b213e40 0x56237b65dd50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cfd543363530d8d server_cookie=82cc0e83ba6bce38 in_seq=0 out_seq=0 2024-09-21T06:04:08.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.706+0000 7fbcc3400640 10 client.4620 ms_handle_connect on v2:172.21.15.149:6836/3721420106 2024-09-21T06:04:08.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcc3400640 1 -- 172.21.15.118:0/3094078673 <== mds.0 v2:172.21.15.149:6836/3721420106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56237b571520 con 0x56237b213e40 2024-09-21T06:04:08.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcc3400640 10 client.4620 handle_command_reply: tid=0 2024-09-21T06:04:08.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 client.4620 shutdown 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 msgr2=0x56237b622b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b622b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400ed70 tx=0x7fbcd4004620 comp rx=0 tx=0).stop 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 shutdown_connections 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b213e40 0x56237b65dd50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b255270 0x56237b6507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b234590 0x56237b650270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcefde4740 1 --2- 172.21.15.118:0/3094078673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b622b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.707+0000 7fbcc3400640 0 client.4620 ms_handle_reset on v2:172.21.15.149:6836/3721420106 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.708+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 >> 172.21.15.118:0/3094078673 conn(0x56237b2493c0 msgr2=0x56237b5f7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.708+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 shutdown_connections 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.708+0000 7fbcefde4740 1 -- 172.21.15.118:0/3094078673 wait complete. 2024-09-21T06:04:08.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.708+0000 7fbcefde4740 20 client.4620 trim_cache size 0 max 16384 2024-09-21T06:04:08.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.727+0000 7fbcefde4740 1 Processor -- start 2024-09-21T06:04:08.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.727+0000 7fbcefde4740 1 -- start start 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b61c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b61c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b255270 0x56237b660d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbcefde4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41ff660 con 0x56237b22c3b0 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41fea60 con 0x56237b234590 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbce41ff010 con 0x56237b255270 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b61c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbce1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b61c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53908/0 (socket says 172.21.15.118:53908) 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.728+0000 7fbce1e00640 1 -- 172.21.15.118:0/2882202001 learned_addr learned my addr 172.21.15.118:0/2882202001 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce2800640 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b255270 0x56237b660d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce1400640 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b61c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce1e00640 1 -- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b255270 msgr2=0x56237b660d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce1e00640 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b255270 0x56237b660d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce1e00640 1 -- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 msgr2=0x56237b61c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce1e00640 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b61c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce1e00640 1 -- 172.21.15.118:0/2882202001 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237b5f7c90 con 0x56237b22c3b0 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbce1e00640 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b61c250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4015d70 tx=0x7fbcd4015da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105777dffba0992a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbcce000640 1 -- 172.21.15.118:0/2882202001 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4025070 con 0x56237b22c3b0 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbcce000640 1 -- 172.21.15.118:0/2882202001 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcd402a8d0 con 0x56237b22c3b0 2024-09-21T06:04:08.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.729+0000 7fbcce000640 1 -- 172.21.15.118:0/2882202001 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd402ace0 con 0x56237b22c3b0 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 -- 172.21.15.118:0/2882202001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 msgr2=0x56237b61c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b61c250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4015d70 tx=0x7fbcd4015da0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 -- 172.21.15.118:0/2882202001 shutdown_connections 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b255270 0x56237b660d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b61c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2882202001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b22c3b0 0x56237b61c250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 -- 172.21.15.118:0/2882202001 >> 172.21.15.118:0/2882202001 conn(0x56237b2493c0 msgr2=0x56237b5f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 -- 172.21.15.118:0/2882202001 shutdown_connections 2024-09-21T06:04:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.730+0000 7fbcefde4740 1 -- 172.21.15.118:0/2882202001 wait complete. 2024-09-21T06:04:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.731+0000 7fbcefde4740 1 -- start start 2024-09-21T06:04:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.731+0000 7fbcefde4740 1 Processor -- start 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b6baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b643cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbcefde4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b255270 0x56237b644200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbcefde4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x56237b650e80 con 0x56237b255270 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56237b621570 con 0x56237b234590 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbcefde4740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56237b620200 con 0x56237b22c3b0 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbcefde4740 10 client.0 _ll_register_callbacks cb 0x7fbcd400ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b255270 0x56237b644200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b255270 0x56237b644200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53920/0 (socket says 172.21.15.118:53920) 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 -- 172.21.15.118:0/2744172433 learned_addr learned my addr 172.21.15.118:0/2744172433 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce1400640 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b643cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce1e00640 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b6baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 -- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 msgr2=0x56237b6baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b6baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 -- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 msgr2=0x56237b643cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b643cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.733+0000 7fbce2800640 1 -- 172.21.15.118:0/2744172433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237b610570 con 0x56237b255270 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbce2800640 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b255270 0x56237b644200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc062640 tx=0x7fbcdc098fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3357bb84bc843e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcc3400640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcc3400640 1 -- 172.21.15.118:0/2744172433 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc061da0 con 0x56237b255270 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcc3400640 1 -- 172.21.15.118:0/2744172433 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbcdc019b60 con 0x56237b255270 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcd402a8d0 con 0x56237b255270 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcc3400640 1 -- 172.21.15.118:0/2744172433 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fbcdc062940 con 0x56237b255270 2024-09-21T06:04:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 10 client.4626 fetch_fsmap learned FSMap version 8 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56237b65e5c0 con 0x56237b255270 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcc3400640 1 -- 172.21.15.118:0/2744172433 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcd402a8d0 con 0x56237b255270 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcc3400640 1 -- 172.21.15.118:0/2744172433 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fbcdc05e290 con 0x56237b255270 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 10 client.4626 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 20 client.4626 populate_metadata read hostname 'smithi118' 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b641d20 0x56237b642130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 4 client.4626 mds_command: new command op to 4411 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:04:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.734+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 --> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] -- command(tid 0: {"prefix": "status"}) -- 0x56237b56cfd0 con 0x56237b641d20 2024-09-21T06:04:08.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.735+0000 7fbce1e00640 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b641d20 0x56237b642130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:08.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.735+0000 7fbce1e00640 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b641d20 0x56237b642130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbea57853c8a71a1 server_cookie=1e10bfb0c2ef5ca8 in_seq=0 out_seq=0 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.735+0000 7fbcc3400640 10 client.4626 ms_handle_connect on v2:172.21.15.149:6836/3721420106 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcc3400640 1 -- 172.21.15.118:0/2744172433 <== mds.0 v2:172.21.15.149:6836/3721420106 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56237b56cfd0 con 0x56237b641d20 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcc3400640 10 client.4626 handle_command_reply: tid=0 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 client.4626 shutdown 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b255270 msgr2=0x56237b644200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b255270 0x56237b644200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc062640 tx=0x7fbcdc098fd0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 shutdown_connections 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:6836/3721420106,v1:172.21.15.149:6837/3721420106] conn(0x56237b641d20 0x56237b642130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56237b255270 0x56237b644200 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56237b234590 0x56237b643cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcc3400640 0 client.4626 ms_handle_reset on v2:172.21.15.149:6836/3721420106 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 --2- 172.21.15.118:0/2744172433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56237b22c3b0 0x56237b6baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 >> 172.21.15.118:0/2744172433 conn(0x56237b2493c0 msgr2=0x56237b63c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 shutdown_connections 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 1 -- 172.21.15.118:0/2744172433 wait complete. 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.736+0000 7fbcefde4740 20 client.4626 trim_cache size 0 max 16384 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4411, 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:04:08.742 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 12.310873710999999, 2024-09-21T06:04:08.743 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 8, 2024-09-21T06:04:08.743 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 20, 2024-09-21T06:04:08.743 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 20, 2024-09-21T06:04:08.743 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 18.548199508 2024-09-21T06:04:08.743 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcc4078bc0 msgr2=0x7fbcc407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcc4078bc0 0x7fbcc407b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4001670 tx=0x7fbcd4009040 comp rx=0 tx=0).stop 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbce413b350 msgr2=0x7fbce41408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbce413b350 0x7fbce41408b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c760 tx=0x7fbcdc00cc20 comp rx=0 tx=0).stop 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 shutdown_connections 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbce413b350 0x7fbce41408b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce413fef0 0x7fbce4140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcc4078bc0 0x7fbcc407b0d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 --2- 172.21.15.118:0/3520715503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce413fae0 0x7fbce413ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 >> 172.21.15.118:0/3520715503 conn(0x7fbce406d110 msgr2=0x7fbce413c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 shutdown_connections 2024-09-21T06:04:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:08.737+0000 7fbce8e00640 1 -- 172.21.15.118:0/3520715503 wait complete. 2024-09-21T06:04:08.764 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T06:04:08.786 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T06:04:08.786 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T06:04:08.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:08.786 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:04:08.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:08.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-09-21T06:04:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-09-21T06:04:08.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:04:08.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:08.923 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:04:08.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:08.959 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-09-21T06:04:09.056 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-09-21T06:04:09.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:04:09.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:09.059 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:04:09.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:09.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-21T06:04:09.204 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-21T06:04:09.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:04:09.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:09.207 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:04:09.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:09.243 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-21T06:04:09.342 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-21T06:04:09.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:04:09.345 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-21T06:04:09.345 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:04:09.345 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:09.346 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 -- 172.21.15.118:0/1860041646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 msgr2=0x7f38c81448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 --2- 172.21.15.118:0/1860041646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c81448a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009be0 tx=0x7f38b802a840 comp rx=0 tx=0).stop 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 -- 172.21.15.118:0/1860041646 shutdown_connections 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 --2- 172.21.15.118:0/1860041646 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38c80d0ec0 0x7f38c80d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 --2- 172.21.15.118:0/1860041646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c81448a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 -- 172.21.15.118:0/1860041646 >> 172.21.15.118:0/1860041646 conn(0x7f38c806d110 msgr2=0x7f38c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 -- 172.21.15.118:0/1860041646 shutdown_connections 2024-09-21T06:04:09.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.565+0000 7f38cdc00640 1 -- 172.21.15.118:0/1860041646 wait complete. 2024-09-21T06:04:09.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.567+0000 7f38cdc00640 1 Processor -- start 2024-09-21T06:04:09.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.567+0000 7f38cdc00640 1 -- start start 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38cdc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c813e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38cdc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38c80d0ec0 0x7f38c80b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38cdc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38c815fa00 0x7f38c815e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38cdc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f38c8073e70 con 0x7f38c80ce0c0 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38cdc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38c8073cf0 con 0x7f38c815fa00 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38cdc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38c8073ff0 con 0x7f38c80d0ec0 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c813e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c813e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53942/0 (socket says 172.21.15.118:53942) 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c6a00640 1 -- 172.21.15.118:0/3577614813 learned_addr learned my addr 172.21.15.118:0/3577614813 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c6a00640 1 -- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38c80d0ec0 msgr2=0x7f38c80b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c6000640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38c80d0ec0 0x7f38c80b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c6a00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38c80d0ec0 0x7f38c80b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c6a00640 1 -- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38c815fa00 msgr2=0x7f38c815e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.569+0000 7f38c7400640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38c815fa00 0x7f38c815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38c6a00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38c815fa00 0x7f38c815e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38c6a00640 1 -- 172.21.15.118:0/3577614813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c80b12b0 con 0x7f38c80ce0c0 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38c6000640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38c80d0ec0 0x7f38c80b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38c7400640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38c815fa00 0x7f38c815e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38c6a00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c813e710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38b8035040 tx=0x7f38b8033e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38bea00640 1 -- 172.21.15.118:0/3577614813 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8037050 con 0x7f38c80ce0c0 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38bea00640 1 -- 172.21.15.118:0/3577614813 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38b8043070 con 0x7f38c80ce0c0 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38bea00640 1 -- 172.21.15.118:0/3577614813 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b80044b0 con 0x7f38c80ce0c0 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c80b1590 con 0x7f38c80ce0c0 2024-09-21T06:04:09.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.570+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c80b1b50 con 0x7f38c80ce0c0 2024-09-21T06:04:09.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.571+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c8074580 con 0x7f38c80ce0c0 2024-09-21T06:04:09.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.572+0000 7f38bea00640 1 -- 172.21.15.118:0/3577614813 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38b8004650 con 0x7f38c80ce0c0 2024-09-21T06:04:09.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.573+0000 7f38bea00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38a8078bc0 0x7f38a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.573+0000 7f38bea00640 1 -- 172.21.15.118:0/3577614813 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38b80bbdf0 con 0x7f38c80ce0c0 2024-09-21T06:04:09.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.574+0000 7f38c6000640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38a8078bc0 0x7f38a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.576+0000 7f38c6000640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38a8078bc0 0x7f38a807b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38c815b5f0 tx=0x7f38b4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.578+0000 7f38bea00640 1 -- 172.21.15.118:0/3577614813 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f38b804d020 con 0x7f38c80ce0c0 2024-09-21T06:04:09.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.803+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f38c80cd3e0 con 0x7f38c80ce0c0 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.803+0000 7f38bea00640 1 -- 172.21.15.118:0/3577614813 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f38b802f070 con 0x7f38c80ce0c0 2024-09-21T06:04:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:04:09.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38a8078bc0 msgr2=0x7f38a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38a8078bc0 0x7f38a807b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38c815b5f0 tx=0x7f38b4005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 msgr2=0x7f38c813e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c813e710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38b8035040 tx=0x7f38b8033e50 comp rx=0 tx=0).stop 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 shutdown_connections 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38c815fa00 0x7f38c815e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38a8078bc0 0x7f38a807b0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38c80d0ec0 0x7f38c80b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 --2- 172.21.15.118:0/3577614813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38c80ce0c0 0x7f38c813e710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 >> 172.21.15.118:0/3577614813 conn(0x7f38c806d110 msgr2=0x7f38c815fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 shutdown_connections 2024-09-21T06:04:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09.806+0000 7f38cdc00640 1 -- 172.21.15.118:0/3577614813 wait complete. 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:04:09.830 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:04:09.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:09.831 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:04:09.865 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:09.866 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:04:09.867 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:09.868 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:04:09.868 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:09.868 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:09.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:04:09.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2024-09-21T06:04:09.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2024-09-21T06:04:09.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:04:09.868 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:09.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:10.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:10.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:10.301 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:04:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:04:10.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:10.361 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:04:10.410 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:04:10.411 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:10.411 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:10.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:04:10.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:04:10.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:04:10.411 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:10.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:11.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:11.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:11.026 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:04:11.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:11.062 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-09-21T06:04:11.139 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:11.139 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:11.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:04:11.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T06:04:11.139 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:11.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:11.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:11.319 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T06:04:11.319 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:11.319 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:11.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T06:04:11.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:04:11.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T06:04:11.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T06:04:11.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T06:04:11.320 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:11.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:11.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:11.558 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:11.558 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:11.558 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:04:11.558 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:04:11.558 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:11.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:11.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:11.726 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:11.726 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:11.761 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:04:11.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:11.761 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:11.835 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:04:11.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:11.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:12.046 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:12.046 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:12.685 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:12.686 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:12.686 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:04:12.686 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:04:12.686 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:04:12.687 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:04:12.688 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:04:12.688 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:04:12.688 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:04:12.688 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:04:12.691 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:04:12.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:12.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:12.748 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:12.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:12.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:12.848 INFO:teuthology.orchestra.run.smithi118.stdout:client4508 2024-09-21T06:04:12.849 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:12.849 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:12.884 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:13.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:13.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:13.022 INFO:teuthology.orchestra.run.smithi118.stdout:client4508 2024-09-21T06:04:13.023 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:13.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:13.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:13.125 INFO:teuthology.orchestra.run.smithi118.stdout:client4508 2024-09-21T06:04:13.126 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4508/status') 2024-09-21T06:04:13.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:13.235 INFO:teuthology.orchestra.run.smithi118.stdout:instance: client.4508 (3)172.21.15.118:0/3478786511 2024-09-21T06:04:13.235 INFO:teuthology.orchestra.run.smithi118.stdout:blocklisted: false 2024-09-21T06:04:13.235 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records in 2024-09-21T06:04:13.235 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records out 2024-09-21T06:04:13.235 INFO:teuthology.orchestra.run.smithi118.stderr:71 bytes copied, 7.0133e-05 s, 1.0 MB/s 2024-09-21T06:04:13.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:13.246 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-21T06:04:13.246 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:04:13.246 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T06:04:13.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:04:13.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.463+0000 7f380b600640 1 -- 172.21.15.118:0/3216162558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 msgr2=0x7f37e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:13.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.463+0000 7f380b600640 1 --2- 172.21.15.118:0/3216162558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 0x7f37e8003e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009b50 tx=0x7f37e8005830 comp rx=0 tx=0).stop 2024-09-21T06:04:13.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.463+0000 7f3809600640 1 -- 172.21.15.118:0/3216162558 reap_dead start 2024-09-21T06:04:13.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.463+0000 7f380b600640 1 -- 172.21.15.118:0/3216162558 shutdown_connections 2024-09-21T06:04:13.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.463+0000 7f380b600640 1 -- 172.21.15.118:0/3216162558 >> 172.21.15.118:0/3216162558 conn(0x7f380406d110 msgr2=0x7f380406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:13.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.463+0000 7f380b600640 1 -- 172.21.15.118:0/3216162558 shutdown_connections 2024-09-21T06:04:13.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.463+0000 7f380b600640 1 -- 172.21.15.118:0/3216162558 wait complete. 2024-09-21T06:04:13.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.466+0000 7f380b600640 1 Processor -- start 2024-09-21T06:04:13.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.466+0000 7f380b600640 1 -- start start 2024-09-21T06:04:13.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f380b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 0x7f38041f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:13.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f380b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3804157ae0 0x7f380415f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:13.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f380b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f380415fb50 0x7f38041f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:13.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f380b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f38040cf5d0 con 0x7f37e8003a00 2024-09-21T06:04:13.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f380b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38040cf450 con 0x7f3804157ae0 2024-09-21T06:04:13.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f380b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38040cf750 con 0x7f380415fb50 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f3808c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 0x7f38041f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f3808c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 0x7f38041f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53956/0 (socket says 172.21.15.118:53956) 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.467+0000 7f3808c00640 1 -- 172.21.15.118:0/3441076853 learned_addr learned my addr 172.21.15.118:0/3441076853 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.468+0000 7f3808c00640 1 -- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f380415fb50 msgr2=0x7f38041f6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.468+0000 7f3808c00640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f380415fb50 0x7f38041f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.468+0000 7f3808c00640 1 -- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3804157ae0 msgr2=0x7f380415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.468+0000 7f3808c00640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3804157ae0 0x7f380415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.468+0000 7f3808c00640 1 -- 172.21.15.118:0/3441076853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380415ff60 con 0x7f37e8003a00 2024-09-21T06:04:13.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.468+0000 7f3808c00640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 0x7f38041f2e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009c70 tx=0x7f37f4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:13.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.468+0000 7f3801600640 1 -- 172.21.15.118:0/3441076853 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4038040 con 0x7f37e8003a00 2024-09-21T06:04:13.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.469+0000 7f3801600640 1 -- 172.21.15.118:0/3441076853 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37f4004020 con 0x7f37e8003a00 2024-09-21T06:04:13.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.469+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38041544e0 con 0x7f37e8003a00 2024-09-21T06:04:13.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.469+0000 7f3801600640 1 -- 172.21.15.118:0/3441076853 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4004470 con 0x7f37e8003a00 2024-09-21T06:04:13.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.469+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3804154aa0 con 0x7f37e8003a00 2024-09-21T06:04:13.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.470+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38040d12f0 con 0x7f37e8003a00 2024-09-21T06:04:13.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.471+0000 7f3801600640 1 -- 172.21.15.118:0/3441076853 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37f4045020 con 0x7f37e8003a00 2024-09-21T06:04:13.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.472+0000 7f3801600640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f37e0078bc0 0x7f37e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:13.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.472+0000 7f3801600640 1 -- 172.21.15.118:0/3441076853 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f37f40bb7b0 con 0x7f37e8003a00 2024-09-21T06:04:13.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.473+0000 7f37fbe00640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f37e0078bc0 0x7f37e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:13.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.473+0000 7f37fbe00640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f37e0078bc0 0x7f37e007b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37ec001eb0 tx=0x7f37ec001cb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:13.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.477+0000 7f3801600640 1 -- 172.21.15.118:0/3441076853 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f380415ff60 con 0x7f37e8003a00 2024-09-21T06:04:13.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.699+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f38040d0690 con 0x7f37e8003a00 2024-09-21T06:04:13.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.700+0000 7f3801600640 1 -- 172.21.15.118:0/3441076853 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f37f4083b50 con 0x7f37e8003a00 2024-09-21T06:04:13.702 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f37e0078bc0 msgr2=0x7f37e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f37e0078bc0 0x7f37e007b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37ec001eb0 tx=0x7f37ec001cb0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 msgr2=0x7f38041f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 0x7f38041f2e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009c70 tx=0x7f37f4033670 comp rx=0 tx=0).stop 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 shutdown_connections 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f37e0078bc0 0x7f37e007b0d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f380415fb50 0x7f38041f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3804157ae0 0x7f380415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 --2- 172.21.15.118:0/3441076853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37e8003a00 0x7f38041f2e20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 >> 172.21.15.118:0/3441076853 conn(0x7f380406d110 msgr2=0x7f3804157260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 shutdown_connections 2024-09-21T06:04:13.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:13.702+0000 7f380b600640 1 -- 172.21.15.118:0/3441076853 wait complete. 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:04:13.728 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T06:04:13.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:13.728 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:13.764 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42731sec preferred_lft 42731sec 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:13.765 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:13.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:13.766 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:04:13.858 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:04:13.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:13.861 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:04:13.899 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:04:13.899 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:04:13.899 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:04:13.899 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:04:13.899 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:04:13.899 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:13.899 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:13.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:04:13.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:04:13.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:04:13.900 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:14.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:14.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:14.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:14.097 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:04:14.132 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:04:14.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:14.133 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-09-21T06:04:14.207 INFO:teuthology.orchestra.run.smithi118.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T06:04:14.209 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:14.209 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:14.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:04:14.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T06:04:14.209 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:14.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:14.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:14.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:14.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T06:04:14.438 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:14.438 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 06:3c:a9:e8:fa:e6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.439 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::43c:a9ff:fee8:fae6/64 scope link 2024-09-21T06:04:14.440 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:14.442 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T06:04:14.497 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:14.497 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:14.497 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:14.497 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 06:3c:a9:e8:fa:e6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::43c:a9ff:fee8:fae6/64 scope link 2024-09-21T06:04:14.498 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:14.500 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T06:04:14.500 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:14.500 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:14.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T06:04:14.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T06:04:14.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T06:04:14.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T06:04:14.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T06:04:14.501 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:14.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:14.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:14.719 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:14.719 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:14.719 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.1 up 2024-09-21T06:04:14.719 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T06:04:14.719 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:14.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:14.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:14.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:14.884 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T06:04:14.919 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T06:04:14.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:14.919 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T06:04:14.993 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-21T06:04:14.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:14.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:15.188 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:15.189 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:15.223 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:15.223 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:15.223 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:04:15.223 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 2@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:04:15.223 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:04:15.225 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-21T06:04:15.225 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:04:15.225 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:04:15.225 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:04:15.225 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:04:15.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:15.228 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T06:04:15.284 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:15.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:15.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:15.375 INFO:teuthology.orchestra.run.smithi118.stdout:client4633 2024-09-21T06:04:15.375 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:15.375 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:15.411 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:15.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:15.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:15.541 INFO:teuthology.orchestra.run.smithi118.stdout:client4633 2024-09-21T06:04:15.541 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:15.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:15.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:15.630 INFO:teuthology.orchestra.run.smithi118.stdout:client4633 2024-09-21T06:04:15.631 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4633/status') 2024-09-21T06:04:15.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:15.729 INFO:teuthology.orchestra.run.smithi118.stdout:instance: client.4633 (3)172.21.15.118:0/1802154271 2024-09-21T06:04:15.729 INFO:teuthology.orchestra.run.smithi118.stdout:blocklisted: false 2024-09-21T06:04:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records in 2024-09-21T06:04:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:0+1 records out 2024-09-21T06:04:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:71 bytes copied, 7.2146e-05 s, 984 kB/s 2024-09-21T06:04:15.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:15.739 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-21T06:04:15.739 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:04:15.740 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:15.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:04:15.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.956+0000 7f56a7200640 1 -- 172.21.15.118:0/1110081801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 msgr2=0x7f56a80d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.956+0000 7f56a7200640 1 --2- 172.21.15.118:0/1110081801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a80d1330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5698009820 tx=0x7f569802a480 comp rx=0 tx=0).stop 2024-09-21T06:04:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.956+0000 7f56a7200640 1 -- 172.21.15.118:0/1110081801 shutdown_connections 2024-09-21T06:04:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.956+0000 7f56a7200640 1 --2- 172.21.15.118:0/1110081801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a80d1330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.956+0000 7f56a7200640 1 -- 172.21.15.118:0/1110081801 >> 172.21.15.118:0/1110081801 conn(0x7f56a80d2900 msgr2=0x7f56a80d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.956+0000 7f56a7200640 1 -- 172.21.15.118:0/1110081801 shutdown_connections 2024-09-21T06:04:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.956+0000 7f56a7200640 1 -- 172.21.15.118:0/1110081801 wait complete. 2024-09-21T06:04:15.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.958+0000 7f56a7200640 1 Processor -- start 2024-09-21T06:04:15.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.958+0000 7f56a7200640 1 -- start start 2024-09-21T06:04:15.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a8158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56a80ce420 0x7f56a81f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56a80cf140 0x7f56a80b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f56a80b2ad0 con 0x7f56a80b7b90 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f56a80b2950 con 0x7f56a80cf140 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f56a80b2c50 con 0x7f56a80ce420 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a8158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a8158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47456/0 (socket says 172.21.15.118:47456) 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 -- 172.21.15.118:0/480374846 learned_addr learned my addr 172.21.15.118:0/480374846 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f569d400640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56a80ce420 0x7f56a81f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a6800640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56a80cf140 0x7f56a80b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 -- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56a80ce420 msgr2=0x7f56a81f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56a80ce420 0x7f56a81f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 -- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56a80cf140 msgr2=0x7f56a80b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56a80cf140 0x7f56a80b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a5e00640 1 -- 172.21.15.118:0/480374846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a81f83d0 con 0x7f56a80b7b90 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f56a6800640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56a80cf140 0x7f56a80b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.960+0000 7f569d400640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56a80ce420 0x7f56a81f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.961+0000 7f56a5e00640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a8158ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5698009940 tx=0x7f5698005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.961+0000 7f569ea00640 1 -- 172.21.15.118:0/480374846 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569803f070 con 0x7f56a80b7b90 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.961+0000 7f569ea00640 1 -- 172.21.15.118:0/480374846 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5698004340 con 0x7f56a80b7b90 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.961+0000 7f569ea00640 1 -- 172.21.15.118:0/480374846 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698031bb0 con 0x7f56a80b7b90 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.961+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a81f80f0 con 0x7f56a80b7b90 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.961+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a81f4380 con 0x7f56a80b7b90 2024-09-21T06:04:15.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.962+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a80d1330 con 0x7f56a80b7b90 2024-09-21T06:04:15.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.964+0000 7f569ea00640 1 -- 172.21.15.118:0/480374846 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5698042070 con 0x7f56a80b7b90 2024-09-21T06:04:15.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.964+0000 7f569ea00640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5684078bc0 0x7f568407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.965+0000 7f569ea00640 1 -- 172.21.15.118:0/480374846 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f56980bbe70 con 0x7f56a80b7b90 2024-09-21T06:04:15.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.965+0000 7f569d400640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5684078bc0 0x7f568407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.966+0000 7f569d400640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5684078bc0 0x7f568407b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56a815f770 tx=0x7f5690009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:15.969+0000 7f569ea00640 1 -- 172.21.15.118:0/480374846 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5698084210 con 0x7f56a80b7b90 2024-09-21T06:04:16.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.191+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56a80ced10 con 0x7f56a80b7b90 2024-09-21T06:04:16.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.191+0000 7f569ea00640 1 -- 172.21.15.118:0/480374846 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f5698083b10 con 0x7f56a80b7b90 2024-09-21T06:04:16.194 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:04:16.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.193+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5684078bc0 msgr2=0x7f568407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:16.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5684078bc0 0x7f568407b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56a815f770 tx=0x7f5690009040 comp rx=0 tx=0).stop 2024-09-21T06:04:16.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 msgr2=0x7f56a8158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a8158ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5698009940 tx=0x7f5698005360 comp rx=0 tx=0).stop 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 shutdown_connections 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56a80cf140 0x7f56a80b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5684078bc0 0x7f568407b0d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56a80ce420 0x7f56a81f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 --2- 172.21.15.118:0/480374846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56a80b7b90 0x7f56a8158ce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 >> 172.21.15.118:0/480374846 conn(0x7f56a80d2900 msgr2=0x7f56a8160a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 shutdown_connections 2024-09-21T06:04:16.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:16.194+0000 7f56a7200640 1 -- 172.21.15.118:0/480374846 wait complete. 2024-09-21T06:04:16.218 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:04:16.218 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:04:16.219 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:04:16.219 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:04:16.219 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:16.219 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:04:16.219 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:04:16.219 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:04:16.219 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:04:16.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:16.219 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:16.260 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42703sec preferred_lft 42703sec 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:04:16.261 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:16.262 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:04:16.262 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:16.262 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:16.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:04:16.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-09-21T06:04:16.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-09-21T06:04:16.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:04:16.262 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:16.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:16.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:16.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:16.725 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:04:16.781 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:04:16.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:16.785 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:04:16.834 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:04:16.834 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:04:16.834 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:04:16.834 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:04:16.834 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:04:16.834 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:16.835 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:16.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:04:16.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:04:16.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:04:16.835 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:16.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:17.448 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:17.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:17.456 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:04:17.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:17.492 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-09-21T06:04:17.567 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:17.568 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:17.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:04:17.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T06:04:17.568 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:17.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:17.739 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:17.748 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T06:04:17.748 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:17.749 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:17.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T06:04:17.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:04:17.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T06:04:17.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T06:04:17.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T06:04:17.750 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:17.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:17.993 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:17.994 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:17.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:04:17.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:04:17.994 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:18.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:18.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:18.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:18.163 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:18.209 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:04:18.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:18.210 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:18.294 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:04:18.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:18.295 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:18.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:04:18.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:04:18.519 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:18.520 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:19.215 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:19.216 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:19.216 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:04:19.216 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:04:19.216 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:04:19.219 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:04:19.219 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:04:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:04:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:04:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:04:19.222 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:04:19.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:19.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:19.325 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:19.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:19.411 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:19.420 INFO:teuthology.orchestra.run.smithi149.stdout:client4636 2024-09-21T06:04:19.420 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:19.420 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:19.462 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:19.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:19.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:19.593 INFO:teuthology.orchestra.run.smithi149.stdout:client4636 2024-09-21T06:04:19.594 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:19.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:19.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:19.684 INFO:teuthology.orchestra.run.smithi149.stdout:client4636 2024-09-21T06:04:19.684 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4636/status') 2024-09-21T06:04:19.761 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:19.783 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4636 (3)192.168.0.1:0/3228630705 2024-09-21T06:04:19.783 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-09-21T06:04:19.783 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-09-21T06:04:19.783 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-09-21T06:04:19.783 INFO:teuthology.orchestra.run.smithi149.stderr:69 bytes copied, 5.5535e-05 s, 1.2 MB/s 2024-09-21T06:04:19.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:19.794 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-21T06:04:19.794 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:04:19.794 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T06:04:19.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:04:20.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.022+0000 7fbc72400640 1 -- 172.21.15.118:0/2028506426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 msgr2=0x7fbc6c0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:20.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.022+0000 7fbc72400640 1 --2- 172.21.15.118:0/2028506426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c0afa50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c072780 tx=0x7fbc5c02a580 comp rx=0 tx=0).stop 2024-09-21T06:04:20.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.022+0000 7fbc72400640 1 -- 172.21.15.118:0/2028506426 shutdown_connections 2024-09-21T06:04:20.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.022+0000 7fbc72400640 1 --2- 172.21.15.118:0/2028506426 >> v2:172.21.15.149:3300/0 conn(0x7fbc6c06ecd0 0x7fbc6c06f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.022+0000 7fbc72400640 1 --2- 172.21.15.118:0/2028506426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c0afa50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.022+0000 7fbc72400640 1 -- 172.21.15.118:0/2028506426 >> 172.21.15.118:0/2028506426 conn(0x7fbc6c06d110 msgr2=0x7fbc6c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:20.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.023+0000 7fbc72400640 1 -- 172.21.15.118:0/2028506426 shutdown_connections 2024-09-21T06:04:20.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.023+0000 7fbc72400640 1 -- 172.21.15.118:0/2028506426 wait complete. 2024-09-21T06:04:20.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.025+0000 7fbc72400640 1 Processor -- start 2024-09-21T06:04:20.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.025+0000 7fbc72400640 1 -- start start 2024-09-21T06:04:20.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.026+0000 7fbc72400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c06ecd0 0x7fbc6c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.026+0000 7fbc72400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc6c0d0de0 0x7fbc6c143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.026+0000 7fbc72400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.026+0000 7fbc72400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c073060 con 0x7fbc6c156220 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.026+0000 7fbc72400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c072ee0 con 0x7fbc6c06ecd0 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.026+0000 7fbc72400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c0731e0 con 0x7fbc6c0d0de0 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47480/0 (socket says 172.21.15.118:47480) 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 -- 172.21.15.118:0/2177442810 learned_addr learned my addr 172.21.15.118:0/2177442810 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc62a00640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc6c0d0de0 0x7fbc6c143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 -- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc6c0d0de0 msgr2=0x7fbc6c143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc6c0d0de0 0x7fbc6c143c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 -- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c06ecd0 msgr2=0x7fbc6c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:20.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c06ecd0 0x7fbc6c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 -- 172.21.15.118:0/2177442810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c15f0c0 con 0x7fbc6c156220 2024-09-21T06:04:20.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc6be00640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c158f80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c700 tx=0x7fbc6400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:20.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.027+0000 7fbc63e00640 1 -- 172.21.15.118:0/2177442810 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64003b70 con 0x7fbc6c156220 2024-09-21T06:04:20.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.028+0000 7fbc63e00640 1 -- 172.21.15.118:0/2177442810 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc64003d10 con 0x7fbc6c156220 2024-09-21T06:04:20.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.028+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6c1441b0 con 0x7fbc6c156220 2024-09-21T06:04:20.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.028+0000 7fbc63e00640 1 -- 172.21.15.118:0/2177442810 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400aab0 con 0x7fbc6c156220 2024-09-21T06:04:20.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.028+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6c1f9b80 con 0x7fbc6c156220 2024-09-21T06:04:20.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.029+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc6c073700 con 0x7fbc6c156220 2024-09-21T06:04:20.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.030+0000 7fbc63e00640 1 -- 172.21.15.118:0/2177442810 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc6400ac50 con 0x7fbc6c156220 2024-09-21T06:04:20.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.031+0000 7fbc63e00640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:20.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.031+0000 7fbc63e00640 1 -- 172.21.15.118:0/2177442810 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbc6409abc0 con 0x7fbc6c156220 2024-09-21T06:04:20.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.032+0000 7fbc6b400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:20.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.035+0000 7fbc6b400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c033000 tx=0x7fbc5c0046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:20.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.035+0000 7fbc63e00640 1 -- 172.21.15.118:0/2177442810 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbc64062f60 con 0x7fbc6c156220 2024-09-21T06:04:20.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.257+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbc6c155850 con 0x7fbc6c156220 2024-09-21T06:04:20.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.258+0000 7fbc63e00640 1 -- 172.21.15.118:0/2177442810 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fbc64062860 con 0x7fbc6c156220 2024-09-21T06:04:20.261 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:04:20.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.260+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 msgr2=0x7fbc4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:20.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.260+0000 7fbc72400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c033000 tx=0x7fbc5c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.260+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 msgr2=0x7fbc6c158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.260+0000 7fbc72400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c158f80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c700 tx=0x7fbc6400cbc0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 shutdown_connections 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc6c156220 0x7fbc6c158f80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc6c0d0de0 0x7fbc6c143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 --2- 172.21.15.118:0/2177442810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c06ecd0 0x7fbc6c15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 >> 172.21.15.118:0/2177442810 conn(0x7fbc6c06d110 msgr2=0x7fbc6c0b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 shutdown_connections 2024-09-21T06:04:20.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:20.261+0000 7fbc72400640 1 -- 172.21.15.118:0/2177442810 wait complete. 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:04:20.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T06:04:20.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:20.290 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:04:20.326 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:20.326 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:20.327 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42699sec preferred_lft 42699sec 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:04:20.328 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:04:20.329 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:20.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:20.329 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:04:20.420 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:04:20.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:20.423 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:04:20.462 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:04:20.462 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:04:20.462 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:04:20.462 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:04:20.462 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:04:20.462 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:20.462 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:20.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:04:20.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:04:20.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:04:20.463 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:20.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:20.653 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:20.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:20.661 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:04:20.697 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:04:20.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:20.697 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-09-21T06:04:20.773 INFO:teuthology.orchestra.run.smithi149.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T06:04:20.773 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:20.773 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:20.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:04:20.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T06:04:20.774 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:20.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:20.942 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:20.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:20.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T06:04:21.007 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:21.007 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:21.007 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:21.007 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether de:e6:8f:28:b9:37 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::dce6:8fff:fe28:b937/64 scope link 2024-09-21T06:04:21.008 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:21.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T06:04:21.065 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether de:e6:8f:28:b9:37 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.066 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::dce6:8fff:fe28:b937/64 scope link 2024-09-21T06:04:21.067 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:21.068 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T06:04:21.069 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:21.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:21.278 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:21.286 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:21.286 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:21.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.1 up 2024-09-21T06:04:21.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T06:04:21.287 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:21.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:21.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:21.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:21.454 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T06:04:21.489 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T06:04:21.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:21.490 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T06:04:21.565 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-21T06:04:21.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:21.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:21.758 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:21.759 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:21.794 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:21.794 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:21.794 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:04:21.794 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 3@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:04:21.794 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:04:21.796 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-21T06:04:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:04:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:04:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:04:21.796 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:04:21.799 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:04:21.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:21.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T06:04:21.854 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:21.933 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:21.936 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:21.944 INFO:teuthology.orchestra.run.smithi149.stdout:client4662 2024-09-21T06:04:21.944 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:21.944 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:21.979 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:22.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:22.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:22.108 INFO:teuthology.orchestra.run.smithi149.stdout:client4662 2024-09-21T06:04:22.108 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:22.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:22.189 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:22.197 INFO:teuthology.orchestra.run.smithi149.stdout:client4662 2024-09-21T06:04:22.197 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4662/status') 2024-09-21T06:04:22.274 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:22.296 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4662 (3)172.21.15.149:0/1466327659 2024-09-21T06:04:22.296 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-09-21T06:04:22.296 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-09-21T06:04:22.296 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-09-21T06:04:22.296 INFO:teuthology.orchestra.run.smithi149.stderr:71 bytes copied, 5.2092e-05 s, 1.4 MB/s 2024-09-21T06:04:22.298 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:22.307 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T06:04:22.371 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-21T06:04:22.372 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2024-09-21T06:04:22.372 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:22.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 -- 172.21.15.118:0/2165892393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fef0 msgr2=0x7f5ca00d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:22.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 --2- 172.21.15.118:0/2165892393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fef0 0x7f5ca00d13c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ca015d7d0 tx=0x7f5c8802a540 comp rx=0 tx=0).stop 2024-09-21T06:04:22.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 -- 172.21.15.118:0/2165892393 shutdown_connections 2024-09-21T06:04:22.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 --2- 172.21.15.118:0/2165892393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fef0 0x7f5ca00d13c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 --2- 172.21.15.118:0/2165892393 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ca0142730 0x7f5ca0142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 --2- 172.21.15.118:0/2165892393 >> v2:172.21.15.149:3300/0 conn(0x7f5ca013fae0 0x7f5ca00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 -- 172.21.15.118:0/2165892393 >> 172.21.15.118:0/2165892393 conn(0x7f5ca006d110 msgr2=0x7f5ca006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:22.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 -- 172.21.15.118:0/2165892393 shutdown_connections 2024-09-21T06:04:22.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.594+0000 7f5ca6000640 1 -- 172.21.15.118:0/2165892393 wait complete. 2024-09-21T06:04:22.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.596+0000 7f5ca6000640 1 Processor -- start 2024-09-21T06:04:22.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.597+0000 7f5ca6000640 1 -- start start 2024-09-21T06:04:22.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5ca6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fae0 0x7f5ca0132070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:22.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5ca6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ca013fef0 0x7f5ca013ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:22.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5ca6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ca0142730 0x7f5ca013b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:22.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5ca6000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca006f300 con 0x7f5ca013fae0 2024-09-21T06:04:22.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5ca6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca006f180 con 0x7f5ca0142730 2024-09-21T06:04:22.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5ca6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca006f480 con 0x7f5ca013fef0 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5c9f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fae0 0x7f5ca0132070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5c9f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fae0 0x7f5ca0132070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47488/0 (socket says 172.21.15.118:47488) 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.598+0000 7f5c9f400640 1 -- 172.21.15.118:0/1973332607 learned_addr learned my addr 172.21.15.118:0/1973332607 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c96a00640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ca013fef0 0x7f5ca013ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9fe00640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ca0142730 0x7f5ca013b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9f400640 1 -- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ca013fef0 msgr2=0x7f5ca013ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9f400640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ca013fef0 0x7f5ca013ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9f400640 1 -- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ca0142730 msgr2=0x7f5ca013b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9f400640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ca0142730 0x7f5ca013b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9f400640 1 -- 172.21.15.118:0/1973332607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca01548c0 con 0x7f5ca013fae0 2024-09-21T06:04:22.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c96a00640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ca013fef0 0x7f5ca013ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9fe00640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ca0142730 0x7f5ca013b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c9f400640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fae0 0x7f5ca0132070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000e790 tx=0x7f5c9000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c97e00640 1 -- 172.21.15.118:0/1973332607 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000eea0 con 0x7f5ca013fae0 2024-09-21T06:04:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c97e00640 1 -- 172.21.15.118:0/1973332607 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c9000cdb0 con 0x7f5ca013fae0 2024-09-21T06:04:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca0140e40 con 0x7f5ca013fae0 2024-09-21T06:04:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5c97e00640 1 -- 172.21.15.118:0/1973332607 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90010690 con 0x7f5ca013fae0 2024-09-21T06:04:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.599+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01545e0 con 0x7f5ca013fae0 2024-09-21T06:04:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.600+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca013cec0 con 0x7f5ca013fae0 2024-09-21T06:04:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.602+0000 7f5c97e00640 1 -- 172.21.15.118:0/1973332607 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c90010830 con 0x7f5ca013fae0 2024-09-21T06:04:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.602+0000 7f5c97e00640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c7c078b90 0x7f5c7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.603+0000 7f5c97e00640 1 -- 172.21.15.118:0/1973332607 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5c9009b7f0 con 0x7f5ca013fae0 2024-09-21T06:04:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.603+0000 7f5c96a00640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c7c078b90 0x7f5c7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:22.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.604+0000 7f5c96a00640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c7c078b90 0x7f5c7c07b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c88033000 tx=0x7f5c88004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:22.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.607+0000 7f5c97e00640 1 -- 172.21.15.118:0/1973332607 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5ca013cec0 con 0x7f5ca013fae0 2024-09-21T06:04:22.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.791+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ca006f9a0 con 0x7f5ca013fae0 2024-09-21T06:04:22.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.793+0000 7f5c97e00640 1 -- 172.21.15.118:0/1973332607 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16737 (secure 0 0 0) 0x7f5c90063c20 con 0x7f5ca013fae0 2024-09-21T06:04:22.796 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:22.796 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:57.424251+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:22.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c7c078b90 msgr2=0x7f5c7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:22.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c7c078b90 0x7f5c7c07b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c88033000 tx=0x7f5c88004730 comp rx=0 tx=0).stop 2024-09-21T06:04:22.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fae0 msgr2=0x7f5ca0132070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:22.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fae0 0x7f5ca0132070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000e790 tx=0x7f5c9000ec50 comp rx=0 tx=0).stop 2024-09-21T06:04:22.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 shutdown_connections 2024-09-21T06:04:22.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ca0142730 0x7f5ca013b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c7c078b90 0x7f5c7c07b0a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ca013fef0 0x7f5ca013ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 --2- 172.21.15.118:0/1973332607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca013fae0 0x7f5ca0132070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:22.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 >> 172.21.15.118:0/1973332607 conn(0x7f5ca006d110 msgr2=0x7f5ca00cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:22.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 shutdown_connections 2024-09-21T06:04:22.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:22.795+0000 7f5ca6000640 1 -- 172.21.15.118:0/1973332607 wait complete. 2024-09-21T06:04:22.821 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:03:53.868746+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:03:54.884852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:04:22.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:04:23.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.043+0000 7f41a2800640 1 -- 172.21.15.118:0/922017390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c0cf720 msgr2=0x7f419c0cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.043+0000 7f41a2800640 1 --2- 172.21.15.118:0/922017390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c0cf720 0x7f419c0cd360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f418c009830 tx=0x7f418c02a510 comp rx=0 tx=0).stop 2024-09-21T06:04:23.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.043+0000 7f41a2800640 1 -- 172.21.15.118:0/922017390 shutdown_connections 2024-09-21T06:04:23.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.043+0000 7f41a2800640 1 --2- 172.21.15.118:0/922017390 >> v2:172.21.15.149:3300/0 conn(0x7f419c1610f0 0x7f419c06f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.043+0000 7f41a2800640 1 --2- 172.21.15.118:0/922017390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c0cf720 0x7f419c0cd360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.043+0000 7f41a2800640 1 -- 172.21.15.118:0/922017390 >> 172.21.15.118:0/922017390 conn(0x7f419c0b2860 msgr2=0x7f419c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:23.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.044+0000 7f41a2800640 1 -- 172.21.15.118:0/922017390 shutdown_connections 2024-09-21T06:04:23.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.044+0000 7f41a2800640 1 -- 172.21.15.118:0/922017390 wait complete. 2024-09-21T06:04:23.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.046+0000 7f41a2800640 1 Processor -- start 2024-09-21T06:04:23.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.046+0000 7f41a2800640 1 -- start start 2024-09-21T06:04:23.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.047+0000 7f41a2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f419c0cd8a0 0x7f419c13e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.047+0000 7f41a2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f419c0cf720 0x7f419c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.047+0000 7f41a2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c074110 0x7f419c074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.047+0000 7f41a2800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f419c070080 con 0x7f419c0cd8a0 2024-09-21T06:04:23.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.047+0000 7f41a2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f419c06ff00 con 0x7f419c0cf720 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.047+0000 7f41a2800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f419c070200 con 0x7f419c074110 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.047+0000 7f419b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f419c0cd8a0 0x7f419c13e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f419c0cd8a0 0x7f419c13e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47500/0 (socket says 172.21.15.118:47500) 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 -- 172.21.15.118:0/1088219472 learned_addr learned my addr 172.21.15.118:0/1088219472 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419be00640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c074110 0x7f419c074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f4192a00640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f419c0cf720 0x7f419c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 -- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c074110 msgr2=0x7f419c074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c074110 0x7f419c074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 -- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f419c0cf720 msgr2=0x7f419c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f419c0cf720 0x7f419c0b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 -- 172.21.15.118:0/1088219472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c0b1e10 con 0x7f419c0cd8a0 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f4192a00640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f419c0cf720 0x7f419c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.048+0000 7f419b400640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f419c0cd8a0 0x7f419c13e4f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f418c009950 tx=0x7f418c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:23.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.049+0000 7f4193e00640 1 -- 172.21.15.118:0/1088219472 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c005c90 con 0x7f419c0cd8a0 2024-09-21T06:04:23.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.049+0000 7f4193e00640 1 -- 172.21.15.118:0/1088219472 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f418c031e50 con 0x7f419c0cd8a0 2024-09-21T06:04:23.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.049+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c074a60 con 0x7f419c0cd8a0 2024-09-21T06:04:23.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.049+0000 7f4193e00640 1 -- 172.21.15.118:0/1088219472 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c005260 con 0x7f419c0cd8a0 2024-09-21T06:04:23.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.049+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c0b0d00 con 0x7f419c0cd8a0 2024-09-21T06:04:23.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.050+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c070720 con 0x7f419c0cd8a0 2024-09-21T06:04:23.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.051+0000 7f4193e00640 1 -- 172.21.15.118:0/1088219472 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f418c005400 con 0x7f419c0cd8a0 2024-09-21T06:04:23.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.052+0000 7f4193e00640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4178078b90 0x7f417807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.052+0000 7f4193e00640 1 -- 172.21.15.118:0/1088219472 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f418c0bbd30 con 0x7f419c0cd8a0 2024-09-21T06:04:23.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.053+0000 7f4192a00640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4178078b90 0x7f417807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.053+0000 7f4192a00640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4178078b90 0x7f417807b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4184007a50 tx=0x7f4184009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:23.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.056+0000 7f4193e00640 1 -- 172.21.15.118:0/1088219472 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f419c074a60 con 0x7f419c0cd8a0 2024-09-21T06:04:23.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.242+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f419c15ad80 con 0x7f419c0cd8a0 2024-09-21T06:04:23.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.242+0000 7f4193e00640 1 -- 172.21.15.118:0/1088219472 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f419c0b1e10 con 0x7f419c0cd8a0 2024-09-21T06:04:23.245 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:04:23.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.244+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4178078b90 msgr2=0x7f417807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.244+0000 7f41a2800640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4178078b90 0x7f417807b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4184007a50 tx=0x7f4184009040 comp rx=0 tx=0).stop 2024-09-21T06:04:23.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f419c0cd8a0 msgr2=0x7f419c13e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f419c0cd8a0 0x7f419c13e4f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f418c009950 tx=0x7f418c033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 shutdown_connections 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4178078b90 0x7f417807b0a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f419c074110 0x7f419c074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f419c0cf720 0x7f419c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 --2- 172.21.15.118:0/1088219472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f419c0cd8a0 0x7f419c13e4f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 >> 172.21.15.118:0/1088219472 conn(0x7f419c0b2860 msgr2=0x7f419c15eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 shutdown_connections 2024-09-21T06:04:23.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.245+0000 7f41a2800640 1 -- 172.21.15.118:0/1088219472 wait complete. 2024-09-21T06:04:23.269 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:04:23.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 -- 172.21.15.118:0/3007586831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fef0 msgr2=0x7ff11c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 --2- 172.21.15.118:0/3007586831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fef0 0x7ff11c0d13c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff11c071c00 tx=0x7ff10802a4a0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 -- 172.21.15.118:0/3007586831 shutdown_connections 2024-09-21T06:04:23.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 --2- 172.21.15.118:0/3007586831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fef0 0x7ff11c0d13c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 --2- 172.21.15.118:0/3007586831 >> v2:172.21.15.149:3300/0 conn(0x7ff11c13fae0 0x7ff11c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 -- 172.21.15.118:0/3007586831 >> 172.21.15.118:0/3007586831 conn(0x7ff11c06d110 msgr2=0x7ff11c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:23.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 -- 172.21.15.118:0/3007586831 shutdown_connections 2024-09-21T06:04:23.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.490+0000 7ff123600640 1 -- 172.21.15.118:0/3007586831 wait complete. 2024-09-21T06:04:23.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.493+0000 7ff123600640 1 Processor -- start 2024-09-21T06:04:23.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.493+0000 7ff123600640 1 -- start start 2024-09-21T06:04:23.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.494+0000 7ff123600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fae0 0x7ff11c152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.494+0000 7ff123600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff11c13fef0 0x7ff11c138740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.494+0000 7ff123600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff11c142730 0x7ff11c138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.494+0000 7ff123600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0cfa70 con 0x7ff11c13fae0 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.494+0000 7ff123600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0cf8f0 con 0x7ff11c142730 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.494+0000 7ff123600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0cfbf0 con 0x7ff11c13fef0 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fae0 0x7ff11c152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fae0 0x7ff11c152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47518/0 (socket says 172.21.15.118:47518) 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 -- 172.21.15.118:0/4152507570 learned_addr learned my addr 172.21.15.118:0/4152507570 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff11be00640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff11c13fef0 0x7ff11c138740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff121600640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff11c142730 0x7ff11c138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 -- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff11c13fef0 msgr2=0x7ff11c138740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff11c13fef0 0x7ff11c138740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 -- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff11c142730 msgr2=0x7ff11c138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff11c142730 0x7ff11c138c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 -- 172.21.15.118:0/4152507570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c1f7330 con 0x7ff11c13fae0 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.495+0000 7ff120c00640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fae0 0x7ff11c152420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff11000d740 tx=0x7ff11000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.496+0000 7ff118c00640 1 -- 172.21.15.118:0/4152507570 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110017070 con 0x7ff11c13fae0 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.496+0000 7ff118c00640 1 -- 172.21.15.118:0/4152507570 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff110009d20 con 0x7ff11c13fae0 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.496+0000 7ff118c00640 1 -- 172.21.15.118:0/4152507570 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1100106c0 con 0x7ff11c13fae0 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.496+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c1f7610 con 0x7ff11c13fae0 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.496+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c1f7bd0 con 0x7ff11c13fae0 2024-09-21T06:04:23.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.497+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c0d0110 con 0x7ff11c13fae0 2024-09-21T06:04:23.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.498+0000 7ff118c00640 1 -- 172.21.15.118:0/4152507570 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff11001a070 con 0x7ff11c13fae0 2024-09-21T06:04:23.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.499+0000 7ff118c00640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0fc078b90 0x7ff0fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.499+0000 7ff118c00640 1 -- 172.21.15.118:0/4152507570 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff11009af00 con 0x7ff11c13fae0 2024-09-21T06:04:23.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.499+0000 7ff11be00640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0fc078b90 0x7ff0fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.500+0000 7ff11be00640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0fc078b90 0x7ff0fc07b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff108034000 tx=0x7ff108004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:23.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.503+0000 7ff118c00640 1 -- 172.21.15.118:0/4152507570 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff110062c50 con 0x7ff11c13fae0 2024-09-21T06:04:23.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.689+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff11c0b55e0 con 0x7ff11c13fae0 2024-09-21T06:04:23.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.689+0000 7ff118c00640 1 -- 172.21.15.118:0/4152507570 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7ff110067680 con 0x7ff11c13fae0 2024-09-21T06:04:23.692 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0fc078b90 msgr2=0x7ff0fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0fc078b90 0x7ff0fc07b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff108034000 tx=0x7ff108004730 comp rx=0 tx=0).stop 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fae0 msgr2=0x7ff11c152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fae0 0x7ff11c152420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff11000d740 tx=0x7ff11000dc00 comp rx=0 tx=0).stop 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 shutdown_connections 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff11c142730 0x7ff11c138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0fc078b90 0x7ff0fc07b0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff11c13fef0 0x7ff11c138740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 --2- 172.21.15.118:0/4152507570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff11c13fae0 0x7ff11c152420 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 >> 172.21.15.118:0/4152507570 conn(0x7ff11c06d110 msgr2=0x7ff11c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:23.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 shutdown_connections 2024-09-21T06:04:23.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.692+0000 7ff123600640 1 -- 172.21.15.118:0/4152507570 wait complete. 2024-09-21T06:04:23.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:04:23.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.940+0000 7fa470200640 1 -- 172.21.15.118:0/3925024897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa450004800 msgr2=0x7fa450004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.940+0000 7fa470200640 1 --2- 172.21.15.118:0/3925024897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa450004800 0x7fa450004c10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa454006ed0 tx=0x7fa450005830 comp rx=0 tx=0).stop 2024-09-21T06:04:23.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.940+0000 7fa46e200640 1 -- 172.21.15.118:0/3925024897 reap_dead start 2024-09-21T06:04:23.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.940+0000 7fa470200640 1 -- 172.21.15.118:0/3925024897 shutdown_connections 2024-09-21T06:04:23.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.940+0000 7fa470200640 1 -- 172.21.15.118:0/3925024897 >> 172.21.15.118:0/3925024897 conn(0x7fa46806d110 msgr2=0x7fa46806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:23.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.940+0000 7fa470200640 1 -- 172.21.15.118:0/3925024897 shutdown_connections 2024-09-21T06:04:23.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.941+0000 7fa470200640 1 -- 172.21.15.118:0/3925024897 wait complete. 2024-09-21T06:04:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.943+0000 7fa470200640 1 Processor -- start 2024-09-21T06:04:23.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.943+0000 7fa470200640 1 -- start start 2024-09-21T06:04:23.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.944+0000 7fa470200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa450004800 0x7fa468155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.944+0000 7fa470200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa46813ef30 0x7fa4681434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.944+0000 7fa470200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa468143a30 0x7fa468143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.944+0000 7fa470200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680b3f10 con 0x7fa468143a30 2024-09-21T06:04:23.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.944+0000 7fa470200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680b3d90 con 0x7fa46813ef30 2024-09-21T06:04:23.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.944+0000 7fa470200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa468073a80 con 0x7fa450004800 2024-09-21T06:04:23.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa468143a30 0x7fa468143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa450004800 0x7fa468155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa450004800 0x7fa468155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:49072/0 (socket says 172.21.15.118:49072) 2024-09-21T06:04:23.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa468143a30 0x7fa468143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47542/0 (socket says 172.21.15.118:47542) 2024-09-21T06:04:23.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46d800640 1 -- 172.21.15.118:0/1785690532 learned_addr learned my addr 172.21.15.118:0/1785690532 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:23.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46ce00640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa46813ef30 0x7fa4681434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 -- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa450004800 msgr2=0x7fa468155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa450004800 0x7fa468155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 -- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa46813ef30 msgr2=0x7fa4681434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa46813ef30 0x7fa4681434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 -- 172.21.15.118:0/1785690532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4681e72c0 con 0x7fa468143a30 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa46e200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa468143a30 0x7fa468143e40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa468145ca0 tx=0x7fa4600064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.945+0000 7fa465600640 1 -- 172.21.15.118:0/1785690532 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46000f960 con 0x7fa468143a30 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.946+0000 7fa465600640 1 -- 172.21.15.118:0/1785690532 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa460018070 con 0x7fa468143a30 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.946+0000 7fa465600640 1 -- 172.21.15.118:0/1785690532 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46000fd40 con 0x7fa468143a30 2024-09-21T06:04:23.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.946+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4681e75a0 con 0x7fa468143a30 2024-09-21T06:04:23.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.946+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4681419c0 con 0x7fa468143a30 2024-09-21T06:04:23.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.947+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4681e77e0 con 0x7fa468143a30 2024-09-21T06:04:23.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.948+0000 7fa465600640 1 -- 172.21.15.118:0/1785690532 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa46001d460 con 0x7fa468143a30 2024-09-21T06:04:23.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.949+0000 7fa465600640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa448078b90 0x7fa44807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:23.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.949+0000 7fa465600640 1 -- 172.21.15.118:0/1785690532 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa46009b390 con 0x7fa468143a30 2024-09-21T06:04:23.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.950+0000 7fa46d800640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa448078b90 0x7fa44807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:23.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.950+0000 7fa46d800640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa448078b90 0x7fa44807b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009d50 tx=0x7fa45c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:23.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:23.953+0000 7fa465600640 1 -- 172.21.15.118:0/1785690532 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa4681e77e0 con 0x7fa468143a30 2024-09-21T06:04:24.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.136+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa4681eae70 con 0x7fa468143a30 2024-09-21T06:04:24.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.137+0000 7fa465600640 1 -- 172.21.15.118:0/1785690532 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fa4681eae70 con 0x7fa468143a30 2024-09-21T06:04:24.140 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-09-21T06:04:24.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.139+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa448078b90 msgr2=0x7fa44807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:24.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.139+0000 7fa470200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa448078b90 0x7fa44807b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009d50 tx=0x7fa45c005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:24.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.139+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa468143a30 msgr2=0x7fa468143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.139+0000 7fa470200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa468143a30 0x7fa468143e40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa468145ca0 tx=0x7fa4600064f0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 shutdown_connections 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa468143a30 0x7fa468143e40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa46813ef30 0x7fa4681434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa448078b90 0x7fa44807b0a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 --2- 172.21.15.118:0/1785690532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa450004800 0x7fa468155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 >> 172.21.15.118:0/1785690532 conn(0x7fa46806d110 msgr2=0x7fa4680d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 shutdown_connections 2024-09-21T06:04:24.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.140+0000 7fa470200640 1 -- 172.21.15.118:0/1785690532 wait complete. 2024-09-21T06:04:24.164 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-21T06:04:24.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 -- 172.21.15.118:0/3394649799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11080b62c0 msgr2=0x7f110815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:24.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 --2- 172.21.15.118:0/3394649799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11080b62c0 0x7f110815d150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f11080cee50 tx=0x7f10f002a4a0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 -- 172.21.15.118:0/3394649799 shutdown_connections 2024-09-21T06:04:24.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 --2- 172.21.15.118:0/3394649799 >> v2:172.21.15.149:3300/0 conn(0x7f110815d690 0x7f110815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 --2- 172.21.15.118:0/3394649799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11080b62c0 0x7f110815d150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 -- 172.21.15.118:0/3394649799 >> 172.21.15.118:0/3394649799 conn(0x7f110806d6e0 msgr2=0x7f11080b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:24.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 -- 172.21.15.118:0/3394649799 shutdown_connections 2024-09-21T06:04:24.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.383+0000 7f1107e00640 1 -- 172.21.15.118:0/3394649799 wait complete. 2024-09-21T06:04:24.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.385+0000 7f1107e00640 1 Processor -- start 2024-09-21T06:04:24.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.385+0000 7f1107e00640 1 -- start start 2024-09-21T06:04:24.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1107e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11081461d0 0x7f11080b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1107e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110815d690 0x7f11081f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1107e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f110813fdd0 0x7f110815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1107e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f110815fa20 con 0x7f110815d690 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1107e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f110815f8a0 con 0x7f11081461d0 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1107e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f110815fba0 con 0x7f110813fdd0 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110815d690 0x7f11081f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110815d690 0x7f11081f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47548/0 (socket says 172.21.15.118:47548) 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 -- 172.21.15.118:0/2196907192 learned_addr learned my addr 172.21.15.118:0/2196907192 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1107400640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f110813fdd0 0x7f110815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f1106a00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11081461d0 0x7f11080b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:24.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 -- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f110813fdd0 msgr2=0x7f110815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f110813fdd0 0x7f110815b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 -- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11081461d0 msgr2=0x7f11080b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11081461d0 0x7f11080b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.387+0000 7f10fe000640 1 -- 172.21.15.118:0/2196907192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110813f5f0 con 0x7f110815d690 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.388+0000 7f10fe000640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110815d690 0x7f11081f5ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009920 tx=0x7f10f0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.388+0000 7f10ff400640 1 -- 172.21.15.118:0/2196907192 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0031d60 con 0x7f110815d690 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.388+0000 7f10ff400640 1 -- 172.21.15.118:0/2196907192 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f0033e10 con 0x7f110815d690 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.388+0000 7f10ff400640 1 -- 172.21.15.118:0/2196907192 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0005260 con 0x7f110815d690 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.388+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11081f6760 con 0x7f110815d690 2024-09-21T06:04:24.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.388+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11081f61e0 con 0x7f110815d690 2024-09-21T06:04:24.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.389+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11081f64d0 con 0x7f110815d690 2024-09-21T06:04:24.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.390+0000 7f10ff400640 1 -- 172.21.15.118:0/2196907192 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10f0005400 con 0x7f110815d690 2024-09-21T06:04:24.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.391+0000 7f10ff400640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f10e4078bc0 0x7f10e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:24.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.392+0000 7f10ff400640 1 -- 172.21.15.118:0/2196907192 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f10f00bbf30 con 0x7f110815d690 2024-09-21T06:04:24.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.392+0000 7f1106a00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f10e4078bc0 0x7f10e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:24.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.393+0000 7f1106a00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f10e4078bc0 0x7f10e407b0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f10f8007fd0 tx=0x7f10f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:24.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.396+0000 7f10ff400640 1 -- 172.21.15.118:0/2196907192 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f10f003f030 con 0x7f110815d690 2024-09-21T06:04:24.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:24.653+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f1108160050 con 0x7f110815d690 2024-09-21T06:04:25.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.550+0000 7f10ff400640 1 -- 172.21.15.118:0/2196907192 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v47) ==== 133+0+0 (secure 0 0 0) 0x7f10f0084400 con 0x7f110815d690 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.553+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f10e4078bc0 msgr2=0x7f10e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.553+0000 7f1107e00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f10e4078bc0 0x7f10e407b0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f10f8007fd0 tx=0x7f10f8009040 comp rx=0 tx=0).stop 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110815d690 msgr2=0x7f11081f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110815d690 0x7f11081f5ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009920 tx=0x7f10f0033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 shutdown_connections 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f10e4078bc0 0x7f10e407b0d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f110813fdd0 0x7f110815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:25.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110815d690 0x7f11081f5ca0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:25.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 --2- 172.21.15.118:0/2196907192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11081461d0 0x7f11080b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:25.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 >> 172.21.15.118:0/2196907192 conn(0x7f110806d6e0 msgr2=0x7f11081577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:25.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 shutdown_connections 2024-09-21T06:04:25.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:25.554+0000 7f1107e00640 1 -- 172.21.15.118:0/2196907192 wait complete. 2024-09-21T06:04:25.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-21T06:04:25.822 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_objectstore":"memstore"} 2024-09-21T06:04:25.822 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-21T06:04:25.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:04:26.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 -- 172.21.15.118:0/1435872957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5040 msgr2=0x7f66580cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 --2- 172.21.15.118:0/1435872957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5040 0x7f66580cca40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6644009830 tx=0x7f664402a480 comp rx=0 tx=0).stop 2024-09-21T06:04:26.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 -- 172.21.15.118:0/1435872957 shutdown_connections 2024-09-21T06:04:26.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 --2- 172.21.15.118:0/1435872957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5040 0x7f66580cca40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 --2- 172.21.15.118:0/1435872957 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f665815cfd0 0x7f66580b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 -- 172.21.15.118:0/1435872957 >> 172.21.15.118:0/1435872957 conn(0x7f665806d110 msgr2=0x7f665806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:26.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 -- 172.21.15.118:0/1435872957 shutdown_connections 2024-09-21T06:04:26.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.040+0000 7f6660000640 1 -- 172.21.15.118:0/1435872957 wait complete. 2024-09-21T06:04:26.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.043+0000 7f6660000640 1 Processor -- start 2024-09-21T06:04:26.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.043+0000 7f6660000640 1 -- start start 2024-09-21T06:04:26.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.044+0000 7f6660000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580b5040 0x7f66581f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.044+0000 7f6660000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5450 0x7f66580ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.044+0000 7f6660000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f665815cfd0 0x7f6658134ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.044+0000 7f6660000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6658073c10 con 0x7f66580b5450 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.044+0000 7f6660000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6658073a90 con 0x7f665815cfd0 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.044+0000 7f6660000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6658073d90 con 0x7f66580b5040 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.044+0000 7f665cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5450 0x7f66580ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5450 0x7f66580ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41774/0 (socket says 172.21.15.118:41774) 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 -- 172.21.15.118:0/3804241859 learned_addr learned my addr 172.21.15.118:0/3804241859 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665d600640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580b5040 0x7f66581f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665e000640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f665815cfd0 0x7f6658134ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 -- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580b5040 msgr2=0x7f66581f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580b5040 0x7f66581f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 -- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f665815cfd0 msgr2=0x7f6658134ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f665815cfd0 0x7f6658134ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 -- 172.21.15.118:0/3804241859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6658135940 con 0x7f66580b5450 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.045+0000 7f665cc00640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5450 0x7f66580ccc90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6644009950 tx=0x7f6644033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.046+0000 7f6655600640 1 -- 172.21.15.118:0/3804241859 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644031d60 con 0x7f66580b5450 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.046+0000 7f6655600640 1 -- 172.21.15.118:0/3804241859 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6644033e10 con 0x7f66580b5450 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.046+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6658135c20 con 0x7f66580b5450 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.046+0000 7f6655600640 1 -- 172.21.15.118:0/3804241859 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644005260 con 0x7f66580b5450 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.046+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66581f4900 con 0x7f66580b5450 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.047+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66581f74c0 con 0x7f66580b5450 2024-09-21T06:04:26.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.048+0000 7f6655600640 1 -- 172.21.15.118:0/3804241859 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6644005400 con 0x7f66580b5450 2024-09-21T06:04:26.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.049+0000 7f6655600640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6638078b90 0x7f663807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.049+0000 7f6655600640 1 -- 172.21.15.118:0/3804241859 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f66440bbe30 con 0x7f66580b5450 2024-09-21T06:04:26.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.050+0000 7f665d600640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6638078b90 0x7f663807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.050+0000 7f665d600640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6638078b90 0x7f663807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f664c00bb50 tx=0x7f664c00b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:26.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.054+0000 7f6655600640 1 -- 172.21.15.118:0/3804241859 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f664403f030 con 0x7f66580b5450 2024-09-21T06:04:26.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.238+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f66580b3a60 con 0x7f66580b5450 2024-09-21T06:04:26.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.239+0000 7f6655600640 1 -- 172.21.15.118:0/3804241859 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f6644005d00 con 0x7f66580b5450 2024-09-21T06:04:26.241 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:04:26.241 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:04:26.242 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:04:26.242 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:04:26.242 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:04:26.242 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:04:26.242 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:04:26.242 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:04:26.242 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:04:26.243 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:04:26.244 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:04:26.244 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:04:26.244 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:04:26.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6638078b90 msgr2=0x7f663807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6638078b90 0x7f663807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f664c00bb50 tx=0x7f664c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5450 msgr2=0x7f66580ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5450 0x7f66580ccc90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6644009950 tx=0x7f6644033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 shutdown_connections 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f665815cfd0 0x7f6658134ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66580b5450 0x7f66580ccc90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6638078b90 0x7f663807b0a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 --2- 172.21.15.118:0/3804241859 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66580b5040 0x7f66581f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 >> 172.21.15.118:0/3804241859 conn(0x7f665806d110 msgr2=0x7f6658156310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 shutdown_connections 2024-09-21T06:04:26.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.241+0000 7f6660000640 1 -- 172.21.15.118:0/3804241859 wait complete. 2024-09-21T06:04:26.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:04:26.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 -- 172.21.15.118:0/4054088106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7540152050 msgr2=0x7f754006ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 --2- 172.21.15.118:0/4054088106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7540152050 0x7f754006ecd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7540072780 tx=0x7f752802a5f0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 -- 172.21.15.118:0/4054088106 shutdown_connections 2024-09-21T06:04:26.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 --2- 172.21.15.118:0/4054088106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7540152050 0x7f754006ecd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 --2- 172.21.15.118:0/4054088106 >> v2:172.21.15.149:3300/0 conn(0x7f75400b44c0 0x7f754015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 -- 172.21.15.118:0/4054088106 >> 172.21.15.118:0/4054088106 conn(0x7f754006d110 msgr2=0x7f754006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:26.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 -- 172.21.15.118:0/4054088106 shutdown_connections 2024-09-21T06:04:26.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.489+0000 7f7545e00640 1 -- 172.21.15.118:0/4054088106 wait complete. 2024-09-21T06:04:26.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.492+0000 7f7545e00640 1 Processor -- start 2024-09-21T06:04:26.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.492+0000 7f7545e00640 1 -- start start 2024-09-21T06:04:26.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.493+0000 7f7545e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f754006f210 0x7f75401f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.493+0000 7f7545e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75400b44c0 0x7f75401f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.493+0000 7f7545e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7540152050 0x7f75401f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.493+0000 7f7545e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7540070f40 con 0x7f75400b44c0 2024-09-21T06:04:26.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.493+0000 7f7545e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7540070dc0 con 0x7f754006f210 2024-09-21T06:04:26.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.493+0000 7f7545e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f75400cfe80 con 0x7f7540152050 2024-09-21T06:04:26.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.493+0000 7f7536000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75400b44c0 0x7f75401f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75400b44c0 0x7f75401f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41784/0 (socket says 172.21.15.118:41784) 2024-09-21T06:04:26.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 -- 172.21.15.118:0/2640381570 learned_addr learned my addr 172.21.15.118:0/2640381570 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:26.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f753ea00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f754006f210 0x7f75401f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f753f400640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7540152050 0x7f75401f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 -- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7540152050 msgr2=0x7f75401f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7540152050 0x7f75401f7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 -- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f754006f210 msgr2=0x7f75401f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f754006f210 0x7f75401f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 -- 172.21.15.118:0/2640381570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75401404d0 con 0x7f75400b44c0 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f753f400640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7540152050 0x7f75401f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.494+0000 7f7536000640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75400b44c0 0x7f75401f76c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7528009340 tx=0x7f7528003880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.495+0000 7f7537e00640 1 -- 172.21.15.118:0/2640381570 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752803f070 con 0x7f75400b44c0 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.495+0000 7f7537e00640 1 -- 172.21.15.118:0/2640381570 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75280047a0 con 0x7f75400b44c0 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.495+0000 7f7537e00640 1 -- 172.21.15.118:0/2640381570 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528035030 con 0x7f75400b44c0 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.495+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75401407b0 con 0x7f75400b44c0 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.495+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7540140d70 con 0x7f75400b44c0 2024-09-21T06:04:26.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.496+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75400b53f0 con 0x7f75400b44c0 2024-09-21T06:04:26.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.497+0000 7f7537e00640 1 -- 172.21.15.118:0/2640381570 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7528042070 con 0x7f75400b44c0 2024-09-21T06:04:26.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.498+0000 7f7537e00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f751c078b90 0x7f751c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:26.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.498+0000 7f7537e00640 1 -- 172.21.15.118:0/2640381570 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f75280bbbd0 con 0x7f75400b44c0 2024-09-21T06:04:26.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.499+0000 7f753ea00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f751c078b90 0x7f751c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:26.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.499+0000 7f753ea00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f751c078b90 0x7f751c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f753000bc50 tx=0x7f753000b3e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:26.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.503+0000 7f7537e00640 1 -- 172.21.15.118:0/2640381570 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f75400b53f0 con 0x7f75400b44c0 2024-09-21T06:04:26.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.692+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f754015f660 con 0x7f75400b44c0 2024-09-21T06:04:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.696+0000 7f7537e00640 1 -- 172.21.15.118:0/2640381570 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f7528083a50 con 0x7f75400b44c0 2024-09-21T06:04:26.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f751c078b90 msgr2=0x7f751c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f751c078b90 0x7f751c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f753000bc50 tx=0x7f753000b3e0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75400b44c0 msgr2=0x7f75401f76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75400b44c0 0x7f75401f76c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7528009340 tx=0x7f7528003880 comp rx=0 tx=0).stop 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 shutdown_connections 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f751c078b90 0x7f751c07b0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7540152050 0x7f75401f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75400b44c0 0x7f75401f76c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 --2- 172.21.15.118:0/2640381570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f754006f210 0x7f75401f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 >> 172.21.15.118:0/2640381570 conn(0x7f754006d110 msgr2=0x7f7540151760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 shutdown_connections 2024-09-21T06:04:26.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:26.699+0000 7f7545e00640 1 -- 172.21.15.118:0/2640381570 wait complete. 2024-09-21T06:04:26.724 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:04:26.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:04:26.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:04:26.911 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:04:26.912 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:26.912 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:26.947 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:26.948 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:27.022 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:27.022 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:27.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:04:27.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.357+0000 7f6e77400640 1 -- 172.21.15.118:0/4128732589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d2b20 msgr2=0x7f6e700d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.357+0000 7f6e77400640 1 --2- 172.21.15.118:0/4128732589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d2b20 0x7f6e700d3330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009830 tx=0x7f6e6002a5c0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.358+0000 7f6e77400640 1 -- 172.21.15.118:0/4128732589 shutdown_connections 2024-09-21T06:04:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.358+0000 7f6e77400640 1 --2- 172.21.15.118:0/4128732589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d2b20 0x7f6e700d3330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.358+0000 7f6e77400640 1 -- 172.21.15.118:0/4128732589 >> 172.21.15.118:0/4128732589 conn(0x7f6e700d1780 msgr2=0x7f6e700d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.358+0000 7f6e77400640 1 -- 172.21.15.118:0/4128732589 shutdown_connections 2024-09-21T06:04:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.358+0000 7f6e77400640 1 -- 172.21.15.118:0/4128732589 wait complete. 2024-09-21T06:04:27.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.360+0000 7f6e77400640 1 Processor -- start 2024-09-21T06:04:27.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.360+0000 7f6e77400640 1 -- start start 2024-09-21T06:04:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.361+0000 7f6e77400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e700b1f80 0x7f6e7015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.361+0000 7f6e77400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e700d2b20 0x7f6e700b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.361+0000 7f6e77400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d3870 0x7f6e700b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.361+0000 7f6e77400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6e700ba450 con 0x7f6e700d3870 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.361+0000 7f6e77400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7008ee20 con 0x7f6e700b1f80 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.361+0000 7f6e77400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e700ba5d0 con 0x7f6e700d2b20 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d3870 0x7f6e700b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d3870 0x7f6e700b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41814/0 (socket says 172.21.15.118:41814) 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 -- 172.21.15.118:0/1888156635 learned_addr learned my addr 172.21.15.118:0/1888156635 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e74a00640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e700b1f80 0x7f6e7015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e67e00640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e700d2b20 0x7f6e700b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 -- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e700d2b20 msgr2=0x7f6e700b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e700d2b20 0x7f6e700b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 -- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e700b1f80 msgr2=0x7f6e7015db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e700b1f80 0x7f6e7015db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 -- 172.21.15.118:0/1888156635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e701f61f0 con 0x7f6e700d3870 2024-09-21T06:04:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e67e00640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e700d2b20 0x7f6e700b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.362+0000 7f6e75400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d3870 0x7f6e700b52a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c730 tx=0x7f6e6800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.363+0000 7f6e6d600640 1 -- 172.21.15.118:0/1888156635 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68003b70 con 0x7f6e700d3870 2024-09-21T06:04:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.363+0000 7f6e6d600640 1 -- 172.21.15.118:0/1888156635 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e68003d10 con 0x7f6e700d3870 2024-09-21T06:04:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.363+0000 7f6e6d600640 1 -- 172.21.15.118:0/1888156635 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e680052d0 con 0x7f6e700d3870 2024-09-21T06:04:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.363+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e701f64d0 con 0x7f6e700d3870 2024-09-21T06:04:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.363+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e701f6a90 con 0x7f6e700d3870 2024-09-21T06:04:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.364+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e700d4ac0 con 0x7f6e700d3870 2024-09-21T06:04:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.365+0000 7f6e6d600640 1 -- 172.21.15.118:0/1888156635 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e68005470 con 0x7f6e700d3870 2024-09-21T06:04:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.366+0000 7f6e6d600640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.366+0000 7f6e6d600640 1 -- 172.21.15.118:0/1888156635 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6e6809b5b0 con 0x7f6e700d3870 2024-09-21T06:04:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.367+0000 7f6e74a00640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:27.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.367+0000 7f6e74a00640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e60034000 tx=0x7f6e60004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:27.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.369+0000 7f6e6d600640 1 -- 172.21.15.118:0/1888156635 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6e700d4ac0 con 0x7f6e700d3870 2024-09-21T06:04:27.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.570+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6e70160d20 con 0x7f6e700d3870 2024-09-21T06:04:27.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.570+0000 7f6e6d600640 1 -- 172.21.15.118:0/1888156635 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f6e680639d0 con 0x7f6e700d3870 2024-09-21T06:04:27.573 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e4c078b90 msgr2=0x7f6e4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e60034000 tx=0x7f6e60004730 comp rx=0 tx=0).stop 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d3870 msgr2=0x7f6e700b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d3870 0x7f6e700b52a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c730 tx=0x7f6e6800cb30 comp rx=0 tx=0).stop 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 shutdown_connections 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e700d3870 0x7f6e700b52a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e700d2b20 0x7f6e700b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 --2- 172.21.15.118:0/1888156635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e700b1f80 0x7f6e7015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 >> 172.21.15.118:0/1888156635 conn(0x7f6e700d1780 msgr2=0x7f6e700b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:27.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 shutdown_connections 2024-09-21T06:04:27.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:27.573+0000 7f6e77400640 1 -- 172.21.15.118:0/1888156635 wait complete. 2024-09-21T06:04:27.600 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:04:27.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:27.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T06:04:27.661 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:04:27.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:27.661 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:04:27.709 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:27.709 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:27.747 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:27.748 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:27.824 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:27.825 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:27.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:04:28.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 -- 172.21.15.118:0/3223874400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5980142e40 msgr2=0x7f59800d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 --2- 172.21.15.118:0/3223874400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5980142e40 0x7f59800d13c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5980071c00 tx=0x7f597802aa30 comp rx=0 tx=0).stop 2024-09-21T06:04:28.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 -- 172.21.15.118:0/3223874400 shutdown_connections 2024-09-21T06:04:28.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 --2- 172.21.15.118:0/3223874400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5980142e40 0x7f59800d13c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 --2- 172.21.15.118:0/3223874400 >> v2:172.21.15.149:3300/0 conn(0x7f598013fae0 0x7f59800d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 -- 172.21.15.118:0/3223874400 >> 172.21.15.118:0/3223874400 conn(0x7f598006d110 msgr2=0x7f598006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:28.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 -- 172.21.15.118:0/3223874400 shutdown_connections 2024-09-21T06:04:28.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.121+0000 7f5987800640 1 -- 172.21.15.118:0/3223874400 wait complete. 2024-09-21T06:04:28.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.124+0000 7f5987800640 1 Processor -- start 2024-09-21T06:04:28.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.124+0000 7f5987800640 1 -- start start 2024-09-21T06:04:28.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.125+0000 7f5987800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598013fae0 0x7f59801fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.125+0000 7f5987800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f598013fef0 0x7f5980152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.125+0000 7f5987800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5980142e40 0x7f598013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.125+0000 7f5987800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59800cfa70 con 0x7f598013fae0 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.125+0000 7f5987800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59800cf8f0 con 0x7f5980142e40 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.125+0000 7f5987800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59800cfbf0 con 0x7f598013fef0 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598013fae0 0x7f59801fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598013fae0 0x7f59801fa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41828/0 (socket says 172.21.15.118:41828) 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 -- 172.21.15.118:0/2691898441 learned_addr learned my addr 172.21.15.118:0/2691898441 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5985800640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5980142e40 0x7f598013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5977e00640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f598013fef0 0x7f5980152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 -- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f598013fef0 msgr2=0x7f5980152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f598013fef0 0x7f5980152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 -- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5980142e40 msgr2=0x7f598013e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5980142e40 0x7f598013e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 -- 172.21.15.118:0/2691898441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5980153040 con 0x7f598013fae0 2024-09-21T06:04:28.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5977e00640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f598013fef0 0x7f5980152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:28.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.126+0000 7f5984e00640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598013fae0 0x7f59801fa2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f597000e790 tx=0x7f597000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:28.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.127+0000 7f597d600640 1 -- 172.21.15.118:0/2691898441 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597000eea0 con 0x7f598013fae0 2024-09-21T06:04:28.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.127+0000 7f597d600640 1 -- 172.21.15.118:0/2691898441 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597000cdb0 con 0x7f598013fae0 2024-09-21T06:04:28.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.127+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59801f6540 con 0x7f598013fae0 2024-09-21T06:04:28.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.127+0000 7f597d600640 1 -- 172.21.15.118:0/2691898441 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970010690 con 0x7f598013fae0 2024-09-21T06:04:28.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.127+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59801f6b00 con 0x7f598013fae0 2024-09-21T06:04:28.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.128+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59800d0110 con 0x7f598013fae0 2024-09-21T06:04:28.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.129+0000 7f597d600640 1 -- 172.21.15.118:0/2691898441 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5970010830 con 0x7f598013fae0 2024-09-21T06:04:28.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.130+0000 7f597d600640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f595c078b90 0x7f595c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.130+0000 7f597d600640 1 -- 172.21.15.118:0/2691898441 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f597009b6f0 con 0x7f598013fae0 2024-09-21T06:04:28.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.130+0000 7f5977e00640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f595c078b90 0x7f595c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.131+0000 7f5977e00640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f595c078b90 0x7f595c07b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5968007fd0 tx=0x7f5968009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:28.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.135+0000 7f597d600640 1 -- 172.21.15.118:0/2691898441 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f59700634d0 con 0x7f598013fae0 2024-09-21T06:04:28.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.334+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f59801604e0 con 0x7f598013fae0 2024-09-21T06:04:28.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.334+0000 7f597d600640 1 -- 172.21.15.118:0/2691898441 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f5970067f00 con 0x7f598013fae0 2024-09-21T06:04:28.337 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:04:28.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f595c078b90 msgr2=0x7f595c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f595c078b90 0x7f595c07b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5968007fd0 tx=0x7f5968009040 comp rx=0 tx=0).stop 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598013fae0 msgr2=0x7f59801fa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598013fae0 0x7f59801fa2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f597000e790 tx=0x7f597000ec50 comp rx=0 tx=0).stop 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 shutdown_connections 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5980142e40 0x7f598013e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f595c078b90 0x7f595c07b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f598013fef0 0x7f5980152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 --2- 172.21.15.118:0/2691898441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f598013fae0 0x7f59801fa2c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 >> 172.21.15.118:0/2691898441 conn(0x7f598006d110 msgr2=0x7f5980153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 shutdown_connections 2024-09-21T06:04:28.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.337+0000 7f5987800640 1 -- 172.21.15.118:0/2691898441 wait complete. 2024-09-21T06:04:28.361 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:04:28.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:28.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T06:04:28.426 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:04:28.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:28.426 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:04:28.473 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:28.473 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:28.508 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:28.508 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:28.583 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:28.583 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:28.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:04:28.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.918+0000 7ff272400640 1 -- 172.21.15.118:0/2188717313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c073fa0 msgr2=0x7ff26c0749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.918+0000 7ff272400640 1 --2- 172.21.15.118:0/2188717313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c073fa0 0x7ff26c0749f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009830 tx=0x7ff25c02a480 comp rx=0 tx=0).stop 2024-09-21T06:04:28.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.918+0000 7ff272400640 1 -- 172.21.15.118:0/2188717313 shutdown_connections 2024-09-21T06:04:28.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.918+0000 7ff272400640 1 --2- 172.21.15.118:0/2188717313 >> v2:172.21.15.149:3300/0 conn(0x7ff26c0b62c0 0x7ff26c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.918+0000 7ff272400640 1 --2- 172.21.15.118:0/2188717313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c073fa0 0x7ff26c0749f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.918+0000 7ff272400640 1 -- 172.21.15.118:0/2188717313 >> 172.21.15.118:0/2188717313 conn(0x7ff26c06d6e0 msgr2=0x7ff26c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:28.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.918+0000 7ff272400640 1 -- 172.21.15.118:0/2188717313 shutdown_connections 2024-09-21T06:04:28.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.919+0000 7ff272400640 1 -- 172.21.15.118:0/2188717313 wait complete. 2024-09-21T06:04:28.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.921+0000 7ff272400640 1 Processor -- start 2024-09-21T06:04:28.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.921+0000 7ff272400640 1 -- start start 2024-09-21T06:04:28.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.922+0000 7ff272400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff26c073fa0 0x7ff26c0cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.922+0000 7ff272400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c0cfe30 0x7ff26c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.922+0000 7ff272400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff26c15a070 0x7ff26c0c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.922+0000 7ff272400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c15d9c0 con 0x7ff26c15a070 2024-09-21T06:04:28.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.922+0000 7ff272400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c15d840 con 0x7ff26c073fa0 2024-09-21T06:04:28.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.922+0000 7ff272400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c15db40 con 0x7ff26c0cfe30 2024-09-21T06:04:28.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff26c15a070 0x7ff26c0c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff26c15a070 0x7ff26c0c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41838/0 (socket says 172.21.15.118:41838) 2024-09-21T06:04:28.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 -- 172.21.15.118:0/4003886136 learned_addr learned my addr 172.21.15.118:0/4003886136 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:28.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271000640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff26c073fa0 0x7ff26c0cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff263e00640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c0cfe30 0x7ff26c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 -- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c0cfe30 msgr2=0x7ff26c159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c0cfe30 0x7ff26c159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 -- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff26c073fa0 msgr2=0x7ff26c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff26c073fa0 0x7ff26c0cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.923+0000 7ff271a00640 1 -- 172.21.15.118:0/4003886136 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c1f3b00 con 0x7ff26c15a070 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.924+0000 7ff271a00640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff26c15a070 0x7ff26c0c6860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff26400ec50 tx=0x7ff26400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.924+0000 7ff269600640 1 -- 172.21.15.118:0/4003886136 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264003b70 con 0x7ff26c15a070 2024-09-21T06:04:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.924+0000 7ff269600640 1 -- 172.21.15.118:0/4003886136 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff264003d10 con 0x7ff26c15a070 2024-09-21T06:04:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.924+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c1f3de0 con 0x7ff26c15a070 2024-09-21T06:04:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.924+0000 7ff269600640 1 -- 172.21.15.118:0/4003886136 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264004280 con 0x7ff26c15a070 2024-09-21T06:04:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.924+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c0c78e0 con 0x7ff26c15a070 2024-09-21T06:04:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.925+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26c15e030 con 0x7ff26c15a070 2024-09-21T06:04:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.926+0000 7ff269600640 1 -- 172.21.15.118:0/4003886136 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff264004420 con 0x7ff26c15a070 2024-09-21T06:04:28.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.927+0000 7ff269600640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff248078bc0 0x7ff24807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:28.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.927+0000 7ff269600640 1 -- 172.21.15.118:0/4003886136 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff26409b930 con 0x7ff26c15a070 2024-09-21T06:04:28.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.928+0000 7ff271000640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff248078bc0 0x7ff24807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:28.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.929+0000 7ff271000640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff248078bc0 0x7ff24807b0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff25c034000 tx=0x7ff25c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:28.932+0000 7ff269600640 1 -- 172.21.15.118:0/4003886136 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff2640637b0 con 0x7ff26c15a070 2024-09-21T06:04:29.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.129+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff26c145db0 con 0x7ff26c15a070 2024-09-21T06:04:29.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.130+0000 7ff269600640 1 -- 172.21.15.118:0/4003886136 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7ff2640681e0 con 0x7ff26c15a070 2024-09-21T06:04:29.133 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:04:29.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff248078bc0 msgr2=0x7ff24807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:29.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff248078bc0 0x7ff24807b0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff25c034000 tx=0x7ff25c004730 comp rx=0 tx=0).stop 2024-09-21T06:04:29.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff26c15a070 msgr2=0x7ff26c0c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:29.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff26c15a070 0x7ff26c0c6860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff26400ec50 tx=0x7ff26400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 shutdown_connections 2024-09-21T06:04:29.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff26c15a070 0x7ff26c0c6860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff248078bc0 0x7ff24807b0d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff26c0cfe30 0x7ff26c159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 --2- 172.21.15.118:0/4003886136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff26c073fa0 0x7ff26c0cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 >> 172.21.15.118:0/4003886136 conn(0x7ff26c06d6e0 msgr2=0x7ff26c0749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:29.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 shutdown_connections 2024-09-21T06:04:29.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.132+0000 7ff272400640 1 -- 172.21.15.118:0/4003886136 wait complete. 2024-09-21T06:04:29.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T06:04:29.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:29.157 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T06:04:29.216 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:04:29.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:29.216 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T06:04:29.252 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:29.252 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:29.291 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:29.291 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:29.368 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:29.368 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:29.444 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:04:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 -- 172.21.15.118:0/1939601661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08980d1590 msgr2=0x7f0898142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 --2- 172.21.15.118:0/1939601661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08980d1590 0x7f0898142730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0884009830 tx=0x7f088402a480 comp rx=0 tx=0).stop 2024-09-21T06:04:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 -- 172.21.15.118:0/1939601661 shutdown_connections 2024-09-21T06:04:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 --2- 172.21.15.118:0/1939601661 >> v2:172.21.15.149:3300/0 conn(0x7f089813fef0 0x7f0898142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 --2- 172.21.15.118:0/1939601661 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08980d1590 0x7f0898142730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 -- 172.21.15.118:0/1939601661 >> 172.21.15.118:0/1939601661 conn(0x7f089806d110 msgr2=0x7f089806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 -- 172.21.15.118:0/1939601661 shutdown_connections 2024-09-21T06:04:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.662+0000 7f089e800640 1 -- 172.21.15.118:0/1939601661 wait complete. 2024-09-21T06:04:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.663+0000 7f089e800640 1 Processor -- start 2024-09-21T06:04:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.663+0000 7f089e800640 1 -- start start 2024-09-21T06:04:29.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.665+0000 7f089e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f089813fae0 0x7f08981527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:29.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.665+0000 7f089e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089813fef0 0x7f08980cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:29.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.665+0000 7f089e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0898140dd0 0x7f0898139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:29.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.665+0000 7f089e800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f08980cfb10 con 0x7f0898140dd0 2024-09-21T06:04:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.665+0000 7f089e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f08980cf990 con 0x7f089813fef0 2024-09-21T06:04:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.665+0000 7f089e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08980cfc90 con 0x7f089813fae0 2024-09-21T06:04:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0898140dd0 0x7f0898139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0898140dd0 0x7f0898139c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41846/0 (socket says 172.21.15.118:41846) 2024-09-21T06:04:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 -- 172.21.15.118:0/3127369025 learned_addr learned my addr 172.21.15.118:0/3127369025 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897400640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f089813fae0 0x7f08981527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:29.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0896a00640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089813fef0 0x7f08980cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 -- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f089813fae0 msgr2=0x7f08981527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f089813fae0 0x7f08981527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 -- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089813fef0 msgr2=0x7f08980cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089813fef0 0x7f08980cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.666+0000 7f0897e00640 1 -- 172.21.15.118:0/3127369025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0898073a50 con 0x7f0898140dd0 2024-09-21T06:04:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.667+0000 7f0897e00640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0898140dd0 0x7f0898139c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f089000ef00 tx=0x7f089000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:29.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.667+0000 7f088f400640 1 -- 172.21.15.118:0/3127369025 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890003970 con 0x7f0898140dd0 2024-09-21T06:04:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.667+0000 7f088f400640 1 -- 172.21.15.118:0/3127369025 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0890003c00 con 0x7f0898140dd0 2024-09-21T06:04:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.667+0000 7f088f400640 1 -- 172.21.15.118:0/3127369025 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890004020 con 0x7f0898140dd0 2024-09-21T06:04:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.667+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0898073d30 con 0x7f0898140dd0 2024-09-21T06:04:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.667+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08980742f0 con 0x7f0898140dd0 2024-09-21T06:04:29.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.668+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08980d0140 con 0x7f0898140dd0 2024-09-21T06:04:29.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.669+0000 7f088f400640 1 -- 172.21.15.118:0/3127369025 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f08900041c0 con 0x7f0898140dd0 2024-09-21T06:04:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.670+0000 7f088f400640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0878078b90 0x7f087807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.671+0000 7f088f400640 1 -- 172.21.15.118:0/3127369025 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f089009b580 con 0x7f0898140dd0 2024-09-21T06:04:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.671+0000 7f0897400640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0878078b90 0x7f087807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:29.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.671+0000 7f0897400640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0878078b90 0x7f087807b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0888000f60 tx=0x7f0888009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:29.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.675+0000 7f088f400640 1 -- 172.21.15.118:0/3127369025 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0890063370 con 0x7f0898140dd0 2024-09-21T06:04:29.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.869+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f08981538d0 con 0x7f0898140dd0 2024-09-21T06:04:29.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.870+0000 7f088f400640 1 -- 172.21.15.118:0/3127369025 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f0890067da0 con 0x7f0898140dd0 2024-09-21T06:04:29.872 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0878078b90 msgr2=0x7f087807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0878078b90 0x7f087807b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0888000f60 tx=0x7f0888009040 comp rx=0 tx=0).stop 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0898140dd0 msgr2=0x7f0898139c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0898140dd0 0x7f0898139c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f089000ef00 tx=0x7f089000c740 comp rx=0 tx=0).stop 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 shutdown_connections 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0898140dd0 0x7f0898139c50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089813fef0 0x7f08980cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0878078b90 0x7f087807b0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 --2- 172.21.15.118:0/3127369025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f089813fae0 0x7f08981527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:29.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 >> 172.21.15.118:0/3127369025 conn(0x7f089806d110 msgr2=0x7f08980d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:29.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 shutdown_connections 2024-09-21T06:04:29.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:29.872+0000 7f089e800640 1 -- 172.21.15.118:0/3127369025 wait complete. 2024-09-21T06:04:29.897 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T06:04:29.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:29.897 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T06:04:29.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:04:29.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:29.960 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T06:04:29.996 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:04:29.996 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:30.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.215+0000 7febd8800640 1 -- 172.21.15.118:0/1096905732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd00d1590 msgr2=0x7febd0142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.215+0000 7febd8800640 1 --2- 172.21.15.118:0/1096905732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd00d1590 0x7febd0142730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febc0009830 tx=0x7febc002a520 comp rx=0 tx=0).stop 2024-09-21T06:04:30.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.215+0000 7febd8800640 1 -- 172.21.15.118:0/1096905732 shutdown_connections 2024-09-21T06:04:30.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.215+0000 7febd8800640 1 --2- 172.21.15.118:0/1096905732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd00d1590 0x7febd0142730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.215+0000 7febd8800640 1 -- 172.21.15.118:0/1096905732 >> 172.21.15.118:0/1096905732 conn(0x7febd006d110 msgr2=0x7febd006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:30.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.216+0000 7febd8800640 1 -- 172.21.15.118:0/1096905732 shutdown_connections 2024-09-21T06:04:30.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.216+0000 7febd8800640 1 -- 172.21.15.118:0/1096905732 wait complete. 2024-09-21T06:04:30.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.218+0000 7febd8800640 1 Processor -- start 2024-09-21T06:04:30.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.218+0000 7febd8800640 1 -- start start 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.219+0000 7febd8800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd013fae0 0x7febd0139380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.219+0000 7febd8800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd013fef0 0x7febd013d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.219+0000 7febd8800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febd0160240 0x7febd013da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.219+0000 7febd8800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7febd0168280 con 0x7febd013fef0 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.219+0000 7febd8800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7febd0168100 con 0x7febd013fae0 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.219+0000 7febd8800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7febd0168400 con 0x7febd0160240 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd013fef0 0x7febd013d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd013fef0 0x7febd013d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41856/0 (socket says 172.21.15.118:41856) 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 -- 172.21.15.118:0/3246580464 learned_addr learned my addr 172.21.15.118:0/3246580464 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:30.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5e00640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd013fae0 0x7febd0139380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd6800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febd0160240 0x7febd013da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 -- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febd0160240 msgr2=0x7febd013da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febd0160240 0x7febd013da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 -- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd013fae0 msgr2=0x7febd0139380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd013fae0 0x7febd0139380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 -- 172.21.15.118:0/3246580464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd015ce50 con 0x7febd013fef0 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd6800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febd0160240 0x7febd013da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:30.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.220+0000 7febd5400640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd013fef0 0x7febd013d500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7febc002ab10 tx=0x7febc0033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:30.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.221+0000 7febca000640 1 -- 172.21.15.118:0/3246580464 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc0031b50 con 0x7febd013fef0 2024-09-21T06:04:30.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.221+0000 7febca000640 1 -- 172.21.15.118:0/3246580464 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febc0031de0 con 0x7febd013fef0 2024-09-21T06:04:30.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.221+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd01f7a40 con 0x7febd013fef0 2024-09-21T06:04:30.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.221+0000 7febca000640 1 -- 172.21.15.118:0/3246580464 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc0005280 con 0x7febd013fef0 2024-09-21T06:04:30.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.221+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd015b150 con 0x7febd013fef0 2024-09-21T06:04:30.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.222+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd015c840 con 0x7febd013fef0 2024-09-21T06:04:30.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.223+0000 7febca000640 1 -- 172.21.15.118:0/3246580464 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febc0005420 con 0x7febd013fef0 2024-09-21T06:04:30.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.224+0000 7febca000640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7febb4078bc0 0x7febb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.225+0000 7febca000640 1 -- 172.21.15.118:0/3246580464 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7febc00bbe20 con 0x7febd013fef0 2024-09-21T06:04:30.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.225+0000 7febd5e00640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7febb4078bc0 0x7febb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.226+0000 7febd5e00640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7febb4078bc0 0x7febb407b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7febc4000f60 tx=0x7febc4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:30.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.229+0000 7febca000640 1 -- 172.21.15.118:0/3246580464 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7febc003f030 con 0x7febd013fef0 2024-09-21T06:04:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.450+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febd01f7840 con 0x7febd013fef0 2024-09-21T06:04:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.450+0000 7febca000640 1 -- 172.21.15.118:0/3246580464 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7febc0031770 con 0x7febd013fef0 2024-09-21T06:04:30.452 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:30.452 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:04:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:04:30.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.452+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7febb4078bc0 msgr2=0x7febb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.452+0000 7febd8800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7febb4078bc0 0x7febb407b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7febc4000f60 tx=0x7febc4009040 comp rx=0 tx=0).stop 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.452+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd013fef0 msgr2=0x7febd013d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.452+0000 7febd8800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd013fef0 0x7febd013d500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7febc002ab10 tx=0x7febc0033ba0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 shutdown_connections 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7febb4078bc0 0x7febb407b0d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febd0160240 0x7febd013da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd013fef0 0x7febd013d500 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 --2- 172.21.15.118:0/3246580464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd013fae0 0x7febd0139380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 >> 172.21.15.118:0/3246580464 conn(0x7febd006d110 msgr2=0x7febd015e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 shutdown_connections 2024-09-21T06:04:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.453+0000 7febd8800640 1 -- 172.21.15.118:0/3246580464 wait complete. 2024-09-21T06:04:30.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 -- 172.21.15.118:0/211376734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2344144ea0 msgr2=0x7f2344144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 --2- 172.21.15.118:0/211376734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2344144ea0 0x7f2344144760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23440afd60 tx=0x7f233402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 -- 172.21.15.118:0/211376734 shutdown_connections 2024-09-21T06:04:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 --2- 172.21.15.118:0/211376734 >> v2:172.21.15.149:3300/0 conn(0x7f23440cedb0 0x7f23440cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 --2- 172.21.15.118:0/211376734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2344144ea0 0x7f2344144760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 -- 172.21.15.118:0/211376734 >> 172.21.15.118:0/211376734 conn(0x7f234406d6e0 msgr2=0x7f23440b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 -- 172.21.15.118:0/211376734 shutdown_connections 2024-09-21T06:04:30.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.700+0000 7f2348e00640 1 -- 172.21.15.118:0/211376734 wait complete. 2024-09-21T06:04:30.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.702+0000 7f2348e00640 1 Processor -- start 2024-09-21T06:04:30.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.702+0000 7f2348e00640 1 -- start start 2024-09-21T06:04:30.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2348e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23440cedb0 0x7f234415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2348e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23440cf700 0x7f23440ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2348e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2344144ea0 0x7f23440aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2348e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f234415fe40 con 0x7f23440cedb0 2024-09-21T06:04:30.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2348e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23440b53a0 con 0x7f2344144ea0 2024-09-21T06:04:30.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2348e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f234415ffc0 con 0x7f23440cf700 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2343400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23440cedb0 0x7f234415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2343400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23440cedb0 0x7f234415eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41878/0 (socket says 172.21.15.118:41878) 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.704+0000 7f2343400640 1 -- 172.21.15.118:0/3351905163 learned_addr learned my addr 172.21.15.118:0/3351905163 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f233aa00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23440cf700 0x7f23440ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2343e00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2344144ea0 0x7f23440aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2343400640 1 -- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23440cf700 msgr2=0x7f23440ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2343400640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23440cf700 0x7f23440ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2343400640 1 -- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2344144ea0 msgr2=0x7f23440aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2343400640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2344144ea0 0x7f23440aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2343400640 1 -- 172.21.15.118:0/3351905163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234413c130 con 0x7f23440cedb0 2024-09-21T06:04:30.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2343400640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23440cedb0 0x7f234415eb50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2334009780 tx=0x7f2334033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:30.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f233be00640 1 -- 172.21.15.118:0/3351905163 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334031d60 con 0x7f23440cedb0 2024-09-21T06:04:30.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f233be00640 1 -- 172.21.15.118:0/3351905163 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2334033e10 con 0x7f23440cedb0 2024-09-21T06:04:30.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f233be00640 1 -- 172.21.15.118:0/3351905163 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334005260 con 0x7f23440cedb0 2024-09-21T06:04:30.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2344143a60 con 0x7f23440cedb0 2024-09-21T06:04:30.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.705+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234413af70 con 0x7f23440cedb0 2024-09-21T06:04:30.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.707+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234413c5e0 con 0x7f23440cedb0 2024-09-21T06:04:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.708+0000 7f233be00640 1 -- 172.21.15.118:0/3351905163 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2334005400 con 0x7f23440cedb0 2024-09-21T06:04:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.709+0000 7f233be00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2320078b90 0x7f232007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.709+0000 7f233be00640 1 -- 172.21.15.118:0/3351905163 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23340bbf60 con 0x7f23440cedb0 2024-09-21T06:04:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.709+0000 7f233aa00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2320078b90 0x7f232007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:30.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.710+0000 7f233aa00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2320078b90 0x7f232007b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f234413ff00 tx=0x7f232c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:30.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.715+0000 7f233be00640 1 -- 172.21.15.118:0/3351905163 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f234413c5e0 con 0x7f23440cedb0 2024-09-21T06:04:30.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.937+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2344160470 con 0x7f23440cedb0 2024-09-21T06:04:30.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.938+0000 7f233be00640 1 -- 172.21.15.118:0/3351905163 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f233403f030 con 0x7f23440cedb0 2024-09-21T06:04:30.939 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:30.939 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:04:30.940 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:04:30.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2320078b90 msgr2=0x7f232007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2320078b90 0x7f232007b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f234413ff00 tx=0x7f232c005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:30.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23440cedb0 msgr2=0x7f234415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:30.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23440cedb0 0x7f234415eb50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2334009780 tx=0x7f2334033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:30.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 shutdown_connections 2024-09-21T06:04:30.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2344144ea0 0x7f23440aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2320078b90 0x7f232007b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23440cf700 0x7f23440ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 --2- 172.21.15.118:0/3351905163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23440cedb0 0x7f234415eb50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:30.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.940+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 >> 172.21.15.118:0/3351905163 conn(0x7f234406d6e0 msgr2=0x7f23440b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:30.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.941+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 shutdown_connections 2024-09-21T06:04:30.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:30.941+0000 7f2348e00640 1 -- 172.21.15.118:0/3351905163 wait complete. 2024-09-21T06:04:30.967 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2329869330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 msgr2=0x7f8ee015f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2329869330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee015f660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8ee008da80 tx=0x7f8ec802a5f0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2329869330 shutdown_connections 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2329869330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee015f660 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2329869330 >> v2:172.21.15.149:3300/0 conn(0x7f8ee01634f0 0x7f8ee00d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2329869330 >> 172.21.15.118:0/2329869330 conn(0x7f8ee006d1c0 msgr2=0x7f8ee006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2329869330 shutdown_connections 2024-09-21T06:04:31.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.186+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2329869330 wait complete. 2024-09-21T06:04:31.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.188+0000 7f8ee5a00640 1 Processor -- start 2024-09-21T06:04:31.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.188+0000 7f8ee5a00640 1 -- start start 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ee015fba0 0x7f8ee00ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ee01634f0 0x7f8ee015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee00d3aa0 con 0x7f8ee0163900 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee00d3920 con 0x7f8ee015fba0 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee00d3c20 con 0x7f8ee01634f0 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee00ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41882/0 (socket says 172.21.15.118:41882) 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 -- 172.21.15.118:0/2600437288 learned_addr learned my addr 172.21.15.118:0/2600437288 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8edfe00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ee015fba0 0x7f8ee00ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ed7400640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ee01634f0 0x7f8ee015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 -- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ee01634f0 msgr2=0x7f8ee015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ee01634f0 0x7f8ee015f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 -- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ee015fba0 msgr2=0x7f8ee00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ee015fba0 0x7f8ee00ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.190+0000 7f8ee5000640 1 -- 172.21.15.118:0/2600437288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee0157d80 con 0x7f8ee0163900 2024-09-21T06:04:31.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.191+0000 7f8ee5000640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee00ccd70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c700 tx=0x7f8ed800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.191+0000 7f8edcc00640 1 -- 172.21.15.118:0/2600437288 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8003b70 con 0x7f8ee0163900 2024-09-21T06:04:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.191+0000 7f8edcc00640 1 -- 172.21.15.118:0/2600437288 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ed8003d10 con 0x7f8ee0163900 2024-09-21T06:04:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.191+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee015e180 con 0x7f8ee0163900 2024-09-21T06:04:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.191+0000 7f8edcc00640 1 -- 172.21.15.118:0/2600437288 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800aab0 con 0x7f8ee0163900 2024-09-21T06:04:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.191+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee015e740 con 0x7f8ee0163900 2024-09-21T06:04:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.192+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee00d02e0 con 0x7f8ee0163900 2024-09-21T06:04:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.193+0000 7f8edcc00640 1 -- 172.21.15.118:0/2600437288 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ed800ac50 con 0x7f8ee0163900 2024-09-21T06:04:31.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.195+0000 7f8edcc00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ebc078b90 0x7f8ebc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.195+0000 7f8edcc00640 1 -- 172.21.15.118:0/2600437288 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ed809aa90 con 0x7f8ee0163900 2024-09-21T06:04:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.195+0000 7f8edfe00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ebc078b90 0x7f8ebc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.196+0000 7f8edfe00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ebc078b90 0x7f8ebc07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000bb50 tx=0x7f8ed000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:31.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.200+0000 7f8edcc00640 1 -- 172.21.15.118:0/2600437288 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ed80627e0 con 0x7f8ee0163900 2024-09-21T06:04:31.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.386+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ee00ce700 con 0x7f8ee0163900 2024-09-21T06:04:31.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.387+0000 7f8edcc00640 1 -- 172.21.15.118:0/2600437288 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16737 (secure 0 0 0) 0x7f8ed8067210 con 0x7f8ee0163900 2024-09-21T06:04:31.389 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:31.389 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:57.424251+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:31.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ebc078b90 msgr2=0x7f8ebc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ebc078b90 0x7f8ebc07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000bb50 tx=0x7f8ed000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 msgr2=0x7f8ee00ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee00ccd70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c700 tx=0x7f8ed800cbc0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 shutdown_connections 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ee0163900 0x7f8ee00ccd70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ebc078b90 0x7f8ebc07b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ee01634f0 0x7f8ee015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 --2- 172.21.15.118:0/2600437288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ee015fba0 0x7f8ee00ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 >> 172.21.15.118:0/2600437288 conn(0x7f8ee006d1c0 msgr2=0x7f8ee00b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 shutdown_connections 2024-09-21T06:04:31.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.390+0000 7f8ee5a00640 1 -- 172.21.15.118:0/2600437288 wait complete. 2024-09-21T06:04:31.416 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:04:31.417 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:31.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.632+0000 7f9e2dc00640 1 -- 172.21.15.118:0/3565880341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 msgr2=0x7f9e2815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.632+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/3565880341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e2815f660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009900 tx=0x7f9e1802a580 comp rx=0 tx=0).stop 2024-09-21T06:04:31.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.633+0000 7f9e2dc00640 1 -- 172.21.15.118:0/3565880341 shutdown_connections 2024-09-21T06:04:31.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.633+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/3565880341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e28152050 0x7f9e2806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.633+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/3565880341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e2815f660 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.633+0000 7f9e2dc00640 1 -- 172.21.15.118:0/3565880341 >> 172.21.15.118:0/3565880341 conn(0x7f9e2806d110 msgr2=0x7f9e2806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:31.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.633+0000 7f9e2dc00640 1 -- 172.21.15.118:0/3565880341 shutdown_connections 2024-09-21T06:04:31.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.633+0000 7f9e2dc00640 1 -- 172.21.15.118:0/3565880341 wait complete. 2024-09-21T06:04:31.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.635+0000 7f9e2dc00640 1 Processor -- start 2024-09-21T06:04:31.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.635+0000 7f9e2dc00640 1 -- start start 2024-09-21T06:04:31.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.636+0000 7f9e2dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e2806f210 0x7f9e281514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.636+0000 7f9e2dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e28159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.636+0000 7f9e2dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e28152050 0x7f9e2815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.636+0000 7f9e2dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9e28070f40 con 0x7f9e280b44c0 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.636+0000 7f9e2dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e28070dc0 con 0x7f9e2806f210 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.636+0000 7f9e2dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e280cfe80 con 0x7f9e28152050 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e28159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e28159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41908/0 (socket says 172.21.15.118:41908) 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 -- 172.21.15.118:0/1047034168 learned_addr learned my addr 172.21.15.118:0/1047034168 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26a00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e2806f210 0x7f9e281514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e27400640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e28152050 0x7f9e2815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 -- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e28152050 msgr2=0x7f9e2815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e28152050 0x7f9e2815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 -- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e2806f210 msgr2=0x7f9e281514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e2806f210 0x7f9e281514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 -- 172.21.15.118:0/1047034168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e281484a0 con 0x7f9e280b44c0 2024-09-21T06:04:31.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.637+0000 7f9e26000640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e28159f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d700 tx=0x7f9e1400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:31.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.638+0000 7f9e1ea00640 1 -- 172.21.15.118:0/1047034168 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14017070 con 0x7f9e280b44c0 2024-09-21T06:04:31.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.638+0000 7f9e1ea00640 1 -- 172.21.15.118:0/1047034168 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e14005310 con 0x7f9e280b44c0 2024-09-21T06:04:31.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.638+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2814e500 con 0x7f9e280b44c0 2024-09-21T06:04:31.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.638+0000 7f9e1ea00640 1 -- 172.21.15.118:0/1047034168 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14009820 con 0x7f9e280b44c0 2024-09-21T06:04:31.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.638+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e28148a20 con 0x7f9e280b44c0 2024-09-21T06:04:31.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.639+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2815f660 con 0x7f9e280b44c0 2024-09-21T06:04:31.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.640+0000 7f9e1ea00640 1 -- 172.21.15.118:0/1047034168 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e140099c0 con 0x7f9e280b44c0 2024-09-21T06:04:31.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.641+0000 7f9e1ea00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e08078b90 0x7f9e0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:31.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.641+0000 7f9e1ea00640 1 -- 172.21.15.118:0/1047034168 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9e1409ae70 con 0x7f9e280b44c0 2024-09-21T06:04:31.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.642+0000 7f9e26a00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e08078b90 0x7f9e0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:31.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.642+0000 7f9e26a00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e08078b90 0x7f9e0807b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e18033000 tx=0x7f9e18004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:31.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.646+0000 7f9e1ea00640 1 -- 172.21.15.118:0/1047034168 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e14062bc0 con 0x7f9e280b44c0 2024-09-21T06:04:31.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.868+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e2814ef20 con 0x7f9e280b44c0 2024-09-21T06:04:31.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.869+0000 7f9e1ea00640 1 -- 172.21.15.118:0/1047034168 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f9e140675f0 con 0x7f9e280b44c0 2024-09-21T06:04:31.870 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:31.870 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:04:31.870 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e08078b90 msgr2=0x7f9e0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e08078b90 0x7f9e0807b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e18033000 tx=0x7f9e18004730 comp rx=0 tx=0).stop 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 msgr2=0x7f9e28159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e28159f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d700 tx=0x7f9e1400dbc0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 shutdown_connections 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e08078b90 0x7f9e0807b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e28152050 0x7f9e2815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e280b44c0 0x7f9e28159f80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 --2- 172.21.15.118:0/1047034168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e2806f210 0x7f9e281514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 >> 172.21.15.118:0/1047034168 conn(0x7f9e2806d110 msgr2=0x7f9e2814a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 shutdown_connections 2024-09-21T06:04:31.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:31.871+0000 7f9e2dc00640 1 -- 172.21.15.118:0/1047034168 wait complete. 2024-09-21T06:04:31.895 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:32.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 -- 172.21.15.118:0/2947674023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 msgr2=0x7f723c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 --2- 172.21.15.118:0/2947674023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c0d13c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f723c071c00 tx=0x7f722802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 -- 172.21.15.118:0/2947674023 shutdown_connections 2024-09-21T06:04:32.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 --2- 172.21.15.118:0/2947674023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c0d13c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 --2- 172.21.15.118:0/2947674023 >> v2:172.21.15.149:3300/0 conn(0x7f723c13fae0 0x7f723c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 -- 172.21.15.118:0/2947674023 >> 172.21.15.118:0/2947674023 conn(0x7f723c06d110 msgr2=0x7f723c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:32.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 -- 172.21.15.118:0/2947674023 shutdown_connections 2024-09-21T06:04:32.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.111+0000 7f7241c00640 1 -- 172.21.15.118:0/2947674023 wait complete. 2024-09-21T06:04:32.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.114+0000 7f7241c00640 1 Processor -- start 2024-09-21T06:04:32.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.114+0000 7f7241c00640 1 -- start start 2024-09-21T06:04:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.115+0000 7f7241c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f723c13fae0 0x7f723c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.115+0000 7f7241c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.115+0000 7f7241c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c142730 0x7f723c0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.115+0000 7f7241c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0cfa70 con 0x7f723c13fef0 2024-09-21T06:04:32.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.115+0000 7f7241c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0cf8f0 con 0x7f723c142730 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.115+0000 7f7241c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f723c0cfbf0 con 0x7f723c13fae0 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.115+0000 7f723a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c131f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41926/0 (socket says 172.21.15.118:41926) 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 -- 172.21.15.118:0/780898373 learned_addr learned my addr 172.21.15.118:0/780898373 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723b400640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c142730 0x7f723c0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723aa00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f723c13fae0 0x7f723c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 -- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f723c13fae0 msgr2=0x7f723c1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f723c13fae0 0x7f723c1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 -- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c142730 msgr2=0x7f723c0b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c142730 0x7f723c0b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 -- 172.21.15.118:0/780898373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c1558e0 con 0x7f723c13fef0 2024-09-21T06:04:32.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.116+0000 7f723a000640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c131f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7228034040 tx=0x7f7228003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:32.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.117+0000 7f7232a00640 1 -- 172.21.15.118:0/780898373 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722803e030 con 0x7f723c13fef0 2024-09-21T06:04:32.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.117+0000 7f7232a00640 1 -- 172.21.15.118:0/780898373 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7228003e00 con 0x7f723c13fef0 2024-09-21T06:04:32.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.117+0000 7f7232a00640 1 -- 172.21.15.118:0/780898373 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228035040 con 0x7f723c13fef0 2024-09-21T06:04:32.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.117+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c132490 con 0x7f723c13fef0 2024-09-21T06:04:32.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.117+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c1409a0 con 0x7f723c13fef0 2024-09-21T06:04:32.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.118+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723c15d080 con 0x7f723c13fef0 2024-09-21T06:04:32.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.119+0000 7f7232a00640 1 -- 172.21.15.118:0/780898373 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7228041030 con 0x7f723c13fef0 2024-09-21T06:04:32.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.120+0000 7f7232a00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f721c078b90 0x7f721c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.120+0000 7f7232a00640 1 -- 172.21.15.118:0/780898373 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72280bb520 con 0x7f723c13fef0 2024-09-21T06:04:32.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.120+0000 7f723aa00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f721c078b90 0x7f721c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.121+0000 7f723aa00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f721c078b90 0x7f721c07b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f722c005fd0 tx=0x7f722c0095e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:32.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.124+0000 7f7232a00640 1 -- 172.21.15.118:0/780898373 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f723c15d080 con 0x7f723c13fef0 2024-09-21T06:04:32.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.346+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f723c0d0130 con 0x7f723c13fef0 2024-09-21T06:04:32.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.346+0000 7f7232a00640 1 -- 172.21.15.118:0/780898373 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f7228083300 con 0x7f723c13fef0 2024-09-21T06:04:32.348 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:32.348 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":8,"btime":"2024-09-21T06:03:59:452441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4322,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2529966573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2529966573},{"type":"v1","addr":"172.21.15.149:6835","nonce":2529966573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/4289977781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":4289977781},{"type":"v1","addr":"172.21.15.118:6834","nonce":4289977781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3240873049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3240873049},{"type":"v1","addr":"172.21.15.118:6835","nonce":3240873049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:03:55.915450+0000","modified":"2024-09-21T06:03:58.939146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4411":{"gid":4411,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6837/3721420106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3721420106},{"type":"v1","addr":"172.21.15.149:6837","nonce":3721420106}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4411,"qdb_cluster":[4411]},"id":1}]} 2024-09-21T06:04:32.348 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 8 2024-09-21T06:04:32.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.348+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f721c078b90 msgr2=0x7f721c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f721c078b90 0x7f721c07b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f722c005fd0 tx=0x7f722c0095e0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 msgr2=0x7f723c131f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c131f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7228034040 tx=0x7f7228003910 comp rx=0 tx=0).stop 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 shutdown_connections 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c142730 0x7f723c0b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723c13fef0 0x7f723c131f50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f721c078b90 0x7f721c07b0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 --2- 172.21.15.118:0/780898373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f723c13fae0 0x7f723c1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 >> 172.21.15.118:0/780898373 conn(0x7f723c06d110 msgr2=0x7f723c0d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 shutdown_connections 2024-09-21T06:04:32.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.349+0000 7f7241c00640 1 -- 172.21.15.118:0/780898373 wait complete. 2024-09-21T06:04:32.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:32.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.594+0000 7f6985c00640 1 -- 172.21.15.118:0/2848478036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f698015cfd0 msgr2=0x7f69800b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.594+0000 7f6985c00640 1 --2- 172.21.15.118:0/2848478036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f698015cfd0 0x7f69800b3a60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6970005fd0 tx=0x7f697002a5f0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.594+0000 7f6985c00640 1 -- 172.21.15.118:0/2848478036 shutdown_connections 2024-09-21T06:04:32.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.594+0000 7f6985c00640 1 --2- 172.21.15.118:0/2848478036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f698015cfd0 0x7f69800b3a60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.594+0000 7f6985c00640 1 -- 172.21.15.118:0/2848478036 >> 172.21.15.118:0/2848478036 conn(0x7f698006d110 msgr2=0x7f698006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:32.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.594+0000 7f6985c00640 1 -- 172.21.15.118:0/2848478036 shutdown_connections 2024-09-21T06:04:32.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.595+0000 7f6985c00640 1 -- 172.21.15.118:0/2848478036 wait complete. 2024-09-21T06:04:32.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.597+0000 7f6985c00640 1 Processor -- start 2024-09-21T06:04:32.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.597+0000 7f6985c00640 1 -- start start 2024-09-21T06:04:32.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.598+0000 7f6985c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69800b5040 0x7f69800cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.598+0000 7f6985c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69800b5450 0x7f69801f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.598+0000 7f6985c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f698015cfd0 0x7f69801e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.598+0000 7f6985c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6980073e40 con 0x7f69800b5450 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.598+0000 7f6985c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6980073cc0 con 0x7f69800b5040 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.598+0000 7f6985c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6980073fc0 con 0x7f698015cfd0 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69800b5450 0x7f69801f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69800b5450 0x7f69801f3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41946/0 (socket says 172.21.15.118:41946) 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 -- 172.21.15.118:0/2340739121 learned_addr learned my addr 172.21.15.118:0/2340739121 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f697ea00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69800b5040 0x7f69800cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f697f400640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f698015cfd0 0x7f69801e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 -- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f698015cfd0 msgr2=0x7f69801e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f698015cfd0 0x7f69801e79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 -- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69800b5040 msgr2=0x7f69800cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69800b5040 0x7f69800cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 -- 172.21.15.118:0/2340739121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69801f75a0 con 0x7f69800b5450 2024-09-21T06:04:32.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.599+0000 7f6977e00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69800b5450 0x7f69801f3cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f696800c370 tx=0x7f696800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:32.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.600+0000 7f6976a00640 1 -- 172.21.15.118:0/2340739121 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968017070 con 0x7f69800b5450 2024-09-21T06:04:32.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.600+0000 7f6976a00640 1 -- 172.21.15.118:0/2340739121 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69680035f0 con 0x7f69800b5450 2024-09-21T06:04:32.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.600+0000 7f6976a00640 1 -- 172.21.15.118:0/2340739121 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968003a40 con 0x7f69800b5450 2024-09-21T06:04:32.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.600+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69801f4890 con 0x7f69800b5450 2024-09-21T06:04:32.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.600+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698012fde0 con 0x7f69800b5450 2024-09-21T06:04:32.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.601+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69801f4600 con 0x7f69800b5450 2024-09-21T06:04:32.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.602+0000 7f6976a00640 1 -- 172.21.15.118:0/2340739121 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f696801a070 con 0x7f69800b5450 2024-09-21T06:04:32.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.603+0000 7f6976a00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f695c078b90 0x7f695c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:32.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.603+0000 7f6976a00640 1 -- 172.21.15.118:0/2340739121 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6968099f90 con 0x7f69800b5450 2024-09-21T06:04:32.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.604+0000 7f697ea00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f695c078b90 0x7f695c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:32.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.604+0000 7f697ea00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f695c078b90 0x7f695c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6970033000 tx=0x7f6970004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:32.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.607+0000 7f6976a00640 1 -- 172.21.15.118:0/2340739121 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6968061d70 con 0x7f69800b5450 2024-09-21T06:04:32.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.797+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69801e8dc0 con 0x7f69800b5450 2024-09-21T06:04:32.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.798+0000 7f6976a00640 1 -- 172.21.15.118:0/2340739121 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16737 (secure 0 0 0) 0x7f69680667a0 con 0x7f69800b5450 2024-09-21T06:04:32.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:32.800 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:03:57.424251+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:03:53.868746+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:03:54.884852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f695c078b90 msgr2=0x7f695c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f695c078b90 0x7f695c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6970033000 tx=0x7f6970004730 comp rx=0 tx=0).stop 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69800b5450 msgr2=0x7f69801f3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69800b5450 0x7f69801f3cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f696800c370 tx=0x7f696800c830 comp rx=0 tx=0).stop 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 shutdown_connections 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f695c078b90 0x7f695c07b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f698015cfd0 0x7f69801e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69800b5450 0x7f69801f3cb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 --2- 172.21.15.118:0/2340739121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69800b5040 0x7f69800cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 >> 172.21.15.118:0/2340739121 conn(0x7f698006d110 msgr2=0x7f69801e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 shutdown_connections 2024-09-21T06:04:32.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:32.801+0000 7f6985c00640 1 -- 172.21.15.118:0/2340739121 wait complete. 2024-09-21T06:04:32.826 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 -- 172.21.15.118:0/511721983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 msgr2=0x7fb4980d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 --2- 172.21.15.118:0/511721983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980d0e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb4980cedb0 tx=0x7fb48802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 -- 172.21.15.118:0/511721983 shutdown_connections 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 --2- 172.21.15.118:0/511721983 >> v2:172.21.15.149:3300/0 conn(0x7fb49813fef0 0x7fb4980d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 --2- 172.21.15.118:0/511721983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980d0e80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 -- 172.21.15.118:0/511721983 >> 172.21.15.118:0/511721983 conn(0x7fb49806d110 msgr2=0x7fb49806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 -- 172.21.15.118:0/511721983 shutdown_connections 2024-09-21T06:04:33.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.046+0000 7fb49ea00640 1 -- 172.21.15.118:0/511721983 wait complete. 2024-09-21T06:04:33.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.048+0000 7fb49ea00640 1 Processor -- start 2024-09-21T06:04:33.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.048+0000 7fb49ea00640 1 -- start start 2024-09-21T06:04:33.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb49ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980748c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb49ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49813fef0 0x7fb498157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb49ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb498142730 0x7fb49813e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb49ea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980cfa70 con 0x7fb49813fae0 2024-09-21T06:04:33.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb49ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980cf8f0 con 0x7fb49813fef0 2024-09-21T06:04:33.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb49ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4980cfbf0 con 0x7fb498142730 2024-09-21T06:04:33.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb497e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb497e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980748c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41968/0 (socket says 172.21.15.118:41968) 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb497e00640 1 -- 172.21.15.118:0/703914374 learned_addr learned my addr 172.21.15.118:0/703914374 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb48f400640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49813fef0 0x7fb498157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.050+0000 7fb49ca00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb498142730 0x7fb49813e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb497e00640 1 -- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb498142730 msgr2=0x7fb49813e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb497e00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb498142730 0x7fb49813e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb497e00640 1 -- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49813fef0 msgr2=0x7fb498157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb497e00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49813fef0 0x7fb498157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb497e00640 1 -- 172.21.15.118:0/703914374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4980b4610 con 0x7fb49813fae0 2024-09-21T06:04:33.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb497e00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980748c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb488034040 tx=0x7fb488003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:33.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb494c00640 1 -- 172.21.15.118:0/703914374 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48803e030 con 0x7fb49813fae0 2024-09-21T06:04:33.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb494c00640 1 -- 172.21.15.118:0/703914374 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb488003e00 con 0x7fb49813fae0 2024-09-21T06:04:33.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4980b48f0 con 0x7fb49813fae0 2024-09-21T06:04:33.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.051+0000 7fb494c00640 1 -- 172.21.15.118:0/703914374 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb488035040 con 0x7fb49813fae0 2024-09-21T06:04:33.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.052+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb498159b90 con 0x7fb49813fae0 2024-09-21T06:04:33.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.053+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4981603a0 con 0x7fb49813fae0 2024-09-21T06:04:33.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.054+0000 7fb494c00640 1 -- 172.21.15.118:0/703914374 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb488041030 con 0x7fb49813fae0 2024-09-21T06:04:33.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.055+0000 7fb494c00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb474078b90 0x7fb47407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.055+0000 7fb494c00640 1 -- 172.21.15.118:0/703914374 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb4880bb3c0 con 0x7fb49813fae0 2024-09-21T06:04:33.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.055+0000 7fb48f400640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb474078b90 0x7fb47407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.056+0000 7fb48f400640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb474078b90 0x7fb47407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb49815cb30 tx=0x7fb48000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:33.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.059+0000 7fb494c00640 1 -- 172.21.15.118:0/703914374 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb4981603a0 con 0x7fb49813fae0 2024-09-21T06:04:33.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.280+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb4980d0130 con 0x7fb49813fae0 2024-09-21T06:04:33.282 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:04:33.281+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:04:33.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.283+0000 7fb494c00640 1 -- 172.21.15.118:0/703914374 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fb488083240 con 0x7fb49813fae0 2024-09-21T06:04:33.285 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:04:33.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb474078b90 msgr2=0x7fb47407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb474078b90 0x7fb47407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb49815cb30 tx=0x7fb48000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 msgr2=0x7fb4980748c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980748c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb488034040 tx=0x7fb488003910 comp rx=0 tx=0).stop 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 shutdown_connections 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb474078b90 0x7fb47407b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb498142730 0x7fb49813e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49813fef0 0x7fb498157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 --2- 172.21.15.118:0/703914374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb49813fae0 0x7fb4980748c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 >> 172.21.15.118:0/703914374 conn(0x7fb49806d110 msgr2=0x7fb4981609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 shutdown_connections 2024-09-21T06:04:33.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.286+0000 7fb49ea00640 1 -- 172.21.15.118:0/703914374 wait complete. 2024-09-21T06:04:33.300 INFO:tasks.ceph.mds.d.smithi149.stderr: -7300> 2024-09-21T06:04:01.185+0000 7f3d60600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:04:33.309 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:04:33.425 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:04:33.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.531+0000 7f3c8e600640 1 -- 172.21.15.118:0/3203223517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 msgr2=0x7f3c880d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.531+0000 7f3c8e600640 1 --2- 172.21.15.118:0/3203223517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c880d23d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3c78005fd0 tx=0x7f3c7802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.531+0000 7f3c8e600640 1 -- 172.21.15.118:0/3203223517 shutdown_connections 2024-09-21T06:04:33.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.531+0000 7f3c8e600640 1 --2- 172.21.15.118:0/3203223517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c880b4f40 0x7f3c880cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.531+0000 7f3c8e600640 1 --2- 172.21.15.118:0/3203223517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c880d23d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.531+0000 7f3c8e600640 1 -- 172.21.15.118:0/3203223517 >> 172.21.15.118:0/3203223517 conn(0x7f3c88071070 msgr2=0x7f3c88071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:33.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.532+0000 7f3c8e600640 1 -- 172.21.15.118:0/3203223517 shutdown_connections 2024-09-21T06:04:33.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.532+0000 7f3c8e600640 1 -- 172.21.15.118:0/3203223517 wait complete. 2024-09-21T06:04:33.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.534+0000 7f3c8e600640 1 Processor -- start 2024-09-21T06:04:33.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.534+0000 7f3c8e600640 1 -- start start 2024-09-21T06:04:33.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.535+0000 7f3c8e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c880ceb40 0x7f3c88158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.535+0000 7f3c8e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c88144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.535+0000 7f3c8e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c881418f0 0x7f3c88145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.535+0000 7f3c8e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3c880d1570 con 0x7f3c88146650 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.535+0000 7f3c8e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c880d13f0 con 0x7f3c880ceb40 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.535+0000 7f3c8e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3c880d16f0 con 0x7f3c881418f0 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c88144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c88144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41988/0 (socket says 172.21.15.118:41988) 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 -- 172.21.15.118:0/4080751935 learned_addr learned my addr 172.21.15.118:0/4080751935 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c87e00640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c881418f0 0x7f3c88145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c87400640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c880ceb40 0x7f3c88158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 -- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c881418f0 msgr2=0x7f3c88145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c881418f0 0x7f3c88145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 -- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c880ceb40 msgr2=0x7f3c88158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c880ceb40 0x7f3c88158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:33.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 -- 172.21.15.118:0/4080751935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c881367a0 con 0x7f3c88146650 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.536+0000 7f3c86a00640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c88144af0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400c370 tx=0x7f3c7400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.537+0000 7f3c7f400640 1 -- 172.21.15.118:0/4080751935 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74017070 con 0x7f3c88146650 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.537+0000 7f3c7f400640 1 -- 172.21.15.118:0/4080751935 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c740053c0 con 0x7f3c88146650 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.537+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c88133900 con 0x7f3c88146650 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.537+0000 7f3c7f400640 1 -- 172.21.15.118:0/4080751935 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74003850 con 0x7f3c88146650 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.537+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c88133ba0 con 0x7f3c88146650 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.538+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c880d1c10 con 0x7f3c88146650 2024-09-21T06:04:33.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.539+0000 7f3c7f400640 1 -- 172.21.15.118:0/4080751935 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c7401a070 con 0x7f3c88146650 2024-09-21T06:04:33.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.540+0000 7f3c7f400640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3c68078bc0 0x7f3c6807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:33.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.540+0000 7f3c7f400640 1 -- 172.21.15.118:0/4080751935 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f3c7409a1b0 con 0x7f3c88146650 2024-09-21T06:04:33.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.540+0000 7f3c87400640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3c68078bc0 0x7f3c6807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:33.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.541+0000 7f3c87400640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3c68078bc0 0x7f3c6807b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c78033000 tx=0x7f3c78004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:33.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.544+0000 7f3c7f400640 1 -- 172.21.15.118:0/4080751935 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3c74062580 con 0x7f3c88146650 2024-09-21T06:04:33.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:33.766+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3c88145bd0 con 0x7f3c88146650 2024-09-21T06:04:34.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.285+0000 7f3c7f400640 1 -- 172.21.15.118:0/4080751935 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f3c74061e80 con 0x7f3c88146650 2024-09-21T06:04:34.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3c68078bc0 msgr2=0x7f3c6807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3c68078bc0 0x7f3c6807b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c78033000 tx=0x7f3c78004730 comp rx=0 tx=0).stop 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 msgr2=0x7f3c88144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c88144af0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400c370 tx=0x7f3c7400c830 comp rx=0 tx=0).stop 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 shutdown_connections 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3c68078bc0 0x7f3c6807b0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c881418f0 0x7f3c88145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c88146650 0x7f3c88144af0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 --2- 172.21.15.118:0/4080751935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c880ceb40 0x7f3c88158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 >> 172.21.15.118:0/4080751935 conn(0x7f3c88071070 msgr2=0x7f3c8815e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 shutdown_connections 2024-09-21T06:04:34.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.288+0000 7f3c8e600640 1 -- 172.21.15.118:0/4080751935 wait complete. 2024-09-21T06:04:34.312 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:04:34.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.537+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2673346149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 msgr2=0x7f8cec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:34.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.537+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2673346149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8cec00b9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d080b4950 tx=0x7f8cec005830 comp rx=0 tx=0).stop 2024-09-21T06:04:34.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.538+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2673346149 shutdown_connections 2024-09-21T06:04:34.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.538+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2673346149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8cec00b9c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.538+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2673346149 >> 172.21.15.118:0/2673346149 conn(0x7f8d0806cf30 msgr2=0x7f8d0806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:34.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.538+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2673346149 shutdown_connections 2024-09-21T06:04:34.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.538+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2673346149 wait complete. 2024-09-21T06:04:34.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.540+0000 7f8d0dc00640 1 Processor -- start 2024-09-21T06:04:34.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.540+0000 7f8d0dc00640 1 -- start start 2024-09-21T06:04:34.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.541+0000 7f8d0dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8d080c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:34.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.541+0000 7f8d0dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d081f5c20 0x7f8d080ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.541+0000 7f8d0dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d081f6030 0x7f8d080aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.541+0000 7f8d0dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080b4210 con 0x7f8cec005250 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.541+0000 7f8d0dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080cf650 con 0x7f8d081f6030 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.541+0000 7f8d0dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8d080b4390 con 0x7f8d081f5c20 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8d080c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8d080c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42000/0 (socket says 172.21.15.118:42000) 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 -- 172.21.15.118:0/2023654933 learned_addr learned my addr 172.21.15.118:0/2023654933 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d07400640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d081f6030 0x7f8d080aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06000640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d081f5c20 0x7f8d080ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 -- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d081f5c20 msgr2=0x7f8d080ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d081f5c20 0x7f8d080ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 -- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d081f6030 msgr2=0x7f8d080aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d081f6030 0x7f8d080aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:34.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 -- 172.21.15.118:0/2023654933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d081f6730 con 0x7f8cec005250 2024-09-21T06:04:34.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.542+0000 7f8d06a00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8d080c5a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8003ed0 tx=0x7f8cf8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:34.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.543+0000 7f8cfea00640 1 -- 172.21.15.118:0/2023654933 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8015070 con 0x7f8cec005250 2024-09-21T06:04:34.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.543+0000 7f8cfea00640 1 -- 172.21.15.118:0/2023654933 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cf8011840 con 0x7f8cec005250 2024-09-21T06:04:34.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.543+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0815a670 con 0x7f8cec005250 2024-09-21T06:04:34.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.543+0000 7f8cfea00640 1 -- 172.21.15.118:0/2023654933 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8011c90 con 0x7f8cec005250 2024-09-21T06:04:34.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.543+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d080b1c20 con 0x7f8cec005250 2024-09-21T06:04:34.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.544+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d080b1e80 con 0x7f8cec005250 2024-09-21T06:04:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.545+0000 7f8cfea00640 1 -- 172.21.15.118:0/2023654933 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8cf8018070 con 0x7f8cec005250 2024-09-21T06:04:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.546+0000 7f8cfea00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ce8078b90 0x7f8ce807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.546+0000 7f8cfea00640 1 -- 172.21.15.118:0/2023654933 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f8cf809ba40 con 0x7f8cec005250 2024-09-21T06:04:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.547+0000 7f8d06000640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ce8078b90 0x7f8ce807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.547+0000 7f8d06000640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ce8078b90 0x7f8ce807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4006bd0 tx=0x7f8cf40067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.550+0000 7f8cfea00640 1 -- 172.21.15.118:0/2023654933 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8cf8063730 con 0x7f8cec005250 2024-09-21T06:04:34.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:34.734+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8d0815db70 con 0x7f8cec005250 2024-09-21T06:04:35.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.733+0000 7f8cfea00640 1 -- 172.21.15.118:0/2023654933 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f8cf8068160 con 0x7f8cec005250 2024-09-21T06:04:35.735 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:04:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.737+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ce8078b90 msgr2=0x7f8ce807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.737+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ce8078b90 0x7f8ce807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4006bd0 tx=0x7f8cf40067a0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.737+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 msgr2=0x7f8d080c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.737+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8d080c5a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8003ed0 tx=0x7f8cf8001630 comp rx=0 tx=0).stop 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 shutdown_connections 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d081f6030 0x7f8d080aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ce8078b90 0x7f8ce807b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d081f5c20 0x7f8d080ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 --2- 172.21.15.118:0/2023654933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cec005250 0x7f8d080c5a60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 >> 172.21.15.118:0/2023654933 conn(0x7f8d0806cf30 msgr2=0x7f8d0815c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 shutdown_connections 2024-09-21T06:04:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.738+0000 7f8d0dc00640 1 -- 172.21.15.118:0/2023654933 wait complete. 2024-09-21T06:04:35.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:04:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.994+0000 7f2ab1800640 1 -- 172.21.15.118:0/1333147902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac0cd380 msgr2=0x7f2aac1606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.994+0000 7f2ab1800640 1 --2- 172.21.15.118:0/1333147902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac0cd380 0x7f2aac1606e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2a94005fd0 tx=0x7f2a9402a540 comp rx=0 tx=0).stop 2024-09-21T06:04:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.994+0000 7f2ab1800640 1 -- 172.21.15.118:0/1333147902 shutdown_connections 2024-09-21T06:04:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.994+0000 7f2ab1800640 1 --2- 172.21.15.118:0/1333147902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac0cd380 0x7f2aac1606e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.994+0000 7f2ab1800640 1 -- 172.21.15.118:0/1333147902 >> 172.21.15.118:0/1333147902 conn(0x7f2aac06d420 msgr2=0x7f2aac0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.994+0000 7f2ab1800640 1 -- 172.21.15.118:0/1333147902 shutdown_connections 2024-09-21T06:04:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.994+0000 7f2ab1800640 1 -- 172.21.15.118:0/1333147902 wait complete. 2024-09-21T06:04:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.996+0000 7f2ab1800640 1 Processor -- start 2024-09-21T06:04:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.996+0000 7f2ab1800640 1 -- start start 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aac0cd380 0x7f2aac1e6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2aac0cf790 0x7f2aac1e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac160c20 0x7f2aac1f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab1800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac06fb90 con 0x7f2aac160c20 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac06fa10 con 0x7f2aac0cd380 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac06fd10 con 0x7f2aac0cf790 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab0e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac160c20 0x7f2aac1f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab0e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac160c20 0x7f2aac1f94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37864/0 (socket says 172.21.15.118:37864) 2024-09-21T06:04:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.998+0000 7f2ab0e00640 1 -- 172.21.15.118:0/755115346 learned_addr learned my addr 172.21.15.118:0/755115346 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2aa3400640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2aac0cf790 0x7f2aac1e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab0e00640 1 -- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2aac0cf790 msgr2=0x7f2aac1e69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2aabe00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aac0cd380 0x7f2aac1e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab0e00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2aac0cf790 0x7f2aac1e69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab0e00640 1 -- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aac0cd380 msgr2=0x7f2aac1e6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab0e00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aac0cd380 0x7f2aac1e6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab0e00640 1 -- 172.21.15.118:0/755115346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac149400 con 0x7f2aac160c20 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2aa3400640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2aac0cf790 0x7f2aac1e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2aabe00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aac0cd380 0x7f2aac1e6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab0e00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac160c20 0x7f2aac1f94e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400b9e0 tx=0x7f2aa400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2aa8c00640 1 -- 172.21.15.118:0/755115346 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4003b70 con 0x7f2aac160c20 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2aa8c00640 1 -- 172.21.15.118:0/755115346 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2aa4003e00 con 0x7f2aac160c20 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac1496e0 con 0x7f2aac160c20 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2aa8c00640 1 -- 172.21.15.118:0/755115346 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400cb80 con 0x7f2aac160c20 2024-09-21T06:04:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:35.999+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac157140 con 0x7f2aac160c20 2024-09-21T06:04:36.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.000+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac15ac00 con 0x7f2aac160c20 2024-09-21T06:04:36.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.002+0000 7f2aa8c00640 1 -- 172.21.15.118:0/755115346 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2aa4004000 con 0x7f2aac160c20 2024-09-21T06:04:36.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.003+0000 7f2aa8c00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a88078b90 0x7f2a8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:36.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.003+0000 7f2aa8c00640 1 -- 172.21.15.118:0/755115346 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7f2aa409aa90 con 0x7f2aac160c20 2024-09-21T06:04:36.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.004+0000 7f2aabe00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a88078b90 0x7f2a8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:36.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.004+0000 7f2aabe00640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a88078b90 0x7f2a8807b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000f60 tx=0x7f2a9c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:36.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.008+0000 7f2aa8c00640 1 -- 172.21.15.118:0/755115346 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2aa4063020 con 0x7f2aac160c20 2024-09-21T06:04:36.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.193+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2aac1606e0 con 0x7f2aac160c20 2024-09-21T06:04:36.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.739+0000 7f2aa8c00640 1 -- 172.21.15.118:0/755115346 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7f2aa4062920 con 0x7f2aac160c20 2024-09-21T06:04:36.741 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a88078b90 msgr2=0x7f2a8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a88078b90 0x7f2a8807b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000f60 tx=0x7f2a9c009040 comp rx=0 tx=0).stop 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac160c20 msgr2=0x7f2aac1f94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac160c20 0x7f2aac1f94e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400b9e0 tx=0x7f2aa400bea0 comp rx=0 tx=0).stop 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 shutdown_connections 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2aac160c20 0x7f2aac1f94e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a88078b90 0x7f2a8807b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2aac0cf790 0x7f2aac1e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 --2- 172.21.15.118:0/755115346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2aac0cd380 0x7f2aac1e6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 >> 172.21.15.118:0/755115346 conn(0x7f2aac06d420 msgr2=0x7f2aac0729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 shutdown_connections 2024-09-21T06:04:36.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:36.743+0000 7f2ab1800640 1 -- 172.21.15.118:0/755115346 wait complete. 2024-09-21T06:04:36.770 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:04:36.770 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:04:36.770 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:04:36.770 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:04:36.770 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:04:36.770 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:04:36.771 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:04:36.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:04:36.771 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:04:36.771 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:04:36.771 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:04:36.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:04:36.771 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:04:36.772 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:04:36.772 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:04:36.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:04:36.791 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:04:36.792 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:04:36.794 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:04:36.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:04:36.795 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:04:36.795 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:04:36.796 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:04:36.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:04:36.838 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:04:36.838 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:36.839 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:04:36.839 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:36.841 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:04:36.841 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:36.841 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:04:36.841 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:36.842 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:04:37.035 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:04:37.035 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:04:37.035 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:04:37.035 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 -- 172.21.15.118:0/1203098833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b72d0 msgr2=0x7fe49c0b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/1203098833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b72d0 0x7fe49c0b5fd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe49c074ff0 tx=0x7fe49402a540 comp rx=0 tx=0).stop 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 -- 172.21.15.118:0/1203098833 shutdown_connections 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/1203098833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b72d0 0x7fe49c0b5fd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/1203098833 >> v2:172.21.15.149:3300/0 conn(0x7fe49c145670 0x7fe49c0710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 -- 172.21.15.118:0/1203098833 >> 172.21.15.118:0/1203098833 conn(0x7fe49c0b38e0 msgr2=0x7fe49c0b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 -- 172.21.15.118:0/1203098833 shutdown_connections 2024-09-21T06:04:37.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.072+0000 7fe4a1c00640 1 -- 172.21.15.118:0/1203098833 wait complete. 2024-09-21T06:04:37.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.074+0000 7fe4a1c00640 1 Processor -- start 2024-09-21T06:04:37.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.074+0000 7fe4a1c00640 1 -- start start 2024-09-21T06:04:37.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe4a1c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b5bc0 0x7fe49c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe4a1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe49c145670 0x7fe49c13ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe4a1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c1f6aa0 0x7fe49c1f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe4a1c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c0cf680 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe4a1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c0cf500 con 0x7fe49c1f6aa0 2024-09-21T06:04:37.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe4a1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe49c0cf800 con 0x7fe49c145670 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe49aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b5bc0 0x7fe49c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe49aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b5bc0 0x7fe49c15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37910/0 (socket says 172.21.15.118:37910) 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe49aa00640 1 -- 172.21.15.118:0/284484481 learned_addr learned my addr 172.21.15.118:0/284484481 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe49b400640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c1f6aa0 0x7fe49c1f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.076+0000 7fe49a000640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe49c145670 0x7fe49c13ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49aa00640 1 -- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe49c145670 msgr2=0x7fe49c13ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49aa00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe49c145670 0x7fe49c13ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49aa00640 1 -- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c1f6aa0 msgr2=0x7fe49c1f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49aa00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c1f6aa0 0x7fe49c1f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49aa00640 1 -- 172.21.15.118:0/284484481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c15ad80 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49b400640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c1f6aa0 0x7fe49c1f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49a000640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe49c145670 0x7fe49c13ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:37.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe49aa00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b5bc0 0x7fe49c15a4a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00eb30 tx=0x7fe48c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:37.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe492a00640 1 -- 172.21.15.118:0/284484481 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c010430 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe492a00640 1 -- 172.21.15.118:0/284484481 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe48c0105d0 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe492a00640 1 -- 172.21.15.118:0/284484481 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c010a20 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c15b060 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.077+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c15b620 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.078+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49c0cfcb0 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.079+0000 7fe492a00640 1 -- 172.21.15.118:0/284484481 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe48c010bc0 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.080+0000 7fe492a00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe47c078b90 0x7fe47c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.081+0000 7fe492a00640 1 -- 172.21.15.118:0/284484481 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7fe48c09b8f0 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.081+0000 7fe49a000640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe47c078b90 0x7fe47c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.082+0000 7fe49a000640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe47c078b90 0x7fe47c07b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0aeee0 tx=0x7fe488009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:37.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.085+0000 7fe492a00640 1 -- 172.21.15.118:0/284484481 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe48c063f90 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.285+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe49c141f90 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.751+0000 7fe492a00640 1 -- 172.21.15.118:0/284484481 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7fe48c063890 con 0x7fe49c0b5bc0 2024-09-21T06:04:37.753 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe47c078b90 msgr2=0x7fe47c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe47c078b90 0x7fe47c07b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0aeee0 tx=0x7fe488009040 comp rx=0 tx=0).stop 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b5bc0 msgr2=0x7fe49c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b5bc0 0x7fe49c15a4a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00eb30 tx=0x7fe48c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 shutdown_connections 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe49c1f6aa0 0x7fe49c1f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe47c078b90 0x7fe47c07b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe49c145670 0x7fe49c13ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 --2- 172.21.15.118:0/284484481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe49c0b5bc0 0x7fe49c15a4a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 >> 172.21.15.118:0/284484481 conn(0x7fe49c0b38e0 msgr2=0x7fe49c06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:37.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 shutdown_connections 2024-09-21T06:04:37.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:37.755+0000 7fe4a1c00640 1 -- 172.21.15.118:0/284484481 wait complete. 2024-09-21T06:04:37.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:04:38.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 -- 172.21.15.118:0/1276113493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fae0 msgr2=0x7f59240d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 --2- 172.21.15.118:0/1276113493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fae0 0x7f59240d0e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5918009830 tx=0x7f591802a510 comp rx=0 tx=0).stop 2024-09-21T06:04:38.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 -- 172.21.15.118:0/1276113493 shutdown_connections 2024-09-21T06:04:38.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 --2- 172.21.15.118:0/1276113493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592413fef0 0x7f59240d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 --2- 172.21.15.118:0/1276113493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fae0 0x7f59240d0e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 -- 172.21.15.118:0/1276113493 >> 172.21.15.118:0/1276113493 conn(0x7f592406d110 msgr2=0x7f592406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:38.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 -- 172.21.15.118:0/1276113493 shutdown_connections 2024-09-21T06:04:38.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.000+0000 7f592c600640 1 -- 172.21.15.118:0/1276113493 wait complete. 2024-09-21T06:04:38.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.002+0000 7f592c600640 1 Processor -- start 2024-09-21T06:04:38.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.002+0000 7f592c600640 1 -- start start 2024-09-21T06:04:38.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f592c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592413fae0 0x7f59241f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f592c600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fef0 0x7f59241f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f592c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5924142730 0x7f5924156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f592c600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59240cfab0 con 0x7f592413fef0 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f592c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59240cf930 con 0x7f5924142730 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f592c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59240cfc30 con 0x7f592413fae0 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fef0 0x7f59241f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fef0 0x7f59241f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37920/0 (socket says 172.21.15.118:37920) 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 -- 172.21.15.118:0/2348058885 learned_addr learned my addr 172.21.15.118:0/2348058885 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929c00640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592413fae0 0x7f59241f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f592a600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5924142730 0x7f5924156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 -- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592413fae0 msgr2=0x7f59241f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592413fae0 0x7f59241f7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 -- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5924142730 msgr2=0x7f5924156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5924142730 0x7f5924156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.004+0000 7f5929200640 1 -- 172.21.15.118:0/2348058885 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59241f7520 con 0x7f592413fef0 2024-09-21T06:04:38.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.005+0000 7f5929200640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fef0 0x7f59241f3bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f591000e790 tx=0x7f591000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:38.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.005+0000 7f5921600640 1 -- 172.21.15.118:0/2348058885 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591000eea0 con 0x7f592413fef0 2024-09-21T06:04:38.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.005+0000 7f5921600640 1 -- 172.21.15.118:0/2348058885 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f591000ccc0 con 0x7f592413fef0 2024-09-21T06:04:38.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.005+0000 7f5921600640 1 -- 172.21.15.118:0/2348058885 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910005280 con 0x7f592413fef0 2024-09-21T06:04:38.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.005+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59241f4840 con 0x7f592413fef0 2024-09-21T06:04:38.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.005+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59240b3e70 con 0x7f592413fef0 2024-09-21T06:04:38.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.006+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59240d0150 con 0x7f592413fef0 2024-09-21T06:04:38.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.007+0000 7f5921600640 1 -- 172.21.15.118:0/2348058885 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5910005420 con 0x7f592413fef0 2024-09-21T06:04:38.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.008+0000 7f5921600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5904078b90 0x7f590407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.008+0000 7f5921600640 1 -- 172.21.15.118:0/2348058885 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f591009b200 con 0x7f592413fef0 2024-09-21T06:04:38.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.009+0000 7f5929c00640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5904078b90 0x7f590407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.010+0000 7f5929c00640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5904078b90 0x7f590407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5918034000 tx=0x7f5918004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:38.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.013+0000 7f5921600640 1 -- 172.21.15.118:0/2348058885 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5910063330 con 0x7f592413fef0 2024-09-21T06:04:38.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.264+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f592406a710 con 0x7f592413fef0 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.264+0000 7f5921600640 1 -- 172.21.15.118:0/2348058885 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f5910067d60 con 0x7f592413fef0 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:04:38.266 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.267 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:04:38.268 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.269 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.270 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.271 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:04:38.272 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.273 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.274 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.275 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:04:38.276 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-mds", 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQC3Ye5mndkKEhAA8jIeDQ/NvIyIWPW2w+6jOw==", 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.277 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQC3Ye5mGOwKEhAAdE01euzwhXx1YS1jcYZAXw==", 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-osd", 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQC3Ye5mH/wKEhAAZo3V4fPhKe+9S4/5p1GWDA==", 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T06:04:38.278 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQC3Ye5mNAwLEhAAW4agZ8RHnHNNOxOIyosxhg==", 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQC3Ye5mfx8LEhAAZehxe4/UKubMFaNy11jrlA==", 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQC3Ye5mDDILEhAAiKSDfIhEAzK+dmat0q+CLg==", 2024-09-21T06:04:38.279 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:04:38.280 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:04:38.281 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:04:38.281 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:04:38.281 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:04:38.281 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.281 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:38.281 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:04:38.281 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5904078b90 msgr2=0x7f590407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5904078b90 0x7f590407b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5918034000 tx=0x7f5918004730 comp rx=0 tx=0).stop 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fef0 msgr2=0x7f59241f3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fef0 0x7f59241f3bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f591000e790 tx=0x7f591000ec50 comp rx=0 tx=0).stop 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 shutdown_connections 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5924142730 0x7f5924156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592413fef0 0x7f59241f3bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5904078b90 0x7f590407b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 --2- 172.21.15.118:0/2348058885 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f592413fae0 0x7f59241f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 >> 172.21.15.118:0/2348058885 conn(0x7f592406d110 msgr2=0x7f592415bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:38.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 shutdown_connections 2024-09-21T06:04:38.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.267+0000 7f592c600640 1 -- 172.21.15.118:0/2348058885 wait complete. 2024-09-21T06:04:38.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 -- 172.21.15.118:0/3699483293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f00b3f40 msgr2=0x7ff4f00b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3699483293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f00b3f40 0x7ff4f00b4350 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0072570 tx=0x7ff4e802aa30 comp rx=0 tx=0).stop 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 -- 172.21.15.118:0/3699483293 shutdown_connections 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3699483293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f00b3f40 0x7ff4f00b4350 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3699483293 >> v2:172.21.15.149:3300/0 conn(0x7ff4f0144760 0x7ff4f00748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 -- 172.21.15.118:0/3699483293 >> 172.21.15.118:0/3699483293 conn(0x7ff4f006d6e0 msgr2=0x7ff4f00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 -- 172.21.15.118:0/3699483293 shutdown_connections 2024-09-21T06:04:38.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.513+0000 7ff4ef200640 1 -- 172.21.15.118:0/3699483293 wait complete. 2024-09-21T06:04:38.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.515+0000 7ff4ef200640 1 Processor -- start 2024-09-21T06:04:38.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.516+0000 7ff4ef200640 1 -- start start 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ef200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f0073bd0 0x7ff4f00c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ef200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f00b3f40 0x7ff4f01594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ef200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f0144760 0x7ff4f00b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ef200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f00b4c20 con 0x7ff4f0144760 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ef200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f00b4aa0 con 0x7ff4f0073bd0 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ef200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f00b4da0 con 0x7ff4f00b3f40 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ee800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f0144760 0x7ff4f00b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ee800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f0144760 0x7ff4f00b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37950/0 (socket says 172.21.15.118:37950) 2024-09-21T06:04:38.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.517+0000 7ff4ee800640 1 -- 172.21.15.118:0/3210796535 learned_addr learned my addr 172.21.15.118:0/3210796535 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:38.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4e5400640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f00b3f40 0x7ff4f01594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4ede00640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f0073bd0 0x7ff4f00c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4ee800640 1 -- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f00b3f40 msgr2=0x7ff4f01594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4ee800640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f00b3f40 0x7ff4f01594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4ee800640 1 -- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f0073bd0 msgr2=0x7ff4f00c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4ee800640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f0073bd0 0x7ff4f00c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4ee800640 1 -- 172.21.15.118:0/3210796535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f00c59b0 con 0x7ff4f0144760 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4ee800640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f0144760 0x7ff4f00b1bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009d60 tx=0x7ff4e8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.518+0000 7ff4e6a00640 1 -- 172.21.15.118:0/3210796535 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8033050 con 0x7ff4f0144760 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.519+0000 7ff4e6a00640 1 -- 172.21.15.118:0/3210796535 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4e8004450 con 0x7ff4f0144760 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.519+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f00c5c50 con 0x7ff4f0144760 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.519+0000 7ff4e6a00640 1 -- 172.21.15.118:0/3210796535 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8038450 con 0x7ff4f0144760 2024-09-21T06:04:38.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.519+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f00c6210 con 0x7ff4f0144760 2024-09-21T06:04:38.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.520+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f00b2650 con 0x7ff4f0144760 2024-09-21T06:04:38.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.521+0000 7ff4e6a00640 1 -- 172.21.15.118:0/3210796535 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4e8036070 con 0x7ff4f0144760 2024-09-21T06:04:38.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.522+0000 7ff4e6a00640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff4cc078bc0 0x7ff4cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:38.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.522+0000 7ff4e6a00640 1 -- 172.21.15.118:0/3210796535 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ff4e80bbda0 con 0x7ff4f0144760 2024-09-21T06:04:38.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.522+0000 7ff4ede00640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff4cc078bc0 0x7ff4cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:38.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.523+0000 7ff4ede00640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff4cc078bc0 0x7ff4cc07b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0004630 tx=0x7ff4e000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.526+0000 7ff4e6a00640 1 -- 172.21.15.118:0/3210796535 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff4e8083f60 con 0x7ff4f0144760 2024-09-21T06:04:38.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.784+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7ff4f00b4350 con 0x7ff4f0144760 2024-09-21T06:04:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.786+0000 7ff4e6a00640 1 -- 172.21.15.118:0/3210796535 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7ff4e8088990 con 0x7ff4f0144760 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff4cc078bc0 msgr2=0x7ff4cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff4cc078bc0 0x7ff4cc07b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0004630 tx=0x7ff4e000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f0144760 msgr2=0x7ff4f00b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f0144760 0x7ff4f00b1bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009d60 tx=0x7ff4e8003f10 comp rx=0 tx=0).stop 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 shutdown_connections 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f0144760 0x7ff4f00b1bb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff4cc078bc0 0x7ff4cc07b0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f00b3f40 0x7ff4f01594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 --2- 172.21.15.118:0/3210796535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f0073bd0 0x7ff4f00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 >> 172.21.15.118:0/3210796535 conn(0x7ff4f006d6e0 msgr2=0x7ff4f013e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 shutdown_connections 2024-09-21T06:04:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:38.789+0000 7ff4ef200640 1 -- 172.21.15.118:0/3210796535 wait complete. 2024-09-21T06:04:38.816 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T06:04:39.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.038+0000 7fe321600640 1 -- 172.21.15.118:0/4229873854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe300005320 msgr2=0x7fe30000b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.038+0000 7fe321600640 1 --2- 172.21.15.118:0/4229873854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe300005320 0x7fe30000b9e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c640 tx=0x7fe300005830 comp rx=0 tx=0).stop 2024-09-21T06:04:39.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.038+0000 7fe321600640 1 -- 172.21.15.118:0/4229873854 shutdown_connections 2024-09-21T06:04:39.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.038+0000 7fe321600640 1 --2- 172.21.15.118:0/4229873854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe300005320 0x7fe30000b9e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.038+0000 7fe321600640 1 -- 172.21.15.118:0/4229873854 >> 172.21.15.118:0/4229873854 conn(0x7fe31c06d110 msgr2=0x7fe31c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.038+0000 7fe321600640 1 -- 172.21.15.118:0/4229873854 shutdown_connections 2024-09-21T06:04:39.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.038+0000 7fe321600640 1 -- 172.21.15.118:0/4229873854 wait complete. 2024-09-21T06:04:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.040+0000 7fe321600640 1 Processor -- start 2024-09-21T06:04:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.041+0000 7fe321600640 1 -- start start 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe321600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe300005320 0x7fe31c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe321600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe31c072d80 0x7fe31c13e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe321600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe31c13e7a0 0x7fe31c140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe321600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0d1000 con 0x7fe31c13e7a0 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe321600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0d0e80 con 0x7fe300005320 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe321600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe31c0d1180 con 0x7fe31c072d80 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe31b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe31c13e7a0 0x7fe31c140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe31b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe31c13e7a0 0x7fe31c140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37968/0 (socket says 172.21.15.118:37968) 2024-09-21T06:04:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe31b400640 1 -- 172.21.15.118:0/868310026 learned_addr learned my addr 172.21.15.118:0/868310026 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe31aa00640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe300005320 0x7fe31c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.042+0000 7fe312000640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe31c072d80 0x7fe31c13e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe31b400640 1 -- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe31c072d80 msgr2=0x7fe31c13e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe31b400640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe31c072d80 0x7fe31c13e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe31b400640 1 -- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe300005320 msgr2=0x7fe31c152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe31b400640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe300005320 0x7fe31c152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe31b400640 1 -- 172.21.15.118:0/868310026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c13efa0 con 0x7fe31c13e7a0 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe31b400640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe31c13e7a0 0x7fe31c140330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c760 tx=0x7fe314003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe313400640 1 -- 172.21.15.118:0/868310026 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314039070 con 0x7fe31c13e7a0 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe313400640 1 -- 172.21.15.118:0/868310026 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe31402ba40 con 0x7fe31c13e7a0 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe313400640 1 -- 172.21.15.118:0/868310026 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31402bdf0 con 0x7fe31c13e7a0 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.043+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c0cd6c0 con 0x7fe31c13e7a0 2024-09-21T06:04:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.044+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c13c1f0 con 0x7fe31c13e7a0 2024-09-21T06:04:39.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.045+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c0cd4e0 con 0x7fe31c13e7a0 2024-09-21T06:04:39.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.046+0000 7fe313400640 1 -- 172.21.15.118:0/868310026 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe31403c020 con 0x7fe31c13e7a0 2024-09-21T06:04:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.047+0000 7fe313400640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe2f8078bc0 0x7fe2f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.047+0000 7fe313400640 1 -- 172.21.15.118:0/868310026 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fe3140ba000 con 0x7fe31c13e7a0 2024-09-21T06:04:39.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.047+0000 7fe31aa00640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe2f8078bc0 0x7fe2f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.048+0000 7fe31aa00640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe2f8078bc0 0x7fe2f807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009bd0 tx=0x7fe30c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.051+0000 7fe313400640 1 -- 172.21.15.118:0/868310026 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe31c0cd4e0 con 0x7fe31c13e7a0 2024-09-21T06:04:39.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.311+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fe31c0d16e0 con 0x7fe31c13e7a0 2024-09-21T06:04:39.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.314+0000 7fe313400640 1 -- 172.21.15.118:0/868310026 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fe314045070 con 0x7fe31c13e7a0 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe2f8078bc0 msgr2=0x7fe2f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe2f8078bc0 0x7fe2f807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009bd0 tx=0x7fe30c005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe31c13e7a0 msgr2=0x7fe31c140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe31c13e7a0 0x7fe31c140330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c760 tx=0x7fe314003f30 comp rx=0 tx=0).stop 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 shutdown_connections 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe31c13e7a0 0x7fe31c140330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe2f8078bc0 0x7fe2f807b0d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe31c072d80 0x7fe31c13e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 --2- 172.21.15.118:0/868310026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe300005320 0x7fe31c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 >> 172.21.15.118:0/868310026 conn(0x7fe31c06d110 msgr2=0x7fe31c13a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 shutdown_connections 2024-09-21T06:04:39.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.317+0000 7fe321600640 1 -- 172.21.15.118:0/868310026 wait complete. 2024-09-21T06:04:39.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T06:04:39.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 -- 172.21.15.118:0/614456302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 msgr2=0x7f71800d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 --2- 172.21.15.118:0/614456302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800d13c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7180071c00 tx=0x7f716c02a4a0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 -- 172.21.15.118:0/614456302 shutdown_connections 2024-09-21T06:04:39.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 --2- 172.21.15.118:0/614456302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800d13c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 --2- 172.21.15.118:0/614456302 >> v2:172.21.15.149:3300/0 conn(0x7f718013fae0 0x7f71800d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 -- 172.21.15.118:0/614456302 >> 172.21.15.118:0/614456302 conn(0x7f718006d110 msgr2=0x7f718006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 -- 172.21.15.118:0/614456302 shutdown_connections 2024-09-21T06:04:39.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.560+0000 7f7187200640 1 -- 172.21.15.118:0/614456302 wait complete. 2024-09-21T06:04:39.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.562+0000 7f7187200640 1 Processor -- start 2024-09-21T06:04:39.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.562+0000 7f7187200640 1 -- start start 2024-09-21T06:04:39.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7187200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f718013fae0 0x7f71801f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7187200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7187200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7180142730 0x7f71801f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7187200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f71800cfa70 con 0x7f718013fef0 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7187200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71800cf8f0 con 0x7f718013fae0 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7187200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71800cfbf0 con 0x7f7180142730 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37996/0 (socket says 172.21.15.118:37996) 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 -- 172.21.15.118:0/1055328051 learned_addr learned my addr 172.21.15.118:0/1055328051 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717fe00640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f718013fae0 0x7f71801f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7185200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7180142730 0x7f71801f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 -- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7180142730 msgr2=0x7f71801f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7180142730 0x7f71801f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 -- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f718013fae0 msgr2=0x7f71801f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f718013fae0 0x7f71801f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717f400640 1 -- 172.21.15.118:0/1055328051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71801f5e40 con 0x7f718013fef0 2024-09-21T06:04:39.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f717fe00640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f718013fae0 0x7f71801f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.564+0000 7f7185200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7180142730 0x7f71801f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.565+0000 7f717f400640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800b4ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f716c02aa90 tx=0x7f716c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.565+0000 7f7177e00640 1 -- 172.21.15.118:0/1055328051 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c031d60 con 0x7f718013fef0 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.565+0000 7f7177e00640 1 -- 172.21.15.118:0/1055328051 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f716c033e10 con 0x7f718013fef0 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.565+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71801f6b40 con 0x7f718013fef0 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.565+0000 7f7177e00640 1 -- 172.21.15.118:0/1055328051 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c005260 con 0x7f718013fef0 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.565+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71801416c0 con 0x7f718013fef0 2024-09-21T06:04:39.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.566+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71800d0110 con 0x7f718013fef0 2024-09-21T06:04:39.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.567+0000 7f7177e00640 1 -- 172.21.15.118:0/1055328051 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f716c005400 con 0x7f718013fef0 2024-09-21T06:04:39.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.568+0000 7f7177e00640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7160078b90 0x7f716007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.568+0000 7f7177e00640 1 -- 172.21.15.118:0/1055328051 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f716c0bbdc0 con 0x7f718013fef0 2024-09-21T06:04:39.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.569+0000 7f717fe00640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7160078b90 0x7f716007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.570+0000 7f717fe00640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7160078b90 0x7f716007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f717000ab40 tx=0x7f717000a520 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.573+0000 7f7177e00640 1 -- 172.21.15.118:0/1055328051 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f716c03f030 con 0x7f718013fef0 2024-09-21T06:04:39.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.830+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f7180142be0 con 0x7f718013fef0 2024-09-21T06:04:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.832+0000 7f7177e00640 1 -- 172.21.15.118:0/1055328051 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f716c031770 con 0x7f718013fef0 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7160078b90 msgr2=0x7f716007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7160078b90 0x7f716007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f717000ab40 tx=0x7f717000a520 comp rx=0 tx=0).stop 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 msgr2=0x7f71800b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800b4ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f716c02aa90 tx=0x7f716c033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 shutdown_connections 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7160078b90 0x7f716007b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7180142730 0x7f71801f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f718013fef0 0x7f71800b4ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 --2- 172.21.15.118:0/1055328051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f718013fae0 0x7f71801f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 >> 172.21.15.118:0/1055328051 conn(0x7f718006d110 msgr2=0x7f718006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 shutdown_connections 2024-09-21T06:04:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:39.835+0000 7f7187200640 1 -- 172.21.15.118:0/1055328051 wait complete. 2024-09-21T06:04:39.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 -- 172.21.15.118:0/1910883369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fef0 msgr2=0x7efcc80d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 --2- 172.21.15.118:0/1910883369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fef0 0x7efcc80d13c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009830 tx=0x7efcb002a520 comp rx=0 tx=0).stop 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 -- 172.21.15.118:0/1910883369 shutdown_connections 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 --2- 172.21.15.118:0/1910883369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fef0 0x7efcc80d13c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 --2- 172.21.15.118:0/1910883369 >> v2:172.21.15.149:3300/0 conn(0x7efcc813fae0 0x7efcc80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 -- 172.21.15.118:0/1910883369 >> 172.21.15.118:0/1910883369 conn(0x7efcc806d110 msgr2=0x7efcc806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 -- 172.21.15.118:0/1910883369 shutdown_connections 2024-09-21T06:04:40.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.079+0000 7efccd400640 1 -- 172.21.15.118:0/1910883369 wait complete. 2024-09-21T06:04:40.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.081+0000 7efccd400640 1 Processor -- start 2024-09-21T06:04:40.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.081+0000 7efccd400640 1 -- start start 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efccd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fae0 0x7efcc81f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efccd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcc813fef0 0x7efcc80b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efccd400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8142730 0x7efcc8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efccd400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80cfab0 con 0x7efcc8142730 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efccd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80cf930 con 0x7efcc813fef0 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efccd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efcc80cfc30 con 0x7efcc813fae0 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efcc7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8142730 0x7efcc8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efcc7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8142730 0x7efcc8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38004/0 (socket says 172.21.15.118:38004) 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efcc6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fae0 0x7efcc81f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efcc7200640 1 -- 172.21.15.118:0/856238291 learned_addr learned my addr 172.21.15.118:0/856238291 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:40.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.083+0000 7efcbde00640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcc813fef0 0x7efcc80b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcc7200640 1 -- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fae0 msgr2=0x7efcc81f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcc7200640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fae0 0x7efcc81f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcc7200640 1 -- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcc813fef0 msgr2=0x7efcc80b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcc7200640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcc813fef0 0x7efcc80b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcc7200640 1 -- 172.21.15.118:0/856238291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc81f4500 con 0x7efcc8142730 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcc7200640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8142730 0x7efcc8159f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c420 tx=0x7efcc000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcbf400640 1 -- 172.21.15.118:0/856238291 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011790 con 0x7efcc8142730 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcbf400640 1 -- 172.21.15.118:0/856238291 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcc0017070 con 0x7efcc8142730 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efcbf400640 1 -- 172.21.15.118:0/856238291 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011cc0 con 0x7efcc8142730 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.084+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc81f47e0 con 0x7efcc8142730 2024-09-21T06:04:40.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.085+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc8153250 con 0x7efcc8142730 2024-09-21T06:04:40.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.086+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc80d0150 con 0x7efcc8142730 2024-09-21T06:04:40.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.087+0000 7efcbf400640 1 -- 172.21.15.118:0/856238291 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efcc001c460 con 0x7efcc8142730 2024-09-21T06:04:40.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.088+0000 7efcbf400640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efca4078bc0 0x7efca407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.088+0000 7efcbf400640 1 -- 172.21.15.118:0/856238291 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7efcc009a640 con 0x7efcc8142730 2024-09-21T06:04:40.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.088+0000 7efcc6800640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efca4078bc0 0x7efca407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.089+0000 7efcc6800640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efca4078bc0 0x7efca407b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcb80099a0 tx=0x7efcb8009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.092+0000 7efcbf400640 1 -- 172.21.15.118:0/856238291 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efcc00626e0 con 0x7efcc8142730 2024-09-21T06:04:40.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.353+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7efcc80cdbe0 con 0x7efcc8142730 2024-09-21T06:04:40.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.356+0000 7efcbf400640 1 -- 172.21.15.118:0/856238291 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7efcc0067110 con 0x7efcc8142730 2024-09-21T06:04:40.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.358+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efca4078bc0 msgr2=0x7efca407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.358+0000 7efccd400640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efca4078bc0 0x7efca407b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcb80099a0 tx=0x7efcb8009500 comp rx=0 tx=0).stop 2024-09-21T06:04:40.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.358+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8142730 msgr2=0x7efcc8159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.358+0000 7efccd400640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8142730 0x7efcc8159f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c420 tx=0x7efcc000c8e0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.358+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 shutdown_connections 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.358+0000 7efccd400640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc8142730 0x7efcc8159f80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.358+0000 7efccd400640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcc813fef0 0x7efcc80b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.359+0000 7efccd400640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efca4078bc0 0x7efca407b0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.359+0000 7efccd400640 1 --2- 172.21.15.118:0/856238291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcc813fae0 0x7efcc81f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.359+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 >> 172.21.15.118:0/856238291 conn(0x7efcc806d110 msgr2=0x7efcc815b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.359+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 shutdown_connections 2024-09-21T06:04:40.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.359+0000 7efccd400640 1 -- 172.21.15.118:0/856238291 wait complete. 2024-09-21T06:04:40.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T06:04:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.603+0000 7f069d200640 1 -- 172.21.15.118:0/2669984599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f067c004800 msgr2=0x7f067c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.603+0000 7f069d200640 1 --2- 172.21.15.118:0/2669984599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f067c004800 0x7f067c004c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06800016c0 tx=0x7f067c005830 comp rx=0 tx=0).stop 2024-09-21T06:04:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.603+0000 7f069d200640 1 -- 172.21.15.118:0/2669984599 shutdown_connections 2024-09-21T06:04:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.603+0000 7f069d200640 1 --2- 172.21.15.118:0/2669984599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f067c004800 0x7f067c004c10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.603+0000 7f069d200640 1 -- 172.21.15.118:0/2669984599 >> 172.21.15.118:0/2669984599 conn(0x7f069806d6e0 msgr2=0x7f06980b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.603+0000 7f069d200640 1 -- 172.21.15.118:0/2669984599 shutdown_connections 2024-09-21T06:04:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.603+0000 7f069d200640 1 -- 172.21.15.118:0/2669984599 wait complete. 2024-09-21T06:04:40.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.605+0000 7f069d200640 1 Processor -- start 2024-09-21T06:04:40.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.605+0000 7f069d200640 1 -- start start 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f069d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c004800 0x7f069812f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f069d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069812fd20 0x7f069813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f069d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069813fd30 0x7f0698140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f069d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f06980d05d0 con 0x7f069813fd30 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f069d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06980d0450 con 0x7f067c004800 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f069d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06980749f0 con 0x7f069812fd20 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f0697e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069813fd30 0x7f0698140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f0697e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069813fd30 0x7f0698140140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38032/0 (socket says 172.21.15.118:38032) 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f0697e00640 1 -- 172.21.15.118:0/4067193029 learned_addr learned my addr 172.21.15.118:0/4067193029 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:40.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f068ea00640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069812fd20 0x7f069813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.607+0000 7f0697400640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c004800 0x7f069812f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f0697e00640 1 -- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069812fd20 msgr2=0x7f069813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f0697e00640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069812fd20 0x7f069813f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f0697e00640 1 -- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c004800 msgr2=0x7f069812f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f0697e00640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c004800 0x7f069812f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f0697e00640 1 -- 172.21.15.118:0/4067193029 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0698140680 con 0x7f069813fd30 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f068ea00640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069812fd20 0x7f069813f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f0697400640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c004800 0x7f069812f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f0697e00640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069813fd30 0x7f0698140140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06980cfba0 tx=0x7f069000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f068fe00640 1 -- 172.21.15.118:0/4067193029 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690003d80 con 0x7f069813fd30 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f068fe00640 1 -- 172.21.15.118:0/4067193029 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0690004b20 con 0x7f069813fd30 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0698130130 con 0x7f069813fd30 2024-09-21T06:04:40.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f068fe00640 1 -- 172.21.15.118:0/4067193029 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690004030 con 0x7f069813fd30 2024-09-21T06:04:40.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.608+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06981e88d0 con 0x7f069813fd30 2024-09-21T06:04:40.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.610+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06980b5bb0 con 0x7f069813fd30 2024-09-21T06:04:40.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.611+0000 7f068fe00640 1 -- 172.21.15.118:0/4067193029 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06900041d0 con 0x7f069813fd30 2024-09-21T06:04:40.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.612+0000 7f068fe00640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0674078b90 0x7f067407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.612+0000 7f068fe00640 1 -- 172.21.15.118:0/4067193029 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f069009ba90 con 0x7f069813fd30 2024-09-21T06:04:40.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.612+0000 7f0697400640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0674078b90 0x7f067407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.613+0000 7f0697400640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0674078b90 0x7f067407b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0688000fb0 tx=0x7f06880067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.616+0000 7f068fe00640 1 -- 172.21.15.118:0/4067193029 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0690064220 con 0x7f069813fd30 2024-09-21T06:04:40.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.872+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f06980cce10 con 0x7f069813fd30 2024-09-21T06:04:40.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.875+0000 7f068fe00640 1 -- 172.21.15.118:0/4067193029 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f0690063b20 con 0x7f069813fd30 2024-09-21T06:04:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0674078b90 msgr2=0x7f067407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0674078b90 0x7f067407b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0688000fb0 tx=0x7f06880067a0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069813fd30 msgr2=0x7f0698140140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069813fd30 0x7f0698140140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06980cfba0 tx=0x7f069000f790 comp rx=0 tx=0).stop 2024-09-21T06:04:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 shutdown_connections 2024-09-21T06:04:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069813fd30 0x7f0698140140 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0674078b90 0x7f067407b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069812fd20 0x7f069813f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 --2- 172.21.15.118:0/4067193029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f067c004800 0x7f069812f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.877+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 >> 172.21.15.118:0/4067193029 conn(0x7f069806d6e0 msgr2=0x7f0698156650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.878+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 shutdown_connections 2024-09-21T06:04:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:40.878+0000 7f069d200640 1 -- 172.21.15.118:0/4067193029 wait complete. 2024-09-21T06:04:40.902 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T06:04:41.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 -- 172.21.15.118:0/2121333334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fef0 msgr2=0x7f6c180d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 --2- 172.21.15.118:0/2121333334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fef0 0x7f6c180d13c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c180ce200 tx=0x7f6c0002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 -- 172.21.15.118:0/2121333334 shutdown_connections 2024-09-21T06:04:41.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 --2- 172.21.15.118:0/2121333334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fef0 0x7f6c180d13c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 --2- 172.21.15.118:0/2121333334 >> v2:172.21.15.149:3300/0 conn(0x7f6c18142730 0x7f6c18142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 --2- 172.21.15.118:0/2121333334 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c1813fae0 0x7f6c180d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 -- 172.21.15.118:0/2121333334 >> 172.21.15.118:0/2121333334 conn(0x7f6c1806d110 msgr2=0x7f6c1806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.124+0000 7f6c1e200640 1 -- 172.21.15.118:0/2121333334 shutdown_connections 2024-09-21T06:04:41.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.125+0000 7f6c1e200640 1 -- 172.21.15.118:0/2121333334 wait complete. 2024-09-21T06:04:41.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.127+0000 7f6c1e200640 1 Processor -- start 2024-09-21T06:04:41.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.127+0000 7f6c1e200640 1 -- start start 2024-09-21T06:04:41.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.128+0000 7f6c1e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fae0 0x7f6c18073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.128+0000 7f6c1e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c1813fef0 0x7f6c18073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.128+0000 7f6c1e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c18142730 0x7f6c18074410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.128+0000 7f6c1e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1806f330 con 0x7f6c1813fae0 2024-09-21T06:04:41.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.128+0000 7f6c1e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1806f1b0 con 0x7f6c18142730 2024-09-21T06:04:41.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.128+0000 7f6c1e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1806f4b0 con 0x7f6c1813fef0 2024-09-21T06:04:41.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fae0 0x7f6c18073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fae0 0x7f6c18073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38048/0 (socket says 172.21.15.118:38048) 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 -- 172.21.15.118:0/66350329 learned_addr learned my addr 172.21.15.118:0/66350329 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c0ea00640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c1813fef0 0x7f6c18073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17e00640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c18142730 0x7f6c18074410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 -- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c1813fef0 msgr2=0x7f6c18073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c1813fef0 0x7f6c18073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 -- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c18142730 msgr2=0x7f6c18074410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c18142730 0x7f6c18074410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 -- 172.21.15.118:0/66350329 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180b5370 con 0x7f6c1813fae0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.129+0000 7f6c17400640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fae0 0x7f6c18073990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e7f0 tx=0x7f6c0800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.130+0000 7f6c0fe00640 1 -- 172.21.15.118:0/66350329 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800ccc0 con 0x7f6c1813fae0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.130+0000 7f6c0fe00640 1 -- 172.21.15.118:0/66350329 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c0800ce80 con 0x7f6c1813fae0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.130+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c180b4ad0 con 0x7f6c1813fae0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.130+0000 7f6c0fe00640 1 -- 172.21.15.118:0/66350329 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08005280 con 0x7f6c1813fae0 2024-09-21T06:04:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.130+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c180b5090 con 0x7f6c1813fae0 2024-09-21T06:04:41.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.131+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1806f960 con 0x7f6c1813fae0 2024-09-21T06:04:41.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.132+0000 7f6c0fe00640 1 -- 172.21.15.118:0/66350329 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c08005420 con 0x7f6c1813fae0 2024-09-21T06:04:41.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.133+0000 7f6c0fe00640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bf4078b90 0x7f6bf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.133+0000 7f6c0fe00640 1 -- 172.21.15.118:0/66350329 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f6c0809b300 con 0x7f6c1813fae0 2024-09-21T06:04:41.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.134+0000 7f6c0ea00640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bf4078b90 0x7f6bf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.134+0000 7f6c0ea00640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bf4078b90 0x7f6bf407b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c00033000 tx=0x7f6c00004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.137+0000 7f6c0fe00640 1 -- 172.21.15.118:0/66350329 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6c080633a0 con 0x7f6c1813fae0 2024-09-21T06:04:41.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.392+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f6c180d01d0 con 0x7f6c1813fae0 2024-09-21T06:04:41.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.395+0000 7f6c0fe00640 1 -- 172.21.15.118:0/66350329 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f6c08067dd0 con 0x7f6c1813fae0 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bf4078b90 msgr2=0x7f6bf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bf4078b90 0x7f6bf407b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c00033000 tx=0x7f6c00004730 comp rx=0 tx=0).stop 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fae0 msgr2=0x7f6c18073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fae0 0x7f6c18073990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e7f0 tx=0x7f6c0800ecb0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 shutdown_connections 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c18142730 0x7f6c18074410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bf4078b90 0x7f6bf407b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c1813fef0 0x7f6c18073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 --2- 172.21.15.118:0/66350329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c1813fae0 0x7f6c18073990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 >> 172.21.15.118:0/66350329 conn(0x7f6c1806d110 msgr2=0x7f6c180cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 shutdown_connections 2024-09-21T06:04:41.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.398+0000 7f6c1e200640 1 -- 172.21.15.118:0/66350329 wait complete. 2024-09-21T06:04:41.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:04:41.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 -- 172.21.15.118:0/1173698183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee80d1590 msgr2=0x7f5ee8142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 --2- 172.21.15.118:0/1173698183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee80d1590 0x7f5ee8142730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ee815d420 tx=0x7f5ed402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 -- 172.21.15.118:0/1173698183 shutdown_connections 2024-09-21T06:04:41.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 --2- 172.21.15.118:0/1173698183 >> v2:172.21.15.149:3300/0 conn(0x7f5ee813fef0 0x7f5ee8142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 --2- 172.21.15.118:0/1173698183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee80d1590 0x7f5ee8142730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 -- 172.21.15.118:0/1173698183 >> 172.21.15.118:0/1173698183 conn(0x7f5ee806d110 msgr2=0x7f5ee806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 -- 172.21.15.118:0/1173698183 shutdown_connections 2024-09-21T06:04:41.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.637+0000 7f5eed400640 1 -- 172.21.15.118:0/1173698183 wait complete. 2024-09-21T06:04:41.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.640+0000 7f5eed400640 1 Processor -- start 2024-09-21T06:04:41.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.640+0000 7f5eed400640 1 -- start start 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5eed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee813fae0 0x7f5ee81413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5eed400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ee813fef0 0x7f5ee8141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5eed400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee806f300 0x7f5ee813d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5eed400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee80cfa70 con 0x7f5ee813fae0 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5eed400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee80cf8f0 con 0x7f5ee806f300 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5eed400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee80cfbf0 con 0x7f5ee813fef0 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5ee6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee813fae0 0x7f5ee81413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5ee6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee813fae0 0x7f5ee81413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38062/0 (socket says 172.21.15.118:38062) 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.641+0000 7f5ee6800640 1 -- 172.21.15.118:0/3036072724 learned_addr learned my addr 172.21.15.118:0/3036072724 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee7200640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee806f300 0x7f5ee813d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee5e00640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ee813fef0 0x7f5ee8141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee6800640 1 -- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ee813fef0 msgr2=0x7f5ee8141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee6800640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ee813fef0 0x7f5ee8141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee6800640 1 -- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee806f300 msgr2=0x7f5ee813d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee6800640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee806f300 0x7f5ee813d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee6800640 1 -- 172.21.15.118:0/3036072724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee80b3b70 con 0x7f5ee813fae0 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee5e00640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ee813fef0 0x7f5ee8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee7200640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee806f300 0x7f5ee813d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5ee6800640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee813fae0 0x7f5ee81413c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c7d0 tx=0x7f5ed800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5edea00640 1 -- 172.21.15.118:0/3036072724 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8017070 con 0x7f5ee813fae0 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5edea00640 1 -- 172.21.15.118:0/3036072724 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ed8005070 con 0x7f5ee813fae0 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee80b3e50 con 0x7f5ee813fae0 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.642+0000 7f5edea00640 1 -- 172.21.15.118:0/3036072724 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80054a0 con 0x7f5ee813fae0 2024-09-21T06:04:41.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.643+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee80b4410 con 0x7f5ee813fae0 2024-09-21T06:04:41.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.644+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee80d0110 con 0x7f5ee813fae0 2024-09-21T06:04:41.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.645+0000 7f5edea00640 1 -- 172.21.15.118:0/3036072724 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ed801a070 con 0x7f5ee813fae0 2024-09-21T06:04:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.646+0000 7f5edea00640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ec8078b90 0x7f5ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.646+0000 7f5edea00640 1 -- 172.21.15.118:0/3036072724 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f5ed809a0d0 con 0x7f5ee813fae0 2024-09-21T06:04:41.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.646+0000 7f5ee5e00640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ec8078b90 0x7f5ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.647+0000 7f5ee5e00640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ec8078b90 0x7f5ec807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4034000 tx=0x7f5ed4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.650+0000 7f5edea00640 1 -- 172.21.15.118:0/3036072724 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5ed80627e0 con 0x7f5ee813fae0 2024-09-21T06:04:41.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.838+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5ee815ea00 con 0x7f5ee813fae0 2024-09-21T06:04:41.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.839+0000 7f5edea00640 1 -- 172.21.15.118:0/3036072724 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f5ed80620e0 con 0x7f5ee813fae0 2024-09-21T06:04:41.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:41.841 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:04:41.841 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:04:41.841 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:04:41.841 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:04:41.842 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:04:41.842 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:04:41.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.841+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ec8078b90 msgr2=0x7f5ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.841+0000 7f5eed400640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ec8078b90 0x7f5ec807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4034000 tx=0x7f5ed4004730 comp rx=0 tx=0).stop 2024-09-21T06:04:41.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.841+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee813fae0 msgr2=0x7f5ee81413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.841+0000 7f5eed400640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee813fae0 0x7f5ee81413c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c7d0 tx=0x7f5ed800cc90 comp rx=0 tx=0).stop 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 shutdown_connections 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ee806f300 0x7f5ee813d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ec8078b90 0x7f5ec807b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ee813fef0 0x7f5ee8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 --2- 172.21.15.118:0/3036072724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ee813fae0 0x7f5ee81413c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 >> 172.21.15.118:0/3036072724 conn(0x7f5ee806d110 msgr2=0x7f5ee81535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 shutdown_connections 2024-09-21T06:04:41.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:41.842+0000 7f5eed400640 1 -- 172.21.15.118:0/3036072724 wait complete. 2024-09-21T06:04:41.865 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:04:41.865 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:04:42.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.087+0000 7f9c5b200640 1 -- 172.21.15.118:0/1012470912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c0cd380 msgr2=0x7f9c5c1606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.087+0000 7f9c5b200640 1 --2- 172.21.15.118:0/1012470912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c0cd380 0x7f9c5c1606e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009830 tx=0x7f9c4402a530 comp rx=0 tx=0).stop 2024-09-21T06:04:42.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.087+0000 7f9c5b200640 1 -- 172.21.15.118:0/1012470912 shutdown_connections 2024-09-21T06:04:42.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.087+0000 7f9c5b200640 1 --2- 172.21.15.118:0/1012470912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c0cd380 0x7f9c5c1606e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.087+0000 7f9c5b200640 1 -- 172.21.15.118:0/1012470912 >> 172.21.15.118:0/1012470912 conn(0x7f9c5c06d420 msgr2=0x7f9c5c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.087+0000 7f9c5b200640 1 -- 172.21.15.118:0/1012470912 shutdown_connections 2024-09-21T06:04:42.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.087+0000 7f9c5b200640 1 -- 172.21.15.118:0/1012470912 wait complete. 2024-09-21T06:04:42.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.089+0000 7f9c5b200640 1 Processor -- start 2024-09-21T06:04:42.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.089+0000 7f9c5b200640 1 -- start start 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5c0cd380 0x7f9c5c1520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c5c0cf790 0x7f9c5c0740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c160c20 0x7f9c5c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c06fb90 con 0x7f9c5c160c20 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c06fa10 con 0x7f9c5c0cd380 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5c06fd10 con 0x7f9c5c0cf790 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c160c20 0x7f9c5c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c160c20 0x7f9c5c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38074/0 (socket says 172.21.15.118:38074) 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 -- 172.21.15.118:0/351432460 learned_addr learned my addr 172.21.15.118:0/351432460 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:42.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c51400640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c5c0cf790 0x7f9c5c0740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c59e00640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5c0cd380 0x7f9c5c1520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 -- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c5c0cf790 msgr2=0x7f9c5c0740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c5c0cf790 0x7f9c5c0740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 -- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5c0cd380 msgr2=0x7f9c5c1520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5c0cd380 0x7f9c5c1520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.091+0000 7f9c5a800640 1 -- 172.21.15.118:0/351432460 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5c1f99b0 con 0x7f9c5c160c20 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.092+0000 7f9c5a800640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c160c20 0x7f9c5c0ae8b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c700 tx=0x7f9c5400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.092+0000 7f9c52a00640 1 -- 172.21.15.118:0/351432460 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54003b70 con 0x7f9c5c160c20 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.092+0000 7f9c52a00640 1 -- 172.21.15.118:0/351432460 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c54003d10 con 0x7f9c5c160c20 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.092+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5c1f9c90 con 0x7f9c5c160c20 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.092+0000 7f9c52a00640 1 -- 172.21.15.118:0/351432460 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400aab0 con 0x7f9c5c160c20 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.092+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5c1fa250 con 0x7f9c5c160c20 2024-09-21T06:04:42.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.093+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c5c1606e0 con 0x7f9c5c160c20 2024-09-21T06:04:42.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.094+0000 7f9c52a00640 1 -- 172.21.15.118:0/351432460 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c5400ac50 con 0x7f9c5c160c20 2024-09-21T06:04:42.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.095+0000 7f9c52a00640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c38078b90 0x7f9c3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.095+0000 7f9c52a00640 1 -- 172.21.15.118:0/351432460 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f9c5409a710 con 0x7f9c5c160c20 2024-09-21T06:04:42.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.096+0000 7f9c59e00640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c38078b90 0x7f9c3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.096+0000 7f9c59e00640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c38078b90 0x7f9c3807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c007d60 tx=0x7f9c4c007cf0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.100+0000 7f9c52a00640 1 -- 172.21.15.118:0/351432460 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9c540627b0 con 0x7f9c5c160c20 2024-09-21T06:04:42.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.284+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9c5c0b30f0 con 0x7f9c5c160c20 2024-09-21T06:04:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.760+0000 7f9c52a00640 1 -- 172.21.15.118:0/351432460 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7f9c540671e0 con 0x7f9c5c160c20 2024-09-21T06:04:42.762 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:04:42.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.762+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c38078b90 msgr2=0x7f9c3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.762+0000 7f9c5b200640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c38078b90 0x7f9c3807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c007d60 tx=0x7f9c4c007cf0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.762+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c160c20 msgr2=0x7f9c5c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.762+0000 7f9c5b200640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c160c20 0x7f9c5c0ae8b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c700 tx=0x7f9c5400cbc0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 shutdown_connections 2024-09-21T06:04:42.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c5c160c20 0x7f9c5c0ae8b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c38078b90 0x7f9c3807b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c5c0cf790 0x7f9c5c0740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 --2- 172.21.15.118:0/351432460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5c0cd380 0x7f9c5c1520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 >> 172.21.15.118:0/351432460 conn(0x7f9c5c06d420 msgr2=0x7f9c5c15fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 shutdown_connections 2024-09-21T06:04:42.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:42.763+0000 7f9c5b200640 1 -- 172.21.15.118:0/351432460 wait complete. 2024-09-21T06:04:42.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:04:43.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 -- 172.21.15.118:0/2817691279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 msgr2=0x7fa62c0b9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 --2- 172.21.15.118:0/2817691279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 0x7fa62c0b9ea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009820 tx=0x7fa61c02a470 comp rx=0 tx=0).stop 2024-09-21T06:04:43.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 -- 172.21.15.118:0/2817691279 shutdown_connections 2024-09-21T06:04:43.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 --2- 172.21.15.118:0/2817691279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa62c0d0250 0x7fa62c0b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 --2- 172.21.15.118:0/2817691279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 0x7fa62c0b9ea0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 -- 172.21.15.118:0/2817691279 >> 172.21.15.118:0/2817691279 conn(0x7fa62c0d4bd0 msgr2=0x7fa62c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:43.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 -- 172.21.15.118:0/2817691279 shutdown_connections 2024-09-21T06:04:43.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.018+0000 7fa632600640 1 -- 172.21.15.118:0/2817691279 wait complete. 2024-09-21T06:04:43.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.021+0000 7fa632600640 1 Processor -- start 2024-09-21T06:04:43.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.021+0000 7fa632600640 1 -- start start 2024-09-21T06:04:43.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.022+0000 7fa632600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 0x7fa62c15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.022+0000 7fa632600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa62c0cf730 0x7fa62c1fa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.022+0000 7fa632600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa62c0d0250 0x7fa62c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.022+0000 7fa632600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c0b8a60 con 0x7fa62c0d0250 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.022+0000 7fa632600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c0b88e0 con 0x7fa62c0b6180 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.022+0000 7fa632600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c0b8be0 con 0x7fa62c0cf730 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.022+0000 7fa631c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa62c0d0250 0x7fa62c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa62c0d0250 0x7fa62c158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38080/0 (socket says 172.21.15.118:38080) 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 -- 172.21.15.118:0/2584968203 learned_addr learned my addr 172.21.15.118:0/2584968203 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631200640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 0x7fa62c15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa623e00640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa62c0cf730 0x7fa62c1fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 -- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa62c0cf730 msgr2=0x7fa62c1fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa62c0cf730 0x7fa62c1fa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 -- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 msgr2=0x7fa62c15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 0x7fa62c15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 -- 172.21.15.118:0/2584968203 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c1f6740 con 0x7fa62c0d0250 2024-09-21T06:04:43.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.023+0000 7fa631c00640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa62c0d0250 0x7fa62c158050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa62400ec20 tx=0x7fa62400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:43.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.024+0000 7fa629600640 1 -- 172.21.15.118:0/2584968203 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624003b70 con 0x7fa62c0d0250 2024-09-21T06:04:43.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.024+0000 7fa629600640 1 -- 172.21.15.118:0/2584968203 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa624003d10 con 0x7fa62c0d0250 2024-09-21T06:04:43.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.024+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62c1f6a20 con 0x7fa62c0d0250 2024-09-21T06:04:43.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.024+0000 7fa629600640 1 -- 172.21.15.118:0/2584968203 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624004280 con 0x7fa62c0d0250 2024-09-21T06:04:43.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.024+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62c15f1f0 con 0x7fa62c0d0250 2024-09-21T06:04:43.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.025+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62c076700 con 0x7fa62c0d0250 2024-09-21T06:04:43.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.026+0000 7fa629600640 1 -- 172.21.15.118:0/2584968203 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa624004420 con 0x7fa62c0d0250 2024-09-21T06:04:43.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.027+0000 7fa629600640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa608078b90 0x7fa60807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.027+0000 7fa629600640 1 -- 172.21.15.118:0/2584968203 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7fa62409b740 con 0x7fa62c0d0250 2024-09-21T06:04:43.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.028+0000 7fa631200640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa608078b90 0x7fa60807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.028+0000 7fa631200640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa608078b90 0x7fa60807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa61c034000 tx=0x7fa61c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:43.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.032+0000 7fa629600640 1 -- 172.21.15.118:0/2584968203 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa62c076700 con 0x7fa62c0d0250 2024-09-21T06:04:43.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.217+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa62c15f450 con 0x7fa62c0d0250 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.763+0000 7fa629600640 1 -- 172.21.15.118:0/2584968203 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7fa624063670 con 0x7fa62c0d0250 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.767+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa608078b90 msgr2=0x7fa60807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.767+0000 7fa632600640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa608078b90 0x7fa60807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa61c034000 tx=0x7fa61c004730 comp rx=0 tx=0).stop 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.767+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa62c0d0250 msgr2=0x7fa62c158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.767+0000 7fa632600640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa62c0d0250 0x7fa62c158050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa62400ec20 tx=0x7fa62400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.768+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 shutdown_connections 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.768+0000 7fa632600640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa62c0d0250 0x7fa62c158050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.768+0000 7fa632600640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa608078b90 0x7fa60807b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.768+0000 7fa632600640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa62c0cf730 0x7fa62c1fa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.768+0000 7fa632600640 1 --2- 172.21.15.118:0/2584968203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa62c0b6180 0x7fa62c15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.768+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 >> 172.21.15.118:0/2584968203 conn(0x7fa62c0d4bd0 msgr2=0x7fa62c1590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.769+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 shutdown_connections 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:43.770+0000 7fa632600640 1 -- 172.21.15.118:0/2584968203 wait complete. 2024-09-21T06:04:43.807 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 -- 172.21.15.118:0/3906593535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74160240 msgr2=0x7fab7406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 --2- 172.21.15.118:0/3906593535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74160240 0x7fab7406ecd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fab74072aa0 tx=0x7fab6402a560 comp rx=0 tx=0).stop 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 -- 172.21.15.118:0/3906593535 shutdown_connections 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 --2- 172.21.15.118:0/3906593535 >> v2:172.21.15.149:3300/0 conn(0x7fab74156270 0x7fab740d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 --2- 172.21.15.118:0/3906593535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab74155e60 0x7fab740d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 --2- 172.21.15.118:0/3906593535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74160240 0x7fab7406ecd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 -- 172.21.15.118:0/3906593535 >> 172.21.15.118:0/3906593535 conn(0x7fab7406d110 msgr2=0x7fab7406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 -- 172.21.15.118:0/3906593535 shutdown_connections 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.028+0000 7fab79000640 1 -- 172.21.15.118:0/3906593535 wait complete. 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.031+0000 7fab79000640 1 Processor -- start 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.031+0000 7fab79000640 1 -- start start 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab79000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74155e60 0x7fab7415eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab79000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74156270 0x7fab740af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab79000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab74160240 0x7fab740af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab79000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab74073c70 con 0x7fab74156270 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab79000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab74073af0 con 0x7fab74155e60 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab79000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab74073df0 con 0x7fab74160240 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab69400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74156270 0x7fab740af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab69400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74156270 0x7fab740af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38102/0 (socket says 172.21.15.118:38102) 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab69400640 1 -- 172.21.15.118:0/1404167066 learned_addr learned my addr 172.21.15.118:0/1404167066 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.032+0000 7fab71e00640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74155e60 0x7fab7415eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab72800640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab74160240 0x7fab740af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab69400640 1 -- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab74160240 msgr2=0x7fab740af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab69400640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab74160240 0x7fab740af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab69400640 1 -- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74155e60 msgr2=0x7fab7415eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab69400640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74155e60 0x7fab7415eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab69400640 1 -- 172.21.15.118:0/1404167066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab74150de0 con 0x7fab74156270 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab69400640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74156270 0x7fab740af0b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00e6f0 tx=0x7fab5c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab6aa00640 1 -- 172.21.15.118:0/1404167066 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c004230 con 0x7fab74156270 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.033+0000 7fab6aa00640 1 -- 172.21.15.118:0/1404167066 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab5c004410 con 0x7fab74156270 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.034+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab740afdc0 con 0x7fab74156270 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.034+0000 7fab6aa00640 1 -- 172.21.15.118:0/1404167066 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00cab0 con 0x7fab74156270 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.034+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab740b0380 con 0x7fab74156270 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.035+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab740afb30 con 0x7fab74156270 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.036+0000 7fab6aa00640 1 -- 172.21.15.118:0/1404167066 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab5c00cc50 con 0x7fab74156270 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.037+0000 7fab6aa00640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab50078bc0 0x7fab5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.037+0000 7fab6aa00640 1 -- 172.21.15.118:0/1404167066 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7fab5c09b3b0 con 0x7fab74156270 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.037+0000 7fab71e00640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab50078bc0 0x7fab5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.038+0000 7fab71e00640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab50078bc0 0x7fab5007b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab64033000 tx=0x7fab64004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.042+0000 7fab6aa00640 1 -- 172.21.15.118:0/1404167066 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fab5c063290 con 0x7fab74156270 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.263+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fab7406ecd0 con 0x7fab74156270 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.787+0000 7fab6aa00640 1 -- 172.21.15.118:0/1404167066 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fab5c067cc0 con 0x7fab74156270 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 4 and data pool 5 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab50078bc0 msgr2=0x7fab5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab50078bc0 0x7fab5007b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab64033000 tx=0x7fab64004730 comp rx=0 tx=0).stop 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74156270 msgr2=0x7fab740af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74156270 0x7fab740af0b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00e6f0 tx=0x7fab5c00ebb0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 shutdown_connections 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab50078bc0 0x7fab5007b0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab74160240 0x7fab740af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab74156270 0x7fab740af0b0 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00e6f0 tx=0x7fab5c00ebb0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 --2- 172.21.15.118:0/1404167066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74155e60 0x7fab7415eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.793+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 >> 172.21.15.118:0/1404167066 conn(0x7fab7406d110 msgr2=0x7fab74157180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.795+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 shutdown_connections 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:44.795+0000 7fab79000640 1 -- 172.21.15.118:0/1404167066 wait complete. 2024-09-21T06:04:44.829 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.047+0000 7ff979600640 1 -- 172.21.15.118:0/3539429803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff97415fba0 msgr2=0x7ff9740d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.047+0000 7ff979600640 1 --2- 172.21.15.118:0/3539429803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff97415fba0 0x7ff9740d1330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff97408dda0 tx=0x7ff96c02aac0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.047+0000 7ff979600640 1 -- 172.21.15.118:0/3539429803 shutdown_connections 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.047+0000 7ff979600640 1 --2- 172.21.15.118:0/3539429803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff97415fba0 0x7ff9740d1330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.047+0000 7ff979600640 1 --2- 172.21.15.118:0/3539429803 >> v2:172.21.15.149:3300/0 conn(0x7ff974163900 0x7ff97415f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.047+0000 7ff979600640 1 -- 172.21.15.118:0/3539429803 >> 172.21.15.118:0/3539429803 conn(0x7ff97406d1c0 msgr2=0x7ff97406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.047+0000 7ff979600640 1 -- 172.21.15.118:0/3539429803 shutdown_connections 2024-09-21T06:04:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.048+0000 7ff979600640 1 -- 172.21.15.118:0/3539429803 wait complete. 2024-09-21T06:04:45.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.050+0000 7ff979600640 1 Processor -- start 2024-09-21T06:04:45.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.050+0000 7ff979600640 1 -- start start 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.051+0000 7ff979600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff97415fba0 0x7ff9740cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.051+0000 7ff979600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9741634f0 0x7ff974149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.051+0000 7ff979600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff974163900 0x7ff9740cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.051+0000 7ff979600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff9740d3aa0 con 0x7ff974163900 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.051+0000 7ff979600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff9740d3920 con 0x7ff97415fba0 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.051+0000 7ff979600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff9740d3c20 con 0x7ff9741634f0 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff974163900 0x7ff9740cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff974163900 0x7ff9740cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38112/0 (socket says 172.21.15.118:38112) 2024-09-21T06:04:45.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 -- 172.21.15.118:0/748265242 learned_addr learned my addr 172.21.15.118:0/748265242 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:45.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff973e00640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff97415fba0 0x7ff9740cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff973400640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9741634f0 0x7ff974149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 -- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9741634f0 msgr2=0x7ff974149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9741634f0 0x7ff974149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 -- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff97415fba0 msgr2=0x7ff9740cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff97415fba0 0x7ff9740cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 -- 172.21.15.118:0/748265242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9740cc700 con 0x7ff974163900 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.052+0000 7ff978c00640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff974163900 0x7ff9740cdb90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff96c02b0b0 tx=0x7ff96c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.053+0000 7ff96be00640 1 -- 172.21.15.118:0/748265242 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c004250 con 0x7ff974163900 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.053+0000 7ff96be00640 1 -- 172.21.15.118:0/748265242 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff96c0043f0 con 0x7ff974163900 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.053+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9740cc9e0 con 0x7ff974163900 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.053+0000 7ff96be00640 1 -- 172.21.15.118:0/748265242 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c004820 con 0x7ff974163900 2024-09-21T06:04:45.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.053+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9740ccfa0 con 0x7ff974163900 2024-09-21T06:04:45.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.054+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9740d1330 con 0x7ff974163900 2024-09-21T06:04:45.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.055+0000 7ff96be00640 1 -- 172.21.15.118:0/748265242 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff96c049430 con 0x7ff974163900 2024-09-21T06:04:45.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.056+0000 7ff96be00640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff954078b90 0x7ff95407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.056+0000 7ff96be00640 1 -- 172.21.15.118:0/748265242 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7ff96c0bbb50 con 0x7ff974163900 2024-09-21T06:04:45.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.057+0000 7ff973e00640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff954078b90 0x7ff95407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.057+0000 7ff973e00640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff954078b90 0x7ff95407b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff964001720 tx=0x7ff964009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:45.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.061+0000 7ff96be00640 1 -- 172.21.15.118:0/748265242 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff96c032030 con 0x7ff974163900 2024-09-21T06:04:45.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.243+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9740cc490 con 0x7ff974163900 2024-09-21T06:04:45.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.245+0000 7ff96be00640 1 -- 172.21.15.118:0/748265242 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16814 (secure 0 0 0) 0x7ff96c0838a0 con 0x7ff974163900 2024-09-21T06:04:45.246 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:45.247 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":30,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:04:44.264835+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:04:42.296386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T06:04:43.228581+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:45.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff954078b90 msgr2=0x7ff95407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff954078b90 0x7ff95407b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff964001720 tx=0x7ff964009040 comp rx=0 tx=0).stop 2024-09-21T06:04:45.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff974163900 msgr2=0x7ff9740cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff974163900 0x7ff9740cdb90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff96c02b0b0 tx=0x7ff96c003f10 comp rx=0 tx=0).stop 2024-09-21T06:04:45.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 shutdown_connections 2024-09-21T06:04:45.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff974163900 0x7ff9740cdb90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff954078b90 0x7ff95407b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9741634f0 0x7ff974149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 --2- 172.21.15.118:0/748265242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff97415fba0 0x7ff9740cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.247+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 >> 172.21.15.118:0/748265242 conn(0x7ff97406d1c0 msgr2=0x7ff97415de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:45.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.248+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 shutdown_connections 2024-09-21T06:04:45.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.248+0000 7ff979600640 1 -- 172.21.15.118:0/748265242 wait complete. 2024-09-21T06:04:45.271 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:45.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.492+0000 7f64a8a00640 1 -- 172.21.15.118:0/1006211858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 msgr2=0x7f6488004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.492+0000 7f64a8a00640 1 --2- 172.21.15.118:0/1006211858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 0x7f6488004c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f648c009b10 tx=0x7f6488005830 comp rx=0 tx=0).stop 2024-09-21T06:04:45.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.492+0000 7f64a3e00640 1 -- 172.21.15.118:0/1006211858 reap_dead start 2024-09-21T06:04:45.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.492+0000 7f64a8a00640 1 -- 172.21.15.118:0/1006211858 shutdown_connections 2024-09-21T06:04:45.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.492+0000 7f64a8a00640 1 -- 172.21.15.118:0/1006211858 >> 172.21.15.118:0/1006211858 conn(0x7f64a40b3640 msgr2=0x7f64a40b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:45.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.492+0000 7f64a8a00640 1 -- 172.21.15.118:0/1006211858 shutdown_connections 2024-09-21T06:04:45.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.492+0000 7f64a8a00640 1 -- 172.21.15.118:0/1006211858 wait complete. 2024-09-21T06:04:45.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.494+0000 7f64a8a00640 1 Processor -- start 2024-09-21T06:04:45.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.494+0000 7f64a8a00640 1 -- start start 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 0x7f64a41f9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a4154bc0 0x7f64a413fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a415aac0 0x7f64a415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a8a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f64a406faf0 con 0x7f6488004800 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f64a415c7b0 con 0x7f64a415aac0 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64a406fc70 con 0x7f64a4154bc0 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 0x7f64a41f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 0x7f64a41f9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38126/0 (socket says 172.21.15.118:38126) 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 -- 172.21.15.118:0/4066769365 learned_addr learned my addr 172.21.15.118:0/4066769365 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f649be00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a4154bc0 0x7f64a413fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3e00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a415aac0 0x7f64a415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 -- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a4154bc0 msgr2=0x7f64a413fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a4154bc0 0x7f64a413fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 -- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a415aac0 msgr2=0x7f64a415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a415aac0 0x7f64a415aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f64a3400640 1 -- 172.21.15.118:0/4066769365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a415b410 con 0x7f6488004800 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.496+0000 7f649be00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a4154bc0 0x7f64a413fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.497+0000 7f64a3400640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 0x7f64a41f9790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6494006600 tx=0x7f64940039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:45.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.497+0000 7f649b400640 1 -- 172.21.15.118:0/4066769365 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494015070 con 0x7f6488004800 2024-09-21T06:04:45.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.497+0000 7f649b400640 1 -- 172.21.15.118:0/4066769365 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6494011900 con 0x7f6488004800 2024-09-21T06:04:45.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.497+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a41425d0 con 0x7f6488004800 2024-09-21T06:04:45.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.497+0000 7f649b400640 1 -- 172.21.15.118:0/4066769365 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494011d50 con 0x7f6488004800 2024-09-21T06:04:45.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.497+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a41533d0 con 0x7f6488004800 2024-09-21T06:04:45.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.498+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a4073f60 con 0x7f6488004800 2024-09-21T06:04:45.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.499+0000 7f649b400640 1 -- 172.21.15.118:0/4066769365 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6494018070 con 0x7f6488004800 2024-09-21T06:04:45.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.500+0000 7f649b400640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6480078bc0 0x7f648007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.500+0000 7f649b400640 1 -- 172.21.15.118:0/4066769365 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f649409ba60 con 0x7f6488004800 2024-09-21T06:04:45.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.501+0000 7f649be00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6480078bc0 0x7f648007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.502+0000 7f649be00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6480078bc0 0x7f648007b0d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c0046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:45.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.505+0000 7f649b400640 1 -- 172.21.15.118:0/4066769365 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f64a415b410 con 0x7f6488004800 2024-09-21T06:04:45.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.690+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64a4070710 con 0x7f6488004800 2024-09-21T06:04:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.691+0000 7f649b400640 1 -- 172.21.15.118:0/4066769365 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16814 (secure 0 0 0) 0x7f64a40744a0 con 0x7f6488004800 2024-09-21T06:04:45.693 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:45.693 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":30,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:04:44.264835+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:04:42.296386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T06:04:43.228581+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6480078bc0 msgr2=0x7f648007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6480078bc0 0x7f648007b0d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 msgr2=0x7f64a41f9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 0x7f64a41f9790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6494006600 tx=0x7f64940039c0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 shutdown_connections 2024-09-21T06:04:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a415aac0 0x7f64a415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6480078bc0 0x7f648007b0d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a4154bc0 0x7f64a413fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 --2- 172.21.15.118:0/4066769365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6488004800 0x7f64a41f9790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 >> 172.21.15.118:0/4066769365 conn(0x7f64a40b3640 msgr2=0x7f64a40b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:45.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 shutdown_connections 2024-09-21T06:04:45.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.694+0000 7f64a8a00640 1 -- 172.21.15.118:0/4066769365 wait complete. 2024-09-21T06:04:45.721 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 -- 172.21.15.118:0/230390647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 msgr2=0x7f92cc0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 --2- 172.21.15.118:0/230390647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0d13c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92cc071c00 tx=0x7f92b402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 -- 172.21.15.118:0/230390647 shutdown_connections 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 --2- 172.21.15.118:0/230390647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0d13c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 --2- 172.21.15.118:0/230390647 >> v2:172.21.15.149:3300/0 conn(0x7f92cc13fae0 0x7f92cc0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 -- 172.21.15.118:0/230390647 >> 172.21.15.118:0/230390647 conn(0x7f92cc06d110 msgr2=0x7f92cc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 -- 172.21.15.118:0/230390647 shutdown_connections 2024-09-21T06:04:45.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.945+0000 7f92d3600640 1 -- 172.21.15.118:0/230390647 wait complete. 2024-09-21T06:04:45.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.947+0000 7f92d3600640 1 Processor -- start 2024-09-21T06:04:45.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.947+0000 7f92d3600640 1 -- start start 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.948+0000 7f92d3600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc13fae0 0x7f92cc152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d3600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92cc142730 0x7f92cc13aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d3600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc0cfa70 con 0x7f92cc13fef0 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d3600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc0cf8f0 con 0x7f92cc142730 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d3600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92cc0cfbf0 con 0x7f92cc13fae0 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59592/0 (socket says 172.21.15.118:59592) 2024-09-21T06:04:45.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 -- 172.21.15.118:0/3175446830 learned_addr learned my addr 172.21.15.118:0/3175446830 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d1600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92cc142730 0x7f92cc13aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d0c00640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc13fae0 0x7f92cc152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 -- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc13fae0 msgr2=0x7f92cc152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc13fae0 0x7f92cc152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 -- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92cc142730 msgr2=0x7f92cc13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92cc142730 0x7f92cc13aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92c3e00640 1 -- 172.21.15.118:0/3175446830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc139e30 con 0x7f92cc13fef0 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.949+0000 7f92d1600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92cc142730 0x7f92cc13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:45.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.950+0000 7f92c3e00640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0b3ec0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f92b40098f0 tx=0x7f92b4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:45.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.950+0000 7f92c9600640 1 -- 172.21.15.118:0/3175446830 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4005c90 con 0x7f92cc13fef0 2024-09-21T06:04:45.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.950+0000 7f92c9600640 1 -- 172.21.15.118:0/3175446830 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92b4031e50 con 0x7f92cc13fef0 2024-09-21T06:04:45.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.950+0000 7f92c9600640 1 -- 172.21.15.118:0/3175446830 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4005260 con 0x7f92cc13fef0 2024-09-21T06:04:45.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.950+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc13a110 con 0x7f92cc13fef0 2024-09-21T06:04:45.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.950+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc13a6d0 con 0x7f92cc13fef0 2024-09-21T06:04:45.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.951+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc0d0110 con 0x7f92cc13fef0 2024-09-21T06:04:45.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.952+0000 7f92c9600640 1 -- 172.21.15.118:0/3175446830 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92b4005400 con 0x7f92cc13fef0 2024-09-21T06:04:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.953+0000 7f92c9600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92a8078b90 0x7f92a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.953+0000 7f92c9600640 1 -- 172.21.15.118:0/3175446830 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f92b40bbe30 con 0x7f92cc13fef0 2024-09-21T06:04:45.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.954+0000 7f92d0c00640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92a8078b90 0x7f92a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:45.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.954+0000 7f92d0c00640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92a8078b90 0x7f92a807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009b30 tx=0x7f92bc005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:45.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:45.958+0000 7f92c9600640 1 -- 172.21.15.118:0/3175446830 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92b403f030 con 0x7f92cc13fef0 2024-09-21T06:04:46.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.184+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f92cc15edd0 con 0x7f92cc13fef0 2024-09-21T06:04:46.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.794+0000 7f92c9600640 1 -- 172.21.15.118:0/3175446830 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f92b4083c10 con 0x7f92cc13fef0 2024-09-21T06:04:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92a8078b90 msgr2=0x7f92a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92a8078b90 0x7f92a807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009b30 tx=0x7f92bc005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 msgr2=0x7f92cc0b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0b3ec0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f92b40098f0 tx=0x7f92b4033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 shutdown_connections 2024-09-21T06:04:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92cc142730 0x7f92cc13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92cc13fef0 0x7f92cc0b3ec0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92a8078b90 0x7f92a807b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 --2- 172.21.15.118:0/3175446830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92cc13fae0 0x7f92cc152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.797+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 >> 172.21.15.118:0/3175446830 conn(0x7f92cc06d110 msgr2=0x7f92cc142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.798+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 shutdown_connections 2024-09-21T06:04:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:46.798+0000 7f92d3600640 1 -- 172.21.15.118:0/3175446830 wait complete. 2024-09-21T06:04:46.822 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:04:46.823 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:04:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.045+0000 7f6879200640 1 -- 172.21.15.118:0/3885916230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687413fef0 msgr2=0x7f6874142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.045+0000 7f6879200640 1 --2- 172.21.15.118:0/3885916230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687413fef0 0x7f6874142c70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f686c005fd0 tx=0x7f686c02a820 comp rx=0 tx=0).stop 2024-09-21T06:04:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.045+0000 7f6879200640 1 -- 172.21.15.118:0/3885916230 shutdown_connections 2024-09-21T06:04:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.045+0000 7f6879200640 1 --2- 172.21.15.118:0/3885916230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687413fef0 0x7f6874142c70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.045+0000 7f6879200640 1 --2- 172.21.15.118:0/3885916230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f68740d1590 0x7f6874142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.045+0000 7f6879200640 1 -- 172.21.15.118:0/3885916230 >> 172.21.15.118:0/3885916230 conn(0x7f687406d110 msgr2=0x7f687406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:47.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.046+0000 7f6879200640 1 -- 172.21.15.118:0/3885916230 shutdown_connections 2024-09-21T06:04:47.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.046+0000 7f6879200640 1 -- 172.21.15.118:0/3885916230 wait complete. 2024-09-21T06:04:47.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.048+0000 7f6879200640 1 Processor -- start 2024-09-21T06:04:47.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.048+0000 7f6879200640 1 -- start start 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.049+0000 7f6879200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f687413fae0 0x7f68740b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.049+0000 7f6879200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f687413fef0 0x7f6874137440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.049+0000 7f6879200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687415cd90 0x7f687413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.049+0000 7f6879200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f68740cfac0 con 0x7f687415cd90 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.049+0000 7f6879200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f68740cf940 con 0x7f687413fae0 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.049+0000 7f6879200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f68740cfc40 con 0x7f687413fef0 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687415cd90 0x7f687413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687415cd90 0x7f687413d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59618/0 (socket says 172.21.15.118:59618) 2024-09-21T06:04:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 -- 172.21.15.118:0/1509297872 learned_addr learned my addr 172.21.15.118:0/1509297872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6871400640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f687413fef0 0x7f6874137440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 -- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f687413fef0 msgr2=0x7f6874137440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6871e00640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f687413fae0 0x7f68740b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f687413fef0 0x7f6874137440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 -- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f687413fae0 msgr2=0x7f68740b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f687413fae0 0x7f68740b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 -- 172.21.15.118:0/1509297872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68740b46c0 con 0x7f687415cd90 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6871400640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f687413fef0 0x7f6874137440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6871e00640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f687413fae0 0x7f68740b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.050+0000 7f6872800640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687415cd90 0x7f687413d160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f686c035040 tx=0x7f686c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.051+0000 7f686a000640 1 -- 172.21.15.118:0/1509297872 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c037040 con 0x7f687415cd90 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.051+0000 7f686a000640 1 -- 172.21.15.118:0/1509297872 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f686c042070 con 0x7f687415cd90 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.051+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68740b49a0 con 0x7f687415cd90 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.051+0000 7f686a000640 1 -- 172.21.15.118:0/1509297872 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c003e60 con 0x7f687415cd90 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.051+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68740b4f60 con 0x7f687415cd90 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.052+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68740b5800 con 0x7f687415cd90 2024-09-21T06:04:47.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.053+0000 7f686a000640 1 -- 172.21.15.118:0/1509297872 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f686c004260 con 0x7f687415cd90 2024-09-21T06:04:47.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.054+0000 7f686a000640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6854078bc0 0x7f685407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:47.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.054+0000 7f686a000640 1 -- 172.21.15.118:0/1509297872 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f686c0bbad0 con 0x7f687415cd90 2024-09-21T06:04:47.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.054+0000 7f6871e00640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6854078bc0 0x7f685407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:47.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.055+0000 7f6871e00640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6854078bc0 0x7f685407b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6864001220 tx=0x7f6864009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:47.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.058+0000 7f686a000640 1 -- 172.21.15.118:0/1509297872 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f686c083e70 con 0x7f687415cd90 2024-09-21T06:04:47.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.281+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6874076700 con 0x7f687415cd90 2024-09-21T06:04:47.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.796+0000 7f686a000640 1 -- 172.21.15.118:0/1509297872 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f6874076700 con 0x7f687415cd90 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6854078bc0 msgr2=0x7f685407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6854078bc0 0x7f685407b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6864001220 tx=0x7f6864009040 comp rx=0 tx=0).stop 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687415cd90 msgr2=0x7f687413d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687415cd90 0x7f687413d160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f686c035040 tx=0x7f686c032c60 comp rx=0 tx=0).stop 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 shutdown_connections 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f687415cd90 0x7f687413d160 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6854078bc0 0x7f685407b0d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f687413fef0 0x7f6874137440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 --2- 172.21.15.118:0/1509297872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f687413fae0 0x7f68740b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:47.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 >> 172.21.15.118:0/1509297872 conn(0x7f687406d110 msgr2=0x7f6874139430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:47.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 shutdown_connections 2024-09-21T06:04:47.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:47.799+0000 7f6879200640 1 -- 172.21.15.118:0/1509297872 wait complete. 2024-09-21T06:04:47.825 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:04:47.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 -- 172.21.15.118:0/3917341533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 msgr2=0x7ff72c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 --2- 172.21.15.118:0/3917341533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c0d0e80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009830 tx=0x7ff71c02a510 comp rx=0 tx=0).stop 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 -- 172.21.15.118:0/3917341533 shutdown_connections 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 --2- 172.21.15.118:0/3917341533 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72c142e40 0x7ff72c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 --2- 172.21.15.118:0/3917341533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c0d0e80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 -- 172.21.15.118:0/3917341533 >> 172.21.15.118:0/3917341533 conn(0x7ff72c06d110 msgr2=0x7ff72c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 -- 172.21.15.118:0/3917341533 shutdown_connections 2024-09-21T06:04:48.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.045+0000 7ff731e00640 1 -- 172.21.15.118:0/3917341533 wait complete. 2024-09-21T06:04:48.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.047+0000 7ff731e00640 1 Processor -- start 2024-09-21T06:04:48.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.048+0000 7ff731e00640 1 -- start start 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff731e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff731e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72c13fef0 0x7ff72c0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff731e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72c142e40 0x7ff72c141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff731e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c0cfa90 con 0x7ff72c13fae0 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff731e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c0cf910 con 0x7ff72c13fef0 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff731e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff72c0cfc10 con 0x7ff72c142e40 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff72aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59640/0 (socket says 172.21.15.118:59640) 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.049+0000 7ff72aa00640 1 -- 172.21.15.118:0/1983489829 learned_addr learned my addr 172.21.15.118:0/1983489829 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff722000640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72c13fef0 0x7ff72c0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72b400640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72c142e40 0x7ff72c141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72aa00640 1 -- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72c142e40 msgr2=0x7ff72c141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72aa00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72c142e40 0x7ff72c141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72aa00640 1 -- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72c13fef0 msgr2=0x7ff72c0b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72aa00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72c13fef0 0x7ff72c0b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72aa00640 1 -- 172.21.15.118:0/1983489829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c15a4f0 con 0x7ff72c13fae0 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72b400640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72c142e40 0x7ff72c141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff722000640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72c13fef0 0x7ff72c0b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff72aa00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c153330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02ab00 tx=0x7ff71c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff723e00640 1 -- 172.21.15.118:0/1983489829 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c005c90 con 0x7ff72c13fae0 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff723e00640 1 -- 172.21.15.118:0/1983489829 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff71c031e50 con 0x7ff72c13fae0 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72c15a7d0 con 0x7ff72c13fae0 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.050+0000 7ff723e00640 1 -- 172.21.15.118:0/1983489829 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c005260 con 0x7ff72c13fae0 2024-09-21T06:04:48.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.051+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72c0b5160 con 0x7ff72c13fae0 2024-09-21T06:04:48.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.051+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72c0d0150 con 0x7ff72c13fae0 2024-09-21T06:04:48.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.053+0000 7ff723e00640 1 -- 172.21.15.118:0/1983489829 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff71c005400 con 0x7ff72c13fae0 2024-09-21T06:04:48.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.054+0000 7ff723e00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff708078b90 0x7ff70807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.054+0000 7ff723e00640 1 -- 172.21.15.118:0/1983489829 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff71c0bbeb0 con 0x7ff72c13fae0 2024-09-21T06:04:48.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.054+0000 7ff722000640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff708078b90 0x7ff70807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.055+0000 7ff722000640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff708078b90 0x7ff70807b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff72c1f9350 tx=0x7ff714009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:48.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.058+0000 7ff723e00640 1 -- 172.21.15.118:0/1983489829 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff71c03f030 con 0x7ff72c13fae0 2024-09-21T06:04:48.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.276+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff72c15a9a0 con 0x7ff72c13fae0 2024-09-21T06:04:48.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.277+0000 7ff723e00640 1 -- 172.21.15.118:0/1983489829 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7ff71c0842e0 con 0x7ff72c13fae0 2024-09-21T06:04:48.278 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:48.278 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:04:48.279 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:04:48.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff708078b90 msgr2=0x7ff70807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff708078b90 0x7ff70807b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff72c1f9350 tx=0x7ff714009040 comp rx=0 tx=0).stop 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 msgr2=0x7ff72c153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c153330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02ab00 tx=0x7ff71c033c20 comp rx=0 tx=0).stop 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 shutdown_connections 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff708078b90 0x7ff70807b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72c142e40 0x7ff72c141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72c13fef0 0x7ff72c0b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 --2- 172.21.15.118:0/1983489829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72c13fae0 0x7ff72c153330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 >> 172.21.15.118:0/1983489829 conn(0x7ff72c06d110 msgr2=0x7ff72c15faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 shutdown_connections 2024-09-21T06:04:48.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.279+0000 7ff731e00640 1 -- 172.21.15.118:0/1983489829 wait complete. 2024-09-21T06:04:48.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:48.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:04:48.503 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:04:48.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 -- 172.21.15.118:0/429988799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80aea60 msgr2=0x7feef80aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 --2- 172.21.15.118:0/429988799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80aea60 0x7feef80aee70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feef8071c00 tx=0x7feef002a8b0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 -- 172.21.15.118:0/429988799 shutdown_connections 2024-09-21T06:04:48.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 --2- 172.21.15.118:0/429988799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80aea60 0x7feef80aee70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 --2- 172.21.15.118:0/429988799 >> v2:172.21.15.149:3300/0 conn(0x7feef8073e30 0x7feef81635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 -- 172.21.15.118:0/429988799 >> 172.21.15.118:0/429988799 conn(0x7feef806d110 msgr2=0x7feef806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:48.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 -- 172.21.15.118:0/429988799 shutdown_connections 2024-09-21T06:04:48.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.520+0000 7fef00200640 1 -- 172.21.15.118:0/429988799 wait complete. 2024-09-21T06:04:48.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.522+0000 7fef00200640 1 Processor -- start 2024-09-21T06:04:48.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.522+0000 7fef00200640 1 -- start start 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7fef00200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feef8073e30 0x7feef8143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7fef00200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feef80aea60 0x7feef815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7fef00200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80d0e80 0x7feef8162f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7fef00200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feef80af530 con 0x7feef80d0e80 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7fef00200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feef80af3b0 con 0x7feef8073e30 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7fef00200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feef80af6b0 con 0x7feef80aea60 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7feefd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feef8073e30 0x7feef8143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7feefe200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80d0e80 0x7feef8162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7feefce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feef80aea60 0x7feef815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7feefd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feef8073e30 0x7feef8143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:60104/0 (socket says 172.21.15.118:60104) 2024-09-21T06:04:48.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.524+0000 7feefd800640 1 -- 172.21.15.118:0/3844553511 learned_addr learned my addr 172.21.15.118:0/3844553511 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:48.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feefe200640 1 -- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feef80aea60 msgr2=0x7feef815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feefe200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feef80aea60 0x7feef815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feefe200640 1 -- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feef8073e30 msgr2=0x7feef8143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feefe200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feef8073e30 0x7feef8143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feefe200640 1 -- 172.21.15.118:0/3844553511 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef8146900 con 0x7feef80d0e80 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feefd800640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feef8073e30 0x7feef8143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feefe200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80d0e80 0x7feef8162f00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feef0009000 tx=0x7feef00316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feef5600640 1 -- 172.21.15.118:0/3844553511 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0031da0 con 0x7feef80d0e80 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feef5600640 1 -- 172.21.15.118:0/3844553511 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feef0003a60 con 0x7feef80d0e80 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef8146be0 con 0x7feef80d0e80 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.525+0000 7feef5600640 1 -- 172.21.15.118:0/3844553511 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef00330d0 con 0x7feef80d0e80 2024-09-21T06:04:48.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.526+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef81471a0 con 0x7feef80d0e80 2024-09-21T06:04:48.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.527+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef8162cc0 con 0x7feef80d0e80 2024-09-21T06:04:48.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.528+0000 7feef5600640 1 -- 172.21.15.118:0/3844553511 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feef0033270 con 0x7feef80d0e80 2024-09-21T06:04:48.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.529+0000 7feef5600640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.529+0000 7feef5600640 1 -- 172.21.15.118:0/3844553511 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7feef00bc040 con 0x7feef80d0e80 2024-09-21T06:04:48.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.529+0000 7feefd800640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.530+0000 7feefd800640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feed8078b90 0x7feed807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feeec011440 tx=0x7feeec005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:48.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.534+0000 7feef5600640 1 -- 172.21.15.118:0/3844553511 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feef8162cc0 con 0x7feef80d0e80 2024-09-21T06:04:48.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.724+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feef80afb60 con 0x7feef80d0e80 2024-09-21T06:04:48.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.726+0000 7feef5600640 1 -- 172.21.15.118:0/3844553511 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16801 (secure 0 0 0) 0x7feef003f030 con 0x7feef80d0e80 2024-09-21T06:04:48.727 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:48.727 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:04:45.778839+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:04:42.296386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T06:04:43.228581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feed8078b90 msgr2=0x7feed807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feed8078b90 0x7feed807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feeec011440 tx=0x7feeec005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80d0e80 msgr2=0x7feef8162f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80d0e80 0x7feef8162f00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feef0009000 tx=0x7feef00316f0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 shutdown_connections 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feef80d0e80 0x7feef8162f00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feef80aea60 0x7feef815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 --2- 172.21.15.118:0/3844553511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feef8073e30 0x7feef8143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 >> 172.21.15.118:0/3844553511 conn(0x7feef806d110 msgr2=0x7feef80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 shutdown_connections 2024-09-21T06:04:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.728+0000 7fef00200640 1 -- 172.21.15.118:0/3844553511 wait complete. 2024-09-21T06:04:48.752 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:04:48.753 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:48.759 INFO:tasks.ceph.mds.d.smithi149.stderr:2024-09-21T06:04:48.757+0000 7fe578e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:04:48.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 -- 172.21.15.118:0/4147717283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 msgr2=0x7f012c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 --2- 172.21.15.118:0/4147717283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c0d0e80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f012c0ceaa0 tx=0x7f011c02a560 comp rx=0 tx=0).stop 2024-09-21T06:04:48.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 -- 172.21.15.118:0/4147717283 shutdown_connections 2024-09-21T06:04:48.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 --2- 172.21.15.118:0/4147717283 >> v2:172.21.15.149:3300/0 conn(0x7f012c142730 0x7f012c142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 --2- 172.21.15.118:0/4147717283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012c13fef0 0x7f012c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 --2- 172.21.15.118:0/4147717283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c0d0e80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 -- 172.21.15.118:0/4147717283 >> 172.21.15.118:0/4147717283 conn(0x7f012c06d110 msgr2=0x7f012c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:48.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 -- 172.21.15.118:0/4147717283 shutdown_connections 2024-09-21T06:04:48.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.970+0000 7f0132600640 1 -- 172.21.15.118:0/4147717283 wait complete. 2024-09-21T06:04:48.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.973+0000 7f0132600640 1 Processor -- start 2024-09-21T06:04:48.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.973+0000 7f0132600640 1 -- start start 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f0132600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c13b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f0132600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c13fef0 0x7f012c141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f0132600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012c142730 0x7f012c1418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f0132600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f012c06f350 con 0x7f012c13fae0 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f0132600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f012c06f1d0 con 0x7f012c13fef0 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f0132600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f012c06f4d0 con 0x7f012c142730 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f012b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f012b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c13b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59682/0 (socket says 172.21.15.118:59682) 2024-09-21T06:04:48.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.974+0000 7f012b400640 1 -- 172.21.15.118:0/1564027057 learned_addr learned my addr 172.21.15.118:0/1564027057 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f0122a00640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c13fef0 0x7f012c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012be00640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012c142730 0x7f012c1418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012b400640 1 -- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012c142730 msgr2=0x7f012c1418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012b400640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012c142730 0x7f012c1418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012b400640 1 -- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c13fef0 msgr2=0x7f012c141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012b400640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c13fef0 0x7f012c141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012b400640 1 -- 172.21.15.118:0/1564027057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c072e70 con 0x7f012c13fae0 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012be00640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012c142730 0x7f012c1418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f012b400640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c13b330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f011c034040 tx=0x7f011c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.975+0000 7f0123e00640 1 -- 172.21.15.118:0/1564027057 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c03e030 con 0x7f012c13fae0 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.976+0000 7f0123e00640 1 -- 172.21.15.118:0/1564027057 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f011c0047a0 con 0x7f012c13fae0 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.976+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012c073150 con 0x7f012c13fae0 2024-09-21T06:04:48.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.976+0000 7f0123e00640 1 -- 172.21.15.118:0/1564027057 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c035040 con 0x7f012c13fae0 2024-09-21T06:04:48.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.976+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012c073710 con 0x7f012c13fae0 2024-09-21T06:04:48.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.977+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012c06fa70 con 0x7f012c13fae0 2024-09-21T06:04:48.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.978+0000 7f0123e00640 1 -- 172.21.15.118:0/1564027057 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f011c041030 con 0x7f012c13fae0 2024-09-21T06:04:48.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.979+0000 7f0123e00640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0108078b90 0x7f010807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:48.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.979+0000 7f0123e00640 1 -- 172.21.15.118:0/1564027057 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f011c0bb510 con 0x7f012c13fae0 2024-09-21T06:04:48.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.979+0000 7f0122a00640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0108078b90 0x7f010807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:48.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.980+0000 7f0122a00640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0108078b90 0x7f010807b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f012c15f530 tx=0x7f0114009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:48.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:48.984+0000 7f0123e00640 1 -- 172.21.15.118:0/1564027057 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f011c083390 con 0x7f012c13fae0 2024-09-21T06:04:49.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.166+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f012c15f560 con 0x7f0108078b90 2024-09-21T06:04:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.172+0000 7f0123e00640 1 -- 172.21.15.118:0/1564027057 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243398 (secure 0 0 0) 0x7f012c15f560 con 0x7f0108078b90 2024-09-21T06:04:49.178 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0108078b90 msgr2=0x7f010807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0108078b90 0x7f010807b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f012c15f530 tx=0x7f0114009060 comp rx=0 tx=0).stop 2024-09-21T06:04:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 msgr2=0x7f012c13b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c13b330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f011c034040 tx=0x7f011c0039e0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 shutdown_connections 2024-09-21T06:04:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0108078b90 0x7f010807b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012c142730 0x7f012c1418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c13fef0 0x7f012c141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 --2- 172.21.15.118:0/1564027057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012c13fae0 0x7f012c13b330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 >> 172.21.15.118:0/1564027057 conn(0x7f012c06d110 msgr2=0x7f012c1609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.175+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 shutdown_connections 2024-09-21T06:04:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.176+0000 7f0132600640 1 -- 172.21.15.118:0/1564027057 wait complete. 2024-09-21T06:04:49.199 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-21T06:04:48.469524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":123,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2066,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560433,"statfs":{"total":1600000000,"available":1597883471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.707445"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773095+0000","last_change":"2024-09-21T06:04:43.773095+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773095+0000","last_undegraded":"2024-09-21T06:04:43.773095+0000","last_fullsized":"2024-09-21T06:04:43.773095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.789371+0000","last_change":"2024-09-21T06:04:44.789175+0000","last_active":"2024-09-21T06:04:44.789371+0000","last_peered":"2024-09-21T06:04:44.789371+0000","last_clean":"2024-09-21T06:04:44.789371+0000","last_became_active":"2024-09-21T06:04:44.788833+0000","last_became_peered":"2024-09-21T06:04:44.788833+0000","last_unstale":"2024-09-21T06:04:44.789371+0000","last_undegraded":"2024-09-21T06:04:44.789371+0000","last_fullsized":"2024-09-21T06:04:44.789371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:24.190174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769072+0000","last_change":"2024-09-21T06:04:43.769072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769072+0000","last_undegraded":"2024-09-21T06:04:43.769072+0000","last_fullsized":"2024-09-21T06:04:43.769072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771238+0000","last_change":"2024-09-21T06:04:43.771238+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771238+0000","last_undegraded":"2024-09-21T06:04:43.771238+0000","last_fullsized":"2024-09-21T06:04:43.771238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766892+0000","last_change":"2024-09-21T06:04:43.766892+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766892+0000","last_undegraded":"2024-09-21T06:04:43.766892+0000","last_fullsized":"2024-09-21T06:04:43.766892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795346+0000","last_change":"2024-09-21T06:04:44.794679+0000","last_active":"2024-09-21T06:04:44.795346+0000","last_peered":"2024-09-21T06:04:44.795346+0000","last_clean":"2024-09-21T06:04:44.795346+0000","last_became_active":"2024-09-21T06:04:44.794390+0000","last_became_peered":"2024-09-21T06:04:44.794390+0000","last_unstale":"2024-09-21T06:04:44.795346+0000","last_undegraded":"2024-09-21T06:04:44.795346+0000","last_fullsized":"2024-09-21T06:04:44.795346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:20.185597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.774104+0000","last_change":"2024-09-21T06:04:43.774104+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.774104+0000","last_undegraded":"2024-09-21T06:04:43.774104+0000","last_fullsized":"2024-09-21T06:04:43.774104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771332+0000","last_change":"2024-09-21T06:04:43.771332+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771332+0000","last_undegraded":"2024-09-21T06:04:43.771332+0000","last_fullsized":"2024-09-21T06:04:43.771332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769819+0000","last_change":"2024-09-21T06:04:43.769819+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769819+0000","last_undegraded":"2024-09-21T06:04:43.769819+0000","last_fullsized":"2024-09-21T06:04:43.769819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772134+0000","last_change":"2024-09-21T06:04:43.772134+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772134+0000","last_undegraded":"2024-09-21T06:04:43.772134+0000","last_fullsized":"2024-09-21T06:04:43.772134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772751+0000","last_change":"2024-09-21T06:04:43.772751+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772751+0000","last_undegraded":"2024-09-21T06:04:43.772751+0000","last_fullsized":"2024-09-21T06:04:43.772751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772669+0000","last_change":"2024-09-21T06:04:43.772669+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772669+0000","last_undegraded":"2024-09-21T06:04:43.772669+0000","last_fullsized":"2024-09-21T06:04:43.772669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767369+0000","last_change":"2024-09-21T06:04:43.767369+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767369+0000","last_undegraded":"2024-09-21T06:04:43.767369+0000","last_fullsized":"2024-09-21T06:04:43.767369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.784564+0000","last_change":"2024-09-21T06:04:44.784324+0000","last_active":"2024-09-21T06:04:44.784564+0000","last_peered":"2024-09-21T06:04:44.784564+0000","last_clean":"2024-09-21T06:04:44.784564+0000","last_became_active":"2024-09-21T06:04:44.783909+0000","last_became_peered":"2024-09-21T06:04:44.783909+0000","last_unstale":"2024-09-21T06:04:44.784564+0000","last_undegraded":"2024-09-21T06:04:44.784564+0000","last_fullsized":"2024-09-21T06:04:44.784564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:55.430222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769474+0000","last_change":"2024-09-21T06:04:43.769474+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769474+0000","last_undegraded":"2024-09-21T06:04:43.769474+0000","last_fullsized":"2024-09-21T06:04:43.769474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767072+0000","last_change":"2024-09-21T06:04:43.767072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767072+0000","last_undegraded":"2024-09-21T06:04:43.767072+0000","last_fullsized":"2024-09-21T06:04:43.767072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771331+0000","last_change":"2024-09-21T06:04:43.771331+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771331+0000","last_undegraded":"2024-09-21T06:04:43.771331+0000","last_fullsized":"2024-09-21T06:04:43.771331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795320+0000","last_change":"2024-09-21T06:04:44.794968+0000","last_active":"2024-09-21T06:04:44.795320+0000","last_peered":"2024-09-21T06:04:44.795320+0000","last_clean":"2024-09-21T06:04:44.795320+0000","last_became_active":"2024-09-21T06:04:44.793534+0000","last_became_peered":"2024-09-21T06:04:44.793534+0000","last_unstale":"2024-09-21T06:04:44.795320+0000","last_undegraded":"2024-09-21T06:04:44.795320+0000","last_fullsized":"2024-09-21T06:04:44.795320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:06.427694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802387+0000","last_change":"2024-09-21T06:04:44.801878+0000","last_active":"2024-09-21T06:04:44.802387+0000","last_peered":"2024-09-21T06:04:44.802387+0000","last_clean":"2024-09-21T06:04:44.802387+0000","last_became_active":"2024-09-21T06:04:44.801289+0000","last_became_peered":"2024-09-21T06:04:44.801289+0000","last_unstale":"2024-09-21T06:04:44.802387+0000","last_undegraded":"2024-09-21T06:04:44.802387+0000","last_fullsized":"2024-09-21T06:04:44.802387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:51.176255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766551+0000","last_change":"2024-09-21T06:04:43.766551+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766551+0000","last_undegraded":"2024-09-21T06:04:43.766551+0000","last_fullsized":"2024-09-21T06:04:43.766551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771499+0000","last_change":"2024-09-21T06:04:43.771499+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771499+0000","last_undegraded":"2024-09-21T06:04:43.771499+0000","last_fullsized":"2024-09-21T06:04:43.771499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770887+0000","last_change":"2024-09-21T06:04:43.770887+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770887+0000","last_undegraded":"2024-09-21T06:04:43.770887+0000","last_fullsized":"2024-09-21T06:04:43.770887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795269+0000","last_change":"2024-09-21T06:04:44.792814+0000","last_active":"2024-09-21T06:04:44.795269+0000","last_peered":"2024-09-21T06:04:44.795269+0000","last_clean":"2024-09-21T06:04:44.795269+0000","last_became_active":"2024-09-21T06:04:44.792399+0000","last_became_peered":"2024-09-21T06:04:44.792399+0000","last_unstale":"2024-09-21T06:04:44.795269+0000","last_undegraded":"2024-09-21T06:04:44.795269+0000","last_fullsized":"2024-09-21T06:04:44.795269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:28.999419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769738+0000","last_change":"2024-09-21T06:04:43.769738+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769738+0000","last_undegraded":"2024-09-21T06:04:43.769738+0000","last_fullsized":"2024-09-21T06:04:43.769738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772862+0000","last_change":"2024-09-21T06:04:43.772862+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772862+0000","last_undegraded":"2024-09-21T06:04:43.772862+0000","last_fullsized":"2024-09-21T06:04:43.772862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.787353+0000","last_change":"2024-09-21T06:04:44.786220+0000","last_active":"2024-09-21T06:04:44.787353+0000","last_peered":"2024-09-21T06:04:44.787353+0000","last_clean":"2024-09-21T06:04:44.787353+0000","last_became_active":"2024-09-21T06:04:44.785908+0000","last_became_peered":"2024-09-21T06:04:44.785908+0000","last_unstale":"2024-09-21T06:04:44.787353+0000","last_undegraded":"2024-09-21T06:04:44.787353+0000","last_fullsized":"2024-09-21T06:04:44.787353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:38.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.777731+0000","last_change":"2024-09-21T06:04:43.777731+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.777731+0000","last_undegraded":"2024-09-21T06:04:43.777731+0000","last_fullsized":"2024-09-21T06:04:43.777731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769850+0000","last_change":"2024-09-21T06:04:43.769850+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769850+0000","last_undegraded":"2024-09-21T06:04:43.769850+0000","last_fullsized":"2024-09-21T06:04:43.769850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768526+0000","last_change":"2024-09-21T06:04:43.768526+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768526+0000","last_undegraded":"2024-09-21T06:04:43.768526+0000","last_fullsized":"2024-09-21T06:04:43.768526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772301+0000","last_change":"2024-09-21T06:04:43.772301+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772301+0000","last_undegraded":"2024-09-21T06:04:43.772301+0000","last_fullsized":"2024-09-21T06:04:43.772301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772711+0000","last_change":"2024-09-21T06:04:43.772711+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772711+0000","last_undegraded":"2024-09-21T06:04:43.772711+0000","last_fullsized":"2024-09-21T06:04:43.772711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767090+0000","last_change":"2024-09-21T06:04:43.767090+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767090+0000","last_undegraded":"2024-09-21T06:04:43.767090+0000","last_fullsized":"2024-09-21T06:04:43.767090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.792013+0000","last_change":"2024-09-21T06:04:44.790611+0000","last_active":"2024-09-21T06:04:44.792013+0000","last_peered":"2024-09-21T06:04:44.792013+0000","last_clean":"2024-09-21T06:04:44.792013+0000","last_became_active":"2024-09-21T06:04:44.790355+0000","last_became_peered":"2024-09-21T06:04:44.790355+0000","last_unstale":"2024-09-21T06:04:44.792013+0000","last_undegraded":"2024-09-21T06:04:44.792013+0000","last_fullsized":"2024-09-21T06:04:44.792013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.157511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780064+0000","last_change":"2024-09-21T06:04:43.779849+0000","last_active":"2024-09-21T06:04:43.780064+0000","last_peered":"2024-09-21T06:04:43.780064+0000","last_clean":"2024-09-21T06:04:43.780064+0000","last_became_active":"2024-09-21T06:04:43.779516+0000","last_became_peered":"2024-09-21T06:04:43.779516+0000","last_unstale":"2024-09-21T06:04:43.780064+0000","last_undegraded":"2024-09-21T06:04:43.780064+0000","last_fullsized":"2024-09-21T06:04:43.780064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.545447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772350+0000","last_change":"2024-09-21T06:04:43.772350+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772350+0000","last_undegraded":"2024-09-21T06:04:43.772350+0000","last_fullsized":"2024-09-21T06:04:43.772350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.812497+0000","last_change":"2024-09-21T06:04:43.776190+0000","last_active":"2024-09-21T06:04:44.812497+0000","last_peered":"2024-09-21T06:04:44.812497+0000","last_clean":"2024-09-21T06:04:44.812497+0000","last_became_active":"2024-09-21T06:04:43.775927+0000","last_became_peered":"2024-09-21T06:04:43.775927+0000","last_unstale":"2024-09-21T06:04:44.812497+0000","last_undegraded":"2024-09-21T06:04:44.812497+0000","last_fullsized":"2024-09-21T06:04:44.812497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:40.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771091+0000","last_change":"2024-09-21T06:04:43.771091+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771091+0000","last_undegraded":"2024-09-21T06:04:43.771091+0000","last_fullsized":"2024-09-21T06:04:43.771091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.813830+0000","last_change":"2024-09-21T06:04:43.779823+0000","last_active":"2024-09-21T06:04:44.813830+0000","last_peered":"2024-09-21T06:04:44.813830+0000","last_clean":"2024-09-21T06:04:44.813830+0000","last_became_active":"2024-09-21T06:04:43.779575+0000","last_became_peered":"2024-09-21T06:04:43.779575+0000","last_unstale":"2024-09-21T06:04:44.813830+0000","last_undegraded":"2024-09-21T06:04:44.813830+0000","last_fullsized":"2024-09-21T06:04:44.813830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.357444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772509+0000","last_change":"2024-09-21T06:04:43.772509+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772509+0000","last_undegraded":"2024-09-21T06:04:43.772509+0000","last_fullsized":"2024-09-21T06:04:43.772509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779193+0000","last_change":"2024-09-21T06:04:43.779019+0000","last_active":"2024-09-21T06:04:43.779193+0000","last_peered":"2024-09-21T06:04:43.779193+0000","last_clean":"2024-09-21T06:04:43.779193+0000","last_became_active":"2024-09-21T06:04:43.778771+0000","last_became_peered":"2024-09-21T06:04:43.778771+0000","last_unstale":"2024-09-21T06:04:43.779193+0000","last_undegraded":"2024-09-21T06:04:43.779193+0000","last_fullsized":"2024-09-21T06:04:43.779193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:12.499910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767761+0000","last_change":"2024-09-21T06:04:43.767761+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767761+0000","last_undegraded":"2024-09-21T06:04:43.767761+0000","last_fullsized":"2024-09-21T06:04:43.767761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780894+0000","last_change":"2024-09-21T06:04:43.780697+0000","last_active":"2024-09-21T06:04:43.780894+0000","last_peered":"2024-09-21T06:04:43.780894+0000","last_clean":"2024-09-21T06:04:43.780894+0000","last_became_active":"2024-09-21T06:04:43.779269+0000","last_became_peered":"2024-09-21T06:04:43.779269+0000","last_unstale":"2024-09-21T06:04:43.780894+0000","last_undegraded":"2024-09-21T06:04:43.780894+0000","last_fullsized":"2024-09-21T06:04:43.780894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:25.269515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771776+0000","last_change":"2024-09-21T06:04:43.771776+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771776+0000","last_undegraded":"2024-09-21T06:04:43.771776+0000","last_fullsized":"2024-09-21T06:04:43.771776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778199+0000","last_change":"2024-09-21T06:04:43.777908+0000","last_active":"2024-09-21T06:04:43.778199+0000","last_peered":"2024-09-21T06:04:43.778199+0000","last_clean":"2024-09-21T06:04:43.778199+0000","last_became_active":"2024-09-21T06:04:43.777364+0000","last_became_peered":"2024-09-21T06:04:43.777364+0000","last_unstale":"2024-09-21T06:04:43.778199+0000","last_undegraded":"2024-09-21T06:04:43.778199+0000","last_fullsized":"2024-09-21T06:04:43.778199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773349+0000","last_change":"2024-09-21T06:04:43.773349+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773349+0000","last_undegraded":"2024-09-21T06:04:43.773349+0000","last_fullsized":"2024-09-21T06:04:43.773349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781040+0000","last_change":"2024-09-21T06:04:43.769051+0000","last_active":"2024-09-21T06:04:44.781040+0000","last_peered":"2024-09-21T06:04:44.781040+0000","last_clean":"2024-09-21T06:04:44.781040+0000","last_became_active":"2024-09-21T06:04:43.768049+0000","last_became_peered":"2024-09-21T06:04:43.768049+0000","last_unstale":"2024-09-21T06:04:44.781040+0000","last_undegraded":"2024-09-21T06:04:44.781040+0000","last_fullsized":"2024-09-21T06:04:44.781040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:55.024560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770860+0000","last_change":"2024-09-21T06:04:43.770860+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770860+0000","last_undegraded":"2024-09-21T06:04:43.770860+0000","last_fullsized":"2024-09-21T06:04:43.770860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782531+0000","last_change":"2024-09-21T06:04:43.782072+0000","last_active":"2024-09-21T06:04:43.782531+0000","last_peered":"2024-09-21T06:04:43.782531+0000","last_clean":"2024-09-21T06:04:43.782531+0000","last_became_active":"2024-09-21T06:04:43.780898+0000","last_became_peered":"2024-09-21T06:04:43.780898+0000","last_unstale":"2024-09-21T06:04:43.782531+0000","last_undegraded":"2024-09-21T06:04:43.782531+0000","last_fullsized":"2024-09-21T06:04:43.782531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:48.779938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768945+0000","last_change":"2024-09-21T06:04:43.768945+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768945+0000","last_undegraded":"2024-09-21T06:04:43.768945+0000","last_fullsized":"2024-09-21T06:04:43.768945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781111+0000","last_change":"2024-09-21T06:04:43.777436+0000","last_active":"2024-09-21T06:04:44.781111+0000","last_peered":"2024-09-21T06:04:44.781111+0000","last_clean":"2024-09-21T06:04:44.781111+0000","last_became_active":"2024-09-21T06:04:43.777182+0000","last_became_peered":"2024-09-21T06:04:43.777182+0000","last_unstale":"2024-09-21T06:04:44.781111+0000","last_undegraded":"2024-09-21T06:04:44.781111+0000","last_fullsized":"2024-09-21T06:04:44.781111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:35.346690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.800326+0000","last_change":"2024-09-21T06:04:44.800008+0000","last_active":"2024-09-21T06:04:44.800326+0000","last_peered":"2024-09-21T06:04:44.800326+0000","last_clean":"2024-09-21T06:04:44.800326+0000","last_became_active":"2024-09-21T06:04:44.799693+0000","last_became_peered":"2024-09-21T06:04:44.799693+0000","last_unstale":"2024-09-21T06:04:44.800326+0000","last_undegraded":"2024-09-21T06:04:44.800326+0000","last_fullsized":"2024-09-21T06:04:44.800326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:11.949961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.786965+0000","last_change":"2024-09-21T06:04:43.774015+0000","last_active":"2024-09-21T06:04:44.786965+0000","last_peered":"2024-09-21T06:04:44.786965+0000","last_clean":"2024-09-21T06:04:44.786965+0000","last_became_active":"2024-09-21T06:04:43.773736+0000","last_became_peered":"2024-09-21T06:04:43.773736+0000","last_unstale":"2024-09-21T06:04:44.786965+0000","last_undegraded":"2024-09-21T06:04:44.786965+0000","last_fullsized":"2024-09-21T06:04:44.786965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:36.605349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.785373+0000","last_change":"2024-09-21T06:04:44.785183+0000","last_active":"2024-09-21T06:04:44.785373+0000","last_peered":"2024-09-21T06:04:44.785373+0000","last_clean":"2024-09-21T06:04:44.785373+0000","last_became_active":"2024-09-21T06:04:44.784934+0000","last_became_peered":"2024-09-21T06:04:44.784934+0000","last_unstale":"2024-09-21T06:04:44.785373+0000","last_undegraded":"2024-09-21T06:04:44.785373+0000","last_fullsized":"2024-09-21T06:04:44.785373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.558542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778833+0000","last_change":"2024-09-21T06:04:43.778587+0000","last_active":"2024-09-21T06:04:43.778833+0000","last_peered":"2024-09-21T06:04:43.778833+0000","last_clean":"2024-09-21T06:04:43.778833+0000","last_became_active":"2024-09-21T06:04:43.777804+0000","last_became_peered":"2024-09-21T06:04:43.777804+0000","last_unstale":"2024-09-21T06:04:43.778833+0000","last_undegraded":"2024-09-21T06:04:43.778833+0000","last_fullsized":"2024-09-21T06:04:43.778833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:32.091866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769448+0000","last_change":"2024-09-21T06:04:43.769448+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769448+0000","last_undegraded":"2024-09-21T06:04:43.769448+0000","last_fullsized":"2024-09-21T06:04:43.769448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.816074+0000","last_change":"2024-09-21T06:04:43.776192+0000","last_active":"2024-09-21T06:04:44.816074+0000","last_peered":"2024-09-21T06:04:44.816074+0000","last_clean":"2024-09-21T06:04:44.816074+0000","last_became_active":"2024-09-21T06:04:43.773385+0000","last_became_peered":"2024-09-21T06:04:43.773385+0000","last_unstale":"2024-09-21T06:04:44.816074+0000","last_undegraded":"2024-09-21T06:04:44.816074+0000","last_fullsized":"2024-09-21T06:04:44.816074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:49.333569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.775625+0000","last_change":"2024-09-21T06:04:43.775625+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.775625+0000","last_undegraded":"2024-09-21T06:04:43.775625+0000","last_fullsized":"2024-09-21T06:04:43.775625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781992+0000","last_change":"2024-09-21T06:04:43.781815+0000","last_active":"2024-09-21T06:04:43.781992+0000","last_peered":"2024-09-21T06:04:43.781992+0000","last_clean":"2024-09-21T06:04:43.781992+0000","last_became_active":"2024-09-21T06:04:43.780375+0000","last_became_peered":"2024-09-21T06:04:43.780375+0000","last_unstale":"2024-09-21T06:04:43.781992+0000","last_undegraded":"2024-09-21T06:04:43.781992+0000","last_fullsized":"2024-09-21T06:04:43.781992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:47.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.788891+0000","last_change":"2024-09-21T06:04:44.788669+0000","last_active":"2024-09-21T06:04:44.788891+0000","last_peered":"2024-09-21T06:04:44.788891+0000","last_clean":"2024-09-21T06:04:44.788891+0000","last_became_active":"2024-09-21T06:04:44.788408+0000","last_became_peered":"2024-09-21T06:04:44.788408+0000","last_unstale":"2024-09-21T06:04:44.788891+0000","last_undegraded":"2024-09-21T06:04:44.788891+0000","last_fullsized":"2024-09-21T06:04:44.788891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:35.124002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.783994+0000","last_change":"2024-09-21T06:04:43.783661+0000","last_active":"2024-09-21T06:04:43.783994+0000","last_peered":"2024-09-21T06:04:43.783994+0000","last_clean":"2024-09-21T06:04:43.783994+0000","last_became_active":"2024-09-21T06:04:43.782413+0000","last_became_peered":"2024-09-21T06:04:43.782413+0000","last_unstale":"2024-09-21T06:04:43.783994+0000","last_undegraded":"2024-09-21T06:04:43.783994+0000","last_fullsized":"2024-09-21T06:04:43.783994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:49.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767370+0000","last_change":"2024-09-21T06:04:43.767370+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767370+0000","last_undegraded":"2024-09-21T06:04:43.767370+0000","last_fullsized":"2024-09-21T06:04:43.767370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.780683+0000","last_change":"2024-09-21T06:04:43.778127+0000","last_active":"2024-09-21T06:04:44.780683+0000","last_peered":"2024-09-21T06:04:44.780683+0000","last_clean":"2024-09-21T06:04:44.780683+0000","last_became_active":"2024-09-21T06:04:43.777711+0000","last_became_peered":"2024-09-21T06:04:43.777711+0000","last_unstale":"2024-09-21T06:04:44.780683+0000","last_undegraded":"2024-09-21T06:04:44.780683+0000","last_fullsized":"2024-09-21T06:04:44.780683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:33.608837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773920+0000","last_change":"2024-09-21T06:04:43.773920+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773920+0000","last_undegraded":"2024-09-21T06:04:43.773920+0000","last_fullsized":"2024-09-21T06:04:43.773920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.816238+0000","last_change":"2024-09-21T06:04:43.780162+0000","last_active":"2024-09-21T06:04:44.816238+0000","last_peered":"2024-09-21T06:04:44.816238+0000","last_clean":"2024-09-21T06:04:44.816238+0000","last_became_active":"2024-09-21T06:04:43.779762+0000","last_became_peered":"2024-09-21T06:04:43.779762+0000","last_unstale":"2024-09-21T06:04:44.816238+0000","last_undegraded":"2024-09-21T06:04:44.816238+0000","last_fullsized":"2024-09-21T06:04:44.816238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:18.310921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772949+0000","last_change":"2024-09-21T06:04:43.772949+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772949+0000","last_undegraded":"2024-09-21T06:04:43.772949+0000","last_fullsized":"2024-09-21T06:04:43.772949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779583+0000","last_change":"2024-09-21T06:04:43.777876+0000","last_active":"2024-09-21T06:04:43.779583+0000","last_peered":"2024-09-21T06:04:43.779583+0000","last_clean":"2024-09-21T06:04:43.779583+0000","last_became_active":"2024-09-21T06:04:43.777617+0000","last_became_peered":"2024-09-21T06:04:43.777617+0000","last_unstale":"2024-09-21T06:04:43.779583+0000","last_undegraded":"2024-09-21T06:04:43.779583+0000","last_fullsized":"2024-09-21T06:04:43.779583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:58.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769379+0000","last_change":"2024-09-21T06:04:43.769379+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769379+0000","last_undegraded":"2024-09-21T06:04:43.769379+0000","last_fullsized":"2024-09-21T06:04:43.769379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781788+0000","last_change":"2024-09-21T06:04:43.781519+0000","last_active":"2024-09-21T06:04:43.781788+0000","last_peered":"2024-09-21T06:04:43.781788+0000","last_clean":"2024-09-21T06:04:43.781788+0000","last_became_active":"2024-09-21T06:04:43.779971+0000","last_became_peered":"2024-09-21T06:04:43.779971+0000","last_unstale":"2024-09-21T06:04:43.781788+0000","last_undegraded":"2024-09-21T06:04:43.781788+0000","last_fullsized":"2024-09-21T06:04:43.781788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:58.265088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.778499+0000","last_change":"2024-09-21T06:04:43.778499+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.778499+0000","last_undegraded":"2024-09-21T06:04:43.778499+0000","last_fullsized":"2024-09-21T06:04:43.778499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779976+0000","last_change":"2024-09-21T06:04:43.778671+0000","last_active":"2024-09-21T06:04:43.779976+0000","last_peered":"2024-09-21T06:04:43.779976+0000","last_clean":"2024-09-21T06:04:43.779976+0000","last_became_active":"2024-09-21T06:04:43.778422+0000","last_became_peered":"2024-09-21T06:04:43.778422+0000","last_unstale":"2024-09-21T06:04:43.779976+0000","last_undegraded":"2024-09-21T06:04:43.779976+0000","last_fullsized":"2024-09-21T06:04:43.779976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768485+0000","last_change":"2024-09-21T06:04:43.768485+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768485+0000","last_undegraded":"2024-09-21T06:04:43.768485+0000","last_fullsized":"2024-09-21T06:04:43.768485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780512+0000","last_change":"2024-09-21T06:04:43.780289+0000","last_active":"2024-09-21T06:04:43.780512+0000","last_peered":"2024-09-21T06:04:43.780512+0000","last_clean":"2024-09-21T06:04:43.780512+0000","last_became_active":"2024-09-21T06:04:43.779004+0000","last_became_peered":"2024-09-21T06:04:43.779004+0000","last_unstale":"2024-09-21T06:04:43.780512+0000","last_undegraded":"2024-09-21T06:04:43.780512+0000","last_fullsized":"2024-09-21T06:04:43.780512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:25.229420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766384+0000","last_change":"2024-09-21T06:04:43.766384+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766384+0000","last_undegraded":"2024-09-21T06:04:43.766384+0000","last_fullsized":"2024-09-21T06:04:43.766384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.813195+0000","last_change":"2024-09-21T06:04:43.782623+0000","last_active":"2024-09-21T06:04:44.813195+0000","last_peered":"2024-09-21T06:04:44.813195+0000","last_clean":"2024-09-21T06:04:44.813195+0000","last_became_active":"2024-09-21T06:04:43.782299+0000","last_became_peered":"2024-09-21T06:04:43.782299+0000","last_unstale":"2024-09-21T06:04:44.813195+0000","last_undegraded":"2024-09-21T06:04:44.813195+0000","last_fullsized":"2024-09-21T06:04:44.813195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:37.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766985+0000","last_change":"2024-09-21T06:04:43.766985+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766985+0000","last_undegraded":"2024-09-21T06:04:43.766985+0000","last_fullsized":"2024-09-21T06:04:43.766985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782835+0000","last_change":"2024-09-21T06:04:43.782645+0000","last_active":"2024-09-21T06:04:43.782835+0000","last_peered":"2024-09-21T06:04:43.782835+0000","last_clean":"2024-09-21T06:04:43.782835+0000","last_became_active":"2024-09-21T06:04:43.782435+0000","last_became_peered":"2024-09-21T06:04:43.782435+0000","last_unstale":"2024-09-21T06:04:43.782835+0000","last_undegraded":"2024-09-21T06:04:43.782835+0000","last_fullsized":"2024-09-21T06:04:43.782835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:51.633097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767520+0000","last_change":"2024-09-21T06:04:43.767520+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767520+0000","last_undegraded":"2024-09-21T06:04:43.767520+0000","last_fullsized":"2024-09-21T06:04:43.767520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782562+0000","last_change":"2024-09-21T06:04:43.782374+0000","last_active":"2024-09-21T06:04:43.782562+0000","last_peered":"2024-09-21T06:04:43.782562+0000","last_clean":"2024-09-21T06:04:43.782562+0000","last_became_active":"2024-09-21T06:04:43.781268+0000","last_became_peered":"2024-09-21T06:04:43.781268+0000","last_unstale":"2024-09-21T06:04:43.782562+0000","last_undegraded":"2024-09-21T06:04:43.782562+0000","last_fullsized":"2024-09-21T06:04:43.782562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:38.842438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767564+0000","last_change":"2024-09-21T06:04:43.767564+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767564+0000","last_undegraded":"2024-09-21T06:04:43.767564+0000","last_fullsized":"2024-09-21T06:04:43.767564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.777803+0000","last_change":"2024-09-21T06:04:43.777589+0000","last_active":"2024-09-21T06:04:43.777803+0000","last_peered":"2024-09-21T06:04:43.777803+0000","last_clean":"2024-09-21T06:04:43.777803+0000","last_became_active":"2024-09-21T06:04:43.777295+0000","last_became_peered":"2024-09-21T06:04:43.777295+0000","last_unstale":"2024-09-21T06:04:43.777803+0000","last_undegraded":"2024-09-21T06:04:43.777803+0000","last_fullsized":"2024-09-21T06:04:43.777803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:35.621299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766648+0000","last_change":"2024-09-21T06:04:43.766648+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766648+0000","last_undegraded":"2024-09-21T06:04:43.766648+0000","last_fullsized":"2024-09-21T06:04:43.766648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.783966+0000","last_change":"2024-09-21T06:04:43.783527+0000","last_active":"2024-09-21T06:04:43.783966+0000","last_peered":"2024-09-21T06:04:43.783966+0000","last_clean":"2024-09-21T06:04:43.783966+0000","last_became_active":"2024-09-21T06:04:43.781452+0000","last_became_peered":"2024-09-21T06:04:43.781452+0000","last_unstale":"2024-09-21T06:04:43.783966+0000","last_undegraded":"2024-09-21T06:04:43.783966+0000","last_fullsized":"2024-09-21T06:04:43.783966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:52.607807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770927+0000","last_change":"2024-09-21T06:04:43.770927+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770927+0000","last_undegraded":"2024-09-21T06:04:43.770927+0000","last_fullsized":"2024-09-21T06:04:43.770927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.788466+0000","last_change":"2024-09-21T06:04:43.780451+0000","last_active":"2024-09-21T06:04:44.788466+0000","last_peered":"2024-09-21T06:04:44.788466+0000","last_clean":"2024-09-21T06:04:44.788466+0000","last_became_active":"2024-09-21T06:04:43.780047+0000","last_became_peered":"2024-09-21T06:04:43.780047+0000","last_unstale":"2024-09-21T06:04:44.788466+0000","last_undegraded":"2024-09-21T06:04:44.788466+0000","last_fullsized":"2024-09-21T06:04:44.788466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:07.506115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802820+0000","last_change":"2024-09-21T06:04:44.801293+0000","last_active":"2024-09-21T06:04:44.802820+0000","last_peered":"2024-09-21T06:04:44.802820+0000","last_clean":"2024-09-21T06:04:44.802820+0000","last_became_active":"2024-09-21T06:04:44.801081+0000","last_became_peered":"2024-09-21T06:04:44.801081+0000","last_unstale":"2024-09-21T06:04:44.802820+0000","last_undegraded":"2024-09-21T06:04:44.802820+0000","last_fullsized":"2024-09-21T06:04:44.802820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:15.671273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779619+0000","last_change":"2024-09-21T06:04:43.778730+0000","last_active":"2024-09-21T06:04:43.779619+0000","last_peered":"2024-09-21T06:04:43.779619+0000","last_clean":"2024-09-21T06:04:43.779619+0000","last_became_active":"2024-09-21T06:04:43.778445+0000","last_became_peered":"2024-09-21T06:04:43.778445+0000","last_unstale":"2024-09-21T06:04:43.779619+0000","last_undegraded":"2024-09-21T06:04:43.779619+0000","last_fullsized":"2024-09-21T06:04:43.779619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:19.002410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773327+0000","last_change":"2024-09-21T06:04:43.773327+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773327+0000","last_undegraded":"2024-09-21T06:04:43.773327+0000","last_fullsized":"2024-09-21T06:04:43.773327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.787911+0000","last_change":"2024-09-21T06:04:43.773074+0000","last_active":"2024-09-21T06:04:44.787911+0000","last_peered":"2024-09-21T06:04:44.787911+0000","last_clean":"2024-09-21T06:04:44.787911+0000","last_became_active":"2024-09-21T06:04:43.772819+0000","last_became_peered":"2024-09-21T06:04:43.772819+0000","last_unstale":"2024-09-21T06:04:44.787911+0000","last_undegraded":"2024-09-21T06:04:44.787911+0000","last_fullsized":"2024-09-21T06:04:44.787911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:05.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795024+0000","last_change":"2024-09-21T06:04:44.792436+0000","last_active":"2024-09-21T06:04:44.795024+0000","last_peered":"2024-09-21T06:04:44.795024+0000","last_clean":"2024-09-21T06:04:44.795024+0000","last_became_active":"2024-09-21T06:04:44.791792+0000","last_became_peered":"2024-09-21T06:04:44.791792+0000","last_unstale":"2024-09-21T06:04:44.795024+0000","last_undegraded":"2024-09-21T06:04:44.795024+0000","last_fullsized":"2024-09-21T06:04:44.795024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:15.538712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780786+0000","last_change":"2024-09-21T06:04:43.779951+0000","last_active":"2024-09-21T06:04:43.780786+0000","last_peered":"2024-09-21T06:04:43.780786+0000","last_clean":"2024-09-21T06:04:43.780786+0000","last_became_active":"2024-09-21T06:04:43.779700+0000","last_became_peered":"2024-09-21T06:04:43.779700+0000","last_unstale":"2024-09-21T06:04:43.780786+0000","last_undegraded":"2024-09-21T06:04:43.780786+0000","last_fullsized":"2024-09-21T06:04:43.780786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:57.508450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802360+0000","last_change":"2024-09-21T06:04:44.801561+0000","last_active":"2024-09-21T06:04:44.802360+0000","last_peered":"2024-09-21T06:04:44.802360+0000","last_clean":"2024-09-21T06:04:44.802360+0000","last_became_active":"2024-09-21T06:04:44.800906+0000","last_became_peered":"2024-09-21T06:04:44.800906+0000","last_unstale":"2024-09-21T06:04:44.802360+0000","last_undegraded":"2024-09-21T06:04:44.802360+0000","last_fullsized":"2024-09-21T06:04:44.802360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:48.608841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778175+0000","last_change":"2024-09-21T06:04:43.777628+0000","last_active":"2024-09-21T06:04:43.778175+0000","last_peered":"2024-09-21T06:04:43.778175+0000","last_clean":"2024-09-21T06:04:43.778175+0000","last_became_active":"2024-09-21T06:04:43.777054+0000","last_became_peered":"2024-09-21T06:04:43.777054+0000","last_unstale":"2024-09-21T06:04:43.778175+0000","last_undegraded":"2024-09-21T06:04:43.778175+0000","last_fullsized":"2024-09-21T06:04:43.778175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:25.101495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770892+0000","last_change":"2024-09-21T06:04:43.770892+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770892+0000","last_undegraded":"2024-09-21T06:04:43.770892+0000","last_fullsized":"2024-09-21T06:04:43.770892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781798+0000","last_change":"2024-09-21T06:04:43.778056+0000","last_active":"2024-09-21T06:04:44.781798+0000","last_peered":"2024-09-21T06:04:44.781798+0000","last_clean":"2024-09-21T06:04:44.781798+0000","last_became_active":"2024-09-21T06:04:43.777777+0000","last_became_peered":"2024-09-21T06:04:43.777777+0000","last_unstale":"2024-09-21T06:04:44.781798+0000","last_undegraded":"2024-09-21T06:04:44.781798+0000","last_fullsized":"2024-09-21T06:04:44.781798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:41.590364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767072+0000","last_change":"2024-09-21T06:04:43.767072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767072+0000","last_undegraded":"2024-09-21T06:04:43.767072+0000","last_fullsized":"2024-09-21T06:04:43.767072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781589+0000","last_change":"2024-09-21T06:04:43.781399+0000","last_active":"2024-09-21T06:04:43.781589+0000","last_peered":"2024-09-21T06:04:43.781589+0000","last_clean":"2024-09-21T06:04:43.781589+0000","last_became_active":"2024-09-21T06:04:43.781096+0000","last_became_peered":"2024-09-21T06:04:43.781096+0000","last_unstale":"2024-09-21T06:04:43.781589+0000","last_undegraded":"2024-09-21T06:04:43.781589+0000","last_fullsized":"2024-09-21T06:04:43.781589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:28.140722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":129,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.765884+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:04:43.765884+0000","last_peered":"2024-09-21T06:04:43.765884+0000","last_clean":"2024-09-21T06:04:43.765884+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:04:43.765884+0000","last_undegraded":"2024-09-21T06:04:43.765884+0000","last_fullsized":"2024-09-21T06:04:43.765884+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194617,"statfs":{"total":200000000,"available":199288741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194617,"statfs":{"total":200000000,"available":199288741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:49.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.466+0000 7f3aea600640 1 -- 172.21.15.118:0/2884552983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ac8004800 msgr2=0x7f3ac8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.466+0000 7f3aea600640 1 --2- 172.21.15.118:0/2884552983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ac8004800 0x7f3ac8004c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009b50 tx=0x7f3ac8005830 comp rx=0 tx=0).stop 2024-09-21T06:04:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.466+0000 7f3aea600640 1 -- 172.21.15.118:0/2884552983 shutdown_connections 2024-09-21T06:04:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.466+0000 7f3aea600640 1 --2- 172.21.15.118:0/2884552983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ac8004800 0x7f3ac8004c10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.466+0000 7f3aea600640 1 -- 172.21.15.118:0/2884552983 >> 172.21.15.118:0/2884552983 conn(0x7f3ae406d110 msgr2=0x7f3ae406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.466+0000 7f3aea600640 1 -- 172.21.15.118:0/2884552983 shutdown_connections 2024-09-21T06:04:49.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.466+0000 7f3aea600640 1 -- 172.21.15.118:0/2884552983 wait complete. 2024-09-21T06:04:49.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.469+0000 7f3aea600640 1 Processor -- start 2024-09-21T06:04:49.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.469+0000 7f3aea600640 1 -- start start 2024-09-21T06:04:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.470+0000 7f3aea600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8004800 0x7f3ae413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.470+0000 7f3aea600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae40cfc80 0x7f3ae413d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.470+0000 7f3aea600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ae4143190 0x7f3ae41435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.470+0000 7f3aea600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae40ccdd0 con 0x7f3ae40cfc80 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.470+0000 7f3aea600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae40ccc50 con 0x7f3ac8004800 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.470+0000 7f3aea600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae40b5040 con 0x7f3ae4143190 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae40cfc80 0x7f3ae413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8004800 0x7f3ae413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae40cfc80 0x7f3ae413d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59694/0 (socket says 172.21.15.118:59694) 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 -- 172.21.15.118:0/3810235936 learned_addr learned my addr 172.21.15.118:0/3810235936 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3ae3e00640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ae4143190 0x7f3ae41435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 -- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ae4143190 msgr2=0x7f3ae41435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ae4143190 0x7f3ae41435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 -- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8004800 msgr2=0x7f3ae413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8004800 0x7f3ae413ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 -- 172.21.15.118:0/3810235936 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae4143ae0 con 0x7f3ae40cfc80 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.471+0000 7f3adbe00640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae40cfc80 0x7f3ae413d550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009a70 tx=0x7f3acc0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.472+0000 7f3adb400640 1 -- 172.21.15.118:0/3810235936 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc038040 con 0x7f3ae40cfc80 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.472+0000 7f3adb400640 1 -- 172.21.15.118:0/3810235936 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3acc041070 con 0x7f3ae40cfc80 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.472+0000 7f3adb400640 1 -- 172.21.15.118:0/3810235936 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc03c430 con 0x7f3ae40cfc80 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.472+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae41f9ff0 con 0x7f3ae40cfc80 2024-09-21T06:04:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.472+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae413f5f0 con 0x7f3ae40cfc80 2024-09-21T06:04:49.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.473+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae40cdd60 con 0x7f3ae40cfc80 2024-09-21T06:04:49.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.474+0000 7f3adb400640 1 -- 172.21.15.118:0/3810235936 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3acc03c5d0 con 0x7f3ae40cfc80 2024-09-21T06:04:49.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.475+0000 7f3adb400640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ac0078b90 0x7f3ac007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.475+0000 7f3adb400640 1 -- 172.21.15.118:0/3810235936 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3acc0bb710 con 0x7f3ae40cfc80 2024-09-21T06:04:49.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.475+0000 7f3ae3400640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ac0078b90 0x7f3ac007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.476+0000 7f3ae3400640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ac0078b90 0x7f3ac007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ae406bd50 tx=0x7f3ad4006b70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:49.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.479+0000 7f3adb400640 1 -- 172.21.15.118:0/3810235936 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ae40cdd60 con 0x7f3ae40cfc80 2024-09-21T06:04:49.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.661+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ae415fb10 con 0x7f3ac0078b90 2024-09-21T06:04:49.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.666+0000 7f3adb400640 1 -- 172.21.15.118:0/3810235936 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243398 (secure 0 0 0) 0x7f3ae415fb10 con 0x7f3ac0078b90 2024-09-21T06:04:49.668 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:49.672 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ac0078b90 msgr2=0x7f3ac007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ac0078b90 0x7f3ac007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ae406bd50 tx=0x7f3ad4006b70 comp rx=0 tx=0).stop 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae40cfc80 msgr2=0x7f3ae413d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae40cfc80 0x7f3ae413d550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009a70 tx=0x7f3acc0336f0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 shutdown_connections 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ac0078b90 0x7f3ac007b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ae4143190 0x7f3ae41435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae40cfc80 0x7f3ae413d550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 --2- 172.21.15.118:0/3810235936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ac8004800 0x7f3ae413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 >> 172.21.15.118:0/3810235936 conn(0x7f3ae406d110 msgr2=0x7f3ae406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:49.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 shutdown_connections 2024-09-21T06:04:49.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.670+0000 7f3aea600640 1 -- 172.21.15.118:0/3810235936 wait complete. 2024-09-21T06:04:49.696 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-21T06:04:48.469524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":123,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2066,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560433,"statfs":{"total":1600000000,"available":1597883471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.707445"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773095+0000","last_change":"2024-09-21T06:04:43.773095+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773095+0000","last_undegraded":"2024-09-21T06:04:43.773095+0000","last_fullsized":"2024-09-21T06:04:43.773095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.789371+0000","last_change":"2024-09-21T06:04:44.789175+0000","last_active":"2024-09-21T06:04:44.789371+0000","last_peered":"2024-09-21T06:04:44.789371+0000","last_clean":"2024-09-21T06:04:44.789371+0000","last_became_active":"2024-09-21T06:04:44.788833+0000","last_became_peered":"2024-09-21T06:04:44.788833+0000","last_unstale":"2024-09-21T06:04:44.789371+0000","last_undegraded":"2024-09-21T06:04:44.789371+0000","last_fullsized":"2024-09-21T06:04:44.789371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:24.190174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769072+0000","last_change":"2024-09-21T06:04:43.769072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769072+0000","last_undegraded":"2024-09-21T06:04:43.769072+0000","last_fullsized":"2024-09-21T06:04:43.769072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771238+0000","last_change":"2024-09-21T06:04:43.771238+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771238+0000","last_undegraded":"2024-09-21T06:04:43.771238+0000","last_fullsized":"2024-09-21T06:04:43.771238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766892+0000","last_change":"2024-09-21T06:04:43.766892+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766892+0000","last_undegraded":"2024-09-21T06:04:43.766892+0000","last_fullsized":"2024-09-21T06:04:43.766892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795346+0000","last_change":"2024-09-21T06:04:44.794679+0000","last_active":"2024-09-21T06:04:44.795346+0000","last_peered":"2024-09-21T06:04:44.795346+0000","last_clean":"2024-09-21T06:04:44.795346+0000","last_became_active":"2024-09-21T06:04:44.794390+0000","last_became_peered":"2024-09-21T06:04:44.794390+0000","last_unstale":"2024-09-21T06:04:44.795346+0000","last_undegraded":"2024-09-21T06:04:44.795346+0000","last_fullsized":"2024-09-21T06:04:44.795346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:20.185597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.774104+0000","last_change":"2024-09-21T06:04:43.774104+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.774104+0000","last_undegraded":"2024-09-21T06:04:43.774104+0000","last_fullsized":"2024-09-21T06:04:43.774104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771332+0000","last_change":"2024-09-21T06:04:43.771332+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771332+0000","last_undegraded":"2024-09-21T06:04:43.771332+0000","last_fullsized":"2024-09-21T06:04:43.771332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769819+0000","last_change":"2024-09-21T06:04:43.769819+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769819+0000","last_undegraded":"2024-09-21T06:04:43.769819+0000","last_fullsized":"2024-09-21T06:04:43.769819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772134+0000","last_change":"2024-09-21T06:04:43.772134+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772134+0000","last_undegraded":"2024-09-21T06:04:43.772134+0000","last_fullsized":"2024-09-21T06:04:43.772134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772751+0000","last_change":"2024-09-21T06:04:43.772751+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772751+0000","last_undegraded":"2024-09-21T06:04:43.772751+0000","last_fullsized":"2024-09-21T06:04:43.772751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772669+0000","last_change":"2024-09-21T06:04:43.772669+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772669+0000","last_undegraded":"2024-09-21T06:04:43.772669+0000","last_fullsized":"2024-09-21T06:04:43.772669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767369+0000","last_change":"2024-09-21T06:04:43.767369+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767369+0000","last_undegraded":"2024-09-21T06:04:43.767369+0000","last_fullsized":"2024-09-21T06:04:43.767369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.784564+0000","last_change":"2024-09-21T06:04:44.784324+0000","last_active":"2024-09-21T06:04:44.784564+0000","last_peered":"2024-09-21T06:04:44.784564+0000","last_clean":"2024-09-21T06:04:44.784564+0000","last_became_active":"2024-09-21T06:04:44.783909+0000","last_became_peered":"2024-09-21T06:04:44.783909+0000","last_unstale":"2024-09-21T06:04:44.784564+0000","last_undegraded":"2024-09-21T06:04:44.784564+0000","last_fullsized":"2024-09-21T06:04:44.784564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:55.430222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769474+0000","last_change":"2024-09-21T06:04:43.769474+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769474+0000","last_undegraded":"2024-09-21T06:04:43.769474+0000","last_fullsized":"2024-09-21T06:04:43.769474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767072+0000","last_change":"2024-09-21T06:04:43.767072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767072+0000","last_undegraded":"2024-09-21T06:04:43.767072+0000","last_fullsized":"2024-09-21T06:04:43.767072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771331+0000","last_change":"2024-09-21T06:04:43.771331+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771331+0000","last_undegraded":"2024-09-21T06:04:43.771331+0000","last_fullsized":"2024-09-21T06:04:43.771331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795320+0000","last_change":"2024-09-21T06:04:44.794968+0000","last_active":"2024-09-21T06:04:44.795320+0000","last_peered":"2024-09-21T06:04:44.795320+0000","last_clean":"2024-09-21T06:04:44.795320+0000","last_became_active":"2024-09-21T06:04:44.793534+0000","last_became_peered":"2024-09-21T06:04:44.793534+0000","last_unstale":"2024-09-21T06:04:44.795320+0000","last_undegraded":"2024-09-21T06:04:44.795320+0000","last_fullsized":"2024-09-21T06:04:44.795320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:06.427694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802387+0000","last_change":"2024-09-21T06:04:44.801878+0000","last_active":"2024-09-21T06:04:44.802387+0000","last_peered":"2024-09-21T06:04:44.802387+0000","last_clean":"2024-09-21T06:04:44.802387+0000","last_became_active":"2024-09-21T06:04:44.801289+0000","last_became_peered":"2024-09-21T06:04:44.801289+0000","last_unstale":"2024-09-21T06:04:44.802387+0000","last_undegraded":"2024-09-21T06:04:44.802387+0000","last_fullsized":"2024-09-21T06:04:44.802387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:51.176255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766551+0000","last_change":"2024-09-21T06:04:43.766551+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766551+0000","last_undegraded":"2024-09-21T06:04:43.766551+0000","last_fullsized":"2024-09-21T06:04:43.766551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771499+0000","last_change":"2024-09-21T06:04:43.771499+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771499+0000","last_undegraded":"2024-09-21T06:04:43.771499+0000","last_fullsized":"2024-09-21T06:04:43.771499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770887+0000","last_change":"2024-09-21T06:04:43.770887+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770887+0000","last_undegraded":"2024-09-21T06:04:43.770887+0000","last_fullsized":"2024-09-21T06:04:43.770887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795269+0000","last_change":"2024-09-21T06:04:44.792814+0000","last_active":"2024-09-21T06:04:44.795269+0000","last_peered":"2024-09-21T06:04:44.795269+0000","last_clean":"2024-09-21T06:04:44.795269+0000","last_became_active":"2024-09-21T06:04:44.792399+0000","last_became_peered":"2024-09-21T06:04:44.792399+0000","last_unstale":"2024-09-21T06:04:44.795269+0000","last_undegraded":"2024-09-21T06:04:44.795269+0000","last_fullsized":"2024-09-21T06:04:44.795269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:28.999419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769738+0000","last_change":"2024-09-21T06:04:43.769738+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769738+0000","last_undegraded":"2024-09-21T06:04:43.769738+0000","last_fullsized":"2024-09-21T06:04:43.769738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772862+0000","last_change":"2024-09-21T06:04:43.772862+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772862+0000","last_undegraded":"2024-09-21T06:04:43.772862+0000","last_fullsized":"2024-09-21T06:04:43.772862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.787353+0000","last_change":"2024-09-21T06:04:44.786220+0000","last_active":"2024-09-21T06:04:44.787353+0000","last_peered":"2024-09-21T06:04:44.787353+0000","last_clean":"2024-09-21T06:04:44.787353+0000","last_became_active":"2024-09-21T06:04:44.785908+0000","last_became_peered":"2024-09-21T06:04:44.785908+0000","last_unstale":"2024-09-21T06:04:44.787353+0000","last_undegraded":"2024-09-21T06:04:44.787353+0000","last_fullsized":"2024-09-21T06:04:44.787353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:38.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.777731+0000","last_change":"2024-09-21T06:04:43.777731+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.777731+0000","last_undegraded":"2024-09-21T06:04:43.777731+0000","last_fullsized":"2024-09-21T06:04:43.777731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769850+0000","last_change":"2024-09-21T06:04:43.769850+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769850+0000","last_undegraded":"2024-09-21T06:04:43.769850+0000","last_fullsized":"2024-09-21T06:04:43.769850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768526+0000","last_change":"2024-09-21T06:04:43.768526+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768526+0000","last_undegraded":"2024-09-21T06:04:43.768526+0000","last_fullsized":"2024-09-21T06:04:43.768526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772301+0000","last_change":"2024-09-21T06:04:43.772301+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772301+0000","last_undegraded":"2024-09-21T06:04:43.772301+0000","last_fullsized":"2024-09-21T06:04:43.772301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772711+0000","last_change":"2024-09-21T06:04:43.772711+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772711+0000","last_undegraded":"2024-09-21T06:04:43.772711+0000","last_fullsized":"2024-09-21T06:04:43.772711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767090+0000","last_change":"2024-09-21T06:04:43.767090+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767090+0000","last_undegraded":"2024-09-21T06:04:43.767090+0000","last_fullsized":"2024-09-21T06:04:43.767090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.792013+0000","last_change":"2024-09-21T06:04:44.790611+0000","last_active":"2024-09-21T06:04:44.792013+0000","last_peered":"2024-09-21T06:04:44.792013+0000","last_clean":"2024-09-21T06:04:44.792013+0000","last_became_active":"2024-09-21T06:04:44.790355+0000","last_became_peered":"2024-09-21T06:04:44.790355+0000","last_unstale":"2024-09-21T06:04:44.792013+0000","last_undegraded":"2024-09-21T06:04:44.792013+0000","last_fullsized":"2024-09-21T06:04:44.792013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.157511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780064+0000","last_change":"2024-09-21T06:04:43.779849+0000","last_active":"2024-09-21T06:04:43.780064+0000","last_peered":"2024-09-21T06:04:43.780064+0000","last_clean":"2024-09-21T06:04:43.780064+0000","last_became_active":"2024-09-21T06:04:43.779516+0000","last_became_peered":"2024-09-21T06:04:43.779516+0000","last_unstale":"2024-09-21T06:04:43.780064+0000","last_undegraded":"2024-09-21T06:04:43.780064+0000","last_fullsized":"2024-09-21T06:04:43.780064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.545447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772350+0000","last_change":"2024-09-21T06:04:43.772350+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772350+0000","last_undegraded":"2024-09-21T06:04:43.772350+0000","last_fullsized":"2024-09-21T06:04:43.772350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.812497+0000","last_change":"2024-09-21T06:04:43.776190+0000","last_active":"2024-09-21T06:04:44.812497+0000","last_peered":"2024-09-21T06:04:44.812497+0000","last_clean":"2024-09-21T06:04:44.812497+0000","last_became_active":"2024-09-21T06:04:43.775927+0000","last_became_peered":"2024-09-21T06:04:43.775927+0000","last_unstale":"2024-09-21T06:04:44.812497+0000","last_undegraded":"2024-09-21T06:04:44.812497+0000","last_fullsized":"2024-09-21T06:04:44.812497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:40.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771091+0000","last_change":"2024-09-21T06:04:43.771091+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771091+0000","last_undegraded":"2024-09-21T06:04:43.771091+0000","last_fullsized":"2024-09-21T06:04:43.771091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.813830+0000","last_change":"2024-09-21T06:04:43.779823+0000","last_active":"2024-09-21T06:04:44.813830+0000","last_peered":"2024-09-21T06:04:44.813830+0000","last_clean":"2024-09-21T06:04:44.813830+0000","last_became_active":"2024-09-21T06:04:43.779575+0000","last_became_peered":"2024-09-21T06:04:43.779575+0000","last_unstale":"2024-09-21T06:04:44.813830+0000","last_undegraded":"2024-09-21T06:04:44.813830+0000","last_fullsized":"2024-09-21T06:04:44.813830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.357444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772509+0000","last_change":"2024-09-21T06:04:43.772509+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772509+0000","last_undegraded":"2024-09-21T06:04:43.772509+0000","last_fullsized":"2024-09-21T06:04:43.772509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779193+0000","last_change":"2024-09-21T06:04:43.779019+0000","last_active":"2024-09-21T06:04:43.779193+0000","last_peered":"2024-09-21T06:04:43.779193+0000","last_clean":"2024-09-21T06:04:43.779193+0000","last_became_active":"2024-09-21T06:04:43.778771+0000","last_became_peered":"2024-09-21T06:04:43.778771+0000","last_unstale":"2024-09-21T06:04:43.779193+0000","last_undegraded":"2024-09-21T06:04:43.779193+0000","last_fullsized":"2024-09-21T06:04:43.779193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:12.499910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767761+0000","last_change":"2024-09-21T06:04:43.767761+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767761+0000","last_undegraded":"2024-09-21T06:04:43.767761+0000","last_fullsized":"2024-09-21T06:04:43.767761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780894+0000","last_change":"2024-09-21T06:04:43.780697+0000","last_active":"2024-09-21T06:04:43.780894+0000","last_peered":"2024-09-21T06:04:43.780894+0000","last_clean":"2024-09-21T06:04:43.780894+0000","last_became_active":"2024-09-21T06:04:43.779269+0000","last_became_peered":"2024-09-21T06:04:43.779269+0000","last_unstale":"2024-09-21T06:04:43.780894+0000","last_undegraded":"2024-09-21T06:04:43.780894+0000","last_fullsized":"2024-09-21T06:04:43.780894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:25.269515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771776+0000","last_change":"2024-09-21T06:04:43.771776+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771776+0000","last_undegraded":"2024-09-21T06:04:43.771776+0000","last_fullsized":"2024-09-21T06:04:43.771776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778199+0000","last_change":"2024-09-21T06:04:43.777908+0000","last_active":"2024-09-21T06:04:43.778199+0000","last_peered":"2024-09-21T06:04:43.778199+0000","last_clean":"2024-09-21T06:04:43.778199+0000","last_became_active":"2024-09-21T06:04:43.777364+0000","last_became_peered":"2024-09-21T06:04:43.777364+0000","last_unstale":"2024-09-21T06:04:43.778199+0000","last_undegraded":"2024-09-21T06:04:43.778199+0000","last_fullsized":"2024-09-21T06:04:43.778199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773349+0000","last_change":"2024-09-21T06:04:43.773349+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773349+0000","last_undegraded":"2024-09-21T06:04:43.773349+0000","last_fullsized":"2024-09-21T06:04:43.773349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781040+0000","last_change":"2024-09-21T06:04:43.769051+0000","last_active":"2024-09-21T06:04:44.781040+0000","last_peered":"2024-09-21T06:04:44.781040+0000","last_clean":"2024-09-21T06:04:44.781040+0000","last_became_active":"2024-09-21T06:04:43.768049+0000","last_became_peered":"2024-09-21T06:04:43.768049+0000","last_unstale":"2024-09-21T06:04:44.781040+0000","last_undegraded":"2024-09-21T06:04:44.781040+0000","last_fullsized":"2024-09-21T06:04:44.781040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:55.024560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770860+0000","last_change":"2024-09-21T06:04:43.770860+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770860+0000","last_undegraded":"2024-09-21T06:04:43.770860+0000","last_fullsized":"2024-09-21T06:04:43.770860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782531+0000","last_change":"2024-09-21T06:04:43.782072+0000","last_active":"2024-09-21T06:04:43.782531+0000","last_peered":"2024-09-21T06:04:43.782531+0000","last_clean":"2024-09-21T06:04:43.782531+0000","last_became_active":"2024-09-21T06:04:43.780898+0000","last_became_peered":"2024-09-21T06:04:43.780898+0000","last_unstale":"2024-09-21T06:04:43.782531+0000","last_undegraded":"2024-09-21T06:04:43.782531+0000","last_fullsized":"2024-09-21T06:04:43.782531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:48.779938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768945+0000","last_change":"2024-09-21T06:04:43.768945+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768945+0000","last_undegraded":"2024-09-21T06:04:43.768945+0000","last_fullsized":"2024-09-21T06:04:43.768945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781111+0000","last_change":"2024-09-21T06:04:43.777436+0000","last_active":"2024-09-21T06:04:44.781111+0000","last_peered":"2024-09-21T06:04:44.781111+0000","last_clean":"2024-09-21T06:04:44.781111+0000","last_became_active":"2024-09-21T06:04:43.777182+0000","last_became_peered":"2024-09-21T06:04:43.777182+0000","last_unstale":"2024-09-21T06:04:44.781111+0000","last_undegraded":"2024-09-21T06:04:44.781111+0000","last_fullsized":"2024-09-21T06:04:44.781111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:35.346690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.800326+0000","last_change":"2024-09-21T06:04:44.800008+0000","last_active":"2024-09-21T06:04:44.800326+0000","last_peered":"2024-09-21T06:04:44.800326+0000","last_clean":"2024-09-21T06:04:44.800326+0000","last_became_active":"2024-09-21T06:04:44.799693+0000","last_became_peered":"2024-09-21T06:04:44.799693+0000","last_unstale":"2024-09-21T06:04:44.800326+0000","last_undegraded":"2024-09-21T06:04:44.800326+0000","last_fullsized":"2024-09-21T06:04:44.800326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:11.949961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.786965+0000","last_change":"2024-09-21T06:04:43.774015+0000","last_active":"2024-09-21T06:04:44.786965+0000","last_peered":"2024-09-21T06:04:44.786965+0000","last_clean":"2024-09-21T06:04:44.786965+0000","last_became_active":"2024-09-21T06:04:43.773736+0000","last_became_peered":"2024-09-21T06:04:43.773736+0000","last_unstale":"2024-09-21T06:04:44.786965+0000","last_undegraded":"2024-09-21T06:04:44.786965+0000","last_fullsized":"2024-09-21T06:04:44.786965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:36.605349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.785373+0000","last_change":"2024-09-21T06:04:44.785183+0000","last_active":"2024-09-21T06:04:44.785373+0000","last_peered":"2024-09-21T06:04:44.785373+0000","last_clean":"2024-09-21T06:04:44.785373+0000","last_became_active":"2024-09-21T06:04:44.784934+0000","last_became_peered":"2024-09-21T06:04:44.784934+0000","last_unstale":"2024-09-21T06:04:44.785373+0000","last_undegraded":"2024-09-21T06:04:44.785373+0000","last_fullsized":"2024-09-21T06:04:44.785373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.558542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778833+0000","last_change":"2024-09-21T06:04:43.778587+0000","last_active":"2024-09-21T06:04:43.778833+0000","last_peered":"2024-09-21T06:04:43.778833+0000","last_clean":"2024-09-21T06:04:43.778833+0000","last_became_active":"2024-09-21T06:04:43.777804+0000","last_became_peered":"2024-09-21T06:04:43.777804+0000","last_unstale":"2024-09-21T06:04:43.778833+0000","last_undegraded":"2024-09-21T06:04:43.778833+0000","last_fullsized":"2024-09-21T06:04:43.778833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:32.091866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769448+0000","last_change":"2024-09-21T06:04:43.769448+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769448+0000","last_undegraded":"2024-09-21T06:04:43.769448+0000","last_fullsized":"2024-09-21T06:04:43.769448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.816074+0000","last_change":"2024-09-21T06:04:43.776192+0000","last_active":"2024-09-21T06:04:44.816074+0000","last_peered":"2024-09-21T06:04:44.816074+0000","last_clean":"2024-09-21T06:04:44.816074+0000","last_became_active":"2024-09-21T06:04:43.773385+0000","last_became_peered":"2024-09-21T06:04:43.773385+0000","last_unstale":"2024-09-21T06:04:44.816074+0000","last_undegraded":"2024-09-21T06:04:44.816074+0000","last_fullsized":"2024-09-21T06:04:44.816074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:49.333569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.775625+0000","last_change":"2024-09-21T06:04:43.775625+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.775625+0000","last_undegraded":"2024-09-21T06:04:43.775625+0000","last_fullsized":"2024-09-21T06:04:43.775625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781992+0000","last_change":"2024-09-21T06:04:43.781815+0000","last_active":"2024-09-21T06:04:43.781992+0000","last_peered":"2024-09-21T06:04:43.781992+0000","last_clean":"2024-09-21T06:04:43.781992+0000","last_became_active":"2024-09-21T06:04:43.780375+0000","last_became_peered":"2024-09-21T06:04:43.780375+0000","last_unstale":"2024-09-21T06:04:43.781992+0000","last_undegraded":"2024-09-21T06:04:43.781992+0000","last_fullsized":"2024-09-21T06:04:43.781992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:47.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.788891+0000","last_change":"2024-09-21T06:04:44.788669+0000","last_active":"2024-09-21T06:04:44.788891+0000","last_peered":"2024-09-21T06:04:44.788891+0000","last_clean":"2024-09-21T06:04:44.788891+0000","last_became_active":"2024-09-21T06:04:44.788408+0000","last_became_peered":"2024-09-21T06:04:44.788408+0000","last_unstale":"2024-09-21T06:04:44.788891+0000","last_undegraded":"2024-09-21T06:04:44.788891+0000","last_fullsized":"2024-09-21T06:04:44.788891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:35.124002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.783994+0000","last_change":"2024-09-21T06:04:43.783661+0000","last_active":"2024-09-21T06:04:43.783994+0000","last_peered":"2024-09-21T06:04:43.783994+0000","last_clean":"2024-09-21T06:04:43.783994+0000","last_became_active":"2024-09-21T06:04:43.782413+0000","last_became_peered":"2024-09-21T06:04:43.782413+0000","last_unstale":"2024-09-21T06:04:43.783994+0000","last_undegraded":"2024-09-21T06:04:43.783994+0000","last_fullsized":"2024-09-21T06:04:43.783994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:49.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767370+0000","last_change":"2024-09-21T06:04:43.767370+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767370+0000","last_undegraded":"2024-09-21T06:04:43.767370+0000","last_fullsized":"2024-09-21T06:04:43.767370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.780683+0000","last_change":"2024-09-21T06:04:43.778127+0000","last_active":"2024-09-21T06:04:44.780683+0000","last_peered":"2024-09-21T06:04:44.780683+0000","last_clean":"2024-09-21T06:04:44.780683+0000","last_became_active":"2024-09-21T06:04:43.777711+0000","last_became_peered":"2024-09-21T06:04:43.777711+0000","last_unstale":"2024-09-21T06:04:44.780683+0000","last_undegraded":"2024-09-21T06:04:44.780683+0000","last_fullsized":"2024-09-21T06:04:44.780683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:33.608837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773920+0000","last_change":"2024-09-21T06:04:43.773920+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773920+0000","last_undegraded":"2024-09-21T06:04:43.773920+0000","last_fullsized":"2024-09-21T06:04:43.773920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.816238+0000","last_change":"2024-09-21T06:04:43.780162+0000","last_active":"2024-09-21T06:04:44.816238+0000","last_peered":"2024-09-21T06:04:44.816238+0000","last_clean":"2024-09-21T06:04:44.816238+0000","last_became_active":"2024-09-21T06:04:43.779762+0000","last_became_peered":"2024-09-21T06:04:43.779762+0000","last_unstale":"2024-09-21T06:04:44.816238+0000","last_undegraded":"2024-09-21T06:04:44.816238+0000","last_fullsized":"2024-09-21T06:04:44.816238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:18.310921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772949+0000","last_change":"2024-09-21T06:04:43.772949+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772949+0000","last_undegraded":"2024-09-21T06:04:43.772949+0000","last_fullsized":"2024-09-21T06:04:43.772949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779583+0000","last_change":"2024-09-21T06:04:43.777876+0000","last_active":"2024-09-21T06:04:43.779583+0000","last_peered":"2024-09-21T06:04:43.779583+0000","last_clean":"2024-09-21T06:04:43.779583+0000","last_became_active":"2024-09-21T06:04:43.777617+0000","last_became_peered":"2024-09-21T06:04:43.777617+0000","last_unstale":"2024-09-21T06:04:43.779583+0000","last_undegraded":"2024-09-21T06:04:43.779583+0000","last_fullsized":"2024-09-21T06:04:43.779583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:58.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769379+0000","last_change":"2024-09-21T06:04:43.769379+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769379+0000","last_undegraded":"2024-09-21T06:04:43.769379+0000","last_fullsized":"2024-09-21T06:04:43.769379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781788+0000","last_change":"2024-09-21T06:04:43.781519+0000","last_active":"2024-09-21T06:04:43.781788+0000","last_peered":"2024-09-21T06:04:43.781788+0000","last_clean":"2024-09-21T06:04:43.781788+0000","last_became_active":"2024-09-21T06:04:43.779971+0000","last_became_peered":"2024-09-21T06:04:43.779971+0000","last_unstale":"2024-09-21T06:04:43.781788+0000","last_undegraded":"2024-09-21T06:04:43.781788+0000","last_fullsized":"2024-09-21T06:04:43.781788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:58.265088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.778499+0000","last_change":"2024-09-21T06:04:43.778499+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.778499+0000","last_undegraded":"2024-09-21T06:04:43.778499+0000","last_fullsized":"2024-09-21T06:04:43.778499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779976+0000","last_change":"2024-09-21T06:04:43.778671+0000","last_active":"2024-09-21T06:04:43.779976+0000","last_peered":"2024-09-21T06:04:43.779976+0000","last_clean":"2024-09-21T06:04:43.779976+0000","last_became_active":"2024-09-21T06:04:43.778422+0000","last_became_peered":"2024-09-21T06:04:43.778422+0000","last_unstale":"2024-09-21T06:04:43.779976+0000","last_undegraded":"2024-09-21T06:04:43.779976+0000","last_fullsized":"2024-09-21T06:04:43.779976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768485+0000","last_change":"2024-09-21T06:04:43.768485+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768485+0000","last_undegraded":"2024-09-21T06:04:43.768485+0000","last_fullsized":"2024-09-21T06:04:43.768485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780512+0000","last_change":"2024-09-21T06:04:43.780289+0000","last_active":"2024-09-21T06:04:43.780512+0000","last_peered":"2024-09-21T06:04:43.780512+0000","last_clean":"2024-09-21T06:04:43.780512+0000","last_became_active":"2024-09-21T06:04:43.779004+0000","last_became_peered":"2024-09-21T06:04:43.779004+0000","last_unstale":"2024-09-21T06:04:43.780512+0000","last_undegraded":"2024-09-21T06:04:43.780512+0000","last_fullsized":"2024-09-21T06:04:43.780512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:25.229420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766384+0000","last_change":"2024-09-21T06:04:43.766384+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766384+0000","last_undegraded":"2024-09-21T06:04:43.766384+0000","last_fullsized":"2024-09-21T06:04:43.766384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.813195+0000","last_change":"2024-09-21T06:04:43.782623+0000","last_active":"2024-09-21T06:04:44.813195+0000","last_peered":"2024-09-21T06:04:44.813195+0000","last_clean":"2024-09-21T06:04:44.813195+0000","last_became_active":"2024-09-21T06:04:43.782299+0000","last_became_peered":"2024-09-21T06:04:43.782299+0000","last_unstale":"2024-09-21T06:04:44.813195+0000","last_undegraded":"2024-09-21T06:04:44.813195+0000","last_fullsized":"2024-09-21T06:04:44.813195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:37.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766985+0000","last_change":"2024-09-21T06:04:43.766985+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766985+0000","last_undegraded":"2024-09-21T06:04:43.766985+0000","last_fullsized":"2024-09-21T06:04:43.766985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782835+0000","last_change":"2024-09-21T06:04:43.782645+0000","last_active":"2024-09-21T06:04:43.782835+0000","last_peered":"2024-09-21T06:04:43.782835+0000","last_clean":"2024-09-21T06:04:43.782835+0000","last_became_active":"2024-09-21T06:04:43.782435+0000","last_became_peered":"2024-09-21T06:04:43.782435+0000","last_unstale":"2024-09-21T06:04:43.782835+0000","last_undegraded":"2024-09-21T06:04:43.782835+0000","last_fullsized":"2024-09-21T06:04:43.782835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:51.633097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767520+0000","last_change":"2024-09-21T06:04:43.767520+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767520+0000","last_undegraded":"2024-09-21T06:04:43.767520+0000","last_fullsized":"2024-09-21T06:04:43.767520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782562+0000","last_change":"2024-09-21T06:04:43.782374+0000","last_active":"2024-09-21T06:04:43.782562+0000","last_peered":"2024-09-21T06:04:43.782562+0000","last_clean":"2024-09-21T06:04:43.782562+0000","last_became_active":"2024-09-21T06:04:43.781268+0000","last_became_peered":"2024-09-21T06:04:43.781268+0000","last_unstale":"2024-09-21T06:04:43.782562+0000","last_undegraded":"2024-09-21T06:04:43.782562+0000","last_fullsized":"2024-09-21T06:04:43.782562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:38.842438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767564+0000","last_change":"2024-09-21T06:04:43.767564+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767564+0000","last_undegraded":"2024-09-21T06:04:43.767564+0000","last_fullsized":"2024-09-21T06:04:43.767564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.777803+0000","last_change":"2024-09-21T06:04:43.777589+0000","last_active":"2024-09-21T06:04:43.777803+0000","last_peered":"2024-09-21T06:04:43.777803+0000","last_clean":"2024-09-21T06:04:43.777803+0000","last_became_active":"2024-09-21T06:04:43.777295+0000","last_became_peered":"2024-09-21T06:04:43.777295+0000","last_unstale":"2024-09-21T06:04:43.777803+0000","last_undegraded":"2024-09-21T06:04:43.777803+0000","last_fullsized":"2024-09-21T06:04:43.777803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:35.621299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766648+0000","last_change":"2024-09-21T06:04:43.766648+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766648+0000","last_undegraded":"2024-09-21T06:04:43.766648+0000","last_fullsized":"2024-09-21T06:04:43.766648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.783966+0000","last_change":"2024-09-21T06:04:43.783527+0000","last_active":"2024-09-21T06:04:43.783966+0000","last_peered":"2024-09-21T06:04:43.783966+0000","last_clean":"2024-09-21T06:04:43.783966+0000","last_became_active":"2024-09-21T06:04:43.781452+0000","last_became_peered":"2024-09-21T06:04:43.781452+0000","last_unstale":"2024-09-21T06:04:43.783966+0000","last_undegraded":"2024-09-21T06:04:43.783966+0000","last_fullsized":"2024-09-21T06:04:43.783966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:52.607807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770927+0000","last_change":"2024-09-21T06:04:43.770927+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770927+0000","last_undegraded":"2024-09-21T06:04:43.770927+0000","last_fullsized":"2024-09-21T06:04:43.770927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.788466+0000","last_change":"2024-09-21T06:04:43.780451+0000","last_active":"2024-09-21T06:04:44.788466+0000","last_peered":"2024-09-21T06:04:44.788466+0000","last_clean":"2024-09-21T06:04:44.788466+0000","last_became_active":"2024-09-21T06:04:43.780047+0000","last_became_peered":"2024-09-21T06:04:43.780047+0000","last_unstale":"2024-09-21T06:04:44.788466+0000","last_undegraded":"2024-09-21T06:04:44.788466+0000","last_fullsized":"2024-09-21T06:04:44.788466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:07.506115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802820+0000","last_change":"2024-09-21T06:04:44.801293+0000","last_active":"2024-09-21T06:04:44.802820+0000","last_peered":"2024-09-21T06:04:44.802820+0000","last_clean":"2024-09-21T06:04:44.802820+0000","last_became_active":"2024-09-21T06:04:44.801081+0000","last_became_peered":"2024-09-21T06:04:44.801081+0000","last_unstale":"2024-09-21T06:04:44.802820+0000","last_undegraded":"2024-09-21T06:04:44.802820+0000","last_fullsized":"2024-09-21T06:04:44.802820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:15.671273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779619+0000","last_change":"2024-09-21T06:04:43.778730+0000","last_active":"2024-09-21T06:04:43.779619+0000","last_peered":"2024-09-21T06:04:43.779619+0000","last_clean":"2024-09-21T06:04:43.779619+0000","last_became_active":"2024-09-21T06:04:43.778445+0000","last_became_peered":"2024-09-21T06:04:43.778445+0000","last_unstale":"2024-09-21T06:04:43.779619+0000","last_undegraded":"2024-09-21T06:04:43.779619+0000","last_fullsized":"2024-09-21T06:04:43.779619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:19.002410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773327+0000","last_change":"2024-09-21T06:04:43.773327+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773327+0000","last_undegraded":"2024-09-21T06:04:43.773327+0000","last_fullsized":"2024-09-21T06:04:43.773327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.787911+0000","last_change":"2024-09-21T06:04:43.773074+0000","last_active":"2024-09-21T06:04:44.787911+0000","last_peered":"2024-09-21T06:04:44.787911+0000","last_clean":"2024-09-21T06:04:44.787911+0000","last_became_active":"2024-09-21T06:04:43.772819+0000","last_became_peered":"2024-09-21T06:04:43.772819+0000","last_unstale":"2024-09-21T06:04:44.787911+0000","last_undegraded":"2024-09-21T06:04:44.787911+0000","last_fullsized":"2024-09-21T06:04:44.787911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:05.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795024+0000","last_change":"2024-09-21T06:04:44.792436+0000","last_active":"2024-09-21T06:04:44.795024+0000","last_peered":"2024-09-21T06:04:44.795024+0000","last_clean":"2024-09-21T06:04:44.795024+0000","last_became_active":"2024-09-21T06:04:44.791792+0000","last_became_peered":"2024-09-21T06:04:44.791792+0000","last_unstale":"2024-09-21T06:04:44.795024+0000","last_undegraded":"2024-09-21T06:04:44.795024+0000","last_fullsized":"2024-09-21T06:04:44.795024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:15.538712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780786+0000","last_change":"2024-09-21T06:04:43.779951+0000","last_active":"2024-09-21T06:04:43.780786+0000","last_peered":"2024-09-21T06:04:43.780786+0000","last_clean":"2024-09-21T06:04:43.780786+0000","last_became_active":"2024-09-21T06:04:43.779700+0000","last_became_peered":"2024-09-21T06:04:43.779700+0000","last_unstale":"2024-09-21T06:04:43.780786+0000","last_undegraded":"2024-09-21T06:04:43.780786+0000","last_fullsized":"2024-09-21T06:04:43.780786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:57.508450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802360+0000","last_change":"2024-09-21T06:04:44.801561+0000","last_active":"2024-09-21T06:04:44.802360+0000","last_peered":"2024-09-21T06:04:44.802360+0000","last_clean":"2024-09-21T06:04:44.802360+0000","last_became_active":"2024-09-21T06:04:44.800906+0000","last_became_peered":"2024-09-21T06:04:44.800906+0000","last_unstale":"2024-09-21T06:04:44.802360+0000","last_undegraded":"2024-09-21T06:04:44.802360+0000","last_fullsized":"2024-09-21T06:04:44.802360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:48.608841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778175+0000","last_change":"2024-09-21T06:04:43.777628+0000","last_active":"2024-09-21T06:04:43.778175+0000","last_peered":"2024-09-21T06:04:43.778175+0000","last_clean":"2024-09-21T06:04:43.778175+0000","last_became_active":"2024-09-21T06:04:43.777054+0000","last_became_peered":"2024-09-21T06:04:43.777054+0000","last_unstale":"2024-09-21T06:04:43.778175+0000","last_undegraded":"2024-09-21T06:04:43.778175+0000","last_fullsized":"2024-09-21T06:04:43.778175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:25.101495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770892+0000","last_change":"2024-09-21T06:04:43.770892+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770892+0000","last_undegraded":"2024-09-21T06:04:43.770892+0000","last_fullsized":"2024-09-21T06:04:43.770892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781798+0000","last_change":"2024-09-21T06:04:43.778056+0000","last_active":"2024-09-21T06:04:44.781798+0000","last_peered":"2024-09-21T06:04:44.781798+0000","last_clean":"2024-09-21T06:04:44.781798+0000","last_became_active":"2024-09-21T06:04:43.777777+0000","last_became_peered":"2024-09-21T06:04:43.777777+0000","last_unstale":"2024-09-21T06:04:44.781798+0000","last_undegraded":"2024-09-21T06:04:44.781798+0000","last_fullsized":"2024-09-21T06:04:44.781798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:41.590364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767072+0000","last_change":"2024-09-21T06:04:43.767072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767072+0000","last_undegraded":"2024-09-21T06:04:43.767072+0000","last_fullsized":"2024-09-21T06:04:43.767072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781589+0000","last_change":"2024-09-21T06:04:43.781399+0000","last_active":"2024-09-21T06:04:43.781589+0000","last_peered":"2024-09-21T06:04:43.781589+0000","last_clean":"2024-09-21T06:04:43.781589+0000","last_became_active":"2024-09-21T06:04:43.781096+0000","last_became_peered":"2024-09-21T06:04:43.781096+0000","last_unstale":"2024-09-21T06:04:43.781589+0000","last_undegraded":"2024-09-21T06:04:43.781589+0000","last_fullsized":"2024-09-21T06:04:43.781589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:28.140722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":129,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.765884+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:04:43.765884+0000","last_peered":"2024-09-21T06:04:43.765884+0000","last_clean":"2024-09-21T06:04:43.765884+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:04:43.765884+0000","last_undegraded":"2024-09-21T06:04:43.765884+0000","last_fullsized":"2024-09-21T06:04:43.765884+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194617,"statfs":{"total":200000000,"available":199288741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194617,"statfs":{"total":200000000,"available":199288741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:49.700 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 -- 172.21.15.118:0/2035582815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 msgr2=0x7fe8f40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 --2- 172.21.15.118:0/2035582815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f40d0e80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40ce7c0 tx=0x7fe8e402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 -- 172.21.15.118:0/2035582815 shutdown_connections 2024-09-21T06:04:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 --2- 172.21.15.118:0/2035582815 >> v2:172.21.15.149:3300/0 conn(0x7fe8f4142e40 0x7fe8f40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 --2- 172.21.15.118:0/2035582815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f40d0e80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 -- 172.21.15.118:0/2035582815 >> 172.21.15.118:0/2035582815 conn(0x7fe8f406d110 msgr2=0x7fe8f406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 -- 172.21.15.118:0/2035582815 shutdown_connections 2024-09-21T06:04:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.957+0000 7fe8fb400640 1 -- 172.21.15.118:0/2035582815 wait complete. 2024-09-21T06:04:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.959+0000 7fe8fb400640 1 Processor -- start 2024-09-21T06:04:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.959+0000 7fe8fb400640 1 -- start start 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8fb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f4157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8fb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f413fef0 0x7fe8f413b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8fb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f4142e40 0x7fe8f415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8fb400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f40cfa90 con 0x7fe8f413fae0 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8fb400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f40cf910 con 0x7fe8f4142e40 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8fb400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f40cfc10 con 0x7fe8f413fef0 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f4157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f4157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59704/0 (socket says 172.21.15.118:59704) 2024-09-21T06:04:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f8a00640 1 -- 172.21.15.118:0/3207289305 learned_addr learned my addr 172.21.15.118:0/3207289305 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f9400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f4142e40 0x7fe8f415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8ebe00640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f413fef0 0x7fe8f413b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f8a00640 1 -- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f413fef0 msgr2=0x7fe8f413b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f8a00640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f413fef0 0x7fe8f413b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f8a00640 1 -- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f4142e40 msgr2=0x7fe8f415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.961+0000 7fe8f8a00640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f4142e40 0x7fe8f415a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8f8a00640 1 -- 172.21.15.118:0/3207289305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f413b5d0 con 0x7fe8f413fae0 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8f9400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f4142e40 0x7fe8f415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8ebe00640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f413fef0 0x7fe8f413b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8f8a00640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f4157c90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4034040 tx=0x7fe8e40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8f1600640 1 -- 172.21.15.118:0/3207289305 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e403e030 con 0x7fe8f413fae0 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8f1600640 1 -- 172.21.15.118:0/3207289305 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8e40047a0 con 0x7fe8f413fae0 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8f1600640 1 -- 172.21.15.118:0/3207289305 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4035040 con 0x7fe8f413fae0 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f4154990 con 0x7fe8f413fae0 2024-09-21T06:04:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.962+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f4154f50 con 0x7fe8f413fae0 2024-09-21T06:04:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.963+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f40d01b0 con 0x7fe8f413fae0 2024-09-21T06:04:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.965+0000 7fe8f1600640 1 -- 172.21.15.118:0/3207289305 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8e4041030 con 0x7fe8f413fae0 2024-09-21T06:04:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.965+0000 7fe8f1600640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8d0078bc0 0x7fe8d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.966+0000 7fe8f1600640 1 -- 172.21.15.118:0/3207289305 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe8e40bb620 con 0x7fe8f413fae0 2024-09-21T06:04:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.966+0000 7fe8ebe00640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8d0078bc0 0x7fe8d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.967+0000 7fe8ebe00640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8d0078bc0 0x7fe8d007b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc006fd0 tx=0x7fe8dc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:49.970+0000 7fe8f1600640 1 -- 172.21.15.118:0/3207289305 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8e4083a60 con 0x7fe8f413fae0 2024-09-21T06:04:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.150+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8f40b3cb0 con 0x7fe8d0078bc0 2024-09-21T06:04:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.155+0000 7fe8f1600640 1 -- 172.21.15.118:0/3207289305 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243398 (secure 0 0 0) 0x7fe8f40b3cb0 con 0x7fe8d0078bc0 2024-09-21T06:04:50.160 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:50.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.158+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8d0078bc0 msgr2=0x7fe8d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.158+0000 7fe8fb400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8d0078bc0 0x7fe8d007b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc006fd0 tx=0x7fe8dc008040 comp rx=0 tx=0).stop 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.158+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 msgr2=0x7fe8f4157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f4157c90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4034040 tx=0x7fe8e40039e0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 shutdown_connections 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f4142e40 0x7fe8f415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8d0078bc0 0x7fe8d007b0d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f413fef0 0x7fe8f413b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 --2- 172.21.15.118:0/3207289305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f413fae0 0x7fe8f4157c90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 >> 172.21.15.118:0/3207289305 conn(0x7fe8f406d110 msgr2=0x7fe8f40b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:50.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 shutdown_connections 2024-09-21T06:04:50.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.159+0000 7fe8fb400640 1 -- 172.21.15.118:0/3207289305 wait complete. 2024-09-21T06:04:50.183 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-21T06:04:48.469524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":123,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2066,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560433,"statfs":{"total":1600000000,"available":1597883471,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.707445"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773095+0000","last_change":"2024-09-21T06:04:43.773095+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773095+0000","last_undegraded":"2024-09-21T06:04:43.773095+0000","last_fullsized":"2024-09-21T06:04:43.773095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.789371+0000","last_change":"2024-09-21T06:04:44.789175+0000","last_active":"2024-09-21T06:04:44.789371+0000","last_peered":"2024-09-21T06:04:44.789371+0000","last_clean":"2024-09-21T06:04:44.789371+0000","last_became_active":"2024-09-21T06:04:44.788833+0000","last_became_peered":"2024-09-21T06:04:44.788833+0000","last_unstale":"2024-09-21T06:04:44.789371+0000","last_undegraded":"2024-09-21T06:04:44.789371+0000","last_fullsized":"2024-09-21T06:04:44.789371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:24.190174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769072+0000","last_change":"2024-09-21T06:04:43.769072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769072+0000","last_undegraded":"2024-09-21T06:04:43.769072+0000","last_fullsized":"2024-09-21T06:04:43.769072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771238+0000","last_change":"2024-09-21T06:04:43.771238+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771238+0000","last_undegraded":"2024-09-21T06:04:43.771238+0000","last_fullsized":"2024-09-21T06:04:43.771238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766892+0000","last_change":"2024-09-21T06:04:43.766892+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766892+0000","last_undegraded":"2024-09-21T06:04:43.766892+0000","last_fullsized":"2024-09-21T06:04:43.766892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795346+0000","last_change":"2024-09-21T06:04:44.794679+0000","last_active":"2024-09-21T06:04:44.795346+0000","last_peered":"2024-09-21T06:04:44.795346+0000","last_clean":"2024-09-21T06:04:44.795346+0000","last_became_active":"2024-09-21T06:04:44.794390+0000","last_became_peered":"2024-09-21T06:04:44.794390+0000","last_unstale":"2024-09-21T06:04:44.795346+0000","last_undegraded":"2024-09-21T06:04:44.795346+0000","last_fullsized":"2024-09-21T06:04:44.795346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:20.185597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.774104+0000","last_change":"2024-09-21T06:04:43.774104+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.774104+0000","last_undegraded":"2024-09-21T06:04:43.774104+0000","last_fullsized":"2024-09-21T06:04:43.774104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771332+0000","last_change":"2024-09-21T06:04:43.771332+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771332+0000","last_undegraded":"2024-09-21T06:04:43.771332+0000","last_fullsized":"2024-09-21T06:04:43.771332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769819+0000","last_change":"2024-09-21T06:04:43.769819+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769819+0000","last_undegraded":"2024-09-21T06:04:43.769819+0000","last_fullsized":"2024-09-21T06:04:43.769819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772134+0000","last_change":"2024-09-21T06:04:43.772134+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772134+0000","last_undegraded":"2024-09-21T06:04:43.772134+0000","last_fullsized":"2024-09-21T06:04:43.772134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772751+0000","last_change":"2024-09-21T06:04:43.772751+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772751+0000","last_undegraded":"2024-09-21T06:04:43.772751+0000","last_fullsized":"2024-09-21T06:04:43.772751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772669+0000","last_change":"2024-09-21T06:04:43.772669+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772669+0000","last_undegraded":"2024-09-21T06:04:43.772669+0000","last_fullsized":"2024-09-21T06:04:43.772669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767369+0000","last_change":"2024-09-21T06:04:43.767369+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767369+0000","last_undegraded":"2024-09-21T06:04:43.767369+0000","last_fullsized":"2024-09-21T06:04:43.767369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.784564+0000","last_change":"2024-09-21T06:04:44.784324+0000","last_active":"2024-09-21T06:04:44.784564+0000","last_peered":"2024-09-21T06:04:44.784564+0000","last_clean":"2024-09-21T06:04:44.784564+0000","last_became_active":"2024-09-21T06:04:44.783909+0000","last_became_peered":"2024-09-21T06:04:44.783909+0000","last_unstale":"2024-09-21T06:04:44.784564+0000","last_undegraded":"2024-09-21T06:04:44.784564+0000","last_fullsized":"2024-09-21T06:04:44.784564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:55.430222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769474+0000","last_change":"2024-09-21T06:04:43.769474+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769474+0000","last_undegraded":"2024-09-21T06:04:43.769474+0000","last_fullsized":"2024-09-21T06:04:43.769474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767072+0000","last_change":"2024-09-21T06:04:43.767072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767072+0000","last_undegraded":"2024-09-21T06:04:43.767072+0000","last_fullsized":"2024-09-21T06:04:43.767072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771331+0000","last_change":"2024-09-21T06:04:43.771331+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771331+0000","last_undegraded":"2024-09-21T06:04:43.771331+0000","last_fullsized":"2024-09-21T06:04:43.771331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795320+0000","last_change":"2024-09-21T06:04:44.794968+0000","last_active":"2024-09-21T06:04:44.795320+0000","last_peered":"2024-09-21T06:04:44.795320+0000","last_clean":"2024-09-21T06:04:44.795320+0000","last_became_active":"2024-09-21T06:04:44.793534+0000","last_became_peered":"2024-09-21T06:04:44.793534+0000","last_unstale":"2024-09-21T06:04:44.795320+0000","last_undegraded":"2024-09-21T06:04:44.795320+0000","last_fullsized":"2024-09-21T06:04:44.795320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:06.427694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802387+0000","last_change":"2024-09-21T06:04:44.801878+0000","last_active":"2024-09-21T06:04:44.802387+0000","last_peered":"2024-09-21T06:04:44.802387+0000","last_clean":"2024-09-21T06:04:44.802387+0000","last_became_active":"2024-09-21T06:04:44.801289+0000","last_became_peered":"2024-09-21T06:04:44.801289+0000","last_unstale":"2024-09-21T06:04:44.802387+0000","last_undegraded":"2024-09-21T06:04:44.802387+0000","last_fullsized":"2024-09-21T06:04:44.802387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:51.176255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766551+0000","last_change":"2024-09-21T06:04:43.766551+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766551+0000","last_undegraded":"2024-09-21T06:04:43.766551+0000","last_fullsized":"2024-09-21T06:04:43.766551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771499+0000","last_change":"2024-09-21T06:04:43.771499+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771499+0000","last_undegraded":"2024-09-21T06:04:43.771499+0000","last_fullsized":"2024-09-21T06:04:43.771499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770887+0000","last_change":"2024-09-21T06:04:43.770887+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770887+0000","last_undegraded":"2024-09-21T06:04:43.770887+0000","last_fullsized":"2024-09-21T06:04:43.770887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795269+0000","last_change":"2024-09-21T06:04:44.792814+0000","last_active":"2024-09-21T06:04:44.795269+0000","last_peered":"2024-09-21T06:04:44.795269+0000","last_clean":"2024-09-21T06:04:44.795269+0000","last_became_active":"2024-09-21T06:04:44.792399+0000","last_became_peered":"2024-09-21T06:04:44.792399+0000","last_unstale":"2024-09-21T06:04:44.795269+0000","last_undegraded":"2024-09-21T06:04:44.795269+0000","last_fullsized":"2024-09-21T06:04:44.795269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:28.999419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769738+0000","last_change":"2024-09-21T06:04:43.769738+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769738+0000","last_undegraded":"2024-09-21T06:04:43.769738+0000","last_fullsized":"2024-09-21T06:04:43.769738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772862+0000","last_change":"2024-09-21T06:04:43.772862+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772862+0000","last_undegraded":"2024-09-21T06:04:43.772862+0000","last_fullsized":"2024-09-21T06:04:43.772862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.787353+0000","last_change":"2024-09-21T06:04:44.786220+0000","last_active":"2024-09-21T06:04:44.787353+0000","last_peered":"2024-09-21T06:04:44.787353+0000","last_clean":"2024-09-21T06:04:44.787353+0000","last_became_active":"2024-09-21T06:04:44.785908+0000","last_became_peered":"2024-09-21T06:04:44.785908+0000","last_unstale":"2024-09-21T06:04:44.787353+0000","last_undegraded":"2024-09-21T06:04:44.787353+0000","last_fullsized":"2024-09-21T06:04:44.787353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:38.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.777731+0000","last_change":"2024-09-21T06:04:43.777731+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.777731+0000","last_undegraded":"2024-09-21T06:04:43.777731+0000","last_fullsized":"2024-09-21T06:04:43.777731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769850+0000","last_change":"2024-09-21T06:04:43.769850+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769850+0000","last_undegraded":"2024-09-21T06:04:43.769850+0000","last_fullsized":"2024-09-21T06:04:43.769850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768526+0000","last_change":"2024-09-21T06:04:43.768526+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768526+0000","last_undegraded":"2024-09-21T06:04:43.768526+0000","last_fullsized":"2024-09-21T06:04:43.768526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772301+0000","last_change":"2024-09-21T06:04:43.772301+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772301+0000","last_undegraded":"2024-09-21T06:04:43.772301+0000","last_fullsized":"2024-09-21T06:04:43.772301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772711+0000","last_change":"2024-09-21T06:04:43.772711+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772711+0000","last_undegraded":"2024-09-21T06:04:43.772711+0000","last_fullsized":"2024-09-21T06:04:43.772711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767090+0000","last_change":"2024-09-21T06:04:43.767090+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767090+0000","last_undegraded":"2024-09-21T06:04:43.767090+0000","last_fullsized":"2024-09-21T06:04:43.767090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.792013+0000","last_change":"2024-09-21T06:04:44.790611+0000","last_active":"2024-09-21T06:04:44.792013+0000","last_peered":"2024-09-21T06:04:44.792013+0000","last_clean":"2024-09-21T06:04:44.792013+0000","last_became_active":"2024-09-21T06:04:44.790355+0000","last_became_peered":"2024-09-21T06:04:44.790355+0000","last_unstale":"2024-09-21T06:04:44.792013+0000","last_undegraded":"2024-09-21T06:04:44.792013+0000","last_fullsized":"2024-09-21T06:04:44.792013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.157511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780064+0000","last_change":"2024-09-21T06:04:43.779849+0000","last_active":"2024-09-21T06:04:43.780064+0000","last_peered":"2024-09-21T06:04:43.780064+0000","last_clean":"2024-09-21T06:04:43.780064+0000","last_became_active":"2024-09-21T06:04:43.779516+0000","last_became_peered":"2024-09-21T06:04:43.779516+0000","last_unstale":"2024-09-21T06:04:43.780064+0000","last_undegraded":"2024-09-21T06:04:43.780064+0000","last_fullsized":"2024-09-21T06:04:43.780064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.545447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772350+0000","last_change":"2024-09-21T06:04:43.772350+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772350+0000","last_undegraded":"2024-09-21T06:04:43.772350+0000","last_fullsized":"2024-09-21T06:04:43.772350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.812497+0000","last_change":"2024-09-21T06:04:43.776190+0000","last_active":"2024-09-21T06:04:44.812497+0000","last_peered":"2024-09-21T06:04:44.812497+0000","last_clean":"2024-09-21T06:04:44.812497+0000","last_became_active":"2024-09-21T06:04:43.775927+0000","last_became_peered":"2024-09-21T06:04:43.775927+0000","last_unstale":"2024-09-21T06:04:44.812497+0000","last_undegraded":"2024-09-21T06:04:44.812497+0000","last_fullsized":"2024-09-21T06:04:44.812497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:40.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771091+0000","last_change":"2024-09-21T06:04:43.771091+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771091+0000","last_undegraded":"2024-09-21T06:04:43.771091+0000","last_fullsized":"2024-09-21T06:04:43.771091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.813830+0000","last_change":"2024-09-21T06:04:43.779823+0000","last_active":"2024-09-21T06:04:44.813830+0000","last_peered":"2024-09-21T06:04:44.813830+0000","last_clean":"2024-09-21T06:04:44.813830+0000","last_became_active":"2024-09-21T06:04:43.779575+0000","last_became_peered":"2024-09-21T06:04:43.779575+0000","last_unstale":"2024-09-21T06:04:44.813830+0000","last_undegraded":"2024-09-21T06:04:44.813830+0000","last_fullsized":"2024-09-21T06:04:44.813830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.357444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772509+0000","last_change":"2024-09-21T06:04:43.772509+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772509+0000","last_undegraded":"2024-09-21T06:04:43.772509+0000","last_fullsized":"2024-09-21T06:04:43.772509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779193+0000","last_change":"2024-09-21T06:04:43.779019+0000","last_active":"2024-09-21T06:04:43.779193+0000","last_peered":"2024-09-21T06:04:43.779193+0000","last_clean":"2024-09-21T06:04:43.779193+0000","last_became_active":"2024-09-21T06:04:43.778771+0000","last_became_peered":"2024-09-21T06:04:43.778771+0000","last_unstale":"2024-09-21T06:04:43.779193+0000","last_undegraded":"2024-09-21T06:04:43.779193+0000","last_fullsized":"2024-09-21T06:04:43.779193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:12.499910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767761+0000","last_change":"2024-09-21T06:04:43.767761+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767761+0000","last_undegraded":"2024-09-21T06:04:43.767761+0000","last_fullsized":"2024-09-21T06:04:43.767761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780894+0000","last_change":"2024-09-21T06:04:43.780697+0000","last_active":"2024-09-21T06:04:43.780894+0000","last_peered":"2024-09-21T06:04:43.780894+0000","last_clean":"2024-09-21T06:04:43.780894+0000","last_became_active":"2024-09-21T06:04:43.779269+0000","last_became_peered":"2024-09-21T06:04:43.779269+0000","last_unstale":"2024-09-21T06:04:43.780894+0000","last_undegraded":"2024-09-21T06:04:43.780894+0000","last_fullsized":"2024-09-21T06:04:43.780894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:25.269515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.771776+0000","last_change":"2024-09-21T06:04:43.771776+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.771776+0000","last_undegraded":"2024-09-21T06:04:43.771776+0000","last_fullsized":"2024-09-21T06:04:43.771776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778199+0000","last_change":"2024-09-21T06:04:43.777908+0000","last_active":"2024-09-21T06:04:43.778199+0000","last_peered":"2024-09-21T06:04:43.778199+0000","last_clean":"2024-09-21T06:04:43.778199+0000","last_became_active":"2024-09-21T06:04:43.777364+0000","last_became_peered":"2024-09-21T06:04:43.777364+0000","last_unstale":"2024-09-21T06:04:43.778199+0000","last_undegraded":"2024-09-21T06:04:43.778199+0000","last_fullsized":"2024-09-21T06:04:43.778199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773349+0000","last_change":"2024-09-21T06:04:43.773349+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773349+0000","last_undegraded":"2024-09-21T06:04:43.773349+0000","last_fullsized":"2024-09-21T06:04:43.773349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781040+0000","last_change":"2024-09-21T06:04:43.769051+0000","last_active":"2024-09-21T06:04:44.781040+0000","last_peered":"2024-09-21T06:04:44.781040+0000","last_clean":"2024-09-21T06:04:44.781040+0000","last_became_active":"2024-09-21T06:04:43.768049+0000","last_became_peered":"2024-09-21T06:04:43.768049+0000","last_unstale":"2024-09-21T06:04:44.781040+0000","last_undegraded":"2024-09-21T06:04:44.781040+0000","last_fullsized":"2024-09-21T06:04:44.781040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:55.024560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770860+0000","last_change":"2024-09-21T06:04:43.770860+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770860+0000","last_undegraded":"2024-09-21T06:04:43.770860+0000","last_fullsized":"2024-09-21T06:04:43.770860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782531+0000","last_change":"2024-09-21T06:04:43.782072+0000","last_active":"2024-09-21T06:04:43.782531+0000","last_peered":"2024-09-21T06:04:43.782531+0000","last_clean":"2024-09-21T06:04:43.782531+0000","last_became_active":"2024-09-21T06:04:43.780898+0000","last_became_peered":"2024-09-21T06:04:43.780898+0000","last_unstale":"2024-09-21T06:04:43.782531+0000","last_undegraded":"2024-09-21T06:04:43.782531+0000","last_fullsized":"2024-09-21T06:04:43.782531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:48.779938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768945+0000","last_change":"2024-09-21T06:04:43.768945+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768945+0000","last_undegraded":"2024-09-21T06:04:43.768945+0000","last_fullsized":"2024-09-21T06:04:43.768945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781111+0000","last_change":"2024-09-21T06:04:43.777436+0000","last_active":"2024-09-21T06:04:44.781111+0000","last_peered":"2024-09-21T06:04:44.781111+0000","last_clean":"2024-09-21T06:04:44.781111+0000","last_became_active":"2024-09-21T06:04:43.777182+0000","last_became_peered":"2024-09-21T06:04:43.777182+0000","last_unstale":"2024-09-21T06:04:44.781111+0000","last_undegraded":"2024-09-21T06:04:44.781111+0000","last_fullsized":"2024-09-21T06:04:44.781111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:35.346690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.800326+0000","last_change":"2024-09-21T06:04:44.800008+0000","last_active":"2024-09-21T06:04:44.800326+0000","last_peered":"2024-09-21T06:04:44.800326+0000","last_clean":"2024-09-21T06:04:44.800326+0000","last_became_active":"2024-09-21T06:04:44.799693+0000","last_became_peered":"2024-09-21T06:04:44.799693+0000","last_unstale":"2024-09-21T06:04:44.800326+0000","last_undegraded":"2024-09-21T06:04:44.800326+0000","last_fullsized":"2024-09-21T06:04:44.800326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:11.949961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.786965+0000","last_change":"2024-09-21T06:04:43.774015+0000","last_active":"2024-09-21T06:04:44.786965+0000","last_peered":"2024-09-21T06:04:44.786965+0000","last_clean":"2024-09-21T06:04:44.786965+0000","last_became_active":"2024-09-21T06:04:43.773736+0000","last_became_peered":"2024-09-21T06:04:43.773736+0000","last_unstale":"2024-09-21T06:04:44.786965+0000","last_undegraded":"2024-09-21T06:04:44.786965+0000","last_fullsized":"2024-09-21T06:04:44.786965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:36.605349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.785373+0000","last_change":"2024-09-21T06:04:44.785183+0000","last_active":"2024-09-21T06:04:44.785373+0000","last_peered":"2024-09-21T06:04:44.785373+0000","last_clean":"2024-09-21T06:04:44.785373+0000","last_became_active":"2024-09-21T06:04:44.784934+0000","last_became_peered":"2024-09-21T06:04:44.784934+0000","last_unstale":"2024-09-21T06:04:44.785373+0000","last_undegraded":"2024-09-21T06:04:44.785373+0000","last_fullsized":"2024-09-21T06:04:44.785373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.558542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778833+0000","last_change":"2024-09-21T06:04:43.778587+0000","last_active":"2024-09-21T06:04:43.778833+0000","last_peered":"2024-09-21T06:04:43.778833+0000","last_clean":"2024-09-21T06:04:43.778833+0000","last_became_active":"2024-09-21T06:04:43.777804+0000","last_became_peered":"2024-09-21T06:04:43.777804+0000","last_unstale":"2024-09-21T06:04:43.778833+0000","last_undegraded":"2024-09-21T06:04:43.778833+0000","last_fullsized":"2024-09-21T06:04:43.778833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:32.091866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769448+0000","last_change":"2024-09-21T06:04:43.769448+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769448+0000","last_undegraded":"2024-09-21T06:04:43.769448+0000","last_fullsized":"2024-09-21T06:04:43.769448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.816074+0000","last_change":"2024-09-21T06:04:43.776192+0000","last_active":"2024-09-21T06:04:44.816074+0000","last_peered":"2024-09-21T06:04:44.816074+0000","last_clean":"2024-09-21T06:04:44.816074+0000","last_became_active":"2024-09-21T06:04:43.773385+0000","last_became_peered":"2024-09-21T06:04:43.773385+0000","last_unstale":"2024-09-21T06:04:44.816074+0000","last_undegraded":"2024-09-21T06:04:44.816074+0000","last_fullsized":"2024-09-21T06:04:44.816074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:49.333569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.775625+0000","last_change":"2024-09-21T06:04:43.775625+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.775625+0000","last_undegraded":"2024-09-21T06:04:43.775625+0000","last_fullsized":"2024-09-21T06:04:43.775625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781992+0000","last_change":"2024-09-21T06:04:43.781815+0000","last_active":"2024-09-21T06:04:43.781992+0000","last_peered":"2024-09-21T06:04:43.781992+0000","last_clean":"2024-09-21T06:04:43.781992+0000","last_became_active":"2024-09-21T06:04:43.780375+0000","last_became_peered":"2024-09-21T06:04:43.780375+0000","last_unstale":"2024-09-21T06:04:43.781992+0000","last_undegraded":"2024-09-21T06:04:43.781992+0000","last_fullsized":"2024-09-21T06:04:43.781992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:47.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.788891+0000","last_change":"2024-09-21T06:04:44.788669+0000","last_active":"2024-09-21T06:04:44.788891+0000","last_peered":"2024-09-21T06:04:44.788891+0000","last_clean":"2024-09-21T06:04:44.788891+0000","last_became_active":"2024-09-21T06:04:44.788408+0000","last_became_peered":"2024-09-21T06:04:44.788408+0000","last_unstale":"2024-09-21T06:04:44.788891+0000","last_undegraded":"2024-09-21T06:04:44.788891+0000","last_fullsized":"2024-09-21T06:04:44.788891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:35.124002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.783994+0000","last_change":"2024-09-21T06:04:43.783661+0000","last_active":"2024-09-21T06:04:43.783994+0000","last_peered":"2024-09-21T06:04:43.783994+0000","last_clean":"2024-09-21T06:04:43.783994+0000","last_became_active":"2024-09-21T06:04:43.782413+0000","last_became_peered":"2024-09-21T06:04:43.782413+0000","last_unstale":"2024-09-21T06:04:43.783994+0000","last_undegraded":"2024-09-21T06:04:43.783994+0000","last_fullsized":"2024-09-21T06:04:43.783994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:49.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767370+0000","last_change":"2024-09-21T06:04:43.767370+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767370+0000","last_undegraded":"2024-09-21T06:04:43.767370+0000","last_fullsized":"2024-09-21T06:04:43.767370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.780683+0000","last_change":"2024-09-21T06:04:43.778127+0000","last_active":"2024-09-21T06:04:44.780683+0000","last_peered":"2024-09-21T06:04:44.780683+0000","last_clean":"2024-09-21T06:04:44.780683+0000","last_became_active":"2024-09-21T06:04:43.777711+0000","last_became_peered":"2024-09-21T06:04:43.777711+0000","last_unstale":"2024-09-21T06:04:44.780683+0000","last_undegraded":"2024-09-21T06:04:44.780683+0000","last_fullsized":"2024-09-21T06:04:44.780683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:33.608837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773920+0000","last_change":"2024-09-21T06:04:43.773920+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773920+0000","last_undegraded":"2024-09-21T06:04:43.773920+0000","last_fullsized":"2024-09-21T06:04:43.773920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.816238+0000","last_change":"2024-09-21T06:04:43.780162+0000","last_active":"2024-09-21T06:04:44.816238+0000","last_peered":"2024-09-21T06:04:44.816238+0000","last_clean":"2024-09-21T06:04:44.816238+0000","last_became_active":"2024-09-21T06:04:43.779762+0000","last_became_peered":"2024-09-21T06:04:43.779762+0000","last_unstale":"2024-09-21T06:04:44.816238+0000","last_undegraded":"2024-09-21T06:04:44.816238+0000","last_fullsized":"2024-09-21T06:04:44.816238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:18.310921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.772949+0000","last_change":"2024-09-21T06:04:43.772949+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.772949+0000","last_undegraded":"2024-09-21T06:04:43.772949+0000","last_fullsized":"2024-09-21T06:04:43.772949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779583+0000","last_change":"2024-09-21T06:04:43.777876+0000","last_active":"2024-09-21T06:04:43.779583+0000","last_peered":"2024-09-21T06:04:43.779583+0000","last_clean":"2024-09-21T06:04:43.779583+0000","last_became_active":"2024-09-21T06:04:43.777617+0000","last_became_peered":"2024-09-21T06:04:43.777617+0000","last_unstale":"2024-09-21T06:04:43.779583+0000","last_undegraded":"2024-09-21T06:04:43.779583+0000","last_fullsized":"2024-09-21T06:04:43.779583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:58.540427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.769379+0000","last_change":"2024-09-21T06:04:43.769379+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.769379+0000","last_undegraded":"2024-09-21T06:04:43.769379+0000","last_fullsized":"2024-09-21T06:04:43.769379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781788+0000","last_change":"2024-09-21T06:04:43.781519+0000","last_active":"2024-09-21T06:04:43.781788+0000","last_peered":"2024-09-21T06:04:43.781788+0000","last_clean":"2024-09-21T06:04:43.781788+0000","last_became_active":"2024-09-21T06:04:43.779971+0000","last_became_peered":"2024-09-21T06:04:43.779971+0000","last_unstale":"2024-09-21T06:04:43.781788+0000","last_undegraded":"2024-09-21T06:04:43.781788+0000","last_fullsized":"2024-09-21T06:04:43.781788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:58.265088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.778499+0000","last_change":"2024-09-21T06:04:43.778499+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.778499+0000","last_undegraded":"2024-09-21T06:04:43.778499+0000","last_fullsized":"2024-09-21T06:04:43.778499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779976+0000","last_change":"2024-09-21T06:04:43.778671+0000","last_active":"2024-09-21T06:04:43.779976+0000","last_peered":"2024-09-21T06:04:43.779976+0000","last_clean":"2024-09-21T06:04:43.779976+0000","last_became_active":"2024-09-21T06:04:43.778422+0000","last_became_peered":"2024-09-21T06:04:43.778422+0000","last_unstale":"2024-09-21T06:04:43.779976+0000","last_undegraded":"2024-09-21T06:04:43.779976+0000","last_fullsized":"2024-09-21T06:04:43.779976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.313510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.768485+0000","last_change":"2024-09-21T06:04:43.768485+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.768485+0000","last_undegraded":"2024-09-21T06:04:43.768485+0000","last_fullsized":"2024-09-21T06:04:43.768485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780512+0000","last_change":"2024-09-21T06:04:43.780289+0000","last_active":"2024-09-21T06:04:43.780512+0000","last_peered":"2024-09-21T06:04:43.780512+0000","last_clean":"2024-09-21T06:04:43.780512+0000","last_became_active":"2024-09-21T06:04:43.779004+0000","last_became_peered":"2024-09-21T06:04:43.779004+0000","last_unstale":"2024-09-21T06:04:43.780512+0000","last_undegraded":"2024-09-21T06:04:43.780512+0000","last_fullsized":"2024-09-21T06:04:43.780512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:25.229420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766384+0000","last_change":"2024-09-21T06:04:43.766384+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766384+0000","last_undegraded":"2024-09-21T06:04:43.766384+0000","last_fullsized":"2024-09-21T06:04:43.766384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.813195+0000","last_change":"2024-09-21T06:04:43.782623+0000","last_active":"2024-09-21T06:04:44.813195+0000","last_peered":"2024-09-21T06:04:44.813195+0000","last_clean":"2024-09-21T06:04:44.813195+0000","last_became_active":"2024-09-21T06:04:43.782299+0000","last_became_peered":"2024-09-21T06:04:43.782299+0000","last_unstale":"2024-09-21T06:04:44.813195+0000","last_undegraded":"2024-09-21T06:04:44.813195+0000","last_fullsized":"2024-09-21T06:04:44.813195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:37.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766985+0000","last_change":"2024-09-21T06:04:43.766985+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766985+0000","last_undegraded":"2024-09-21T06:04:43.766985+0000","last_fullsized":"2024-09-21T06:04:43.766985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782835+0000","last_change":"2024-09-21T06:04:43.782645+0000","last_active":"2024-09-21T06:04:43.782835+0000","last_peered":"2024-09-21T06:04:43.782835+0000","last_clean":"2024-09-21T06:04:43.782835+0000","last_became_active":"2024-09-21T06:04:43.782435+0000","last_became_peered":"2024-09-21T06:04:43.782435+0000","last_unstale":"2024-09-21T06:04:43.782835+0000","last_undegraded":"2024-09-21T06:04:43.782835+0000","last_fullsized":"2024-09-21T06:04:43.782835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:51.633097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767520+0000","last_change":"2024-09-21T06:04:43.767520+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767520+0000","last_undegraded":"2024-09-21T06:04:43.767520+0000","last_fullsized":"2024-09-21T06:04:43.767520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.782562+0000","last_change":"2024-09-21T06:04:43.782374+0000","last_active":"2024-09-21T06:04:43.782562+0000","last_peered":"2024-09-21T06:04:43.782562+0000","last_clean":"2024-09-21T06:04:43.782562+0000","last_became_active":"2024-09-21T06:04:43.781268+0000","last_became_peered":"2024-09-21T06:04:43.781268+0000","last_unstale":"2024-09-21T06:04:43.782562+0000","last_undegraded":"2024-09-21T06:04:43.782562+0000","last_fullsized":"2024-09-21T06:04:43.782562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:38.842438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767564+0000","last_change":"2024-09-21T06:04:43.767564+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767564+0000","last_undegraded":"2024-09-21T06:04:43.767564+0000","last_fullsized":"2024-09-21T06:04:43.767564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.777803+0000","last_change":"2024-09-21T06:04:43.777589+0000","last_active":"2024-09-21T06:04:43.777803+0000","last_peered":"2024-09-21T06:04:43.777803+0000","last_clean":"2024-09-21T06:04:43.777803+0000","last_became_active":"2024-09-21T06:04:43.777295+0000","last_became_peered":"2024-09-21T06:04:43.777295+0000","last_unstale":"2024-09-21T06:04:43.777803+0000","last_undegraded":"2024-09-21T06:04:43.777803+0000","last_fullsized":"2024-09-21T06:04:43.777803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:35.621299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.766648+0000","last_change":"2024-09-21T06:04:43.766648+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.766648+0000","last_undegraded":"2024-09-21T06:04:43.766648+0000","last_fullsized":"2024-09-21T06:04:43.766648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.783966+0000","last_change":"2024-09-21T06:04:43.783527+0000","last_active":"2024-09-21T06:04:43.783966+0000","last_peered":"2024-09-21T06:04:43.783966+0000","last_clean":"2024-09-21T06:04:43.783966+0000","last_became_active":"2024-09-21T06:04:43.781452+0000","last_became_peered":"2024-09-21T06:04:43.781452+0000","last_unstale":"2024-09-21T06:04:43.783966+0000","last_undegraded":"2024-09-21T06:04:43.783966+0000","last_fullsized":"2024-09-21T06:04:43.783966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:52.607807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770927+0000","last_change":"2024-09-21T06:04:43.770927+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770927+0000","last_undegraded":"2024-09-21T06:04:43.770927+0000","last_fullsized":"2024-09-21T06:04:43.770927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.788466+0000","last_change":"2024-09-21T06:04:43.780451+0000","last_active":"2024-09-21T06:04:44.788466+0000","last_peered":"2024-09-21T06:04:44.788466+0000","last_clean":"2024-09-21T06:04:44.788466+0000","last_became_active":"2024-09-21T06:04:43.780047+0000","last_became_peered":"2024-09-21T06:04:43.780047+0000","last_unstale":"2024-09-21T06:04:44.788466+0000","last_undegraded":"2024-09-21T06:04:44.788466+0000","last_fullsized":"2024-09-21T06:04:44.788466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:07.506115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802820+0000","last_change":"2024-09-21T06:04:44.801293+0000","last_active":"2024-09-21T06:04:44.802820+0000","last_peered":"2024-09-21T06:04:44.802820+0000","last_clean":"2024-09-21T06:04:44.802820+0000","last_became_active":"2024-09-21T06:04:44.801081+0000","last_became_peered":"2024-09-21T06:04:44.801081+0000","last_unstale":"2024-09-21T06:04:44.802820+0000","last_undegraded":"2024-09-21T06:04:44.802820+0000","last_fullsized":"2024-09-21T06:04:44.802820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:15.671273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.779619+0000","last_change":"2024-09-21T06:04:43.778730+0000","last_active":"2024-09-21T06:04:43.779619+0000","last_peered":"2024-09-21T06:04:43.779619+0000","last_clean":"2024-09-21T06:04:43.779619+0000","last_became_active":"2024-09-21T06:04:43.778445+0000","last_became_peered":"2024-09-21T06:04:43.778445+0000","last_unstale":"2024-09-21T06:04:43.779619+0000","last_undegraded":"2024-09-21T06:04:43.779619+0000","last_fullsized":"2024-09-21T06:04:43.779619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:19.002410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.773327+0000","last_change":"2024-09-21T06:04:43.773327+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.773327+0000","last_undegraded":"2024-09-21T06:04:43.773327+0000","last_fullsized":"2024-09-21T06:04:43.773327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.787911+0000","last_change":"2024-09-21T06:04:43.773074+0000","last_active":"2024-09-21T06:04:44.787911+0000","last_peered":"2024-09-21T06:04:44.787911+0000","last_clean":"2024-09-21T06:04:44.787911+0000","last_became_active":"2024-09-21T06:04:43.772819+0000","last_became_peered":"2024-09-21T06:04:43.772819+0000","last_unstale":"2024-09-21T06:04:44.787911+0000","last_undegraded":"2024-09-21T06:04:44.787911+0000","last_fullsized":"2024-09-21T06:04:44.787911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:05.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.795024+0000","last_change":"2024-09-21T06:04:44.792436+0000","last_active":"2024-09-21T06:04:44.795024+0000","last_peered":"2024-09-21T06:04:44.795024+0000","last_clean":"2024-09-21T06:04:44.795024+0000","last_became_active":"2024-09-21T06:04:44.791792+0000","last_became_peered":"2024-09-21T06:04:44.791792+0000","last_unstale":"2024-09-21T06:04:44.795024+0000","last_undegraded":"2024-09-21T06:04:44.795024+0000","last_fullsized":"2024-09-21T06:04:44.795024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:15.538712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.780786+0000","last_change":"2024-09-21T06:04:43.779951+0000","last_active":"2024-09-21T06:04:43.780786+0000","last_peered":"2024-09-21T06:04:43.780786+0000","last_clean":"2024-09-21T06:04:43.780786+0000","last_became_active":"2024-09-21T06:04:43.779700+0000","last_became_peered":"2024-09-21T06:04:43.779700+0000","last_unstale":"2024-09-21T06:04:43.780786+0000","last_undegraded":"2024-09-21T06:04:43.780786+0000","last_fullsized":"2024-09-21T06:04:43.780786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:57.508450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.802360+0000","last_change":"2024-09-21T06:04:44.801561+0000","last_active":"2024-09-21T06:04:44.802360+0000","last_peered":"2024-09-21T06:04:44.802360+0000","last_clean":"2024-09-21T06:04:44.802360+0000","last_became_active":"2024-09-21T06:04:44.800906+0000","last_became_peered":"2024-09-21T06:04:44.800906+0000","last_unstale":"2024-09-21T06:04:44.802360+0000","last_undegraded":"2024-09-21T06:04:44.802360+0000","last_fullsized":"2024-09-21T06:04:44.802360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:48.608841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.778175+0000","last_change":"2024-09-21T06:04:43.777628+0000","last_active":"2024-09-21T06:04:43.778175+0000","last_peered":"2024-09-21T06:04:43.778175+0000","last_clean":"2024-09-21T06:04:43.778175+0000","last_became_active":"2024-09-21T06:04:43.777054+0000","last_became_peered":"2024-09-21T06:04:43.777054+0000","last_unstale":"2024-09-21T06:04:43.778175+0000","last_undegraded":"2024-09-21T06:04:43.778175+0000","last_fullsized":"2024-09-21T06:04:43.778175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:25.101495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.770892+0000","last_change":"2024-09-21T06:04:43.770892+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.770892+0000","last_undegraded":"2024-09-21T06:04:43.770892+0000","last_fullsized":"2024-09-21T06:04:43.770892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-21T06:04:44.781798+0000","last_change":"2024-09-21T06:04:43.778056+0000","last_active":"2024-09-21T06:04:44.781798+0000","last_peered":"2024-09-21T06:04:44.781798+0000","last_clean":"2024-09-21T06:04:44.781798+0000","last_became_active":"2024-09-21T06:04:43.777777+0000","last_became_peered":"2024-09-21T06:04:43.777777+0000","last_unstale":"2024-09-21T06:04:44.781798+0000","last_undegraded":"2024-09-21T06:04:44.781798+0000","last_fullsized":"2024-09-21T06:04:44.781798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:41.590364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-21T06:04:43.767072+0000","last_change":"2024-09-21T06:04:43.767072+0000","last_active":"2024-09-21T06:04:43.760425+0000","last_peered":"2024-09-21T06:04:43.760425+0000","last_clean":"2024-09-21T06:04:43.760425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:04:43.767072+0000","last_undegraded":"2024-09-21T06:04:43.767072+0000","last_fullsized":"2024-09-21T06:04:43.767072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.781589+0000","last_change":"2024-09-21T06:04:43.781399+0000","last_active":"2024-09-21T06:04:43.781589+0000","last_peered":"2024-09-21T06:04:43.781589+0000","last_clean":"2024-09-21T06:04:43.781589+0000","last_became_active":"2024-09-21T06:04:43.781096+0000","last_became_peered":"2024-09-21T06:04:43.781096+0000","last_unstale":"2024-09-21T06:04:43.781589+0000","last_undegraded":"2024-09-21T06:04:43.781589+0000","last_fullsized":"2024-09-21T06:04:43.781589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:28.140722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":129,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-21T06:04:43.765884+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:04:43.765884+0000","last_peered":"2024-09-21T06:04:43.765884+0000","last_clean":"2024-09-21T06:04:43.765884+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:04:43.765884+0000","last_undegraded":"2024-09-21T06:04:43.765884+0000","last_fullsized":"2024-09-21T06:04:43.765884+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":118,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194617,"statfs":{"total":200000000,"available":199288741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194617,"statfs":{"total":200000000,"available":199288741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:50.187 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-21T06:04:50.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.773095+0000', 'last_change': '2024-09-21T06:04:43.773095+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.773095+0000', 'last_undegraded': '2024-09-21T06:04:43.773095+0000', 'last_fullsized': '2024-09-21T06:04:43.773095+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:04:50.188 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-21T06:04:50.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.769072+0000', 'last_change': '2024-09-21T06:04:43.769072+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.769072+0000', 'last_undegraded': '2024-09-21T06:04:43.769072+0000', 'last_fullsized': '2024-09-21T06:04:43.769072+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.188 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-21T06:04:50.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.771238+0000', 'last_change': '2024-09-21T06:04:43.771238+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.771238+0000', 'last_undegraded': '2024-09-21T06:04:43.771238+0000', 'last_fullsized': '2024-09-21T06:04:43.771238+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.188 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.766892+0000', 'last_change': '2024-09-21T06:04:43.766892+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.766892+0000', 'last_undegraded': '2024-09-21T06:04:43.766892+0000', 'last_fullsized': '2024-09-21T06:04:43.766892+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.774104+0000', 'last_change': '2024-09-21T06:04:43.774104+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.774104+0000', 'last_undegraded': '2024-09-21T06:04:43.774104+0000', 'last_fullsized': '2024-09-21T06:04:43.774104+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.771332+0000', 'last_change': '2024-09-21T06:04:43.771332+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.771332+0000', 'last_undegraded': '2024-09-21T06:04:43.771332+0000', 'last_fullsized': '2024-09-21T06:04:43.771332+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.769819+0000', 'last_change': '2024-09-21T06:04:43.769819+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.769819+0000', 'last_undegraded': '2024-09-21T06:04:43.769819+0000', 'last_fullsized': '2024-09-21T06:04:43.769819+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.189 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-21T06:04:50.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772134+0000', 'last_change': '2024-09-21T06:04:43.772134+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772134+0000', 'last_undegraded': '2024-09-21T06:04:43.772134+0000', 'last_fullsized': '2024-09-21T06:04:43.772134+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.190 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-21T06:04:50.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772751+0000', 'last_change': '2024-09-21T06:04:43.772751+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772751+0000', 'last_undegraded': '2024-09-21T06:04:43.772751+0000', 'last_fullsized': '2024-09-21T06:04:43.772751+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.190 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-21T06:04:50.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772669+0000', 'last_change': '2024-09-21T06:04:43.772669+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772669+0000', 'last_undegraded': '2024-09-21T06:04:43.772669+0000', 'last_fullsized': '2024-09-21T06:04:43.772669+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.190 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-21T06:04:50.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767369+0000', 'last_change': '2024-09-21T06:04:43.767369+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767369+0000', 'last_undegraded': '2024-09-21T06:04:43.767369+0000', 'last_fullsized': '2024-09-21T06:04:43.767369+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.191 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-21T06:04:50.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.769474+0000', 'last_change': '2024-09-21T06:04:43.769474+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.769474+0000', 'last_undegraded': '2024-09-21T06:04:43.769474+0000', 'last_fullsized': '2024-09-21T06:04:43.769474+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.191 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-21T06:04:50.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767072+0000', 'last_change': '2024-09-21T06:04:43.767072+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767072+0000', 'last_undegraded': '2024-09-21T06:04:43.767072+0000', 'last_fullsized': '2024-09-21T06:04:43.767072+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.191 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-21T06:04:50.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.771331+0000', 'last_change': '2024-09-21T06:04:43.771331+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.771331+0000', 'last_undegraded': '2024-09-21T06:04:43.771331+0000', 'last_fullsized': '2024-09-21T06:04:43.771331+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.192 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-21T06:04:50.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.766551+0000', 'last_change': '2024-09-21T06:04:43.766551+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.766551+0000', 'last_undegraded': '2024-09-21T06:04:43.766551+0000', 'last_fullsized': '2024-09-21T06:04:43.766551+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.192 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-21T06:04:50.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.771499+0000', 'last_change': '2024-09-21T06:04:43.771499+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.771499+0000', 'last_undegraded': '2024-09-21T06:04:43.771499+0000', 'last_fullsized': '2024-09-21T06:04:43.771499+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.192 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-21T06:04:50.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.770887+0000', 'last_change': '2024-09-21T06:04:43.770887+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.770887+0000', 'last_undegraded': '2024-09-21T06:04:43.770887+0000', 'last_fullsized': '2024-09-21T06:04:43.770887+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.192 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.769738+0000', 'last_change': '2024-09-21T06:04:43.769738+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.769738+0000', 'last_undegraded': '2024-09-21T06:04:43.769738+0000', 'last_fullsized': '2024-09-21T06:04:43.769738+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772862+0000', 'last_change': '2024-09-21T06:04:43.772862+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772862+0000', 'last_undegraded': '2024-09-21T06:04:43.772862+0000', 'last_fullsized': '2024-09-21T06:04:43.772862+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.777731+0000', 'last_change': '2024-09-21T06:04:43.777731+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.777731+0000', 'last_undegraded': '2024-09-21T06:04:43.777731+0000', 'last_fullsized': '2024-09-21T06:04:43.777731+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.769850+0000', 'last_change': '2024-09-21T06:04:43.769850+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.769850+0000', 'last_undegraded': '2024-09-21T06:04:43.769850+0000', 'last_fullsized': '2024-09-21T06:04:43.769850+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.193 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-21T06:04:50.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.768526+0000', 'last_change': '2024-09-21T06:04:43.768526+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.768526+0000', 'last_undegraded': '2024-09-21T06:04:43.768526+0000', 'last_fullsized': '2024-09-21T06:04:43.768526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.194 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-21T06:04:50.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772301+0000', 'last_change': '2024-09-21T06:04:43.772301+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772301+0000', 'last_undegraded': '2024-09-21T06:04:43.772301+0000', 'last_fullsized': '2024-09-21T06:04:43.772301+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.194 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-21T06:04:50.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772711+0000', 'last_change': '2024-09-21T06:04:43.772711+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772711+0000', 'last_undegraded': '2024-09-21T06:04:43.772711+0000', 'last_fullsized': '2024-09-21T06:04:43.772711+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:04:50.194 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-21T06:04:50.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767090+0000', 'last_change': '2024-09-21T06:04:43.767090+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767090+0000', 'last_undegraded': '2024-09-21T06:04:43.767090+0000', 'last_fullsized': '2024-09-21T06:04:43.767090+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772350+0000', 'last_change': '2024-09-21T06:04:43.772350+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772350+0000', 'last_undegraded': '2024-09-21T06:04:43.772350+0000', 'last_fullsized': '2024-09-21T06:04:43.772350+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.771091+0000', 'last_change': '2024-09-21T06:04:43.771091+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.771091+0000', 'last_undegraded': '2024-09-21T06:04:43.771091+0000', 'last_fullsized': '2024-09-21T06:04:43.771091+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772509+0000', 'last_change': '2024-09-21T06:04:43.772509+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772509+0000', 'last_undegraded': '2024-09-21T06:04:43.772509+0000', 'last_fullsized': '2024-09-21T06:04:43.772509+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-21T06:04:50.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767761+0000', 'last_change': '2024-09-21T06:04:43.767761+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767761+0000', 'last_undegraded': '2024-09-21T06:04:43.767761+0000', 'last_fullsized': '2024-09-21T06:04:43.767761+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.771776+0000', 'last_change': '2024-09-21T06:04:43.771776+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.771776+0000', 'last_undegraded': '2024-09-21T06:04:43.771776+0000', 'last_fullsized': '2024-09-21T06:04:43.771776+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.773349+0000', 'last_change': '2024-09-21T06:04:43.773349+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.773349+0000', 'last_undegraded': '2024-09-21T06:04:43.773349+0000', 'last_fullsized': '2024-09-21T06:04:43.773349+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.770860+0000', 'last_change': '2024-09-21T06:04:43.770860+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.770860+0000', 'last_undegraded': '2024-09-21T06:04:43.770860+0000', 'last_fullsized': '2024-09-21T06:04:43.770860+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-21T06:04:50.196 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.768945+0000', 'last_change': '2024-09-21T06:04:43.768945+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.768945+0000', 'last_undegraded': '2024-09-21T06:04:43.768945+0000', 'last_fullsized': '2024-09-21T06:04:43.768945+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.197 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-21T06:04:50.197 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.769448+0000', 'last_change': '2024-09-21T06:04:43.769448+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.769448+0000', 'last_undegraded': '2024-09-21T06:04:43.769448+0000', 'last_fullsized': '2024-09-21T06:04:43.769448+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.197 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-21T06:04:50.197 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.775625+0000', 'last_change': '2024-09-21T06:04:43.775625+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.775625+0000', 'last_undegraded': '2024-09-21T06:04:43.775625+0000', 'last_fullsized': '2024-09-21T06:04:43.775625+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.197 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-21T06:04:50.197 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767370+0000', 'last_change': '2024-09-21T06:04:43.767370+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767370+0000', 'last_undegraded': '2024-09-21T06:04:43.767370+0000', 'last_fullsized': '2024-09-21T06:04:43.767370+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.773920+0000', 'last_change': '2024-09-21T06:04:43.773920+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.773920+0000', 'last_undegraded': '2024-09-21T06:04:43.773920+0000', 'last_fullsized': '2024-09-21T06:04:43.773920+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.772949+0000', 'last_change': '2024-09-21T06:04:43.772949+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.772949+0000', 'last_undegraded': '2024-09-21T06:04:43.772949+0000', 'last_fullsized': '2024-09-21T06:04:43.772949+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.769379+0000', 'last_change': '2024-09-21T06:04:43.769379+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.769379+0000', 'last_undegraded': '2024-09-21T06:04:43.769379+0000', 'last_fullsized': '2024-09-21T06:04:43.769379+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-21T06:04:50.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.778499+0000', 'last_change': '2024-09-21T06:04:43.778499+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.778499+0000', 'last_undegraded': '2024-09-21T06:04:43.778499+0000', 'last_fullsized': '2024-09-21T06:04:43.778499+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.768485+0000', 'last_change': '2024-09-21T06:04:43.768485+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.768485+0000', 'last_undegraded': '2024-09-21T06:04:43.768485+0000', 'last_fullsized': '2024-09-21T06:04:43.768485+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.766384+0000', 'last_change': '2024-09-21T06:04:43.766384+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.766384+0000', 'last_undegraded': '2024-09-21T06:04:43.766384+0000', 'last_fullsized': '2024-09-21T06:04:43.766384+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.766985+0000', 'last_change': '2024-09-21T06:04:43.766985+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.766985+0000', 'last_undegraded': '2024-09-21T06:04:43.766985+0000', 'last_fullsized': '2024-09-21T06:04:43.766985+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-21T06:04:50.199 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767520+0000', 'last_change': '2024-09-21T06:04:43.767520+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767520+0000', 'last_undegraded': '2024-09-21T06:04:43.767520+0000', 'last_fullsized': '2024-09-21T06:04:43.767520+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.200 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-21T06:04:50.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767564+0000', 'last_change': '2024-09-21T06:04:43.767564+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767564+0000', 'last_undegraded': '2024-09-21T06:04:43.767564+0000', 'last_fullsized': '2024-09-21T06:04:43.767564+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.200 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-21T06:04:50.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.766648+0000', 'last_change': '2024-09-21T06:04:43.766648+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.766648+0000', 'last_undegraded': '2024-09-21T06:04:43.766648+0000', 'last_fullsized': '2024-09-21T06:04:43.766648+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:04:50.200 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-21T06:04:50.200 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.770927+0000', 'last_change': '2024-09-21T06:04:43.770927+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.770927+0000', 'last_undegraded': '2024-09-21T06:04:43.770927+0000', 'last_fullsized': '2024-09-21T06:04:43.770927+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:04:50.201 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-21T06:04:50.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.773327+0000', 'last_change': '2024-09-21T06:04:43.773327+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.773327+0000', 'last_undegraded': '2024-09-21T06:04:43.773327+0000', 'last_fullsized': '2024-09-21T06:04:43.773327+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:04:50.201 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-21T06:04:50.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.770892+0000', 'last_change': '2024-09-21T06:04:43.770892+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.770892+0000', 'last_undegraded': '2024-09-21T06:04:43.770892+0000', 'last_fullsized': '2024-09-21T06:04:43.770892+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:04:50.201 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-21T06:04:50.201 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:04:43.767072+0000', 'last_change': '2024-09-21T06:04:43.767072+0000', 'last_active': '2024-09-21T06:04:43.760425+0000', 'last_peered': '2024-09-21T06:04:43.760425+0000', 'last_clean': '2024-09-21T06:04:43.760425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:04:43.767072+0000', 'last_undegraded': '2024-09-21T06:04:43.767072+0000', 'last_fullsized': '2024-09-21T06:04:43.767072+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'last_clean_scrub_stamp': '2024-09-21T06:04:43.760425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:04:50.202 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T06:04:50.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.454+0000 7fb4dd200640 1 -- 172.21.15.118:0/1957893372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 msgr2=0x7fb4d808c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.454+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1957893372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d808c2d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80cd800 tx=0x7fb4c802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.455+0000 7fb4dd200640 1 -- 172.21.15.118:0/1957893372 shutdown_connections 2024-09-21T06:04:50.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.455+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1957893372 >> v2:172.21.15.149:3300/0 conn(0x7fb4d80af9b0 0x7fb4d808c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.455+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1957893372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d808c2d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.455+0000 7fb4dd200640 1 -- 172.21.15.118:0/1957893372 >> 172.21.15.118:0/1957893372 conn(0x7fb4d806d320 msgr2=0x7fb4d80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:50.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.455+0000 7fb4dd200640 1 -- 172.21.15.118:0/1957893372 shutdown_connections 2024-09-21T06:04:50.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.455+0000 7fb4dd200640 1 -- 172.21.15.118:0/1957893372 wait complete. 2024-09-21T06:04:50.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.457+0000 7fb4dd200640 1 Processor -- start 2024-09-21T06:04:50.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.457+0000 7fb4dd200640 1 -- start start 2024-09-21T06:04:50.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.458+0000 7fb4dd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d8074d50 0x7fb4d8163b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.458+0000 7fb4dd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d80af9b0 0x7fb4d8168f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.458+0000 7fb4dd200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d8169450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.458+0000 7fb4dd200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d8074540 con 0x7fb4d80cdc90 2024-09-21T06:04:50.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.458+0000 7fb4dd200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d80743c0 con 0x7fb4d80af9b0 2024-09-21T06:04:50.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.458+0000 7fb4dd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d80746c0 con 0x7fb4d8074d50 2024-09-21T06:04:50.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d8169450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d8169450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59726/0 (socket says 172.21.15.118:59726) 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 -- 172.21.15.118:0/1422427467 learned_addr learned my addr 172.21.15.118:0/1422427467 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4cea00640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d80af9b0 0x7fb4d8168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7400640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d8074d50 0x7fb4d8163b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 -- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d8074d50 msgr2=0x7fb4d8163b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d8074d50 0x7fb4d8163b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 -- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d80af9b0 msgr2=0x7fb4d8168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d80af9b0 0x7fb4d8168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 -- 172.21.15.118:0/1422427467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d80c6a70 con 0x7fb4d80cdc90 2024-09-21T06:04:50.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.459+0000 7fb4d7e00640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d8169450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000ca80 tx=0x7fb4d000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:50.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.460+0000 7fb4cfe00640 1 -- 172.21.15.118:0/1422427467 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000be20 con 0x7fb4d80cdc90 2024-09-21T06:04:50.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.460+0000 7fb4cfe00640 1 -- 172.21.15.118:0/1422427467 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4d0004b20 con 0x7fb4d80cdc90 2024-09-21T06:04:50.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.460+0000 7fb4cfe00640 1 -- 172.21.15.118:0/1422427467 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0005020 con 0x7fb4d80cdc90 2024-09-21T06:04:50.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.460+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d8168430 con 0x7fb4d80cdc90 2024-09-21T06:04:50.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.460+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d81689f0 con 0x7fb4d80cdc90 2024-09-21T06:04:50.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.461+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d80738b0 con 0x7fb4d80cdc90 2024-09-21T06:04:50.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.462+0000 7fb4cfe00640 1 -- 172.21.15.118:0/1422427467 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4d001e020 con 0x7fb4d80cdc90 2024-09-21T06:04:50.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.463+0000 7fb4cfe00640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.463+0000 7fb4cfe00640 1 -- 172.21.15.118:0/1422427467 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb4d009ae80 con 0x7fb4d80cdc90 2024-09-21T06:04:50.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.463+0000 7fb4d7400640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.464+0000 7fb4d7400640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8033000 tx=0x7fb4c8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:50.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.468+0000 7fb4cfe00640 1 -- 172.21.15.118:0/1422427467 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb4d0062d00 con 0x7fb4d80cdc90 2024-09-21T06:04:50.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.721+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb4d806dd00 con 0x7fb4d80cdc90 2024-09-21T06:04:50.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.721+0000 7fb4cfe00640 1 -- 172.21.15.118:0/1422427467 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1681 (secure 0 0 0) 0x7fb4d0067730 con 0x7fb4d80cdc90 2024-09-21T06:04:50.723 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:50.724 INFO:teuthology.orchestra.run.smithi118.stdout:{"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1726898623,"num_in_osds":8,"osd_in_since":1726898620,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":50},{"state_name":"active+clean","count":47}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":591980,"bytes_used":2116529,"bytes_avail":1597883471,"bytes_total":1600000000,"inactive_pgs_ratio":0.51546388864517212,"write_bytes_sec":538,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4795}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-21T06:04:46.468962+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T06:04:50.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb4b4078bc0 msgr2=0x7fb4b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8033000 tx=0x7fb4c8004730 comp rx=0 tx=0).stop 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 msgr2=0x7fb4d8169450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d8169450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000ca80 tx=0x7fb4d000b6d0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 shutdown_connections 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4d80cdc90 0x7fb4d8169450 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4d80af9b0 0x7fb4d8168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 --2- 172.21.15.118:0/1422427467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4d8074d50 0x7fb4d8163b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 >> 172.21.15.118:0/1422427467 conn(0x7fb4d806d320 msgr2=0x7fb4d81756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 shutdown_connections 2024-09-21T06:04:50.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.724+0000 7fb4dd200640 1 -- 172.21.15.118:0/1422427467 wait complete. 2024-09-21T06:04:50.749 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T06:04:50.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 -- 172.21.15.118:0/2028077431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f015415cfd0 msgr2=0x7f01540b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 --2- 172.21.15.118:0/2028077431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f015415cfd0 0x7f01540b3a60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f01540b5db0 tx=0x7f014402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 -- 172.21.15.118:0/2028077431 shutdown_connections 2024-09-21T06:04:50.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 --2- 172.21.15.118:0/2028077431 >> v2:172.21.15.149:3300/0 conn(0x7f01540b5450 0x7f01540cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 --2- 172.21.15.118:0/2028077431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f015415cfd0 0x7f01540b3a60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 -- 172.21.15.118:0/2028077431 >> 172.21.15.118:0/2028077431 conn(0x7f015406d110 msgr2=0x7f015406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:50.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 -- 172.21.15.118:0/2028077431 shutdown_connections 2024-09-21T06:04:50.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.968+0000 7f015b200640 1 -- 172.21.15.118:0/2028077431 wait complete. 2024-09-21T06:04:50.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.971+0000 7f015b200640 1 Processor -- start 2024-09-21T06:04:50.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.971+0000 7f015b200640 1 -- start start 2024-09-21T06:04:50.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.972+0000 7f015b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01540b5040 0x7f01541eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.972+0000 7f015b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01540b5450 0x7f01541445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.972+0000 7f015b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f015415cfd0 0x7f01540c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.972+0000 7f015b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0154073c60 con 0x7f01540b5450 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.972+0000 7f015b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0154073ae0 con 0x7f01540b5040 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.972+0000 7f015b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0154073de0 con 0x7f015415cfd0 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.972+0000 7f014b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01540b5450 0x7f01541445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f0153e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01540b5040 0x7f01541eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f0159200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f015415cfd0 0x7f01540c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01540b5450 0x7f01541445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59732/0 (socket says 172.21.15.118:59732) 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 -- 172.21.15.118:0/854683489 learned_addr learned my addr 172.21.15.118:0/854683489 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f0153e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01540b5040 0x7f01541eb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:60206/0 (socket says 172.21.15.118:60206) 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 -- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f015415cfd0 msgr2=0x7f01540c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f015415cfd0 0x7f01540c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 -- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01540b5040 msgr2=0x7f01541eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:50.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01540b5040 0x7f01541eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:50.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 -- 172.21.15.118:0/854683489 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01540c67a0 con 0x7f01540b5450 2024-09-21T06:04:50.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f014b400640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01540b5450 0x7f01541445e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f013c00b3f0 tx=0x7f013c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:50.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.973+0000 7f0150c00640 1 -- 172.21.15.118:0/854683489 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c015020 con 0x7f01540b5450 2024-09-21T06:04:50.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.974+0000 7f0150c00640 1 -- 172.21.15.118:0/854683489 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f013c011920 con 0x7f01540b5450 2024-09-21T06:04:50.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.974+0000 7f0150c00640 1 -- 172.21.15.118:0/854683489 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c011d70 con 0x7f01540b5450 2024-09-21T06:04:50.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.974+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01540c6a80 con 0x7f01540b5450 2024-09-21T06:04:50.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.974+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01541ea330 con 0x7f01540b5450 2024-09-21T06:04:50.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.975+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01540b3a60 con 0x7f01540b5450 2024-09-21T06:04:50.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.976+0000 7f0150c00640 1 -- 172.21.15.118:0/854683489 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f013c018020 con 0x7f01540b5450 2024-09-21T06:04:50.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.977+0000 7f0150c00640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0130078b90 0x7f013007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:50.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.977+0000 7f0150c00640 1 -- 172.21.15.118:0/854683489 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f013c09a900 con 0x7f01540b5450 2024-09-21T06:04:50.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.977+0000 7f0153e00640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0130078b90 0x7f013007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:50.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.978+0000 7f0153e00640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0130078b90 0x7f013007b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0144033000 tx=0x7f0144004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:50.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:50.982+0000 7f0150c00640 1 -- 172.21.15.118:0/854683489 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f013c01f030 con 0x7f01540b5450 2024-09-21T06:04:51.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.162+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01540d10f0 con 0x7f0130078b90 2024-09-21T06:04:51.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.167+0000 7f0150c00640 1 -- 172.21.15.118:0/854683489 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247480 (secure 0 0 0) 0x7f01540d10f0 con 0x7f0130078b90 2024-09-21T06:04:51.171 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:51.172 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:51.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0130078b90 msgr2=0x7f013007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:51.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0130078b90 0x7f013007b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0144033000 tx=0x7f0144004730 comp rx=0 tx=0).stop 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01540b5450 msgr2=0x7f01541445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01540b5450 0x7f01541445e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f013c00b3f0 tx=0x7f013c00b8b0 comp rx=0 tx=0).stop 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 shutdown_connections 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0130078b90 0x7f013007b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f015415cfd0 0x7f01540c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01540b5450 0x7f01541445e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 --2- 172.21.15.118:0/854683489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01540b5040 0x7f01541eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 >> 172.21.15.118:0/854683489 conn(0x7f015406d110 msgr2=0x7f0154075fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 shutdown_connections 2024-09-21T06:04:51.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:51.171+0000 7f015b200640 1 -- 172.21.15.118:0/854683489 wait complete. 2024-09-21T06:04:51.194 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-21T06:04:50.469941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560295,"statfs":{"total":1600000000,"available":1597742716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.704817"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891711+0000","last_change":"2024-09-21T06:04:44.803485+0000","last_active":"2024-09-21T06:04:45.891711+0000","last_peered":"2024-09-21T06:04:45.891711+0000","last_clean":"2024-09-21T06:04:45.891711+0000","last_became_active":"2024-09-21T06:04:44.803195+0000","last_became_peered":"2024-09-21T06:04:44.803195+0000","last_unstale":"2024-09-21T06:04:45.891711+0000","last_undegraded":"2024-09-21T06:04:45.891711+0000","last_fullsized":"2024-09-21T06:04:45.891711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:28.415244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781930+0000","last_change":"2024-09-21T06:04:44.789175+0000","last_active":"2024-09-21T06:04:45.781930+0000","last_peered":"2024-09-21T06:04:45.781930+0000","last_clean":"2024-09-21T06:04:45.781930+0000","last_became_active":"2024-09-21T06:04:44.788833+0000","last_became_peered":"2024-09-21T06:04:44.788833+0000","last_unstale":"2024-09-21T06:04:45.781930+0000","last_undegraded":"2024-09-21T06:04:45.781930+0000","last_fullsized":"2024-09-21T06:04:45.781930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:14.880036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892229+0000","last_change":"2024-09-21T06:04:44.796745+0000","last_active":"2024-09-21T06:04:45.892229+0000","last_peered":"2024-09-21T06:04:45.892229+0000","last_clean":"2024-09-21T06:04:45.892229+0000","last_became_active":"2024-09-21T06:04:44.796475+0000","last_became_peered":"2024-09-21T06:04:44.796475+0000","last_unstale":"2024-09-21T06:04:45.892229+0000","last_undegraded":"2024-09-21T06:04:45.892229+0000","last_fullsized":"2024-09-21T06:04:45.892229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:02.360665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783191+0000","last_change":"2024-09-21T06:04:44.800722+0000","last_active":"2024-09-21T06:04:45.783191+0000","last_peered":"2024-09-21T06:04:45.783191+0000","last_clean":"2024-09-21T06:04:45.783191+0000","last_became_active":"2024-09-21T06:04:44.799790+0000","last_became_peered":"2024-09-21T06:04:44.799790+0000","last_unstale":"2024-09-21T06:04:45.783191+0000","last_undegraded":"2024-09-21T06:04:45.783191+0000","last_fullsized":"2024-09-21T06:04:45.783191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:42.500811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784601+0000","last_change":"2024-09-21T06:04:44.784847+0000","last_active":"2024-09-21T06:04:45.784601+0000","last_peered":"2024-09-21T06:04:45.784601+0000","last_clean":"2024-09-21T06:04:45.784601+0000","last_became_active":"2024-09-21T06:04:44.784593+0000","last_became_peered":"2024-09-21T06:04:44.784593+0000","last_unstale":"2024-09-21T06:04:45.784601+0000","last_undegraded":"2024-09-21T06:04:45.784601+0000","last_fullsized":"2024-09-21T06:04:45.784601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:09.435714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782004+0000","last_change":"2024-09-21T06:04:44.794679+0000","last_active":"2024-09-21T06:04:45.782004+0000","last_peered":"2024-09-21T06:04:45.782004+0000","last_clean":"2024-09-21T06:04:45.782004+0000","last_became_active":"2024-09-21T06:04:44.794390+0000","last_became_peered":"2024-09-21T06:04:44.794390+0000","last_unstale":"2024-09-21T06:04:45.782004+0000","last_undegraded":"2024-09-21T06:04:45.782004+0000","last_fullsized":"2024-09-21T06:04:45.782004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:46.270777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891794+0000","last_change":"2024-09-21T06:04:44.795208+0000","last_active":"2024-09-21T06:04:45.891794+0000","last_peered":"2024-09-21T06:04:45.891794+0000","last_clean":"2024-09-21T06:04:45.891794+0000","last_became_active":"2024-09-21T06:04:44.794629+0000","last_became_peered":"2024-09-21T06:04:44.794629+0000","last_unstale":"2024-09-21T06:04:45.891794+0000","last_undegraded":"2024-09-21T06:04:45.891794+0000","last_fullsized":"2024-09-21T06:04:45.891794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:55.430329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890840+0000","last_change":"2024-09-21T06:04:44.787154+0000","last_active":"2024-09-21T06:04:45.890840+0000","last_peered":"2024-09-21T06:04:45.890840+0000","last_clean":"2024-09-21T06:04:45.890840+0000","last_became_active":"2024-09-21T06:04:44.785584+0000","last_became_peered":"2024-09-21T06:04:44.785584+0000","last_unstale":"2024-09-21T06:04:45.890840+0000","last_undegraded":"2024-09-21T06:04:45.890840+0000","last_fullsized":"2024-09-21T06:04:45.890840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:16.273528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890057+0000","last_change":"2024-09-21T06:04:44.802546+0000","last_active":"2024-09-21T06:04:45.890057+0000","last_peered":"2024-09-21T06:04:45.890057+0000","last_clean":"2024-09-21T06:04:45.890057+0000","last_became_active":"2024-09-21T06:04:44.802183+0000","last_became_peered":"2024-09-21T06:04:44.802183+0000","last_unstale":"2024-09-21T06:04:45.890057+0000","last_undegraded":"2024-09-21T06:04:45.890057+0000","last_fullsized":"2024-09-21T06:04:45.890057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:21.937804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784515+0000","last_change":"2024-09-21T06:04:44.794323+0000","last_active":"2024-09-21T06:04:45.784515+0000","last_peered":"2024-09-21T06:04:45.784515+0000","last_clean":"2024-09-21T06:04:45.784515+0000","last_became_active":"2024-09-21T06:04:44.794050+0000","last_became_peered":"2024-09-21T06:04:44.794050+0000","last_unstale":"2024-09-21T06:04:45.784515+0000","last_undegraded":"2024-09-21T06:04:45.784515+0000","last_fullsized":"2024-09-21T06:04:45.784515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:48.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890537+0000","last_change":"2024-09-21T06:04:44.802173+0000","last_active":"2024-09-21T06:04:45.890537+0000","last_peered":"2024-09-21T06:04:45.890537+0000","last_clean":"2024-09-21T06:04:45.890537+0000","last_became_active":"2024-09-21T06:04:44.801901+0000","last_became_peered":"2024-09-21T06:04:44.801901+0000","last_unstale":"2024-09-21T06:04:45.890537+0000","last_undegraded":"2024-09-21T06:04:45.890537+0000","last_fullsized":"2024-09-21T06:04:45.890537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:55.492340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890360+0000","last_change":"2024-09-21T06:04:44.804585+0000","last_active":"2024-09-21T06:04:45.890360+0000","last_peered":"2024-09-21T06:04:45.890360+0000","last_clean":"2024-09-21T06:04:45.890360+0000","last_became_active":"2024-09-21T06:04:44.803994+0000","last_became_peered":"2024-09-21T06:04:44.803994+0000","last_unstale":"2024-09-21T06:04:45.890360+0000","last_undegraded":"2024-09-21T06:04:45.890360+0000","last_fullsized":"2024-09-21T06:04:45.890360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:36.563401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784683+0000","last_change":"2024-09-21T06:04:44.794786+0000","last_active":"2024-09-21T06:04:45.784683+0000","last_peered":"2024-09-21T06:04:45.784683+0000","last_clean":"2024-09-21T06:04:45.784683+0000","last_became_active":"2024-09-21T06:04:44.794148+0000","last_became_peered":"2024-09-21T06:04:44.794148+0000","last_unstale":"2024-09-21T06:04:45.784683+0000","last_undegraded":"2024-09-21T06:04:45.784683+0000","last_fullsized":"2024-09-21T06:04:45.784683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:04.674778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782584+0000","last_change":"2024-09-21T06:04:44.784324+0000","last_active":"2024-09-21T06:04:45.782584+0000","last_peered":"2024-09-21T06:04:45.782584+0000","last_clean":"2024-09-21T06:04:45.782584+0000","last_became_active":"2024-09-21T06:04:44.783909+0000","last_became_peered":"2024-09-21T06:04:44.783909+0000","last_unstale":"2024-09-21T06:04:45.782584+0000","last_undegraded":"2024-09-21T06:04:45.782584+0000","last_fullsized":"2024-09-21T06:04:45.782584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:19.078916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891135+0000","last_change":"2024-09-21T06:04:44.802203+0000","last_active":"2024-09-21T06:04:45.891135+0000","last_peered":"2024-09-21T06:04:45.891135+0000","last_clean":"2024-09-21T06:04:45.891135+0000","last_became_active":"2024-09-21T06:04:44.797138+0000","last_became_peered":"2024-09-21T06:04:44.797138+0000","last_unstale":"2024-09-21T06:04:45.891135+0000","last_undegraded":"2024-09-21T06:04:45.891135+0000","last_fullsized":"2024-09-21T06:04:45.891135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.953514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890780+0000","last_change":"2024-09-21T06:04:44.790182+0000","last_active":"2024-09-21T06:04:45.890780+0000","last_peered":"2024-09-21T06:04:45.890780+0000","last_clean":"2024-09-21T06:04:45.890780+0000","last_became_active":"2024-09-21T06:04:44.789772+0000","last_became_peered":"2024-09-21T06:04:44.789772+0000","last_unstale":"2024-09-21T06:04:45.890780+0000","last_undegraded":"2024-09-21T06:04:45.890780+0000","last_fullsized":"2024-09-21T06:04:45.890780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:24.193410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889753+0000","last_change":"2024-09-21T06:04:44.794888+0000","last_active":"2024-09-21T06:04:45.889753+0000","last_peered":"2024-09-21T06:04:45.889753+0000","last_clean":"2024-09-21T06:04:45.889753+0000","last_became_active":"2024-09-21T06:04:44.794175+0000","last_became_peered":"2024-09-21T06:04:44.794175+0000","last_unstale":"2024-09-21T06:04:45.889753+0000","last_undegraded":"2024-09-21T06:04:45.889753+0000","last_fullsized":"2024-09-21T06:04:45.889753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:34.039623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781857+0000","last_change":"2024-09-21T06:04:44.794968+0000","last_active":"2024-09-21T06:04:45.781857+0000","last_peered":"2024-09-21T06:04:45.781857+0000","last_clean":"2024-09-21T06:04:45.781857+0000","last_became_active":"2024-09-21T06:04:44.793534+0000","last_became_peered":"2024-09-21T06:04:44.793534+0000","last_unstale":"2024-09-21T06:04:45.781857+0000","last_undegraded":"2024-09-21T06:04:45.781857+0000","last_fullsized":"2024-09-21T06:04:45.781857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:14.296283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781688+0000","last_change":"2024-09-21T06:04:44.801878+0000","last_active":"2024-09-21T06:04:45.781688+0000","last_peered":"2024-09-21T06:04:45.781688+0000","last_clean":"2024-09-21T06:04:45.781688+0000","last_became_active":"2024-09-21T06:04:44.801289+0000","last_became_peered":"2024-09-21T06:04:44.801289+0000","last_unstale":"2024-09-21T06:04:45.781688+0000","last_undegraded":"2024-09-21T06:04:45.781688+0000","last_fullsized":"2024-09-21T06:04:45.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:31.602243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784827+0000","last_change":"2024-09-21T06:04:44.795438+0000","last_active":"2024-09-21T06:04:45.784827+0000","last_peered":"2024-09-21T06:04:45.784827+0000","last_clean":"2024-09-21T06:04:45.784827+0000","last_became_active":"2024-09-21T06:04:44.795179+0000","last_became_peered":"2024-09-21T06:04:44.795179+0000","last_unstale":"2024-09-21T06:04:45.784827+0000","last_undegraded":"2024-09-21T06:04:45.784827+0000","last_fullsized":"2024-09-21T06:04:45.784827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:40.589122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891724+0000","last_change":"2024-09-21T06:04:44.799598+0000","last_active":"2024-09-21T06:04:45.891724+0000","last_peered":"2024-09-21T06:04:45.891724+0000","last_clean":"2024-09-21T06:04:45.891724+0000","last_became_active":"2024-09-21T06:04:44.798977+0000","last_became_peered":"2024-09-21T06:04:44.798977+0000","last_unstale":"2024-09-21T06:04:45.891724+0000","last_undegraded":"2024-09-21T06:04:45.891724+0000","last_fullsized":"2024-09-21T06:04:45.891724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.796651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891779+0000","last_change":"2024-09-21T06:04:44.805235+0000","last_active":"2024-09-21T06:04:45.891779+0000","last_peered":"2024-09-21T06:04:45.891779+0000","last_clean":"2024-09-21T06:04:45.891779+0000","last_became_active":"2024-09-21T06:04:44.804618+0000","last_became_peered":"2024-09-21T06:04:44.804618+0000","last_unstale":"2024-09-21T06:04:45.891779+0000","last_undegraded":"2024-09-21T06:04:45.891779+0000","last_fullsized":"2024-09-21T06:04:45.891779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:17.218513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808750+0000","last_change":"2024-09-21T06:04:44.792814+0000","last_active":"2024-09-21T06:04:45.808750+0000","last_peered":"2024-09-21T06:04:45.808750+0000","last_clean":"2024-09-21T06:04:45.808750+0000","last_became_active":"2024-09-21T06:04:44.792399+0000","last_became_peered":"2024-09-21T06:04:44.792399+0000","last_unstale":"2024-09-21T06:04:45.808750+0000","last_undegraded":"2024-09-21T06:04:45.808750+0000","last_fullsized":"2024-09-21T06:04:45.808750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:50.873350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889791+0000","last_change":"2024-09-21T06:04:44.791550+0000","last_active":"2024-09-21T06:04:45.889791+0000","last_peered":"2024-09-21T06:04:45.889791+0000","last_clean":"2024-09-21T06:04:45.889791+0000","last_became_active":"2024-09-21T06:04:44.791253+0000","last_became_peered":"2024-09-21T06:04:44.791253+0000","last_unstale":"2024-09-21T06:04:45.889791+0000","last_undegraded":"2024-09-21T06:04:45.889791+0000","last_fullsized":"2024-09-21T06:04:45.889791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:03.570783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784060+0000","last_change":"2024-09-21T06:04:44.798792+0000","last_active":"2024-09-21T06:04:45.784060+0000","last_peered":"2024-09-21T06:04:45.784060+0000","last_clean":"2024-09-21T06:04:45.784060+0000","last_became_active":"2024-09-21T06:04:44.798613+0000","last_became_peered":"2024-09-21T06:04:44.798613+0000","last_unstale":"2024-09-21T06:04:45.784060+0000","last_undegraded":"2024-09-21T06:04:45.784060+0000","last_fullsized":"2024-09-21T06:04:45.784060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:29.183926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782348+0000","last_change":"2024-09-21T06:04:44.786220+0000","last_active":"2024-09-21T06:04:45.782348+0000","last_peered":"2024-09-21T06:04:45.782348+0000","last_clean":"2024-09-21T06:04:45.782348+0000","last_became_active":"2024-09-21T06:04:44.785908+0000","last_became_peered":"2024-09-21T06:04:44.785908+0000","last_unstale":"2024-09-21T06:04:45.782348+0000","last_undegraded":"2024-09-21T06:04:45.782348+0000","last_fullsized":"2024-09-21T06:04:45.782348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:32.210837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784060+0000","last_change":"2024-09-21T06:04:44.805942+0000","last_active":"2024-09-21T06:04:45.784060+0000","last_peered":"2024-09-21T06:04:45.784060+0000","last_clean":"2024-09-21T06:04:45.784060+0000","last_became_active":"2024-09-21T06:04:44.805645+0000","last_became_peered":"2024-09-21T06:04:44.805645+0000","last_unstale":"2024-09-21T06:04:45.784060+0000","last_undegraded":"2024-09-21T06:04:45.784060+0000","last_fullsized":"2024-09-21T06:04:45.784060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:16.407530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890797+0000","last_change":"2024-09-21T06:04:44.796051+0000","last_active":"2024-09-21T06:04:45.890797+0000","last_peered":"2024-09-21T06:04:45.890797+0000","last_clean":"2024-09-21T06:04:45.890797+0000","last_became_active":"2024-09-21T06:04:44.794568+0000","last_became_peered":"2024-09-21T06:04:44.794568+0000","last_unstale":"2024-09-21T06:04:45.890797+0000","last_undegraded":"2024-09-21T06:04:45.890797+0000","last_fullsized":"2024-09-21T06:04:45.890797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:08.898566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890306+0000","last_change":"2024-09-21T06:04:44.796966+0000","last_active":"2024-09-21T06:04:45.890306+0000","last_peered":"2024-09-21T06:04:45.890306+0000","last_clean":"2024-09-21T06:04:45.890306+0000","last_became_active":"2024-09-21T06:04:44.796556+0000","last_became_peered":"2024-09-21T06:04:44.796556+0000","last_unstale":"2024-09-21T06:04:45.890306+0000","last_undegraded":"2024-09-21T06:04:45.890306+0000","last_fullsized":"2024-09-21T06:04:45.890306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:19.403973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889914+0000","last_change":"2024-09-21T06:04:44.797177+0000","last_active":"2024-09-21T06:04:45.889914+0000","last_peered":"2024-09-21T06:04:45.889914+0000","last_clean":"2024-09-21T06:04:45.889914+0000","last_became_active":"2024-09-21T06:04:44.796360+0000","last_became_peered":"2024-09-21T06:04:44.796360+0000","last_unstale":"2024-09-21T06:04:45.889914+0000","last_undegraded":"2024-09-21T06:04:45.889914+0000","last_fullsized":"2024-09-21T06:04:45.889914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:18.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892430+0000","last_change":"2024-09-21T06:04:44.793158+0000","last_active":"2024-09-21T06:04:45.892430+0000","last_peered":"2024-09-21T06:04:45.892430+0000","last_clean":"2024-09-21T06:04:45.892430+0000","last_became_active":"2024-09-21T06:04:44.792875+0000","last_became_peered":"2024-09-21T06:04:44.792875+0000","last_unstale":"2024-09-21T06:04:45.892430+0000","last_undegraded":"2024-09-21T06:04:45.892430+0000","last_fullsized":"2024-09-21T06:04:45.892430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.177878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890013+0000","last_change":"2024-09-21T06:04:44.801109+0000","last_active":"2024-09-21T06:04:45.890013+0000","last_peered":"2024-09-21T06:04:45.890013+0000","last_clean":"2024-09-21T06:04:45.890013+0000","last_became_active":"2024-09-21T06:04:44.800834+0000","last_became_peered":"2024-09-21T06:04:44.800834+0000","last_unstale":"2024-09-21T06:04:45.890013+0000","last_undegraded":"2024-09-21T06:04:45.890013+0000","last_fullsized":"2024-09-21T06:04:45.890013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:21.472427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808798+0000","last_change":"2024-09-21T06:04:44.790611+0000","last_active":"2024-09-21T06:04:45.808798+0000","last_peered":"2024-09-21T06:04:45.808798+0000","last_clean":"2024-09-21T06:04:45.808798+0000","last_became_active":"2024-09-21T06:04:44.790355+0000","last_became_peered":"2024-09-21T06:04:44.790355+0000","last_unstale":"2024-09-21T06:04:45.808798+0000","last_undegraded":"2024-09-21T06:04:45.808798+0000","last_fullsized":"2024-09-21T06:04:45.808798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:28.670542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890450+0000","last_change":"2024-09-21T06:04:43.779849+0000","last_active":"2024-09-21T06:04:45.890450+0000","last_peered":"2024-09-21T06:04:45.890450+0000","last_clean":"2024-09-21T06:04:45.890450+0000","last_became_active":"2024-09-21T06:04:43.779516+0000","last_became_peered":"2024-09-21T06:04:43.779516+0000","last_unstale":"2024-09-21T06:04:45.890450+0000","last_undegraded":"2024-09-21T06:04:45.890450+0000","last_fullsized":"2024-09-21T06:04:45.890450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:42.525771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890262+0000","last_change":"2024-09-21T06:04:44.804649+0000","last_active":"2024-09-21T06:04:45.890262+0000","last_peered":"2024-09-21T06:04:45.890262+0000","last_clean":"2024-09-21T06:04:45.890262+0000","last_became_active":"2024-09-21T06:04:44.804395+0000","last_became_peered":"2024-09-21T06:04:44.804395+0000","last_unstale":"2024-09-21T06:04:45.890262+0000","last_undegraded":"2024-09-21T06:04:45.890262+0000","last_fullsized":"2024-09-21T06:04:45.890262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:34.445445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808704+0000","last_change":"2024-09-21T06:04:43.776190+0000","last_active":"2024-09-21T06:04:45.808704+0000","last_peered":"2024-09-21T06:04:45.808704+0000","last_clean":"2024-09-21T06:04:45.808704+0000","last_became_active":"2024-09-21T06:04:43.775927+0000","last_became_peered":"2024-09-21T06:04:43.775927+0000","last_unstale":"2024-09-21T06:04:45.808704+0000","last_undegraded":"2024-09-21T06:04:45.808704+0000","last_fullsized":"2024-09-21T06:04:45.808704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:40.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891993+0000","last_change":"2024-09-21T06:04:44.799273+0000","last_active":"2024-09-21T06:04:45.891993+0000","last_peered":"2024-09-21T06:04:45.891993+0000","last_clean":"2024-09-21T06:04:45.891993+0000","last_became_active":"2024-09-21T06:04:44.798587+0000","last_became_peered":"2024-09-21T06:04:44.798587+0000","last_unstale":"2024-09-21T06:04:45.891993+0000","last_undegraded":"2024-09-21T06:04:45.891993+0000","last_fullsized":"2024-09-21T06:04:45.891993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:03.680255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782342+0000","last_change":"2024-09-21T06:04:43.779823+0000","last_active":"2024-09-21T06:04:45.782342+0000","last_peered":"2024-09-21T06:04:45.782342+0000","last_clean":"2024-09-21T06:04:45.782342+0000","last_became_active":"2024-09-21T06:04:43.779575+0000","last_became_peered":"2024-09-21T06:04:43.779575+0000","last_unstale":"2024-09-21T06:04:45.782342+0000","last_undegraded":"2024-09-21T06:04:45.782342+0000","last_fullsized":"2024-09-21T06:04:45.782342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.357444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784284+0000","last_change":"2024-09-21T06:04:44.797443+0000","last_active":"2024-09-21T06:04:45.784284+0000","last_peered":"2024-09-21T06:04:45.784284+0000","last_clean":"2024-09-21T06:04:45.784284+0000","last_became_active":"2024-09-21T06:04:44.797237+0000","last_became_peered":"2024-09-21T06:04:44.797237+0000","last_unstale":"2024-09-21T06:04:45.784284+0000","last_undegraded":"2024-09-21T06:04:45.784284+0000","last_fullsized":"2024-09-21T06:04:45.784284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:31.598945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784381+0000","last_change":"2024-09-21T06:04:43.779019+0000","last_active":"2024-09-21T06:04:45.784381+0000","last_peered":"2024-09-21T06:04:45.784381+0000","last_clean":"2024-09-21T06:04:45.784381+0000","last_became_active":"2024-09-21T06:04:43.778771+0000","last_became_peered":"2024-09-21T06:04:43.778771+0000","last_unstale":"2024-09-21T06:04:45.784381+0000","last_undegraded":"2024-09-21T06:04:45.784381+0000","last_fullsized":"2024-09-21T06:04:45.784381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.601619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891169+0000","last_change":"2024-09-21T06:04:44.801616+0000","last_active":"2024-09-21T06:04:45.891169+0000","last_peered":"2024-09-21T06:04:45.891169+0000","last_clean":"2024-09-21T06:04:45.891169+0000","last_became_active":"2024-09-21T06:04:44.800886+0000","last_became_peered":"2024-09-21T06:04:44.800886+0000","last_unstale":"2024-09-21T06:04:45.891169+0000","last_undegraded":"2024-09-21T06:04:45.891169+0000","last_fullsized":"2024-09-21T06:04:45.891169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:33.383758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891507+0000","last_change":"2024-09-21T06:04:43.780697+0000","last_active":"2024-09-21T06:04:45.891507+0000","last_peered":"2024-09-21T06:04:45.891507+0000","last_clean":"2024-09-21T06:04:45.891507+0000","last_became_active":"2024-09-21T06:04:43.779269+0000","last_became_peered":"2024-09-21T06:04:43.779269+0000","last_unstale":"2024-09-21T06:04:45.891507+0000","last_undegraded":"2024-09-21T06:04:45.891507+0000","last_fullsized":"2024-09-21T06:04:45.891507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:52.371562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890589+0000","last_change":"2024-09-21T06:04:44.803645+0000","last_active":"2024-09-21T06:04:45.890589+0000","last_peered":"2024-09-21T06:04:45.890589+0000","last_clean":"2024-09-21T06:04:45.890589+0000","last_became_active":"2024-09-21T06:04:44.800665+0000","last_became_peered":"2024-09-21T06:04:44.800665+0000","last_unstale":"2024-09-21T06:04:45.890589+0000","last_undegraded":"2024-09-21T06:04:45.890589+0000","last_fullsized":"2024-09-21T06:04:45.890589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:25.472376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891871+0000","last_change":"2024-09-21T06:04:43.777908+0000","last_active":"2024-09-21T06:04:45.891871+0000","last_peered":"2024-09-21T06:04:45.891871+0000","last_clean":"2024-09-21T06:04:45.891871+0000","last_became_active":"2024-09-21T06:04:43.777364+0000","last_became_peered":"2024-09-21T06:04:43.777364+0000","last_unstale":"2024-09-21T06:04:45.891871+0000","last_undegraded":"2024-09-21T06:04:45.891871+0000","last_fullsized":"2024-09-21T06:04:45.891871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:59.148778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891461+0000","last_change":"2024-09-21T06:04:44.795317+0000","last_active":"2024-09-21T06:04:45.891461+0000","last_peered":"2024-09-21T06:04:45.891461+0000","last_clean":"2024-09-21T06:04:45.891461+0000","last_became_active":"2024-09-21T06:04:44.794966+0000","last_became_peered":"2024-09-21T06:04:44.794966+0000","last_unstale":"2024-09-21T06:04:45.891461+0000","last_undegraded":"2024-09-21T06:04:45.891461+0000","last_fullsized":"2024-09-21T06:04:45.891461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:15.638123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782754+0000","last_change":"2024-09-21T06:04:43.769051+0000","last_active":"2024-09-21T06:04:45.782754+0000","last_peered":"2024-09-21T06:04:45.782754+0000","last_clean":"2024-09-21T06:04:45.782754+0000","last_became_active":"2024-09-21T06:04:43.768049+0000","last_became_peered":"2024-09-21T06:04:43.768049+0000","last_unstale":"2024-09-21T06:04:45.782754+0000","last_undegraded":"2024-09-21T06:04:45.782754+0000","last_fullsized":"2024-09-21T06:04:45.782754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:55.024560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783421+0000","last_change":"2024-09-21T06:04:44.801065+0000","last_active":"2024-09-21T06:04:45.783421+0000","last_peered":"2024-09-21T06:04:45.783421+0000","last_clean":"2024-09-21T06:04:45.783421+0000","last_became_active":"2024-09-21T06:04:44.800113+0000","last_became_peered":"2024-09-21T06:04:44.800113+0000","last_unstale":"2024-09-21T06:04:45.783421+0000","last_undegraded":"2024-09-21T06:04:45.783421+0000","last_fullsized":"2024-09-21T06:04:45.783421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:35.349849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892062+0000","last_change":"2024-09-21T06:04:43.782072+0000","last_active":"2024-09-21T06:04:45.892062+0000","last_peered":"2024-09-21T06:04:45.892062+0000","last_clean":"2024-09-21T06:04:45.892062+0000","last_became_active":"2024-09-21T06:04:43.780898+0000","last_became_peered":"2024-09-21T06:04:43.780898+0000","last_unstale":"2024-09-21T06:04:45.892062+0000","last_undegraded":"2024-09-21T06:04:45.892062+0000","last_fullsized":"2024-09-21T06:04:45.892062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:42.087630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891172+0000","last_change":"2024-09-21T06:04:44.800964+0000","last_active":"2024-09-21T06:04:45.891172+0000","last_peered":"2024-09-21T06:04:45.891172+0000","last_clean":"2024-09-21T06:04:45.891172+0000","last_became_active":"2024-09-21T06:04:44.795832+0000","last_became_peered":"2024-09-21T06:04:44.795832+0000","last_unstale":"2024-09-21T06:04:45.891172+0000","last_undegraded":"2024-09-21T06:04:45.891172+0000","last_fullsized":"2024-09-21T06:04:45.891172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:32.263136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782657+0000","last_change":"2024-09-21T06:04:43.777436+0000","last_active":"2024-09-21T06:04:45.782657+0000","last_peered":"2024-09-21T06:04:45.782657+0000","last_clean":"2024-09-21T06:04:45.782657+0000","last_became_active":"2024-09-21T06:04:43.777182+0000","last_became_peered":"2024-09-21T06:04:43.777182+0000","last_unstale":"2024-09-21T06:04:45.782657+0000","last_undegraded":"2024-09-21T06:04:45.782657+0000","last_fullsized":"2024-09-21T06:04:45.782657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:35.346690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782560+0000","last_change":"2024-09-21T06:04:44.800008+0000","last_active":"2024-09-21T06:04:45.782560+0000","last_peered":"2024-09-21T06:04:45.782560+0000","last_clean":"2024-09-21T06:04:45.782560+0000","last_became_active":"2024-09-21T06:04:44.799693+0000","last_became_peered":"2024-09-21T06:04:44.799693+0000","last_unstale":"2024-09-21T06:04:45.782560+0000","last_undegraded":"2024-09-21T06:04:45.782560+0000","last_fullsized":"2024-09-21T06:04:45.782560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.749039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808706+0000","last_change":"2024-09-21T06:04:43.774015+0000","last_active":"2024-09-21T06:04:45.808706+0000","last_peered":"2024-09-21T06:04:45.808706+0000","last_clean":"2024-09-21T06:04:45.808706+0000","last_became_active":"2024-09-21T06:04:43.773736+0000","last_became_peered":"2024-09-21T06:04:43.773736+0000","last_unstale":"2024-09-21T06:04:45.808706+0000","last_undegraded":"2024-09-21T06:04:45.808706+0000","last_fullsized":"2024-09-21T06:04:45.808706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:36.605349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783015+0000","last_change":"2024-09-21T06:04:44.785183+0000","last_active":"2024-09-21T06:04:45.783015+0000","last_peered":"2024-09-21T06:04:45.783015+0000","last_clean":"2024-09-21T06:04:45.783015+0000","last_became_active":"2024-09-21T06:04:44.784934+0000","last_became_peered":"2024-09-21T06:04:44.784934+0000","last_unstale":"2024-09-21T06:04:45.783015+0000","last_undegraded":"2024-09-21T06:04:45.783015+0000","last_fullsized":"2024-09-21T06:04:45.783015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:02.207775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892425+0000","last_change":"2024-09-21T06:04:43.778587+0000","last_active":"2024-09-21T06:04:45.892425+0000","last_peered":"2024-09-21T06:04:45.892425+0000","last_clean":"2024-09-21T06:04:45.892425+0000","last_became_active":"2024-09-21T06:04:43.777804+0000","last_became_peered":"2024-09-21T06:04:43.777804+0000","last_unstale":"2024-09-21T06:04:45.892425+0000","last_undegraded":"2024-09-21T06:04:45.892425+0000","last_fullsized":"2024-09-21T06:04:45.892425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.168028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891150+0000","last_change":"2024-09-21T06:04:44.803036+0000","last_active":"2024-09-21T06:04:45.891150+0000","last_peered":"2024-09-21T06:04:45.891150+0000","last_clean":"2024-09-21T06:04:45.891150+0000","last_became_active":"2024-09-21T06:04:44.799295+0000","last_became_peered":"2024-09-21T06:04:44.799295+0000","last_unstale":"2024-09-21T06:04:45.891150+0000","last_undegraded":"2024-09-21T06:04:45.891150+0000","last_fullsized":"2024-09-21T06:04:45.891150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:03.371128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782860+0000","last_change":"2024-09-21T06:04:43.776192+0000","last_active":"2024-09-21T06:04:45.782860+0000","last_peered":"2024-09-21T06:04:45.782860+0000","last_clean":"2024-09-21T06:04:45.782860+0000","last_became_active":"2024-09-21T06:04:43.773385+0000","last_became_peered":"2024-09-21T06:04:43.773385+0000","last_unstale":"2024-09-21T06:04:45.782860+0000","last_undegraded":"2024-09-21T06:04:45.782860+0000","last_fullsized":"2024-09-21T06:04:45.782860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:49.333569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783985+0000","last_change":"2024-09-21T06:04:44.802066+0000","last_active":"2024-09-21T06:04:45.783985+0000","last_peered":"2024-09-21T06:04:45.783985+0000","last_clean":"2024-09-21T06:04:45.783985+0000","last_became_active":"2024-09-21T06:04:44.801776+0000","last_became_peered":"2024-09-21T06:04:44.801776+0000","last_unstale":"2024-09-21T06:04:45.783985+0000","last_undegraded":"2024-09-21T06:04:45.783985+0000","last_fullsized":"2024-09-21T06:04:45.783985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:00.842943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892181+0000","last_change":"2024-09-21T06:04:43.781815+0000","last_active":"2024-09-21T06:04:45.892181+0000","last_peered":"2024-09-21T06:04:45.892181+0000","last_clean":"2024-09-21T06:04:45.892181+0000","last_became_active":"2024-09-21T06:04:43.780375+0000","last_became_peered":"2024-09-21T06:04:43.780375+0000","last_unstale":"2024-09-21T06:04:45.892181+0000","last_undegraded":"2024-09-21T06:04:45.892181+0000","last_fullsized":"2024-09-21T06:04:45.892181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:38.140626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781997+0000","last_change":"2024-09-21T06:04:44.788669+0000","last_active":"2024-09-21T06:04:45.781997+0000","last_peered":"2024-09-21T06:04:45.781997+0000","last_clean":"2024-09-21T06:04:45.781997+0000","last_became_active":"2024-09-21T06:04:44.788408+0000","last_became_peered":"2024-09-21T06:04:44.788408+0000","last_unstale":"2024-09-21T06:04:45.781997+0000","last_undegraded":"2024-09-21T06:04:45.781997+0000","last_fullsized":"2024-09-21T06:04:45.781997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:46.833376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784361+0000","last_change":"2024-09-21T06:04:43.783661+0000","last_active":"2024-09-21T06:04:45.784361+0000","last_peered":"2024-09-21T06:04:45.784361+0000","last_clean":"2024-09-21T06:04:45.784361+0000","last_became_active":"2024-09-21T06:04:43.782413+0000","last_became_peered":"2024-09-21T06:04:43.782413+0000","last_unstale":"2024-09-21T06:04:45.784361+0000","last_undegraded":"2024-09-21T06:04:45.784361+0000","last_fullsized":"2024-09-21T06:04:45.784361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.926433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891444+0000","last_change":"2024-09-21T06:04:44.801941+0000","last_active":"2024-09-21T06:04:45.891444+0000","last_peered":"2024-09-21T06:04:45.891444+0000","last_clean":"2024-09-21T06:04:45.891444+0000","last_became_active":"2024-09-21T06:04:44.801322+0000","last_became_peered":"2024-09-21T06:04:44.801322+0000","last_unstale":"2024-09-21T06:04:45.891444+0000","last_undegraded":"2024-09-21T06:04:45.891444+0000","last_fullsized":"2024-09-21T06:04:45.891444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:33.902211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783763+0000","last_change":"2024-09-21T06:04:43.778127+0000","last_active":"2024-09-21T06:04:45.783763+0000","last_peered":"2024-09-21T06:04:45.783763+0000","last_clean":"2024-09-21T06:04:45.783763+0000","last_became_active":"2024-09-21T06:04:43.777711+0000","last_became_peered":"2024-09-21T06:04:43.777711+0000","last_unstale":"2024-09-21T06:04:45.783763+0000","last_undegraded":"2024-09-21T06:04:45.783763+0000","last_fullsized":"2024-09-21T06:04:45.783763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:33.608837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891608+0000","last_change":"2024-09-21T06:04:44.802803+0000","last_active":"2024-09-21T06:04:45.891608+0000","last_peered":"2024-09-21T06:04:45.891608+0000","last_clean":"2024-09-21T06:04:45.891608+0000","last_became_active":"2024-09-21T06:04:44.802531+0000","last_became_peered":"2024-09-21T06:04:44.802531+0000","last_unstale":"2024-09-21T06:04:45.891608+0000","last_undegraded":"2024-09-21T06:04:45.891608+0000","last_fullsized":"2024-09-21T06:04:45.891608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:39.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782127+0000","last_change":"2024-09-21T06:04:43.780162+0000","last_active":"2024-09-21T06:04:45.782127+0000","last_peered":"2024-09-21T06:04:45.782127+0000","last_clean":"2024-09-21T06:04:45.782127+0000","last_became_active":"2024-09-21T06:04:43.779762+0000","last_became_peered":"2024-09-21T06:04:43.779762+0000","last_unstale":"2024-09-21T06:04:45.782127+0000","last_undegraded":"2024-09-21T06:04:45.782127+0000","last_fullsized":"2024-09-21T06:04:45.782127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:18.310921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891877+0000","last_change":"2024-09-21T06:04:44.800492+0000","last_active":"2024-09-21T06:04:45.891877+0000","last_peered":"2024-09-21T06:04:45.891877+0000","last_clean":"2024-09-21T06:04:45.891877+0000","last_became_active":"2024-09-21T06:04:44.799583+0000","last_became_peered":"2024-09-21T06:04:44.799583+0000","last_unstale":"2024-09-21T06:04:45.891877+0000","last_undegraded":"2024-09-21T06:04:45.891877+0000","last_fullsized":"2024-09-21T06:04:45.891877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:00.218900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783719+0000","last_change":"2024-09-21T06:04:43.777876+0000","last_active":"2024-09-21T06:04:45.783719+0000","last_peered":"2024-09-21T06:04:45.783719+0000","last_clean":"2024-09-21T06:04:45.783719+0000","last_became_active":"2024-09-21T06:04:43.777617+0000","last_became_peered":"2024-09-21T06:04:43.777617+0000","last_unstale":"2024-09-21T06:04:45.783719+0000","last_undegraded":"2024-09-21T06:04:45.783719+0000","last_fullsized":"2024-09-21T06:04:45.783719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:35.223135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890025+0000","last_change":"2024-09-21T06:04:44.797597+0000","last_active":"2024-09-21T06:04:45.890025+0000","last_peered":"2024-09-21T06:04:45.890025+0000","last_clean":"2024-09-21T06:04:45.890025+0000","last_became_active":"2024-09-21T06:04:44.797277+0000","last_became_peered":"2024-09-21T06:04:44.797277+0000","last_unstale":"2024-09-21T06:04:45.890025+0000","last_undegraded":"2024-09-21T06:04:45.890025+0000","last_fullsized":"2024-09-21T06:04:45.890025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:07.160212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892277+0000","last_change":"2024-09-21T06:04:43.781519+0000","last_active":"2024-09-21T06:04:45.892277+0000","last_peered":"2024-09-21T06:04:45.892277+0000","last_clean":"2024-09-21T06:04:45.892277+0000","last_became_active":"2024-09-21T06:04:43.779971+0000","last_became_peered":"2024-09-21T06:04:43.779971+0000","last_unstale":"2024-09-21T06:04:45.892277+0000","last_undegraded":"2024-09-21T06:04:45.892277+0000","last_fullsized":"2024-09-21T06:04:45.892277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:24.581723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783186+0000","last_change":"2024-09-21T06:04:44.806750+0000","last_active":"2024-09-21T06:04:45.783186+0000","last_peered":"2024-09-21T06:04:45.783186+0000","last_clean":"2024-09-21T06:04:45.783186+0000","last_became_active":"2024-09-21T06:04:44.806450+0000","last_became_peered":"2024-09-21T06:04:44.806450+0000","last_unstale":"2024-09-21T06:04:45.783186+0000","last_undegraded":"2024-09-21T06:04:45.783186+0000","last_fullsized":"2024-09-21T06:04:45.783186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:18.349678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892206+0000","last_change":"2024-09-21T06:04:43.778671+0000","last_active":"2024-09-21T06:04:45.892206+0000","last_peered":"2024-09-21T06:04:45.892206+0000","last_clean":"2024-09-21T06:04:45.892206+0000","last_became_active":"2024-09-21T06:04:43.778422+0000","last_became_peered":"2024-09-21T06:04:43.778422+0000","last_unstale":"2024-09-21T06:04:45.892206+0000","last_undegraded":"2024-09-21T06:04:45.892206+0000","last_fullsized":"2024-09-21T06:04:45.892206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:12.162784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784001+0000","last_change":"2024-09-21T06:04:44.785437+0000","last_active":"2024-09-21T06:04:45.784001+0000","last_peered":"2024-09-21T06:04:45.784001+0000","last_clean":"2024-09-21T06:04:45.784001+0000","last_became_active":"2024-09-21T06:04:44.785168+0000","last_became_peered":"2024-09-21T06:04:44.785168+0000","last_unstale":"2024-09-21T06:04:45.784001+0000","last_undegraded":"2024-09-21T06:04:45.784001+0000","last_fullsized":"2024-09-21T06:04:45.784001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:11.623483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892140+0000","last_change":"2024-09-21T06:04:43.780289+0000","last_active":"2024-09-21T06:04:45.892140+0000","last_peered":"2024-09-21T06:04:45.892140+0000","last_clean":"2024-09-21T06:04:45.892140+0000","last_became_active":"2024-09-21T06:04:43.779004+0000","last_became_peered":"2024-09-21T06:04:43.779004+0000","last_unstale":"2024-09-21T06:04:45.892140+0000","last_undegraded":"2024-09-21T06:04:45.892140+0000","last_fullsized":"2024-09-21T06:04:45.892140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:04.653901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784605+0000","last_change":"2024-09-21T06:04:44.795267+0000","last_active":"2024-09-21T06:04:45.784605+0000","last_peered":"2024-09-21T06:04:45.784605+0000","last_clean":"2024-09-21T06:04:45.784605+0000","last_became_active":"2024-09-21T06:04:44.794959+0000","last_became_peered":"2024-09-21T06:04:44.794959+0000","last_unstale":"2024-09-21T06:04:45.784605+0000","last_undegraded":"2024-09-21T06:04:45.784605+0000","last_fullsized":"2024-09-21T06:04:45.784605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:29.944176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808906+0000","last_change":"2024-09-21T06:04:43.782623+0000","last_active":"2024-09-21T06:04:45.808906+0000","last_peered":"2024-09-21T06:04:45.808906+0000","last_clean":"2024-09-21T06:04:45.808906+0000","last_became_active":"2024-09-21T06:04:43.782299+0000","last_became_peered":"2024-09-21T06:04:43.782299+0000","last_unstale":"2024-09-21T06:04:45.808906+0000","last_undegraded":"2024-09-21T06:04:45.808906+0000","last_fullsized":"2024-09-21T06:04:45.808906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:37.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784905+0000","last_change":"2024-09-21T06:04:44.789948+0000","last_active":"2024-09-21T06:04:45.784905+0000","last_peered":"2024-09-21T06:04:45.784905+0000","last_clean":"2024-09-21T06:04:45.784905+0000","last_became_active":"2024-09-21T06:04:44.789681+0000","last_became_peered":"2024-09-21T06:04:44.789681+0000","last_unstale":"2024-09-21T06:04:45.784905+0000","last_undegraded":"2024-09-21T06:04:45.784905+0000","last_fullsized":"2024-09-21T06:04:45.784905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:29.729502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889626+0000","last_change":"2024-09-21T06:04:43.782645+0000","last_active":"2024-09-21T06:04:45.889626+0000","last_peered":"2024-09-21T06:04:45.889626+0000","last_clean":"2024-09-21T06:04:45.889626+0000","last_became_active":"2024-09-21T06:04:43.782435+0000","last_became_peered":"2024-09-21T06:04:43.782435+0000","last_unstale":"2024-09-21T06:04:45.889626+0000","last_undegraded":"2024-09-21T06:04:45.889626+0000","last_fullsized":"2024-09-21T06:04:45.889626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:00.381189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784225+0000","last_change":"2024-09-21T06:04:44.789083+0000","last_active":"2024-09-21T06:04:45.784225+0000","last_peered":"2024-09-21T06:04:45.784225+0000","last_clean":"2024-09-21T06:04:45.784225+0000","last_became_active":"2024-09-21T06:04:44.788836+0000","last_became_peered":"2024-09-21T06:04:44.788836+0000","last_unstale":"2024-09-21T06:04:45.784225+0000","last_undegraded":"2024-09-21T06:04:45.784225+0000","last_fullsized":"2024-09-21T06:04:45.784225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:12.584442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892362+0000","last_change":"2024-09-21T06:04:43.782374+0000","last_active":"2024-09-21T06:04:45.892362+0000","last_peered":"2024-09-21T06:04:45.892362+0000","last_clean":"2024-09-21T06:04:45.892362+0000","last_became_active":"2024-09-21T06:04:43.781268+0000","last_became_peered":"2024-09-21T06:04:43.781268+0000","last_unstale":"2024-09-21T06:04:45.892362+0000","last_undegraded":"2024-09-21T06:04:45.892362+0000","last_fullsized":"2024-09-21T06:04:45.892362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:05.662087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890181+0000","last_change":"2024-09-21T06:04:44.790351+0000","last_active":"2024-09-21T06:04:45.890181+0000","last_peered":"2024-09-21T06:04:45.890181+0000","last_clean":"2024-09-21T06:04:45.890181+0000","last_became_active":"2024-09-21T06:04:44.790005+0000","last_became_peered":"2024-09-21T06:04:44.790005+0000","last_unstale":"2024-09-21T06:04:45.890181+0000","last_undegraded":"2024-09-21T06:04:45.890181+0000","last_fullsized":"2024-09-21T06:04:45.890181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:48.368420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890971+0000","last_change":"2024-09-21T06:04:43.777589+0000","last_active":"2024-09-21T06:04:45.890971+0000","last_peered":"2024-09-21T06:04:45.890971+0000","last_clean":"2024-09-21T06:04:45.890971+0000","last_became_active":"2024-09-21T06:04:43.777295+0000","last_became_peered":"2024-09-21T06:04:43.777295+0000","last_unstale":"2024-09-21T06:04:45.890971+0000","last_undegraded":"2024-09-21T06:04:45.890971+0000","last_fullsized":"2024-09-21T06:04:45.890971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.810595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.785040+0000","last_change":"2024-09-21T06:04:44.791495+0000","last_active":"2024-09-21T06:04:45.785040+0000","last_peered":"2024-09-21T06:04:45.785040+0000","last_clean":"2024-09-21T06:04:45.785040+0000","last_became_active":"2024-09-21T06:04:44.791190+0000","last_became_peered":"2024-09-21T06:04:44.791190+0000","last_unstale":"2024-09-21T06:04:45.785040+0000","last_undegraded":"2024-09-21T06:04:45.785040+0000","last_fullsized":"2024-09-21T06:04:45.785040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:13.937332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783355+0000","last_change":"2024-09-21T06:04:43.783527+0000","last_active":"2024-09-21T06:04:45.783355+0000","last_peered":"2024-09-21T06:04:45.783355+0000","last_clean":"2024-09-21T06:04:45.783355+0000","last_became_active":"2024-09-21T06:04:43.781452+0000","last_became_peered":"2024-09-21T06:04:43.781452+0000","last_unstale":"2024-09-21T06:04:45.783355+0000","last_undegraded":"2024-09-21T06:04:45.783355+0000","last_fullsized":"2024-09-21T06:04:45.783355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:35.603774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890852+0000","last_change":"2024-09-21T06:04:44.804270+0000","last_active":"2024-09-21T06:04:45.890852+0000","last_peered":"2024-09-21T06:04:45.890852+0000","last_clean":"2024-09-21T06:04:45.890852+0000","last_became_active":"2024-09-21T06:04:44.803401+0000","last_became_peered":"2024-09-21T06:04:44.803401+0000","last_unstale":"2024-09-21T06:04:45.890852+0000","last_undegraded":"2024-09-21T06:04:45.890852+0000","last_fullsized":"2024-09-21T06:04:45.890852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:55.618574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.809042+0000","last_change":"2024-09-21T06:04:43.780451+0000","last_active":"2024-09-21T06:04:45.809042+0000","last_peered":"2024-09-21T06:04:45.809042+0000","last_clean":"2024-09-21T06:04:45.809042+0000","last_became_active":"2024-09-21T06:04:43.780047+0000","last_became_peered":"2024-09-21T06:04:43.780047+0000","last_unstale":"2024-09-21T06:04:45.809042+0000","last_undegraded":"2024-09-21T06:04:45.809042+0000","last_fullsized":"2024-09-21T06:04:45.809042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:07.506115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808562+0000","last_change":"2024-09-21T06:04:44.801293+0000","last_active":"2024-09-21T06:04:45.808562+0000","last_peered":"2024-09-21T06:04:45.808562+0000","last_clean":"2024-09-21T06:04:45.808562+0000","last_became_active":"2024-09-21T06:04:44.801081+0000","last_became_peered":"2024-09-21T06:04:44.801081+0000","last_unstale":"2024-09-21T06:04:45.808562+0000","last_undegraded":"2024-09-21T06:04:45.808562+0000","last_fullsized":"2024-09-21T06:04:45.808562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:10.401756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784813+0000","last_change":"2024-09-21T06:04:43.778730+0000","last_active":"2024-09-21T06:04:45.784813+0000","last_peered":"2024-09-21T06:04:45.784813+0000","last_clean":"2024-09-21T06:04:45.784813+0000","last_became_active":"2024-09-21T06:04:43.778445+0000","last_became_peered":"2024-09-21T06:04:43.778445+0000","last_unstale":"2024-09-21T06:04:45.784813+0000","last_undegraded":"2024-09-21T06:04:45.784813+0000","last_fullsized":"2024-09-21T06:04:45.784813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:51.142521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891888+0000","last_change":"2024-09-21T06:04:44.791231+0000","last_active":"2024-09-21T06:04:45.891888+0000","last_peered":"2024-09-21T06:04:45.891888+0000","last_clean":"2024-09-21T06:04:45.891888+0000","last_became_active":"2024-09-21T06:04:44.790823+0000","last_became_peered":"2024-09-21T06:04:44.790823+0000","last_unstale":"2024-09-21T06:04:45.891888+0000","last_undegraded":"2024-09-21T06:04:45.891888+0000","last_fullsized":"2024-09-21T06:04:45.891888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:53.609279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808943+0000","last_change":"2024-09-21T06:04:43.773074+0000","last_active":"2024-09-21T06:04:45.808943+0000","last_peered":"2024-09-21T06:04:45.808943+0000","last_clean":"2024-09-21T06:04:45.808943+0000","last_became_active":"2024-09-21T06:04:43.772819+0000","last_became_peered":"2024-09-21T06:04:43.772819+0000","last_unstale":"2024-09-21T06:04:45.808943+0000","last_undegraded":"2024-09-21T06:04:45.808943+0000","last_fullsized":"2024-09-21T06:04:45.808943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:05.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808697+0000","last_change":"2024-09-21T06:04:44.792436+0000","last_active":"2024-09-21T06:04:45.808697+0000","last_peered":"2024-09-21T06:04:45.808697+0000","last_clean":"2024-09-21T06:04:45.808697+0000","last_became_active":"2024-09-21T06:04:44.791792+0000","last_became_peered":"2024-09-21T06:04:44.791792+0000","last_unstale":"2024-09-21T06:04:45.808697+0000","last_undegraded":"2024-09-21T06:04:45.808697+0000","last_fullsized":"2024-09-21T06:04:45.808697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:13.899691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784222+0000","last_change":"2024-09-21T06:04:43.779951+0000","last_active":"2024-09-21T06:04:45.784222+0000","last_peered":"2024-09-21T06:04:45.784222+0000","last_clean":"2024-09-21T06:04:45.784222+0000","last_became_active":"2024-09-21T06:04:43.779700+0000","last_became_peered":"2024-09-21T06:04:43.779700+0000","last_unstale":"2024-09-21T06:04:45.784222+0000","last_undegraded":"2024-09-21T06:04:45.784222+0000","last_fullsized":"2024-09-21T06:04:45.784222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:38.902041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781936+0000","last_change":"2024-09-21T06:04:44.801561+0000","last_active":"2024-09-21T06:04:45.781936+0000","last_peered":"2024-09-21T06:04:45.781936+0000","last_clean":"2024-09-21T06:04:45.781936+0000","last_became_active":"2024-09-21T06:04:44.800906+0000","last_became_peered":"2024-09-21T06:04:44.800906+0000","last_unstale":"2024-09-21T06:04:45.781936+0000","last_undegraded":"2024-09-21T06:04:45.781936+0000","last_fullsized":"2024-09-21T06:04:45.781936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:59.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892127+0000","last_change":"2024-09-21T06:04:43.777628+0000","last_active":"2024-09-21T06:04:45.892127+0000","last_peered":"2024-09-21T06:04:45.892127+0000","last_clean":"2024-09-21T06:04:45.892127+0000","last_became_active":"2024-09-21T06:04:43.777054+0000","last_became_peered":"2024-09-21T06:04:43.777054+0000","last_unstale":"2024-09-21T06:04:45.892127+0000","last_undegraded":"2024-09-21T06:04:45.892127+0000","last_fullsized":"2024-09-21T06:04:45.892127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:41.076366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891665+0000","last_change":"2024-09-21T06:04:44.800126+0000","last_active":"2024-09-21T06:04:45.891665+0000","last_peered":"2024-09-21T06:04:45.891665+0000","last_clean":"2024-09-21T06:04:45.891665+0000","last_became_active":"2024-09-21T06:04:44.799830+0000","last_became_peered":"2024-09-21T06:04:44.799830+0000","last_unstale":"2024-09-21T06:04:45.891665+0000","last_undegraded":"2024-09-21T06:04:45.891665+0000","last_fullsized":"2024-09-21T06:04:45.891665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:00.351515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783169+0000","last_change":"2024-09-21T06:04:43.778056+0000","last_active":"2024-09-21T06:04:45.783169+0000","last_peered":"2024-09-21T06:04:45.783169+0000","last_clean":"2024-09-21T06:04:45.783169+0000","last_became_active":"2024-09-21T06:04:43.777777+0000","last_became_peered":"2024-09-21T06:04:43.777777+0000","last_unstale":"2024-09-21T06:04:45.783169+0000","last_undegraded":"2024-09-21T06:04:45.783169+0000","last_fullsized":"2024-09-21T06:04:45.783169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:41.590364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890454+0000","last_change":"2024-09-21T06:04:44.785071+0000","last_active":"2024-09-21T06:04:45.890454+0000","last_peered":"2024-09-21T06:04:45.890454+0000","last_clean":"2024-09-21T06:04:45.890454+0000","last_became_active":"2024-09-21T06:04:44.784808+0000","last_became_peered":"2024-09-21T06:04:44.784808+0000","last_unstale":"2024-09-21T06:04:45.890454+0000","last_undegraded":"2024-09-21T06:04:45.890454+0000","last_fullsized":"2024-09-21T06:04:45.890454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:59.888200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889771+0000","last_change":"2024-09-21T06:04:43.781399+0000","last_active":"2024-09-21T06:04:45.889771+0000","last_peered":"2024-09-21T06:04:45.889771+0000","last_clean":"2024-09-21T06:04:45.889771+0000","last_became_active":"2024-09-21T06:04:43.781096+0000","last_became_peered":"2024-09-21T06:04:43.781096+0000","last_unstale":"2024-09-21T06:04:45.889771+0000","last_undegraded":"2024-09-21T06:04:45.889771+0000","last_fullsized":"2024-09-21T06:04:45.889771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:40.312251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890052+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:04:45.890052+0000","last_peered":"2024-09-21T06:04:45.890052+0000","last_clean":"2024-09-21T06:04:45.890052+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:04:45.890052+0000","last_undegraded":"2024-09-21T06:04:45.890052+0000","last_fullsized":"2024-09-21T06:04:45.890052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864400,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865418,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865362,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865930,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864400,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:54.198 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:04:54.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.423+0000 7f7e3fe00640 1 -- 172.21.15.118:0/177256709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fef0 msgr2=0x7f7e38142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.423+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/177256709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fef0 0x7f7e38142e40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e30005fd0 tx=0x7f7e3002a820 comp rx=0 tx=0).stop 2024-09-21T06:04:54.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.423+0000 7f7e3fe00640 1 -- 172.21.15.118:0/177256709 shutdown_connections 2024-09-21T06:04:54.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.423+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/177256709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fef0 0x7f7e38142e40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.423+0000 7f7e3fe00640 1 -- 172.21.15.118:0/177256709 >> 172.21.15.118:0/177256709 conn(0x7f7e3806d110 msgr2=0x7f7e3806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:54.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.423+0000 7f7e3fe00640 1 -- 172.21.15.118:0/177256709 shutdown_connections 2024-09-21T06:04:54.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.423+0000 7f7e3fe00640 1 -- 172.21.15.118:0/177256709 wait complete. 2024-09-21T06:04:54.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.425+0000 7f7e3fe00640 1 Processor -- start 2024-09-21T06:04:54.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.426+0000 7f7e3fe00640 1 -- start start 2024-09-21T06:04:54.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fae0 0x7f7e3815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e3813fef0 0x7f7e380b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e380b51d0 0x7f7e3815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7e381682e0 con 0x7f7e3813fae0 2024-09-21T06:04:54.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38168160 con 0x7f7e3813fef0 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e38168460 con 0x7f7e380b51d0 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fae0 0x7f7e3815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fae0 0x7f7e3815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59744/0 (socket says 172.21.15.118:59744) 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.427+0000 7f7e3d400640 1 -- 172.21.15.118:0/4063698473 learned_addr learned my addr 172.21.15.118:0/4063698473 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3d400640 1 -- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e380b51d0 msgr2=0x7f7e3815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3d400640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e380b51d0 0x7f7e3815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3d400640 1 -- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e3813fef0 msgr2=0x7f7e380b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3d400640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e3813fef0 0x7f7e380b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3d400640 1 -- 172.21.15.118:0/4063698473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e38139d60 con 0x7f7e3813fae0 2024-09-21T06:04:54.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3d400640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fae0 0x7f7e3815ca40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00b3f0 tx=0x7f7e2c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:54.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e35600640 1 -- 172.21.15.118:0/4063698473 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c015020 con 0x7f7e3813fae0 2024-09-21T06:04:54.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e35600640 1 -- 172.21.15.118:0/4063698473 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e2c011920 con 0x7f7e3813fae0 2024-09-21T06:04:54.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e35600640 1 -- 172.21.15.118:0/4063698473 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c011d70 con 0x7f7e3813fae0 2024-09-21T06:04:54.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3813a040 con 0x7f7e3813fae0 2024-09-21T06:04:54.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.428+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3813bcf0 con 0x7f7e3813fae0 2024-09-21T06:04:54.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.429+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e380d0e80 con 0x7f7e3813fae0 2024-09-21T06:04:54.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.431+0000 7f7e35600640 1 -- 172.21.15.118:0/4063698473 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e2c018020 con 0x7f7e3813fae0 2024-09-21T06:04:54.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.431+0000 7f7e35600640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e18078b90 0x7f7e1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.432+0000 7f7e35600640 1 -- 172.21.15.118:0/4063698473 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2c09aa90 con 0x7f7e3813fae0 2024-09-21T06:04:54.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.432+0000 7f7e3ca00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e18078b90 0x7f7e1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:54.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.433+0000 7f7e3ca00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e18078b90 0x7f7e1807b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7e24007fd0 tx=0x7f7e24007900 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:54.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.436+0000 7f7e35600640 1 -- 172.21.15.118:0/4063698473 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7e2c01f030 con 0x7f7e3813fae0 2024-09-21T06:04:54.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.619+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e38157ac0 con 0x7f7e18078b90 2024-09-21T06:04:54.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.624+0000 7f7e35600640 1 -- 172.21.15.118:0/4063698473 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247480 (secure 0 0 0) 0x7f7e38157ac0 con 0x7f7e18078b90 2024-09-21T06:04:54.629 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:54.630 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e18078b90 msgr2=0x7f7e1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e18078b90 0x7f7e1807b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7e24007fd0 tx=0x7f7e24007900 comp rx=0 tx=0).stop 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fae0 msgr2=0x7f7e3815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fae0 0x7f7e3815ca40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00b3f0 tx=0x7f7e2c00b8b0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 shutdown_connections 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e18078b90 0x7f7e1807b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e380b51d0 0x7f7e3815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e3813fef0 0x7f7e380b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 --2- 172.21.15.118:0/4063698473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e3813fae0 0x7f7e3815ca40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 >> 172.21.15.118:0/4063698473 conn(0x7f7e3806d110 msgr2=0x7f7e38142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 shutdown_connections 2024-09-21T06:04:54.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.628+0000 7f7e3fe00640 1 -- 172.21.15.118:0/4063698473 wait complete. 2024-09-21T06:04:54.654 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-21T06:04:54.470846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560295,"statfs":{"total":1600000000,"available":1597742716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.690222"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891711+0000","last_change":"2024-09-21T06:04:44.803485+0000","last_active":"2024-09-21T06:04:45.891711+0000","last_peered":"2024-09-21T06:04:45.891711+0000","last_clean":"2024-09-21T06:04:45.891711+0000","last_became_active":"2024-09-21T06:04:44.803195+0000","last_became_peered":"2024-09-21T06:04:44.803195+0000","last_unstale":"2024-09-21T06:04:45.891711+0000","last_undegraded":"2024-09-21T06:04:45.891711+0000","last_fullsized":"2024-09-21T06:04:45.891711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:28.415244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781930+0000","last_change":"2024-09-21T06:04:44.789175+0000","last_active":"2024-09-21T06:04:45.781930+0000","last_peered":"2024-09-21T06:04:45.781930+0000","last_clean":"2024-09-21T06:04:45.781930+0000","last_became_active":"2024-09-21T06:04:44.788833+0000","last_became_peered":"2024-09-21T06:04:44.788833+0000","last_unstale":"2024-09-21T06:04:45.781930+0000","last_undegraded":"2024-09-21T06:04:45.781930+0000","last_fullsized":"2024-09-21T06:04:45.781930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:14.880036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892229+0000","last_change":"2024-09-21T06:04:44.796745+0000","last_active":"2024-09-21T06:04:45.892229+0000","last_peered":"2024-09-21T06:04:45.892229+0000","last_clean":"2024-09-21T06:04:45.892229+0000","last_became_active":"2024-09-21T06:04:44.796475+0000","last_became_peered":"2024-09-21T06:04:44.796475+0000","last_unstale":"2024-09-21T06:04:45.892229+0000","last_undegraded":"2024-09-21T06:04:45.892229+0000","last_fullsized":"2024-09-21T06:04:45.892229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:02.360665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783191+0000","last_change":"2024-09-21T06:04:44.800722+0000","last_active":"2024-09-21T06:04:45.783191+0000","last_peered":"2024-09-21T06:04:45.783191+0000","last_clean":"2024-09-21T06:04:45.783191+0000","last_became_active":"2024-09-21T06:04:44.799790+0000","last_became_peered":"2024-09-21T06:04:44.799790+0000","last_unstale":"2024-09-21T06:04:45.783191+0000","last_undegraded":"2024-09-21T06:04:45.783191+0000","last_fullsized":"2024-09-21T06:04:45.783191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:42.500811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784601+0000","last_change":"2024-09-21T06:04:44.784847+0000","last_active":"2024-09-21T06:04:45.784601+0000","last_peered":"2024-09-21T06:04:45.784601+0000","last_clean":"2024-09-21T06:04:45.784601+0000","last_became_active":"2024-09-21T06:04:44.784593+0000","last_became_peered":"2024-09-21T06:04:44.784593+0000","last_unstale":"2024-09-21T06:04:45.784601+0000","last_undegraded":"2024-09-21T06:04:45.784601+0000","last_fullsized":"2024-09-21T06:04:45.784601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:09.435714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782004+0000","last_change":"2024-09-21T06:04:44.794679+0000","last_active":"2024-09-21T06:04:45.782004+0000","last_peered":"2024-09-21T06:04:45.782004+0000","last_clean":"2024-09-21T06:04:45.782004+0000","last_became_active":"2024-09-21T06:04:44.794390+0000","last_became_peered":"2024-09-21T06:04:44.794390+0000","last_unstale":"2024-09-21T06:04:45.782004+0000","last_undegraded":"2024-09-21T06:04:45.782004+0000","last_fullsized":"2024-09-21T06:04:45.782004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:46.270777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891794+0000","last_change":"2024-09-21T06:04:44.795208+0000","last_active":"2024-09-21T06:04:45.891794+0000","last_peered":"2024-09-21T06:04:45.891794+0000","last_clean":"2024-09-21T06:04:45.891794+0000","last_became_active":"2024-09-21T06:04:44.794629+0000","last_became_peered":"2024-09-21T06:04:44.794629+0000","last_unstale":"2024-09-21T06:04:45.891794+0000","last_undegraded":"2024-09-21T06:04:45.891794+0000","last_fullsized":"2024-09-21T06:04:45.891794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:55.430329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890840+0000","last_change":"2024-09-21T06:04:44.787154+0000","last_active":"2024-09-21T06:04:45.890840+0000","last_peered":"2024-09-21T06:04:45.890840+0000","last_clean":"2024-09-21T06:04:45.890840+0000","last_became_active":"2024-09-21T06:04:44.785584+0000","last_became_peered":"2024-09-21T06:04:44.785584+0000","last_unstale":"2024-09-21T06:04:45.890840+0000","last_undegraded":"2024-09-21T06:04:45.890840+0000","last_fullsized":"2024-09-21T06:04:45.890840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:16.273528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890057+0000","last_change":"2024-09-21T06:04:44.802546+0000","last_active":"2024-09-21T06:04:45.890057+0000","last_peered":"2024-09-21T06:04:45.890057+0000","last_clean":"2024-09-21T06:04:45.890057+0000","last_became_active":"2024-09-21T06:04:44.802183+0000","last_became_peered":"2024-09-21T06:04:44.802183+0000","last_unstale":"2024-09-21T06:04:45.890057+0000","last_undegraded":"2024-09-21T06:04:45.890057+0000","last_fullsized":"2024-09-21T06:04:45.890057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:21.937804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784515+0000","last_change":"2024-09-21T06:04:44.794323+0000","last_active":"2024-09-21T06:04:45.784515+0000","last_peered":"2024-09-21T06:04:45.784515+0000","last_clean":"2024-09-21T06:04:45.784515+0000","last_became_active":"2024-09-21T06:04:44.794050+0000","last_became_peered":"2024-09-21T06:04:44.794050+0000","last_unstale":"2024-09-21T06:04:45.784515+0000","last_undegraded":"2024-09-21T06:04:45.784515+0000","last_fullsized":"2024-09-21T06:04:45.784515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:48.044394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890537+0000","last_change":"2024-09-21T06:04:44.802173+0000","last_active":"2024-09-21T06:04:45.890537+0000","last_peered":"2024-09-21T06:04:45.890537+0000","last_clean":"2024-09-21T06:04:45.890537+0000","last_became_active":"2024-09-21T06:04:44.801901+0000","last_became_peered":"2024-09-21T06:04:44.801901+0000","last_unstale":"2024-09-21T06:04:45.890537+0000","last_undegraded":"2024-09-21T06:04:45.890537+0000","last_fullsized":"2024-09-21T06:04:45.890537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:55.492340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890360+0000","last_change":"2024-09-21T06:04:44.804585+0000","last_active":"2024-09-21T06:04:45.890360+0000","last_peered":"2024-09-21T06:04:45.890360+0000","last_clean":"2024-09-21T06:04:45.890360+0000","last_became_active":"2024-09-21T06:04:44.803994+0000","last_became_peered":"2024-09-21T06:04:44.803994+0000","last_unstale":"2024-09-21T06:04:45.890360+0000","last_undegraded":"2024-09-21T06:04:45.890360+0000","last_fullsized":"2024-09-21T06:04:45.890360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:36.563401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784683+0000","last_change":"2024-09-21T06:04:44.794786+0000","last_active":"2024-09-21T06:04:45.784683+0000","last_peered":"2024-09-21T06:04:45.784683+0000","last_clean":"2024-09-21T06:04:45.784683+0000","last_became_active":"2024-09-21T06:04:44.794148+0000","last_became_peered":"2024-09-21T06:04:44.794148+0000","last_unstale":"2024-09-21T06:04:45.784683+0000","last_undegraded":"2024-09-21T06:04:45.784683+0000","last_fullsized":"2024-09-21T06:04:45.784683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:04.674778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782584+0000","last_change":"2024-09-21T06:04:44.784324+0000","last_active":"2024-09-21T06:04:45.782584+0000","last_peered":"2024-09-21T06:04:45.782584+0000","last_clean":"2024-09-21T06:04:45.782584+0000","last_became_active":"2024-09-21T06:04:44.783909+0000","last_became_peered":"2024-09-21T06:04:44.783909+0000","last_unstale":"2024-09-21T06:04:45.782584+0000","last_undegraded":"2024-09-21T06:04:45.782584+0000","last_fullsized":"2024-09-21T06:04:45.782584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:19.078916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891135+0000","last_change":"2024-09-21T06:04:44.802203+0000","last_active":"2024-09-21T06:04:45.891135+0000","last_peered":"2024-09-21T06:04:45.891135+0000","last_clean":"2024-09-21T06:04:45.891135+0000","last_became_active":"2024-09-21T06:04:44.797138+0000","last_became_peered":"2024-09-21T06:04:44.797138+0000","last_unstale":"2024-09-21T06:04:45.891135+0000","last_undegraded":"2024-09-21T06:04:45.891135+0000","last_fullsized":"2024-09-21T06:04:45.891135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.953514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890780+0000","last_change":"2024-09-21T06:04:44.790182+0000","last_active":"2024-09-21T06:04:45.890780+0000","last_peered":"2024-09-21T06:04:45.890780+0000","last_clean":"2024-09-21T06:04:45.890780+0000","last_became_active":"2024-09-21T06:04:44.789772+0000","last_became_peered":"2024-09-21T06:04:44.789772+0000","last_unstale":"2024-09-21T06:04:45.890780+0000","last_undegraded":"2024-09-21T06:04:45.890780+0000","last_fullsized":"2024-09-21T06:04:45.890780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:24.193410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889753+0000","last_change":"2024-09-21T06:04:44.794888+0000","last_active":"2024-09-21T06:04:45.889753+0000","last_peered":"2024-09-21T06:04:45.889753+0000","last_clean":"2024-09-21T06:04:45.889753+0000","last_became_active":"2024-09-21T06:04:44.794175+0000","last_became_peered":"2024-09-21T06:04:44.794175+0000","last_unstale":"2024-09-21T06:04:45.889753+0000","last_undegraded":"2024-09-21T06:04:45.889753+0000","last_fullsized":"2024-09-21T06:04:45.889753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:34.039623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781857+0000","last_change":"2024-09-21T06:04:44.794968+0000","last_active":"2024-09-21T06:04:45.781857+0000","last_peered":"2024-09-21T06:04:45.781857+0000","last_clean":"2024-09-21T06:04:45.781857+0000","last_became_active":"2024-09-21T06:04:44.793534+0000","last_became_peered":"2024-09-21T06:04:44.793534+0000","last_unstale":"2024-09-21T06:04:45.781857+0000","last_undegraded":"2024-09-21T06:04:45.781857+0000","last_fullsized":"2024-09-21T06:04:45.781857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:14.296283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781688+0000","last_change":"2024-09-21T06:04:44.801878+0000","last_active":"2024-09-21T06:04:45.781688+0000","last_peered":"2024-09-21T06:04:45.781688+0000","last_clean":"2024-09-21T06:04:45.781688+0000","last_became_active":"2024-09-21T06:04:44.801289+0000","last_became_peered":"2024-09-21T06:04:44.801289+0000","last_unstale":"2024-09-21T06:04:45.781688+0000","last_undegraded":"2024-09-21T06:04:45.781688+0000","last_fullsized":"2024-09-21T06:04:45.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:31.602243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784827+0000","last_change":"2024-09-21T06:04:44.795438+0000","last_active":"2024-09-21T06:04:45.784827+0000","last_peered":"2024-09-21T06:04:45.784827+0000","last_clean":"2024-09-21T06:04:45.784827+0000","last_became_active":"2024-09-21T06:04:44.795179+0000","last_became_peered":"2024-09-21T06:04:44.795179+0000","last_unstale":"2024-09-21T06:04:45.784827+0000","last_undegraded":"2024-09-21T06:04:45.784827+0000","last_fullsized":"2024-09-21T06:04:45.784827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:40.589122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891724+0000","last_change":"2024-09-21T06:04:44.799598+0000","last_active":"2024-09-21T06:04:45.891724+0000","last_peered":"2024-09-21T06:04:45.891724+0000","last_clean":"2024-09-21T06:04:45.891724+0000","last_became_active":"2024-09-21T06:04:44.798977+0000","last_became_peered":"2024-09-21T06:04:44.798977+0000","last_unstale":"2024-09-21T06:04:45.891724+0000","last_undegraded":"2024-09-21T06:04:45.891724+0000","last_fullsized":"2024-09-21T06:04:45.891724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.796651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891779+0000","last_change":"2024-09-21T06:04:44.805235+0000","last_active":"2024-09-21T06:04:45.891779+0000","last_peered":"2024-09-21T06:04:45.891779+0000","last_clean":"2024-09-21T06:04:45.891779+0000","last_became_active":"2024-09-21T06:04:44.804618+0000","last_became_peered":"2024-09-21T06:04:44.804618+0000","last_unstale":"2024-09-21T06:04:45.891779+0000","last_undegraded":"2024-09-21T06:04:45.891779+0000","last_fullsized":"2024-09-21T06:04:45.891779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:17.218513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808750+0000","last_change":"2024-09-21T06:04:44.792814+0000","last_active":"2024-09-21T06:04:45.808750+0000","last_peered":"2024-09-21T06:04:45.808750+0000","last_clean":"2024-09-21T06:04:45.808750+0000","last_became_active":"2024-09-21T06:04:44.792399+0000","last_became_peered":"2024-09-21T06:04:44.792399+0000","last_unstale":"2024-09-21T06:04:45.808750+0000","last_undegraded":"2024-09-21T06:04:45.808750+0000","last_fullsized":"2024-09-21T06:04:45.808750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:50.873350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889791+0000","last_change":"2024-09-21T06:04:44.791550+0000","last_active":"2024-09-21T06:04:45.889791+0000","last_peered":"2024-09-21T06:04:45.889791+0000","last_clean":"2024-09-21T06:04:45.889791+0000","last_became_active":"2024-09-21T06:04:44.791253+0000","last_became_peered":"2024-09-21T06:04:44.791253+0000","last_unstale":"2024-09-21T06:04:45.889791+0000","last_undegraded":"2024-09-21T06:04:45.889791+0000","last_fullsized":"2024-09-21T06:04:45.889791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:03.570783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784060+0000","last_change":"2024-09-21T06:04:44.798792+0000","last_active":"2024-09-21T06:04:45.784060+0000","last_peered":"2024-09-21T06:04:45.784060+0000","last_clean":"2024-09-21T06:04:45.784060+0000","last_became_active":"2024-09-21T06:04:44.798613+0000","last_became_peered":"2024-09-21T06:04:44.798613+0000","last_unstale":"2024-09-21T06:04:45.784060+0000","last_undegraded":"2024-09-21T06:04:45.784060+0000","last_fullsized":"2024-09-21T06:04:45.784060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:29.183926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782348+0000","last_change":"2024-09-21T06:04:44.786220+0000","last_active":"2024-09-21T06:04:45.782348+0000","last_peered":"2024-09-21T06:04:45.782348+0000","last_clean":"2024-09-21T06:04:45.782348+0000","last_became_active":"2024-09-21T06:04:44.785908+0000","last_became_peered":"2024-09-21T06:04:44.785908+0000","last_unstale":"2024-09-21T06:04:45.782348+0000","last_undegraded":"2024-09-21T06:04:45.782348+0000","last_fullsized":"2024-09-21T06:04:45.782348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:32.210837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784060+0000","last_change":"2024-09-21T06:04:44.805942+0000","last_active":"2024-09-21T06:04:45.784060+0000","last_peered":"2024-09-21T06:04:45.784060+0000","last_clean":"2024-09-21T06:04:45.784060+0000","last_became_active":"2024-09-21T06:04:44.805645+0000","last_became_peered":"2024-09-21T06:04:44.805645+0000","last_unstale":"2024-09-21T06:04:45.784060+0000","last_undegraded":"2024-09-21T06:04:45.784060+0000","last_fullsized":"2024-09-21T06:04:45.784060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:16.407530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890797+0000","last_change":"2024-09-21T06:04:44.796051+0000","last_active":"2024-09-21T06:04:45.890797+0000","last_peered":"2024-09-21T06:04:45.890797+0000","last_clean":"2024-09-21T06:04:45.890797+0000","last_became_active":"2024-09-21T06:04:44.794568+0000","last_became_peered":"2024-09-21T06:04:44.794568+0000","last_unstale":"2024-09-21T06:04:45.890797+0000","last_undegraded":"2024-09-21T06:04:45.890797+0000","last_fullsized":"2024-09-21T06:04:45.890797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:08.898566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890306+0000","last_change":"2024-09-21T06:04:44.796966+0000","last_active":"2024-09-21T06:04:45.890306+0000","last_peered":"2024-09-21T06:04:45.890306+0000","last_clean":"2024-09-21T06:04:45.890306+0000","last_became_active":"2024-09-21T06:04:44.796556+0000","last_became_peered":"2024-09-21T06:04:44.796556+0000","last_unstale":"2024-09-21T06:04:45.890306+0000","last_undegraded":"2024-09-21T06:04:45.890306+0000","last_fullsized":"2024-09-21T06:04:45.890306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:19.403973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889914+0000","last_change":"2024-09-21T06:04:44.797177+0000","last_active":"2024-09-21T06:04:45.889914+0000","last_peered":"2024-09-21T06:04:45.889914+0000","last_clean":"2024-09-21T06:04:45.889914+0000","last_became_active":"2024-09-21T06:04:44.796360+0000","last_became_peered":"2024-09-21T06:04:44.796360+0000","last_unstale":"2024-09-21T06:04:45.889914+0000","last_undegraded":"2024-09-21T06:04:45.889914+0000","last_fullsized":"2024-09-21T06:04:45.889914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:18.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892430+0000","last_change":"2024-09-21T06:04:44.793158+0000","last_active":"2024-09-21T06:04:45.892430+0000","last_peered":"2024-09-21T06:04:45.892430+0000","last_clean":"2024-09-21T06:04:45.892430+0000","last_became_active":"2024-09-21T06:04:44.792875+0000","last_became_peered":"2024-09-21T06:04:44.792875+0000","last_unstale":"2024-09-21T06:04:45.892430+0000","last_undegraded":"2024-09-21T06:04:45.892430+0000","last_fullsized":"2024-09-21T06:04:45.892430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:55.177878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890013+0000","last_change":"2024-09-21T06:04:44.801109+0000","last_active":"2024-09-21T06:04:45.890013+0000","last_peered":"2024-09-21T06:04:45.890013+0000","last_clean":"2024-09-21T06:04:45.890013+0000","last_became_active":"2024-09-21T06:04:44.800834+0000","last_became_peered":"2024-09-21T06:04:44.800834+0000","last_unstale":"2024-09-21T06:04:45.890013+0000","last_undegraded":"2024-09-21T06:04:45.890013+0000","last_fullsized":"2024-09-21T06:04:45.890013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:21.472427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808798+0000","last_change":"2024-09-21T06:04:44.790611+0000","last_active":"2024-09-21T06:04:45.808798+0000","last_peered":"2024-09-21T06:04:45.808798+0000","last_clean":"2024-09-21T06:04:45.808798+0000","last_became_active":"2024-09-21T06:04:44.790355+0000","last_became_peered":"2024-09-21T06:04:44.790355+0000","last_unstale":"2024-09-21T06:04:45.808798+0000","last_undegraded":"2024-09-21T06:04:45.808798+0000","last_fullsized":"2024-09-21T06:04:45.808798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:28.670542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890450+0000","last_change":"2024-09-21T06:04:43.779849+0000","last_active":"2024-09-21T06:04:45.890450+0000","last_peered":"2024-09-21T06:04:45.890450+0000","last_clean":"2024-09-21T06:04:45.890450+0000","last_became_active":"2024-09-21T06:04:43.779516+0000","last_became_peered":"2024-09-21T06:04:43.779516+0000","last_unstale":"2024-09-21T06:04:45.890450+0000","last_undegraded":"2024-09-21T06:04:45.890450+0000","last_fullsized":"2024-09-21T06:04:45.890450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:42.525771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890262+0000","last_change":"2024-09-21T06:04:44.804649+0000","last_active":"2024-09-21T06:04:45.890262+0000","last_peered":"2024-09-21T06:04:45.890262+0000","last_clean":"2024-09-21T06:04:45.890262+0000","last_became_active":"2024-09-21T06:04:44.804395+0000","last_became_peered":"2024-09-21T06:04:44.804395+0000","last_unstale":"2024-09-21T06:04:45.890262+0000","last_undegraded":"2024-09-21T06:04:45.890262+0000","last_fullsized":"2024-09-21T06:04:45.890262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:34.445445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808704+0000","last_change":"2024-09-21T06:04:43.776190+0000","last_active":"2024-09-21T06:04:45.808704+0000","last_peered":"2024-09-21T06:04:45.808704+0000","last_clean":"2024-09-21T06:04:45.808704+0000","last_became_active":"2024-09-21T06:04:43.775927+0000","last_became_peered":"2024-09-21T06:04:43.775927+0000","last_unstale":"2024-09-21T06:04:45.808704+0000","last_undegraded":"2024-09-21T06:04:45.808704+0000","last_fullsized":"2024-09-21T06:04:45.808704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:40.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891993+0000","last_change":"2024-09-21T06:04:44.799273+0000","last_active":"2024-09-21T06:04:45.891993+0000","last_peered":"2024-09-21T06:04:45.891993+0000","last_clean":"2024-09-21T06:04:45.891993+0000","last_became_active":"2024-09-21T06:04:44.798587+0000","last_became_peered":"2024-09-21T06:04:44.798587+0000","last_unstale":"2024-09-21T06:04:45.891993+0000","last_undegraded":"2024-09-21T06:04:45.891993+0000","last_fullsized":"2024-09-21T06:04:45.891993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:03.680255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782342+0000","last_change":"2024-09-21T06:04:43.779823+0000","last_active":"2024-09-21T06:04:45.782342+0000","last_peered":"2024-09-21T06:04:45.782342+0000","last_clean":"2024-09-21T06:04:45.782342+0000","last_became_active":"2024-09-21T06:04:43.779575+0000","last_became_peered":"2024-09-21T06:04:43.779575+0000","last_unstale":"2024-09-21T06:04:45.782342+0000","last_undegraded":"2024-09-21T06:04:45.782342+0000","last_fullsized":"2024-09-21T06:04:45.782342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.357444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784284+0000","last_change":"2024-09-21T06:04:44.797443+0000","last_active":"2024-09-21T06:04:45.784284+0000","last_peered":"2024-09-21T06:04:45.784284+0000","last_clean":"2024-09-21T06:04:45.784284+0000","last_became_active":"2024-09-21T06:04:44.797237+0000","last_became_peered":"2024-09-21T06:04:44.797237+0000","last_unstale":"2024-09-21T06:04:45.784284+0000","last_undegraded":"2024-09-21T06:04:45.784284+0000","last_fullsized":"2024-09-21T06:04:45.784284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:31.598945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784381+0000","last_change":"2024-09-21T06:04:43.779019+0000","last_active":"2024-09-21T06:04:45.784381+0000","last_peered":"2024-09-21T06:04:45.784381+0000","last_clean":"2024-09-21T06:04:45.784381+0000","last_became_active":"2024-09-21T06:04:43.778771+0000","last_became_peered":"2024-09-21T06:04:43.778771+0000","last_unstale":"2024-09-21T06:04:45.784381+0000","last_undegraded":"2024-09-21T06:04:45.784381+0000","last_fullsized":"2024-09-21T06:04:45.784381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.601619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891169+0000","last_change":"2024-09-21T06:04:44.801616+0000","last_active":"2024-09-21T06:04:45.891169+0000","last_peered":"2024-09-21T06:04:45.891169+0000","last_clean":"2024-09-21T06:04:45.891169+0000","last_became_active":"2024-09-21T06:04:44.800886+0000","last_became_peered":"2024-09-21T06:04:44.800886+0000","last_unstale":"2024-09-21T06:04:45.891169+0000","last_undegraded":"2024-09-21T06:04:45.891169+0000","last_fullsized":"2024-09-21T06:04:45.891169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:33.383758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891507+0000","last_change":"2024-09-21T06:04:43.780697+0000","last_active":"2024-09-21T06:04:45.891507+0000","last_peered":"2024-09-21T06:04:45.891507+0000","last_clean":"2024-09-21T06:04:45.891507+0000","last_became_active":"2024-09-21T06:04:43.779269+0000","last_became_peered":"2024-09-21T06:04:43.779269+0000","last_unstale":"2024-09-21T06:04:45.891507+0000","last_undegraded":"2024-09-21T06:04:45.891507+0000","last_fullsized":"2024-09-21T06:04:45.891507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:52.371562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890589+0000","last_change":"2024-09-21T06:04:44.803645+0000","last_active":"2024-09-21T06:04:45.890589+0000","last_peered":"2024-09-21T06:04:45.890589+0000","last_clean":"2024-09-21T06:04:45.890589+0000","last_became_active":"2024-09-21T06:04:44.800665+0000","last_became_peered":"2024-09-21T06:04:44.800665+0000","last_unstale":"2024-09-21T06:04:45.890589+0000","last_undegraded":"2024-09-21T06:04:45.890589+0000","last_fullsized":"2024-09-21T06:04:45.890589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:25.472376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891871+0000","last_change":"2024-09-21T06:04:43.777908+0000","last_active":"2024-09-21T06:04:45.891871+0000","last_peered":"2024-09-21T06:04:45.891871+0000","last_clean":"2024-09-21T06:04:45.891871+0000","last_became_active":"2024-09-21T06:04:43.777364+0000","last_became_peered":"2024-09-21T06:04:43.777364+0000","last_unstale":"2024-09-21T06:04:45.891871+0000","last_undegraded":"2024-09-21T06:04:45.891871+0000","last_fullsized":"2024-09-21T06:04:45.891871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:59.148778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891461+0000","last_change":"2024-09-21T06:04:44.795317+0000","last_active":"2024-09-21T06:04:45.891461+0000","last_peered":"2024-09-21T06:04:45.891461+0000","last_clean":"2024-09-21T06:04:45.891461+0000","last_became_active":"2024-09-21T06:04:44.794966+0000","last_became_peered":"2024-09-21T06:04:44.794966+0000","last_unstale":"2024-09-21T06:04:45.891461+0000","last_undegraded":"2024-09-21T06:04:45.891461+0000","last_fullsized":"2024-09-21T06:04:45.891461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:15.638123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782754+0000","last_change":"2024-09-21T06:04:43.769051+0000","last_active":"2024-09-21T06:04:45.782754+0000","last_peered":"2024-09-21T06:04:45.782754+0000","last_clean":"2024-09-21T06:04:45.782754+0000","last_became_active":"2024-09-21T06:04:43.768049+0000","last_became_peered":"2024-09-21T06:04:43.768049+0000","last_unstale":"2024-09-21T06:04:45.782754+0000","last_undegraded":"2024-09-21T06:04:45.782754+0000","last_fullsized":"2024-09-21T06:04:45.782754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:55.024560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783421+0000","last_change":"2024-09-21T06:04:44.801065+0000","last_active":"2024-09-21T06:04:45.783421+0000","last_peered":"2024-09-21T06:04:45.783421+0000","last_clean":"2024-09-21T06:04:45.783421+0000","last_became_active":"2024-09-21T06:04:44.800113+0000","last_became_peered":"2024-09-21T06:04:44.800113+0000","last_unstale":"2024-09-21T06:04:45.783421+0000","last_undegraded":"2024-09-21T06:04:45.783421+0000","last_fullsized":"2024-09-21T06:04:45.783421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:35.349849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892062+0000","last_change":"2024-09-21T06:04:43.782072+0000","last_active":"2024-09-21T06:04:45.892062+0000","last_peered":"2024-09-21T06:04:45.892062+0000","last_clean":"2024-09-21T06:04:45.892062+0000","last_became_active":"2024-09-21T06:04:43.780898+0000","last_became_peered":"2024-09-21T06:04:43.780898+0000","last_unstale":"2024-09-21T06:04:45.892062+0000","last_undegraded":"2024-09-21T06:04:45.892062+0000","last_fullsized":"2024-09-21T06:04:45.892062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:42.087630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891172+0000","last_change":"2024-09-21T06:04:44.800964+0000","last_active":"2024-09-21T06:04:45.891172+0000","last_peered":"2024-09-21T06:04:45.891172+0000","last_clean":"2024-09-21T06:04:45.891172+0000","last_became_active":"2024-09-21T06:04:44.795832+0000","last_became_peered":"2024-09-21T06:04:44.795832+0000","last_unstale":"2024-09-21T06:04:45.891172+0000","last_undegraded":"2024-09-21T06:04:45.891172+0000","last_fullsized":"2024-09-21T06:04:45.891172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:32.263136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782657+0000","last_change":"2024-09-21T06:04:43.777436+0000","last_active":"2024-09-21T06:04:45.782657+0000","last_peered":"2024-09-21T06:04:45.782657+0000","last_clean":"2024-09-21T06:04:45.782657+0000","last_became_active":"2024-09-21T06:04:43.777182+0000","last_became_peered":"2024-09-21T06:04:43.777182+0000","last_unstale":"2024-09-21T06:04:45.782657+0000","last_undegraded":"2024-09-21T06:04:45.782657+0000","last_fullsized":"2024-09-21T06:04:45.782657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:35.346690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782560+0000","last_change":"2024-09-21T06:04:44.800008+0000","last_active":"2024-09-21T06:04:45.782560+0000","last_peered":"2024-09-21T06:04:45.782560+0000","last_clean":"2024-09-21T06:04:45.782560+0000","last_became_active":"2024-09-21T06:04:44.799693+0000","last_became_peered":"2024-09-21T06:04:44.799693+0000","last_unstale":"2024-09-21T06:04:45.782560+0000","last_undegraded":"2024-09-21T06:04:45.782560+0000","last_fullsized":"2024-09-21T06:04:45.782560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.749039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808706+0000","last_change":"2024-09-21T06:04:43.774015+0000","last_active":"2024-09-21T06:04:45.808706+0000","last_peered":"2024-09-21T06:04:45.808706+0000","last_clean":"2024-09-21T06:04:45.808706+0000","last_became_active":"2024-09-21T06:04:43.773736+0000","last_became_peered":"2024-09-21T06:04:43.773736+0000","last_unstale":"2024-09-21T06:04:45.808706+0000","last_undegraded":"2024-09-21T06:04:45.808706+0000","last_fullsized":"2024-09-21T06:04:45.808706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:36.605349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783015+0000","last_change":"2024-09-21T06:04:44.785183+0000","last_active":"2024-09-21T06:04:45.783015+0000","last_peered":"2024-09-21T06:04:45.783015+0000","last_clean":"2024-09-21T06:04:45.783015+0000","last_became_active":"2024-09-21T06:04:44.784934+0000","last_became_peered":"2024-09-21T06:04:44.784934+0000","last_unstale":"2024-09-21T06:04:45.783015+0000","last_undegraded":"2024-09-21T06:04:45.783015+0000","last_fullsized":"2024-09-21T06:04:45.783015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:02.207775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892425+0000","last_change":"2024-09-21T06:04:43.778587+0000","last_active":"2024-09-21T06:04:45.892425+0000","last_peered":"2024-09-21T06:04:45.892425+0000","last_clean":"2024-09-21T06:04:45.892425+0000","last_became_active":"2024-09-21T06:04:43.777804+0000","last_became_peered":"2024-09-21T06:04:43.777804+0000","last_unstale":"2024-09-21T06:04:45.892425+0000","last_undegraded":"2024-09-21T06:04:45.892425+0000","last_fullsized":"2024-09-21T06:04:45.892425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.168028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891150+0000","last_change":"2024-09-21T06:04:44.803036+0000","last_active":"2024-09-21T06:04:45.891150+0000","last_peered":"2024-09-21T06:04:45.891150+0000","last_clean":"2024-09-21T06:04:45.891150+0000","last_became_active":"2024-09-21T06:04:44.799295+0000","last_became_peered":"2024-09-21T06:04:44.799295+0000","last_unstale":"2024-09-21T06:04:45.891150+0000","last_undegraded":"2024-09-21T06:04:45.891150+0000","last_fullsized":"2024-09-21T06:04:45.891150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:03.371128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782860+0000","last_change":"2024-09-21T06:04:43.776192+0000","last_active":"2024-09-21T06:04:45.782860+0000","last_peered":"2024-09-21T06:04:45.782860+0000","last_clean":"2024-09-21T06:04:45.782860+0000","last_became_active":"2024-09-21T06:04:43.773385+0000","last_became_peered":"2024-09-21T06:04:43.773385+0000","last_unstale":"2024-09-21T06:04:45.782860+0000","last_undegraded":"2024-09-21T06:04:45.782860+0000","last_fullsized":"2024-09-21T06:04:45.782860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:49.333569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783985+0000","last_change":"2024-09-21T06:04:44.802066+0000","last_active":"2024-09-21T06:04:45.783985+0000","last_peered":"2024-09-21T06:04:45.783985+0000","last_clean":"2024-09-21T06:04:45.783985+0000","last_became_active":"2024-09-21T06:04:44.801776+0000","last_became_peered":"2024-09-21T06:04:44.801776+0000","last_unstale":"2024-09-21T06:04:45.783985+0000","last_undegraded":"2024-09-21T06:04:45.783985+0000","last_fullsized":"2024-09-21T06:04:45.783985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:00.842943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892181+0000","last_change":"2024-09-21T06:04:43.781815+0000","last_active":"2024-09-21T06:04:45.892181+0000","last_peered":"2024-09-21T06:04:45.892181+0000","last_clean":"2024-09-21T06:04:45.892181+0000","last_became_active":"2024-09-21T06:04:43.780375+0000","last_became_peered":"2024-09-21T06:04:43.780375+0000","last_unstale":"2024-09-21T06:04:45.892181+0000","last_undegraded":"2024-09-21T06:04:45.892181+0000","last_fullsized":"2024-09-21T06:04:45.892181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:38.140626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781997+0000","last_change":"2024-09-21T06:04:44.788669+0000","last_active":"2024-09-21T06:04:45.781997+0000","last_peered":"2024-09-21T06:04:45.781997+0000","last_clean":"2024-09-21T06:04:45.781997+0000","last_became_active":"2024-09-21T06:04:44.788408+0000","last_became_peered":"2024-09-21T06:04:44.788408+0000","last_unstale":"2024-09-21T06:04:45.781997+0000","last_undegraded":"2024-09-21T06:04:45.781997+0000","last_fullsized":"2024-09-21T06:04:45.781997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:46.833376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784361+0000","last_change":"2024-09-21T06:04:43.783661+0000","last_active":"2024-09-21T06:04:45.784361+0000","last_peered":"2024-09-21T06:04:45.784361+0000","last_clean":"2024-09-21T06:04:45.784361+0000","last_became_active":"2024-09-21T06:04:43.782413+0000","last_became_peered":"2024-09-21T06:04:43.782413+0000","last_unstale":"2024-09-21T06:04:45.784361+0000","last_undegraded":"2024-09-21T06:04:45.784361+0000","last_fullsized":"2024-09-21T06:04:45.784361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.926433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891444+0000","last_change":"2024-09-21T06:04:44.801941+0000","last_active":"2024-09-21T06:04:45.891444+0000","last_peered":"2024-09-21T06:04:45.891444+0000","last_clean":"2024-09-21T06:04:45.891444+0000","last_became_active":"2024-09-21T06:04:44.801322+0000","last_became_peered":"2024-09-21T06:04:44.801322+0000","last_unstale":"2024-09-21T06:04:45.891444+0000","last_undegraded":"2024-09-21T06:04:45.891444+0000","last_fullsized":"2024-09-21T06:04:45.891444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:33.902211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783763+0000","last_change":"2024-09-21T06:04:43.778127+0000","last_active":"2024-09-21T06:04:45.783763+0000","last_peered":"2024-09-21T06:04:45.783763+0000","last_clean":"2024-09-21T06:04:45.783763+0000","last_became_active":"2024-09-21T06:04:43.777711+0000","last_became_peered":"2024-09-21T06:04:43.777711+0000","last_unstale":"2024-09-21T06:04:45.783763+0000","last_undegraded":"2024-09-21T06:04:45.783763+0000","last_fullsized":"2024-09-21T06:04:45.783763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:33.608837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891608+0000","last_change":"2024-09-21T06:04:44.802803+0000","last_active":"2024-09-21T06:04:45.891608+0000","last_peered":"2024-09-21T06:04:45.891608+0000","last_clean":"2024-09-21T06:04:45.891608+0000","last_became_active":"2024-09-21T06:04:44.802531+0000","last_became_peered":"2024-09-21T06:04:44.802531+0000","last_unstale":"2024-09-21T06:04:45.891608+0000","last_undegraded":"2024-09-21T06:04:45.891608+0000","last_fullsized":"2024-09-21T06:04:45.891608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:39.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.782127+0000","last_change":"2024-09-21T06:04:43.780162+0000","last_active":"2024-09-21T06:04:45.782127+0000","last_peered":"2024-09-21T06:04:45.782127+0000","last_clean":"2024-09-21T06:04:45.782127+0000","last_became_active":"2024-09-21T06:04:43.779762+0000","last_became_peered":"2024-09-21T06:04:43.779762+0000","last_unstale":"2024-09-21T06:04:45.782127+0000","last_undegraded":"2024-09-21T06:04:45.782127+0000","last_fullsized":"2024-09-21T06:04:45.782127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:18.310921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891877+0000","last_change":"2024-09-21T06:04:44.800492+0000","last_active":"2024-09-21T06:04:45.891877+0000","last_peered":"2024-09-21T06:04:45.891877+0000","last_clean":"2024-09-21T06:04:45.891877+0000","last_became_active":"2024-09-21T06:04:44.799583+0000","last_became_peered":"2024-09-21T06:04:44.799583+0000","last_unstale":"2024-09-21T06:04:45.891877+0000","last_undegraded":"2024-09-21T06:04:45.891877+0000","last_fullsized":"2024-09-21T06:04:45.891877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:00.218900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783719+0000","last_change":"2024-09-21T06:04:43.777876+0000","last_active":"2024-09-21T06:04:45.783719+0000","last_peered":"2024-09-21T06:04:45.783719+0000","last_clean":"2024-09-21T06:04:45.783719+0000","last_became_active":"2024-09-21T06:04:43.777617+0000","last_became_peered":"2024-09-21T06:04:43.777617+0000","last_unstale":"2024-09-21T06:04:45.783719+0000","last_undegraded":"2024-09-21T06:04:45.783719+0000","last_fullsized":"2024-09-21T06:04:45.783719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:35.223135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890025+0000","last_change":"2024-09-21T06:04:44.797597+0000","last_active":"2024-09-21T06:04:45.890025+0000","last_peered":"2024-09-21T06:04:45.890025+0000","last_clean":"2024-09-21T06:04:45.890025+0000","last_became_active":"2024-09-21T06:04:44.797277+0000","last_became_peered":"2024-09-21T06:04:44.797277+0000","last_unstale":"2024-09-21T06:04:45.890025+0000","last_undegraded":"2024-09-21T06:04:45.890025+0000","last_fullsized":"2024-09-21T06:04:45.890025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:07.160212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892277+0000","last_change":"2024-09-21T06:04:43.781519+0000","last_active":"2024-09-21T06:04:45.892277+0000","last_peered":"2024-09-21T06:04:45.892277+0000","last_clean":"2024-09-21T06:04:45.892277+0000","last_became_active":"2024-09-21T06:04:43.779971+0000","last_became_peered":"2024-09-21T06:04:43.779971+0000","last_unstale":"2024-09-21T06:04:45.892277+0000","last_undegraded":"2024-09-21T06:04:45.892277+0000","last_fullsized":"2024-09-21T06:04:45.892277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:24.581723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783186+0000","last_change":"2024-09-21T06:04:44.806750+0000","last_active":"2024-09-21T06:04:45.783186+0000","last_peered":"2024-09-21T06:04:45.783186+0000","last_clean":"2024-09-21T06:04:45.783186+0000","last_became_active":"2024-09-21T06:04:44.806450+0000","last_became_peered":"2024-09-21T06:04:44.806450+0000","last_unstale":"2024-09-21T06:04:45.783186+0000","last_undegraded":"2024-09-21T06:04:45.783186+0000","last_fullsized":"2024-09-21T06:04:45.783186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:18.349678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892206+0000","last_change":"2024-09-21T06:04:43.778671+0000","last_active":"2024-09-21T06:04:45.892206+0000","last_peered":"2024-09-21T06:04:45.892206+0000","last_clean":"2024-09-21T06:04:45.892206+0000","last_became_active":"2024-09-21T06:04:43.778422+0000","last_became_peered":"2024-09-21T06:04:43.778422+0000","last_unstale":"2024-09-21T06:04:45.892206+0000","last_undegraded":"2024-09-21T06:04:45.892206+0000","last_fullsized":"2024-09-21T06:04:45.892206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:12.162784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784001+0000","last_change":"2024-09-21T06:04:44.785437+0000","last_active":"2024-09-21T06:04:45.784001+0000","last_peered":"2024-09-21T06:04:45.784001+0000","last_clean":"2024-09-21T06:04:45.784001+0000","last_became_active":"2024-09-21T06:04:44.785168+0000","last_became_peered":"2024-09-21T06:04:44.785168+0000","last_unstale":"2024-09-21T06:04:45.784001+0000","last_undegraded":"2024-09-21T06:04:45.784001+0000","last_fullsized":"2024-09-21T06:04:45.784001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:11.623483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892140+0000","last_change":"2024-09-21T06:04:43.780289+0000","last_active":"2024-09-21T06:04:45.892140+0000","last_peered":"2024-09-21T06:04:45.892140+0000","last_clean":"2024-09-21T06:04:45.892140+0000","last_became_active":"2024-09-21T06:04:43.779004+0000","last_became_peered":"2024-09-21T06:04:43.779004+0000","last_unstale":"2024-09-21T06:04:45.892140+0000","last_undegraded":"2024-09-21T06:04:45.892140+0000","last_fullsized":"2024-09-21T06:04:45.892140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:04.653901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784605+0000","last_change":"2024-09-21T06:04:44.795267+0000","last_active":"2024-09-21T06:04:45.784605+0000","last_peered":"2024-09-21T06:04:45.784605+0000","last_clean":"2024-09-21T06:04:45.784605+0000","last_became_active":"2024-09-21T06:04:44.794959+0000","last_became_peered":"2024-09-21T06:04:44.794959+0000","last_unstale":"2024-09-21T06:04:45.784605+0000","last_undegraded":"2024-09-21T06:04:45.784605+0000","last_fullsized":"2024-09-21T06:04:45.784605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:29.944176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808906+0000","last_change":"2024-09-21T06:04:43.782623+0000","last_active":"2024-09-21T06:04:45.808906+0000","last_peered":"2024-09-21T06:04:45.808906+0000","last_clean":"2024-09-21T06:04:45.808906+0000","last_became_active":"2024-09-21T06:04:43.782299+0000","last_became_peered":"2024-09-21T06:04:43.782299+0000","last_unstale":"2024-09-21T06:04:45.808906+0000","last_undegraded":"2024-09-21T06:04:45.808906+0000","last_fullsized":"2024-09-21T06:04:45.808906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:37.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784905+0000","last_change":"2024-09-21T06:04:44.789948+0000","last_active":"2024-09-21T06:04:45.784905+0000","last_peered":"2024-09-21T06:04:45.784905+0000","last_clean":"2024-09-21T06:04:45.784905+0000","last_became_active":"2024-09-21T06:04:44.789681+0000","last_became_peered":"2024-09-21T06:04:44.789681+0000","last_unstale":"2024-09-21T06:04:45.784905+0000","last_undegraded":"2024-09-21T06:04:45.784905+0000","last_fullsized":"2024-09-21T06:04:45.784905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:29.729502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889626+0000","last_change":"2024-09-21T06:04:43.782645+0000","last_active":"2024-09-21T06:04:45.889626+0000","last_peered":"2024-09-21T06:04:45.889626+0000","last_clean":"2024-09-21T06:04:45.889626+0000","last_became_active":"2024-09-21T06:04:43.782435+0000","last_became_peered":"2024-09-21T06:04:43.782435+0000","last_unstale":"2024-09-21T06:04:45.889626+0000","last_undegraded":"2024-09-21T06:04:45.889626+0000","last_fullsized":"2024-09-21T06:04:45.889626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:00.381189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784225+0000","last_change":"2024-09-21T06:04:44.789083+0000","last_active":"2024-09-21T06:04:45.784225+0000","last_peered":"2024-09-21T06:04:45.784225+0000","last_clean":"2024-09-21T06:04:45.784225+0000","last_became_active":"2024-09-21T06:04:44.788836+0000","last_became_peered":"2024-09-21T06:04:44.788836+0000","last_unstale":"2024-09-21T06:04:45.784225+0000","last_undegraded":"2024-09-21T06:04:45.784225+0000","last_fullsized":"2024-09-21T06:04:45.784225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:12.584442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892362+0000","last_change":"2024-09-21T06:04:43.782374+0000","last_active":"2024-09-21T06:04:45.892362+0000","last_peered":"2024-09-21T06:04:45.892362+0000","last_clean":"2024-09-21T06:04:45.892362+0000","last_became_active":"2024-09-21T06:04:43.781268+0000","last_became_peered":"2024-09-21T06:04:43.781268+0000","last_unstale":"2024-09-21T06:04:45.892362+0000","last_undegraded":"2024-09-21T06:04:45.892362+0000","last_fullsized":"2024-09-21T06:04:45.892362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:05.662087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890181+0000","last_change":"2024-09-21T06:04:44.790351+0000","last_active":"2024-09-21T06:04:45.890181+0000","last_peered":"2024-09-21T06:04:45.890181+0000","last_clean":"2024-09-21T06:04:45.890181+0000","last_became_active":"2024-09-21T06:04:44.790005+0000","last_became_peered":"2024-09-21T06:04:44.790005+0000","last_unstale":"2024-09-21T06:04:45.890181+0000","last_undegraded":"2024-09-21T06:04:45.890181+0000","last_fullsized":"2024-09-21T06:04:45.890181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:48.368420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890971+0000","last_change":"2024-09-21T06:04:43.777589+0000","last_active":"2024-09-21T06:04:45.890971+0000","last_peered":"2024-09-21T06:04:45.890971+0000","last_clean":"2024-09-21T06:04:45.890971+0000","last_became_active":"2024-09-21T06:04:43.777295+0000","last_became_peered":"2024-09-21T06:04:43.777295+0000","last_unstale":"2024-09-21T06:04:45.890971+0000","last_undegraded":"2024-09-21T06:04:45.890971+0000","last_fullsized":"2024-09-21T06:04:45.890971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.810595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.785040+0000","last_change":"2024-09-21T06:04:44.791495+0000","last_active":"2024-09-21T06:04:45.785040+0000","last_peered":"2024-09-21T06:04:45.785040+0000","last_clean":"2024-09-21T06:04:45.785040+0000","last_became_active":"2024-09-21T06:04:44.791190+0000","last_became_peered":"2024-09-21T06:04:44.791190+0000","last_unstale":"2024-09-21T06:04:45.785040+0000","last_undegraded":"2024-09-21T06:04:45.785040+0000","last_fullsized":"2024-09-21T06:04:45.785040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:13.937332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783355+0000","last_change":"2024-09-21T06:04:43.783527+0000","last_active":"2024-09-21T06:04:45.783355+0000","last_peered":"2024-09-21T06:04:45.783355+0000","last_clean":"2024-09-21T06:04:45.783355+0000","last_became_active":"2024-09-21T06:04:43.781452+0000","last_became_peered":"2024-09-21T06:04:43.781452+0000","last_unstale":"2024-09-21T06:04:45.783355+0000","last_undegraded":"2024-09-21T06:04:45.783355+0000","last_fullsized":"2024-09-21T06:04:45.783355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:35.603774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890852+0000","last_change":"2024-09-21T06:04:44.804270+0000","last_active":"2024-09-21T06:04:45.890852+0000","last_peered":"2024-09-21T06:04:45.890852+0000","last_clean":"2024-09-21T06:04:45.890852+0000","last_became_active":"2024-09-21T06:04:44.803401+0000","last_became_peered":"2024-09-21T06:04:44.803401+0000","last_unstale":"2024-09-21T06:04:45.890852+0000","last_undegraded":"2024-09-21T06:04:45.890852+0000","last_fullsized":"2024-09-21T06:04:45.890852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:55.618574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.809042+0000","last_change":"2024-09-21T06:04:43.780451+0000","last_active":"2024-09-21T06:04:45.809042+0000","last_peered":"2024-09-21T06:04:45.809042+0000","last_clean":"2024-09-21T06:04:45.809042+0000","last_became_active":"2024-09-21T06:04:43.780047+0000","last_became_peered":"2024-09-21T06:04:43.780047+0000","last_unstale":"2024-09-21T06:04:45.809042+0000","last_undegraded":"2024-09-21T06:04:45.809042+0000","last_fullsized":"2024-09-21T06:04:45.809042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:07.506115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808562+0000","last_change":"2024-09-21T06:04:44.801293+0000","last_active":"2024-09-21T06:04:45.808562+0000","last_peered":"2024-09-21T06:04:45.808562+0000","last_clean":"2024-09-21T06:04:45.808562+0000","last_became_active":"2024-09-21T06:04:44.801081+0000","last_became_peered":"2024-09-21T06:04:44.801081+0000","last_unstale":"2024-09-21T06:04:45.808562+0000","last_undegraded":"2024-09-21T06:04:45.808562+0000","last_fullsized":"2024-09-21T06:04:45.808562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:10.401756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784813+0000","last_change":"2024-09-21T06:04:43.778730+0000","last_active":"2024-09-21T06:04:45.784813+0000","last_peered":"2024-09-21T06:04:45.784813+0000","last_clean":"2024-09-21T06:04:45.784813+0000","last_became_active":"2024-09-21T06:04:43.778445+0000","last_became_peered":"2024-09-21T06:04:43.778445+0000","last_unstale":"2024-09-21T06:04:45.784813+0000","last_undegraded":"2024-09-21T06:04:45.784813+0000","last_fullsized":"2024-09-21T06:04:45.784813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:51.142521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891888+0000","last_change":"2024-09-21T06:04:44.791231+0000","last_active":"2024-09-21T06:04:45.891888+0000","last_peered":"2024-09-21T06:04:45.891888+0000","last_clean":"2024-09-21T06:04:45.891888+0000","last_became_active":"2024-09-21T06:04:44.790823+0000","last_became_peered":"2024-09-21T06:04:44.790823+0000","last_unstale":"2024-09-21T06:04:45.891888+0000","last_undegraded":"2024-09-21T06:04:45.891888+0000","last_fullsized":"2024-09-21T06:04:45.891888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:53.609279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808943+0000","last_change":"2024-09-21T06:04:43.773074+0000","last_active":"2024-09-21T06:04:45.808943+0000","last_peered":"2024-09-21T06:04:45.808943+0000","last_clean":"2024-09-21T06:04:45.808943+0000","last_became_active":"2024-09-21T06:04:43.772819+0000","last_became_peered":"2024-09-21T06:04:43.772819+0000","last_unstale":"2024-09-21T06:04:45.808943+0000","last_undegraded":"2024-09-21T06:04:45.808943+0000","last_fullsized":"2024-09-21T06:04:45.808943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:05.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.808697+0000","last_change":"2024-09-21T06:04:44.792436+0000","last_active":"2024-09-21T06:04:45.808697+0000","last_peered":"2024-09-21T06:04:45.808697+0000","last_clean":"2024-09-21T06:04:45.808697+0000","last_became_active":"2024-09-21T06:04:44.791792+0000","last_became_peered":"2024-09-21T06:04:44.791792+0000","last_unstale":"2024-09-21T06:04:45.808697+0000","last_undegraded":"2024-09-21T06:04:45.808697+0000","last_fullsized":"2024-09-21T06:04:45.808697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:13.899691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.784222+0000","last_change":"2024-09-21T06:04:43.779951+0000","last_active":"2024-09-21T06:04:45.784222+0000","last_peered":"2024-09-21T06:04:45.784222+0000","last_clean":"2024-09-21T06:04:45.784222+0000","last_became_active":"2024-09-21T06:04:43.779700+0000","last_became_peered":"2024-09-21T06:04:43.779700+0000","last_unstale":"2024-09-21T06:04:45.784222+0000","last_undegraded":"2024-09-21T06:04:45.784222+0000","last_fullsized":"2024-09-21T06:04:45.784222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:38.902041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.781936+0000","last_change":"2024-09-21T06:04:44.801561+0000","last_active":"2024-09-21T06:04:45.781936+0000","last_peered":"2024-09-21T06:04:45.781936+0000","last_clean":"2024-09-21T06:04:45.781936+0000","last_became_active":"2024-09-21T06:04:44.800906+0000","last_became_peered":"2024-09-21T06:04:44.800906+0000","last_unstale":"2024-09-21T06:04:45.781936+0000","last_undegraded":"2024-09-21T06:04:45.781936+0000","last_fullsized":"2024-09-21T06:04:45.781936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:59.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.892127+0000","last_change":"2024-09-21T06:04:43.777628+0000","last_active":"2024-09-21T06:04:45.892127+0000","last_peered":"2024-09-21T06:04:45.892127+0000","last_clean":"2024-09-21T06:04:45.892127+0000","last_became_active":"2024-09-21T06:04:43.777054+0000","last_became_peered":"2024-09-21T06:04:43.777054+0000","last_unstale":"2024-09-21T06:04:45.892127+0000","last_undegraded":"2024-09-21T06:04:45.892127+0000","last_fullsized":"2024-09-21T06:04:45.892127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:41.076366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.891665+0000","last_change":"2024-09-21T06:04:44.800126+0000","last_active":"2024-09-21T06:04:45.891665+0000","last_peered":"2024-09-21T06:04:45.891665+0000","last_clean":"2024-09-21T06:04:45.891665+0000","last_became_active":"2024-09-21T06:04:44.799830+0000","last_became_peered":"2024-09-21T06:04:44.799830+0000","last_unstale":"2024-09-21T06:04:45.891665+0000","last_undegraded":"2024-09-21T06:04:45.891665+0000","last_fullsized":"2024-09-21T06:04:45.891665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:00.351515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.783169+0000","last_change":"2024-09-21T06:04:43.778056+0000","last_active":"2024-09-21T06:04:45.783169+0000","last_peered":"2024-09-21T06:04:45.783169+0000","last_clean":"2024-09-21T06:04:45.783169+0000","last_became_active":"2024-09-21T06:04:43.777777+0000","last_became_peered":"2024-09-21T06:04:43.777777+0000","last_unstale":"2024-09-21T06:04:45.783169+0000","last_undegraded":"2024-09-21T06:04:45.783169+0000","last_fullsized":"2024-09-21T06:04:45.783169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:41.590364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890454+0000","last_change":"2024-09-21T06:04:44.785071+0000","last_active":"2024-09-21T06:04:45.890454+0000","last_peered":"2024-09-21T06:04:45.890454+0000","last_clean":"2024-09-21T06:04:45.890454+0000","last_became_active":"2024-09-21T06:04:44.784808+0000","last_became_peered":"2024-09-21T06:04:44.784808+0000","last_unstale":"2024-09-21T06:04:45.890454+0000","last_undegraded":"2024-09-21T06:04:45.890454+0000","last_fullsized":"2024-09-21T06:04:45.890454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:43.760425+0000","last_clean_scrub_stamp":"2024-09-21T06:04:43.760425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:59.888200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.889771+0000","last_change":"2024-09-21T06:04:43.781399+0000","last_active":"2024-09-21T06:04:45.889771+0000","last_peered":"2024-09-21T06:04:45.889771+0000","last_clean":"2024-09-21T06:04:45.889771+0000","last_became_active":"2024-09-21T06:04:43.781096+0000","last_became_peered":"2024-09-21T06:04:43.781096+0000","last_unstale":"2024-09-21T06:04:45.889771+0000","last_undegraded":"2024-09-21T06:04:45.889771+0000","last_fullsized":"2024-09-21T06:04:45.889771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:04:42.754736+0000","last_clean_scrub_stamp":"2024-09-21T06:04:42.754736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:40.312251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T06:04:45.890052+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:04:45.890052+0000","last_peered":"2024-09-21T06:04:45.890052+0000","last_clean":"2024-09-21T06:04:45.890052+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:04:45.890052+0000","last_undegraded":"2024-09-21T06:04:45.890052+0000","last_fullsized":"2024-09-21T06:04:45.890052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864400,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865418,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865362,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865930,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864400,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:04:54.657 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:04:54.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:04:54.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 -- 172.21.15.118:0/3837540341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 msgr2=0x7f5d100cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/3837540341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d100cd250 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009830 tx=0x7f5d0002a480 comp rx=0 tx=0).stop 2024-09-21T06:04:54.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 -- 172.21.15.118:0/3837540341 shutdown_connections 2024-09-21T06:04:54.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/3837540341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d100cd790 0x7f5d10160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/3837540341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d100cd250 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 -- 172.21.15.118:0/3837540341 >> 172.21.15.118:0/3837540341 conn(0x7f5d100b2dd0 msgr2=0x7f5d100d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:54.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 -- 172.21.15.118:0/3837540341 shutdown_connections 2024-09-21T06:04:54.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.918+0000 7f5d0fe00640 1 -- 172.21.15.118:0/3837540341 wait complete. 2024-09-21T06:04:54.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.921+0000 7f5d0fe00640 1 Processor -- start 2024-09-21T06:04:54.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.921+0000 7f5d0fe00640 1 -- start start 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.922+0000 7f5d0fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d100cd790 0x7f5d1013c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.922+0000 7f5d0fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d101563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.922+0000 7f5d0fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d10160dc0 0x7f5d1015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.922+0000 7f5d0fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1015d9a0 con 0x7f5d101571e0 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.922+0000 7f5d0fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d100cfab0 con 0x7f5d10160dc0 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.922+0000 7f5d0fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1015db20 con 0x7f5d100cd790 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.922+0000 7f5d06000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d101563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:54.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d101563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59762/0 (socket says 172.21.15.118:59762) 2024-09-21T06:04:54.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 -- 172.21.15.118:0/717307037 learned_addr learned my addr 172.21.15.118:0/717307037 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:54.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d0ea00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d100cd790 0x7f5d1013c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:54.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d0f400640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d10160dc0 0x7f5d1015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 -- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d100cd790 msgr2=0x7f5d1013c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d100cd790 0x7f5d1013c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 -- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d10160dc0 msgr2=0x7f5d1015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d10160dc0 0x7f5d1015f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 -- 172.21.15.118:0/717307037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d101fa6a0 con 0x7f5d101571e0 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.923+0000 7f5d06000640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d101563f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800e7c0 tx=0x7f5cf800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.924+0000 7f5d07400640 1 -- 172.21.15.118:0/717307037 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800ccc0 con 0x7f5d101571e0 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.924+0000 7f5d07400640 1 -- 172.21.15.118:0/717307037 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cf8010430 con 0x7f5d101571e0 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.924+0000 7f5d07400640 1 -- 172.21.15.118:0/717307037 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8010860 con 0x7f5d101571e0 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.924+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d101fa170 con 0x7f5d101571e0 2024-09-21T06:04:54.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.924+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1013ec50 con 0x7f5d101571e0 2024-09-21T06:04:54.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.925+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d101fa410 con 0x7f5d101571e0 2024-09-21T06:04:54.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.926+0000 7f5d07400640 1 -- 172.21.15.118:0/717307037 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cf8010a00 con 0x7f5d101571e0 2024-09-21T06:04:54.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.928+0000 7f5d07400640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5cec078b90 0x7f5cec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:54.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.928+0000 7f5d07400640 1 -- 172.21.15.118:0/717307037 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf809b700 con 0x7f5d101571e0 2024-09-21T06:04:54.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.928+0000 7f5d0ea00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5cec078b90 0x7f5cec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:54.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.929+0000 7f5d0ea00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5cec078b90 0x7f5cec07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5d00034000 tx=0x7f5d00004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:54.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:54.932+0000 7f5d07400640 1 -- 172.21.15.118:0/717307037 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5cf80634e0 con 0x7f5d101571e0 2024-09-21T06:04:55.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.185+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5d1015dfd0 con 0x7f5d101571e0 2024-09-21T06:04:55.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.188+0000 7f5d07400640 1 -- 172.21.15.118:0/717307037 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f5cf8067f10 con 0x7f5d101571e0 2024-09-21T06:04:55.191 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:04:55.191 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:04:55.191 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:04:55.191 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:04:55.191 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:04:55.191 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:04:55.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5cec078b90 msgr2=0x7f5cec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5cec078b90 0x7f5cec07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5d00034000 tx=0x7f5d00004730 comp rx=0 tx=0).stop 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 msgr2=0x7f5d101563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d101563f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800e7c0 tx=0x7f5cf800ec80 comp rx=0 tx=0).stop 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 shutdown_connections 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d10160dc0 0x7f5d1015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d101571e0 0x7f5d101563f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5cec078b90 0x7f5cec07b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 --2- 172.21.15.118:0/717307037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d100cd790 0x7f5d1013c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 >> 172.21.15.118:0/717307037 conn(0x7f5d100b2dd0 msgr2=0x7f5d100b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 shutdown_connections 2024-09-21T06:04:55.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.191+0000 7f5d0fe00640 1 -- 172.21.15.118:0/717307037 wait complete. 2024-09-21T06:04:55.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:55.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 -- 172.21.15.118:0/1343599000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 msgr2=0x7f852815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 --2- 172.21.15.118:0/1343599000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f852815f660 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85280d3390 tx=0x7f851002a530 comp rx=0 tx=0).stop 2024-09-21T06:04:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 -- 172.21.15.118:0/1343599000 shutdown_connections 2024-09-21T06:04:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 --2- 172.21.15.118:0/1343599000 >> v2:172.21.15.149:3300/0 conn(0x7f852815fba0 0x7f85280d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 --2- 172.21.15.118:0/1343599000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f852815f660 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 -- 172.21.15.118:0/1343599000 >> 172.21.15.118:0/1343599000 conn(0x7f852806d1c0 msgr2=0x7f852806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 -- 172.21.15.118:0/1343599000 shutdown_connections 2024-09-21T06:04:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.433+0000 7f8527e00640 1 -- 172.21.15.118:0/1343599000 wait complete. 2024-09-21T06:04:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.435+0000 7f8527e00640 1 Processor -- start 2024-09-21T06:04:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.435+0000 7f8527e00640 1 -- start start 2024-09-21T06:04:55.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.436+0000 7f8527e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f852815fba0 0x7f852814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:55.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.436+0000 7f8527e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85281634f0 0x7f85280cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:55.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.436+0000 7f8527e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f85280cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:55.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.436+0000 7f8527e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f85280d3920 con 0x7f8528163900 2024-09-21T06:04:55.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.436+0000 7f8527e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85280d1d80 con 0x7f85281634f0 2024-09-21T06:04:55.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.436+0000 7f8527e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85280d3aa0 con 0x7f852815fba0 2024-09-21T06:04:55.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f85280cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:55.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f85280cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59768/0 (socket says 172.21.15.118:59768) 2024-09-21T06:04:55.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 -- 172.21.15.118:0/1637010725 learned_addr learned my addr 172.21.15.118:0/1637010725 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:55.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f851e000640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85281634f0 0x7f85280cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:55.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 -- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f852815fba0 msgr2=0x7f852814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:55.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8526a00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f852815fba0 0x7f852814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:55.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f852815fba0 0x7f852814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 -- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85281634f0 msgr2=0x7f85280cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:55.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85281634f0 0x7f85280cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8527400640 1 -- 172.21.15.118:0/1637010725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85281540f0 con 0x7f8528163900 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f851e000640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85281634f0 0x7f85280cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.437+0000 7f8526a00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f852815fba0 0x7f852814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.438+0000 7f8527400640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f85280cd990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f852000cb30 tx=0x7f852000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.438+0000 7f851fe00640 1 -- 172.21.15.118:0/1637010725 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852000f450 con 0x7f8528163900 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.438+0000 7f851fe00640 1 -- 172.21.15.118:0/1637010725 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f852000f700 con 0x7f8528163900 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.438+0000 7f851fe00640 1 -- 172.21.15.118:0/1637010725 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852000fb50 con 0x7f8528163900 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.438+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85281561d0 con 0x7f8528163900 2024-09-21T06:04:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.438+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85281f69d0 con 0x7f8528163900 2024-09-21T06:04:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.439+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85280d1330 con 0x7f8528163900 2024-09-21T06:04:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.440+0000 7f851fe00640 1 -- 172.21.15.118:0/1637010725 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f852000fcf0 con 0x7f8528163900 2024-09-21T06:04:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.441+0000 7f851fe00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8504078b90 0x7f850407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.441+0000 7f851fe00640 1 -- 172.21.15.118:0/1637010725 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f852009b890 con 0x7f8528163900 2024-09-21T06:04:55.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.442+0000 7f8526a00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8504078b90 0x7f850407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:55.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.442+0000 7f8526a00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8504078b90 0x7f850407b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:55.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.446+0000 7f851fe00640 1 -- 172.21.15.118:0/1637010725 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8520014030 con 0x7f8528163900 2024-09-21T06:04:55.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.667+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8528161d00 con 0x7f8528163900 2024-09-21T06:04:55.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.667+0000 7f851fe00640 1 -- 172.21.15.118:0/1637010725 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7f8520063cc0 con 0x7f8528163900 2024-09-21T06:04:55.670 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:04:55.670 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:04:55.670 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:04:55.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8504078b90 msgr2=0x7f850407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8504078b90 0x7f850407b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518009040 comp rx=0 tx=0).stop 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 msgr2=0x7f85280cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f85280cd990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f852000cb30 tx=0x7f852000a250 comp rx=0 tx=0).stop 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 shutdown_connections 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8528163900 0x7f85280cd990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85281634f0 0x7f85280cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8504078b90 0x7f850407b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 --2- 172.21.15.118:0/1637010725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f852815fba0 0x7f852814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 >> 172.21.15.118:0/1637010725 conn(0x7f852806d1c0 msgr2=0x7f8528162220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 shutdown_connections 2024-09-21T06:04:55.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:55.670+0000 7f8527e00640 1 -- 172.21.15.118:0/1637010725 wait complete. 2024-09-21T06:04:56.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:04:44.264788+0000', 'modified': '2024-09-21T06:04:47.281946+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4795}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4795': {'gid': 4795, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6836/1393220922', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 1393220922}, {'type': 'v1', 'addr': '172.21.15.149:6836', 'nonce': 1393220922}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4795, 'qdb_cluster': [4795]} 2024-09-21T06:04:56.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:04:56.101 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T06:04:56.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.320+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2347487972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2efc003a30 msgr2=0x7f2efc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.320+0000 7f2f1dc00640 1 --2- 172.21.15.118:0/2347487972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2efc003a30 0x7f2efc003ea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2f080016c0 tx=0x7f2efc005830 comp rx=0 tx=0).stop 2024-09-21T06:04:56.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.320+0000 7f2f17400640 1 -- 172.21.15.118:0/2347487972 reap_dead start 2024-09-21T06:04:56.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.320+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2347487972 shutdown_connections 2024-09-21T06:04:56.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.320+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2347487972 >> 172.21.15.118:0/2347487972 conn(0x7f2f1806d110 msgr2=0x7f2f1806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.320+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2347487972 shutdown_connections 2024-09-21T06:04:56.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.321+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2347487972 wait complete. 2024-09-21T06:04:56.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.323+0000 7f2f1dc00640 1 Processor -- start 2024-09-21T06:04:56.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.323+0000 7f2f1dc00640 1 -- start start 2024-09-21T06:04:56.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.324+0000 7f2f1dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc003a30 0x7f2f181545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.324+0000 7f2f1dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f181531c0 0x7f2f18149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.324+0000 7f2f1dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f18160e50 0x7f2f18161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.324+0000 7f2f1dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f180d12b0 con 0x7f2f18160e50 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.324+0000 7f2f1dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1815d890 con 0x7f2efc003a30 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.324+0000 7f2f1dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f180d1430 con 0x7f2f181531c0 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f18160e50 0x7f2f18161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f18160e50 0x7f2f18161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48650/0 (socket says 172.21.15.118:48650) 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 -- 172.21.15.118:0/2405968951 learned_addr learned my addr 172.21.15.118:0/2405968951 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f16a00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc003a30 0x7f2f181545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f16000640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f181531c0 0x7f2f18149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 -- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f181531c0 msgr2=0x7f2f18149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f181531c0 0x7f2f18149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 -- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc003a30 msgr2=0x7f2f181545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc003a30 0x7f2f181545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.325+0000 7f2f17400640 1 -- 172.21.15.118:0/2405968951 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f181617a0 con 0x7f2f18160e50 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.326+0000 7f2f17400640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f18160e50 0x7f2f18161260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001330 tx=0x7f2f10006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.326+0000 7f2f0ea00640 1 -- 172.21.15.118:0/2405968951 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f100069a0 con 0x7f2f18160e50 2024-09-21T06:04:56.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.326+0000 7f2f0ea00640 1 -- 172.21.15.118:0/2405968951 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f1000fa40 con 0x7f2f18160e50 2024-09-21T06:04:56.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.326+0000 7f2f0ea00640 1 -- 172.21.15.118:0/2405968951 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000fe90 con 0x7f2f18160e50 2024-09-21T06:04:56.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.326+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1813c2d0 con 0x7f2f18160e50 2024-09-21T06:04:56.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.326+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1813c890 con 0x7f2f18160e50 2024-09-21T06:04:56.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.329+0000 7f2f0ea00640 1 -- 172.21.15.118:0/2405968951 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f10018020 con 0x7f2f18160e50 2024-09-21T06:04:56.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.330+0000 7f2f0ea00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ef8078d30 0x7f2ef807b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.330+0000 7f2f0ea00640 1 -- 172.21.15.118:0/2405968951 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2f1009b330 con 0x7f2f18160e50 2024-09-21T06:04:56.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.331+0000 7f2f24cb3740 1 Processor -- start 2024-09-21T06:04:56.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.331+0000 7f2f16a00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ef8078d30 0x7f2ef807b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.331+0000 7f2f24cb3740 1 -- start start 2024-09-21T06:04:56.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.331+0000 7f2f16a00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ef8078d30 0x7f2ef807b240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2f08032000 tx=0x7f2f0802c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef77970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef77eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb86590 0x5596aef47f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5596aeed1430 con 0x5596aeba7270 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5596aeec15d0 con 0x5596aeb86590 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5596aeeb0a00 con 0x5596aeb7e3b0 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f16a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef77970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f16a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef77970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48664/0 (socket says 172.21.15.118:48664) 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.332+0000 7f2f16a00640 1 -- 172.21.15.118:0/1270173387 learned_addr learned my addr 172.21.15.118:0/1270173387 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f17400640 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb86590 0x5596aef47f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f16000640 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef77eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f16a00640 1 -- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 msgr2=0x5596aef77eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef77eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f16a00640 1 -- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb86590 msgr2=0x5596aef47f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb86590 0x5596aef47f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f16a00640 1 -- 172.21.15.118:0/1270173387 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596aee79520 con 0x5596aeba7270 2024-09-21T06:04:56.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef77970 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f0802a930 tx=0x7f2efc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220ea83c5853fb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f03400640 1 -- 172.21.15.118:0/1270173387 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0803e660 con 0x5596aeba7270 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f03400640 1 -- 172.21.15.118:0/1270173387 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f0803e8f0 con 0x5596aeba7270 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.333+0000 7f2f03400640 1 -- 172.21.15.118:0/1270173387 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0803ed00 con 0x5596aeba7270 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1270173387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 msgr2=0x5596aef77970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef77970 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f0802a930 tx=0x7f2efc005830 comp rx=0 tx=0).stop 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1270173387 shutdown_connections 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb86590 0x5596aef47f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef77eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1270173387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef77970 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1270173387 >> 172.21.15.118:0/1270173387 conn(0x5596aeb9b3c0 msgr2=0x5596aef4d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1270173387 shutdown_connections 2024-09-21T06:04:56.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.334+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1270173387 wait complete. 2024-09-21T06:04:56.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.335+0000 7f2f24cb3740 1 -- start start 2024-09-21T06:04:56.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.336+0000 7f2f24cb3740 1 Processor -- start 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb7e3b0 0x5596aef8c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aefa14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef72990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5596aee57330 con 0x5596aeba7270 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5596aeeb4810 con 0x5596aeb7e3b0 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5596aec21620 con 0x5596aeb86590 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f24cb3740 10 client.0 _ll_register_callbacks cb 0x5596aee5c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef72990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef72990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48666/0 (socket says 172.21.15.118:48666) 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.337+0000 7f2f17400640 1 -- 172.21.15.118:0/1084097941 learned_addr learned my addr 172.21.15.118:0/1084097941 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f16000640 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aefa14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb7e3b0 0x5596aef8c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f17400640 1 -- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 msgr2=0x5596aefa14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f17400640 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aefa14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f17400640 1 -- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb7e3b0 msgr2=0x5596aef8c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f17400640 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb7e3b0 0x5596aef8c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f17400640 1 -- 172.21.15.118:0/1084097941 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596aec12850 con 0x5596aeba7270 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f17400640 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef72990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f10002230 tx=0x7f2f10062cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72d2c5b90c46e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2ef7e00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1084097941 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f100893b0 con 0x5596aeba7270 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1084097941 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2f10062350 con 0x5596aeba7270 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0803e8f0 con 0x5596aeba7270 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1084097941 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2f10067bd0 con 0x5596aeba7270 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f24cb3740 10 client.5043 fetch_fsmap learned FSMap version 16 2024-09-21T06:04:56.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.338+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5596aec896b0 con 0x5596aeba7270 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1084097941 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f0803e8f0 con 0x5596aeba7270 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1084097941 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f2f1007d080 con 0x5596aeba7270 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2f24cb3740 10 client.5043 fetch_fsmap finished waiting for FSMap version 16 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2f24cb3740 10 client.5043 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2f24cb3740 20 client.5043 populate_metadata read hostname 'smithi118' 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596aeb65e40 0x5596aefa4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2f24cb3740 4 client.5043 mds_command: new command op to 4795 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 --> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596aeec3520 con 0x5596aeb65e40 2024-09-21T06:04:56.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.339+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596aeb65e40 0x5596aefa4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.340+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596aeb65e40 0x5596aefa4b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74cc74d162e2b91c server_cookie=3c6d9df00f827a4e in_seq=0 out_seq=0 2024-09-21T06:04:56.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.340+0000 7f2ef7e00640 10 client.5043 ms_handle_connect on v2:172.21.15.149:6834/1393220922 2024-09-21T06:04:56.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1084097941 <== mds.0 v2:172.21.15.149:6834/1393220922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596aeec3520 con 0x5596aeb65e40 2024-09-21T06:04:56.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2ef7e00640 10 client.5043 handle_command_reply: tid=0 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 client.5043 shutdown 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 msgr2=0x5596aef72990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef72990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f10002230 tx=0x7f2f10062cc0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 shutdown_connections 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596aeb65e40 0x5596aefa4b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeba7270 0x5596aef72990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aefa14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1084097941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeb7e3b0 0x5596aef8c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 >> 172.21.15.118:0/1084097941 conn(0x5596aeb9b3c0 msgr2=0x5596aef6eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2ef7e00640 0 client.5043 ms_handle_reset on v2:172.21.15.149:6834/1393220922 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 shutdown_connections 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.341+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1084097941 wait complete. 2024-09-21T06:04:56.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.342+0000 7f2f24cb3740 20 client.5043 trim_cache size 0 max 16384 2024-09-21T06:04:56.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.360+0000 7f2f24cb3740 1 Processor -- start 2024-09-21T06:04:56.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.361+0000 7f2f24cb3740 1 -- start start 2024-09-21T06:04:56.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef6edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb86590 0x5596aef8d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aef8de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18074650 con 0x5596aeb86590 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1813e310 con 0x5596aeba7270 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f18074000 con 0x5596aeb7e3b0 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f16000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb86590 0x5596aef8d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f16000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb86590 0x5596aef8d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48676/0 (socket says 172.21.15.118:48676) 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f16000640 1 -- 172.21.15.118:0/1002112922 learned_addr learned my addr 172.21.15.118:0/1002112922 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef6edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.362+0000 7f2f17400640 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aef8de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f16000640 1 -- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 msgr2=0x5596aef6edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f16000640 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef6edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f16000640 1 -- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 msgr2=0x5596aef8de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f16000640 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aef8de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f16000640 1 -- 172.21.15.118:0/1002112922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596aef4d160 con 0x5596aeb86590 2024-09-21T06:04:56.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f16000640 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb86590 0x5596aef8d8e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009cd0 tx=0x7f2f04005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa566aea15b4788f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f02a00640 1 -- 172.21.15.118:0/1002112922 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04004050 con 0x5596aeb86590 2024-09-21T06:04:56.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f02a00640 1 -- 172.21.15.118:0/1002112922 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f040041f0 con 0x5596aeb86590 2024-09-21T06:04:56.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.363+0000 7f2f02a00640 1 -- 172.21.15.118:0/1002112922 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04005020 con 0x5596aeb86590 2024-09-21T06:04:56.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1002112922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb86590 msgr2=0x5596aef8d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb86590 0x5596aef8d8e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009cd0 tx=0x7f2f04005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:56.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1002112922 shutdown_connections 2024-09-21T06:04:56.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aef8de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb86590 0x5596aef8d8e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1002112922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb7e3b0 0x5596aef6edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1002112922 >> 172.21.15.118:0/1002112922 conn(0x5596aeb9b3c0 msgr2=0x5596aef74d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1002112922 shutdown_connections 2024-09-21T06:04:56.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.364+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1002112922 wait complete. 2024-09-21T06:04:56.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.365+0000 7f2f24cb3740 1 -- start start 2024-09-21T06:04:56.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.365+0000 7f2f24cb3740 1 Processor -- start 2024-09-21T06:04:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb7e3b0 0x5596aef74060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aef894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f24cb3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aefb9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5596aef73150 con 0x5596aeb7e3b0 2024-09-21T06:04:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5596aef70fe0 con 0x5596aeba7270 2024-09-21T06:04:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f24cb3740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5596aef93820 con 0x5596aeb86590 2024-09-21T06:04:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f24cb3740 10 client.0 _ll_register_callbacks cb 0x7f2f10062860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb7e3b0 0x5596aef74060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb7e3b0 0x5596aef74060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48682/0 (socket says 172.21.15.118:48682) 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 -- 172.21.15.118:0/1605379279 learned_addr learned my addr 172.21.15.118:0/1605379279 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16000640 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aef894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f17400640 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aefb9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 -- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 msgr2=0x5596aef894e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aef894e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 -- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 msgr2=0x5596aefb9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aefb9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 -- 172.21.15.118:0/1605379279 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596aef745a0 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2f16a00640 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb7e3b0 0x5596aef74060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f08001690 tx=0x7f2f0803e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244e3243025378e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.367+0000 7f2ef7e00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1605379279 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0805d060 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1605379279 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2f0803e8f0 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f040041f0 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1605379279 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2f08063050 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 10 client.5049 fetch_fsmap learned FSMap version 16 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5596aef736f0 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1605379279 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f040041f0 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1605379279 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f2f08066020 con 0x5596aeb7e3b0 2024-09-21T06:04:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 10 client.5049 fetch_fsmap finished waiting for FSMap version 16 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 10 client.5049 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 20 client.5049 populate_metadata read hostname 'smithi118' 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596af01af30 0x5596af01b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 4 client.5049 mds_command: new command op to 4795 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.368+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 --> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] -- command(tid 0: {"prefix": "status"}) -- 0x5596aeebefd0 con 0x5596af01af30 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.369+0000 7f2f16000640 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596af01af30 0x5596af01b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.369+0000 7f2f16000640 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596af01af30 0x5596af01b340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c18a26e3a3d8ff46 server_cookie=8454907806617df8 in_seq=0 out_seq=0 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.369+0000 7f2ef7e00640 10 client.5049 ms_handle_connect on v2:172.21.15.149:6834/1393220922 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2ef7e00640 1 -- 172.21.15.118:0/1605379279 <== mds.0 v2:172.21.15.149:6834/1393220922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5596aeebefd0 con 0x5596af01af30 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2ef7e00640 10 client.5049 handle_command_reply: tid=0 2024-09-21T06:04:56.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 client.5049 shutdown 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb7e3b0 msgr2=0x5596aef74060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb7e3b0 0x5596aef74060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f08001690 tx=0x7f2f0803e5e0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 shutdown_connections 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:6834/1393220922,v1:172.21.15.149:6836/1393220922] conn(0x5596af01af30 0x5596af01b340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5596aeba7270 0x5596aefb9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5596aeb86590 0x5596aef894e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2ef7e00640 0 client.5049 ms_handle_reset on v2:172.21.15.149:6834/1393220922 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 --2- 172.21.15.118:0/1605379279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5596aeb7e3b0 0x5596aef74060 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 >> 172.21.15.118:0/1605379279 conn(0x5596aeb9b3c0 msgr2=0x5596aef492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 shutdown_connections 2024-09-21T06:04:56.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 1 -- 172.21.15.118:0/1605379279 wait complete. 2024-09-21T06:04:56.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.370+0000 7f2f24cb3740 20 client.5049 trim_cache size 0 max 16384 2024-09-21T06:04:56.378 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:04:56.378 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:04:56.378 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:04:56.378 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4795, 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 11.578933991, 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 16, 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 31, 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 31, 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 19.332896305999999 2024-09-21T06:04:56.379 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:04:56.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ef8078d30 msgr2=0x7f2ef807b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ef8078d30 0x7f2ef807b240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2f08032000 tx=0x7f2f0802c040 comp rx=0 tx=0).stop 2024-09-21T06:04:56.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f18160e50 msgr2=0x7f2f18161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f18160e50 0x7f2f18161260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001330 tx=0x7f2f10006660 comp rx=0 tx=0).stop 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 shutdown_connections 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f18160e50 0x7f2f18161260 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ef8078d30 0x7f2ef807b240 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f181531c0 0x7f2f18149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 --2- 172.21.15.118:0/2405968951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2efc003a30 0x7f2f181545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 >> 172.21.15.118:0/2405968951 conn(0x7f2f1806d110 msgr2=0x7f2f180701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 shutdown_connections 2024-09-21T06:04:56.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.371+0000 7f2f1dc00640 1 -- 172.21.15.118:0/2405968951 wait complete. 2024-09-21T06:04:56.398 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:04:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.616+0000 7f7491000640 1 -- 172.21.15.118:0/2618910773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c13fae0 msgr2=0x7f748c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.616+0000 7f7491000640 1 --2- 172.21.15.118:0/2618910773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c13fae0 0x7f748c0d0e80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f747c009830 tx=0x7f747c02a480 comp rx=0 tx=0).stop 2024-09-21T06:04:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.616+0000 7f7491000640 1 -- 172.21.15.118:0/2618910773 shutdown_connections 2024-09-21T06:04:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.616+0000 7f7491000640 1 --2- 172.21.15.118:0/2618910773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c13fae0 0x7f748c0d0e80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.616+0000 7f7491000640 1 -- 172.21.15.118:0/2618910773 >> 172.21.15.118:0/2618910773 conn(0x7f748c06d110 msgr2=0x7f748c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.616+0000 7f7491000640 1 -- 172.21.15.118:0/2618910773 shutdown_connections 2024-09-21T06:04:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.616+0000 7f7491000640 1 -- 172.21.15.118:0/2618910773 wait complete. 2024-09-21T06:04:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.618+0000 7f7491000640 1 Processor -- start 2024-09-21T06:04:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.619+0000 7f7491000640 1 -- start start 2024-09-21T06:04:56.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f7491000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f748c13fae0 0x7f748c1f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f7491000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748c13fef0 0x7f748c1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f7491000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c142e40 0x7f748c13ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f7491000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f748c0cfce0 con 0x7f748c142e40 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f7491000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f748c0cfb60 con 0x7f748c13fef0 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f7491000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f748c0cfe60 con 0x7f748c13fae0 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f748a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c142e40 0x7f748c13ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f748a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c142e40 0x7f748c13ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48698/0 (socket says 172.21.15.118:48698) 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f748a800640 1 -- 172.21.15.118:0/2455585860 learned_addr learned my addr 172.21.15.118:0/2455585860 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.620+0000 7f7481400640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748c13fef0 0x7f748c1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f7489e00640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f748c13fae0 0x7f748c1f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f748a800640 1 -- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f748c13fae0 msgr2=0x7f748c1f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f748a800640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f748c13fae0 0x7f748c1f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f748a800640 1 -- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748c13fef0 msgr2=0x7f748c1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f748a800640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748c13fef0 0x7f748c1416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f748a800640 1 -- 172.21.15.118:0/2455585860 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c1f6a80 con 0x7f748c142e40 2024-09-21T06:04:56.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f748a800640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c142e40 0x7f748c13ed00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f748400cb10 tx=0x7f748400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f7482a00640 1 -- 172.21.15.118:0/2455585860 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484016020 con 0x7f748c142e40 2024-09-21T06:04:56.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f7482a00640 1 -- 172.21.15.118:0/2455585860 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f748400ad60 con 0x7f748c142e40 2024-09-21T06:04:56.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.621+0000 7f7482a00640 1 -- 172.21.15.118:0/2455585860 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484012680 con 0x7f748c142e40 2024-09-21T06:04:56.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.622+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c13dd20 con 0x7f748c142e40 2024-09-21T06:04:56.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.622+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c141c30 con 0x7f748c142e40 2024-09-21T06:04:56.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.623+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748c0d0330 con 0x7f748c142e40 2024-09-21T06:04:56.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.624+0000 7f7482a00640 1 -- 172.21.15.118:0/2455585860 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7484019020 con 0x7f748c142e40 2024-09-21T06:04:56.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.625+0000 7f7482a00640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7468078bc0 0x7f746807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:56.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.625+0000 7f7482a00640 1 -- 172.21.15.118:0/2455585860 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f748409af50 con 0x7f748c142e40 2024-09-21T06:04:56.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.625+0000 7f7489e00640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7468078bc0 0x7f746807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:56.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.626+0000 7f7489e00640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7468078bc0 0x7f746807b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f747c034000 tx=0x7f747c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:56.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.630+0000 7f7482a00640 1 -- 172.21.15.118:0/2455585860 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7484020030 con 0x7f748c142e40 2024-09-21T06:04:56.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.852+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f748c13da40 con 0x7f748c142e40 2024-09-21T06:04:56.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.853+0000 7f7482a00640 1 -- 172.21.15.118:0/2455585860 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f748c1f6a80 con 0x7f748c142e40 2024-09-21T06:04:56.855 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7468078bc0 msgr2=0x7f746807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7468078bc0 0x7f746807b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f747c034000 tx=0x7f747c004730 comp rx=0 tx=0).stop 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c142e40 msgr2=0x7f748c13ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c142e40 0x7f748c13ed00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f748400cb10 tx=0x7f748400a060 comp rx=0 tx=0).stop 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 shutdown_connections 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f748c142e40 0x7f748c13ed00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748c13fef0 0x7f748c1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7468078bc0 0x7f746807b0d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 --2- 172.21.15.118:0/2455585860 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f748c13fae0 0x7f748c1f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:56.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 >> 172.21.15.118:0/2455585860 conn(0x7f748c06d110 msgr2=0x7f748c0cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:56.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 shutdown_connections 2024-09-21T06:04:56.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:56.855+0000 7f7491000640 1 -- 172.21.15.118:0/2455585860 wait complete. 2024-09-21T06:04:56.879 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:04:56.879 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:04:56.879 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:04:56.880 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:04:56.880 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:56.880 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:04:56.880 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:04:56.880 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:04:56.880 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:04:56.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:56.880 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:56.915 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42688sec preferred_lft 42688sec 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:56.916 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:04:56.917 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:56.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:56.918 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:04:57.011 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:04:57.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:57.014 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:04:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:04:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:04:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:04:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:04:57.050 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:04:57.051 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:57.051 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:04:57.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:04:57.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:04:57.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:04:57.051 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:04:57.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:57.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:57.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:57.247 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:04:57.281 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:04:57.281 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:04:57.282 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:04:57.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:57.282 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:04:57.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:57.378 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:57.414 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:04:57.414 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:57.414 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:57.489 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:04:57.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:57.489 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:57.684 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:57.684 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:57.718 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:57.719 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:57.719 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:04:57.719 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:04:57.719 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:04:57.720 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:04:57.720 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:04:57.720 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:04:57.720 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:04:57.720 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:04:57.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:04:57.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:57.723 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:04:57.781 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:57.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:57.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:57.881 INFO:teuthology.orchestra.run.smithi118.stdout:client4733 2024-09-21T06:04:57.882 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:04:57.882 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:57.917 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:04:58.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.184+0000 7f0dd8a00640 1 -- 172.21.15.118:0/3370786363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd40b5bb0 msgr2=0x7f0dd40b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.184+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/3370786363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd40b5bb0 0x7f0dd40b5fc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc005fd0 tx=0x7f0dcc02aa10 comp rx=0 tx=0).stop 2024-09-21T06:04:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.184+0000 7f0dd8a00640 1 -- 172.21.15.118:0/3370786363 shutdown_connections 2024-09-21T06:04:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.184+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/3370786363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd40b5bb0 0x7f0dd40b5fc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.184+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/3370786363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0dd40cfe30 0x7f0dd40d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.184+0000 7f0dd8a00640 1 -- 172.21.15.118:0/3370786363 >> 172.21.15.118:0/3370786363 conn(0x7f0dd406d6e0 msgr2=0x7f0dd40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.185+0000 7f0dd8a00640 1 -- 172.21.15.118:0/3370786363 shutdown_connections 2024-09-21T06:04:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.185+0000 7f0dd8a00640 1 -- 172.21.15.118:0/3370786363 wait complete. 2024-09-21T06:04:58.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.187+0000 7f0dd8a00640 1 Processor -- start 2024-09-21T06:04:58.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.187+0000 7f0dd8a00640 1 -- start start 2024-09-21T06:04:58.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.188+0000 7f0dd8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd4073fa0 0x7f0dd40c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:58.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.188+0000 7f0dd8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dd40b5bb0 0x7f0dd41f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.188+0000 7f0dd8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0dd40cfe30 0x7f0dd40c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.188+0000 7f0dd8a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd415d9c0 con 0x7f0dd4073fa0 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.188+0000 7f0dd8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd415d840 con 0x7f0dd40b5bb0 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.188+0000 7f0dd8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd415db40 con 0x7f0dd40cfe30 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.188+0000 7f0dd3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd4073fa0 0x7f0dd40c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd4073fa0 0x7f0dd40c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48718/0 (socket says 172.21.15.118:48718) 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3400640 1 -- 172.21.15.118:0/1236954831 learned_addr learned my addr 172.21.15.118:0/1236954831 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd2a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dd40b5bb0 0x7f0dd41f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3e00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0dd40cfe30 0x7f0dd40c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3400640 1 -- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0dd40cfe30 msgr2=0x7f0dd40c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:58.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3400640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0dd40cfe30 0x7f0dd40c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3400640 1 -- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dd40b5bb0 msgr2=0x7f0dd41f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3400640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dd40b5bb0 0x7f0dd41f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.189+0000 7f0dd3400640 1 -- 172.21.15.118:0/1236954831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd41f7620 con 0x7f0dd4073fa0 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.190+0000 7f0dd3400640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd4073fa0 0x7f0dd40c7ec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c3a0 tx=0x7f0dc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.190+0000 7f0dcb400640 1 -- 172.21.15.118:0/1236954831 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4017070 con 0x7f0dd4073fa0 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.190+0000 7f0dcb400640 1 -- 172.21.15.118:0/1236954831 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dc40053c0 con 0x7f0dd4073fa0 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.190+0000 7f0dcb400640 1 -- 172.21.15.118:0/1236954831 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4003850 con 0x7f0dd4073fa0 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.190+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd41f7900 con 0x7f0dd4073fa0 2024-09-21T06:04:58.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.190+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd41f3af0 con 0x7f0dd4073fa0 2024-09-21T06:04:58.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.191+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd415e060 con 0x7f0dd4073fa0 2024-09-21T06:04:58.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.192+0000 7f0dcb400640 1 -- 172.21.15.118:0/1236954831 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0dc401a070 con 0x7f0dd4073fa0 2024-09-21T06:04:58.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.193+0000 7f0dcb400640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0db4078b90 0x7f0db407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:58.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.193+0000 7f0dcb400640 1 -- 172.21.15.118:0/1236954831 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0dc409a000 con 0x7f0dd4073fa0 2024-09-21T06:04:58.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.194+0000 7f0dd2a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0db4078b90 0x7f0db407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:58.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.194+0000 7f0dd2a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0db4078b90 0x7f0db407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4157150 tx=0x7f0dc000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:58.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.198+0000 7f0dcb400640 1 -- 172.21.15.118:0/1236954831 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0dd40b6500 con 0x7f0dd4073fa0 2024-09-21T06:04:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.449+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0dd40cd870 con 0x7f0dd4073fa0 2024-09-21T06:04:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.450+0000 7f0dcb400640 1 -- 172.21.15.118:0/1236954831 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f0dc4061df0 con 0x7f0dd4073fa0 2024-09-21T06:04:58.452 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:04:58.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0db4078b90 msgr2=0x7f0db407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:58.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0db4078b90 0x7f0db407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4157150 tx=0x7f0dc000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd4073fa0 msgr2=0x7f0dd40c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:58.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd4073fa0 0x7f0dd40c7ec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c3a0 tx=0x7f0dc400c860 comp rx=0 tx=0).stop 2024-09-21T06:04:58.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 shutdown_connections 2024-09-21T06:04:58.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0db4078b90 0x7f0db407b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0dd40cfe30 0x7f0dd40c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dd40b5bb0 0x7f0dd41f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 --2- 172.21.15.118:0/1236954831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dd4073fa0 0x7f0dd40c7ec0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.452+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 >> 172.21.15.118:0/1236954831 conn(0x7f0dd406d6e0 msgr2=0x7f0dd415e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.453+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 shutdown_connections 2024-09-21T06:04:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:58.453+0000 7f0dd8a00640 1 -- 172.21.15.118:0/1236954831 wait complete. 2024-09-21T06:04:58.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:04:58.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:04:58.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:04:58.478 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:04:58.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:58.479 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:04:58.479 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:04:58.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:04:58.479 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:04:58.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:58.479 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:04:58.520 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:04:58.520 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:04:58.520 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:04:58.520 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:04:58.521 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42661sec preferred_lft 42661sec 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:58.522 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:04:58.523 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:04:58.523 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:04:58.523 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:04:58.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:58.523 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:04:58.619 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:04:58.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:58.622 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:04:58.659 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:04:58.659 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:04:58.660 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:04:58.660 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:04:58.660 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:04:58.660 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:04:58.660 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:04:58.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:04:58.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:04:58.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:04:58.660 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:04:58.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:04:58.850 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:58.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:58.859 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:04:58.893 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:04:58.893 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:04:58.894 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:04:58.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:58.895 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:04:58.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:58.992 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:59.027 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:04:59.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:04:59.027 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:59.102 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:04:59.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:59.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:59.298 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:59.298 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:59.331 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:04:59.331 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:04:59.331 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:04:59.331 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:04:59.331 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:04:59.333 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:04:59.333 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:04:59.333 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:04:59.333 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:04:59.333 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:04:59.336 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:04:59.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:04:59.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:04:59.392 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:04:59.471 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:04:59.474 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:04:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:04:59.482 INFO:teuthology.orchestra.run.smithi149.stdout:client4742 2024-09-21T06:04:59.482 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:04:59.482 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:04:59.517 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:04:59.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.796+0000 7f6790e00640 1 -- 172.21.15.118:0/767174473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6770004d40 msgr2=0x7f6770005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:59.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.796+0000 7f6790e00640 1 --2- 172.21.15.118:0/767174473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6770004d40 0x7f6770005150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6784005fd0 tx=0x7f6770005830 comp rx=0 tx=0).stop 2024-09-21T06:04:59.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.796+0000 7f678be00640 1 -- 172.21.15.118:0/767174473 reap_dead start 2024-09-21T06:04:59.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.797+0000 7f6790e00640 1 -- 172.21.15.118:0/767174473 shutdown_connections 2024-09-21T06:04:59.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.797+0000 7f6790e00640 1 -- 172.21.15.118:0/767174473 >> 172.21.15.118:0/767174473 conn(0x7f678c06d6e0 msgr2=0x7f678c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:59.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.797+0000 7f6790e00640 1 -- 172.21.15.118:0/767174473 shutdown_connections 2024-09-21T06:04:59.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.797+0000 7f6790e00640 1 -- 172.21.15.118:0/767174473 wait complete. 2024-09-21T06:04:59.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.799+0000 7f6790e00640 1 Processor -- start 2024-09-21T06:04:59.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.799+0000 7f6790e00640 1 -- start start 2024-09-21T06:04:59.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.800+0000 7f6790e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6770004d40 0x7f678c1f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:59.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.800+0000 7f6790e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678c13e120 0x7f678c1f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:59.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.800+0000 7f6790e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f678c0b0510 0x7f678c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:59.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.800+0000 7f6790e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f678c0b44d0 con 0x7f678c13e120 2024-09-21T06:04:59.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6790e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f678c0b4350 con 0x7f678c0b0510 2024-09-21T06:04:59.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6790e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f678c0b4650 con 0x7f6770004d40 2024-09-21T06:04:59.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678c13e120 0x7f678c1f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:59.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f678b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6770004d40 0x7f678c1f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:59.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678c13e120 0x7f678c1f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48736/0 (socket says 172.21.15.118:48736) 2024-09-21T06:04:59.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 -- 172.21.15.118:0/2828961571 learned_addr learned my addr 172.21.15.118:0/2828961571 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:04:59.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f678be00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f678c0b0510 0x7f678c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 -- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6770004d40 msgr2=0x7f678c1f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6770004d40 0x7f678c1f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 -- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f678c0b0510 msgr2=0x7f678c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f678c0b0510 0x7f678c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f6782a00640 1 -- 172.21.15.118:0/2828961571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c0c6320 con 0x7f678c13e120 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f678b400640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6770004d40 0x7f678c1f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.801+0000 7f678be00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f678c0b0510 0x7f678c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.802+0000 7f6782a00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678c13e120 0x7f678c1f60f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6774001db0 tx=0x7f67740039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:59.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.802+0000 7f6783e00640 1 -- 172.21.15.118:0/2828961571 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774015070 con 0x7f678c13e120 2024-09-21T06:04:59.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.802+0000 7f6783e00640 1 -- 172.21.15.118:0/2828961571 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6774011900 con 0x7f678c13e120 2024-09-21T06:04:59.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.802+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678c0c5d60 con 0x7f678c13e120 2024-09-21T06:04:59.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.802+0000 7f6783e00640 1 -- 172.21.15.118:0/2828961571 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774011d50 con 0x7f678c13e120 2024-09-21T06:04:59.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.802+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f678c1f58f0 con 0x7f678c13e120 2024-09-21T06:04:59.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.803+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f678c144760 con 0x7f678c13e120 2024-09-21T06:04:59.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.804+0000 7f6783e00640 1 -- 172.21.15.118:0/2828961571 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6774018070 con 0x7f678c13e120 2024-09-21T06:04:59.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.806+0000 7f6783e00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6768078b90 0x7f676807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:59.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.806+0000 7f6783e00640 1 -- 172.21.15.118:0/2828961571 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f677409ba50 con 0x7f678c13e120 2024-09-21T06:04:59.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.806+0000 7f678b400640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6768078b90 0x7f676807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:59.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.807+0000 7f678b400640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6768078b90 0x7f676807b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f677c012510 tx=0x7f677c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:59.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:04:59.811+0000 7f6783e00640 1 -- 172.21.15.118:0/2828961571 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f678c0cfce0 con 0x7f678c13e120 2024-09-21T06:05:00.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.034+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f678c073600 con 0x7f678c13e120 2024-09-21T06:05:00.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.035+0000 7f6783e00640 1 -- 172.21.15.118:0/2828961571 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7f67740681e0 con 0x7f678c13e120 2024-09-21T06:05:00.038 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:00.038 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:05:00.038 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:05:00.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6768078b90 msgr2=0x7f676807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:00.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6768078b90 0x7f676807b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f677c012510 tx=0x7f677c005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:00.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678c13e120 msgr2=0x7f678c1f60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:00.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678c13e120 0x7f678c1f60f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6774001db0 tx=0x7f67740039c0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 shutdown_connections 2024-09-21T06:05:00.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f678c0b0510 0x7f678c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678c13e120 0x7f678c1f60f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6768078b90 0x7f676807b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 --2- 172.21.15.118:0/2828961571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6770004d40 0x7f678c1f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.037+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 >> 172.21.15.118:0/2828961571 conn(0x7f678c06d6e0 msgr2=0x7f678c142cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:00.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.038+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 shutdown_connections 2024-09-21T06:05:00.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.038+0000 7f6790e00640 1 -- 172.21.15.118:0/2828961571 wait complete. 2024-09-21T06:05:00.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-21T06:05:00.317 INFO:teuthology.orchestra.run.smithi149.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":4795,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.505251943999999,"mdsmap_epoch":16,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":23.259215617999999} 2024-09-21T06:05:00.317 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 4795, "mdsmap_epoch": 16, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 15.505251944, "state": "up:active", "uptime": 23.259215618, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:05:00.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-21T06:05:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.538+0000 7fd8f3e00640 1 -- 172.21.15.118:0/1731719227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 msgr2=0x7fd8ec142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.538+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/1731719227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 0x7fd8ec142c70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4005fd0 tx=0x7fd8e402aaa0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.538+0000 7fd8f3e00640 1 -- 172.21.15.118:0/1731719227 shutdown_connections 2024-09-21T06:05:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.538+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/1731719227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 0x7fd8ec142c70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.538+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/1731719227 >> v2:172.21.15.149:3300/0 conn(0x7fd8ec0d1590 0x7fd8ec142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.538+0000 7fd8f3e00640 1 -- 172.21.15.118:0/1731719227 >> 172.21.15.118:0/1731719227 conn(0x7fd8ec06d110 msgr2=0x7fd8ec06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:00.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.539+0000 7fd8f3e00640 1 -- 172.21.15.118:0/1731719227 shutdown_connections 2024-09-21T06:05:00.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.539+0000 7fd8f3e00640 1 -- 172.21.15.118:0/1731719227 wait complete. 2024-09-21T06:05:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.541+0000 7fd8f3e00640 1 Processor -- start 2024-09-21T06:05:00.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.541+0000 7fd8f3e00640 1 -- start start 2024-09-21T06:05:00.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.542+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8ec13fae0 0x7fd8ec152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.542+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 0x7fd8ec1392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.542+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec15eed0 0x7fd8ec15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.542+0000 7fd8f3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec0cfb10 con 0x7fd8ec15eed0 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.542+0000 7fd8f3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec0cf990 con 0x7fd8ec13fae0 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.542+0000 7fd8f3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec0cfc90 con 0x7fd8ec13fef0 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec15eed0 0x7fd8ec15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec15eed0 0x7fd8ec15f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48752/0 (socket says 172.21.15.118:48752) 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 -- 172.21.15.118:0/2326982877 learned_addr learned my addr 172.21.15.118:0/2326982877 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1400640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8ec13fae0 0x7fd8ec152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f0a00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 0x7fd8ec1392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 -- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 msgr2=0x7fd8ec1392f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 0x7fd8ec1392f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 -- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8ec13fae0 msgr2=0x7fd8ec152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:00.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8ec13fae0 0x7fd8ec152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 -- 172.21.15.118:0/2326982877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec13edf0 con 0x7fd8ec15eed0 2024-09-21T06:05:00.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.543+0000 7fd8f1e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec15eed0 0x7fd8ec15f2e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4006010 tx=0x7fd8e4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:00.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.544+0000 7fd8e9600640 1 -- 172.21.15.118:0/2326982877 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4044070 con 0x7fd8ec15eed0 2024-09-21T06:05:00.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.544+0000 7fd8e9600640 1 -- 172.21.15.118:0/2326982877 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8e4004040 con 0x7fd8ec15eed0 2024-09-21T06:05:00.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.544+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec15f820 con 0x7fd8ec15eed0 2024-09-21T06:05:00.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.544+0000 7fd8e9600640 1 -- 172.21.15.118:0/2326982877 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4004430 con 0x7fd8ec15eed0 2024-09-21T06:05:00.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.544+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec13e0d0 con 0x7fd8ec15eed0 2024-09-21T06:05:00.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.545+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ec0d0140 con 0x7fd8ec15eed0 2024-09-21T06:05:00.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.546+0000 7fd8e9600640 1 -- 172.21.15.118:0/2326982877 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8e4047070 con 0x7fd8ec15eed0 2024-09-21T06:05:00.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.547+0000 7fd8e9600640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8cc078b90 0x7fd8cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:00.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.548+0000 7fd8e9600640 1 -- 172.21.15.118:0/2326982877 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd8e40bbc30 con 0x7fd8ec15eed0 2024-09-21T06:05:00.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.548+0000 7fd8f1400640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8cc078b90 0x7fd8cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:00.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.549+0000 7fd8f1400640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8cc078b90 0x7fd8cc07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0001720 tx=0x7fd8e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:00.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.552+0000 7fd8e9600640 1 -- 172.21.15.118:0/2326982877 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd8ec15f820 con 0x7fd8ec15eed0 2024-09-21T06:05:00.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.815+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7fd8ec153f60 con 0x7fd8ec15eed0 2024-09-21T06:05:00.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.816+0000 7fd8e9600640 1 -- 172.21.15.118:0/2326982877 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1620 (secure 0 0 0) 0x7fd8e4032030 con 0x7fd8ec15eed0 2024-09-21T06:05:00.818 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "stats": { 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "total_bytes": 1600000000, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "total_avail_bytes": 1597742716, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "total_used_bytes": 2257284, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "total_used_raw_bytes": 2257284, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "total_used_raw_ratio": 0.0014108024770393968, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "num_osds": 8, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "num_per_pool_osds": 0, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "num_per_pool_omap_osds": 0 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "stats_by_class": { 2024-09-21T06:05:00.819 INFO:teuthology.orchestra.run.smithi118.stdout: "hdd": { 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "total_bytes": 1600000000, 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "total_avail_bytes": 1597742716, 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "total_used_bytes": 2257284, 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "total_used_raw_bytes": 2257284, 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "total_used_raw_ratio": 0.0014108024770393968 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "name": ".mgr", 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 1, 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "stats": { 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "stored": 590368, 2024-09-21T06:05:00.820 INFO:teuthology.orchestra.run.smithi118.stdout: "objects": 2, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "kb_used": 577, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "bytes_used": 590368, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "percent_used": 0.00052957510342821479, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "max_avail": 557102656 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "name": "cephfs_metadata", 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "stats": { 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "stored": 2410, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "objects": 22, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "kb_used": 3, 2024-09-21T06:05:00.821 INFO:teuthology.orchestra.run.smithi118.stdout: "bytes_used": 2410, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "percent_used": 2.1629718958138255e-06, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "max_avail": 557102656 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "name": "cephfs_data", 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 5, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "stats": { 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "stored": 0, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "objects": 0, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "kb_used": 0, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bytes_used": 0, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "percent_used": 0, 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: "max_avail": 557102656 2024-09-21T06:05:00.822 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:00.823 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:00.823 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:00.823 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8cc078b90 msgr2=0x7fd8cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8cc078b90 0x7fd8cc07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0001720 tx=0x7fd8e0009040 comp rx=0 tx=0).stop 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec15eed0 msgr2=0x7fd8ec15f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec15eed0 0x7fd8ec15f2e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4006010 tx=0x7fd8e4003ce0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 shutdown_connections 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8ec15eed0 0x7fd8ec15f2e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8cc078b90 0x7fd8cc07b0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8ec13fef0 0x7fd8ec1392f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 --2- 172.21.15.118:0/2326982877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8ec13fae0 0x7fd8ec152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 >> 172.21.15.118:0/2326982877 conn(0x7fd8ec06d110 msgr2=0x7fd8ec15ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 shutdown_connections 2024-09-21T06:05:00.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00.819+0000 7fd8f3e00640 1 -- 172.21.15.118:0/2326982877 wait complete. 2024-09-21T06:05:00.844 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:05:00.844 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:05:00.844 DEBUG:teuthology.orchestra.run.smithi118:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-21T06:05:00.844 DEBUG:teuthology.orchestra.run.smithi118:> os.fchmod(fd, 0O666) 2024-09-21T06:05:00.844 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(fd) 2024-09-21T06:05:00.844 DEBUG:teuthology.orchestra.run.smithi118:> os.close(fd) 2024-09-21T06:05:00.844 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:05:00.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:00.961 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:05:01.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:05:01.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:01.091 INFO:teuthology.orchestra.run.smithi118.stdout:client4733 2024-09-21T06:05:01.092 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4733/osdmap') 2024-09-21T06:05:01.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 31 barrier 31 flags 0x588000 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:05:01.190 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:05:01.191 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:05:01.191 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:05:01.191 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:05:01.191 INFO:teuthology.orchestra.run.smithi118.stderr:799 bytes copied, 0.000108071 s, 7.4 MB/s 2024-09-21T06:05:01.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:01.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-21T06:05:01.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.420+0000 7f9a14200640 1 -- 172.21.15.118:0/1243596871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fae0 msgr2=0x7f9a0c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:01.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.420+0000 7f9a14200640 1 --2- 172.21.15.118:0/1243596871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fae0 0x7f9a0c0d0e80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009830 tx=0x7f9a0002a530 comp rx=0 tx=0).stop 2024-09-21T06:05:01.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.420+0000 7f9a14200640 1 -- 172.21.15.118:0/1243596871 shutdown_connections 2024-09-21T06:05:01.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.420+0000 7f9a14200640 1 --2- 172.21.15.118:0/1243596871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fae0 0x7f9a0c0d0e80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.420+0000 7f9a14200640 1 -- 172.21.15.118:0/1243596871 >> 172.21.15.118:0/1243596871 conn(0x7f9a0c06d110 msgr2=0x7f9a0c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:01.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.420+0000 7f9a14200640 1 -- 172.21.15.118:0/1243596871 shutdown_connections 2024-09-21T06:05:01.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.420+0000 7f9a14200640 1 -- 172.21.15.118:0/1243596871 wait complete. 2024-09-21T06:05:01.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.422+0000 7f9a14200640 1 Processor -- start 2024-09-21T06:05:01.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.422+0000 7f9a14200640 1 -- start start 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a14200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a0c13fae0 0x7f9a0c1f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a14200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fef0 0x7f9a0c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a14200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a0c142e40 0x7f9a0c1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a14200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c0cfce0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a14200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c0cfb60 con 0x7f9a0c13fae0 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a14200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0c0cfe60 con 0x7f9a0c142e40 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a10e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fef0 0x7f9a0c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a10e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fef0 0x7f9a0c0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48764/0 (socket says 172.21.15.118:48764) 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a10e00640 1 -- 172.21.15.118:0/3624344924 learned_addr learned my addr 172.21.15.118:0/3624344924 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a11800640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a0c13fae0 0x7f9a0c1f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:01.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.424+0000 7f9a12200640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a0c142e40 0x7f9a0c1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a10e00640 1 -- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a0c142e40 msgr2=0x7f9a0c1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a10e00640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a0c142e40 0x7f9a0c1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a10e00640 1 -- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a0c13fae0 msgr2=0x7f9a0c1f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a10e00640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a0c13fae0 0x7f9a0c1f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a10e00640 1 -- 172.21.15.118:0/3624344924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c13f4a0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a10e00640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fef0 0x7f9a0c0cd220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c400 tx=0x7f99f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a09600640 1 -- 172.21.15.118:0/3624344924 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8017070 con 0x7f9a0c13fef0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a09600640 1 -- 172.21.15.118:0/3624344924 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99f80053c0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c13e400 con 0x7f9a0c13fef0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a09600640 1 -- 172.21.15.118:0/3624344924 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8003850 con 0x7f9a0c13fef0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.425+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c13e9c0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.426+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c0d0310 con 0x7f9a0c13fef0 2024-09-21T06:05:01.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.428+0000 7f9a09600640 1 -- 172.21.15.118:0/3624344924 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99f801a070 con 0x7f9a0c13fef0 2024-09-21T06:05:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.429+0000 7f9a09600640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99ec078bc0 0x7f99ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.429+0000 7f9a09600640 1 -- 172.21.15.118:0/3624344924 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f99f809a0d0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.429+0000 7f9a11800640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99ec078bc0 0x7f99ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:01.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.430+0000 7f9a11800640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99ec078bc0 0x7f99ec07b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a00034000 tx=0x7f9a00004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.434+0000 7f9a09600640 1 -- 172.21.15.118:0/3624344924 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f99f8061ec0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.627+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7f9a0c15bad0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.846+0000 7f9a09600640 1 -- 172.21.15.118:0/3624344924 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v32) ==== 93+0+0 (secure 0 0 0) 0x7f99f80668f0 con 0x7f9a0c13fef0 2024-09-21T06:05:01.849 INFO:teuthology.orchestra.run.smithi118.stderr:pauserd,pausewr is set 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99ec078bc0 msgr2=0x7f99ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99ec078bc0 0x7f99ec07b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a00034000 tx=0x7f9a00004730 comp rx=0 tx=0).stop 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fef0 msgr2=0x7f9a0c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fef0 0x7f9a0c0cd220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c400 tx=0x7f99f800c8c0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 shutdown_connections 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99ec078bc0 0x7f99ec07b0d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a0c142e40 0x7f9a0c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a0c13fef0 0x7f9a0c0cd220 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 --2- 172.21.15.118:0/3624344924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a0c13fae0 0x7f9a0c1f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 >> 172.21.15.118:0/3624344924 conn(0x7f9a0c06d110 msgr2=0x7f9a0c15efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 shutdown_connections 2024-09-21T06:05:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:01.849+0000 7f9a14200640 1 -- 172.21.15.118:0/3624344924 wait complete. 2024-09-21T06:05:01.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-21T06:05:02.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.095+0000 7f63fc200640 1 -- 172.21.15.118:0/1021598244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fae0 msgr2=0x7f63f40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:02.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.095+0000 7f63fc200640 1 --2- 172.21.15.118:0/1021598244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fae0 0x7f63f40d0e80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009830 tx=0x7f63e802a510 comp rx=0 tx=0).stop 2024-09-21T06:05:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.095+0000 7f63fc200640 1 -- 172.21.15.118:0/1021598244 shutdown_connections 2024-09-21T06:05:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.095+0000 7f63fc200640 1 --2- 172.21.15.118:0/1021598244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63f413fef0 0x7f63f40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.095+0000 7f63fc200640 1 --2- 172.21.15.118:0/1021598244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fae0 0x7f63f40d0e80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.095+0000 7f63fc200640 1 -- 172.21.15.118:0/1021598244 >> 172.21.15.118:0/1021598244 conn(0x7f63f406d110 msgr2=0x7f63f406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.096+0000 7f63fc200640 1 -- 172.21.15.118:0/1021598244 shutdown_connections 2024-09-21T06:05:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.096+0000 7f63fc200640 1 -- 172.21.15.118:0/1021598244 wait complete. 2024-09-21T06:05:02.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.098+0000 7f63fc200640 1 Processor -- start 2024-09-21T06:05:02.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.098+0000 7f63fc200640 1 -- start start 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.099+0000 7f63fc200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63f413fae0 0x7f63f4139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.099+0000 7f63fc200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fef0 0x7f63f40b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.099+0000 7f63fc200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63f4142730 0x7f63f4141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.099+0000 7f63fc200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f63f40cfab0 con 0x7f63f413fef0 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.099+0000 7f63fc200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f63f40cf930 con 0x7f63f4142730 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.099+0000 7f63fc200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f63f40cfc30 con 0x7f63f413fae0 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.099+0000 7f63f8e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fef0 0x7f63f40b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fef0 0x7f63f40b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48786/0 (socket says 172.21.15.118:48786) 2024-09-21T06:05:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 -- 172.21.15.118:0/1574160627 learned_addr learned my addr 172.21.15.118:0/1574160627 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 -- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63f413fae0 msgr2=0x7f63f4139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f9800640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63f413fae0 0x7f63f4139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63f413fae0 0x7f63f4139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 -- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63f4142730 msgr2=0x7f63f4141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63fa200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63f4142730 0x7f63f4141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63f4142730 0x7f63f4141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 -- 172.21.15.118:0/1574160627 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f4140c50 con 0x7f63f413fef0 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63fa200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63f4142730 0x7f63f4141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f8e00640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fef0 0x7f63f40b3a60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63e000d6d0 tx=0x7f63e000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.100+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0017070 con 0x7f63f413fef0 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.101+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63e0009b10 con 0x7f63f413fef0 2024-09-21T06:05:02.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.101+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f4140f30 con 0x7f63f413fef0 2024-09-21T06:05:02.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.101+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0010460 con 0x7f63f413fef0 2024-09-21T06:05:02.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.101+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41414f0 con 0x7f63f413fef0 2024-09-21T06:05:02.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.102+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f413a740 con 0x7f63f413fef0 2024-09-21T06:05:02.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.103+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63e001a070 con 0x7f63f413fef0 2024-09-21T06:05:02.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.104+0000 7f63f1600640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63d4078bc0 0x7f63d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:02.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.104+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f63e009aff0 con 0x7f63f413fef0 2024-09-21T06:05:02.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.104+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=33+}) -- 0x7f63d40807a0 con 0x7f63f413fef0 2024-09-21T06:05:02.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.104+0000 7f63f9800640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63d4078bc0 0x7f63d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:02.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.105+0000 7f63f9800640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63d4078bc0 0x7f63d407b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f63e8034000 tx=0x7f63e8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:02.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.108+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f63e00634a0 con 0x7f63f413fef0 2024-09-21T06:05:02.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.301+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f63f415ae20 con 0x7f63f413fef0 2024-09-21T06:05:02.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.853+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v33) ==== 97+0+0 (secure 0 0 0) 0x7f63e0062da0 con 0x7f63f413fef0 2024-09-21T06:05:02.856 INFO:teuthology.orchestra.run.smithi118.stderr:pauserd,pausewr is unset 2024-09-21T06:05:02.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.854+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(33..33 src has 1..33) ==== 288+0+0 (secure 0 0 0) 0x7f63e00d22b0 con 0x7f63f413fef0 2024-09-21T06:05:02.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.854+0000 7f63f1600640 1 -- 172.21.15.118:0/1574160627 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=34}) -- 0x7f63d4081100 con 0x7f63f413fef0 2024-09-21T06:05:02.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63d4078bc0 msgr2=0x7f63d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:02.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63d4078bc0 0x7f63d407b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f63e8034000 tx=0x7f63e8004730 comp rx=0 tx=0).stop 2024-09-21T06:05:02.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fef0 msgr2=0x7f63f40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:02.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fef0 0x7f63f40b3a60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63e000d6d0 tx=0x7f63e000db90 comp rx=0 tx=0).stop 2024-09-21T06:05:02.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 shutdown_connections 2024-09-21T06:05:02.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63f4142730 0x7f63f4141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63f413fef0 0x7f63f40b3a60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63d4078bc0 0x7f63d407b0d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 --2- 172.21.15.118:0/1574160627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63f413fae0 0x7f63f4139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:02.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 >> 172.21.15.118:0/1574160627 conn(0x7f63f406d110 msgr2=0x7f63f415b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:02.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 shutdown_connections 2024-09-21T06:05:02.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:02.858+0000 7f63fc200640 1 -- 172.21.15.118:0/1574160627 wait complete. 2024-09-21T06:05:02.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:05:03.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.100+0000 7fecc8200640 1 -- 172.21.15.118:0/964351915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc013fef0 msgr2=0x7fecc00d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.100+0000 7fecc8200640 1 --2- 172.21.15.118:0/964351915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc013fef0 0x7fecc00d13c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fecc0071c00 tx=0x7fecac02a4d0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.100+0000 7fecc8200640 1 -- 172.21.15.118:0/964351915 shutdown_connections 2024-09-21T06:05:03.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.100+0000 7fecc8200640 1 --2- 172.21.15.118:0/964351915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc013fef0 0x7fecc00d13c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.100+0000 7fecc8200640 1 --2- 172.21.15.118:0/964351915 >> v2:172.21.15.149:3300/0 conn(0x7fecc013fae0 0x7fecc00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.100+0000 7fecc8200640 1 -- 172.21.15.118:0/964351915 >> 172.21.15.118:0/964351915 conn(0x7fecc006d110 msgr2=0x7fecc006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:03.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.101+0000 7fecc8200640 1 -- 172.21.15.118:0/964351915 shutdown_connections 2024-09-21T06:05:03.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.101+0000 7fecc8200640 1 -- 172.21.15.118:0/964351915 wait complete. 2024-09-21T06:05:03.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.103+0000 7fecc8200640 1 Processor -- start 2024-09-21T06:05:03.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.103+0000 7fecc8200640 1 -- start start 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.104+0000 7fecc8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecc013fae0 0x7fecc015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.104+0000 7fecc8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecc013fef0 0x7fecc01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.104+0000 7fecc8200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0142730 0x7fecc013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.104+0000 7fecc8200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fecc00cfa70 con 0x7fecc0142730 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.104+0000 7fecc8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fecc00cf8f0 con 0x7fecc013fae0 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.104+0000 7fecc8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fecc00cfbf0 con 0x7fecc013fef0 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0142730 0x7fecc013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0142730 0x7fecc013e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48806/0 (socket says 172.21.15.118:48806) 2024-09-21T06:05:03.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 -- 172.21.15.118:0/1331661285 learned_addr learned my addr 172.21.15.118:0/1331661285 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:03.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc5800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecc013fae0 0x7fecc015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc4e00640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecc013fef0 0x7fecc01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 -- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecc013fef0 msgr2=0x7fecc01584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecc013fef0 0x7fecc01584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 -- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecc013fae0 msgr2=0x7fecc015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecc013fae0 0x7fecc015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 -- 172.21.15.118:0/1331661285 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc013d8c0 con 0x7fecc0142730 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.105+0000 7fecc6200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0142730 0x7fecc013e9e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b970 tx=0x7fecb800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.106+0000 7fecbd600640 1 -- 172.21.15.118:0/1331661285 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8019070 con 0x7fecc0142730 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.106+0000 7fecbd600640 1 -- 172.21.15.118:0/1331661285 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecb800cc30 con 0x7fecc0142730 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.106+0000 7fecbd600640 1 -- 172.21.15.118:0/1331661285 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb80146a0 con 0x7fecc0142730 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.106+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc013dba0 con 0x7fecc0142730 2024-09-21T06:05:03.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.106+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc013e4c0 con 0x7fecc0142730 2024-09-21T06:05:03.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.107+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc00d0130 con 0x7fecc0142730 2024-09-21T06:05:03.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.108+0000 7fecbd600640 1 -- 172.21.15.118:0/1331661285 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fecb801c070 con 0x7fecc0142730 2024-09-21T06:05:03.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.109+0000 7fecbd600640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feca0078b90 0x7feca007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.109+0000 7fecbd600640 1 -- 172.21.15.118:0/1331661285 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fecb809aa30 con 0x7fecc0142730 2024-09-21T06:05:03.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.110+0000 7fecc5800640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feca0078b90 0x7feca007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.111+0000 7fecc5800640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feca0078b90 0x7feca007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fecb4004630 tx=0x7fecb400b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:03.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.114+0000 7fecbd600640 1 -- 172.21.15.118:0/1331661285 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fecb8062780 con 0x7fecc0142730 2024-09-21T06:05:03.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.302+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecc0153ef0 con 0x7fecc0142730 2024-09-21T06:05:03.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.303+0000 7fecbd600640 1 -- 172.21.15.118:0/1331661285 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16801 (secure 0 0 0) 0x7fecb80671b0 con 0x7fecc0142730 2024-09-21T06:05:03.306 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:03.306 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":33,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:02.848340+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:04:42.296386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T06:04:43.228581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:03.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feca0078b90 msgr2=0x7feca007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feca0078b90 0x7feca007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fecb4004630 tx=0x7fecb400b2e0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0142730 msgr2=0x7fecc013e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0142730 0x7fecc013e9e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b970 tx=0x7fecb800be30 comp rx=0 tx=0).stop 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 shutdown_connections 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecc0142730 0x7fecc013e9e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feca0078b90 0x7feca007b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecc013fef0 0x7fecc01584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 --2- 172.21.15.118:0/1331661285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecc013fae0 0x7fecc015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 >> 172.21.15.118:0/1331661285 conn(0x7fecc006d110 msgr2=0x7fecc00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 shutdown_connections 2024-09-21T06:05:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.306+0000 7fecc8200640 1 -- 172.21.15.118:0/1331661285 wait complete. 2024-09-21T06:05:03.331 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:05:03.332 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:05:03.332 DEBUG:teuthology.orchestra.run.smithi118:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-21T06:05:03.332 DEBUG:teuthology.orchestra.run.smithi118:> os.fchmod(fd, 0O666) 2024-09-21T06:05:03.332 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(fd) 2024-09-21T06:05:03.332 DEBUG:teuthology.orchestra.run.smithi118:> os.close(fd) 2024-09-21T06:05:03.332 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:03.445 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:05:03.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:05:03.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:03.574 INFO:teuthology.orchestra.run.smithi118.stdout:client4733 2024-09-21T06:05:03.574 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4733/osdmap') 2024-09-21T06:05:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 31 barrier 31 flags 0x588000 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:05:03.672 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:05:03.673 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:05:03.673 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:05:03.673 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:05:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:05:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:05:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:799 bytes copied, 6.6869e-05 s, 11.9 MB/s 2024-09-21T06:05:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:03.683 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:03.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.902+0000 7f94bca00640 1 -- 172.21.15.118:0/485631307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b813fef0 msgr2=0x7f94b80d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.902+0000 7f94bca00640 1 --2- 172.21.15.118:0/485631307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b813fef0 0x7f94b80d13c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f94b8071c00 tx=0x7f94a402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.902+0000 7f94bca00640 1 -- 172.21.15.118:0/485631307 shutdown_connections 2024-09-21T06:05:03.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.902+0000 7f94bca00640 1 --2- 172.21.15.118:0/485631307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b813fef0 0x7f94b80d13c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.902+0000 7f94bca00640 1 --2- 172.21.15.118:0/485631307 >> v2:172.21.15.149:3300/0 conn(0x7f94b813fae0 0x7f94b80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.902+0000 7f94bca00640 1 -- 172.21.15.118:0/485631307 >> 172.21.15.118:0/485631307 conn(0x7f94b806d110 msgr2=0x7f94b806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:03.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.903+0000 7f94bca00640 1 -- 172.21.15.118:0/485631307 shutdown_connections 2024-09-21T06:05:03.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.903+0000 7f94bca00640 1 -- 172.21.15.118:0/485631307 wait complete. 2024-09-21T06:05:03.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.905+0000 7f94bca00640 1 Processor -- start 2024-09-21T06:05:03.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.905+0000 7f94bca00640 1 -- start start 2024-09-21T06:05:03.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.906+0000 7f94bca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b813fae0 0x7f94b8132100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.906+0000 7f94bca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b813fef0 0x7f94b813db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.906+0000 7f94bca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b8142730 0x7f94b813e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.906+0000 7f94bca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80cfa70 con 0x7f94b8142730 2024-09-21T06:05:03.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.906+0000 7f94bca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80cf8f0 con 0x7f94b813fef0 2024-09-21T06:05:03.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.906+0000 7f94bca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94b80cfbf0 con 0x7f94b813fae0 2024-09-21T06:05:03.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b8142730 0x7f94b813e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b8142730 0x7f94b813e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48818/0 (socket says 172.21.15.118:48818) 2024-09-21T06:05:03.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b813fef0 0x7f94b813db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 -- 172.21.15.118:0/3613183013 learned_addr learned my addr 172.21.15.118:0/3613183013 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:03.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b5e00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b813fae0 0x7f94b8132100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 -- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b813fae0 msgr2=0x7f94b8132100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b813fae0 0x7f94b8132100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 -- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b813fef0 msgr2=0x7f94b813db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b813fef0 0x7f94b813db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 -- 172.21.15.118:0/3613183013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b813d390 con 0x7f94b8142730 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.907+0000 7f94b6800640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b8142730 0x7f94b813e0b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f94b000b9c0 tx=0x7f94b000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.908+0000 7f94ae000640 1 -- 172.21.15.118:0/3613183013 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0019070 con 0x7f94b8142730 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.908+0000 7f94ae000640 1 -- 172.21.15.118:0/3613183013 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94b000cc90 con 0x7f94b8142730 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.908+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b81413f0 con 0x7f94b8142730 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.908+0000 7f94ae000640 1 -- 172.21.15.118:0/3613183013 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b00146a0 con 0x7f94b8142730 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.908+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b81419b0 con 0x7f94b8142730 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.909+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b80d0150 con 0x7f94b8142730 2024-09-21T06:05:03.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.910+0000 7f94ae000640 1 -- 172.21.15.118:0/3613183013 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94b001d3f0 con 0x7f94b8142730 2024-09-21T06:05:03.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.911+0000 7f94ae000640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9498078bc0 0x7f949807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:03.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.911+0000 7f94ae000640 1 -- 172.21.15.118:0/3613183013 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f94b009a830 con 0x7f94b8142730 2024-09-21T06:05:03.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.912+0000 7f94b5e00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9498078bc0 0x7f949807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:03.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.912+0000 7f94b5e00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9498078bc0 0x7f949807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94a80058c0 tx=0x7f94a8005f60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:03.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:03.915+0000 7f94ae000640 1 -- 172.21.15.118:0/3613183013 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f94b00626b0 con 0x7f94b8142730 2024-09-21T06:05:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.135+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94b815bd00 con 0x7f94b8142730 2024-09-21T06:05:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.136+0000 7f94ae000640 1 -- 172.21.15.118:0/3613183013 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7f94b00670e0 con 0x7f94b8142730 2024-09-21T06:05:04.139 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:04.139 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:05:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:05:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9498078bc0 msgr2=0x7f949807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9498078bc0 0x7f949807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94a80058c0 tx=0x7f94a8005f60 comp rx=0 tx=0).stop 2024-09-21T06:05:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b8142730 msgr2=0x7f94b813e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b8142730 0x7f94b813e0b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f94b000b9c0 tx=0x7f94b000be80 comp rx=0 tx=0).stop 2024-09-21T06:05:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 shutdown_connections 2024-09-21T06:05:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94b8142730 0x7f94b813e0b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94b813fef0 0x7f94b813db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9498078bc0 0x7f949807b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 --2- 172.21.15.118:0/3613183013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94b813fae0 0x7f94b8132100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.138+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 >> 172.21.15.118:0/3613183013 conn(0x7f94b806d110 msgr2=0x7f94b806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.139+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 shutdown_connections 2024-09-21T06:05:04.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04.139+0000 7f94bca00640 1 -- 172.21.15.118:0/3613183013 wait complete. 2024-09-21T06:05:04.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json osdmap barrier 33 2024-09-21T06:05:04.413 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-21T06:05:04.413 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:05:04.413 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:05:04.413 DEBUG:teuthology.orchestra.run.smithi118:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-21T06:05:04.413 DEBUG:teuthology.orchestra.run.smithi118:> os.fchmod(fd, 0O666) 2024-09-21T06:05:04.413 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(fd) 2024-09-21T06:05:04.413 DEBUG:teuthology.orchestra.run.smithi118:> os.close(fd) 2024-09-21T06:05:04.414 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:05:04.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:04.530 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:05:04.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:05:04.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:04.663 INFO:teuthology.orchestra.run.smithi118.stdout:client4733 2024-09-21T06:05:04.663 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4733/osdmap') 2024-09-21T06:05:04.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 33 barrier 33 flags 0x588000 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:05:04.762 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:05:04.763 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:05:04.763 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:05:04.763 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:05:04.763 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:05:04.763 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:05:04.763 INFO:teuthology.orchestra.run.smithi118.stderr:799 bytes copied, 7.9884e-05 s, 10.0 MB/s 2024-09-21T06:05:04.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:04.772 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:05:04.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:05:04.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:04.863 INFO:teuthology.orchestra.run.smithi118.stdout:client4733 2024-09-21T06:05:04.863 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client4733/osdmap') 2024-09-21T06:05:04.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 33 barrier 33 flags 0x588000 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:05:04.962 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:05:04.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:05:04.963 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:05:04.963 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:05:04.963 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:05:04.963 INFO:teuthology.orchestra.run.smithi118.stderr:799 bytes copied, 6.4479e-05 s, 12.4 MB/s 2024-09-21T06:05:04.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:04.972 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:05:04.973 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:05:04.973 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:05:05.049 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:05:05.147 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:05:05.147 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:05:05.147 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:05.148 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:05.183 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:05.183 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:05.258 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 -- 172.21.15.118:0/2791498758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d38144dc0 msgr2=0x7f1d38144860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2791498758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d38144dc0 0x7f1d38144860 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1d380ce560 tx=0x7f1d2c02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 -- 172.21.15.118:0/2791498758 shutdown_connections 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2791498758 >> v2:172.21.15.149:3300/0 conn(0x7f1d380cedb0 0x7f1d380cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2791498758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d38144dc0 0x7f1d38144860 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 -- 172.21.15.118:0/2791498758 >> 172.21.15.118:0/2791498758 conn(0x7f1d3806d6e0 msgr2=0x7f1d380b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 -- 172.21.15.118:0/2791498758 shutdown_connections 2024-09-21T06:05:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.517+0000 7f1d3de00640 1 -- 172.21.15.118:0/2791498758 wait complete. 2024-09-21T06:05:05.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.519+0000 7f1d3de00640 1 Processor -- start 2024-09-21T06:05:05.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.520+0000 7f1d3de00640 1 -- start start 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d380cedb0 0x7f1d3815acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d380cf700 0x7f1d380b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d38144dc0 0x7f1d380b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3de00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3815fe40 con 0x7f1d380cedb0 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d380b5230 con 0x7f1d380cf700 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3815ffc0 con 0x7f1d38144dc0 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d380cedb0 0x7f1d3815acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d380cedb0 0x7f1d3815acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48832/0 (socket says 172.21.15.118:48832) 2024-09-21T06:05:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.521+0000 7f1d3ca00640 1 -- 172.21.15.118:0/2105845716 learned_addr learned my addr 172.21.15.118:0/2105845716 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d37e00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d380cf700 0x7f1d380b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3ca00640 1 -- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d38144dc0 msgr2=0x7f1d380b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3d400640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d38144dc0 0x7f1d380b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3ca00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d38144dc0 0x7f1d380b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3ca00640 1 -- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d380cf700 msgr2=0x7f1d380b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3ca00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d380cf700 0x7f1d380b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3ca00640 1 -- 172.21.15.118:0/2105845716 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d38143bb0 con 0x7f1d380cedb0 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d37e00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d380cf700 0x7f1d380b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3d400640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d38144dc0 0x7f1d380b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3ca00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d380cedb0 0x7f1d3815acc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c034040 tx=0x7f1d2c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d34c00640 1 -- 172.21.15.118:0/2105845716 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c03e030 con 0x7f1d380cedb0 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d34c00640 1 -- 172.21.15.118:0/2105845716 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d2c003d10 con 0x7f1d380cedb0 2024-09-21T06:05:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d38143e90 con 0x7f1d380cedb0 2024-09-21T06:05:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.522+0000 7f1d34c00640 1 -- 172.21.15.118:0/2105845716 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c035040 con 0x7f1d380cedb0 2024-09-21T06:05:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.523+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d380b1590 con 0x7f1d380cedb0 2024-09-21T06:05:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.524+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d38160470 con 0x7f1d380cedb0 2024-09-21T06:05:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.525+0000 7f1d34c00640 1 -- 172.21.15.118:0/2105845716 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d2c041030 con 0x7f1d380cedb0 2024-09-21T06:05:05.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.526+0000 7f1d34c00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d18078bc0 0x7f1d1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:05.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.526+0000 7f1d34c00640 1 -- 172.21.15.118:0/2105845716 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1d2c0bb4b0 con 0x7f1d380cedb0 2024-09-21T06:05:05.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.526+0000 7f1d37e00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d18078bc0 0x7f1d1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:05.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.527+0000 7f1d37e00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d18078bc0 0x7f1d1807b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1d381e9ed0 tx=0x7f1d24005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.530+0000 7f1d34c00640 1 -- 172.21.15.118:0/2105845716 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1d2c0838e0 con 0x7f1d380cedb0 2024-09-21T06:05:05.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.731+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1d38072e00 con 0x7f1d380cedb0 2024-09-21T06:05:05.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.731+0000 7f1d34c00640 1 -- 172.21.15.118:0/2105845716 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f1d2c0831e0 con 0x7f1d380cedb0 2024-09-21T06:05:05.734 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d18078bc0 msgr2=0x7f1d1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d18078bc0 0x7f1d1807b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1d381e9ed0 tx=0x7f1d24005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d380cedb0 msgr2=0x7f1d3815acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d380cedb0 0x7f1d3815acc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c034040 tx=0x7f1d2c003820 comp rx=0 tx=0).stop 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 shutdown_connections 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d18078bc0 0x7f1d1807b0d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d38144dc0 0x7f1d380b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d380cf700 0x7f1d380b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 --2- 172.21.15.118:0/2105845716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d380cedb0 0x7f1d3815acc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 >> 172.21.15.118:0/2105845716 conn(0x7f1d3806d6e0 msgr2=0x7f1d38141770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 shutdown_connections 2024-09-21T06:05:05.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:05.734+0000 7f1d3de00640 1 -- 172.21.15.118:0/2105845716 wait complete. 2024-09-21T06:05:05.761 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:05:05.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:05.761 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:05:05.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:05:05.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:05.857 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:05:05.895 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:05:05.896 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:05:05.896 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:05.931 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:05:05.931 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:06.007 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:05:06.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 -- 172.21.15.118:0/2813385478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 msgr2=0x7fb1700d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 --2- 172.21.15.118:0/2813385478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700d0e80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb160009830 tx=0x7fb16002a510 comp rx=0 tx=0).stop 2024-09-21T06:05:06.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 -- 172.21.15.118:0/2813385478 shutdown_connections 2024-09-21T06:05:06.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 --2- 172.21.15.118:0/2813385478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb17013fef0 0x7fb1700d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 --2- 172.21.15.118:0/2813385478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700d0e80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 -- 172.21.15.118:0/2813385478 >> 172.21.15.118:0/2813385478 conn(0x7fb17006d110 msgr2=0x7fb17006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:06.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 -- 172.21.15.118:0/2813385478 shutdown_connections 2024-09-21T06:05:06.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.226+0000 7fb176400640 1 -- 172.21.15.118:0/2813385478 wait complete. 2024-09-21T06:05:06.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.229+0000 7fb176400640 1 Processor -- start 2024-09-21T06:05:06.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.229+0000 7fb176400640 1 -- start start 2024-09-21T06:05:06.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.230+0000 7fb176400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.230+0000 7fb176400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb17013fef0 0x7fb170155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.230+0000 7fb176400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb170142730 0x7fb170152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.230+0000 7fb176400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700cfab0 con 0x7fb17013fae0 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.230+0000 7fb176400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700cf930 con 0x7fb170142730 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.230+0000 7fb176400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700cfc30 con 0x7fb17013fef0 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.230+0000 7fb16f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56324/0 (socket says 172.21.15.118:56324) 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 -- 172.21.15.118:0/491640042 learned_addr learned my addr 172.21.15.118:0/491640042 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb166a00640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb17013fef0 0x7fb170155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16fe00640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb170142730 0x7fb170152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 -- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb17013fef0 msgr2=0x7fb170155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb17013fef0 0x7fb170155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 -- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb170142730 msgr2=0x7fb170152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb170142730 0x7fb170152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 -- 172.21.15.118:0/491640042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700b5490 con 0x7fb17013fae0 2024-09-21T06:05:06.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.231+0000 7fb16f400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700b4f50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb160009950 tx=0x7fb160033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:06.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.232+0000 7fb167e00640 1 -- 172.21.15.118:0/491640042 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160005c90 con 0x7fb17013fae0 2024-09-21T06:05:06.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.232+0000 7fb167e00640 1 -- 172.21.15.118:0/491640042 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb160031e50 con 0x7fb17013fae0 2024-09-21T06:05:06.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.232+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1701f3d50 con 0x7fb17013fae0 2024-09-21T06:05:06.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.232+0000 7fb167e00640 1 -- 172.21.15.118:0/491640042 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160005260 con 0x7fb17013fae0 2024-09-21T06:05:06.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.232+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1701f42d0 con 0x7fb17013fae0 2024-09-21T06:05:06.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.233+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17015e2f0 con 0x7fb17013fae0 2024-09-21T06:05:06.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.234+0000 7fb167e00640 1 -- 172.21.15.118:0/491640042 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb160005400 con 0x7fb17013fae0 2024-09-21T06:05:06.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.235+0000 7fb167e00640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb14c078b90 0x7fb14c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.235+0000 7fb167e00640 1 -- 172.21.15.118:0/491640042 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb1600bbeb0 con 0x7fb17013fae0 2024-09-21T06:05:06.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.236+0000 7fb166a00640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb14c078b90 0x7fb14c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.236+0000 7fb166a00640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb14c078b90 0x7fb14c07b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1700b42a0 tx=0x7fb158005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:06.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.240+0000 7fb167e00640 1 -- 172.21.15.118:0/491640042 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb17015e2f0 con 0x7fb17013fae0 2024-09-21T06:05:06.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.436+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1700d0170 con 0x7fb17013fae0 2024-09-21T06:05:06.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.437+0000 7fb167e00640 1 -- 172.21.15.118:0/491640042 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fb16003f030 con 0x7fb17013fae0 2024-09-21T06:05:06.439 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:05:06.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb14c078b90 msgr2=0x7fb14c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb14c078b90 0x7fb14c07b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1700b42a0 tx=0x7fb158005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:06.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 msgr2=0x7fb1700b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700b4f50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb160009950 tx=0x7fb160033c20 comp rx=0 tx=0).stop 2024-09-21T06:05:06.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 shutdown_connections 2024-09-21T06:05:06.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb170142730 0x7fb170152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb14c078b90 0x7fb14c07b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb17013fef0 0x7fb170155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 --2- 172.21.15.118:0/491640042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb17013fae0 0x7fb1700b4f50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.439+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 >> 172.21.15.118:0/491640042 conn(0x7fb17006d110 msgr2=0x7fb17015bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:06.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.440+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 shutdown_connections 2024-09-21T06:05:06.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.440+0000 7fb176400640 1 -- 172.21.15.118:0/491640042 wait complete. 2024-09-21T06:05:06.465 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:05:06.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:06.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:05:06.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:05:06.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:06.528 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:05:06.564 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:05:06.565 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:06.565 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:06.600 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:05:06.600 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:05:06.600 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:05:06.601 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:06.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:05:06.640 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:06.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.858+0000 7f3ff1a00640 1 -- 172.21.15.118:0/1759066728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 msgr2=0x7f3fec0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.858+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/1759066728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec0d0e80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009830 tx=0x7f3fdc02a510 comp rx=0 tx=0).stop 2024-09-21T06:05:06.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.858+0000 7f3ff1a00640 1 -- 172.21.15.118:0/1759066728 shutdown_connections 2024-09-21T06:05:06.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.858+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/1759066728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fec142e40 0x7f3fec0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.858+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/1759066728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec0d0e80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.858+0000 7f3ff1a00640 1 -- 172.21.15.118:0/1759066728 >> 172.21.15.118:0/1759066728 conn(0x7f3fec06d110 msgr2=0x7f3fec06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:06.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.859+0000 7f3ff1a00640 1 -- 172.21.15.118:0/1759066728 shutdown_connections 2024-09-21T06:05:06.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.859+0000 7f3ff1a00640 1 -- 172.21.15.118:0/1759066728 wait complete. 2024-09-21T06:05:06.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.861+0000 7f3ff1a00640 1 Processor -- start 2024-09-21T06:05:06.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.861+0000 7f3ff1a00640 1 -- start start 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.862+0000 7f3ff1a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec13d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.862+0000 7f3ff1a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fec13fef0 0x7f3fec13b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.862+0000 7f3ff1a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fec142e40 0x7f3fec1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.862+0000 7f3ff1a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec0cfa90 con 0x7f3fec13fae0 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.862+0000 7f3ff1a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec0cf910 con 0x7f3fec13fef0 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.862+0000 7f3ff1a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3fec0cfc10 con 0x7f3fec142e40 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec13d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec13d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56348/0 (socket says 172.21.15.118:56348) 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 -- 172.21.15.118:0/3138213072 learned_addr learned my addr 172.21.15.118:0/3138213072 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3fea000640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fec13fef0 0x7f3fec13b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feb400640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fec142e40 0x7f3fec1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 -- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fec142e40 msgr2=0x7f3fec1f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fec142e40 0x7f3fec1f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 -- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fec13fef0 msgr2=0x7f3fec13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fec13fef0 0x7f3fec13b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.863+0000 7f3feaa00640 1 -- 172.21.15.118:0/3138213072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec154720 con 0x7f3fec13fae0 2024-09-21T06:05:06.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.864+0000 7f3feaa00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec13d160 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc000c00 tx=0x7f3fdc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:06.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.864+0000 7f3fe2a00640 1 -- 172.21.15.118:0/3138213072 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc031d60 con 0x7f3fec13fae0 2024-09-21T06:05:06.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.864+0000 7f3fe2a00640 1 -- 172.21.15.118:0/3138213072 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fdc033e10 con 0x7f3fec13fae0 2024-09-21T06:05:06.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.864+0000 7f3fe2a00640 1 -- 172.21.15.118:0/3138213072 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0332b0 con 0x7f3fec13fae0 2024-09-21T06:05:06.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.864+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fec073f70 con 0x7f3fec13fae0 2024-09-21T06:05:06.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.864+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fec074530 con 0x7f3fec13fae0 2024-09-21T06:05:06.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.865+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fec0d0130 con 0x7f3fec13fae0 2024-09-21T06:05:06.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.866+0000 7f3fe2a00640 1 -- 172.21.15.118:0/3138213072 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fdc033450 con 0x7f3fec13fae0 2024-09-21T06:05:06.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.867+0000 7f3fe2a00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3fcc078bc0 0x7f3fcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.867+0000 7f3fe2a00640 1 -- 172.21.15.118:0/3138213072 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3fdc0bbfe0 con 0x7f3fec13fae0 2024-09-21T06:05:06.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.868+0000 7f3fea000640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3fcc078bc0 0x7f3fcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.868+0000 7f3fea000640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3fcc078bc0 0x7f3fcc07b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3fec13f510 tx=0x7f3fd8007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:06.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:06.873+0000 7f3fe2a00640 1 -- 172.21.15.118:0/3138213072 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3fdc03f030 con 0x7f3fec13fae0 2024-09-21T06:05:07.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.099+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fec074700 con 0x7f3fec13fae0 2024-09-21T06:05:07.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.099+0000 7f3fe2a00640 1 -- 172.21.15.118:0/3138213072 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7f3fdc083e50 con 0x7f3fec13fae0 2024-09-21T06:05:07.102 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:07.102 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:05:07.103 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:05:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3fcc078bc0 msgr2=0x7f3fcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3fcc078bc0 0x7f3fcc07b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3fec13f510 tx=0x7f3fd8007e90 comp rx=0 tx=0).stop 2024-09-21T06:05:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 msgr2=0x7f3fec13d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec13d160 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc000c00 tx=0x7f3fdc033c20 comp rx=0 tx=0).stop 2024-09-21T06:05:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 shutdown_connections 2024-09-21T06:05:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3fcc078bc0 0x7f3fcc07b0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fec142e40 0x7f3fec1f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fec13fef0 0x7f3fec13b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 --2- 172.21.15.118:0/3138213072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec13fae0 0x7f3fec13d160 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.102+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 >> 172.21.15.118:0/3138213072 conn(0x7f3fec06d110 msgr2=0x7f3fec13c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:07.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.103+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 shutdown_connections 2024-09-21T06:05:07.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.103+0000 7f3ff1a00640 1 -- 172.21.15.118:0/3138213072 wait complete. 2024-09-21T06:05:07.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 -- 172.21.15.118:0/2607345699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc180d1590 msgr2=0x7fdc18142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 --2- 172.21.15.118:0/2607345699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc180d1590 0x7fdc18142730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdc1815d420 tx=0x7fdc0002a4b0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 -- 172.21.15.118:0/2607345699 shutdown_connections 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 --2- 172.21.15.118:0/2607345699 >> v2:172.21.15.149:3300/0 conn(0x7fdc1813fef0 0x7fdc18142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 --2- 172.21.15.118:0/2607345699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc180d1590 0x7fdc18142730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 -- 172.21.15.118:0/2607345699 >> 172.21.15.118:0/2607345699 conn(0x7fdc1806d110 msgr2=0x7fdc1806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 -- 172.21.15.118:0/2607345699 shutdown_connections 2024-09-21T06:05:07.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.343+0000 7fdc1da00640 1 -- 172.21.15.118:0/2607345699 wait complete. 2024-09-21T06:05:07.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.345+0000 7fdc1da00640 1 Processor -- start 2024-09-21T06:05:07.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.346+0000 7fdc1da00640 1 -- start start 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc1da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc1813fae0 0x7fdc1813aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc1da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc1813fef0 0x7fdc1813b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc1da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc181f7670 0x7fdc181f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc1da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdc180cfa70 con 0x7fdc1813fef0 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc1da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdc180cf8f0 con 0x7fdc1813fae0 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc1da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdc180cfbf0 con 0x7fdc181f7670 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc0e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc1813fef0 0x7fdc1813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc0e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc1813fef0 0x7fdc1813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56360/0 (socket says 172.21.15.118:56360) 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.347+0000 7fdc0e000640 1 -- 172.21.15.118:0/1406753359 learned_addr learned my addr 172.21.15.118:0/1406753359 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc16a00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc1813fae0 0x7fdc1813aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc17400640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc181f7670 0x7fdc181f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0e000640 1 -- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc181f7670 msgr2=0x7fdc181f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0e000640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc181f7670 0x7fdc181f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0e000640 1 -- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc1813fae0 msgr2=0x7fdc1813aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0e000640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc1813fae0 0x7fdc1813aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0e000640 1 -- 172.21.15.118:0/1406753359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1815a140 con 0x7fdc1813fef0 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0e000640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc1813fef0 0x7fdc1813b410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009780 tx=0x7fdc00033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0f400640 1 -- 172.21.15.118:0/1406753359 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00031d60 con 0x7fdc1813fef0 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0f400640 1 -- 172.21.15.118:0/1406753359 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc00033e10 con 0x7fdc1813fef0 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc0f400640 1 -- 172.21.15.118:0/1406753359 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00005260 con 0x7fdc1813fef0 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.348+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1815a420 con 0x7fdc1813fef0 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.349+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1815a9e0 con 0x7fdc1813fef0 2024-09-21T06:05:07.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.350+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1813de00 con 0x7fdc1813fef0 2024-09-21T06:05:07.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.351+0000 7fdc0f400640 1 -- 172.21.15.118:0/1406753359 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc00005400 con 0x7fdc1813fef0 2024-09-21T06:05:07.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.352+0000 7fdc0f400640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdbf4078b90 0x7fdbf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.352+0000 7fdc0f400640 1 -- 172.21.15.118:0/1406753359 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdc000bbd80 con 0x7fdc1813fef0 2024-09-21T06:05:07.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.352+0000 7fdc16a00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdbf4078b90 0x7fdbf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.353+0000 7fdc16a00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdbf4078b90 0x7fdbf407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001720 tx=0x7fdc08007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:07.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.356+0000 7fdc0f400640 1 -- 172.21.15.118:0/1406753359 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdc0003f030 con 0x7fdc1813fef0 2024-09-21T06:05:07.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.580+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc180d0110 con 0x7fdc1813fef0 2024-09-21T06:05:07.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.580+0000 7fdc0f400640 1 -- 172.21.15.118:0/1406753359 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7fdc00083c00 con 0x7fdc1813fef0 2024-09-21T06:05:07.583 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:07.583 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:05:07.584 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdbf4078b90 msgr2=0x7fdbf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdbf4078b90 0x7fdbf407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001720 tx=0x7fdc08007e90 comp rx=0 tx=0).stop 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc1813fef0 msgr2=0x7fdc1813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc1813fef0 0x7fdc1813b410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009780 tx=0x7fdc00033c20 comp rx=0 tx=0).stop 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 shutdown_connections 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdbf4078b90 0x7fdbf407b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc181f7670 0x7fdc181f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc1813fef0 0x7fdc1813b410 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 --2- 172.21.15.118:0/1406753359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc1813fae0 0x7fdc1813aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 >> 172.21.15.118:0/1406753359 conn(0x7fdc1806d110 msgr2=0x7fdc1815fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:07.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 shutdown_connections 2024-09-21T06:05:07.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.583+0000 7fdc1da00640 1 -- 172.21.15.118:0/1406753359 wait complete. 2024-09-21T06:05:07.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 -- 172.21.15.118:0/3069523630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 msgr2=0x7f040815f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 --2- 172.21.15.118:0/3069523630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f040815f510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0408069210 tx=0x7f03f002a4b0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 -- 172.21.15.118:0/3069523630 shutdown_connections 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 --2- 172.21.15.118:0/3069523630 >> v2:172.21.15.149:3300/0 conn(0x7f04080cdfd0 0x7f04080b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 --2- 172.21.15.118:0/3069523630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f040815f510 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 -- 172.21.15.118:0/3069523630 >> 172.21.15.118:0/3069523630 conn(0x7f04080748d0 msgr2=0x7f0408074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 -- 172.21.15.118:0/3069523630 shutdown_connections 2024-09-21T06:05:07.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.827+0000 7f040da00640 1 -- 172.21.15.118:0/3069523630 wait complete. 2024-09-21T06:05:07.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.829+0000 7f040da00640 1 Processor -- start 2024-09-21T06:05:07.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.829+0000 7f040da00640 1 -- start start 2024-09-21T06:05:07.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f040da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f04080ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f040da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04080b6950 0x7f04080c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f040da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04080cdfd0 0x7f04080af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f040da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f04080b4710 con 0x7f0408075580 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f040da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f04080b4590 con 0x7f04080cdfd0 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f040da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f04080b4890 con 0x7f04080b6950 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f04080ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f04080ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56364/0 (socket says 172.21.15.118:56364) 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 -- 172.21.15.118:0/1831682115 learned_addr learned my addr 172.21.15.118:0/1831682115 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f03fe000640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04080b6950 0x7f04080c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0407400640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04080cdfd0 0x7f04080af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 -- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04080b6950 msgr2=0x7f04080c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04080b6950 0x7f04080c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 -- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04080cdfd0 msgr2=0x7f04080af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04080cdfd0 0x7f04080af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.831+0000 7f0406a00640 1 -- 172.21.15.118:0/1831682115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04080cafc0 con 0x7f0408075580 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.832+0000 7f0406a00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f04080ca6e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f03f800c3a0 tx=0x7f03f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.832+0000 7f03ff400640 1 -- 172.21.15.118:0/1831682115 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8011790 con 0x7f0408075580 2024-09-21T06:05:07.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.832+0000 7f03ff400640 1 -- 172.21.15.118:0/1831682115 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03f8017070 con 0x7f0408075580 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.832+0000 7f03ff400640 1 -- 172.21.15.118:0/1831682115 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8011cc0 con 0x7f0408075580 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.832+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04081f5d10 con 0x7f0408075580 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.832+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04081f62d0 con 0x7f0408075580 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.833+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04080b4d40 con 0x7f0408075580 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.834+0000 7f03ff400640 1 -- 172.21.15.118:0/1831682115 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03f801c460 con 0x7f0408075580 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.835+0000 7f03ff400640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03e4078b90 0x7f03e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.836+0000 7f03ff400640 1 -- 172.21.15.118:0/1831682115 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f03f809a940 con 0x7f0408075580 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.836+0000 7f03fe000640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03e4078b90 0x7f03e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.837+0000 7f03fe000640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03e4078b90 0x7f03e407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03f0034000 tx=0x7f03f0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:07.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:07.840+0000 7f03ff400640 1 -- 172.21.15.118:0/1831682115 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f03f80627c0 con 0x7f0408075580 2024-09-21T06:05:08.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.027+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04080b3820 con 0x7f0408075580 2024-09-21T06:05:08.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.028+0000 7f03ff400640 1 -- 172.21.15.118:0/1831682115 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16801 (secure 0 0 0) 0x7f03f80671f0 con 0x7f0408075580 2024-09-21T06:05:08.031 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:08.031 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":33,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:02.848340+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:04:42.296386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T06:04:43.228581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:08.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.030+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03e4078b90 msgr2=0x7f03e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.030+0000 7f040da00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03e4078b90 0x7f03e407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03f0034000 tx=0x7f03f0004730 comp rx=0 tx=0).stop 2024-09-21T06:05:08.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.030+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 msgr2=0x7f04080ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.030+0000 7f040da00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f04080ca6e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f03f800c3a0 tx=0x7f03f800c860 comp rx=0 tx=0).stop 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 shutdown_connections 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04080cdfd0 0x7f04080af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03e4078b90 0x7f03e407b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04080b6950 0x7f04080c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 --2- 172.21.15.118:0/1831682115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0408075580 0x7f04080ca6e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 >> 172.21.15.118:0/1831682115 conn(0x7f04080748d0 msgr2=0x7f04080b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 shutdown_connections 2024-09-21T06:05:08.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.031+0000 7f040da00640 1 -- 172.21.15.118:0/1831682115 wait complete. 2024-09-21T06:05:08.056 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:05:08.056 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 -- 172.21.15.118:0/2365733548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee880cd310 msgr2=0x7fee88073ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 --2- 172.21.15.118:0/2365733548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee880cd310 0x7fee88073ce0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee880d0630 tx=0x7fee7402a560 comp rx=0 tx=0).stop 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 -- 172.21.15.118:0/2365733548 shutdown_connections 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 --2- 172.21.15.118:0/2365733548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee880cd310 0x7fee88073ce0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 --2- 172.21.15.118:0/2365733548 >> v2:172.21.15.149:3300/0 conn(0x7fee88074220 0x7fee8815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 --2- 172.21.15.118:0/2365733548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee88160840 0x7fee880ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 -- 172.21.15.118:0/2365733548 >> 172.21.15.118:0/2365733548 conn(0x7fee8806d6e0 msgr2=0x7fee880b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 -- 172.21.15.118:0/2365733548 shutdown_connections 2024-09-21T06:05:08.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.276+0000 7fee8ec00640 1 -- 172.21.15.118:0/2365733548 wait complete. 2024-09-21T06:05:08.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.278+0000 7fee8ec00640 1 Processor -- start 2024-09-21T06:05:08.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.278+0000 7fee8ec00640 1 -- start start 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8ec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee88074220 0x7fee880cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee880cd310 0x7fee8813c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee88160840 0x7fee8813cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8ec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fee880b5bb0 con 0x7fee88074220 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee8815e0b0 con 0x7fee880cd310 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee880b5d30 con 0x7fee88160840 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee88074220 0x7fee880cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee88074220 0x7fee880cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56386/0 (socket says 172.21.15.118:56386) 2024-09-21T06:05:08.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8d800640 1 -- 172.21.15.118:0/3215476960 learned_addr learned my addr 172.21.15.118:0/3215476960 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8ce00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee880cd310 0x7fee8813c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8e200640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee88160840 0x7fee8813cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.280+0000 7fee8d800640 1 -- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee88160840 msgr2=0x7fee8813cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8d800640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee88160840 0x7fee8813cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8d800640 1 -- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee880cd310 msgr2=0x7fee8813c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8d800640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee880cd310 0x7fee8813c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8d800640 1 -- 172.21.15.118:0/3215476960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee88136cc0 con 0x7fee88074220 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8e200640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee88160840 0x7fee8813cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8d800640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee88074220 0x7fee880cbc00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00d6d0 tx=0x7fee7c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee85600640 1 -- 172.21.15.118:0/3215476960 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c017070 con 0x7fee88074220 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee85600640 1 -- 172.21.15.118:0/3215476960 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee7c005330 con 0x7fee88074220 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8813d1d0 con 0x7fee88074220 2024-09-21T06:05:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee85600640 1 -- 172.21.15.118:0/3215476960 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c009820 con 0x7fee88074220 2024-09-21T06:05:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.281+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee88137260 con 0x7fee88074220 2024-09-21T06:05:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.282+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee880b6250 con 0x7fee88074220 2024-09-21T06:05:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.283+0000 7fee85600640 1 -- 172.21.15.118:0/3215476960 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee7c009bd0 con 0x7fee88074220 2024-09-21T06:05:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.284+0000 7fee85600640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee68078b90 0x7fee6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.284+0000 7fee85600640 1 -- 172.21.15.118:0/3215476960 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fee7c09afd0 con 0x7fee88074220 2024-09-21T06:05:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.285+0000 7fee8ce00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee68078b90 0x7fee6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.286+0000 7fee8ce00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee68078b90 0x7fee6807b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee74033000 tx=0x7fee74004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:08.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.289+0000 7fee85600640 1 -- 172.21.15.118:0/3215476960 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee7c062e50 con 0x7fee88074220 2024-09-21T06:05:08.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.510+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee880b3290 con 0x7fee88074220 2024-09-21T06:05:08.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.511+0000 7fee85600640 1 -- 172.21.15.118:0/3215476960 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7fee7c067880 con 0x7fee88074220 2024-09-21T06:05:08.513 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:08.514 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:05:08.514 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee68078b90 msgr2=0x7fee6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee68078b90 0x7fee6807b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fee74033000 tx=0x7fee74004730 comp rx=0 tx=0).stop 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee88074220 msgr2=0x7fee880cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee88074220 0x7fee880cbc00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00d6d0 tx=0x7fee7c00db90 comp rx=0 tx=0).stop 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 shutdown_connections 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee68078b90 0x7fee6807b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee88160840 0x7fee8813cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee880cd310 0x7fee8813c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 --2- 172.21.15.118:0/3215476960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee88074220 0x7fee880cbc00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 >> 172.21.15.118:0/3215476960 conn(0x7fee8806d6e0 msgr2=0x7fee8815ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:08.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 shutdown_connections 2024-09-21T06:05:08.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.513+0000 7fee8ec00640 1 -- 172.21.15.118:0/3215476960 wait complete. 2024-09-21T06:05:08.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:08.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.755+0000 7f09f5600640 1 -- 172.21.15.118:0/3336587195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 msgr2=0x7f09f00cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.755+0000 7f09f5600640 1 --2- 172.21.15.118:0/3336587195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f00cca40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f09d8005fd0 tx=0x7f09d802a540 comp rx=0 tx=0).stop 2024-09-21T06:05:08.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.755+0000 7f09f5600640 1 -- 172.21.15.118:0/3336587195 shutdown_connections 2024-09-21T06:05:08.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.755+0000 7f09f5600640 1 --2- 172.21.15.118:0/3336587195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09f00ccf80 0x7f09f0073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.755+0000 7f09f5600640 1 --2- 172.21.15.118:0/3336587195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f00cca40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.755+0000 7f09f5600640 1 -- 172.21.15.118:0/3336587195 >> 172.21.15.118:0/3336587195 conn(0x7f09f006d110 msgr2=0x7f09f006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:08.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.756+0000 7f09f5600640 1 -- 172.21.15.118:0/3336587195 shutdown_connections 2024-09-21T06:05:08.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.756+0000 7f09f5600640 1 -- 172.21.15.118:0/3336587195 wait complete. 2024-09-21T06:05:08.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.758+0000 7f09f5600640 1 Processor -- start 2024-09-21T06:05:08.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.758+0000 7f09f5600640 1 -- start start 2024-09-21T06:05:08.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.759+0000 7f09f5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f01e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.759+0000 7f09f5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09f00ccf80 0x7f09f01e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.759+0000 7f09f5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09f015cfd0 0x7f09f015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.759+0000 7f09f5600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f09f0073cc0 con 0x7f09f00b3a60 2024-09-21T06:05:08.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.759+0000 7f09f5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f09f0073b40 con 0x7f09f015cfd0 2024-09-21T06:05:08.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.759+0000 7f09f5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f09f0073e40 con 0x7f09f00ccf80 2024-09-21T06:05:08.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f01e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:08.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f01e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56414/0 (socket says 172.21.15.118:56414) 2024-09-21T06:05:08.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 -- 172.21.15.118:0/3579140229 learned_addr learned my addr 172.21.15.118:0/3579140229 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 -- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09f00ccf80 msgr2=0x7f09f01e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09f00ccf80 0x7f09f01e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 -- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09f015cfd0 msgr2=0x7f09f015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09f015cfd0 0x7f09f015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 -- 172.21.15.118:0/3579140229 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f01e5790 con 0x7f09f00b3a60 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09eea00640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f01e7130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f09e000c3d0 tx=0x7f09e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.760+0000 7f09e7400640 1 -- 172.21.15.118:0/3579140229 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0017070 con 0x7f09f00b3a60 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.761+0000 7f09e7400640 1 -- 172.21.15.118:0/3579140229 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09e00053c0 con 0x7f09f00b3a60 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.761+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f01e5c90 con 0x7f09f00b3a60 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.761+0000 7f09e7400640 1 -- 172.21.15.118:0/3579140229 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0003850 con 0x7f09f00b3a60 2024-09-21T06:05:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.761+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f01e6250 con 0x7f09f00b3a60 2024-09-21T06:05:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.762+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f00cca40 con 0x7f09f00b3a60 2024-09-21T06:05:08.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.763+0000 7f09e7400640 1 -- 172.21.15.118:0/3579140229 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09e001a070 con 0x7f09f00b3a60 2024-09-21T06:05:08.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.764+0000 7f09e7400640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f09cc078b90 0x7f09cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:08.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.764+0000 7f09e7400640 1 -- 172.21.15.118:0/3579140229 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f09e009a100 con 0x7f09f00b3a60 2024-09-21T06:05:08.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.764+0000 7f09e6000640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f09cc078b90 0x7f09cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:08.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.765+0000 7f09e6000640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f09cc078b90 0x7f09cc07b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f09d8033000 tx=0x7f09d80046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:08.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:08.769+0000 7f09e7400640 1 -- 172.21.15.118:0/3579140229 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f09e0062540 con 0x7f09f00b3a60 2024-09-21T06:05:09.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.003+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09f00b5300 con 0x7f09f00b3a60 2024-09-21T06:05:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.003+0000 7f09e7400640 1 -- 172.21.15.118:0/3579140229 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7f09e0061e40 con 0x7f09f00b3a60 2024-09-21T06:05:09.006 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:09.006 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"btime":"2024-09-21T06:04:47:795359+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:04:44.264788+0000","modified":"2024-09-21T06:04:47.281946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4795":{"gid":4795,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/1393220922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1393220922},{"type":"v1","addr":"172.21.15.149:6836","nonce":1393220922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4795,"qdb_cluster":[4795]},"id":2}]} 2024-09-21T06:05:09.007 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 16 2024-09-21T06:05:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f09cc078b90 msgr2=0x7f09cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f09cc078b90 0x7f09cc07b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f09d8033000 tx=0x7f09d80046c0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 msgr2=0x7f09f01e7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f01e7130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f09e000c3d0 tx=0x7f09e000c890 comp rx=0 tx=0).stop 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 shutdown_connections 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09f015cfd0 0x7f09f015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f09cc078b90 0x7f09cc07b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09f00ccf80 0x7f09f01e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 --2- 172.21.15.118:0/3579140229 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09f00b3a60 0x7f09f01e7130 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 >> 172.21.15.118:0/3579140229 conn(0x7f09f006d110 msgr2=0x7f09f00d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 shutdown_connections 2024-09-21T06:05:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.006+0000 7f09f5600640 1 -- 172.21.15.118:0/3579140229 wait complete. 2024-09-21T06:05:09.032 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:05:09.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.254+0000 7f7501200640 1 -- 172.21.15.118:0/3037779239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74e0003a00 msgr2=0x7f74e0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.254+0000 7f7501200640 1 --2- 172.21.15.118:0/3037779239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74e0003a00 0x7f74e0003e70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009b50 tx=0x7f74e0005830 comp rx=0 tx=0).stop 2024-09-21T06:05:09.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.254+0000 7f74fa800640 1 -- 172.21.15.118:0/3037779239 reap_dead start 2024-09-21T06:05:09.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.255+0000 7f7501200640 1 -- 172.21.15.118:0/3037779239 shutdown_connections 2024-09-21T06:05:09.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.255+0000 7f7501200640 1 -- 172.21.15.118:0/3037779239 >> 172.21.15.118:0/3037779239 conn(0x7f74fc06ced0 msgr2=0x7f74fc06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:09.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.255+0000 7f7501200640 1 -- 172.21.15.118:0/3037779239 shutdown_connections 2024-09-21T06:05:09.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.255+0000 7f7501200640 1 -- 172.21.15.118:0/3037779239 wait complete. 2024-09-21T06:05:09.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.257+0000 7f7501200640 1 Processor -- start 2024-09-21T06:05:09.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.257+0000 7f7501200640 1 -- start start 2024-09-21T06:05:09.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.258+0000 7f7501200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e0003a00 0x7f74fc14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.258+0000 7f7501200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74fc1f9dc0 0x7f74fc1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.258+0000 7f7501200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74fc159050 0x7f74fc0b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.258+0000 7f7501200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc06f4c0 con 0x7f74e0003a00 2024-09-21T06:05:09.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.258+0000 7f7501200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc06f340 con 0x7f74fc1f9dc0 2024-09-21T06:05:09.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.258+0000 7f7501200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f74fc06f640 con 0x7f74fc159050 2024-09-21T06:05:09.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e0003a00 0x7f74fc14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e0003a00 0x7f74fc14a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56428/0 (socket says 172.21.15.118:56428) 2024-09-21T06:05:09.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 -- 172.21.15.118:0/1282338231 learned_addr learned my addr 172.21.15.118:0/1282338231 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:09.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f3e00640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74fc1f9dc0 0x7f74fc1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74fa800640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74fc159050 0x7f74fc0b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 -- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74fc159050 msgr2=0x7f74fc0b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74fc159050 0x7f74fc0b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 -- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74fc1f9dc0 msgr2=0x7f74fc1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74fc1f9dc0 0x7f74fc1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.259+0000 7f74f9e00640 1 -- 172.21.15.118:0/1282338231 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc0b5450 con 0x7f74e0003a00 2024-09-21T06:05:09.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.260+0000 7f74f9e00640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e0003a00 0x7f74fc14a160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f74ec036040 tx=0x7f74ec033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:09.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.260+0000 7f74f2000640 1 -- 172.21.15.118:0/1282338231 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec038040 con 0x7f74e0003a00 2024-09-21T06:05:09.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.260+0000 7f74f2000640 1 -- 172.21.15.118:0/1282338231 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74ec02b7e0 con 0x7f74e0003a00 2024-09-21T06:05:09.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.260+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc0b5730 con 0x7f74e0003a00 2024-09-21T06:05:09.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.260+0000 7f74f2000640 1 -- 172.21.15.118:0/1282338231 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec004260 con 0x7f74e0003a00 2024-09-21T06:05:09.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.260+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc0b5cf0 con 0x7f74e0003a00 2024-09-21T06:05:09.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.261+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc076fe0 con 0x7f74e0003a00 2024-09-21T06:05:09.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.263+0000 7f74f2000640 1 -- 172.21.15.118:0/1282338231 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74ec045020 con 0x7f74e0003a00 2024-09-21T06:05:09.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.264+0000 7f74f2000640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f74d8078bc0 0x7f74d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.264+0000 7f74f2000640 1 -- 172.21.15.118:0/1282338231 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f74ec0bb6d0 con 0x7f74e0003a00 2024-09-21T06:05:09.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.264+0000 7f74f3e00640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f74d8078bc0 0x7f74d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.265+0000 7f74f3e00640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f74d8078bc0 0x7f74d807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0af5f0 tx=0x7f74e4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:09.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.269+0000 7f74f2000640 1 -- 172.21.15.118:0/1282338231 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f74ec083b30 con 0x7f74e0003a00 2024-09-21T06:05:09.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.461+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74fc155dd0 con 0x7f74e0003a00 2024-09-21T06:05:09.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.462+0000 7f74f2000640 1 -- 172.21.15.118:0/1282338231 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16801 (secure 0 0 0) 0x7f74ec083430 con 0x7f74e0003a00 2024-09-21T06:05:09.465 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:09.465 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":33,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:02.848340+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:04:42.296386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T06:04:43.228581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:09.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f74d8078bc0 msgr2=0x7f74d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f74d8078bc0 0x7f74d807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0af5f0 tx=0x7f74e4005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:09.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e0003a00 msgr2=0x7f74fc14a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e0003a00 0x7f74fc14a160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f74ec036040 tx=0x7f74ec033670 comp rx=0 tx=0).stop 2024-09-21T06:05:09.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 shutdown_connections 2024-09-21T06:05:09.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f74d8078bc0 0x7f74d807b0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74fc159050 0x7f74fc0b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74fc1f9dc0 0x7f74fc1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 --2- 172.21.15.118:0/1282338231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e0003a00 0x7f74fc14a160 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 >> 172.21.15.118:0/1282338231 conn(0x7f74fc06ced0 msgr2=0x7f74fc1633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:09.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.464+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 shutdown_connections 2024-09-21T06:05:09.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.465+0000 7f7501200640 1 -- 172.21.15.118:0/1282338231 wait complete. 2024-09-21T06:05:09.494 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 -- 172.21.15.118:0/1044784480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076015fba0 msgr2=0x7f07600d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 --2- 172.21.15.118:0/1044784480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076015fba0 0x7f07600d1330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0758005fd0 tx=0x7f075802aa90 comp rx=0 tx=0).stop 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 -- 172.21.15.118:0/1044784480 shutdown_connections 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 --2- 172.21.15.118:0/1044784480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f076015fba0 0x7f07600d1330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 --2- 172.21.15.118:0/1044784480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0760163900 0x7f076015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 -- 172.21.15.118:0/1044784480 >> 172.21.15.118:0/1044784480 conn(0x7f076006d1c0 msgr2=0x7f076006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 -- 172.21.15.118:0/1044784480 shutdown_connections 2024-09-21T06:05:09.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.713+0000 7f075f200640 1 -- 172.21.15.118:0/1044784480 wait complete. 2024-09-21T06:05:09.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.715+0000 7f075f200640 1 Processor -- start 2024-09-21T06:05:09.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.715+0000 7f075f200640 1 -- start start 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076015fba0 0x7f07601f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07601634f0 0x7f076014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760163900 0x7f076014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f07600d3920 con 0x7f0760163900 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f07600d1d30 con 0x7f07601634f0 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07600d3aa0 con 0x7f076015fba0 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760163900 0x7f076014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760163900 0x7f076014cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56460/0 (socket says 172.21.15.118:56460) 2024-09-21T06:05:09.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 -- 172.21.15.118:0/4035475964 learned_addr learned my addr 172.21.15.118:0/4035475964 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f0755400640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07601634f0 0x7f076014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075de00640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076015fba0 0x7f07601f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 -- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076015fba0 msgr2=0x7f07601f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076015fba0 0x7f07601f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 -- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07601634f0 msgr2=0x7f076014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07601634f0 0x7f076014bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.717+0000 7f075e800640 1 -- 172.21.15.118:0/4035475964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076014c100 con 0x7f0760163900 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.718+0000 7f075e800640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760163900 0x7f076014cbe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0758009bf0 tx=0x7f0758003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.718+0000 7f0756a00640 1 -- 172.21.15.118:0/4035475964 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758044070 con 0x7f0760163900 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.718+0000 7f0756a00640 1 -- 172.21.15.118:0/4035475964 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0758004250 con 0x7f0760163900 2024-09-21T06:05:09.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.718+0000 7f0756a00640 1 -- 172.21.15.118:0/4035475964 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758004660 con 0x7f0760163900 2024-09-21T06:05:09.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.718+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076015a480 con 0x7f0760163900 2024-09-21T06:05:09.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.718+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f076015a720 con 0x7f0760163900 2024-09-21T06:05:09.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.719+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07600d1330 con 0x7f0760163900 2024-09-21T06:05:09.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.721+0000 7f0756a00640 1 -- 172.21.15.118:0/4035475964 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0758047070 con 0x7f0760163900 2024-09-21T06:05:09.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.722+0000 7f0756a00640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f073c078bc0 0x7f073c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.722+0000 7f0756a00640 1 -- 172.21.15.118:0/4035475964 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f07580bc020 con 0x7f0760163900 2024-09-21T06:05:09.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.722+0000 7f075de00640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f073c078bc0 0x7f073c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.723+0000 7f075de00640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f073c078bc0 0x7f073c07b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f07600d4c60 tx=0x7f0750009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:09.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.725+0000 7f0756a00640 1 -- 172.21.15.118:0/4035475964 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f075804e020 con 0x7f0760163900 2024-09-21T06:05:09.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.950+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0760159370 con 0x7f0760163900 2024-09-21T06:05:09.953 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:05:09.951+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:05:09.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.953+0000 7f0756a00640 1 -- 172.21.15.118:0/4035475964 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f0758032030 con 0x7f0760163900 2024-09-21T06:05:09.955 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f073c078bc0 msgr2=0x7f073c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f073c078bc0 0x7f073c07b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f07600d4c60 tx=0x7f0750009040 comp rx=0 tx=0).stop 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760163900 msgr2=0x7f076014cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760163900 0x7f076014cbe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0758009bf0 tx=0x7f0758003ce0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 shutdown_connections 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760163900 0x7f076014cbe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07601634f0 0x7f076014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f073c078bc0 0x7f073c07b0d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 --2- 172.21.15.118:0/4035475964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f076015fba0 0x7f07601f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 >> 172.21.15.118:0/4035475964 conn(0x7f076006d1c0 msgr2=0x7f076015dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:09.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 shutdown_connections 2024-09-21T06:05:09.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:09.956+0000 7f075f200640 1 -- 172.21.15.118:0/4035475964 wait complete. 2024-09-21T06:05:09.970 INFO:tasks.ceph.mds.d.smithi149.stderr: -5853> 2024-09-21T06:04:48.757+0000 7fe578e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:05:09.984 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:05:10.093 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:05:10.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.205+0000 7f7d30200640 1 -- 172.21.15.118:0/2836258863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d280ce0c0 msgr2=0x7f7d281448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:10.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.205+0000 7f7d30200640 1 --2- 172.21.15.118:0/2836258863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d280ce0c0 0x7f7d281448a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d28072e50 tx=0x7f7d1c02a510 comp rx=0 tx=0).stop 2024-09-21T06:05:10.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.205+0000 7f7d30200640 1 -- 172.21.15.118:0/2836258863 shutdown_connections 2024-09-21T06:05:10.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.205+0000 7f7d30200640 1 --2- 172.21.15.118:0/2836258863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d280ce0c0 0x7f7d281448a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.205+0000 7f7d30200640 1 -- 172.21.15.118:0/2836258863 >> 172.21.15.118:0/2836258863 conn(0x7f7d2806d110 msgr2=0x7f7d2806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:10.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.205+0000 7f7d30200640 1 -- 172.21.15.118:0/2836258863 shutdown_connections 2024-09-21T06:05:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.205+0000 7f7d30200640 1 -- 172.21.15.118:0/2836258863 wait complete. 2024-09-21T06:05:10.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.208+0000 7f7d30200640 1 Processor -- start 2024-09-21T06:05:10.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.208+0000 7f7d30200640 1 -- start start 2024-09-21T06:05:10.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.209+0000 7f7d30200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d280ce0c0 0x7f7d2813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:10.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.209+0000 7f7d30200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d280d0ec0 0x7f7d28159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:10.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.209+0000 7f7d30200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d2815fa00 0x7f7d2813fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:10.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.209+0000 7f7d30200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d281671e0 con 0x7f7d2815fa00 2024-09-21T06:05:10.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.209+0000 7f7d30200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d28167060 con 0x7f7d280ce0c0 2024-09-21T06:05:10.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.209+0000 7f7d30200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d28167360 con 0x7f7d280d0ec0 2024-09-21T06:05:10.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d2815fa00 0x7f7d2813fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:10.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2d800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d280ce0c0 0x7f7d2813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:10.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d2815fa00 0x7f7d2813fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56478/0 (socket says 172.21.15.118:56478) 2024-09-21T06:05:10.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 -- 172.21.15.118:0/3209248881 learned_addr learned my addr 172.21.15.118:0/3209248881 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:10.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2ce00640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d280d0ec0 0x7f7d28159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 -- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d280d0ec0 msgr2=0x7f7d28159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d280d0ec0 0x7f7d28159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 -- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d280ce0c0 msgr2=0x7f7d2813e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d280ce0c0 0x7f7d2813e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 -- 172.21.15.118:0/3209248881 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2815ab00 con 0x7f7d2815fa00 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2d800640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d280ce0c0 0x7f7d2813e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.210+0000 7f7d2e200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d2815fa00 0x7f7d2813fe40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7d20002230 tx=0x7f7d2000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.211+0000 7f7d25600640 1 -- 172.21.15.118:0/3209248881 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20003b70 con 0x7f7d2815fa00 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.211+0000 7f7d25600640 1 -- 172.21.15.118:0/3209248881 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d20003d10 con 0x7f7d2815fa00 2024-09-21T06:05:10.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.211+0000 7f7d25600640 1 -- 172.21.15.118:0/3209248881 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20005330 con 0x7f7d2815fa00 2024-09-21T06:05:10.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.211+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2815ade0 con 0x7f7d2815fa00 2024-09-21T06:05:10.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.211+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d281637f0 con 0x7f7d2815fa00 2024-09-21T06:05:10.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.212+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d281448a0 con 0x7f7d2815fa00 2024-09-21T06:05:10.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.213+0000 7f7d25600640 1 -- 172.21.15.118:0/3209248881 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d200054d0 con 0x7f7d2815fa00 2024-09-21T06:05:10.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.214+0000 7f7d25600640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d08078b90 0x7f7d0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:10.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.215+0000 7f7d25600640 1 -- 172.21.15.118:0/3209248881 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f7d2009aad0 con 0x7f7d2815fa00 2024-09-21T06:05:10.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.215+0000 7f7d2d800640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d08078b90 0x7f7d0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:10.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.215+0000 7f7d2d800640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d08078b90 0x7f7d0807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c034000 tx=0x7f7d1c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:10.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.219+0000 7f7d25600640 1 -- 172.21.15.118:0/3209248881 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d200627c0 con 0x7f7d2815fa00 2024-09-21T06:05:10.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.441+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7d280b56e0 con 0x7f7d2815fa00 2024-09-21T06:05:10.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.958+0000 7f7d25600640 1 -- 172.21.15.118:0/3209248881 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f7d200671f0 con 0x7f7d2815fa00 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d08078b90 msgr2=0x7f7d0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d08078b90 0x7f7d0807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c034000 tx=0x7f7d1c004730 comp rx=0 tx=0).stop 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d2815fa00 msgr2=0x7f7d2813fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d2815fa00 0x7f7d2813fe40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7d20002230 tx=0x7f7d2000cb90 comp rx=0 tx=0).stop 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 shutdown_connections 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d2815fa00 0x7f7d2813fe40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d08078b90 0x7f7d0807b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d280d0ec0 0x7f7d28159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 --2- 172.21.15.118:0/3209248881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d280ce0c0 0x7f7d2813e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 >> 172.21.15.118:0/3209248881 conn(0x7f7d2806d110 msgr2=0x7f7d280d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:10.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 shutdown_connections 2024-09-21T06:05:10.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:10.961+0000 7f7d30200640 1 -- 172.21.15.118:0/3209248881 wait complete. 2024-09-21T06:05:10.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:05:11.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 -- 172.21.15.118:0/2129618775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc160a50 msgr2=0x7f85bc070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2129618775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc160a50 0x7f85bc070240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f85ac005fd0 tx=0x7f85ac02a5d0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 -- 172.21.15.118:0/2129618775 shutdown_connections 2024-09-21T06:05:11.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2129618775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc0cee10 0x7f85bc0cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2129618775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc160a50 0x7f85bc070240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 -- 172.21.15.118:0/2129618775 >> 172.21.15.118:0/2129618775 conn(0x7f85bc06cf30 msgr2=0x7f85bc06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:11.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 -- 172.21.15.118:0/2129618775 shutdown_connections 2024-09-21T06:05:11.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.214+0000 7f85c0a00640 1 -- 172.21.15.118:0/2129618775 wait complete. 2024-09-21T06:05:11.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.217+0000 7f85c0a00640 1 Processor -- start 2024-09-21T06:05:11.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.217+0000 7f85c0a00640 1 -- start start 2024-09-21T06:05:11.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.218+0000 7f85c0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85bc0b4210 0x7f85bc1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.218+0000 7f85c0a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc0cee10 0x7f85bc073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.218+0000 7f85c0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc160a50 0x7f85bc074130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.218+0000 7f85c0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc0cd9f0 con 0x7f85bc0b4210 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.218+0000 7f85c0a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc0cd870 con 0x7f85bc0cee10 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.218+0000 7f85c0a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85bc0cdb70 con 0x7f85bc160a50 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.218+0000 7f85b9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85bc0b4210 0x7f85bc1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85bc0b4210 0x7f85bc1400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56480/0 (socket says 172.21.15.118:56480) 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 -- 172.21.15.118:0/2796855090 learned_addr learned my addr 172.21.15.118:0/2796855090 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b1400640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc0cee10 0x7f85bc073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85ba800640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc160a50 0x7f85bc074130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 -- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc160a50 msgr2=0x7f85bc074130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc160a50 0x7f85bc074130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 -- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc0cee10 msgr2=0x7f85bc073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc0cee10 0x7f85bc073bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 -- 172.21.15.118:0/2796855090 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc0b02e0 con 0x7f85bc0b4210 2024-09-21T06:05:11.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.219+0000 7f85b9e00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85bc0b4210 0x7f85bc1400f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85ac034040 tx=0x7f85ac0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:11.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.220+0000 7f85b2a00640 1 -- 172.21.15.118:0/2796855090 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac03e030 con 0x7f85bc0b4210 2024-09-21T06:05:11.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.220+0000 7f85b2a00640 1 -- 172.21.15.118:0/2796855090 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85ac003b00 con 0x7f85bc0b4210 2024-09-21T06:05:11.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.220+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc0afa40 con 0x7f85bc0b4210 2024-09-21T06:05:11.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.220+0000 7f85b2a00640 1 -- 172.21.15.118:0/2796855090 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac035040 con 0x7f85bc0b4210 2024-09-21T06:05:11.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.220+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc0b0000 con 0x7f85bc0b4210 2024-09-21T06:05:11.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.221+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85bc0ce090 con 0x7f85bc0b4210 2024-09-21T06:05:11.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.222+0000 7f85b2a00640 1 -- 172.21.15.118:0/2796855090 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85ac041030 con 0x7f85bc0b4210 2024-09-21T06:05:11.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.223+0000 7f85b2a00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8598078b90 0x7f859807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.224+0000 7f85b2a00640 1 -- 172.21.15.118:0/2796855090 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f85ac0bb240 con 0x7f85bc0b4210 2024-09-21T06:05:11.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.224+0000 7f85b1400640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8598078b90 0x7f859807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.224+0000 7f85b1400640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8598078b90 0x7f859807b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f85bc156e10 tx=0x7f85a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:11.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.228+0000 7f85b2a00640 1 -- 172.21.15.118:0/2796855090 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f85ac082eb0 con 0x7f85bc0b4210 2024-09-21T06:05:11.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.415+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f85bc06a260 con 0x7f85bc0b4210 2024-09-21T06:05:11.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.960+0000 7f85b2a00640 1 -- 172.21.15.118:0/2796855090 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f85ac0878e0 con 0x7f85bc0b4210 2024-09-21T06:05:11.963 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8598078b90 msgr2=0x7f859807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8598078b90 0x7f859807b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f85bc156e10 tx=0x7f85a4009040 comp rx=0 tx=0).stop 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85bc0b4210 msgr2=0x7f85bc1400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85bc0b4210 0x7f85bc1400f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85ac034040 tx=0x7f85ac0035f0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 shutdown_connections 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8598078b90 0x7f859807b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc160a50 0x7f85bc074130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc0cee10 0x7f85bc073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 --2- 172.21.15.118:0/2796855090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85bc0b4210 0x7f85bc1400f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.964+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 >> 172.21.15.118:0/2796855090 conn(0x7f85bc06cf30 msgr2=0x7f85bc0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:11.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.965+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 shutdown_connections 2024-09-21T06:05:11.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:11.965+0000 7f85c0a00640 1 -- 172.21.15.118:0/2796855090 wait complete. 2024-09-21T06:05:11.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:05:12.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.217+0000 7f49b9800640 1 -- 172.21.15.118:0/3810773230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b2660 msgr2=0x7f49b4161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:12.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.217+0000 7f49b9800640 1 --2- 172.21.15.118:0/3810773230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b2660 0x7f49b4161500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49b40692e0 tx=0x7f49a002a480 comp rx=0 tx=0).stop 2024-09-21T06:05:12.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.217+0000 7f49b9800640 1 -- 172.21.15.118:0/3810773230 shutdown_connections 2024-09-21T06:05:12.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.217+0000 7f49b9800640 1 --2- 172.21.15.118:0/3810773230 >> v2:172.21.15.149:3300/0 conn(0x7f49b40b0c30 0x7f49b40afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.217+0000 7f49b9800640 1 --2- 172.21.15.118:0/3810773230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b2660 0x7f49b4161500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.217+0000 7f49b9800640 1 -- 172.21.15.118:0/3810773230 >> 172.21.15.118:0/3810773230 conn(0x7f49b4074860 msgr2=0x7f49b4074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:12.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.217+0000 7f49b9800640 1 -- 172.21.15.118:0/3810773230 shutdown_connections 2024-09-21T06:05:12.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.218+0000 7f49b9800640 1 -- 172.21.15.118:0/3810773230 wait complete. 2024-09-21T06:05:12.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.220+0000 7f49b9800640 1 Processor -- start 2024-09-21T06:05:12.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.220+0000 7f49b9800640 1 -- start start 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.221+0000 7f49b9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b0c30 0x7f49b41e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.221+0000 7f49b9800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49b41541a0 0x7f49b415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.221+0000 7f49b9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b41e9d20 0x7f49b41ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.221+0000 7f49b9800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f49b40b00f0 con 0x7f49b41541a0 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.221+0000 7f49b9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49b40aff70 con 0x7f49b41e9d20 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.221+0000 7f49b9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49b40b0270 con 0x7f49b40b0c30 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49b41541a0 0x7f49b415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49b41541a0 0x7f49b415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56482/0 (socket says 172.21.15.118:56482) 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 -- 172.21.15.118:0/4149534612 learned_addr learned my addr 172.21.15.118:0/4149534612 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b3400640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b41e9d20 0x7f49b41ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2a00640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b0c30 0x7f49b41e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 -- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b0c30 msgr2=0x7f49b41e8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b0c30 0x7f49b41e8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 -- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b41e9d20 msgr2=0x7f49b41ea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b41e9d20 0x7f49b41ea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 -- 172.21.15.118:0/4149534612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b41e9700 con 0x7f49b41541a0 2024-09-21T06:05:12.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.222+0000 7f49b2000640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49b41541a0 0x7f49b415a440 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098f0 tx=0x7f49a0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:12.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.223+0000 7f49aaa00640 1 -- 172.21.15.118:0/4149534612 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0005c90 con 0x7f49b41541a0 2024-09-21T06:05:12.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.223+0000 7f49aaa00640 1 -- 172.21.15.118:0/4149534612 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49a0031e50 con 0x7f49b41541a0 2024-09-21T06:05:12.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.223+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b41f47e0 con 0x7f49b41541a0 2024-09-21T06:05:12.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.223+0000 7f49aaa00640 1 -- 172.21.15.118:0/4149534612 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0005260 con 0x7f49b41541a0 2024-09-21T06:05:12.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.223+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b415a980 con 0x7f49b41541a0 2024-09-21T06:05:12.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.224+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b40b07b0 con 0x7f49b41541a0 2024-09-21T06:05:12.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.225+0000 7f49aaa00640 1 -- 172.21.15.118:0/4149534612 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49a0005400 con 0x7f49b41541a0 2024-09-21T06:05:12.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.226+0000 7f49aaa00640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4994078b90 0x7f499407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:12.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.226+0000 7f49aaa00640 1 -- 172.21.15.118:0/4149534612 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f49a00bbd30 con 0x7f49b41541a0 2024-09-21T06:05:12.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.226+0000 7f49b2a00640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4994078b90 0x7f499407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:12.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.227+0000 7f49b2a00640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4994078b90 0x7f499407b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49a4000f60 tx=0x7f49a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:12.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.230+0000 7f49aaa00640 1 -- 172.21.15.118:0/4149534612 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f49b41f47e0 con 0x7f49b41541a0 2024-09-21T06:05:12.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.417+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49b40b1650 con 0x7f49b41541a0 2024-09-21T06:05:12.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.966+0000 7f49aaa00640 1 -- 172.21.15.118:0/4149534612 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f49a003f030 con 0x7f49b41541a0 2024-09-21T06:05:12.969 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:05:12.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.970+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4994078b90 msgr2=0x7f499407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:12.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.970+0000 7f49b9800640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4994078b90 0x7f499407b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49a4000f60 tx=0x7f49a4009040 comp rx=0 tx=0).stop 2024-09-21T06:05:12.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.970+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49b41541a0 msgr2=0x7f49b415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:12.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.970+0000 7f49b9800640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49b41541a0 0x7f49b415a440 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098f0 tx=0x7f49a0033c20 comp rx=0 tx=0).stop 2024-09-21T06:05:12.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 shutdown_connections 2024-09-21T06:05:12.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49b41e9d20 0x7f49b41ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49b41541a0 0x7f49b415a440 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4994078b90 0x7f499407b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 --2- 172.21.15.118:0/4149534612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49b40b0c30 0x7f49b41e8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 >> 172.21.15.118:0/4149534612 conn(0x7f49b4074860 msgr2=0x7f49b4070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:12.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 shutdown_connections 2024-09-21T06:05:12.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:12.971+0000 7f49b9800640 1 -- 172.21.15.118:0/4149534612 wait complete. 2024-09-21T06:05:12.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:05:13.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 -- 172.21.15.118:0/1099199419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab0142e40 msgr2=0x7f2ab00d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/1099199419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab0142e40 0x7f2ab00d13c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8005fd0 tx=0x7f2aa802a540 comp rx=0 tx=0).stop 2024-09-21T06:05:13.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 -- 172.21.15.118:0/1099199419 shutdown_connections 2024-09-21T06:05:13.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/1099199419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab0142e40 0x7f2ab00d13c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/1099199419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ab013fae0 0x7f2ab00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 -- 172.21.15.118:0/1099199419 >> 172.21.15.118:0/1099199419 conn(0x7f2ab006d110 msgr2=0x7f2ab006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:13.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 -- 172.21.15.118:0/1099199419 shutdown_connections 2024-09-21T06:05:13.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.222+0000 7f2ab4c00640 1 -- 172.21.15.118:0/1099199419 wait complete. 2024-09-21T06:05:13.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.225+0000 7f2ab4c00640 1 Processor -- start 2024-09-21T06:05:13.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.225+0000 7f2ab4c00640 1 -- start start 2024-09-21T06:05:13.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.226+0000 7f2ab4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab013fae0 0x7f2ab01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.226+0000 7f2ab4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab013fef0 0x7f2ab0073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.226+0000 7f2ab4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ab0142e40 0x7f2ab0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.226+0000 7f2ab4c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00cfac0 con 0x7f2ab013fef0 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.226+0000 7f2ab4c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00cf940 con 0x7f2ab013fae0 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.226+0000 7f2ab4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab00cfc40 con 0x7f2ab0142e40 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab013fef0 0x7f2ab0073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab013fef0 0x7f2ab0073d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56498/0 (socket says 172.21.15.118:56498) 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 -- 172.21.15.118:0/3786006189 learned_addr learned my addr 172.21.15.118:0/3786006189 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aae800640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ab0142e40 0x7f2ab0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aade00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab013fae0 0x7f2ab01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 -- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ab0142e40 msgr2=0x7f2ab0074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ab0142e40 0x7f2ab0074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 -- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab013fae0 msgr2=0x7f2ab01560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab013fae0 0x7f2ab01560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 -- 172.21.15.118:0/3786006189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab0159c60 con 0x7f2ab013fef0 2024-09-21T06:05:13.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.227+0000 7f2aa5400640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab013fef0 0x7f2ab0073d20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c3d0 tx=0x7f2a9800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:13.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.228+0000 7f2aa6a00640 1 -- 172.21.15.118:0/3786006189 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a98017070 con 0x7f2ab013fef0 2024-09-21T06:05:13.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.228+0000 7f2aa6a00640 1 -- 172.21.15.118:0/3786006189 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a980053c0 con 0x7f2ab013fef0 2024-09-21T06:05:13.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.228+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab01403d0 con 0x7f2ab013fef0 2024-09-21T06:05:13.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.228+0000 7f2aa6a00640 1 -- 172.21.15.118:0/3786006189 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a98003850 con 0x7f2ab013fef0 2024-09-21T06:05:13.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.228+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab0140990 con 0x7f2ab013fef0 2024-09-21T06:05:13.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.229+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab01599d0 con 0x7f2ab013fef0 2024-09-21T06:05:13.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.230+0000 7f2aa6a00640 1 -- 172.21.15.118:0/3786006189 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a9801a070 con 0x7f2ab013fef0 2024-09-21T06:05:13.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.231+0000 7f2aa6a00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a8c078b90 0x7f2a8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.232+0000 7f2aa6a00640 1 -- 172.21.15.118:0/3786006189 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f2a98099eb0 con 0x7f2ab013fef0 2024-09-21T06:05:13.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.232+0000 7f2aade00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a8c078b90 0x7f2a8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.232+0000 7f2aade00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a8c078b90 0x7f2a8c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0005fd0 tx=0x7f2aa00095e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:13.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.236+0000 7f2aa6a00640 1 -- 172.21.15.118:0/3786006189 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2a98061e80 con 0x7f2ab013fef0 2024-09-21T06:05:13.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.423+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f2ab00d00f0 con 0x7f2ab013fef0 2024-09-21T06:05:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.427+0000 7f2aa6a00640 1 -- 172.21.15.118:0/3786006189 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v25) ==== 71+0+0 (secure 0 0 0) 0x7f2a980668b0 con 0x7f2ab013fef0 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a8c078b90 msgr2=0x7f2a8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a8c078b90 0x7f2a8c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0005fd0 tx=0x7f2aa00095e0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab013fef0 msgr2=0x7f2ab0073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab013fef0 0x7f2ab0073d20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c3d0 tx=0x7f2a9800c890 comp rx=0 tx=0).stop 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 shutdown_connections 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a8c078b90 0x7f2a8c07b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ab0142e40 0x7f2ab0074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab013fef0 0x7f2ab0073d20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 --2- 172.21.15.118:0/3786006189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab013fae0 0x7f2ab01560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 >> 172.21.15.118:0/3786006189 conn(0x7f2ab006d110 msgr2=0x7f2ab006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:13.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 shutdown_connections 2024-09-21T06:05:13.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.430+0000 7f2ab4c00640 1 -- 172.21.15.118:0/3786006189 wait complete. 2024-09-21T06:05:13.454 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-21T06:05:13.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.672+0000 7f9e89200640 1 -- 172.21.15.118:0/3282186981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 msgr2=0x7f9e68004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.672+0000 7f9e89200640 1 --2- 172.21.15.118:0/3282186981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 0x7f9e68004c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009b50 tx=0x7f9e68005830 comp rx=0 tx=0).stop 2024-09-21T06:05:13.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.672+0000 7f9e82800640 1 -- 172.21.15.118:0/3282186981 reap_dead start 2024-09-21T06:05:13.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.672+0000 7f9e89200640 1 -- 172.21.15.118:0/3282186981 shutdown_connections 2024-09-21T06:05:13.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.672+0000 7f9e89200640 1 -- 172.21.15.118:0/3282186981 >> 172.21.15.118:0/3282186981 conn(0x7f9e8406d110 msgr2=0x7f9e8406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:13.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.672+0000 7f9e89200640 1 -- 172.21.15.118:0/3282186981 shutdown_connections 2024-09-21T06:05:13.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.672+0000 7f9e89200640 1 -- 172.21.15.118:0/3282186981 wait complete. 2024-09-21T06:05:13.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.675+0000 7f9e89200640 1 Processor -- start 2024-09-21T06:05:13.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.675+0000 7f9e89200640 1 -- start start 2024-09-21T06:05:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e89200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 0x7f9e84074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e89200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e8413a910 0x7f9e84074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e89200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e841538e0 0x7f9e8413c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e89200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9e840cf5d0 con 0x7f9e68004800 2024-09-21T06:05:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e89200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e840cf450 con 0x7f9e8413a910 2024-09-21T06:05:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e89200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e840cf750 con 0x7f9e841538e0 2024-09-21T06:05:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e81e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 0x7f9e84074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e81e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 0x7f9e84074230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56528/0 (socket says 172.21.15.118:56528) 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.676+0000 7f9e81e00640 1 -- 172.21.15.118:0/1172632140 learned_addr learned my addr 172.21.15.118:0/1172632140 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e79400640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e8413a910 0x7f9e84074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e82800640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e841538e0 0x7f9e8413c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e81e00640 1 -- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e841538e0 msgr2=0x7f9e8413c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e81e00640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e841538e0 0x7f9e8413c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e81e00640 1 -- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e8413a910 msgr2=0x7f9e84074770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e81e00640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e8413a910 0x7f9e84074770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e81e00640 1 -- 172.21.15.118:0/1172632140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84157790 con 0x7f9e68004800 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e82800640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e841538e0 0x7f9e8413c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e81e00640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 0x7f9e84074230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9e74011ae0 tx=0x7f9e74009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.677+0000 7f9e7aa00640 1 -- 172.21.15.118:0/1172632140 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7401e070 con 0x7f9e68004800 2024-09-21T06:05:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.678+0000 7f9e7aa00640 1 -- 172.21.15.118:0/1172632140 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e74004460 con 0x7f9e68004800 2024-09-21T06:05:13.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.678+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e841f5570 con 0x7f9e68004800 2024-09-21T06:05:13.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.678+0000 7f9e7aa00640 1 -- 172.21.15.118:0/1172632140 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400fc60 con 0x7f9e68004800 2024-09-21T06:05:13.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.678+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e841f9200 con 0x7f9e68004800 2024-09-21T06:05:13.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.679+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e840d12f0 con 0x7f9e68004800 2024-09-21T06:05:13.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.680+0000 7f9e7aa00640 1 -- 172.21.15.118:0/1172632140 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e74021070 con 0x7f9e68004800 2024-09-21T06:05:13.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.681+0000 7f9e7aa00640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e60078b90 0x7f9e6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.681+0000 7f9e7aa00640 1 -- 172.21.15.118:0/1172632140 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f9e7409b490 con 0x7f9e68004800 2024-09-21T06:05:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.681+0000 7f9e79400640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e60078b90 0x7f9e6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.682+0000 7f9e79400640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e60078b90 0x7f9e6007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009b50 tx=0x7f9e6c02d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:13.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.685+0000 7f9e7aa00640 1 -- 172.21.15.118:0/1172632140 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e841f5570 con 0x7f9e68004800 2024-09-21T06:05:13.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.938+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f9e8406dd00 con 0x7f9e68004800 2024-09-21T06:05:13.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.968+0000 7f9e7aa00640 1 -- 172.21.15.118:0/1172632140 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v92) ==== 130+0+0 (secure 0 0 0) 0x7f9e740635b0 con 0x7f9e68004800 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e60078b90 msgr2=0x7f9e6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e60078b90 0x7f9e6007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009b50 tx=0x7f9e6c02d040 comp rx=0 tx=0).stop 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 msgr2=0x7f9e84074230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 0x7f9e84074230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9e74011ae0 tx=0x7f9e74009e90 comp rx=0 tx=0).stop 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 shutdown_connections 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e60078b90 0x7f9e6007b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e841538e0 0x7f9e8413c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e8413a910 0x7f9e84074770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 --2- 172.21.15.118:0/1172632140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e68004800 0x7f9e84074230 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 >> 172.21.15.118:0/1172632140 conn(0x7f9e8406d110 msgr2=0x7f9e840b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 shutdown_connections 2024-09-21T06:05:13.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:13.971+0000 7f9e89200640 1 -- 172.21.15.118:0/1172632140 wait complete. 2024-09-21T06:05:13.995 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-21T06:05:13.995 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-21T06:05:13.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:05:14.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 -- 172.21.15.118:0/2321277281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc0ceb40 msgr2=0x7f8efc0cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 --2- 172.21.15.118:0/2321277281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc0ceb40 0x7f8efc0cef50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0b5940 tx=0x7f8ee802a560 comp rx=0 tx=0).stop 2024-09-21T06:05:14.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 -- 172.21.15.118:0/2321277281 shutdown_connections 2024-09-21T06:05:14.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 --2- 172.21.15.118:0/2321277281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc0ceb40 0x7f8efc0cef50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 --2- 172.21.15.118:0/2321277281 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8efc0b4830 0x7f8efc0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 --2- 172.21.15.118:0/2321277281 >> v2:172.21.15.149:3300/0 conn(0x7f8efc146650 0x7f8efc0d23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 -- 172.21.15.118:0/2321277281 >> 172.21.15.118:0/2321277281 conn(0x7f8efc071070 msgr2=0x7f8efc071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:14.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.211+0000 7f8f03e00640 1 -- 172.21.15.118:0/2321277281 shutdown_connections 2024-09-21T06:05:14.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.212+0000 7f8f03e00640 1 -- 172.21.15.118:0/2321277281 wait complete. 2024-09-21T06:05:14.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.214+0000 7f8f03e00640 1 Processor -- start 2024-09-21T06:05:14.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.214+0000 7f8f03e00640 1 -- start start 2024-09-21T06:05:14.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.215+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8efc0b4830 0x7f8efc15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.215+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8efc0ceb40 0x7f8efc1efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.215+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc146650 0x7f8efc06ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.215+0000 7f8f03e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0d1360 con 0x7f8efc146650 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.215+0000 7f8f03e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0d11e0 con 0x7f8efc0b4830 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.215+0000 7f8f03e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc0d14e0 con 0x7f8efc0ceb40 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.215+0000 7f8f01e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc146650 0x7f8efc06ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc146650 0x7f8efc06ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56550/0 (socket says 172.21.15.118:56550) 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 -- 172.21.15.118:0/505820821 learned_addr learned my addr 172.21.15.118:0/505820821 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01400640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8efc0b4830 0x7f8efc15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f00a00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8efc0ceb40 0x7f8efc1efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 -- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8efc0ceb40 msgr2=0x7f8efc1efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8efc0ceb40 0x7f8efc1efc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 -- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8efc0b4830 msgr2=0x7f8efc15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8efc0b4830 0x7f8efc15a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 -- 172.21.15.118:0/505820821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc1f6440 con 0x7f8efc146650 2024-09-21T06:05:14.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.216+0000 7f8f01e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc146650 0x7f8efc06ee50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400b9e0 tx=0x7f8ef400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:14.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.217+0000 7f8ef9600640 1 -- 172.21.15.118:0/505820821 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4019070 con 0x7f8efc146650 2024-09-21T06:05:14.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.217+0000 7f8ef9600640 1 -- 172.21.15.118:0/505820821 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ef400cc30 con 0x7f8efc146650 2024-09-21T06:05:14.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.217+0000 7f8ef9600640 1 -- 172.21.15.118:0/505820821 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40146a0 con 0x7f8efc146650 2024-09-21T06:05:14.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.217+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc1f6720 con 0x7f8efc146650 2024-09-21T06:05:14.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.217+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc15a9f0 con 0x7f8efc146650 2024-09-21T06:05:14.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.218+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8efc1f61b0 con 0x7f8efc146650 2024-09-21T06:05:14.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.219+0000 7f8ef9600640 1 -- 172.21.15.118:0/505820821 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ef401c070 con 0x7f8efc146650 2024-09-21T06:05:14.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.220+0000 7f8ef9600640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8edc078b90 0x7f8edc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.220+0000 7f8ef9600640 1 -- 172.21.15.118:0/505820821 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f8ef409a780 con 0x7f8efc146650 2024-09-21T06:05:14.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.220+0000 7f8f01400640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8edc078b90 0x7f8edc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.221+0000 7f8f01400640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8edc078b90 0x7f8edc07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0005fd0 tx=0x7f8ef000a250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:14.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.224+0000 7f8ef9600640 1 -- 172.21.15.118:0/505820821 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ef400ce20 con 0x7f8efc146650 2024-09-21T06:05:14.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.411+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8efc0d1a40 con 0x7f8efc146650 2024-09-21T06:05:14.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.411+0000 7f8ef9600640 1 -- 172.21.15.118:0/505820821 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13106 (secure 0 0 0) 0x7f8ef40627d0 con 0x7f8efc146650 2024-09-21T06:05:14.414 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:14.414 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":36,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:12.962252+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6836/1393220922":"2024-09-22T06:05:09.952345+0000","172.21.15.149:6834/1393220922":"2024-09-22T06:05:09.952345+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8edc078b90 msgr2=0x7f8edc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8edc078b90 0x7f8edc07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0005fd0 tx=0x7f8ef000a250 comp rx=0 tx=0).stop 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc146650 msgr2=0x7f8efc06ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc146650 0x7f8efc06ee50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400b9e0 tx=0x7f8ef400bea0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 shutdown_connections 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8efc146650 0x7f8efc06ee50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8edc078b90 0x7f8edc07b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8efc0ceb40 0x7f8efc1efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 --2- 172.21.15.118:0/505820821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8efc0b4830 0x7f8efc15a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 >> 172.21.15.118:0/505820821 conn(0x7f8efc071070 msgr2=0x7f8efc15f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 shutdown_connections 2024-09-21T06:05:14.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.414+0000 7f8f03e00640 1 -- 172.21.15.118:0/505820821 wait complete. 2024-09-21T06:05:14.438 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:05:14.439 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:05:14.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.658+0000 7fa27ba00640 1 -- 172.21.15.118:0/955574097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740d3930 msgr2=0x7fa2740b9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.658+0000 7fa27ba00640 1 --2- 172.21.15.118:0/955574097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740d3930 0x7fa2740b9570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa2740cbda0 tx=0x7fa26402a560 comp rx=0 tx=0).stop 2024-09-21T06:05:14.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.659+0000 7fa27ba00640 1 -- 172.21.15.118:0/955574097 shutdown_connections 2024-09-21T06:05:14.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.659+0000 7fa27ba00640 1 --2- 172.21.15.118:0/955574097 >> v2:172.21.15.149:3300/0 conn(0x7fa2740b62b0 0x7fa2740b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.659+0000 7fa27ba00640 1 --2- 172.21.15.118:0/955574097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2740ba050 0x7fa2740b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.659+0000 7fa27ba00640 1 --2- 172.21.15.118:0/955574097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740d3930 0x7fa2740b9570 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.659+0000 7fa27ba00640 1 -- 172.21.15.118:0/955574097 >> 172.21.15.118:0/955574097 conn(0x7fa2740d4d40 msgr2=0x7fa2740d5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:14.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.659+0000 7fa27ba00640 1 -- 172.21.15.118:0/955574097 shutdown_connections 2024-09-21T06:05:14.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.659+0000 7fa27ba00640 1 -- 172.21.15.118:0/955574097 wait complete. 2024-09-21T06:05:14.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.661+0000 7fa27ba00640 1 Processor -- start 2024-09-21T06:05:14.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.661+0000 7fa27ba00640 1 -- start start 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2740b62b0 0x7fa2741d78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740ba050 0x7fa2740ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2740d3930 0x7fa2741f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa2740b59c0 con 0x7fa2740ba050 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2740b5840 con 0x7fa2740b62b0 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa2740b4a00 con 0x7fa2740d3930 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740ba050 0x7fa2740ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740ba050 0x7fa2740ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56572/0 (socket says 172.21.15.118:56572) 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 -- 172.21.15.118:0/4008146007 learned_addr learned my addr 172.21.15.118:0/4008146007 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:14.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa279000640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2740b62b0 0x7fa2741d78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa279a00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2740d3930 0x7fa2741f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 -- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2740d3930 msgr2=0x7fa2741f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2740d3930 0x7fa2741f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 -- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2740b62b0 msgr2=0x7fa2741d78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2740b62b0 0x7fa2741d78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 -- 172.21.15.118:0/4008146007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2740b2c80 con 0x7fa2740ba050 2024-09-21T06:05:14.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa26be00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740ba050 0x7fa2740ce170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00d750 tx=0x7fa25c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:14.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa271600640 1 -- 172.21.15.118:0/4008146007 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c017070 con 0x7fa2740ba050 2024-09-21T06:05:14.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa271600640 1 -- 172.21.15.118:0/4008146007 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa25c009b10 con 0x7fa2740ba050 2024-09-21T06:05:14.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa271600640 1 -- 172.21.15.118:0/4008146007 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c010460 con 0x7fa2740ba050 2024-09-21T06:05:14.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2740b2f60 con 0x7fa2740ba050 2024-09-21T06:05:14.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.664+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2741d51e0 con 0x7fa2740ba050 2024-09-21T06:05:14.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.665+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2740a2990 con 0x7fa2740ba050 2024-09-21T06:05:14.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.666+0000 7fa271600640 1 -- 172.21.15.118:0/4008146007 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa25c01a070 con 0x7fa2740ba050 2024-09-21T06:05:14.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.667+0000 7fa271600640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa250078bc0 0x7fa25007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:14.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.667+0000 7fa271600640 1 -- 172.21.15.118:0/4008146007 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fa25c09af00 con 0x7fa2740ba050 2024-09-21T06:05:14.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.668+0000 7fa279000640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa250078bc0 0x7fa25007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:14.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.668+0000 7fa279000640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa250078bc0 0x7fa25007b0d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa264033000 tx=0x7fa264004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:14.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.671+0000 7fa271600640 1 -- 172.21.15.118:0/4008146007 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa25c062f50 con 0x7fa2740ba050 2024-09-21T06:05:14.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.856+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2740b5d70 con 0x7fa2740ba050 2024-09-21T06:05:14.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.857+0000 7fa271600640 1 -- 172.21.15.118:0/4008146007 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fa25c067980 con 0x7fa2740ba050 2024-09-21T06:05:14.859 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:05:14.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa250078bc0 msgr2=0x7fa25007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa250078bc0 0x7fa25007b0d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa264033000 tx=0x7fa264004730 comp rx=0 tx=0).stop 2024-09-21T06:05:14.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740ba050 msgr2=0x7fa2740ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740ba050 0x7fa2740ce170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00d750 tx=0x7fa25c00dc10 comp rx=0 tx=0).stop 2024-09-21T06:05:14.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 shutdown_connections 2024-09-21T06:05:14.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa250078bc0 0x7fa25007b0d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2740d3930 0x7fa2741f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2740ba050 0x7fa2740ce170 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 --2- 172.21.15.118:0/4008146007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2740b62b0 0x7fa2741d78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 >> 172.21.15.118:0/4008146007 conn(0x7fa2740d4d40 msgr2=0x7fa2740d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:14.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 shutdown_connections 2024-09-21T06:05:14.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:14.859+0000 7fa27ba00640 1 -- 172.21.15.118:0/4008146007 wait complete. 2024-09-21T06:05:14.884 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 -- 172.21.15.118:0/3320341272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d8142e40 msgr2=0x7f66d80d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 --2- 172.21.15.118:0/3320341272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d8142e40 0x7f66d80d13c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f66d8071c00 tx=0x7f66d002a980 comp rx=0 tx=0).stop 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 -- 172.21.15.118:0/3320341272 shutdown_connections 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 --2- 172.21.15.118:0/3320341272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d8142e40 0x7f66d80d13c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 --2- 172.21.15.118:0/3320341272 >> v2:172.21.15.149:3300/0 conn(0x7f66d813fae0 0x7f66d80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 -- 172.21.15.118:0/3320341272 >> 172.21.15.118:0/3320341272 conn(0x7f66d806d110 msgr2=0x7f66d806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 -- 172.21.15.118:0/3320341272 shutdown_connections 2024-09-21T06:05:15.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.104+0000 7f66dea00640 1 -- 172.21.15.118:0/3320341272 wait complete. 2024-09-21T06:05:15.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.106+0000 7f66dea00640 1 Processor -- start 2024-09-21T06:05:15.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.106+0000 7f66dea00640 1 -- start start 2024-09-21T06:05:15.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66dea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d813fae0 0x7f66d80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66dea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d813fef0 0x7f66d8072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66dea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d8142e40 0x7f66d813ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66dea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80cfa70 con 0x7f66d813fae0 2024-09-21T06:05:15.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66dea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80cf8f0 con 0x7f66d8142e40 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66dea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f66d80cfbf0 con 0x7f66d813fef0 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66d7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d813fae0 0x7f66d80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66d7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d813fae0 0x7f66d80b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56582/0 (socket says 172.21.15.118:56582) 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66d7e00640 1 -- 172.21.15.118:0/3397714024 learned_addr learned my addr 172.21.15.118:0/3397714024 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66cf400640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d813fef0 0x7f66d8072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.108+0000 7f66dca00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d8142e40 0x7f66d813ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d7e00640 1 -- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d813fef0 msgr2=0x7f66d8072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d7e00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d813fef0 0x7f66d8072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d7e00640 1 -- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d8142e40 msgr2=0x7f66d813ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d7e00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d8142e40 0x7f66d813ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d7e00640 1 -- 172.21.15.118:0/3397714024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d80b3d10 con 0x7f66d813fae0 2024-09-21T06:05:15.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66dca00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d8142e40 0x7f66d813ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:15.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66cf400640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d813fef0 0x7f66d8072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:15.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d7e00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d813fae0 0x7f66d80b4db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f66c800d6d0 tx=0x7f66c800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:15.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d4c00640 1 -- 172.21.15.118:0/3397714024 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8017070 con 0x7f66d813fae0 2024-09-21T06:05:15.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d4c00640 1 -- 172.21.15.118:0/3397714024 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66c8005330 con 0x7f66d813fae0 2024-09-21T06:05:15.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d80b3ff0 con 0x7f66d813fae0 2024-09-21T06:05:15.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66d4c00640 1 -- 172.21.15.118:0/3397714024 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8009820 con 0x7f66d813fae0 2024-09-21T06:05:15.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.109+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d80b45b0 con 0x7f66d813fae0 2024-09-21T06:05:15.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.110+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d80d0130 con 0x7f66d813fae0 2024-09-21T06:05:15.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.112+0000 7f66d4c00640 1 -- 172.21.15.118:0/3397714024 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66c8009bd0 con 0x7f66d813fae0 2024-09-21T06:05:15.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.113+0000 7f66d4c00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f66b4078b90 0x7f66b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.113+0000 7f66d4c00640 1 -- 172.21.15.118:0/3397714024 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f66c809ade0 con 0x7f66d813fae0 2024-09-21T06:05:15.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.113+0000 7f66cf400640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f66b4078b90 0x7f66b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.114+0000 7f66cf400640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f66b4078b90 0x7f66b407b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f66c0006fd0 tx=0x7f66c0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:15.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.117+0000 7f66d4c00640 1 -- 172.21.15.118:0/3397714024 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66c8063480 con 0x7f66d813fae0 2024-09-21T06:05:15.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.370+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7f66d8161550 con 0x7f66d813fae0 2024-09-21T06:05:15.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.978+0000 7f66d4c00640 1 -- 172.21.15.118:0/3397714024 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v94) ==== 145+0+0 (secure 0 0 0) 0x7f66c8062d80 con 0x7f66d813fae0 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f66b4078b90 msgr2=0x7f66b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f66b4078b90 0x7f66b407b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f66c0006fd0 tx=0x7f66c0008040 comp rx=0 tx=0).stop 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d813fae0 msgr2=0x7f66d80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d813fae0 0x7f66d80b4db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f66c800d6d0 tx=0x7f66c800db90 comp rx=0 tx=0).stop 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 shutdown_connections 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d8142e40 0x7f66d813ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f66b4078b90 0x7f66b407b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d813fef0 0x7f66d8072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 --2- 172.21.15.118:0/3397714024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d813fae0 0x7f66d80b4db0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 >> 172.21.15.118:0/3397714024 conn(0x7f66d806d110 msgr2=0x7f66d81609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:15.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 shutdown_connections 2024-09-21T06:05:15.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:15.981+0000 7f66dea00640 1 -- 172.21.15.118:0/3397714024 wait complete. 2024-09-21T06:05:16.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-21T06:05:16.243 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_objectstore":"memstore"} 2024-09-21T06:05:16.243 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-21T06:05:16.244 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 -- 172.21.15.118:0/3654493051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fef0 msgr2=0x7f24680d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 --2- 172.21.15.118:0/3654493051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fef0 0x7f24680d13c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2468071c00 tx=0x7f245402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 -- 172.21.15.118:0/3654493051 shutdown_connections 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 --2- 172.21.15.118:0/3654493051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fef0 0x7f24680d13c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 --2- 172.21.15.118:0/3654493051 >> v2:172.21.15.149:3300/0 conn(0x7f246813fae0 0x7f24680d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 -- 172.21.15.118:0/3654493051 >> 172.21.15.118:0/3654493051 conn(0x7f246806d110 msgr2=0x7f246806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 -- 172.21.15.118:0/3654493051 shutdown_connections 2024-09-21T06:05:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.462+0000 7f246fa00640 1 -- 172.21.15.118:0/3654493051 wait complete. 2024-09-21T06:05:16.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.464+0000 7f246fa00640 1 Processor -- start 2024-09-21T06:05:16.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.465+0000 7f246fa00640 1 -- start start 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246fa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fae0 0x7f24681f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246813fef0 0x7f2468152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246fa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468142730 0x7f2468141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246fa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f24680cfa70 con 0x7f246813fae0 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246fa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24680cf8f0 con 0x7f2468142730 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24680cfbf0 con 0x7f246813fef0 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fae0 0x7f24681f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fae0 0x7f24681f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54024/0 (socket says 172.21.15.118:54024) 2024-09-21T06:05:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.466+0000 7f246d000640 1 -- 172.21.15.118:0/3285720405 learned_addr learned my addr 172.21.15.118:0/3285720405 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f2467e00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246813fef0 0x7f2468152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246da00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468142730 0x7f2468141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246d000640 1 -- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246813fef0 msgr2=0x7f2468152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246d000640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246813fef0 0x7f2468152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246d000640 1 -- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468142730 msgr2=0x7f2468141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246d000640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468142730 0x7f2468141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246d000640 1 -- 172.21.15.118:0/3285720405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2468152b90 con 0x7f246813fae0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246d000640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fae0 0x7f24681f9cf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f245c00d770 tx=0x7f245c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f2464c00640 1 -- 172.21.15.118:0/3285720405 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c017070 con 0x7f246813fae0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f2464c00640 1 -- 172.21.15.118:0/3285720405 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f245c009d20 con 0x7f246813fae0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24680b4b60 con 0x7f246813fae0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f2464c00640 1 -- 172.21.15.118:0/3285720405 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c004280 con 0x7f246813fae0 2024-09-21T06:05:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.467+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2468151e50 con 0x7f246813fae0 2024-09-21T06:05:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.469+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24680d0110 con 0x7f246813fae0 2024-09-21T06:05:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.470+0000 7f2464c00640 1 -- 172.21.15.118:0/3285720405 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f245c005020 con 0x7f246813fae0 2024-09-21T06:05:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.471+0000 7f2464c00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2448078bc0 0x7f244807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.471+0000 7f2464c00640 1 -- 172.21.15.118:0/3285720405 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f245c09aed0 con 0x7f246813fae0 2024-09-21T06:05:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.471+0000 7f2467e00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2448078bc0 0x7f244807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.472+0000 7f2467e00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2448078bc0 0x7f244807b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2454034000 tx=0x7f2454004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:16.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.475+0000 7f2464c00640 1 -- 172.21.15.118:0/3285720405 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f245c020020 con 0x7f246813fae0 2024-09-21T06:05:16.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.661+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f2468160410 con 0x7f246813fae0 2024-09-21T06:05:16.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.662+0000 7f2464c00640 1 -- 172.21.15.118:0/3285720405 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v25) ==== 59+0+1472 (secure 0 0 0) 0x7f245c063570 con 0x7f246813fae0 2024-09-21T06:05:16.663 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:05:16.663 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:05:16.663 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:05:16.664 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:05:16.665 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:05:16.665 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:05:16.665 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:05:16.665 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:05:16.665 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:05:16.665 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:05:16.665 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2448078bc0 msgr2=0x7f244807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2448078bc0 0x7f244807b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2454034000 tx=0x7f2454004730 comp rx=0 tx=0).stop 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fae0 msgr2=0x7f24681f9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fae0 0x7f24681f9cf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f245c00d770 tx=0x7f245c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 shutdown_connections 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2468142730 0x7f2468141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2448078bc0 0x7f244807b0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246813fef0 0x7f2468152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 --2- 172.21.15.118:0/3285720405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246813fae0 0x7f24681f9cf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 >> 172.21.15.118:0/3285720405 conn(0x7f246806d110 msgr2=0x7f2468153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:16.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 shutdown_connections 2024-09-21T06:05:16.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.664+0000 7f246fa00640 1 -- 172.21.15.118:0/3285720405 wait complete. 2024-09-21T06:05:16.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:05:16.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.912+0000 7fdbcd000640 1 -- 172.21.15.118:0/226238076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 msgr2=0x7fdbac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.912+0000 7fdbcd000640 1 --2- 172.21.15.118:0/226238076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 0x7fdbac00b9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009ed0 tx=0x7fdbac005830 comp rx=0 tx=0).stop 2024-09-21T06:05:16.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.912+0000 7fdbcd000640 1 -- 172.21.15.118:0/226238076 shutdown_connections 2024-09-21T06:05:16.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.912+0000 7fdbcd000640 1 --2- 172.21.15.118:0/226238076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 0x7fdbac00b9c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.912+0000 7fdbcd000640 1 -- 172.21.15.118:0/226238076 >> 172.21.15.118:0/226238076 conn(0x7fdbc806d110 msgr2=0x7fdbc806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:16.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.912+0000 7fdbcd000640 1 -- 172.21.15.118:0/226238076 shutdown_connections 2024-09-21T06:05:16.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.912+0000 7fdbcd000640 1 -- 172.21.15.118:0/226238076 wait complete. 2024-09-21T06:05:16.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.914+0000 7fdbcd000640 1 Processor -- start 2024-09-21T06:05:16.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.914+0000 7fdbcd000640 1 -- start start 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbcd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 0x7fdbc81f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbcd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbc8074920 0x7fdbc8145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbcd000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbc815e6c0 0x7fdbc815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbcd000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc80d15d0 con 0x7fdbc815e6c0 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbcd000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc80d1450 con 0x7fdbac005250 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbcd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc80d1750 con 0x7fdbc8074920 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbc815e6c0 0x7fdbc815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbc815e6c0 0x7fdbc815ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54042/0 (socket says 172.21.15.118:54042) 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 -- 172.21.15.118:0/1187900118 learned_addr learned my addr 172.21.15.118:0/1187900118 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc5e00640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 0x7fdbc81f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc5400640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbc8074920 0x7fdbc8145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 -- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbc8074920 msgr2=0x7fdbc8145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbc8074920 0x7fdbc8145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 -- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 msgr2=0x7fdbc81f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 0x7fdbc81f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.916+0000 7fdbc6800640 1 -- 172.21.15.118:0/1187900118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc8160380 con 0x7fdbc815e6c0 2024-09-21T06:05:16.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.917+0000 7fdbc6800640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbc815e6c0 0x7fdbc815ead0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009ed0 tx=0x7fdbc00042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:16.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.917+0000 7fdbbe000640 1 -- 172.21.15.118:0/1187900118 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0009ad0 con 0x7fdbc815e6c0 2024-09-21T06:05:16.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.917+0000 7fdbbe000640 1 -- 172.21.15.118:0/1187900118 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbc0004880 con 0x7fdbc815e6c0 2024-09-21T06:05:16.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.917+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc8160660 con 0x7fdbc815e6c0 2024-09-21T06:05:16.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.917+0000 7fdbbe000640 1 -- 172.21.15.118:0/1187900118 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc003c6e0 con 0x7fdbc815e6c0 2024-09-21T06:05:16.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.917+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc81f95c0 con 0x7fdbc815e6c0 2024-09-21T06:05:16.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.918+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc81613d0 con 0x7fdbc815e6c0 2024-09-21T06:05:16.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.919+0000 7fdbbe000640 1 -- 172.21.15.118:0/1187900118 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbc0044020 con 0x7fdbc815e6c0 2024-09-21T06:05:16.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.921+0000 7fdbbe000640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdba8078b90 0x7fdba807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:16.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.921+0000 7fdbbe000640 1 -- 172.21.15.118:0/1187900118 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fdbc00bba60 con 0x7fdbc815e6c0 2024-09-21T06:05:16.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.922+0000 7fdbc5e00640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdba8078b90 0x7fdba807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:16.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.922+0000 7fdbc5e00640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdba8078b90 0x7fdba807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8001050 tx=0x7fdbb80067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:16.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:16.925+0000 7fdbbe000640 1 -- 172.21.15.118:0/1187900118 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdbc004b020 con 0x7fdbc815e6c0 2024-09-21T06:05:17.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.113+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdbc80b5b40 con 0x7fdbc815e6c0 2024-09-21T06:05:17.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.117+0000 7fdbbe000640 1 -- 172.21.15.118:0/1187900118 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fdbc0084230 con 0x7fdbc815e6c0 2024-09-21T06:05:17.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdba8078b90 msgr2=0x7fdba807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdba8078b90 0x7fdba807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8001050 tx=0x7fdbb80067a0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbc815e6c0 msgr2=0x7fdbc815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbc815e6c0 0x7fdbc815ead0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009ed0 tx=0x7fdbc00042d0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 shutdown_connections 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbc815e6c0 0x7fdbc815ead0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdba8078b90 0x7fdba807b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbc8074920 0x7fdbc8145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 --2- 172.21.15.118:0/1187900118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbac005250 0x7fdbc81f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 >> 172.21.15.118:0/1187900118 conn(0x7fdbc806d110 msgr2=0x7fdbc813d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 shutdown_connections 2024-09-21T06:05:17.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.120+0000 7fdbcd000640 1 -- 172.21.15.118:0/1187900118 wait complete. 2024-09-21T06:05:17.146 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:05:17.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:05:17.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:05:17.345 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:05:17.346 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:17.346 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:17.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:05:17.381 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:05:17.381 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:17.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:05:17.418 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:17.418 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:17.456 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:05:17.457 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:05:17.457 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:17.493 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:05:17.494 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:05:17.494 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:17.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.712+0000 7f5c6b200640 1 -- 172.21.15.118:0/1516734837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0b5bb0 msgr2=0x7f5c6c0b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.712+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1516734837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0b5bb0 0x7f5c6c0b5fc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5c64005fd0 tx=0x7f5c6402a970 comp rx=0 tx=0).stop 2024-09-21T06:05:17.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.712+0000 7f5c6b200640 1 -- 172.21.15.118:0/1516734837 shutdown_connections 2024-09-21T06:05:17.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.712+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1516734837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0b5bb0 0x7f5c6c0b5fc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.712+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1516734837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c6c0cfe30 0x7f5c6c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.712+0000 7f5c6b200640 1 -- 172.21.15.118:0/1516734837 >> 172.21.15.118:0/1516734837 conn(0x7f5c6c06d6e0 msgr2=0x7f5c6c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:17.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.713+0000 7f5c6b200640 1 -- 172.21.15.118:0/1516734837 shutdown_connections 2024-09-21T06:05:17.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.713+0000 7f5c6b200640 1 -- 172.21.15.118:0/1516734837 wait complete. 2024-09-21T06:05:17.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.715+0000 7f5c6b200640 1 Processor -- start 2024-09-21T06:05:17.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.715+0000 7f5c6b200640 1 -- start start 2024-09-21T06:05:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.716+0000 7f5c6b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c6c073fa0 0x7f5c6c0cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.716+0000 7f5c6b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c6c0b5bb0 0x7f5c6c0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.716+0000 7f5c6b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0cfe30 0x7f5c6c1f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.716+0000 7f5c6b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c15d9c0 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.716+0000 7f5c6b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c15d840 con 0x7f5c6c073fa0 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.716+0000 7f5c6b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c15db40 con 0x7f5c6c0b5bb0 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.716+0000 7f5c6a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0cfe30 0x7f5c6c1f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0cfe30 0x7f5c6c1f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54064/0 (socket says 172.21.15.118:54064) 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 -- 172.21.15.118:0/1470179259 learned_addr learned my addr 172.21.15.118:0/1470179259 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c63e00640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c6c0b5bb0 0x7f5c6c0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c69e00640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c6c073fa0 0x7f5c6c0cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 -- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c6c0b5bb0 msgr2=0x7f5c6c0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c6c0b5bb0 0x7f5c6c0cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 -- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c6c073fa0 msgr2=0x7f5c6c0cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c6c073fa0 0x7f5c6c0cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 -- 172.21.15.118:0/1470179259 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c0c9e70 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c6a800640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0cfe30 0x7f5c6c1f5e80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c64033040 tx=0x7f5c64003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:17.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.717+0000 7f5c62000640 1 -- 172.21.15.118:0/1470179259 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64034040 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.718+0000 7f5c62000640 1 -- 172.21.15.118:0/1470179259 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c64004540 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.718+0000 7f5c62000640 1 -- 172.21.15.118:0/1470179259 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64045480 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.718+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c0ca150 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.718+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c0ca710 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.719+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6c15f200 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.720+0000 7f5c62000640 1 -- 172.21.15.118:0/1470179259 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c64037020 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.721+0000 7f5c62000640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c48078b90 0x7f5c4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.721+0000 7f5c62000640 1 -- 172.21.15.118:0/1470179259 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5c640bc340 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.721+0000 7f5c69e00640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c48078b90 0x7f5c4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.722+0000 7f5c69e00640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c48078b90 0x7f5c4807b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c006fd0 tx=0x7f5c5c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:17.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.725+0000 7f5c62000640 1 -- 172.21.15.118:0/1470179259 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5c6c0b6500 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.945+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c6c15bbb0 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.946+0000 7f5c62000640 1 -- 172.21.15.118:0/1470179259 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3923 (secure 0 0 0) 0x7f5c64084a80 con 0x7f5c6c0cfe30 2024-09-21T06:05:17.947 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:17.947 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":18,"btime":"2024-09-21T06:05:10:954839+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2668357419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2668357419},{"type":"v1","addr":"172.21.15.118:6834","nonce":2668357419}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1257991047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1257991047},{"type":"v1","addr":"172.21.15.149:6837","nonce":1257991047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3800326409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3800326409},{"type":"v1","addr":"172.21.15.118:6835","nonce":3800326409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2354546140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2354546140},{"type":"v1","addr":"172.21.15.149:6836","nonce":2354546140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-21T06:05:17.948 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 18 2024-09-21T06:05:17.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c48078b90 msgr2=0x7f5c4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c48078b90 0x7f5c4807b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c006fd0 tx=0x7f5c5c008040 comp rx=0 tx=0).stop 2024-09-21T06:05:17.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0cfe30 msgr2=0x7f5c6c1f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0cfe30 0x7f5c6c1f5e80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c64033040 tx=0x7f5c64003f10 comp rx=0 tx=0).stop 2024-09-21T06:05:17.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 shutdown_connections 2024-09-21T06:05:17.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6c0cfe30 0x7f5c6c1f5e80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5c48078b90 0x7f5c4807b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c6c0b5bb0 0x7f5c6c0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 --2- 172.21.15.118:0/1470179259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c6c073fa0 0x7f5c6c0cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 >> 172.21.15.118:0/1470179259 conn(0x7f5c6c06d6e0 msgr2=0x7f5c6c15f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:17.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.948+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 shutdown_connections 2024-09-21T06:05:17.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:17.949+0000 7f5c6b200640 1 -- 172.21.15.118:0/1470179259 wait complete. 2024-09-21T06:05:17.972 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:05:17.972 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:05:17.972 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:05:17.972 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:05:17.973 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:05:17.973 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:05:17.973 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:05:17.973 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:05:17.973 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:05:17.973 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:05:17.973 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:05:17.974 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:05:17.974 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:05:17.974 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:05:17.974 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:05:17.974 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:05:17.996 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:05:17.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:05:17.998 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:05:17.998 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:05:17.999 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:05:17.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:05:18.000 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:05:18.000 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:05:18.042 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:05:18.042 DEBUG:teuthology.parallel:result is None 2024-09-21T06:05:18.043 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:05:18.044 DEBUG:teuthology.parallel:result is None 2024-09-21T06:05:18.044 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:05:18.045 DEBUG:teuthology.parallel:result is None 2024-09-21T06:05:18.046 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:05:18.047 DEBUG:teuthology.parallel:result is None 2024-09-21T06:05:18.047 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:05:18.239 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:05:18.239 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:05:18.240 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:05:18.241 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:05:18.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.280+0000 7f7bd9e00640 1 -- 172.21.15.118:0/3240359704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8004d40 msgr2=0x7f7bb80051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:18.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.280+0000 7f7bd9e00640 1 --2- 172.21.15.118:0/3240359704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8004d40 0x7f7bb80051f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c2e0 tx=0x7f7bb8005830 comp rx=0 tx=0).stop 2024-09-21T06:05:18.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.280+0000 7f7bd3400640 1 -- 172.21.15.118:0/3240359704 reap_dead start 2024-09-21T06:05:18.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.280+0000 7f7bd9e00640 1 -- 172.21.15.118:0/3240359704 shutdown_connections 2024-09-21T06:05:18.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.280+0000 7f7bd9e00640 1 -- 172.21.15.118:0/3240359704 >> 172.21.15.118:0/3240359704 conn(0x7f7bd406d110 msgr2=0x7f7bd406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:18.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.280+0000 7f7bd9e00640 1 -- 172.21.15.118:0/3240359704 shutdown_connections 2024-09-21T06:05:18.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.280+0000 7f7bd9e00640 1 -- 172.21.15.118:0/3240359704 wait complete. 2024-09-21T06:05:18.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.283+0000 7f7bd9e00640 1 Processor -- start 2024-09-21T06:05:18.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.283+0000 7f7bd9e00640 1 -- start start 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb8004d40 0x7f7bd4131b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd4154300 0x7f7bd41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bd413d080 0x7f7bd413d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd9e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd40d17e0 con 0x7f7bd413d080 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd9e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd40d1660 con 0x7f7bd4154300 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd9e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd40cf950 con 0x7f7bb8004d40 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bd413d080 0x7f7bd413d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bd413d080 0x7f7bd413d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54106/0 (socket says 172.21.15.118:54106) 2024-09-21T06:05:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.284+0000 7f7bd3400640 1 -- 172.21.15.118:0/1936829529 learned_addr learned my addr 172.21.15.118:0/1936829529 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bca000640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd4154300 0x7f7bd41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bd2a00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb8004d40 0x7f7bd4131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bd3400640 1 -- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb8004d40 msgr2=0x7f7bd4131b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bd3400640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb8004d40 0x7f7bd4131b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bd3400640 1 -- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd4154300 msgr2=0x7f7bd41579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bd3400640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd4154300 0x7f7bd41579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bd3400640 1 -- 172.21.15.118:0/1936829529 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd4132080 con 0x7f7bd413d080 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bd3400640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bd413d080 0x7f7bd413d490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc02b130 tx=0x7f7bcc036c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bcbe00640 1 -- 172.21.15.118:0/1936829529 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc031070 con 0x7f7bd413d080 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.285+0000 7f7bcbe00640 1 -- 172.21.15.118:0/1936829529 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bcc0014f0 con 0x7f7bd413d080 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.286+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd4156900 con 0x7f7bd413d080 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.286+0000 7f7bcbe00640 1 -- 172.21.15.118:0/1936829529 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4009ad0 con 0x7f7bd413d080 2024-09-21T06:05:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.286+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd4156ec0 con 0x7f7bd413d080 2024-09-21T06:05:18.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.287+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd4076790 con 0x7f7bd413d080 2024-09-21T06:05:18.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.288+0000 7f7bcbe00640 1 -- 172.21.15.118:0/1936829529 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bcc034070 con 0x7f7bd413d080 2024-09-21T06:05:18.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.289+0000 7f7bcbe00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:18.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.289+0000 7f7bcbe00640 1 -- 172.21.15.118:0/1936829529 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f7bcc0baa20 con 0x7f7bd413d080 2024-09-21T06:05:18.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.289+0000 7f7bd2a00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:18.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.290+0000 7f7bd2a00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009aa0 tx=0x7f7bc4009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:18.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.292+0000 7f7bcbe00640 1 -- 172.21.15.118:0/1936829529 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7bd4076790 con 0x7f7bd413d080 2024-09-21T06:05:18.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:18.487+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7bd4155130 con 0x7f7bd413d080 2024-09-21T06:05:18.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:05:18.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:05:19.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.130+0000 7f7bcbe00640 1 -- 172.21.15.118:0/1936829529 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) ==== 97+0+0 (secure 0 0 0) 0x7f7bcc006630 con 0x7f7bd413d080 2024-09-21T06:05:19.131 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:05:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.133+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 msgr2=0x7f7bb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.133+0000 7f7bd9e00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009aa0 tx=0x7f7bc4009500 comp rx=0 tx=0).stop 2024-09-21T06:05:19.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.133+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bd413d080 msgr2=0x7f7bd413d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.133+0000 7f7bd9e00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bd413d080 0x7f7bd413d490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc02b130 tx=0x7f7bcc036c20 comp rx=0 tx=0).stop 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 shutdown_connections 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bd413d080 0x7f7bd413d490 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd4154300 0x7f7bd41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 --2- 172.21.15.118:0/1936829529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb8004d40 0x7f7bd4131b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 >> 172.21.15.118:0/1936829529 conn(0x7f7bd406d110 msgr2=0x7f7bd415c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 shutdown_connections 2024-09-21T06:05:19.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.134+0000 7f7bd9e00640 1 -- 172.21.15.118:0/1936829529 wait complete. 2024-09-21T06:05:19.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:05:19.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.378+0000 7f85fa800640 1 -- 172.21.15.118:0/2368527782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 msgr2=0x7f85dc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.378+0000 7f85fa800640 1 --2- 172.21.15.118:0/2368527782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 0x7f85dc005150 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f85f415d320 tx=0x7f85dc005830 comp rx=0 tx=0).stop 2024-09-21T06:05:19.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.378+0000 7f85f9e00640 1 -- 172.21.15.118:0/2368527782 reap_dead start 2024-09-21T06:05:19.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.378+0000 7f85fa800640 1 -- 172.21.15.118:0/2368527782 shutdown_connections 2024-09-21T06:05:19.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.378+0000 7f85fa800640 1 -- 172.21.15.118:0/2368527782 >> 172.21.15.118:0/2368527782 conn(0x7f85f406d6e0 msgr2=0x7f85f40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:19.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.378+0000 7f85fa800640 1 -- 172.21.15.118:0/2368527782 shutdown_connections 2024-09-21T06:05:19.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.378+0000 7f85fa800640 1 -- 172.21.15.118:0/2368527782 wait complete. 2024-09-21T06:05:19.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.380+0000 7f85fa800640 1 Processor -- start 2024-09-21T06:05:19.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.380+0000 7f85fa800640 1 -- start start 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85fa800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 0x7f85f4145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85fa800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f41e7bf0 0x7f85f4139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85fa800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85f415c260 0x7f85f415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85fa800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f85f40d05d0 con 0x7f85dc004d40 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85fa800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85f40d0450 con 0x7f85f41e7bf0 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85fa800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85f415d630 con 0x7f85f415c260 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 0x7f85f4145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 0x7f85f4145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54116/0 (socket says 172.21.15.118:54116) 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 -- 172.21.15.118:0/1099334651 learned_addr learned my addr 172.21.15.118:0/1099334651 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9e00640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85f415c260 0x7f85f415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f8a00640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f41e7bf0 0x7f85f4139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 -- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85f415c260 msgr2=0x7f85f415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85f415c260 0x7f85f415c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 -- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f41e7bf0 msgr2=0x7f85f4139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f41e7bf0 0x7f85f4139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.382+0000 7f85f9400640 1 -- 172.21.15.118:0/1099334651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f415cbb0 con 0x7f85dc004d40 2024-09-21T06:05:19.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.383+0000 7f85f9400640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 0x7f85f4145450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006670 tx=0x7f85e80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:19.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.383+0000 7f85f1600640 1 -- 172.21.15.118:0/1099334651 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8015070 con 0x7f85dc004d40 2024-09-21T06:05:19.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.383+0000 7f85f1600640 1 -- 172.21.15.118:0/1099334651 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e8011920 con 0x7f85dc004d40 2024-09-21T06:05:19.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.383+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f41e8000 con 0x7f85dc004d40 2024-09-21T06:05:19.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.383+0000 7f85f1600640 1 -- 172.21.15.118:0/1099334651 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8011d70 con 0x7f85dc004d40 2024-09-21T06:05:19.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.383+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f41e6e30 con 0x7f85dc004d40 2024-09-21T06:05:19.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.384+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f40b5fc0 con 0x7f85dc004d40 2024-09-21T06:05:19.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.386+0000 7f85f1600640 1 -- 172.21.15.118:0/1099334651 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85e8018070 con 0x7f85dc004d40 2024-09-21T06:05:19.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.387+0000 7f85f1600640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f85d4078b90 0x7f85d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.387+0000 7f85f1600640 1 -- 172.21.15.118:0/1099334651 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f85e809b840 con 0x7f85dc004d40 2024-09-21T06:05:19.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.388+0000 7f85f8a00640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f85d4078b90 0x7f85d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.388+0000 7f85f8a00640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f85d4078b90 0x7f85d407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85f40733d0 tx=0x7f85e0005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:19.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.392+0000 7f85f1600640 1 -- 172.21.15.118:0/1099334651 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f85f415cbb0 con 0x7f85dc004d40 2024-09-21T06:05:19.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.644+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f85f4157230 con 0x7f85dc004d40 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.644+0000 7f85f1600640 1 -- 172.21.15.118:0/1099334651 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f85f40b6500 con 0x7f85dc004d40 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.646 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:05:19.647 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:05:19.648 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.649 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:05:19.650 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.651 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.652 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.653 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.654 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:05:19.655 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.656 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:05:19.657 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:05:19.658 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:05:19.659 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:05:19.660 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:05:19.660 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:05:19.660 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:05:19.660 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.660 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:19.660 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:19.660 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.646+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f85d4078b90 msgr2=0x7f85d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.646+0000 7f85fa800640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f85d4078b90 0x7f85d407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85f40733d0 tx=0x7f85e0005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.646+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 msgr2=0x7f85f4145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.646+0000 7f85fa800640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 0x7f85f4145450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006670 tx=0x7f85e80039c0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 shutdown_connections 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f85d4078b90 0x7f85d407b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85f415c260 0x7f85f415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85f41e7bf0 0x7f85f4139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 --2- 172.21.15.118:0/1099334651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc004d40 0x7f85f4145450 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 >> 172.21.15.118:0/1099334651 conn(0x7f85f406d6e0 msgr2=0x7f85f40cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:19.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 shutdown_connections 2024-09-21T06:05:19.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.647+0000 7f85fa800640 1 -- 172.21.15.118:0/1099334651 wait complete. 2024-09-21T06:05:19.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:05:19.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.894+0000 7fa38c000640 1 -- 172.21.15.118:0/1737963576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa38415cfd0 msgr2=0x7fa3840b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.894+0000 7fa38c000640 1 --2- 172.21.15.118:0/1737963576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa38415cfd0 0x7fa3840b3a60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa378009830 tx=0x7fa37802a520 comp rx=0 tx=0).stop 2024-09-21T06:05:19.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.894+0000 7fa38c000640 1 -- 172.21.15.118:0/1737963576 shutdown_connections 2024-09-21T06:05:19.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.894+0000 7fa38c000640 1 --2- 172.21.15.118:0/1737963576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa38415cfd0 0x7fa3840b3a60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.894+0000 7fa38c000640 1 -- 172.21.15.118:0/1737963576 >> 172.21.15.118:0/1737963576 conn(0x7fa38406d110 msgr2=0x7fa38406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:19.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.894+0000 7fa38c000640 1 -- 172.21.15.118:0/1737963576 shutdown_connections 2024-09-21T06:05:19.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.894+0000 7fa38c000640 1 -- 172.21.15.118:0/1737963576 wait complete. 2024-09-21T06:05:19.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.896+0000 7fa38c000640 1 Processor -- start 2024-09-21T06:05:19.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.896+0000 7fa38c000640 1 -- start start 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa38c000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3840b5040 0x7fa3841e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa38c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3840b5450 0x7fa3841e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa38c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa38415cfd0 0x7fa3840cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa38c000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa384073e40 con 0x7fa3840b5040 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa38c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa384073cc0 con 0x7fa3840b5450 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa38c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa384073fc0 con 0x7fa38415cfd0 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa389600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3840b5040 0x7fa3841e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa389600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3840b5040 0x7fa3841e7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54130/0 (socket says 172.21.15.118:54130) 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa389600640 1 -- 172.21.15.118:0/2782068238 learned_addr learned my addr 172.21.15.118:0/2782068238 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa38a000640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa38415cfd0 0x7fa3840cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.898+0000 7fa388c00640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3840b5450 0x7fa3841e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa389600640 1 -- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa38415cfd0 msgr2=0x7fa3840cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa389600640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa38415cfd0 0x7fa3840cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa389600640 1 -- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3840b5450 msgr2=0x7fa3841e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa389600640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3840b5450 0x7fa3841e7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa389600640 1 -- 172.21.15.118:0/2782068238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa384144be0 con 0x7fa3840b5040 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa389600640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3840b5040 0x7fa3841e7200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa378009780 tx=0x7fa378033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa381600640 1 -- 172.21.15.118:0/2782068238 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378005c90 con 0x7fa3840b5040 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa381600640 1 -- 172.21.15.118:0/2782068238 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa378031e50 con 0x7fa3840b5040 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa381600640 1 -- 172.21.15.118:0/2782068238 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378005280 con 0x7fa3840b5040 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3841e5470 con 0x7fa3840b5040 2024-09-21T06:05:19.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.899+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa384144900 con 0x7fa3840b5040 2024-09-21T06:05:19.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.900+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3840744a0 con 0x7fa3840b5040 2024-09-21T06:05:19.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.902+0000 7fa381600640 1 -- 172.21.15.118:0/2782068238 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa378005420 con 0x7fa3840b5040 2024-09-21T06:05:19.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.903+0000 7fa381600640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa364078b90 0x7fa36407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:19.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.903+0000 7fa381600640 1 -- 172.21.15.118:0/2782068238 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7fa3780bb950 con 0x7fa3840b5040 2024-09-21T06:05:19.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.903+0000 7fa388c00640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa364078b90 0x7fa36407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:19.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.904+0000 7fa388c00640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa364078b90 0x7fa36407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3841e87e0 tx=0x7fa370009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:19.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:19.907+0000 7fa381600640 1 -- 172.21.15.118:0/2782068238 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa37803f030 con 0x7fa3840b5040 2024-09-21T06:05:20.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.096+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa38406fa60 con 0x7fa3840b5040 2024-09-21T06:05:20.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.097+0000 7fa381600640 1 -- 172.21.15.118:0/2782068238 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) ==== 84+0+65 (secure 0 0 0) 0x7fa378083b20 con 0x7fa3840b5040 2024-09-21T06:05:20.098 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:20.098 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:05:20.099 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:20.099 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:05:20.099 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:05:20.099 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:20.099 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:05:20.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa364078b90 msgr2=0x7fa36407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa364078b90 0x7fa36407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3841e87e0 tx=0x7fa370009040 comp rx=0 tx=0).stop 2024-09-21T06:05:20.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3840b5040 msgr2=0x7fa3841e7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3840b5040 0x7fa3841e7200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa378009780 tx=0x7fa378033c20 comp rx=0 tx=0).stop 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 shutdown_connections 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa364078b90 0x7fa36407b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa38415cfd0 0x7fa3840cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3840b5450 0x7fa3841e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 --2- 172.21.15.118:0/2782068238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3840b5040 0x7fa3841e7200 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 >> 172.21.15.118:0/2782068238 conn(0x7fa38406d110 msgr2=0x7fa384145350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.099+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 shutdown_connections 2024-09-21T06:05:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.100+0000 7fa38c000640 1 -- 172.21.15.118:0/2782068238 wait complete. 2024-09-21T06:05:20.126 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:05:20.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:05:20.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 -- 172.21.15.118:0/2123472776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100cf790 msgr2=0x7fc1100cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 --2- 172.21.15.118:0/2123472776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100cf790 0x7fc1100cd380 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc1100ce270 tx=0x7fc10002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 -- 172.21.15.118:0/2123472776 shutdown_connections 2024-09-21T06:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 --2- 172.21.15.118:0/2123472776 >> v2:172.21.15.149:3300/0 conn(0x7fc110160df0 0x7fc11006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 --2- 172.21.15.118:0/2123472776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100cf790 0x7fc1100cd380 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 -- 172.21.15.118:0/2123472776 >> 172.21.15.118:0/2123472776 conn(0x7fc11006d420 msgr2=0x7fc1100b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:20.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 -- 172.21.15.118:0/2123472776 shutdown_connections 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.360+0000 7fc115e00640 1 -- 172.21.15.118:0/2123472776 wait complete. 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.363+0000 7fc115e00640 1 Processor -- start 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.363+0000 7fc115e00640 1 -- start start 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.364+0000 7fc115e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100cf790 0x7fc1101f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.364+0000 7fc115e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc110156ef0 0x7fc110159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.364+0000 7fc115e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100b14a0 0x7fc1100b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.364+0000 7fc115e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc11006f9c0 con 0x7fc1100b14a0 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.364+0000 7fc115e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc11006f840 con 0x7fc1100cf790 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.364+0000 7fc115e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc11006fb40 con 0x7fc110156ef0 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100b14a0 0x7fc1100b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100b14a0 0x7fc1100b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54148/0 (socket says 172.21.15.118:54148) 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 -- 172.21.15.118:0/3801482170 learned_addr learned my addr 172.21.15.118:0/3801482170 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc107e00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc110156ef0 0x7fc110159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc114a00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100cf790 0x7fc1101f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 -- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc110156ef0 msgr2=0x7fc110159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc110156ef0 0x7fc110159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 -- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100cf790 msgr2=0x7fc1101f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100cf790 0x7fc1101f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 -- 172.21.15.118:0/3801482170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1100b1df0 con 0x7fc1100b14a0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.365+0000 7fc115400640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100b14a0 0x7fc1100b18b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc10800e9c0 tx=0x7fc10800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.366+0000 7fc10d600640 1 -- 172.21.15.118:0/3801482170 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108004d20 con 0x7fc1100b14a0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.366+0000 7fc10d600640 1 -- 172.21.15.118:0/3801482170 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc10800cb20 con 0x7fc1100b14a0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.366+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1101f6850 con 0x7fc1100b14a0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.366+0000 7fc10d600640 1 -- 172.21.15.118:0/3801482170 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108005020 con 0x7fc1100b14a0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.366+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1101f6af0 con 0x7fc1100b14a0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.367+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc110070080 con 0x7fc1100b14a0 2024-09-21T06:05:20.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.368+0000 7fc10d600640 1 -- 172.21.15.118:0/3801482170 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1080051c0 con 0x7fc1100b14a0 2024-09-21T06:05:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.369+0000 7fc10d600640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0ec078b90 0x7fc0ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.369+0000 7fc10d600640 1 -- 172.21.15.118:0/3801482170 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7fc10809b1b0 con 0x7fc1100b14a0 2024-09-21T06:05:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.369+0000 7fc114a00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0ec078b90 0x7fc0ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.370+0000 7fc114a00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0ec078b90 0x7fc0ec07b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc100033000 tx=0x7fc100004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:20.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.374+0000 7fc10d600640 1 -- 172.21.15.118:0/3801482170 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc1100b1df0 con 0x7fc1100b14a0 2024-09-21T06:05:20.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:20.563+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc1100b30f0 con 0x7fc1100b14a0 2024-09-21T06:05:21.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.139+0000 7fc10d600640 1 -- 172.21.15.118:0/3801482170 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) ==== 138+0+0 (secure 0 0 0) 0x7fc108016030 con 0x7fc1100b14a0 2024-09-21T06:05:21.141 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:05:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0ec078b90 msgr2=0x7fc0ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0ec078b90 0x7fc0ec07b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc100033000 tx=0x7fc100004730 comp rx=0 tx=0).stop 2024-09-21T06:05:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100b14a0 msgr2=0x7fc1100b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100b14a0 0x7fc1100b18b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc10800e9c0 tx=0x7fc10800ee80 comp rx=0 tx=0).stop 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 shutdown_connections 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1100b14a0 0x7fc1100b18b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0ec078b90 0x7fc0ec07b0a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc110156ef0 0x7fc110159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 --2- 172.21.15.118:0/3801482170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100cf790 0x7fc1101f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 >> 172.21.15.118:0/3801482170 conn(0x7fc11006d420 msgr2=0x7fc11015c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 shutdown_connections 2024-09-21T06:05:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.142+0000 7fc115e00640 1 -- 172.21.15.118:0/3801482170 wait complete. 2024-09-21T06:05:21.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:05:21.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.401+0000 7f3f7f800640 1 -- 172.21.15.118:0/3155332330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f5c003a00 msgr2=0x7f3f5c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:21.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.401+0000 7f3f7f800640 1 --2- 172.21.15.118:0/3155332330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f5c003a00 0x7f3f5c003e70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c290 tx=0x7f3f5c005830 comp rx=0 tx=0).stop 2024-09-21T06:05:21.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.401+0000 7f3f7d800640 1 -- 172.21.15.118:0/3155332330 reap_dead start 2024-09-21T06:05:21.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.401+0000 7f3f7f800640 1 -- 172.21.15.118:0/3155332330 shutdown_connections 2024-09-21T06:05:21.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.401+0000 7f3f7f800640 1 -- 172.21.15.118:0/3155332330 >> 172.21.15.118:0/3155332330 conn(0x7f3f7806d110 msgr2=0x7f3f7806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:21.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.401+0000 7f3f7f800640 1 -- 172.21.15.118:0/3155332330 shutdown_connections 2024-09-21T06:05:21.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.401+0000 7f3f7f800640 1 -- 172.21.15.118:0/3155332330 wait complete. 2024-09-21T06:05:21.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.404+0000 7f3f7f800640 1 Processor -- start 2024-09-21T06:05:21.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.404+0000 7f3f7f800640 1 -- start start 2024-09-21T06:05:21.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.405+0000 7f3f7f800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f5c003a00 0x7f3f781e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:21.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.405+0000 7f3f7f800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f781e83a0 0x7f3f7813e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:21.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.405+0000 7f3f7f800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f7815a600 0x7f3f7813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:21.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.405+0000 7f3f7f800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3f780cf240 con 0x7f3f781e83a0 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.405+0000 7f3f7f800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78142a50 con 0x7f3f7815a600 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.405+0000 7f3f7f800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3f780cf3c0 con 0x7f3f5c003a00 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f781e83a0 0x7f3f7813e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f781e83a0 0x7f3f7813e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54176/0 (socket says 172.21.15.118:54176) 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 -- 172.21.15.118:0/3382799880 learned_addr learned my addr 172.21.15.118:0/3382799880 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f7d800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f7815a600 0x7f3f7813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f7ce00640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f5c003a00 0x7f3f781e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 -- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f5c003a00 msgr2=0x7f3f781e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:21.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f5c003a00 0x7f3f781e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:21.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 -- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f7815a600 msgr2=0x7f3f7813eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:21.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f7815a600 0x7f3f7813eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:21.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 -- 172.21.15.118:0/3382799880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f780cd530 con 0x7f3f781e83a0 2024-09-21T06:05:21.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f7d800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f7815a600 0x7f3f7813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:21.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.406+0000 7f3f6fe00640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f781e83a0 0x7f3f7813e620 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f600119e0 tx=0x7f3f60011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:21.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.407+0000 7f3f75600640 1 -- 172.21.15.118:0/3382799880 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000fd20 con 0x7f3f781e83a0 2024-09-21T06:05:21.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.407+0000 7f3f75600640 1 -- 172.21.15.118:0/3382799880 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f60004030 con 0x7f3f781e83a0 2024-09-21T06:05:21.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.407+0000 7f3f75600640 1 -- 172.21.15.118:0/3382799880 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60004480 con 0x7f3f781e83a0 2024-09-21T06:05:21.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.407+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f781e5f40 con 0x7f3f781e83a0 2024-09-21T06:05:21.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.407+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f781f9ab0 con 0x7f3f781e83a0 2024-09-21T06:05:21.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.408+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f780d0e80 con 0x7f3f781e83a0 2024-09-21T06:05:21.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.409+0000 7f3f75600640 1 -- 172.21.15.118:0/3382799880 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f600035f0 con 0x7f3f781e83a0 2024-09-21T06:05:21.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.410+0000 7f3f75600640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3f54078b90 0x7f3f5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:21.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.410+0000 7f3f75600640 1 -- 172.21.15.118:0/3382799880 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5227+0+0 (secure 0 0 0) 0x7f3f6009b9a0 con 0x7f3f781e83a0 2024-09-21T06:05:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.411+0000 7f3f7ce00640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3f54078b90 0x7f3f5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:21.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.411+0000 7f3f7ce00640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3f54078b90 0x7f3f5407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f68033000 tx=0x7f3f780ce230 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.415+0000 7f3f75600640 1 -- 172.21.15.118:0/3382799880 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3f60063f20 con 0x7f3f781e83a0 2024-09-21T06:05:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:21.602+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3f7815cc50 con 0x7f3f781e83a0 2024-09-21T06:05:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.142+0000 7f3f75600640 1 -- 172.21.15.118:0/3382799880 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) ==== 170+0+0 (secure 0 0 0) 0x7f3f60063820 con 0x7f3f781e83a0 2024-09-21T06:05:22.144 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:05:22.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.146+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3f54078b90 msgr2=0x7f3f5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.146+0000 7f3f7f800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3f54078b90 0x7f3f5407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f68033000 tx=0x7f3f780ce230 comp rx=0 tx=0).stop 2024-09-21T06:05:22.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.146+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f781e83a0 msgr2=0x7f3f7813e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.146+0000 7f3f7f800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f781e83a0 0x7f3f7813e620 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f600119e0 tx=0x7f3f60011ea0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.147+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 shutdown_connections 2024-09-21T06:05:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.147+0000 7f3f7f800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f7815a600 0x7f3f7813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.147+0000 7f3f7f800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f781e83a0 0x7f3f7813e620 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.147+0000 7f3f7f800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3f54078b90 0x7f3f5407b0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.147+0000 7f3f7f800640 1 --2- 172.21.15.118:0/3382799880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f5c003a00 0x7f3f781e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.147+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 >> 172.21.15.118:0/3382799880 conn(0x7f3f7806d110 msgr2=0x7f3f7815b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.149+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 shutdown_connections 2024-09-21T06:05:22.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.151+0000 7f3f7f800640 1 -- 172.21.15.118:0/3382799880 wait complete. 2024-09-21T06:05:22.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:05:22.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 -- 172.21.15.118:0/1640185028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480b60f0 msgr2=0x7f764815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 --2- 172.21.15.118:0/1640185028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480b60f0 0x7f764815d150 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7648072570 tx=0x7f763002a560 comp rx=0 tx=0).stop 2024-09-21T06:05:22.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 -- 172.21.15.118:0/1640185028 shutdown_connections 2024-09-21T06:05:22.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 --2- 172.21.15.118:0/1640185028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76480b60f0 0x7f764815d150 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 --2- 172.21.15.118:0/1640185028 >> v2:172.21.15.149:3300/0 conn(0x7f76481461d0 0x7f76480b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 -- 172.21.15.118:0/1640185028 >> 172.21.15.118:0/1640185028 conn(0x7f764806d6e0 msgr2=0x7f76480b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:22.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 -- 172.21.15.118:0/1640185028 shutdown_connections 2024-09-21T06:05:22.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.405+0000 7f7647200640 1 -- 172.21.15.118:0/1640185028 wait complete. 2024-09-21T06:05:22.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.407+0000 7f7647200640 1 Processor -- start 2024-09-21T06:05:22.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.408+0000 7f7647200640 1 -- start start 2024-09-21T06:05:22.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7647200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76480b60f0 0x7f764813fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7647200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76481461d0 0x7f76481e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7647200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f764815d690 0x7f7648143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7647200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7648160e50 con 0x7f764815d690 2024-09-21T06:05:22.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7647200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76481601d0 con 0x7f76480b60f0 2024-09-21T06:05:22.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7647200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7648160fd0 con 0x7f76481461d0 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7646800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f764815d690 0x7f7648143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7646800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f764815d690 0x7f7648143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54188/0 (socket says 172.21.15.118:54188) 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.409+0000 7f7646800640 1 -- 172.21.15.118:0/4215370997 learned_addr learned my addr 172.21.15.118:0/4215370997 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7645e00640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76480b60f0 0x7f764813fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f763d400640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76481461d0 0x7f76481e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7646800640 1 -- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76481461d0 msgr2=0x7f76481e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7646800640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76481461d0 0x7f76481e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7646800640 1 -- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76480b60f0 msgr2=0x7f764813fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7646800640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76480b60f0 0x7f764813fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7646800640 1 -- 172.21.15.118:0/4215370997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76481e6560 con 0x7f764815d690 2024-09-21T06:05:22.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7646800640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f764815d690 0x7f7648143850 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7640010b40 tx=0x7f7640010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:22.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f763ea00640 1 -- 172.21.15.118:0/4215370997 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764000aa30 con 0x7f764815d690 2024-09-21T06:05:22.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f763ea00640 1 -- 172.21.15.118:0/4215370997 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f764000acc0 con 0x7f764815d690 2024-09-21T06:05:22.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.410+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76481e6840 con 0x7f764815d690 2024-09-21T06:05:22.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.411+0000 7f763ea00640 1 -- 172.21.15.118:0/4215370997 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640003bd0 con 0x7f764815d690 2024-09-21T06:05:22.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.411+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76481e6e00 con 0x7f764815d690 2024-09-21T06:05:22.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.412+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7648142770 con 0x7f764815d690 2024-09-21T06:05:22.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.413+0000 7f763ea00640 1 -- 172.21.15.118:0/4215370997 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7640018400 con 0x7f764815d690 2024-09-21T06:05:22.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.414+0000 7f763ea00640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7624078bc0 0x7f762407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.414+0000 7f763ea00640 1 -- 172.21.15.118:0/4215370997 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5609+0+0 (secure 0 0 0) 0x7f764009ebc0 con 0x7f764815d690 2024-09-21T06:05:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.415+0000 7f7645e00640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7624078bc0 0x7f762407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.416+0000 7f7645e00640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7624078bc0 0x7f762407b0d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7638009b30 tx=0x7f7638005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:22.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.418+0000 7f763ea00640 1 -- 172.21.15.118:0/4215370997 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f76480b6500 con 0x7f764815d690 2024-09-21T06:05:22.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:22.641+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7648161430 con 0x7f764815d690 2024-09-21T06:05:23.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.173+0000 7f763ea00640 1 -- 172.21.15.118:0/4215370997 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7f7640066a00 con 0x7f764815d690 2024-09-21T06:05:23.175 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 6 and data pool 7 2024-09-21T06:05:23.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.180+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7624078bc0 msgr2=0x7f762407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.180+0000 7f7647200640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7624078bc0 0x7f762407b0d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7638009b30 tx=0x7f7638005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:23.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.180+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f764815d690 msgr2=0x7f7648143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.180+0000 7f7647200640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f764815d690 0x7f7648143850 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7640010b40 tx=0x7f7640010f40 comp rx=0 tx=0).stop 2024-09-21T06:05:23.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.181+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 shutdown_connections 2024-09-21T06:05:23.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.181+0000 7f7647200640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f764815d690 0x7f7648143850 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.181+0000 7f7647200640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7624078bc0 0x7f762407b0d0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7638009b30 tx=0x7f7638005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:23.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.181+0000 7f7647200640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76481461d0 0x7f76481e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.181+0000 7f7647200640 1 --2- 172.21.15.118:0/4215370997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76480b60f0 0x7f764813fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.181+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 >> 172.21.15.118:0/4215370997 conn(0x7f764806d6e0 msgr2=0x7f7648144070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:23.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.183+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 shutdown_connections 2024-09-21T06:05:23.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.183+0000 7f7647200640 1 -- 172.21.15.118:0/4215370997 wait complete. 2024-09-21T06:05:23.216 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:05:23.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 -- 172.21.15.118:0/1580720132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49400cfe30 msgr2=0x7f49400d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 --2- 172.21.15.118:0/1580720132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49400cfe30 0x7f49400d0240 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f492c005fd0 tx=0x7f492c02a540 comp rx=0 tx=0).stop 2024-09-21T06:05:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 -- 172.21.15.118:0/1580720132 shutdown_connections 2024-09-21T06:05:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 --2- 172.21.15.118:0/1580720132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49400cfe30 0x7f49400d0240 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 --2- 172.21.15.118:0/1580720132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4940073fa0 0x7f49400749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 -- 172.21.15.118:0/1580720132 >> 172.21.15.118:0/1580720132 conn(0x7f494006d6e0 msgr2=0x7f49400b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 -- 172.21.15.118:0/1580720132 shutdown_connections 2024-09-21T06:05:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.436+0000 7f4946c00640 1 -- 172.21.15.118:0/1580720132 wait complete. 2024-09-21T06:05:23.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.438+0000 7f4946c00640 1 Processor -- start 2024-09-21T06:05:23.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.438+0000 7f4946c00640 1 -- start start 2024-09-21T06:05:23.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4946c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4940073fa0 0x7f494015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4946c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49400b5bb0 0x7f49400ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4946c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49400cfe30 0x7f494013c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4946c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f494015d9c0 con 0x7f4940073fa0 2024-09-21T06:05:23.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4946c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f494015d840 con 0x7f49400cfe30 2024-09-21T06:05:23.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4946c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f494015db40 con 0x7f49400b5bb0 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4945800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4940073fa0 0x7f494015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4945800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4940073fa0 0x7f494015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54216/0 (socket says 172.21.15.118:54216) 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4945800640 1 -- 172.21.15.118:0/132201122 learned_addr learned my addr 172.21.15.118:0/132201122 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4944e00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49400b5bb0 0x7f49400ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.440+0000 7f4946200640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49400cfe30 0x7f494013c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4945800640 1 -- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49400b5bb0 msgr2=0x7f49400ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4945800640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49400b5bb0 0x7f49400ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4945800640 1 -- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49400cfe30 msgr2=0x7f494013c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4945800640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49400cfe30 0x7f494013c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4945800640 1 -- 172.21.15.118:0/132201122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49400abaf0 con 0x7f4940073fa0 2024-09-21T06:05:23.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4944e00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49400b5bb0 0x7f49400ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:23.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4945800640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4940073fa0 0x7f494015a1f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f493400d700 tx=0x7f493400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:23.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f493d600640 1 -- 172.21.15.118:0/132201122 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934017070 con 0x7f4940073fa0 2024-09-21T06:05:23.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f493d600640 1 -- 172.21.15.118:0/132201122 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4934005310 con 0x7f4940073fa0 2024-09-21T06:05:23.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f493d600640 1 -- 172.21.15.118:0/132201122 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934009820 con 0x7f4940073fa0 2024-09-21T06:05:23.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494013c5b0 con 0x7f4940073fa0 2024-09-21T06:05:23.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.441+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4940159430 con 0x7f4940073fa0 2024-09-21T06:05:23.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.442+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494015f170 con 0x7f4940073fa0 2024-09-21T06:05:23.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.443+0000 7f493d600640 1 -- 172.21.15.118:0/132201122 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49340099c0 con 0x7f4940073fa0 2024-09-21T06:05:23.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.445+0000 7f493d600640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4920078b90 0x7f492007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.445+0000 7f493d600640 1 -- 172.21.15.118:0/132201122 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f493409ae40 con 0x7f4940073fa0 2024-09-21T06:05:23.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.445+0000 7f4944e00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4920078b90 0x7f492007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.446+0000 7f4944e00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4920078b90 0x7f492007b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f492c033000 tx=0x7f492c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:23.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.450+0000 7f493d600640 1 -- 172.21.15.118:0/132201122 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4934062c10 con 0x7f4940073fa0 2024-09-21T06:05:23.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.635+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49400ce8b0 con 0x7f4940073fa0 2024-09-21T06:05:23.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.637+0000 7f493d600640 1 -- 172.21.15.118:0/132201122 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16758 (secure 0 0 0) 0x7f4934067640 con 0x7f4940073fa0 2024-09-21T06:05:23.638 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:23.638 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:22.642068+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:05:20.575073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T06:05:21.613973+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4920078b90 msgr2=0x7f492007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4920078b90 0x7f492007b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f492c033000 tx=0x7f492c004730 comp rx=0 tx=0).stop 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4940073fa0 msgr2=0x7f494015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4940073fa0 0x7f494015a1f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f493400d700 tx=0x7f493400dbc0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 shutdown_connections 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49400cfe30 0x7f494013c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4920078b90 0x7f492007b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49400b5bb0 0x7f49400ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 --2- 172.21.15.118:0/132201122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4940073fa0 0x7f494015a1f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 >> 172.21.15.118:0/132201122 conn(0x7f494006d6e0 msgr2=0x7f49400cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 shutdown_connections 2024-09-21T06:05:23.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.639+0000 7f4946c00640 1 -- 172.21.15.118:0/132201122 wait complete. 2024-09-21T06:05:23.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:05:23.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.884+0000 7fe7c5c00640 1 -- 172.21.15.118:0/910229183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 msgr2=0x7fe7c00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.884+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/910229183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 0x7fe7c00d0240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009830 tx=0x7fe7ac02a530 comp rx=0 tx=0).stop 2024-09-21T06:05:23.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.884+0000 7fe7c5c00640 1 -- 172.21.15.118:0/910229183 shutdown_connections 2024-09-21T06:05:23.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.884+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/910229183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 0x7fe7c00d0240 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.884+0000 7fe7c5c00640 1 -- 172.21.15.118:0/910229183 >> 172.21.15.118:0/910229183 conn(0x7fe7c006d6e0 msgr2=0x7fe7c00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:23.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.885+0000 7fe7c5c00640 1 -- 172.21.15.118:0/910229183 shutdown_connections 2024-09-21T06:05:23.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.885+0000 7fe7c5c00640 1 -- 172.21.15.118:0/910229183 wait complete. 2024-09-21T06:05:23.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.887+0000 7fe7c5c00640 1 Processor -- start 2024-09-21T06:05:23.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.887+0000 7fe7c5c00640 1 -- start start 2024-09-21T06:05:23.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.888+0000 7fe7c5c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7c0073fa0 0x7fe7c01396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.888+0000 7fe7c5c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7c00b5bb0 0x7fe7c01f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.888+0000 7fe7c5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 0x7fe7c01f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.888+0000 7fe7c5c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c015db10 con 0x7fe7c0073fa0 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.888+0000 7fe7c5c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c015d990 con 0x7fe7c00cfe30 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.888+0000 7fe7c5c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c015dc90 con 0x7fe7c00b5bb0 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7c0073fa0 0x7fe7c01396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7c0073fa0 0x7fe7c01396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54226/0 (socket says 172.21.15.118:54226) 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 -- 172.21.15.118:0/3298499757 learned_addr learned my addr 172.21.15.118:0/3298499757 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bf400640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7c00b5bb0 0x7fe7c01f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7c5200640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 0x7fe7c01f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 -- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7c00b5bb0 msgr2=0x7fe7c01f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7c00b5bb0 0x7fe7c01f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 -- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 msgr2=0x7fe7c01f93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 0x7fe7c01f93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7bfe00640 1 -- 172.21.15.118:0/3298499757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c00b3a40 con 0x7fe7c0073fa0 2024-09-21T06:05:23.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.889+0000 7fe7c5200640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 0x7fe7c01f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.890+0000 7fe7bfe00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7c0073fa0 0x7fe7c01396a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000cbe0 tx=0x7fe7b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.890+0000 7fe7b7e00640 1 -- 172.21.15.118:0/3298499757 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0016020 con 0x7fe7c0073fa0 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.890+0000 7fe7b7e00640 1 -- 172.21.15.118:0/3298499757 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7b000ad90 con 0x7fe7c0073fa0 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.890+0000 7fe7b7e00640 1 -- 172.21.15.118:0/3298499757 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0012680 con 0x7fe7c0073fa0 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.890+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c0139be0 con 0x7fe7c0073fa0 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.890+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c00b3ce0 con 0x7fe7c0073fa0 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.891+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c015e140 con 0x7fe7c0073fa0 2024-09-21T06:05:23.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.892+0000 7fe7b7e00640 1 -- 172.21.15.118:0/3298499757 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7b0019020 con 0x7fe7c0073fa0 2024-09-21T06:05:23.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.893+0000 7fe7b7e00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7a0078bc0 0x7fe7a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:23.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.893+0000 7fe7b7e00640 1 -- 172.21.15.118:0/3298499757 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fe7b009b100 con 0x7fe7c0073fa0 2024-09-21T06:05:23.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.894+0000 7fe7bf400640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7a0078bc0 0x7fe7a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:23.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.894+0000 7fe7bf400640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7a0078bc0 0x7fe7a007b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac034000 tx=0x7fe7ac004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:23.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:23.898+0000 7fe7b7e00640 1 -- 172.21.15.118:0/3298499757 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe7b0020030 con 0x7fe7c0073fa0 2024-09-21T06:05:24.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.083+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7c0074a90 con 0x7fe7c0073fa0 2024-09-21T06:05:24.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.085+0000 7fe7b7e00640 1 -- 172.21.15.118:0/3298499757 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16758 (secure 0 0 0) 0x7fe7b00634a0 con 0x7fe7c0073fa0 2024-09-21T06:05:24.086 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:24.086 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:22.642068+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:05:20.575073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T06:05:21.613973+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7a0078bc0 msgr2=0x7fe7a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7a0078bc0 0x7fe7a007b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac034000 tx=0x7fe7ac004730 comp rx=0 tx=0).stop 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7c0073fa0 msgr2=0x7fe7c01396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7c0073fa0 0x7fe7c01396a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000cbe0 tx=0x7fe7b000a060 comp rx=0 tx=0).stop 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 shutdown_connections 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7c00cfe30 0x7fe7c01f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7a0078bc0 0x7fe7a007b0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7c00b5bb0 0x7fe7c01f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 --2- 172.21.15.118:0/3298499757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7c0073fa0 0x7fe7c01396a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 >> 172.21.15.118:0/3298499757 conn(0x7fe7c006d6e0 msgr2=0x7fe7c015c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 shutdown_connections 2024-09-21T06:05:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.087+0000 7fe7c5c00640 1 -- 172.21.15.118:0/3298499757 wait complete. 2024-09-21T06:05:24.115 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:05:24.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.339+0000 7f037c600640 1 -- 172.21.15.118:0/970532820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0374142dd0 msgr2=0x7f0374167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:24.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.339+0000 7f037c600640 1 --2- 172.21.15.118:0/970532820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0374142dd0 0x7f0374167b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f036c005fd0 tx=0x7f036c02a940 comp rx=0 tx=0).stop 2024-09-21T06:05:24.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.339+0000 7f037c600640 1 -- 172.21.15.118:0/970532820 shutdown_connections 2024-09-21T06:05:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.339+0000 7f037c600640 1 --2- 172.21.15.118:0/970532820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0374142dd0 0x7f0374167b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.339+0000 7f037c600640 1 -- 172.21.15.118:0/970532820 >> 172.21.15.118:0/970532820 conn(0x7f037406d110 msgr2=0x7f037406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.339+0000 7f037c600640 1 -- 172.21.15.118:0/970532820 shutdown_connections 2024-09-21T06:05:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.339+0000 7f037c600640 1 -- 172.21.15.118:0/970532820 wait complete. 2024-09-21T06:05:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.342+0000 7f037c600640 1 Processor -- start 2024-09-21T06:05:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.342+0000 7f037c600640 1 -- start start 2024-09-21T06:05:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f037413fe10 0x7f0374154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0374142dd0 0x7f0374150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037c600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03740b22c0 0x7f037413a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037c600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03741682e0 con 0x7f03740b22c0 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03740d03f0 con 0x7f0374142dd0 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0374168460 con 0x7f037413fe10 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03740b22c0 0x7f037413a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03740b22c0 0x7f037413a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54248/0 (socket says 172.21.15.118:54248) 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.343+0000 7f037a600640 1 -- 172.21.15.118:0/284839392 learned_addr learned my addr 172.21.15.118:0/284839392 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f0379200640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0374142dd0 0x7f0374150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f0379c00640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f037413fe10 0x7f0374154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f037a600640 1 -- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f037413fe10 msgr2=0x7f0374154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f037a600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f037413fe10 0x7f0374154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f037a600640 1 -- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0374142dd0 msgr2=0x7f0374150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f037a600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0374142dd0 0x7f0374150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f037a600640 1 -- 172.21.15.118:0/284839392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03740b1500 con 0x7f03740b22c0 2024-09-21T06:05:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f037a600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03740b22c0 0x7f037413a290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.344+0000 7f0371600640 1 -- 172.21.15.118:0/284839392 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c03e070 con 0x7f03740b22c0 2024-09-21T06:05:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.345+0000 7f0371600640 1 -- 172.21.15.118:0/284839392 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f036c004540 con 0x7f03740b22c0 2024-09-21T06:05:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.345+0000 7f0371600640 1 -- 172.21.15.118:0/284839392 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c043460 con 0x7f03740b22c0 2024-09-21T06:05:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.345+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03740b17e0 con 0x7f03740b22c0 2024-09-21T06:05:24.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.345+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037413ae80 con 0x7f03740b22c0 2024-09-21T06:05:24.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.346+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037413b0e0 con 0x7f03740b22c0 2024-09-21T06:05:24.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.347+0000 7f0371600640 1 -- 172.21.15.118:0/284839392 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f036c043600 con 0x7f03740b22c0 2024-09-21T06:05:24.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.348+0000 7f0371600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0354078b90 0x7f035407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:24.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.348+0000 7f0371600640 1 -- 172.21.15.118:0/284839392 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f036c0bc8a0 con 0x7f03740b22c0 2024-09-21T06:05:24.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.348+0000 7f0379c00640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0354078b90 0x7f035407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:24.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.349+0000 7f0379c00640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0354078b90 0x7f035407b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0368000f60 tx=0x7f0368009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:24.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.352+0000 7f0371600640 1 -- 172.21.15.118:0/284839392 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f036c084680 con 0x7f03740b22c0 2024-09-21T06:05:24.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:24.582+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f037415eaf0 con 0x7f03740b22c0 2024-09-21T06:05:25.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.192+0000 7f0371600640 1 -- 172.21.15.118:0/284839392 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f036c0890b0 con 0x7f03740b22c0 2024-09-21T06:05:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0354078b90 msgr2=0x7f035407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0354078b90 0x7f035407b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0368000f60 tx=0x7f0368009040 comp rx=0 tx=0).stop 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03740b22c0 msgr2=0x7f037413a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03740b22c0 0x7f037413a290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c031e20 comp rx=0 tx=0).stop 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 shutdown_connections 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03740b22c0 0x7f037413a290 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0374142dd0 0x7f0374150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0354078b90 0x7f035407b0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 --2- 172.21.15.118:0/284839392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f037413fe10 0x7f0374154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 >> 172.21.15.118:0/284839392 conn(0x7f037406d110 msgr2=0x7f03740b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 shutdown_connections 2024-09-21T06:05:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.195+0000 7f037c600640 1 -- 172.21.15.118:0/284839392 wait complete. 2024-09-21T06:05:25.220 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:05:25.220 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 -- 172.21.15.118:0/896149295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 msgr2=0x7f0b1415efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/896149295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b1415efb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0b14072890 tx=0x7f0b0c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 -- 172.21.15.118:0/896149295 shutdown_connections 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/896149295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b1415efb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/896149295 >> v2:172.21.15.149:3300/0 conn(0x7f0b140b62c0 0x7f0b1415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 -- 172.21.15.118:0/896149295 >> 172.21.15.118:0/896149295 conn(0x7f0b1406d6e0 msgr2=0x7f0b140b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 -- 172.21.15.118:0/896149295 shutdown_connections 2024-09-21T06:05:25.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.442+0000 7f0b1aa00640 1 -- 172.21.15.118:0/896149295 wait complete. 2024-09-21T06:05:25.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.444+0000 7f0b1aa00640 1 Processor -- start 2024-09-21T06:05:25.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.445+0000 7f0b1aa00640 1 -- start start 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b1aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b141461d0 0x7f0b1413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b1aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b140ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b1aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b14144190 0x7f0b140cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b1aa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1415fa20 con 0x7f0b1415d690 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b1aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1415f8a0 con 0x7f0b141461d0 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b1aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1415fba0 con 0x7f0b14144190 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b18c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b140ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b18c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b140ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54258/0 (socket says 172.21.15.118:54258) 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b18c00640 1 -- 172.21.15.118:0/2635550115 learned_addr learned my addr 172.21.15.118:0/2635550115 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b19600640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b141461d0 0x7f0b1413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.446+0000 7f0b1a000640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b14144190 0x7f0b140cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b18c00640 1 -- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b14144190 msgr2=0x7f0b140cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b18c00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b14144190 0x7f0b140cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b18c00640 1 -- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b141461d0 msgr2=0x7f0b1413c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b18c00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b141461d0 0x7f0b1413c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b18c00640 1 -- 172.21.15.118:0/2635550115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140cacc0 con 0x7f0b1415d690 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b18c00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b140ca3e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000d740 tx=0x7f0b0000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b11600640 1 -- 172.21.15.118:0/2635550115 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00017070 con 0x7f0b1415d690 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b11600640 1 -- 172.21.15.118:0/2635550115 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b00009d20 con 0x7f0b1415d690 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b11600640 1 -- 172.21.15.118:0/2635550115 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000106c0 con 0x7f0b1415d690 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b140cafa0 con 0x7f0b1415d690 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.447+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b140cb560 con 0x7f0b1415d690 2024-09-21T06:05:25.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.448+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b14160050 con 0x7f0b1415d690 2024-09-21T06:05:25.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.450+0000 7f0b11600640 1 -- 172.21.15.118:0/2635550115 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b0001a070 con 0x7f0b1415d690 2024-09-21T06:05:25.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.450+0000 7f0b11600640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0af4078bc0 0x7f0af407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.451+0000 7f0b11600640 1 -- 172.21.15.118:0/2635550115 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f0b0009ae20 con 0x7f0b1415d690 2024-09-21T06:05:25.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.451+0000 7f0b19600640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0af4078bc0 0x7f0af407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.452+0000 7f0b19600640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0af4078bc0 0x7f0af407b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b08000f60 tx=0x7f0b08009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:25.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.455+0000 7f0b11600640 1 -- 172.21.15.118:0/2635550115 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b00062b70 con 0x7f0b1415d690 2024-09-21T06:05:25.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:25.675+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0b140ceeb0 con 0x7f0b1415d690 2024-09-21T06:05:26.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.198+0000 7f0b11600640 1 -- 172.21.15.118:0/2635550115 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f0b000675a0 con 0x7f0b1415d690 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0af4078bc0 msgr2=0x7f0af407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0af4078bc0 0x7f0af407b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b08000f60 tx=0x7f0b08009040 comp rx=0 tx=0).stop 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 msgr2=0x7f0b140ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b140ca3e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000d740 tx=0x7f0b0000dc00 comp rx=0 tx=0).stop 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 shutdown_connections 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0af4078bc0 0x7f0af407b0d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b14144190 0x7f0b140cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b1415d690 0x7f0b140ca3e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 --2- 172.21.15.118:0/2635550115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b141461d0 0x7f0b1413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 >> 172.21.15.118:0/2635550115 conn(0x7f0b1406d6e0 msgr2=0x7f0b14076040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:26.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 shutdown_connections 2024-09-21T06:05:26.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.201+0000 7f0b1aa00640 1 -- 172.21.15.118:0/2635550115 wait complete. 2024-09-21T06:05:26.226 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:05:26.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:26.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 -- 172.21.15.118:0/3433778947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013fef0 msgr2=0x7f92f0142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 --2- 172.21.15.118:0/3433778947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013fef0 0x7f92f0142c70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f92e8005fd0 tx=0x7f92e802aa10 comp rx=0 tx=0).stop 2024-09-21T06:05:26.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 -- 172.21.15.118:0/3433778947 shutdown_connections 2024-09-21T06:05:26.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 --2- 172.21.15.118:0/3433778947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013fef0 0x7f92f0142c70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 --2- 172.21.15.118:0/3433778947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92f00d1590 0x7f92f0142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 -- 172.21.15.118:0/3433778947 >> 172.21.15.118:0/3433778947 conn(0x7f92f006d110 msgr2=0x7f92f006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:26.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 -- 172.21.15.118:0/3433778947 shutdown_connections 2024-09-21T06:05:26.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.446+0000 7f92f7600640 1 -- 172.21.15.118:0/3433778947 wait complete. 2024-09-21T06:05:26.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.449+0000 7f92f7600640 1 Processor -- start 2024-09-21T06:05:26.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.449+0000 7f92f7600640 1 -- start start 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.450+0000 7f92f7600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92f013fae0 0x7f92f013e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.450+0000 7f92f7600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92f013fef0 0x7f92f0147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.450+0000 7f92f7600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013ebe0 0x7f92f0147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.450+0000 7f92f7600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00cfb10 con 0x7f92f013ebe0 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.450+0000 7f92f7600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00cf990 con 0x7f92f013fae0 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.450+0000 7f92f7600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92f00cfc90 con 0x7f92f013fef0 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.450+0000 7f92f5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013ebe0 0x7f92f0147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013ebe0 0x7f92f0147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56110/0 (socket says 172.21.15.118:56110) 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 -- 172.21.15.118:0/1228437186 learned_addr learned my addr 172.21.15.118:0/1228437186 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92e7e00640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92f013fef0 0x7f92f0147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f4c00640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92f013fae0 0x7f92f013e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 -- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92f013fef0 msgr2=0x7f92f0147640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92f013fef0 0x7f92f0147640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 -- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92f013fae0 msgr2=0x7f92f013e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92f013fae0 0x7f92f013e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 -- 172.21.15.118:0/1228437186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f01536b0 con 0x7f92f013ebe0 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f4c00640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92f013fae0 0x7f92f013e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.451+0000 7f92f5600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013ebe0 0x7f92f0147b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f92e802b000 tx=0x7f92e8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.452+0000 7f92ed600640 1 -- 172.21.15.118:0/1228437186 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8033050 con 0x7f92f013ebe0 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.452+0000 7f92ed600640 1 -- 172.21.15.118:0/1228437186 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e80044d0 con 0x7f92f013ebe0 2024-09-21T06:05:26.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.452+0000 7f92ed600640 1 -- 172.21.15.118:0/1228437186 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8038450 con 0x7f92f013ebe0 2024-09-21T06:05:26.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.452+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f0073c80 con 0x7f92f013ebe0 2024-09-21T06:05:26.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.452+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f0074240 con 0x7f92f013ebe0 2024-09-21T06:05:26.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.453+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f00d0140 con 0x7f92f013ebe0 2024-09-21T06:05:26.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.454+0000 7f92ed600640 1 -- 172.21.15.118:0/1228437186 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92e8036070 con 0x7f92f013ebe0 2024-09-21T06:05:26.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.455+0000 7f92ed600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92cc078b90 0x7f92cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.455+0000 7f92ed600640 1 -- 172.21.15.118:0/1228437186 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f92e80bc310 con 0x7f92f013ebe0 2024-09-21T06:05:26.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.456+0000 7f92f4c00640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92cc078b90 0x7f92cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.456+0000 7f92f4c00640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92cc078b90 0x7f92cc07b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f92e0000f60 tx=0x7f92e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:26.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.460+0000 7f92ed600640 1 -- 172.21.15.118:0/1228437186 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92e80846d0 con 0x7f92f013ebe0 2024-09-21T06:05:26.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.684+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f01542a0 con 0x7f92f013ebe0 2024-09-21T06:05:26.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.684+0000 7f92ed600640 1 -- 172.21.15.118:0/1228437186 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f92e8083fd0 con 0x7f92f013ebe0 2024-09-21T06:05:26.686 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:26.686 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:05:26.686 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:05:26.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92cc078b90 msgr2=0x7f92cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92cc078b90 0x7f92cc07b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f92e0000f60 tx=0x7f92e0009040 comp rx=0 tx=0).stop 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013ebe0 msgr2=0x7f92f0147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013ebe0 0x7f92f0147b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f92e802b000 tx=0x7f92e8003f90 comp rx=0 tx=0).stop 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 shutdown_connections 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f013ebe0 0x7f92f0147b80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92cc078b90 0x7f92cc07b0a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92f013fef0 0x7f92f0147640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 --2- 172.21.15.118:0/1228437186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92f013fae0 0x7f92f013e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 >> 172.21.15.118:0/1228437186 conn(0x7f92f006d110 msgr2=0x7f92f015e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 shutdown_connections 2024-09-21T06:05:26.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.687+0000 7f92f7600640 1 -- 172.21.15.118:0/1228437186 wait complete. 2024-09-21T06:05:26.711 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:05:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 -- 172.21.15.118:0/907738872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f415cfd0 msgr2=0x7fa3f40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 --2- 172.21.15.118:0/907738872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f415cfd0 0x7fa3f40b3a60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40cd9d0 tx=0x7fa3e402aa30 comp rx=0 tx=0).stop 2024-09-21T06:05:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 -- 172.21.15.118:0/907738872 shutdown_connections 2024-09-21T06:05:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 --2- 172.21.15.118:0/907738872 >> v2:172.21.15.149:3300/0 conn(0x7fa3f40b5040 0x7fa3f40cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 --2- 172.21.15.118:0/907738872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f415cfd0 0x7fa3f40b3a60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 -- 172.21.15.118:0/907738872 >> 172.21.15.118:0/907738872 conn(0x7fa3f406d110 msgr2=0x7fa3f406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 -- 172.21.15.118:0/907738872 shutdown_connections 2024-09-21T06:05:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.929+0000 7fa3f9800640 1 -- 172.21.15.118:0/907738872 wait complete. 2024-09-21T06:05:26.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.932+0000 7fa3f9800640 1 Processor -- start 2024-09-21T06:05:26.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.932+0000 7fa3f9800640 1 -- start start 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3f9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f40b5040 0x7fa3f40c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3f9800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f40b5450 0x7fa3f40cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3f9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f415cfd0 0x7fa3f4155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3f9800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4073c60 con 0x7fa3f40b5450 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3f9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4073ae0 con 0x7fa3f415cfd0 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3f9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f4073de0 con 0x7fa3f40b5040 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3ea000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f40b5450 0x7fa3f40cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3ea000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f40b5450 0x7fa3f40cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56128/0 (socket says 172.21.15.118:56128) 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.933+0000 7fa3ea000640 1 -- 172.21.15.118:0/3392380056 learned_addr learned my addr 172.21.15.118:0/3392380056 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3f3400640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f415cfd0 0x7fa3f4155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3f2a00640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f40b5040 0x7fa3f40c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3ea000640 1 -- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f40b5040 msgr2=0x7fa3f40c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3ea000640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f40b5040 0x7fa3f40c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3ea000640 1 -- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f415cfd0 msgr2=0x7fa3f4155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3ea000640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f415cfd0 0x7fa3f4155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3ea000640 1 -- 172.21.15.118:0/3392380056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f41e6b60 con 0x7fa3f40b5450 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3ea000640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f40b5450 0x7fa3f40cfa80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d740 tx=0x7fa3dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3eb400640 1 -- 172.21.15.118:0/3392380056 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc017070 con 0x7fa3f40b5450 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3eb400640 1 -- 172.21.15.118:0/3392380056 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3dc009d20 con 0x7fa3f40b5450 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3eb400640 1 -- 172.21.15.118:0/3392380056 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0106c0 con 0x7fa3f40b5450 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.934+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f41e6e40 con 0x7fa3f40b5450 2024-09-21T06:05:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.935+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f41e7400 con 0x7fa3f40b5450 2024-09-21T06:05:26.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.936+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f41e7840 con 0x7fa3f40b5450 2024-09-21T06:05:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.937+0000 7fa3eb400640 1 -- 172.21.15.118:0/3392380056 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3dc01a070 con 0x7fa3f40b5450 2024-09-21T06:05:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.938+0000 7fa3eb400640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa3d0078b90 0x7fa3d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.938+0000 7fa3eb400640 1 -- 172.21.15.118:0/3392380056 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fa3dc09af20 con 0x7fa3f40b5450 2024-09-21T06:05:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.938+0000 7fa3f2a00640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa3d0078b90 0x7fa3d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:26.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.939+0000 7fa3f2a00640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa3d0078b90 0x7fa3d007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4035000 tx=0x7fa3e4004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:26.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:26.942+0000 7fa3eb400640 1 -- 172.21.15.118:0/3392380056 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa3dc063350 con 0x7fa3f40b5450 2024-09-21T06:05:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.127+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3f40b3a60 con 0x7fa3f40b5450 2024-09-21T06:05:27.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.128+0000 7fa3eb400640 1 -- 172.21.15.118:0/3392380056 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16745 (secure 0 0 0) 0x7fa3dc062c50 con 0x7fa3f40b5450 2024-09-21T06:05:27.130 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:27.130 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":44,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:24.159394+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:05:20.575073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T06:05:21.613973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa3d0078b90 msgr2=0x7fa3d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa3d0078b90 0x7fa3d007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4035000 tx=0x7fa3e4004ab0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f40b5450 msgr2=0x7fa3f40cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f40b5450 0x7fa3f40cfa80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d740 tx=0x7fa3dc00dc00 comp rx=0 tx=0).stop 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 shutdown_connections 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f415cfd0 0x7fa3f4155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3f40b5450 0x7fa3f40cfa80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa3d0078b90 0x7fa3d007b0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 --2- 172.21.15.118:0/3392380056 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f40b5040 0x7fa3f40c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 >> 172.21.15.118:0/3392380056 conn(0x7fa3f406d110 msgr2=0x7fa3f40ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.130+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 shutdown_connections 2024-09-21T06:05:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.131+0000 7fa3f9800640 1 -- 172.21.15.118:0/3392380056 wait complete. 2024-09-21T06:05:27.159 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:05:27.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 -- 172.21.15.118:0/3754837693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 msgr2=0x7f9db00cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 --2- 172.21.15.118:0/3754837693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db00cca40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9db00b3800 tx=0x7f9d9802a560 comp rx=0 tx=0).stop 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 -- 172.21.15.118:0/3754837693 shutdown_connections 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 --2- 172.21.15.118:0/3754837693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db00cca40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 --2- 172.21.15.118:0/3754837693 >> v2:172.21.15.149:3300/0 conn(0x7f9db015cfd0 0x7f9db00b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 -- 172.21.15.118:0/3754837693 >> 172.21.15.118:0/3754837693 conn(0x7f9db006d110 msgr2=0x7f9db006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 -- 172.21.15.118:0/3754837693 shutdown_connections 2024-09-21T06:05:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.381+0000 7f9db7800640 1 -- 172.21.15.118:0/3754837693 wait complete. 2024-09-21T06:05:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.383+0000 7f9db7800640 1 Processor -- start 2024-09-21T06:05:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.383+0000 7f9db7800640 1 -- start start 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db7800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db01f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db7800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db00b5450 0x7f9db0139600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db7800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9db015cfd0 0x7f9db0139b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db7800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0073c60 con 0x7f9db00b5040 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db7800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0073ae0 con 0x7f9db00b5450 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db7800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9db0073de0 con 0x7f9db015cfd0 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db4e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db01f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db4e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db01f74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56150/0 (socket says 172.21.15.118:56150) 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db4e00640 1 -- 172.21.15.118:0/640185528 learned_addr learned my addr 172.21.15.118:0/640185528 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9da7e00640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db00b5450 0x7f9db0139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db5800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9db015cfd0 0x7f9db0139b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db4e00640 1 -- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9db015cfd0 msgr2=0x7f9db0139b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db4e00640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9db015cfd0 0x7f9db0139b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db4e00640 1 -- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db00b5450 msgr2=0x7f9db0139600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.385+0000 7f9db4e00640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db00b5450 0x7f9db0139600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9db4e00640 1 -- 172.21.15.118:0/640185528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db00c94f0 con 0x7f9db00b5040 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9db5800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9db015cfd0 0x7f9db0139b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9db4e00640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db01f74e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9da000d6d0 tx=0x7f9da000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9dad600640 1 -- 172.21.15.118:0/640185528 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0017070 con 0x7f9db00b5040 2024-09-21T06:05:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9dad600640 1 -- 172.21.15.118:0/640185528 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9da0005330 con 0x7f9db00b5040 2024-09-21T06:05:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9dad600640 1 -- 172.21.15.118:0/640185528 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0009820 con 0x7f9db00b5040 2024-09-21T06:05:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db01f81f0 con 0x7f9db00b5040 2024-09-21T06:05:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.386+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db01f7f10 con 0x7f9db00b5040 2024-09-21T06:05:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.387+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db00b3a60 con 0x7f9db00b5040 2024-09-21T06:05:27.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.389+0000 7f9dad600640 1 -- 172.21.15.118:0/640185528 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9da0009bd0 con 0x7f9db00b5040 2024-09-21T06:05:27.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.390+0000 7f9dad600640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d8c078bc0 0x7f9d8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.390+0000 7f9dad600640 1 -- 172.21.15.118:0/640185528 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f9da009afe0 con 0x7f9db00b5040 2024-09-21T06:05:27.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.390+0000 7f9da7e00640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d8c078bc0 0x7f9d8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.391+0000 7f9da7e00640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d8c078bc0 0x7f9d8c07b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d98033000 tx=0x7f9d98004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:27.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.394+0000 7f9dad600640 1 -- 172.21.15.118:0/640185528 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9da00634e0 con 0x7f9db00b5040 2024-09-21T06:05:27.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.578+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9db00c7dd0 con 0x7f9d8c078bc0 2024-09-21T06:05:27.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.583+0000 7f9dad600640 1 -- 172.21.15.118:0/640185528 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247475 (secure 0 0 0) 0x7f9db00c7dd0 con 0x7f9d8c078bc0 2024-09-21T06:05:27.587 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d8c078bc0 msgr2=0x7f9d8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d8c078bc0 0x7f9d8c07b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d98033000 tx=0x7f9d98004730 comp rx=0 tx=0).stop 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 msgr2=0x7f9db01f74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db01f74e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9da000d6d0 tx=0x7f9da000db90 comp rx=0 tx=0).stop 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 shutdown_connections 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d8c078bc0 0x7f9d8c07b0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9db015cfd0 0x7f9db0139b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9db00b5450 0x7f9db0139600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 --2- 172.21.15.118:0/640185528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9db00b5040 0x7f9db01f74e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.587+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 >> 172.21.15.118:0/640185528 conn(0x7f9db006d110 msgr2=0x7f9db006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:27.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.588+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 shutdown_connections 2024-09-21T06:05:27.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.588+0000 7f9db7800640 1 -- 172.21.15.118:0/640185528 wait complete. 2024-09-21T06:05:27.615 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-21T06:05:26.478127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559753,"statfs":{"total":1600000000,"available":1597187883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.334748"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176380+0000","last_change":"2024-09-21T06:05:23.176178+0000","last_active":"2024-09-21T06:05:23.176380+0000","last_peered":"2024-09-21T06:05:23.176380+0000","last_clean":"2024-09-21T06:05:23.176380+0000","last_became_active":"2024-09-21T06:05:23.173241+0000","last_became_peered":"2024-09-21T06:05:23.173241+0000","last_unstale":"2024-09-21T06:05:23.176380+0000","last_undegraded":"2024-09-21T06:05:23.176380+0000","last_fullsized":"2024-09-21T06:05:23.176380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:38.391837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176976+0000","last_change":"2024-09-21T06:05:23.176397+0000","last_active":"2024-09-21T06:05:23.176976+0000","last_peered":"2024-09-21T06:05:23.176976+0000","last_clean":"2024-09-21T06:05:23.176976+0000","last_became_active":"2024-09-21T06:05:23.175848+0000","last_became_peered":"2024-09-21T06:05:23.175848+0000","last_unstale":"2024-09-21T06:05:23.176976+0000","last_undegraded":"2024-09-21T06:05:23.176976+0000","last_fullsized":"2024-09-21T06:05:23.176976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:44.709693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184414+0000","last_change":"2024-09-21T06:05:23.184131+0000","last_active":"2024-09-21T06:05:23.184414+0000","last_peered":"2024-09-21T06:05:23.184414+0000","last_clean":"2024-09-21T06:05:23.184414+0000","last_became_active":"2024-09-21T06:05:23.183714+0000","last_became_peered":"2024-09-21T06:05:23.183714+0000","last_unstale":"2024-09-21T06:05:23.184414+0000","last_undegraded":"2024-09-21T06:05:23.184414+0000","last_fullsized":"2024-09-21T06:05:23.184414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:17.222268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394505+0000","last_change":"2024-09-21T06:05:23.181939+0000","last_active":"2024-09-21T06:05:24.394505+0000","last_peered":"2024-09-21T06:05:24.394505+0000","last_clean":"2024-09-21T06:05:24.394505+0000","last_became_active":"2024-09-21T06:05:23.178998+0000","last_became_peered":"2024-09-21T06:05:23.178998+0000","last_unstale":"2024-09-21T06:05:24.394505+0000","last_undegraded":"2024-09-21T06:05:24.394505+0000","last_fullsized":"2024-09-21T06:05:24.394505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:24.301022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.179423+0000","last_change":"2024-09-21T06:05:23.179205+0000","last_active":"2024-09-21T06:05:23.179423+0000","last_peered":"2024-09-21T06:05:23.179423+0000","last_clean":"2024-09-21T06:05:23.179423+0000","last_became_active":"2024-09-21T06:05:23.178926+0000","last_became_peered":"2024-09-21T06:05:23.178926+0000","last_unstale":"2024-09-21T06:05:23.179423+0000","last_undegraded":"2024-09-21T06:05:23.179423+0000","last_fullsized":"2024-09-21T06:05:23.179423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:54.462352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163008+0000","last_change":"2024-09-21T06:05:23.168940+0000","last_active":"2024-09-21T06:05:24.163008+0000","last_peered":"2024-09-21T06:05:24.163008+0000","last_clean":"2024-09-21T06:05:24.163008+0000","last_became_active":"2024-09-21T06:05:23.168668+0000","last_became_peered":"2024-09-21T06:05:23.168668+0000","last_unstale":"2024-09-21T06:05:24.163008+0000","last_undegraded":"2024-09-21T06:05:24.163008+0000","last_fullsized":"2024-09-21T06:05:24.163008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:11.257761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178923+0000","last_change":"2024-09-21T06:05:23.178633+0000","last_active":"2024-09-21T06:05:23.178923+0000","last_peered":"2024-09-21T06:05:23.178923+0000","last_clean":"2024-09-21T06:05:23.178923+0000","last_became_active":"2024-09-21T06:05:23.177726+0000","last_became_peered":"2024-09-21T06:05:23.177726+0000","last_unstale":"2024-09-21T06:05:23.178923+0000","last_undegraded":"2024-09-21T06:05:23.178923+0000","last_fullsized":"2024-09-21T06:05:23.178923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:39.745012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395419+0000","last_change":"2024-09-21T06:05:23.180727+0000","last_active":"2024-09-21T06:05:24.395419+0000","last_peered":"2024-09-21T06:05:24.395419+0000","last_clean":"2024-09-21T06:05:24.395419+0000","last_became_active":"2024-09-21T06:05:23.178419+0000","last_became_peered":"2024-09-21T06:05:23.178419+0000","last_unstale":"2024-09-21T06:05:24.395419+0000","last_undegraded":"2024-09-21T06:05:24.395419+0000","last_fullsized":"2024-09-21T06:05:24.395419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:38.050670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394744+0000","last_change":"2024-09-21T06:05:23.182997+0000","last_active":"2024-09-21T06:05:24.394744+0000","last_peered":"2024-09-21T06:05:24.394744+0000","last_clean":"2024-09-21T06:05:24.394744+0000","last_became_active":"2024-09-21T06:05:23.182703+0000","last_became_peered":"2024-09-21T06:05:23.182703+0000","last_unstale":"2024-09-21T06:05:24.394744+0000","last_undegraded":"2024-09-21T06:05:24.394744+0000","last_fullsized":"2024-09-21T06:05:24.394744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:29.090773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395797+0000","last_change":"2024-09-21T06:05:23.184072+0000","last_active":"2024-09-21T06:05:24.395797+0000","last_peered":"2024-09-21T06:05:24.395797+0000","last_clean":"2024-09-21T06:05:24.395797+0000","last_became_active":"2024-09-21T06:05:23.183080+0000","last_became_peered":"2024-09-21T06:05:23.183080+0000","last_unstale":"2024-09-21T06:05:24.395797+0000","last_undegraded":"2024-09-21T06:05:24.395797+0000","last_fullsized":"2024-09-21T06:05:24.395797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:30.128103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394732+0000","last_change":"2024-09-21T06:05:23.172240+0000","last_active":"2024-09-21T06:05:24.394732+0000","last_peered":"2024-09-21T06:05:24.394732+0000","last_clean":"2024-09-21T06:05:24.394732+0000","last_became_active":"2024-09-21T06:05:23.171936+0000","last_became_peered":"2024-09-21T06:05:23.171936+0000","last_unstale":"2024-09-21T06:05:24.394732+0000","last_undegraded":"2024-09-21T06:05:24.394732+0000","last_fullsized":"2024-09-21T06:05:24.394732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:55.273216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176954+0000","last_change":"2024-09-21T06:05:23.176118+0000","last_active":"2024-09-21T06:05:23.176954+0000","last_peered":"2024-09-21T06:05:23.176954+0000","last_clean":"2024-09-21T06:05:23.176954+0000","last_became_active":"2024-09-21T06:05:23.174907+0000","last_became_peered":"2024-09-21T06:05:23.174907+0000","last_unstale":"2024-09-21T06:05:23.176954+0000","last_undegraded":"2024-09-21T06:05:23.176954+0000","last_fullsized":"2024-09-21T06:05:23.176954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:10.641459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182175+0000","last_change":"2024-09-21T06:05:23.181609+0000","last_active":"2024-09-21T06:05:23.182175+0000","last_peered":"2024-09-21T06:05:23.182175+0000","last_clean":"2024-09-21T06:05:23.182175+0000","last_became_active":"2024-09-21T06:05:23.180893+0000","last_became_peered":"2024-09-21T06:05:23.180893+0000","last_unstale":"2024-09-21T06:05:23.182175+0000","last_undegraded":"2024-09-21T06:05:23.182175+0000","last_fullsized":"2024-09-21T06:05:23.182175+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:42.253609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395940+0000","last_change":"2024-09-21T06:05:23.182299+0000","last_active":"2024-09-21T06:05:24.395940+0000","last_peered":"2024-09-21T06:05:24.395940+0000","last_clean":"2024-09-21T06:05:24.395940+0000","last_became_active":"2024-09-21T06:05:23.179344+0000","last_became_peered":"2024-09-21T06:05:23.179344+0000","last_unstale":"2024-09-21T06:05:24.395940+0000","last_undegraded":"2024-09-21T06:05:24.395940+0000","last_fullsized":"2024-09-21T06:05:24.395940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:13.248281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163117+0000","last_change":"2024-09-21T06:05:23.177669+0000","last_active":"2024-09-21T06:05:24.163117+0000","last_peered":"2024-09-21T06:05:24.163117+0000","last_clean":"2024-09-21T06:05:24.163117+0000","last_became_active":"2024-09-21T06:05:23.177367+0000","last_became_peered":"2024-09-21T06:05:23.177367+0000","last_unstale":"2024-09-21T06:05:24.163117+0000","last_undegraded":"2024-09-21T06:05:24.163117+0000","last_fullsized":"2024-09-21T06:05:24.163117+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:45.364399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.185065+0000","last_change":"2024-09-21T06:05:23.184610+0000","last_active":"2024-09-21T06:05:23.185065+0000","last_peered":"2024-09-21T06:05:23.185065+0000","last_clean":"2024-09-21T06:05:23.185065+0000","last_became_active":"2024-09-21T06:05:23.183704+0000","last_became_peered":"2024-09-21T06:05:23.183704+0000","last_unstale":"2024-09-21T06:05:23.185065+0000","last_undegraded":"2024-09-21T06:05:23.185065+0000","last_fullsized":"2024-09-21T06:05:23.185065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:18.037047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182113+0000","last_change":"2024-09-21T06:05:23.180762+0000","last_active":"2024-09-21T06:05:23.182113+0000","last_peered":"2024-09-21T06:05:23.182113+0000","last_clean":"2024-09-21T06:05:23.182113+0000","last_became_active":"2024-09-21T06:05:23.180024+0000","last_became_peered":"2024-09-21T06:05:23.180024+0000","last_unstale":"2024-09-21T06:05:23.182113+0000","last_undegraded":"2024-09-21T06:05:23.182113+0000","last_fullsized":"2024-09-21T06:05:23.182113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:25.561332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182888+0000","last_change":"2024-09-21T06:05:23.182578+0000","last_active":"2024-09-21T06:05:23.182888+0000","last_peered":"2024-09-21T06:05:23.182888+0000","last_clean":"2024-09-21T06:05:23.182888+0000","last_became_active":"2024-09-21T06:05:23.182289+0000","last_became_peered":"2024-09-21T06:05:23.182289+0000","last_unstale":"2024-09-21T06:05:23.182888+0000","last_undegraded":"2024-09-21T06:05:23.182888+0000","last_fullsized":"2024-09-21T06:05:23.182888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:23.888662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183898+0000","last_change":"2024-09-21T06:05:23.183476+0000","last_active":"2024-09-21T06:05:23.183898+0000","last_peered":"2024-09-21T06:05:23.183898+0000","last_clean":"2024-09-21T06:05:23.183898+0000","last_became_active":"2024-09-21T06:05:23.181879+0000","last_became_peered":"2024-09-21T06:05:23.181879+0000","last_unstale":"2024-09-21T06:05:23.183898+0000","last_undegraded":"2024-09-21T06:05:23.183898+0000","last_fullsized":"2024-09-21T06:05:23.183898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:43.884289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182205+0000","last_change":"2024-09-21T06:05:23.181928+0000","last_active":"2024-09-21T06:05:23.182205+0000","last_peered":"2024-09-21T06:05:23.182205+0000","last_clean":"2024-09-21T06:05:23.182205+0000","last_became_active":"2024-09-21T06:05:23.181662+0000","last_became_peered":"2024-09-21T06:05:23.181662+0000","last_unstale":"2024-09-21T06:05:23.182205+0000","last_undegraded":"2024-09-21T06:05:23.182205+0000","last_fullsized":"2024-09-21T06:05:23.182205+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:43.706045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163513+0000","last_change":"2024-09-21T06:05:23.182064+0000","last_active":"2024-09-21T06:05:24.163513+0000","last_peered":"2024-09-21T06:05:24.163513+0000","last_clean":"2024-09-21T06:05:24.163513+0000","last_became_active":"2024-09-21T06:05:23.181687+0000","last_became_peered":"2024-09-21T06:05:23.181687+0000","last_unstale":"2024-09-21T06:05:24.163513+0000","last_undegraded":"2024-09-21T06:05:24.163513+0000","last_fullsized":"2024-09-21T06:05:24.163513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:20.840864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395318+0000","last_change":"2024-09-21T06:05:23.180956+0000","last_active":"2024-09-21T06:05:24.395318+0000","last_peered":"2024-09-21T06:05:24.395318+0000","last_clean":"2024-09-21T06:05:24.395318+0000","last_became_active":"2024-09-21T06:05:23.178132+0000","last_became_peered":"2024-09-21T06:05:23.178132+0000","last_unstale":"2024-09-21T06:05:24.395318+0000","last_undegraded":"2024-09-21T06:05:24.395318+0000","last_fullsized":"2024-09-21T06:05:24.395318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:21.668879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.175361+0000","last_change":"2024-09-21T06:05:23.174504+0000","last_active":"2024-09-21T06:05:23.175361+0000","last_peered":"2024-09-21T06:05:23.175361+0000","last_clean":"2024-09-21T06:05:23.175361+0000","last_became_active":"2024-09-21T06:05:23.172587+0000","last_became_peered":"2024-09-21T06:05:23.172587+0000","last_unstale":"2024-09-21T06:05:23.175361+0000","last_undegraded":"2024-09-21T06:05:23.175361+0000","last_fullsized":"2024-09-21T06:05:23.175361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:38.052825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.179095+0000","last_change":"2024-09-21T06:05:23.178892+0000","last_active":"2024-09-21T06:05:23.179095+0000","last_peered":"2024-09-21T06:05:23.179095+0000","last_clean":"2024-09-21T06:05:23.179095+0000","last_became_active":"2024-09-21T06:05:23.178628+0000","last_became_peered":"2024-09-21T06:05:23.178628+0000","last_unstale":"2024-09-21T06:05:23.179095+0000","last_undegraded":"2024-09-21T06:05:23.179095+0000","last_fullsized":"2024-09-21T06:05:23.179095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:30.929140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180886+0000","last_change":"2024-09-21T06:05:23.180568+0000","last_active":"2024-09-21T06:05:23.180886+0000","last_peered":"2024-09-21T06:05:23.180886+0000","last_clean":"2024-09-21T06:05:23.180886+0000","last_became_active":"2024-09-21T06:05:23.180293+0000","last_became_peered":"2024-09-21T06:05:23.180293+0000","last_unstale":"2024-09-21T06:05:23.180886+0000","last_undegraded":"2024-09-21T06:05:23.180886+0000","last_fullsized":"2024-09-21T06:05:23.180886+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:42.899880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184429+0000","last_change":"2024-09-21T06:05:23.182707+0000","last_active":"2024-09-21T06:05:23.184429+0000","last_peered":"2024-09-21T06:05:23.184429+0000","last_clean":"2024-09-21T06:05:23.184429+0000","last_became_active":"2024-09-21T06:05:23.179748+0000","last_became_peered":"2024-09-21T06:05:23.179748+0000","last_unstale":"2024-09-21T06:05:23.184429+0000","last_undegraded":"2024-09-21T06:05:23.184429+0000","last_fullsized":"2024-09-21T06:05:23.184429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:10.873769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182086+0000","last_change":"2024-09-21T06:05:23.180421+0000","last_active":"2024-09-21T06:05:23.182086+0000","last_peered":"2024-09-21T06:05:23.182086+0000","last_clean":"2024-09-21T06:05:23.182086+0000","last_became_active":"2024-09-21T06:05:23.179656+0000","last_became_peered":"2024-09-21T06:05:23.179656+0000","last_unstale":"2024-09-21T06:05:23.182086+0000","last_undegraded":"2024-09-21T06:05:23.182086+0000","last_fullsized":"2024-09-21T06:05:23.182086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:51.649867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176908+0000","last_change":"2024-09-21T06:05:23.172039+0000","last_active":"2024-09-21T06:05:23.176908+0000","last_peered":"2024-09-21T06:05:23.176908+0000","last_clean":"2024-09-21T06:05:23.176908+0000","last_became_active":"2024-09-21T06:05:23.171702+0000","last_became_peered":"2024-09-21T06:05:23.171702+0000","last_unstale":"2024-09-21T06:05:23.176908+0000","last_undegraded":"2024-09-21T06:05:23.176908+0000","last_fullsized":"2024-09-21T06:05:23.176908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:19.477443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.179887+0000","last_change":"2024-09-21T06:05:23.179703+0000","last_active":"2024-09-21T06:05:23.179887+0000","last_peered":"2024-09-21T06:05:23.179887+0000","last_clean":"2024-09-21T06:05:23.179887+0000","last_became_active":"2024-09-21T06:05:23.179329+0000","last_became_peered":"2024-09-21T06:05:23.179329+0000","last_unstale":"2024-09-21T06:05:23.179887+0000","last_undegraded":"2024-09-21T06:05:23.179887+0000","last_fullsized":"2024-09-21T06:05:23.179887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:08.327941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178071+0000","last_change":"2024-09-21T06:05:23.177572+0000","last_active":"2024-09-21T06:05:23.178071+0000","last_peered":"2024-09-21T06:05:23.178071+0000","last_clean":"2024-09-21T06:05:23.178071+0000","last_became_active":"2024-09-21T06:05:23.177301+0000","last_became_peered":"2024-09-21T06:05:23.177301+0000","last_unstale":"2024-09-21T06:05:23.178071+0000","last_undegraded":"2024-09-21T06:05:23.178071+0000","last_fullsized":"2024-09-21T06:05:23.178071+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:42.233713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163723+0000","last_change":"2024-09-21T06:05:23.175668+0000","last_active":"2024-09-21T06:05:24.163723+0000","last_peered":"2024-09-21T06:05:24.163723+0000","last_clean":"2024-09-21T06:05:24.163723+0000","last_became_active":"2024-09-21T06:05:23.175112+0000","last_became_peered":"2024-09-21T06:05:23.175112+0000","last_unstale":"2024-09-21T06:05:24.163723+0000","last_undegraded":"2024-09-21T06:05:24.163723+0000","last_fullsized":"2024-09-21T06:05:24.163723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:11.239951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.174373+0000","last_change":"2024-09-21T06:05:23.174187+0000","last_active":"2024-09-21T06:05:23.174373+0000","last_peered":"2024-09-21T06:05:23.174373+0000","last_clean":"2024-09-21T06:05:23.174373+0000","last_became_active":"2024-09-21T06:05:23.173934+0000","last_became_peered":"2024-09-21T06:05:23.173934+0000","last_unstale":"2024-09-21T06:05:23.174373+0000","last_undegraded":"2024-09-21T06:05:23.174373+0000","last_fullsized":"2024-09-21T06:05:23.174373+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:38.329396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180819+0000","last_change":"2024-09-21T06:05:23.180081+0000","last_active":"2024-09-21T06:05:23.180819+0000","last_peered":"2024-09-21T06:05:23.180819+0000","last_clean":"2024-09-21T06:05:23.180819+0000","last_became_active":"2024-09-21T06:05:23.179703+0000","last_became_peered":"2024-09-21T06:05:23.179703+0000","last_unstale":"2024-09-21T06:05:23.180819+0000","last_undegraded":"2024-09-21T06:05:23.180819+0000","last_fullsized":"2024-09-21T06:05:23.180819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:25.102752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162901+0000","last_change":"2024-09-21T06:05:22.161066+0000","last_active":"2024-09-21T06:05:24.162901+0000","last_peered":"2024-09-21T06:05:24.162901+0000","last_clean":"2024-09-21T06:05:24.162901+0000","last_became_active":"2024-09-21T06:05:22.159651+0000","last_became_peered":"2024-09-21T06:05:22.159651+0000","last_unstale":"2024-09-21T06:05:24.162901+0000","last_undegraded":"2024-09-21T06:05:24.162901+0000","last_fullsized":"2024-09-21T06:05:24.162901+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.512010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178270+0000","last_change":"2024-09-21T06:05:23.176385+0000","last_active":"2024-09-21T06:05:23.178270+0000","last_peered":"2024-09-21T06:05:23.178270+0000","last_clean":"2024-09-21T06:05:23.178270+0000","last_became_active":"2024-09-21T06:05:23.176051+0000","last_became_peered":"2024-09-21T06:05:23.176051+0000","last_unstale":"2024-09-21T06:05:23.178270+0000","last_undegraded":"2024-09-21T06:05:23.178270+0000","last_fullsized":"2024-09-21T06:05:23.178270+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:10.054431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.194593+0000","last_change":"2024-09-21T06:05:22.160702+0000","last_active":"2024-09-21T06:05:23.194593+0000","last_peered":"2024-09-21T06:05:23.194593+0000","last_clean":"2024-09-21T06:05:23.194593+0000","last_became_active":"2024-09-21T06:05:22.160400+0000","last_became_peered":"2024-09-21T06:05:22.160400+0000","last_unstale":"2024-09-21T06:05:23.194593+0000","last_undegraded":"2024-09-21T06:05:23.194593+0000","last_fullsized":"2024-09-21T06:05:23.194593+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:56.823830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183952+0000","last_change":"2024-09-21T06:05:23.182827+0000","last_active":"2024-09-21T06:05:23.183952+0000","last_peered":"2024-09-21T06:05:23.183952+0000","last_clean":"2024-09-21T06:05:23.183952+0000","last_became_active":"2024-09-21T06:05:23.182397+0000","last_became_peered":"2024-09-21T06:05:23.182397+0000","last_unstale":"2024-09-21T06:05:23.183952+0000","last_undegraded":"2024-09-21T06:05:23.183952+0000","last_fullsized":"2024-09-21T06:05:23.183952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:55.629878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.193889+0000","last_change":"2024-09-21T06:05:22.148534+0000","last_active":"2024-09-21T06:05:23.193889+0000","last_peered":"2024-09-21T06:05:23.193889+0000","last_clean":"2024-09-21T06:05:23.193889+0000","last_became_active":"2024-09-21T06:05:22.148257+0000","last_became_peered":"2024-09-21T06:05:22.148257+0000","last_unstale":"2024-09-21T06:05:23.193889+0000","last_undegraded":"2024-09-21T06:05:23.193889+0000","last_fullsized":"2024-09-21T06:05:23.193889+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:02.726642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182738+0000","last_change":"2024-09-21T06:05:23.181602+0000","last_active":"2024-09-21T06:05:23.182738+0000","last_peered":"2024-09-21T06:05:23.182738+0000","last_clean":"2024-09-21T06:05:23.182738+0000","last_became_active":"2024-09-21T06:05:23.181202+0000","last_became_peered":"2024-09-21T06:05:23.181202+0000","last_unstale":"2024-09-21T06:05:23.182738+0000","last_undegraded":"2024-09-21T06:05:23.182738+0000","last_fullsized":"2024-09-21T06:05:23.182738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:57.824332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.192871+0000","last_change":"2024-09-21T06:05:22.155911+0000","last_active":"2024-09-21T06:05:23.192871+0000","last_peered":"2024-09-21T06:05:23.192871+0000","last_clean":"2024-09-21T06:05:23.192871+0000","last_became_active":"2024-09-21T06:05:22.155640+0000","last_became_peered":"2024-09-21T06:05:22.155640+0000","last_unstale":"2024-09-21T06:05:23.192871+0000","last_undegraded":"2024-09-21T06:05:23.192871+0000","last_fullsized":"2024-09-21T06:05:23.192871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:23.237568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.177575+0000","last_change":"2024-09-21T06:05:23.177240+0000","last_active":"2024-09-21T06:05:23.177575+0000","last_peered":"2024-09-21T06:05:23.177575+0000","last_clean":"2024-09-21T06:05:23.177575+0000","last_became_active":"2024-09-21T06:05:23.176956+0000","last_became_peered":"2024-09-21T06:05:23.176956+0000","last_unstale":"2024-09-21T06:05:23.177575+0000","last_undegraded":"2024-09-21T06:05:23.177575+0000","last_fullsized":"2024-09-21T06:05:23.177575+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:23.240874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163062+0000","last_change":"2024-09-21T06:05:22.155355+0000","last_active":"2024-09-21T06:05:24.163062+0000","last_peered":"2024-09-21T06:05:24.163062+0000","last_clean":"2024-09-21T06:05:24.163062+0000","last_became_active":"2024-09-21T06:05:22.154719+0000","last_became_peered":"2024-09-21T06:05:22.154719+0000","last_unstale":"2024-09-21T06:05:24.163062+0000","last_undegraded":"2024-09-21T06:05:24.163062+0000","last_fullsized":"2024-09-21T06:05:24.163062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:27.788932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395572+0000","last_change":"2024-09-21T06:05:23.181542+0000","last_active":"2024-09-21T06:05:24.395572+0000","last_peered":"2024-09-21T06:05:24.395572+0000","last_clean":"2024-09-21T06:05:24.395572+0000","last_became_active":"2024-09-21T06:05:23.178500+0000","last_became_peered":"2024-09-21T06:05:23.178500+0000","last_unstale":"2024-09-21T06:05:24.395572+0000","last_undegraded":"2024-09-21T06:05:24.395572+0000","last_fullsized":"2024-09-21T06:05:24.395572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:20.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.195034+0000","last_change":"2024-09-21T06:05:22.155745+0000","last_active":"2024-09-21T06:05:23.195034+0000","last_peered":"2024-09-21T06:05:23.195034+0000","last_clean":"2024-09-21T06:05:23.195034+0000","last_became_active":"2024-09-21T06:05:22.155476+0000","last_became_peered":"2024-09-21T06:05:22.155476+0000","last_unstale":"2024-09-21T06:05:23.195034+0000","last_undegraded":"2024-09-21T06:05:23.195034+0000","last_fullsized":"2024-09-21T06:05:23.195034+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:00.328840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395913+0000","last_change":"2024-09-21T06:05:23.183657+0000","last_active":"2024-09-21T06:05:24.395913+0000","last_peered":"2024-09-21T06:05:24.395913+0000","last_clean":"2024-09-21T06:05:24.395913+0000","last_became_active":"2024-09-21T06:05:23.182630+0000","last_became_peered":"2024-09-21T06:05:23.182630+0000","last_unstale":"2024-09-21T06:05:24.395913+0000","last_undegraded":"2024-09-21T06:05:24.395913+0000","last_fullsized":"2024-09-21T06:05:24.395913+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:24.907986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.172238+0000","last_change":"2024-09-21T06:05:22.149074+0000","last_active":"2024-09-21T06:05:23.172238+0000","last_peered":"2024-09-21T06:05:23.172238+0000","last_clean":"2024-09-21T06:05:23.172238+0000","last_became_active":"2024-09-21T06:05:22.148513+0000","last_became_peered":"2024-09-21T06:05:22.148513+0000","last_unstale":"2024-09-21T06:05:23.172238+0000","last_undegraded":"2024-09-21T06:05:23.172238+0000","last_fullsized":"2024-09-21T06:05:23.172238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:18.863349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178429+0000","last_change":"2024-09-21T06:05:23.178219+0000","last_active":"2024-09-21T06:05:23.178429+0000","last_peered":"2024-09-21T06:05:23.178429+0000","last_clean":"2024-09-21T06:05:23.178429+0000","last_became_active":"2024-09-21T06:05:23.177913+0000","last_became_peered":"2024-09-21T06:05:23.177913+0000","last_unstale":"2024-09-21T06:05:23.178429+0000","last_undegraded":"2024-09-21T06:05:23.178429+0000","last_fullsized":"2024-09-21T06:05:23.178429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:47.004666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396398+0000","last_change":"2024-09-21T06:05:22.160764+0000","last_active":"2024-09-21T06:05:24.396398+0000","last_peered":"2024-09-21T06:05:24.396398+0000","last_clean":"2024-09-21T06:05:24.396398+0000","last_became_active":"2024-09-21T06:05:22.160028+0000","last_became_peered":"2024-09-21T06:05:22.160028+0000","last_unstale":"2024-09-21T06:05:24.396398+0000","last_undegraded":"2024-09-21T06:05:24.396398+0000","last_fullsized":"2024-09-21T06:05:24.396398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:56.899411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183032+0000","last_change":"2024-09-21T06:05:23.182717+0000","last_active":"2024-09-21T06:05:23.183032+0000","last_peered":"2024-09-21T06:05:23.183032+0000","last_clean":"2024-09-21T06:05:23.183032+0000","last_became_active":"2024-09-21T06:05:23.182426+0000","last_became_peered":"2024-09-21T06:05:23.182426+0000","last_unstale":"2024-09-21T06:05:23.183032+0000","last_undegraded":"2024-09-21T06:05:23.183032+0000","last_fullsized":"2024-09-21T06:05:23.183032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:59.023508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.170504+0000","last_change":"2024-09-21T06:05:22.158358+0000","last_active":"2024-09-21T06:05:23.170504+0000","last_peered":"2024-09-21T06:05:23.170504+0000","last_clean":"2024-09-21T06:05:23.170504+0000","last_became_active":"2024-09-21T06:05:22.158054+0000","last_became_peered":"2024-09-21T06:05:22.158054+0000","last_unstale":"2024-09-21T06:05:23.170504+0000","last_undegraded":"2024-09-21T06:05:23.170504+0000","last_fullsized":"2024-09-21T06:05:23.170504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:27.146393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176089+0000","last_change":"2024-09-21T06:05:23.175856+0000","last_active":"2024-09-21T06:05:23.176089+0000","last_peered":"2024-09-21T06:05:23.176089+0000","last_clean":"2024-09-21T06:05:23.176089+0000","last_became_active":"2024-09-21T06:05:23.172753+0000","last_became_peered":"2024-09-21T06:05:23.172753+0000","last_unstale":"2024-09-21T06:05:23.176089+0000","last_undegraded":"2024-09-21T06:05:23.176089+0000","last_fullsized":"2024-09-21T06:05:23.176089+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:04.144406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395758+0000","last_change":"2024-09-21T06:05:22.158847+0000","last_active":"2024-09-21T06:05:24.395758+0000","last_peered":"2024-09-21T06:05:24.395758+0000","last_clean":"2024-09-21T06:05:24.395758+0000","last_became_active":"2024-09-21T06:05:22.158235+0000","last_became_peered":"2024-09-21T06:05:22.158235+0000","last_unstale":"2024-09-21T06:05:24.395758+0000","last_undegraded":"2024-09-21T06:05:24.395758+0000","last_fullsized":"2024-09-21T06:05:24.395758+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:52.465597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163187+0000","last_change":"2024-09-21T06:05:23.179526+0000","last_active":"2024-09-21T06:05:24.163187+0000","last_peered":"2024-09-21T06:05:24.163187+0000","last_clean":"2024-09-21T06:05:24.163187+0000","last_became_active":"2024-09-21T06:05:23.176567+0000","last_became_peered":"2024-09-21T06:05:23.176567+0000","last_unstale":"2024-09-21T06:05:24.163187+0000","last_undegraded":"2024-09-21T06:05:24.163187+0000","last_fullsized":"2024-09-21T06:05:24.163187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.497237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.193432+0000","last_change":"2024-09-21T06:05:22.160892+0000","last_active":"2024-09-21T06:05:23.193432+0000","last_peered":"2024-09-21T06:05:23.193432+0000","last_clean":"2024-09-21T06:05:23.193432+0000","last_became_active":"2024-09-21T06:05:22.160615+0000","last_became_peered":"2024-09-21T06:05:22.160615+0000","last_unstale":"2024-09-21T06:05:23.193432+0000","last_undegraded":"2024-09-21T06:05:23.193432+0000","last_fullsized":"2024-09-21T06:05:23.193432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:02.817509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176404+0000","last_change":"2024-09-21T06:05:23.176147+0000","last_active":"2024-09-21T06:05:23.176404+0000","last_peered":"2024-09-21T06:05:23.176404+0000","last_clean":"2024-09-21T06:05:23.176404+0000","last_became_active":"2024-09-21T06:05:23.172688+0000","last_became_peered":"2024-09-21T06:05:23.172688+0000","last_unstale":"2024-09-21T06:05:23.176404+0000","last_undegraded":"2024-09-21T06:05:23.176404+0000","last_fullsized":"2024-09-21T06:05:23.176404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:45.107863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.197516+0000","last_change":"2024-09-21T06:05:22.159403+0000","last_active":"2024-09-21T06:05:23.197516+0000","last_peered":"2024-09-21T06:05:23.197516+0000","last_clean":"2024-09-21T06:05:23.197516+0000","last_became_active":"2024-09-21T06:05:22.159041+0000","last_became_peered":"2024-09-21T06:05:22.159041+0000","last_unstale":"2024-09-21T06:05:23.197516+0000","last_undegraded":"2024-09-21T06:05:23.197516+0000","last_fullsized":"2024-09-21T06:05:23.197516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:30.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184507+0000","last_change":"2024-09-21T06:05:23.184302+0000","last_active":"2024-09-21T06:05:23.184507+0000","last_peered":"2024-09-21T06:05:23.184507+0000","last_clean":"2024-09-21T06:05:23.184507+0000","last_became_active":"2024-09-21T06:05:23.183297+0000","last_became_peered":"2024-09-21T06:05:23.183297+0000","last_unstale":"2024-09-21T06:05:23.184507+0000","last_undegraded":"2024-09-21T06:05:23.184507+0000","last_fullsized":"2024-09-21T06:05:23.184507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:21.085566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163245+0000","last_change":"2024-09-21T06:05:22.161271+0000","last_active":"2024-09-21T06:05:24.163245+0000","last_peered":"2024-09-21T06:05:24.163245+0000","last_clean":"2024-09-21T06:05:24.163245+0000","last_became_active":"2024-09-21T06:05:22.161013+0000","last_became_peered":"2024-09-21T06:05:22.161013+0000","last_unstale":"2024-09-21T06:05:24.163245+0000","last_undegraded":"2024-09-21T06:05:24.163245+0000","last_fullsized":"2024-09-21T06:05:24.163245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:54.419000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396020+0000","last_change":"2024-09-21T06:05:23.166865+0000","last_active":"2024-09-21T06:05:24.396020+0000","last_peered":"2024-09-21T06:05:24.396020+0000","last_clean":"2024-09-21T06:05:24.396020+0000","last_became_active":"2024-09-21T06:05:23.166687+0000","last_became_peered":"2024-09-21T06:05:23.166687+0000","last_unstale":"2024-09-21T06:05:24.396020+0000","last_undegraded":"2024-09-21T06:05:24.396020+0000","last_fullsized":"2024-09-21T06:05:24.396020+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.040511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.166765+0000","last_change":"2024-09-21T06:05:22.156905+0000","last_active":"2024-09-21T06:05:23.166765+0000","last_peered":"2024-09-21T06:05:23.166765+0000","last_clean":"2024-09-21T06:05:23.166765+0000","last_became_active":"2024-09-21T06:05:22.156501+0000","last_became_peered":"2024-09-21T06:05:22.156501+0000","last_unstale":"2024-09-21T06:05:23.166765+0000","last_undegraded":"2024-09-21T06:05:23.166765+0000","last_fullsized":"2024-09-21T06:05:23.166765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:12.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162770+0000","last_change":"2024-09-21T06:05:23.173352+0000","last_active":"2024-09-21T06:05:24.162770+0000","last_peered":"2024-09-21T06:05:24.162770+0000","last_clean":"2024-09-21T06:05:24.162770+0000","last_became_active":"2024-09-21T06:05:23.171078+0000","last_became_peered":"2024-09-21T06:05:23.171078+0000","last_unstale":"2024-09-21T06:05:24.162770+0000","last_undegraded":"2024-09-21T06:05:24.162770+0000","last_fullsized":"2024-09-21T06:05:24.162770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:00.603743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163142+0000","last_change":"2024-09-21T06:05:22.161133+0000","last_active":"2024-09-21T06:05:24.163142+0000","last_peered":"2024-09-21T06:05:24.163142+0000","last_clean":"2024-09-21T06:05:24.163142+0000","last_became_active":"2024-09-21T06:05:22.160875+0000","last_became_peered":"2024-09-21T06:05:22.160875+0000","last_unstale":"2024-09-21T06:05:24.163142+0000","last_undegraded":"2024-09-21T06:05:24.163142+0000","last_fullsized":"2024-09-21T06:05:24.163142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:55.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180981+0000","last_change":"2024-09-21T06:05:23.180713+0000","last_active":"2024-09-21T06:05:23.180981+0000","last_peered":"2024-09-21T06:05:23.180981+0000","last_clean":"2024-09-21T06:05:23.180981+0000","last_became_active":"2024-09-21T06:05:23.180114+0000","last_became_peered":"2024-09-21T06:05:23.180114+0000","last_unstale":"2024-09-21T06:05:23.180981+0000","last_undegraded":"2024-09-21T06:05:23.180981+0000","last_fullsized":"2024-09-21T06:05:23.180981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:43.032916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395740+0000","last_change":"2024-09-21T06:05:22.153182+0000","last_active":"2024-09-21T06:05:24.395740+0000","last_peered":"2024-09-21T06:05:24.395740+0000","last_clean":"2024-09-21T06:05:24.395740+0000","last_became_active":"2024-09-21T06:05:22.152605+0000","last_became_peered":"2024-09-21T06:05:22.152605+0000","last_unstale":"2024-09-21T06:05:24.395740+0000","last_undegraded":"2024-09-21T06:05:24.395740+0000","last_fullsized":"2024-09-21T06:05:24.395740+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:40.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.174077+0000","last_change":"2024-09-21T06:05:23.173881+0000","last_active":"2024-09-21T06:05:23.174077+0000","last_peered":"2024-09-21T06:05:23.174077+0000","last_clean":"2024-09-21T06:05:23.174077+0000","last_became_active":"2024-09-21T06:05:23.173624+0000","last_became_peered":"2024-09-21T06:05:23.173624+0000","last_unstale":"2024-09-21T06:05:23.174077+0000","last_undegraded":"2024-09-21T06:05:23.174077+0000","last_fullsized":"2024-09-21T06:05:23.174077+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:54.162338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.195532+0000","last_change":"2024-09-21T06:05:22.155349+0000","last_active":"2024-09-21T06:05:23.195532+0000","last_peered":"2024-09-21T06:05:23.195532+0000","last_clean":"2024-09-21T06:05:23.195532+0000","last_became_active":"2024-09-21T06:05:22.155105+0000","last_became_peered":"2024-09-21T06:05:22.155105+0000","last_unstale":"2024-09-21T06:05:23.195532+0000","last_undegraded":"2024-09-21T06:05:23.195532+0000","last_fullsized":"2024-09-21T06:05:23.195532+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:04.424319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394986+0000","last_change":"2024-09-21T06:05:23.166232+0000","last_active":"2024-09-21T06:05:24.394986+0000","last_peered":"2024-09-21T06:05:24.394986+0000","last_clean":"2024-09-21T06:05:24.394986+0000","last_became_active":"2024-09-21T06:05:23.166031+0000","last_became_peered":"2024-09-21T06:05:23.166031+0000","last_unstale":"2024-09-21T06:05:24.394986+0000","last_undegraded":"2024-09-21T06:05:24.394986+0000","last_fullsized":"2024-09-21T06:05:24.394986+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:44.475905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.195271+0000","last_change":"2024-09-21T06:05:22.162362+0000","last_active":"2024-09-21T06:05:23.195271+0000","last_peered":"2024-09-21T06:05:23.195271+0000","last_clean":"2024-09-21T06:05:23.195271+0000","last_became_active":"2024-09-21T06:05:22.162032+0000","last_became_peered":"2024-09-21T06:05:22.162032+0000","last_unstale":"2024-09-21T06:05:23.195271+0000","last_undegraded":"2024-09-21T06:05:23.195271+0000","last_fullsized":"2024-09-21T06:05:23.195271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.267437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183871+0000","last_change":"2024-09-21T06:05:23.183037+0000","last_active":"2024-09-21T06:05:23.183871+0000","last_peered":"2024-09-21T06:05:23.183871+0000","last_clean":"2024-09-21T06:05:23.183871+0000","last_became_active":"2024-09-21T06:05:23.182766+0000","last_became_peered":"2024-09-21T06:05:23.182766+0000","last_unstale":"2024-09-21T06:05:23.183871+0000","last_undegraded":"2024-09-21T06:05:23.183871+0000","last_fullsized":"2024-09-21T06:05:23.183871+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:09.044203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.192903+0000","last_change":"2024-09-21T06:05:22.148803+0000","last_active":"2024-09-21T06:05:23.192903+0000","last_peered":"2024-09-21T06:05:23.192903+0000","last_clean":"2024-09-21T06:05:23.192903+0000","last_became_active":"2024-09-21T06:05:22.148522+0000","last_became_peered":"2024-09-21T06:05:22.148522+0000","last_unstale":"2024-09-21T06:05:23.192903+0000","last_undegraded":"2024-09-21T06:05:23.192903+0000","last_fullsized":"2024-09-21T06:05:23.192903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:39.939472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180912+0000","last_change":"2024-09-21T06:05:23.180621+0000","last_active":"2024-09-21T06:05:23.180912+0000","last_peered":"2024-09-21T06:05:23.180912+0000","last_clean":"2024-09-21T06:05:23.180912+0000","last_became_active":"2024-09-21T06:05:23.179605+0000","last_became_peered":"2024-09-21T06:05:23.179605+0000","last_unstale":"2024-09-21T06:05:23.180912+0000","last_undegraded":"2024-09-21T06:05:23.180912+0000","last_fullsized":"2024-09-21T06:05:23.180912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:46.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163204+0000","last_change":"2024-09-21T06:05:22.155650+0000","last_active":"2024-09-21T06:05:24.163204+0000","last_peered":"2024-09-21T06:05:24.163204+0000","last_clean":"2024-09-21T06:05:24.163204+0000","last_became_active":"2024-09-21T06:05:22.155079+0000","last_became_peered":"2024-09-21T06:05:22.155079+0000","last_unstale":"2024-09-21T06:05:24.163204+0000","last_undegraded":"2024-09-21T06:05:24.163204+0000","last_fullsized":"2024-09-21T06:05:24.163204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:23.632953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162933+0000","last_change":"2024-09-21T06:05:23.179227+0000","last_active":"2024-09-21T06:05:24.162933+0000","last_peered":"2024-09-21T06:05:24.162933+0000","last_clean":"2024-09-21T06:05:24.162933+0000","last_became_active":"2024-09-21T06:05:23.176207+0000","last_became_peered":"2024-09-21T06:05:23.176207+0000","last_unstale":"2024-09-21T06:05:24.162933+0000","last_undegraded":"2024-09-21T06:05:24.162933+0000","last_fullsized":"2024-09-21T06:05:24.162933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:17.253113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163089+0000","last_change":"2024-09-21T06:05:22.154655+0000","last_active":"2024-09-21T06:05:24.163089+0000","last_peered":"2024-09-21T06:05:24.163089+0000","last_clean":"2024-09-21T06:05:24.163089+0000","last_became_active":"2024-09-21T06:05:22.154287+0000","last_became_peered":"2024-09-21T06:05:22.154287+0000","last_unstale":"2024-09-21T06:05:24.163089+0000","last_undegraded":"2024-09-21T06:05:24.163089+0000","last_fullsized":"2024-09-21T06:05:24.163089+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:29.024409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.174429+0000","last_change":"2024-09-21T06:05:23.172936+0000","last_active":"2024-09-21T06:05:23.174429+0000","last_peered":"2024-09-21T06:05:23.174429+0000","last_clean":"2024-09-21T06:05:23.174429+0000","last_became_active":"2024-09-21T06:05:23.172668+0000","last_became_peered":"2024-09-21T06:05:23.172668+0000","last_unstale":"2024-09-21T06:05:23.174429+0000","last_undegraded":"2024-09-21T06:05:23.174429+0000","last_fullsized":"2024-09-21T06:05:23.174429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:19.790881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176629+0000","last_change":"2024-09-21T06:05:22.155723+0000","last_active":"2024-09-21T06:05:23.176629+0000","last_peered":"2024-09-21T06:05:23.176629+0000","last_clean":"2024-09-21T06:05:23.176629+0000","last_became_active":"2024-09-21T06:05:22.155451+0000","last_became_peered":"2024-09-21T06:05:22.155451+0000","last_unstale":"2024-09-21T06:05:23.176629+0000","last_undegraded":"2024-09-21T06:05:23.176629+0000","last_fullsized":"2024-09-21T06:05:23.176629+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:42.310635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180047+0000","last_change":"2024-09-21T06:05:23.178860+0000","last_active":"2024-09-21T06:05:23.180047+0000","last_peered":"2024-09-21T06:05:23.180047+0000","last_clean":"2024-09-21T06:05:23.180047+0000","last_became_active":"2024-09-21T06:05:23.178608+0000","last_became_peered":"2024-09-21T06:05:23.178608+0000","last_unstale":"2024-09-21T06:05:23.180047+0000","last_undegraded":"2024-09-21T06:05:23.180047+0000","last_fullsized":"2024-09-21T06:05:23.180047+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:29.342707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396446+0000","last_change":"2024-09-21T06:05:22.157619+0000","last_active":"2024-09-21T06:05:24.396446+0000","last_peered":"2024-09-21T06:05:24.396446+0000","last_clean":"2024-09-21T06:05:24.396446+0000","last_became_active":"2024-09-21T06:05:22.157188+0000","last_became_peered":"2024-09-21T06:05:22.157188+0000","last_unstale":"2024-09-21T06:05:24.396446+0000","last_undegraded":"2024-09-21T06:05:24.396446+0000","last_fullsized":"2024-09-21T06:05:24.396446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:16.395803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396129+0000","last_change":"2024-09-21T06:05:23.172652+0000","last_active":"2024-09-21T06:05:24.396129+0000","last_peered":"2024-09-21T06:05:24.396129+0000","last_clean":"2024-09-21T06:05:24.396129+0000","last_became_active":"2024-09-21T06:05:23.171390+0000","last_became_peered":"2024-09-21T06:05:23.171390+0000","last_unstale":"2024-09-21T06:05:24.396129+0000","last_undegraded":"2024-09-21T06:05:24.396129+0000","last_fullsized":"2024-09-21T06:05:24.396129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:22.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.166996+0000","last_change":"2024-09-21T06:05:22.161267+0000","last_active":"2024-09-21T06:05:23.166996+0000","last_peered":"2024-09-21T06:05:23.166996+0000","last_clean":"2024-09-21T06:05:23.166996+0000","last_became_active":"2024-09-21T06:05:22.160668+0000","last_became_peered":"2024-09-21T06:05:22.160668+0000","last_unstale":"2024-09-21T06:05:23.166996+0000","last_undegraded":"2024-09-21T06:05:23.166996+0000","last_fullsized":"2024-09-21T06:05:23.166996+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:09.928138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184732+0000","last_change":"2024-09-21T06:05:23.184527+0000","last_active":"2024-09-21T06:05:23.184732+0000","last_peered":"2024-09-21T06:05:23.184732+0000","last_clean":"2024-09-21T06:05:23.184732+0000","last_became_active":"2024-09-21T06:05:23.184228+0000","last_became_peered":"2024-09-21T06:05:23.184228+0000","last_unstale":"2024-09-21T06:05:23.184732+0000","last_undegraded":"2024-09-21T06:05:23.184732+0000","last_fullsized":"2024-09-21T06:05:23.184732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:17.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.188330+0000","last_change":"2024-09-21T06:05:22.160657+0000","last_active":"2024-09-21T06:05:24.188330+0000","last_peered":"2024-09-21T06:05:24.188330+0000","last_clean":"2024-09-21T06:05:24.188330+0000","last_became_active":"2024-09-21T06:05:22.159299+0000","last_became_peered":"2024-09-21T06:05:22.159299+0000","last_unstale":"2024-09-21T06:05:24.188330+0000","last_undegraded":"2024-09-21T06:05:24.188330+0000","last_fullsized":"2024-09-21T06:05:24.188330+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:11.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396233+0000","last_change":"2024-09-21T06:05:23.183331+0000","last_active":"2024-09-21T06:05:24.396233+0000","last_peered":"2024-09-21T06:05:24.396233+0000","last_clean":"2024-09-21T06:05:24.396233+0000","last_became_active":"2024-09-21T06:05:23.181905+0000","last_became_peered":"2024-09-21T06:05:23.181905+0000","last_unstale":"2024-09-21T06:05:24.396233+0000","last_undegraded":"2024-09-21T06:05:24.396233+0000","last_fullsized":"2024-09-21T06:05:24.396233+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:50.163151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.165003+0000","last_change":"2024-09-21T06:05:22.160082+0000","last_active":"2024-09-21T06:05:23.165003+0000","last_peered":"2024-09-21T06:05:23.165003+0000","last_clean":"2024-09-21T06:05:23.165003+0000","last_became_active":"2024-09-21T06:05:22.159736+0000","last_became_peered":"2024-09-21T06:05:22.159736+0000","last_unstale":"2024-09-21T06:05:23.165003+0000","last_undegraded":"2024-09-21T06:05:23.165003+0000","last_fullsized":"2024-09-21T06:05:23.165003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:47.501589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.175817+0000","last_change":"2024-09-21T06:05:23.175578+0000","last_active":"2024-09-21T06:05:23.175817+0000","last_peered":"2024-09-21T06:05:23.175817+0000","last_clean":"2024-09-21T06:05:23.175817+0000","last_became_active":"2024-09-21T06:05:23.172505+0000","last_became_peered":"2024-09-21T06:05:23.172505+0000","last_unstale":"2024-09-21T06:05:23.175817+0000","last_undegraded":"2024-09-21T06:05:23.175817+0000","last_fullsized":"2024-09-21T06:05:23.175817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:19.268516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.170613+0000","last_change":"2024-09-21T06:05:22.149418+0000","last_active":"2024-09-21T06:05:23.170613+0000","last_peered":"2024-09-21T06:05:23.170613+0000","last_clean":"2024-09-21T06:05:23.170613+0000","last_became_active":"2024-09-21T06:05:22.149160+0000","last_became_peered":"2024-09-21T06:05:22.149160+0000","last_unstale":"2024-09-21T06:05:23.170613+0000","last_undegraded":"2024-09-21T06:05:23.170613+0000","last_fullsized":"2024-09-21T06:05:23.170613+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:23.556124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162859+0000","last_change":"2024-09-21T06:05:23.180604+0000","last_active":"2024-09-21T06:05:24.162859+0000","last_peered":"2024-09-21T06:05:24.162859+0000","last_clean":"2024-09-21T06:05:24.162859+0000","last_became_active":"2024-09-21T06:05:23.180162+0000","last_became_peered":"2024-09-21T06:05:23.180162+0000","last_unstale":"2024-09-21T06:05:24.162859+0000","last_undegraded":"2024-09-21T06:05:24.162859+0000","last_fullsized":"2024-09-21T06:05:24.162859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:49.238204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.167234+0000","last_change":"2024-09-21T06:05:22.160961+0000","last_active":"2024-09-21T06:05:23.167234+0000","last_peered":"2024-09-21T06:05:23.167234+0000","last_clean":"2024-09-21T06:05:23.167234+0000","last_became_active":"2024-09-21T06:05:22.160287+0000","last_became_peered":"2024-09-21T06:05:22.160287+0000","last_unstale":"2024-09-21T06:05:23.167234+0000","last_undegraded":"2024-09-21T06:05:23.167234+0000","last_fullsized":"2024-09-21T06:05:23.167234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:23.115747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163916+0000","last_change":"2024-09-21T06:05:23.175371+0000","last_active":"2024-09-21T06:05:24.163916+0000","last_peered":"2024-09-21T06:05:24.163916+0000","last_clean":"2024-09-21T06:05:24.163916+0000","last_became_active":"2024-09-21T06:05:23.174768+0000","last_became_peered":"2024-09-21T06:05:23.174768+0000","last_unstale":"2024-09-21T06:05:24.163916+0000","last_undegraded":"2024-09-21T06:05:24.163916+0000","last_fullsized":"2024-09-21T06:05:24.163916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.908458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.169865+0000","last_change":"2024-09-21T06:05:22.162467+0000","last_active":"2024-09-21T06:05:23.169865+0000","last_peered":"2024-09-21T06:05:23.169865+0000","last_clean":"2024-09-21T06:05:23.169865+0000","last_became_active":"2024-09-21T06:05:22.161862+0000","last_became_peered":"2024-09-21T06:05:22.161862+0000","last_unstale":"2024-09-21T06:05:23.169865+0000","last_undegraded":"2024-09-21T06:05:23.169865+0000","last_fullsized":"2024-09-21T06:05:23.169865+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:44.210357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.177828+0000","last_change":"2024-09-21T06:05:23.177425+0000","last_active":"2024-09-21T06:05:23.177828+0000","last_peered":"2024-09-21T06:05:23.177828+0000","last_clean":"2024-09-21T06:05:23.177828+0000","last_became_active":"2024-09-21T06:05:23.177150+0000","last_became_peered":"2024-09-21T06:05:23.177150+0000","last_unstale":"2024-09-21T06:05:23.177828+0000","last_undegraded":"2024-09-21T06:05:23.177828+0000","last_fullsized":"2024-09-21T06:05:23.177828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:36.199861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.168927+0000","last_change":"2024-09-21T06:05:22.158005+0000","last_active":"2024-09-21T06:05:23.168927+0000","last_peered":"2024-09-21T06:05:23.168927+0000","last_clean":"2024-09-21T06:05:23.168927+0000","last_became_active":"2024-09-21T06:05:22.157723+0000","last_became_peered":"2024-09-21T06:05:22.157723+0000","last_unstale":"2024-09-21T06:05:23.168927+0000","last_undegraded":"2024-09-21T06:05:23.168927+0000","last_fullsized":"2024-09-21T06:05:23.168927+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:36.268323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.185634+0000","last_change":"2024-09-21T06:05:23.185385+0000","last_active":"2024-09-21T06:05:23.185634+0000","last_peered":"2024-09-21T06:05:23.185634+0000","last_clean":"2024-09-21T06:05:23.185634+0000","last_became_active":"2024-09-21T06:05:23.185011+0000","last_became_peered":"2024-09-21T06:05:23.185011+0000","last_unstale":"2024-09-21T06:05:23.185634+0000","last_undegraded":"2024-09-21T06:05:23.185634+0000","last_fullsized":"2024-09-21T06:05:23.185634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:05.382056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395105+0000","last_change":"2024-09-21T06:05:22.156821+0000","last_active":"2024-09-21T06:05:24.395105+0000","last_peered":"2024-09-21T06:05:24.395105+0000","last_clean":"2024-09-21T06:05:24.395105+0000","last_became_active":"2024-09-21T06:05:22.156576+0000","last_became_peered":"2024-09-21T06:05:22.156576+0000","last_unstale":"2024-09-21T06:05:24.395105+0000","last_undegraded":"2024-09-21T06:05:24.395105+0000","last_fullsized":"2024-09-21T06:05:24.395105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:25.258770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395635+0000","last_change":"2024-09-21T06:05:23.166861+0000","last_active":"2024-09-21T06:05:24.395635+0000","last_peered":"2024-09-21T06:05:24.395635+0000","last_clean":"2024-09-21T06:05:24.395635+0000","last_became_active":"2024-09-21T06:05:23.166683+0000","last_became_peered":"2024-09-21T06:05:23.166683+0000","last_unstale":"2024-09-21T06:05:24.395635+0000","last_undegraded":"2024-09-21T06:05:24.395635+0000","last_fullsized":"2024-09-21T06:05:24.395635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:05.787787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.193570+0000","last_change":"2024-09-21T06:05:22.150547+0000","last_active":"2024-09-21T06:05:23.193570+0000","last_peered":"2024-09-21T06:05:23.193570+0000","last_clean":"2024-09-21T06:05:23.193570+0000","last_became_active":"2024-09-21T06:05:22.150265+0000","last_became_peered":"2024-09-21T06:05:22.150265+0000","last_unstale":"2024-09-21T06:05:23.193570+0000","last_undegraded":"2024-09-21T06:05:23.193570+0000","last_fullsized":"2024-09-21T06:05:23.193570+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:35.041543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.165086+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:05:23.165086+0000","last_peered":"2024-09-21T06:05:23.165086+0000","last_clean":"2024-09-21T06:05:23.165086+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:05:23.165086+0000","last_undegraded":"2024-09-21T06:05:23.165086+0000","last_fullsized":"2024-09-21T06:05:23.165086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790386,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":780,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194531,"statfs":{"total":200000000,"available":199200622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194537,"statfs":{"total":200000000,"available":199206866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195121,"statfs":{"total":200000000,"available":199804099,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195113,"statfs":{"total":200000000,"available":199795712,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195112,"statfs":{"total":200000000,"available":199795690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:05:27.620 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 -- 172.21.15.118:0/2498875636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3500073fa0 msgr2=0x7f35000749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 --2- 172.21.15.118:0/2498875636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3500073fa0 0x7f35000749f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f350015aed0 tx=0x7f34f002a560 comp rx=0 tx=0).stop 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 -- 172.21.15.118:0/2498875636 shutdown_connections 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 --2- 172.21.15.118:0/2498875636 >> v2:172.21.15.149:3300/0 conn(0x7f35000cfe30 0x7f35000d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 --2- 172.21.15.118:0/2498875636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3500073fa0 0x7f35000749f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 -- 172.21.15.118:0/2498875636 >> 172.21.15.118:0/2498875636 conn(0x7f350006d6e0 msgr2=0x7f35000b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 -- 172.21.15.118:0/2498875636 shutdown_connections 2024-09-21T06:05:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.877+0000 7f34ffe00640 1 -- 172.21.15.118:0/2498875636 wait complete. 2024-09-21T06:05:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.879+0000 7f34ffe00640 1 Processor -- start 2024-09-21T06:05:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.879+0000 7f34ffe00640 1 -- start start 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ffe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3500073fa0 0x7f35001f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ffe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35000b5bb0 0x7f35001f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ffe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35000cfe30 0x7f35001f9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ffe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f350015da00 con 0x7f35000cfe30 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ffe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f350015d880 con 0x7f3500073fa0 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ffe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f350015db80 con 0x7f35000b5bb0 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35000cfe30 0x7f35001f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35000cfe30 0x7f35001f9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56164/0 (socket says 172.21.15.118:56164) 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34ff400640 1 -- 172.21.15.118:0/3336948915 learned_addr learned my addr 172.21.15.118:0/3336948915 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34fea00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3500073fa0 0x7f35001f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.881+0000 7f34f7e00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35000b5bb0 0x7f35001f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ff400640 1 -- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35000b5bb0 msgr2=0x7f35001f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ff400640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35000b5bb0 0x7f35001f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ff400640 1 -- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3500073fa0 msgr2=0x7f35001f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ff400640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3500073fa0 0x7f35001f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ff400640 1 -- 172.21.15.118:0/3336948915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35001f7140 con 0x7f35000cfe30 2024-09-21T06:05:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ff400640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35000cfe30 0x7f35001f9870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c6f0 tx=0x7f34f800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34f6a00640 1 -- 172.21.15.118:0/3336948915 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8017070 con 0x7f35000cfe30 2024-09-21T06:05:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34f6a00640 1 -- 172.21.15.118:0/3336948915 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34f8003c90 con 0x7f35000cfe30 2024-09-21T06:05:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35000c6860 con 0x7f35000cfe30 2024-09-21T06:05:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34f6a00640 1 -- 172.21.15.118:0/3336948915 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8003e60 con 0x7f35000cfe30 2024-09-21T06:05:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.882+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35000c6e20 con 0x7f35000cfe30 2024-09-21T06:05:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.883+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35001f6eb0 con 0x7f35000cfe30 2024-09-21T06:05:27.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.885+0000 7f34f6a00640 1 -- 172.21.15.118:0/3336948915 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34f801a070 con 0x7f35000cfe30 2024-09-21T06:05:27.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.886+0000 7f34f6a00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34dc078bf0 0x7f34dc07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:27.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.886+0000 7f34f6a00640 1 -- 172.21.15.118:0/3336948915 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f34f809a260 con 0x7f35000cfe30 2024-09-21T06:05:27.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.886+0000 7f34fea00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34dc078bf0 0x7f34dc07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.887+0000 7f34fea00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34dc078bf0 0x7f34dc07b100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f34f0033000 tx=0x7f34f0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:27.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:27.890+0000 7f34f6a00640 1 -- 172.21.15.118:0/3336948915 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f34f8062040 con 0x7f35000cfe30 2024-09-21T06:05:28.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.073+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f350015e030 con 0x7f34dc078bf0 2024-09-21T06:05:28.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.078+0000 7f34f6a00640 1 -- 172.21.15.118:0/3336948915 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247475 (secure 0 0 0) 0x7f350015e030 con 0x7f34dc078bf0 2024-09-21T06:05:28.082 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:28.083 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:05:28.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34dc078bf0 msgr2=0x7f34dc07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34dc078bf0 0x7f34dc07b100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f34f0033000 tx=0x7f34f0004730 comp rx=0 tx=0).stop 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35000cfe30 msgr2=0x7f35001f9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35000cfe30 0x7f35001f9870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c6f0 tx=0x7f34f800cbb0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 shutdown_connections 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35000cfe30 0x7f35001f9870 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34dc078bf0 0x7f34dc07b100 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35000b5bb0 0x7f35001f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 --2- 172.21.15.118:0/3336948915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3500073fa0 0x7f35001f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 >> 172.21.15.118:0/3336948915 conn(0x7f350006d6e0 msgr2=0x7f350015fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 shutdown_connections 2024-09-21T06:05:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.082+0000 7f34ffe00640 1 -- 172.21.15.118:0/3336948915 wait complete. 2024-09-21T06:05:28.106 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-21T06:05:26.478127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559753,"statfs":{"total":1600000000,"available":1597187883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.334748"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176380+0000","last_change":"2024-09-21T06:05:23.176178+0000","last_active":"2024-09-21T06:05:23.176380+0000","last_peered":"2024-09-21T06:05:23.176380+0000","last_clean":"2024-09-21T06:05:23.176380+0000","last_became_active":"2024-09-21T06:05:23.173241+0000","last_became_peered":"2024-09-21T06:05:23.173241+0000","last_unstale":"2024-09-21T06:05:23.176380+0000","last_undegraded":"2024-09-21T06:05:23.176380+0000","last_fullsized":"2024-09-21T06:05:23.176380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:38.391837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176976+0000","last_change":"2024-09-21T06:05:23.176397+0000","last_active":"2024-09-21T06:05:23.176976+0000","last_peered":"2024-09-21T06:05:23.176976+0000","last_clean":"2024-09-21T06:05:23.176976+0000","last_became_active":"2024-09-21T06:05:23.175848+0000","last_became_peered":"2024-09-21T06:05:23.175848+0000","last_unstale":"2024-09-21T06:05:23.176976+0000","last_undegraded":"2024-09-21T06:05:23.176976+0000","last_fullsized":"2024-09-21T06:05:23.176976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:44.709693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184414+0000","last_change":"2024-09-21T06:05:23.184131+0000","last_active":"2024-09-21T06:05:23.184414+0000","last_peered":"2024-09-21T06:05:23.184414+0000","last_clean":"2024-09-21T06:05:23.184414+0000","last_became_active":"2024-09-21T06:05:23.183714+0000","last_became_peered":"2024-09-21T06:05:23.183714+0000","last_unstale":"2024-09-21T06:05:23.184414+0000","last_undegraded":"2024-09-21T06:05:23.184414+0000","last_fullsized":"2024-09-21T06:05:23.184414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:17.222268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394505+0000","last_change":"2024-09-21T06:05:23.181939+0000","last_active":"2024-09-21T06:05:24.394505+0000","last_peered":"2024-09-21T06:05:24.394505+0000","last_clean":"2024-09-21T06:05:24.394505+0000","last_became_active":"2024-09-21T06:05:23.178998+0000","last_became_peered":"2024-09-21T06:05:23.178998+0000","last_unstale":"2024-09-21T06:05:24.394505+0000","last_undegraded":"2024-09-21T06:05:24.394505+0000","last_fullsized":"2024-09-21T06:05:24.394505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:24.301022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.179423+0000","last_change":"2024-09-21T06:05:23.179205+0000","last_active":"2024-09-21T06:05:23.179423+0000","last_peered":"2024-09-21T06:05:23.179423+0000","last_clean":"2024-09-21T06:05:23.179423+0000","last_became_active":"2024-09-21T06:05:23.178926+0000","last_became_peered":"2024-09-21T06:05:23.178926+0000","last_unstale":"2024-09-21T06:05:23.179423+0000","last_undegraded":"2024-09-21T06:05:23.179423+0000","last_fullsized":"2024-09-21T06:05:23.179423+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:54.462352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163008+0000","last_change":"2024-09-21T06:05:23.168940+0000","last_active":"2024-09-21T06:05:24.163008+0000","last_peered":"2024-09-21T06:05:24.163008+0000","last_clean":"2024-09-21T06:05:24.163008+0000","last_became_active":"2024-09-21T06:05:23.168668+0000","last_became_peered":"2024-09-21T06:05:23.168668+0000","last_unstale":"2024-09-21T06:05:24.163008+0000","last_undegraded":"2024-09-21T06:05:24.163008+0000","last_fullsized":"2024-09-21T06:05:24.163008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:11.257761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178923+0000","last_change":"2024-09-21T06:05:23.178633+0000","last_active":"2024-09-21T06:05:23.178923+0000","last_peered":"2024-09-21T06:05:23.178923+0000","last_clean":"2024-09-21T06:05:23.178923+0000","last_became_active":"2024-09-21T06:05:23.177726+0000","last_became_peered":"2024-09-21T06:05:23.177726+0000","last_unstale":"2024-09-21T06:05:23.178923+0000","last_undegraded":"2024-09-21T06:05:23.178923+0000","last_fullsized":"2024-09-21T06:05:23.178923+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:39.745012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395419+0000","last_change":"2024-09-21T06:05:23.180727+0000","last_active":"2024-09-21T06:05:24.395419+0000","last_peered":"2024-09-21T06:05:24.395419+0000","last_clean":"2024-09-21T06:05:24.395419+0000","last_became_active":"2024-09-21T06:05:23.178419+0000","last_became_peered":"2024-09-21T06:05:23.178419+0000","last_unstale":"2024-09-21T06:05:24.395419+0000","last_undegraded":"2024-09-21T06:05:24.395419+0000","last_fullsized":"2024-09-21T06:05:24.395419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:38.050670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394744+0000","last_change":"2024-09-21T06:05:23.182997+0000","last_active":"2024-09-21T06:05:24.394744+0000","last_peered":"2024-09-21T06:05:24.394744+0000","last_clean":"2024-09-21T06:05:24.394744+0000","last_became_active":"2024-09-21T06:05:23.182703+0000","last_became_peered":"2024-09-21T06:05:23.182703+0000","last_unstale":"2024-09-21T06:05:24.394744+0000","last_undegraded":"2024-09-21T06:05:24.394744+0000","last_fullsized":"2024-09-21T06:05:24.394744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:29.090773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395797+0000","last_change":"2024-09-21T06:05:23.184072+0000","last_active":"2024-09-21T06:05:24.395797+0000","last_peered":"2024-09-21T06:05:24.395797+0000","last_clean":"2024-09-21T06:05:24.395797+0000","last_became_active":"2024-09-21T06:05:23.183080+0000","last_became_peered":"2024-09-21T06:05:23.183080+0000","last_unstale":"2024-09-21T06:05:24.395797+0000","last_undegraded":"2024-09-21T06:05:24.395797+0000","last_fullsized":"2024-09-21T06:05:24.395797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:30.128103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394732+0000","last_change":"2024-09-21T06:05:23.172240+0000","last_active":"2024-09-21T06:05:24.394732+0000","last_peered":"2024-09-21T06:05:24.394732+0000","last_clean":"2024-09-21T06:05:24.394732+0000","last_became_active":"2024-09-21T06:05:23.171936+0000","last_became_peered":"2024-09-21T06:05:23.171936+0000","last_unstale":"2024-09-21T06:05:24.394732+0000","last_undegraded":"2024-09-21T06:05:24.394732+0000","last_fullsized":"2024-09-21T06:05:24.394732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:55.273216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176954+0000","last_change":"2024-09-21T06:05:23.176118+0000","last_active":"2024-09-21T06:05:23.176954+0000","last_peered":"2024-09-21T06:05:23.176954+0000","last_clean":"2024-09-21T06:05:23.176954+0000","last_became_active":"2024-09-21T06:05:23.174907+0000","last_became_peered":"2024-09-21T06:05:23.174907+0000","last_unstale":"2024-09-21T06:05:23.176954+0000","last_undegraded":"2024-09-21T06:05:23.176954+0000","last_fullsized":"2024-09-21T06:05:23.176954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:10.641459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182175+0000","last_change":"2024-09-21T06:05:23.181609+0000","last_active":"2024-09-21T06:05:23.182175+0000","last_peered":"2024-09-21T06:05:23.182175+0000","last_clean":"2024-09-21T06:05:23.182175+0000","last_became_active":"2024-09-21T06:05:23.180893+0000","last_became_peered":"2024-09-21T06:05:23.180893+0000","last_unstale":"2024-09-21T06:05:23.182175+0000","last_undegraded":"2024-09-21T06:05:23.182175+0000","last_fullsized":"2024-09-21T06:05:23.182175+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:42.253609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395940+0000","last_change":"2024-09-21T06:05:23.182299+0000","last_active":"2024-09-21T06:05:24.395940+0000","last_peered":"2024-09-21T06:05:24.395940+0000","last_clean":"2024-09-21T06:05:24.395940+0000","last_became_active":"2024-09-21T06:05:23.179344+0000","last_became_peered":"2024-09-21T06:05:23.179344+0000","last_unstale":"2024-09-21T06:05:24.395940+0000","last_undegraded":"2024-09-21T06:05:24.395940+0000","last_fullsized":"2024-09-21T06:05:24.395940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:13.248281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163117+0000","last_change":"2024-09-21T06:05:23.177669+0000","last_active":"2024-09-21T06:05:24.163117+0000","last_peered":"2024-09-21T06:05:24.163117+0000","last_clean":"2024-09-21T06:05:24.163117+0000","last_became_active":"2024-09-21T06:05:23.177367+0000","last_became_peered":"2024-09-21T06:05:23.177367+0000","last_unstale":"2024-09-21T06:05:24.163117+0000","last_undegraded":"2024-09-21T06:05:24.163117+0000","last_fullsized":"2024-09-21T06:05:24.163117+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:45.364399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.185065+0000","last_change":"2024-09-21T06:05:23.184610+0000","last_active":"2024-09-21T06:05:23.185065+0000","last_peered":"2024-09-21T06:05:23.185065+0000","last_clean":"2024-09-21T06:05:23.185065+0000","last_became_active":"2024-09-21T06:05:23.183704+0000","last_became_peered":"2024-09-21T06:05:23.183704+0000","last_unstale":"2024-09-21T06:05:23.185065+0000","last_undegraded":"2024-09-21T06:05:23.185065+0000","last_fullsized":"2024-09-21T06:05:23.185065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:18.037047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182113+0000","last_change":"2024-09-21T06:05:23.180762+0000","last_active":"2024-09-21T06:05:23.182113+0000","last_peered":"2024-09-21T06:05:23.182113+0000","last_clean":"2024-09-21T06:05:23.182113+0000","last_became_active":"2024-09-21T06:05:23.180024+0000","last_became_peered":"2024-09-21T06:05:23.180024+0000","last_unstale":"2024-09-21T06:05:23.182113+0000","last_undegraded":"2024-09-21T06:05:23.182113+0000","last_fullsized":"2024-09-21T06:05:23.182113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:25.561332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182888+0000","last_change":"2024-09-21T06:05:23.182578+0000","last_active":"2024-09-21T06:05:23.182888+0000","last_peered":"2024-09-21T06:05:23.182888+0000","last_clean":"2024-09-21T06:05:23.182888+0000","last_became_active":"2024-09-21T06:05:23.182289+0000","last_became_peered":"2024-09-21T06:05:23.182289+0000","last_unstale":"2024-09-21T06:05:23.182888+0000","last_undegraded":"2024-09-21T06:05:23.182888+0000","last_fullsized":"2024-09-21T06:05:23.182888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:23.888662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183898+0000","last_change":"2024-09-21T06:05:23.183476+0000","last_active":"2024-09-21T06:05:23.183898+0000","last_peered":"2024-09-21T06:05:23.183898+0000","last_clean":"2024-09-21T06:05:23.183898+0000","last_became_active":"2024-09-21T06:05:23.181879+0000","last_became_peered":"2024-09-21T06:05:23.181879+0000","last_unstale":"2024-09-21T06:05:23.183898+0000","last_undegraded":"2024-09-21T06:05:23.183898+0000","last_fullsized":"2024-09-21T06:05:23.183898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:43.884289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182205+0000","last_change":"2024-09-21T06:05:23.181928+0000","last_active":"2024-09-21T06:05:23.182205+0000","last_peered":"2024-09-21T06:05:23.182205+0000","last_clean":"2024-09-21T06:05:23.182205+0000","last_became_active":"2024-09-21T06:05:23.181662+0000","last_became_peered":"2024-09-21T06:05:23.181662+0000","last_unstale":"2024-09-21T06:05:23.182205+0000","last_undegraded":"2024-09-21T06:05:23.182205+0000","last_fullsized":"2024-09-21T06:05:23.182205+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:43.706045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163513+0000","last_change":"2024-09-21T06:05:23.182064+0000","last_active":"2024-09-21T06:05:24.163513+0000","last_peered":"2024-09-21T06:05:24.163513+0000","last_clean":"2024-09-21T06:05:24.163513+0000","last_became_active":"2024-09-21T06:05:23.181687+0000","last_became_peered":"2024-09-21T06:05:23.181687+0000","last_unstale":"2024-09-21T06:05:24.163513+0000","last_undegraded":"2024-09-21T06:05:24.163513+0000","last_fullsized":"2024-09-21T06:05:24.163513+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:20.840864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395318+0000","last_change":"2024-09-21T06:05:23.180956+0000","last_active":"2024-09-21T06:05:24.395318+0000","last_peered":"2024-09-21T06:05:24.395318+0000","last_clean":"2024-09-21T06:05:24.395318+0000","last_became_active":"2024-09-21T06:05:23.178132+0000","last_became_peered":"2024-09-21T06:05:23.178132+0000","last_unstale":"2024-09-21T06:05:24.395318+0000","last_undegraded":"2024-09-21T06:05:24.395318+0000","last_fullsized":"2024-09-21T06:05:24.395318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:21.668879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.175361+0000","last_change":"2024-09-21T06:05:23.174504+0000","last_active":"2024-09-21T06:05:23.175361+0000","last_peered":"2024-09-21T06:05:23.175361+0000","last_clean":"2024-09-21T06:05:23.175361+0000","last_became_active":"2024-09-21T06:05:23.172587+0000","last_became_peered":"2024-09-21T06:05:23.172587+0000","last_unstale":"2024-09-21T06:05:23.175361+0000","last_undegraded":"2024-09-21T06:05:23.175361+0000","last_fullsized":"2024-09-21T06:05:23.175361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:38.052825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.179095+0000","last_change":"2024-09-21T06:05:23.178892+0000","last_active":"2024-09-21T06:05:23.179095+0000","last_peered":"2024-09-21T06:05:23.179095+0000","last_clean":"2024-09-21T06:05:23.179095+0000","last_became_active":"2024-09-21T06:05:23.178628+0000","last_became_peered":"2024-09-21T06:05:23.178628+0000","last_unstale":"2024-09-21T06:05:23.179095+0000","last_undegraded":"2024-09-21T06:05:23.179095+0000","last_fullsized":"2024-09-21T06:05:23.179095+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:30.929140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180886+0000","last_change":"2024-09-21T06:05:23.180568+0000","last_active":"2024-09-21T06:05:23.180886+0000","last_peered":"2024-09-21T06:05:23.180886+0000","last_clean":"2024-09-21T06:05:23.180886+0000","last_became_active":"2024-09-21T06:05:23.180293+0000","last_became_peered":"2024-09-21T06:05:23.180293+0000","last_unstale":"2024-09-21T06:05:23.180886+0000","last_undegraded":"2024-09-21T06:05:23.180886+0000","last_fullsized":"2024-09-21T06:05:23.180886+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:42.899880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184429+0000","last_change":"2024-09-21T06:05:23.182707+0000","last_active":"2024-09-21T06:05:23.184429+0000","last_peered":"2024-09-21T06:05:23.184429+0000","last_clean":"2024-09-21T06:05:23.184429+0000","last_became_active":"2024-09-21T06:05:23.179748+0000","last_became_peered":"2024-09-21T06:05:23.179748+0000","last_unstale":"2024-09-21T06:05:23.184429+0000","last_undegraded":"2024-09-21T06:05:23.184429+0000","last_fullsized":"2024-09-21T06:05:23.184429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:10.873769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182086+0000","last_change":"2024-09-21T06:05:23.180421+0000","last_active":"2024-09-21T06:05:23.182086+0000","last_peered":"2024-09-21T06:05:23.182086+0000","last_clean":"2024-09-21T06:05:23.182086+0000","last_became_active":"2024-09-21T06:05:23.179656+0000","last_became_peered":"2024-09-21T06:05:23.179656+0000","last_unstale":"2024-09-21T06:05:23.182086+0000","last_undegraded":"2024-09-21T06:05:23.182086+0000","last_fullsized":"2024-09-21T06:05:23.182086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:51.649867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176908+0000","last_change":"2024-09-21T06:05:23.172039+0000","last_active":"2024-09-21T06:05:23.176908+0000","last_peered":"2024-09-21T06:05:23.176908+0000","last_clean":"2024-09-21T06:05:23.176908+0000","last_became_active":"2024-09-21T06:05:23.171702+0000","last_became_peered":"2024-09-21T06:05:23.171702+0000","last_unstale":"2024-09-21T06:05:23.176908+0000","last_undegraded":"2024-09-21T06:05:23.176908+0000","last_fullsized":"2024-09-21T06:05:23.176908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:19.477443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.179887+0000","last_change":"2024-09-21T06:05:23.179703+0000","last_active":"2024-09-21T06:05:23.179887+0000","last_peered":"2024-09-21T06:05:23.179887+0000","last_clean":"2024-09-21T06:05:23.179887+0000","last_became_active":"2024-09-21T06:05:23.179329+0000","last_became_peered":"2024-09-21T06:05:23.179329+0000","last_unstale":"2024-09-21T06:05:23.179887+0000","last_undegraded":"2024-09-21T06:05:23.179887+0000","last_fullsized":"2024-09-21T06:05:23.179887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:08.327941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178071+0000","last_change":"2024-09-21T06:05:23.177572+0000","last_active":"2024-09-21T06:05:23.178071+0000","last_peered":"2024-09-21T06:05:23.178071+0000","last_clean":"2024-09-21T06:05:23.178071+0000","last_became_active":"2024-09-21T06:05:23.177301+0000","last_became_peered":"2024-09-21T06:05:23.177301+0000","last_unstale":"2024-09-21T06:05:23.178071+0000","last_undegraded":"2024-09-21T06:05:23.178071+0000","last_fullsized":"2024-09-21T06:05:23.178071+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:42.233713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163723+0000","last_change":"2024-09-21T06:05:23.175668+0000","last_active":"2024-09-21T06:05:24.163723+0000","last_peered":"2024-09-21T06:05:24.163723+0000","last_clean":"2024-09-21T06:05:24.163723+0000","last_became_active":"2024-09-21T06:05:23.175112+0000","last_became_peered":"2024-09-21T06:05:23.175112+0000","last_unstale":"2024-09-21T06:05:24.163723+0000","last_undegraded":"2024-09-21T06:05:24.163723+0000","last_fullsized":"2024-09-21T06:05:24.163723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:11.239951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.174373+0000","last_change":"2024-09-21T06:05:23.174187+0000","last_active":"2024-09-21T06:05:23.174373+0000","last_peered":"2024-09-21T06:05:23.174373+0000","last_clean":"2024-09-21T06:05:23.174373+0000","last_became_active":"2024-09-21T06:05:23.173934+0000","last_became_peered":"2024-09-21T06:05:23.173934+0000","last_unstale":"2024-09-21T06:05:23.174373+0000","last_undegraded":"2024-09-21T06:05:23.174373+0000","last_fullsized":"2024-09-21T06:05:23.174373+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:38.329396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180819+0000","last_change":"2024-09-21T06:05:23.180081+0000","last_active":"2024-09-21T06:05:23.180819+0000","last_peered":"2024-09-21T06:05:23.180819+0000","last_clean":"2024-09-21T06:05:23.180819+0000","last_became_active":"2024-09-21T06:05:23.179703+0000","last_became_peered":"2024-09-21T06:05:23.179703+0000","last_unstale":"2024-09-21T06:05:23.180819+0000","last_undegraded":"2024-09-21T06:05:23.180819+0000","last_fullsized":"2024-09-21T06:05:23.180819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:25.102752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162901+0000","last_change":"2024-09-21T06:05:22.161066+0000","last_active":"2024-09-21T06:05:24.162901+0000","last_peered":"2024-09-21T06:05:24.162901+0000","last_clean":"2024-09-21T06:05:24.162901+0000","last_became_active":"2024-09-21T06:05:22.159651+0000","last_became_peered":"2024-09-21T06:05:22.159651+0000","last_unstale":"2024-09-21T06:05:24.162901+0000","last_undegraded":"2024-09-21T06:05:24.162901+0000","last_fullsized":"2024-09-21T06:05:24.162901+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:54.512010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178270+0000","last_change":"2024-09-21T06:05:23.176385+0000","last_active":"2024-09-21T06:05:23.178270+0000","last_peered":"2024-09-21T06:05:23.178270+0000","last_clean":"2024-09-21T06:05:23.178270+0000","last_became_active":"2024-09-21T06:05:23.176051+0000","last_became_peered":"2024-09-21T06:05:23.176051+0000","last_unstale":"2024-09-21T06:05:23.178270+0000","last_undegraded":"2024-09-21T06:05:23.178270+0000","last_fullsized":"2024-09-21T06:05:23.178270+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:10.054431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.194593+0000","last_change":"2024-09-21T06:05:22.160702+0000","last_active":"2024-09-21T06:05:23.194593+0000","last_peered":"2024-09-21T06:05:23.194593+0000","last_clean":"2024-09-21T06:05:23.194593+0000","last_became_active":"2024-09-21T06:05:22.160400+0000","last_became_peered":"2024-09-21T06:05:22.160400+0000","last_unstale":"2024-09-21T06:05:23.194593+0000","last_undegraded":"2024-09-21T06:05:23.194593+0000","last_fullsized":"2024-09-21T06:05:23.194593+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:56.823830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183952+0000","last_change":"2024-09-21T06:05:23.182827+0000","last_active":"2024-09-21T06:05:23.183952+0000","last_peered":"2024-09-21T06:05:23.183952+0000","last_clean":"2024-09-21T06:05:23.183952+0000","last_became_active":"2024-09-21T06:05:23.182397+0000","last_became_peered":"2024-09-21T06:05:23.182397+0000","last_unstale":"2024-09-21T06:05:23.183952+0000","last_undegraded":"2024-09-21T06:05:23.183952+0000","last_fullsized":"2024-09-21T06:05:23.183952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:55.629878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.193889+0000","last_change":"2024-09-21T06:05:22.148534+0000","last_active":"2024-09-21T06:05:23.193889+0000","last_peered":"2024-09-21T06:05:23.193889+0000","last_clean":"2024-09-21T06:05:23.193889+0000","last_became_active":"2024-09-21T06:05:22.148257+0000","last_became_peered":"2024-09-21T06:05:22.148257+0000","last_unstale":"2024-09-21T06:05:23.193889+0000","last_undegraded":"2024-09-21T06:05:23.193889+0000","last_fullsized":"2024-09-21T06:05:23.193889+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:02.726642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.182738+0000","last_change":"2024-09-21T06:05:23.181602+0000","last_active":"2024-09-21T06:05:23.182738+0000","last_peered":"2024-09-21T06:05:23.182738+0000","last_clean":"2024-09-21T06:05:23.182738+0000","last_became_active":"2024-09-21T06:05:23.181202+0000","last_became_peered":"2024-09-21T06:05:23.181202+0000","last_unstale":"2024-09-21T06:05:23.182738+0000","last_undegraded":"2024-09-21T06:05:23.182738+0000","last_fullsized":"2024-09-21T06:05:23.182738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:57.824332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.192871+0000","last_change":"2024-09-21T06:05:22.155911+0000","last_active":"2024-09-21T06:05:23.192871+0000","last_peered":"2024-09-21T06:05:23.192871+0000","last_clean":"2024-09-21T06:05:23.192871+0000","last_became_active":"2024-09-21T06:05:22.155640+0000","last_became_peered":"2024-09-21T06:05:22.155640+0000","last_unstale":"2024-09-21T06:05:23.192871+0000","last_undegraded":"2024-09-21T06:05:23.192871+0000","last_fullsized":"2024-09-21T06:05:23.192871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:23.237568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.177575+0000","last_change":"2024-09-21T06:05:23.177240+0000","last_active":"2024-09-21T06:05:23.177575+0000","last_peered":"2024-09-21T06:05:23.177575+0000","last_clean":"2024-09-21T06:05:23.177575+0000","last_became_active":"2024-09-21T06:05:23.176956+0000","last_became_peered":"2024-09-21T06:05:23.176956+0000","last_unstale":"2024-09-21T06:05:23.177575+0000","last_undegraded":"2024-09-21T06:05:23.177575+0000","last_fullsized":"2024-09-21T06:05:23.177575+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:23.240874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163062+0000","last_change":"2024-09-21T06:05:22.155355+0000","last_active":"2024-09-21T06:05:24.163062+0000","last_peered":"2024-09-21T06:05:24.163062+0000","last_clean":"2024-09-21T06:05:24.163062+0000","last_became_active":"2024-09-21T06:05:22.154719+0000","last_became_peered":"2024-09-21T06:05:22.154719+0000","last_unstale":"2024-09-21T06:05:24.163062+0000","last_undegraded":"2024-09-21T06:05:24.163062+0000","last_fullsized":"2024-09-21T06:05:24.163062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:27.788932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395572+0000","last_change":"2024-09-21T06:05:23.181542+0000","last_active":"2024-09-21T06:05:24.395572+0000","last_peered":"2024-09-21T06:05:24.395572+0000","last_clean":"2024-09-21T06:05:24.395572+0000","last_became_active":"2024-09-21T06:05:23.178500+0000","last_became_peered":"2024-09-21T06:05:23.178500+0000","last_unstale":"2024-09-21T06:05:24.395572+0000","last_undegraded":"2024-09-21T06:05:24.395572+0000","last_fullsized":"2024-09-21T06:05:24.395572+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:20.824128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.195034+0000","last_change":"2024-09-21T06:05:22.155745+0000","last_active":"2024-09-21T06:05:23.195034+0000","last_peered":"2024-09-21T06:05:23.195034+0000","last_clean":"2024-09-21T06:05:23.195034+0000","last_became_active":"2024-09-21T06:05:22.155476+0000","last_became_peered":"2024-09-21T06:05:22.155476+0000","last_unstale":"2024-09-21T06:05:23.195034+0000","last_undegraded":"2024-09-21T06:05:23.195034+0000","last_fullsized":"2024-09-21T06:05:23.195034+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:00.328840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395913+0000","last_change":"2024-09-21T06:05:23.183657+0000","last_active":"2024-09-21T06:05:24.395913+0000","last_peered":"2024-09-21T06:05:24.395913+0000","last_clean":"2024-09-21T06:05:24.395913+0000","last_became_active":"2024-09-21T06:05:23.182630+0000","last_became_peered":"2024-09-21T06:05:23.182630+0000","last_unstale":"2024-09-21T06:05:24.395913+0000","last_undegraded":"2024-09-21T06:05:24.395913+0000","last_fullsized":"2024-09-21T06:05:24.395913+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:24.907986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.172238+0000","last_change":"2024-09-21T06:05:22.149074+0000","last_active":"2024-09-21T06:05:23.172238+0000","last_peered":"2024-09-21T06:05:23.172238+0000","last_clean":"2024-09-21T06:05:23.172238+0000","last_became_active":"2024-09-21T06:05:22.148513+0000","last_became_peered":"2024-09-21T06:05:22.148513+0000","last_unstale":"2024-09-21T06:05:23.172238+0000","last_undegraded":"2024-09-21T06:05:23.172238+0000","last_fullsized":"2024-09-21T06:05:23.172238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:18.863349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.178429+0000","last_change":"2024-09-21T06:05:23.178219+0000","last_active":"2024-09-21T06:05:23.178429+0000","last_peered":"2024-09-21T06:05:23.178429+0000","last_clean":"2024-09-21T06:05:23.178429+0000","last_became_active":"2024-09-21T06:05:23.177913+0000","last_became_peered":"2024-09-21T06:05:23.177913+0000","last_unstale":"2024-09-21T06:05:23.178429+0000","last_undegraded":"2024-09-21T06:05:23.178429+0000","last_fullsized":"2024-09-21T06:05:23.178429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:47.004666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396398+0000","last_change":"2024-09-21T06:05:22.160764+0000","last_active":"2024-09-21T06:05:24.396398+0000","last_peered":"2024-09-21T06:05:24.396398+0000","last_clean":"2024-09-21T06:05:24.396398+0000","last_became_active":"2024-09-21T06:05:22.160028+0000","last_became_peered":"2024-09-21T06:05:22.160028+0000","last_unstale":"2024-09-21T06:05:24.396398+0000","last_undegraded":"2024-09-21T06:05:24.396398+0000","last_fullsized":"2024-09-21T06:05:24.396398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:56.899411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183032+0000","last_change":"2024-09-21T06:05:23.182717+0000","last_active":"2024-09-21T06:05:23.183032+0000","last_peered":"2024-09-21T06:05:23.183032+0000","last_clean":"2024-09-21T06:05:23.183032+0000","last_became_active":"2024-09-21T06:05:23.182426+0000","last_became_peered":"2024-09-21T06:05:23.182426+0000","last_unstale":"2024-09-21T06:05:23.183032+0000","last_undegraded":"2024-09-21T06:05:23.183032+0000","last_fullsized":"2024-09-21T06:05:23.183032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:59.023508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.170504+0000","last_change":"2024-09-21T06:05:22.158358+0000","last_active":"2024-09-21T06:05:23.170504+0000","last_peered":"2024-09-21T06:05:23.170504+0000","last_clean":"2024-09-21T06:05:23.170504+0000","last_became_active":"2024-09-21T06:05:22.158054+0000","last_became_peered":"2024-09-21T06:05:22.158054+0000","last_unstale":"2024-09-21T06:05:23.170504+0000","last_undegraded":"2024-09-21T06:05:23.170504+0000","last_fullsized":"2024-09-21T06:05:23.170504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:27.146393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176089+0000","last_change":"2024-09-21T06:05:23.175856+0000","last_active":"2024-09-21T06:05:23.176089+0000","last_peered":"2024-09-21T06:05:23.176089+0000","last_clean":"2024-09-21T06:05:23.176089+0000","last_became_active":"2024-09-21T06:05:23.172753+0000","last_became_peered":"2024-09-21T06:05:23.172753+0000","last_unstale":"2024-09-21T06:05:23.176089+0000","last_undegraded":"2024-09-21T06:05:23.176089+0000","last_fullsized":"2024-09-21T06:05:23.176089+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:04.144406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395758+0000","last_change":"2024-09-21T06:05:22.158847+0000","last_active":"2024-09-21T06:05:24.395758+0000","last_peered":"2024-09-21T06:05:24.395758+0000","last_clean":"2024-09-21T06:05:24.395758+0000","last_became_active":"2024-09-21T06:05:22.158235+0000","last_became_peered":"2024-09-21T06:05:22.158235+0000","last_unstale":"2024-09-21T06:05:24.395758+0000","last_undegraded":"2024-09-21T06:05:24.395758+0000","last_fullsized":"2024-09-21T06:05:24.395758+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:52.465597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163187+0000","last_change":"2024-09-21T06:05:23.179526+0000","last_active":"2024-09-21T06:05:24.163187+0000","last_peered":"2024-09-21T06:05:24.163187+0000","last_clean":"2024-09-21T06:05:24.163187+0000","last_became_active":"2024-09-21T06:05:23.176567+0000","last_became_peered":"2024-09-21T06:05:23.176567+0000","last_unstale":"2024-09-21T06:05:24.163187+0000","last_undegraded":"2024-09-21T06:05:24.163187+0000","last_fullsized":"2024-09-21T06:05:24.163187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:54.497237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.193432+0000","last_change":"2024-09-21T06:05:22.160892+0000","last_active":"2024-09-21T06:05:23.193432+0000","last_peered":"2024-09-21T06:05:23.193432+0000","last_clean":"2024-09-21T06:05:23.193432+0000","last_became_active":"2024-09-21T06:05:22.160615+0000","last_became_peered":"2024-09-21T06:05:22.160615+0000","last_unstale":"2024-09-21T06:05:23.193432+0000","last_undegraded":"2024-09-21T06:05:23.193432+0000","last_fullsized":"2024-09-21T06:05:23.193432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:02.817509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176404+0000","last_change":"2024-09-21T06:05:23.176147+0000","last_active":"2024-09-21T06:05:23.176404+0000","last_peered":"2024-09-21T06:05:23.176404+0000","last_clean":"2024-09-21T06:05:23.176404+0000","last_became_active":"2024-09-21T06:05:23.172688+0000","last_became_peered":"2024-09-21T06:05:23.172688+0000","last_unstale":"2024-09-21T06:05:23.176404+0000","last_undegraded":"2024-09-21T06:05:23.176404+0000","last_fullsized":"2024-09-21T06:05:23.176404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:45.107863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.197516+0000","last_change":"2024-09-21T06:05:22.159403+0000","last_active":"2024-09-21T06:05:23.197516+0000","last_peered":"2024-09-21T06:05:23.197516+0000","last_clean":"2024-09-21T06:05:23.197516+0000","last_became_active":"2024-09-21T06:05:22.159041+0000","last_became_peered":"2024-09-21T06:05:22.159041+0000","last_unstale":"2024-09-21T06:05:23.197516+0000","last_undegraded":"2024-09-21T06:05:23.197516+0000","last_fullsized":"2024-09-21T06:05:23.197516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:30.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184507+0000","last_change":"2024-09-21T06:05:23.184302+0000","last_active":"2024-09-21T06:05:23.184507+0000","last_peered":"2024-09-21T06:05:23.184507+0000","last_clean":"2024-09-21T06:05:23.184507+0000","last_became_active":"2024-09-21T06:05:23.183297+0000","last_became_peered":"2024-09-21T06:05:23.183297+0000","last_unstale":"2024-09-21T06:05:23.184507+0000","last_undegraded":"2024-09-21T06:05:23.184507+0000","last_fullsized":"2024-09-21T06:05:23.184507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:21.085566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163245+0000","last_change":"2024-09-21T06:05:22.161271+0000","last_active":"2024-09-21T06:05:24.163245+0000","last_peered":"2024-09-21T06:05:24.163245+0000","last_clean":"2024-09-21T06:05:24.163245+0000","last_became_active":"2024-09-21T06:05:22.161013+0000","last_became_peered":"2024-09-21T06:05:22.161013+0000","last_unstale":"2024-09-21T06:05:24.163245+0000","last_undegraded":"2024-09-21T06:05:24.163245+0000","last_fullsized":"2024-09-21T06:05:24.163245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:54.419000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396020+0000","last_change":"2024-09-21T06:05:23.166865+0000","last_active":"2024-09-21T06:05:24.396020+0000","last_peered":"2024-09-21T06:05:24.396020+0000","last_clean":"2024-09-21T06:05:24.396020+0000","last_became_active":"2024-09-21T06:05:23.166687+0000","last_became_peered":"2024-09-21T06:05:23.166687+0000","last_unstale":"2024-09-21T06:05:24.396020+0000","last_undegraded":"2024-09-21T06:05:24.396020+0000","last_fullsized":"2024-09-21T06:05:24.396020+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.040511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.166765+0000","last_change":"2024-09-21T06:05:22.156905+0000","last_active":"2024-09-21T06:05:23.166765+0000","last_peered":"2024-09-21T06:05:23.166765+0000","last_clean":"2024-09-21T06:05:23.166765+0000","last_became_active":"2024-09-21T06:05:22.156501+0000","last_became_peered":"2024-09-21T06:05:22.156501+0000","last_unstale":"2024-09-21T06:05:23.166765+0000","last_undegraded":"2024-09-21T06:05:23.166765+0000","last_fullsized":"2024-09-21T06:05:23.166765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:12.528859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162770+0000","last_change":"2024-09-21T06:05:23.173352+0000","last_active":"2024-09-21T06:05:24.162770+0000","last_peered":"2024-09-21T06:05:24.162770+0000","last_clean":"2024-09-21T06:05:24.162770+0000","last_became_active":"2024-09-21T06:05:23.171078+0000","last_became_peered":"2024-09-21T06:05:23.171078+0000","last_unstale":"2024-09-21T06:05:24.162770+0000","last_undegraded":"2024-09-21T06:05:24.162770+0000","last_fullsized":"2024-09-21T06:05:24.162770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:00.603743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163142+0000","last_change":"2024-09-21T06:05:22.161133+0000","last_active":"2024-09-21T06:05:24.163142+0000","last_peered":"2024-09-21T06:05:24.163142+0000","last_clean":"2024-09-21T06:05:24.163142+0000","last_became_active":"2024-09-21T06:05:22.160875+0000","last_became_peered":"2024-09-21T06:05:22.160875+0000","last_unstale":"2024-09-21T06:05:24.163142+0000","last_undegraded":"2024-09-21T06:05:24.163142+0000","last_fullsized":"2024-09-21T06:05:24.163142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:55.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180981+0000","last_change":"2024-09-21T06:05:23.180713+0000","last_active":"2024-09-21T06:05:23.180981+0000","last_peered":"2024-09-21T06:05:23.180981+0000","last_clean":"2024-09-21T06:05:23.180981+0000","last_became_active":"2024-09-21T06:05:23.180114+0000","last_became_peered":"2024-09-21T06:05:23.180114+0000","last_unstale":"2024-09-21T06:05:23.180981+0000","last_undegraded":"2024-09-21T06:05:23.180981+0000","last_fullsized":"2024-09-21T06:05:23.180981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:43.032916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395740+0000","last_change":"2024-09-21T06:05:22.153182+0000","last_active":"2024-09-21T06:05:24.395740+0000","last_peered":"2024-09-21T06:05:24.395740+0000","last_clean":"2024-09-21T06:05:24.395740+0000","last_became_active":"2024-09-21T06:05:22.152605+0000","last_became_peered":"2024-09-21T06:05:22.152605+0000","last_unstale":"2024-09-21T06:05:24.395740+0000","last_undegraded":"2024-09-21T06:05:24.395740+0000","last_fullsized":"2024-09-21T06:05:24.395740+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:40.628078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.174077+0000","last_change":"2024-09-21T06:05:23.173881+0000","last_active":"2024-09-21T06:05:23.174077+0000","last_peered":"2024-09-21T06:05:23.174077+0000","last_clean":"2024-09-21T06:05:23.174077+0000","last_became_active":"2024-09-21T06:05:23.173624+0000","last_became_peered":"2024-09-21T06:05:23.173624+0000","last_unstale":"2024-09-21T06:05:23.174077+0000","last_undegraded":"2024-09-21T06:05:23.174077+0000","last_fullsized":"2024-09-21T06:05:23.174077+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:54.162338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.195532+0000","last_change":"2024-09-21T06:05:22.155349+0000","last_active":"2024-09-21T06:05:23.195532+0000","last_peered":"2024-09-21T06:05:23.195532+0000","last_clean":"2024-09-21T06:05:23.195532+0000","last_became_active":"2024-09-21T06:05:22.155105+0000","last_became_peered":"2024-09-21T06:05:22.155105+0000","last_unstale":"2024-09-21T06:05:23.195532+0000","last_undegraded":"2024-09-21T06:05:23.195532+0000","last_fullsized":"2024-09-21T06:05:23.195532+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:04.424319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.394986+0000","last_change":"2024-09-21T06:05:23.166232+0000","last_active":"2024-09-21T06:05:24.394986+0000","last_peered":"2024-09-21T06:05:24.394986+0000","last_clean":"2024-09-21T06:05:24.394986+0000","last_became_active":"2024-09-21T06:05:23.166031+0000","last_became_peered":"2024-09-21T06:05:23.166031+0000","last_unstale":"2024-09-21T06:05:24.394986+0000","last_undegraded":"2024-09-21T06:05:24.394986+0000","last_fullsized":"2024-09-21T06:05:24.394986+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:44.475905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.195271+0000","last_change":"2024-09-21T06:05:22.162362+0000","last_active":"2024-09-21T06:05:23.195271+0000","last_peered":"2024-09-21T06:05:23.195271+0000","last_clean":"2024-09-21T06:05:23.195271+0000","last_became_active":"2024-09-21T06:05:22.162032+0000","last_became_peered":"2024-09-21T06:05:22.162032+0000","last_unstale":"2024-09-21T06:05:23.195271+0000","last_undegraded":"2024-09-21T06:05:23.195271+0000","last_fullsized":"2024-09-21T06:05:23.195271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.267437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.183871+0000","last_change":"2024-09-21T06:05:23.183037+0000","last_active":"2024-09-21T06:05:23.183871+0000","last_peered":"2024-09-21T06:05:23.183871+0000","last_clean":"2024-09-21T06:05:23.183871+0000","last_became_active":"2024-09-21T06:05:23.182766+0000","last_became_peered":"2024-09-21T06:05:23.182766+0000","last_unstale":"2024-09-21T06:05:23.183871+0000","last_undegraded":"2024-09-21T06:05:23.183871+0000","last_fullsized":"2024-09-21T06:05:23.183871+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:09.044203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.192903+0000","last_change":"2024-09-21T06:05:22.148803+0000","last_active":"2024-09-21T06:05:23.192903+0000","last_peered":"2024-09-21T06:05:23.192903+0000","last_clean":"2024-09-21T06:05:23.192903+0000","last_became_active":"2024-09-21T06:05:22.148522+0000","last_became_peered":"2024-09-21T06:05:22.148522+0000","last_unstale":"2024-09-21T06:05:23.192903+0000","last_undegraded":"2024-09-21T06:05:23.192903+0000","last_fullsized":"2024-09-21T06:05:23.192903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:39.939472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180912+0000","last_change":"2024-09-21T06:05:23.180621+0000","last_active":"2024-09-21T06:05:23.180912+0000","last_peered":"2024-09-21T06:05:23.180912+0000","last_clean":"2024-09-21T06:05:23.180912+0000","last_became_active":"2024-09-21T06:05:23.179605+0000","last_became_peered":"2024-09-21T06:05:23.179605+0000","last_unstale":"2024-09-21T06:05:23.180912+0000","last_undegraded":"2024-09-21T06:05:23.180912+0000","last_fullsized":"2024-09-21T06:05:23.180912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:46.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163204+0000","last_change":"2024-09-21T06:05:22.155650+0000","last_active":"2024-09-21T06:05:24.163204+0000","last_peered":"2024-09-21T06:05:24.163204+0000","last_clean":"2024-09-21T06:05:24.163204+0000","last_became_active":"2024-09-21T06:05:22.155079+0000","last_became_peered":"2024-09-21T06:05:22.155079+0000","last_unstale":"2024-09-21T06:05:24.163204+0000","last_undegraded":"2024-09-21T06:05:24.163204+0000","last_fullsized":"2024-09-21T06:05:24.163204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:23.632953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162933+0000","last_change":"2024-09-21T06:05:23.179227+0000","last_active":"2024-09-21T06:05:24.162933+0000","last_peered":"2024-09-21T06:05:24.162933+0000","last_clean":"2024-09-21T06:05:24.162933+0000","last_became_active":"2024-09-21T06:05:23.176207+0000","last_became_peered":"2024-09-21T06:05:23.176207+0000","last_unstale":"2024-09-21T06:05:24.162933+0000","last_undegraded":"2024-09-21T06:05:24.162933+0000","last_fullsized":"2024-09-21T06:05:24.162933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:17.253113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163089+0000","last_change":"2024-09-21T06:05:22.154655+0000","last_active":"2024-09-21T06:05:24.163089+0000","last_peered":"2024-09-21T06:05:24.163089+0000","last_clean":"2024-09-21T06:05:24.163089+0000","last_became_active":"2024-09-21T06:05:22.154287+0000","last_became_peered":"2024-09-21T06:05:22.154287+0000","last_unstale":"2024-09-21T06:05:24.163089+0000","last_undegraded":"2024-09-21T06:05:24.163089+0000","last_fullsized":"2024-09-21T06:05:24.163089+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:29.024409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.174429+0000","last_change":"2024-09-21T06:05:23.172936+0000","last_active":"2024-09-21T06:05:23.174429+0000","last_peered":"2024-09-21T06:05:23.174429+0000","last_clean":"2024-09-21T06:05:23.174429+0000","last_became_active":"2024-09-21T06:05:23.172668+0000","last_became_peered":"2024-09-21T06:05:23.172668+0000","last_unstale":"2024-09-21T06:05:23.174429+0000","last_undegraded":"2024-09-21T06:05:23.174429+0000","last_fullsized":"2024-09-21T06:05:23.174429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:19.790881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.176629+0000","last_change":"2024-09-21T06:05:22.155723+0000","last_active":"2024-09-21T06:05:23.176629+0000","last_peered":"2024-09-21T06:05:23.176629+0000","last_clean":"2024-09-21T06:05:23.176629+0000","last_became_active":"2024-09-21T06:05:22.155451+0000","last_became_peered":"2024-09-21T06:05:22.155451+0000","last_unstale":"2024-09-21T06:05:23.176629+0000","last_undegraded":"2024-09-21T06:05:23.176629+0000","last_fullsized":"2024-09-21T06:05:23.176629+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:42.310635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.180047+0000","last_change":"2024-09-21T06:05:23.178860+0000","last_active":"2024-09-21T06:05:23.180047+0000","last_peered":"2024-09-21T06:05:23.180047+0000","last_clean":"2024-09-21T06:05:23.180047+0000","last_became_active":"2024-09-21T06:05:23.178608+0000","last_became_peered":"2024-09-21T06:05:23.178608+0000","last_unstale":"2024-09-21T06:05:23.180047+0000","last_undegraded":"2024-09-21T06:05:23.180047+0000","last_fullsized":"2024-09-21T06:05:23.180047+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:29.342707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396446+0000","last_change":"2024-09-21T06:05:22.157619+0000","last_active":"2024-09-21T06:05:24.396446+0000","last_peered":"2024-09-21T06:05:24.396446+0000","last_clean":"2024-09-21T06:05:24.396446+0000","last_became_active":"2024-09-21T06:05:22.157188+0000","last_became_peered":"2024-09-21T06:05:22.157188+0000","last_unstale":"2024-09-21T06:05:24.396446+0000","last_undegraded":"2024-09-21T06:05:24.396446+0000","last_fullsized":"2024-09-21T06:05:24.396446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:16.395803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396129+0000","last_change":"2024-09-21T06:05:23.172652+0000","last_active":"2024-09-21T06:05:24.396129+0000","last_peered":"2024-09-21T06:05:24.396129+0000","last_clean":"2024-09-21T06:05:24.396129+0000","last_became_active":"2024-09-21T06:05:23.171390+0000","last_became_peered":"2024-09-21T06:05:23.171390+0000","last_unstale":"2024-09-21T06:05:24.396129+0000","last_undegraded":"2024-09-21T06:05:24.396129+0000","last_fullsized":"2024-09-21T06:05:24.396129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:22.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.166996+0000","last_change":"2024-09-21T06:05:22.161267+0000","last_active":"2024-09-21T06:05:23.166996+0000","last_peered":"2024-09-21T06:05:23.166996+0000","last_clean":"2024-09-21T06:05:23.166996+0000","last_became_active":"2024-09-21T06:05:22.160668+0000","last_became_peered":"2024-09-21T06:05:22.160668+0000","last_unstale":"2024-09-21T06:05:23.166996+0000","last_undegraded":"2024-09-21T06:05:23.166996+0000","last_fullsized":"2024-09-21T06:05:23.166996+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:09.928138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.184732+0000","last_change":"2024-09-21T06:05:23.184527+0000","last_active":"2024-09-21T06:05:23.184732+0000","last_peered":"2024-09-21T06:05:23.184732+0000","last_clean":"2024-09-21T06:05:23.184732+0000","last_became_active":"2024-09-21T06:05:23.184228+0000","last_became_peered":"2024-09-21T06:05:23.184228+0000","last_unstale":"2024-09-21T06:05:23.184732+0000","last_undegraded":"2024-09-21T06:05:23.184732+0000","last_fullsized":"2024-09-21T06:05:23.184732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:17.265094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.188330+0000","last_change":"2024-09-21T06:05:22.160657+0000","last_active":"2024-09-21T06:05:24.188330+0000","last_peered":"2024-09-21T06:05:24.188330+0000","last_clean":"2024-09-21T06:05:24.188330+0000","last_became_active":"2024-09-21T06:05:22.159299+0000","last_became_peered":"2024-09-21T06:05:22.159299+0000","last_unstale":"2024-09-21T06:05:24.188330+0000","last_undegraded":"2024-09-21T06:05:24.188330+0000","last_fullsized":"2024-09-21T06:05:24.188330+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:11.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.396233+0000","last_change":"2024-09-21T06:05:23.183331+0000","last_active":"2024-09-21T06:05:24.396233+0000","last_peered":"2024-09-21T06:05:24.396233+0000","last_clean":"2024-09-21T06:05:24.396233+0000","last_became_active":"2024-09-21T06:05:23.181905+0000","last_became_peered":"2024-09-21T06:05:23.181905+0000","last_unstale":"2024-09-21T06:05:24.396233+0000","last_undegraded":"2024-09-21T06:05:24.396233+0000","last_fullsized":"2024-09-21T06:05:24.396233+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:50.163151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.165003+0000","last_change":"2024-09-21T06:05:22.160082+0000","last_active":"2024-09-21T06:05:23.165003+0000","last_peered":"2024-09-21T06:05:23.165003+0000","last_clean":"2024-09-21T06:05:23.165003+0000","last_became_active":"2024-09-21T06:05:22.159736+0000","last_became_peered":"2024-09-21T06:05:22.159736+0000","last_unstale":"2024-09-21T06:05:23.165003+0000","last_undegraded":"2024-09-21T06:05:23.165003+0000","last_fullsized":"2024-09-21T06:05:23.165003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:47.501589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.175817+0000","last_change":"2024-09-21T06:05:23.175578+0000","last_active":"2024-09-21T06:05:23.175817+0000","last_peered":"2024-09-21T06:05:23.175817+0000","last_clean":"2024-09-21T06:05:23.175817+0000","last_became_active":"2024-09-21T06:05:23.172505+0000","last_became_peered":"2024-09-21T06:05:23.172505+0000","last_unstale":"2024-09-21T06:05:23.175817+0000","last_undegraded":"2024-09-21T06:05:23.175817+0000","last_fullsized":"2024-09-21T06:05:23.175817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:19.268516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.170613+0000","last_change":"2024-09-21T06:05:22.149418+0000","last_active":"2024-09-21T06:05:23.170613+0000","last_peered":"2024-09-21T06:05:23.170613+0000","last_clean":"2024-09-21T06:05:23.170613+0000","last_became_active":"2024-09-21T06:05:22.149160+0000","last_became_peered":"2024-09-21T06:05:22.149160+0000","last_unstale":"2024-09-21T06:05:23.170613+0000","last_undegraded":"2024-09-21T06:05:23.170613+0000","last_fullsized":"2024-09-21T06:05:23.170613+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:23.556124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.162859+0000","last_change":"2024-09-21T06:05:23.180604+0000","last_active":"2024-09-21T06:05:24.162859+0000","last_peered":"2024-09-21T06:05:24.162859+0000","last_clean":"2024-09-21T06:05:24.162859+0000","last_became_active":"2024-09-21T06:05:23.180162+0000","last_became_peered":"2024-09-21T06:05:23.180162+0000","last_unstale":"2024-09-21T06:05:24.162859+0000","last_undegraded":"2024-09-21T06:05:24.162859+0000","last_fullsized":"2024-09-21T06:05:24.162859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:49.238204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.167234+0000","last_change":"2024-09-21T06:05:22.160961+0000","last_active":"2024-09-21T06:05:23.167234+0000","last_peered":"2024-09-21T06:05:23.167234+0000","last_clean":"2024-09-21T06:05:23.167234+0000","last_became_active":"2024-09-21T06:05:22.160287+0000","last_became_peered":"2024-09-21T06:05:22.160287+0000","last_unstale":"2024-09-21T06:05:23.167234+0000","last_undegraded":"2024-09-21T06:05:23.167234+0000","last_fullsized":"2024-09-21T06:05:23.167234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:23.115747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.163916+0000","last_change":"2024-09-21T06:05:23.175371+0000","last_active":"2024-09-21T06:05:24.163916+0000","last_peered":"2024-09-21T06:05:24.163916+0000","last_clean":"2024-09-21T06:05:24.163916+0000","last_became_active":"2024-09-21T06:05:23.174768+0000","last_became_peered":"2024-09-21T06:05:23.174768+0000","last_unstale":"2024-09-21T06:05:24.163916+0000","last_undegraded":"2024-09-21T06:05:24.163916+0000","last_fullsized":"2024-09-21T06:05:24.163916+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:15.908458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.169865+0000","last_change":"2024-09-21T06:05:22.162467+0000","last_active":"2024-09-21T06:05:23.169865+0000","last_peered":"2024-09-21T06:05:23.169865+0000","last_clean":"2024-09-21T06:05:23.169865+0000","last_became_active":"2024-09-21T06:05:22.161862+0000","last_became_peered":"2024-09-21T06:05:22.161862+0000","last_unstale":"2024-09-21T06:05:23.169865+0000","last_undegraded":"2024-09-21T06:05:23.169865+0000","last_fullsized":"2024-09-21T06:05:23.169865+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:44.210357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.177828+0000","last_change":"2024-09-21T06:05:23.177425+0000","last_active":"2024-09-21T06:05:23.177828+0000","last_peered":"2024-09-21T06:05:23.177828+0000","last_clean":"2024-09-21T06:05:23.177828+0000","last_became_active":"2024-09-21T06:05:23.177150+0000","last_became_peered":"2024-09-21T06:05:23.177150+0000","last_unstale":"2024-09-21T06:05:23.177828+0000","last_undegraded":"2024-09-21T06:05:23.177828+0000","last_fullsized":"2024-09-21T06:05:23.177828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:36.199861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.168927+0000","last_change":"2024-09-21T06:05:22.158005+0000","last_active":"2024-09-21T06:05:23.168927+0000","last_peered":"2024-09-21T06:05:23.168927+0000","last_clean":"2024-09-21T06:05:23.168927+0000","last_became_active":"2024-09-21T06:05:22.157723+0000","last_became_peered":"2024-09-21T06:05:22.157723+0000","last_unstale":"2024-09-21T06:05:23.168927+0000","last_undegraded":"2024-09-21T06:05:23.168927+0000","last_fullsized":"2024-09-21T06:05:23.168927+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:36.268323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.185634+0000","last_change":"2024-09-21T06:05:23.185385+0000","last_active":"2024-09-21T06:05:23.185634+0000","last_peered":"2024-09-21T06:05:23.185634+0000","last_clean":"2024-09-21T06:05:23.185634+0000","last_became_active":"2024-09-21T06:05:23.185011+0000","last_became_peered":"2024-09-21T06:05:23.185011+0000","last_unstale":"2024-09-21T06:05:23.185634+0000","last_undegraded":"2024-09-21T06:05:23.185634+0000","last_fullsized":"2024-09-21T06:05:23.185634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:05.382056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395105+0000","last_change":"2024-09-21T06:05:22.156821+0000","last_active":"2024-09-21T06:05:24.395105+0000","last_peered":"2024-09-21T06:05:24.395105+0000","last_clean":"2024-09-21T06:05:24.395105+0000","last_became_active":"2024-09-21T06:05:22.156576+0000","last_became_peered":"2024-09-21T06:05:22.156576+0000","last_unstale":"2024-09-21T06:05:24.395105+0000","last_undegraded":"2024-09-21T06:05:24.395105+0000","last_fullsized":"2024-09-21T06:05:24.395105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:25.258770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T06:05:24.395635+0000","last_change":"2024-09-21T06:05:23.166861+0000","last_active":"2024-09-21T06:05:24.395635+0000","last_peered":"2024-09-21T06:05:24.395635+0000","last_clean":"2024-09-21T06:05:24.395635+0000","last_became_active":"2024-09-21T06:05:23.166683+0000","last_became_peered":"2024-09-21T06:05:23.166683+0000","last_unstale":"2024-09-21T06:05:24.395635+0000","last_undegraded":"2024-09-21T06:05:24.395635+0000","last_fullsized":"2024-09-21T06:05:24.395635+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:22.139828+0000","last_clean_scrub_stamp":"2024-09-21T06:05:22.139828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:05.787787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.193570+0000","last_change":"2024-09-21T06:05:22.150547+0000","last_active":"2024-09-21T06:05:23.193570+0000","last_peered":"2024-09-21T06:05:23.193570+0000","last_clean":"2024-09-21T06:05:23.193570+0000","last_became_active":"2024-09-21T06:05:22.150265+0000","last_became_peered":"2024-09-21T06:05:22.150265+0000","last_unstale":"2024-09-21T06:05:23.193570+0000","last_undegraded":"2024-09-21T06:05:23.193570+0000","last_fullsized":"2024-09-21T06:05:23.193570+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:21.133641+0000","last_clean_scrub_stamp":"2024-09-21T06:05:21.133641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:35.041543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T06:05:23.165086+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:05:23.165086+0000","last_peered":"2024-09-21T06:05:23.165086+0000","last_clean":"2024-09-21T06:05:23.165086+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:05:23.165086+0000","last_undegraded":"2024-09-21T06:05:23.165086+0000","last_fullsized":"2024-09-21T06:05:23.165086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:07.642925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790386,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":780,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194531,"statfs":{"total":200000000,"available":199200622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194537,"statfs":{"total":200000000,"available":199206866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195121,"statfs":{"total":200000000,"available":199804099,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195113,"statfs":{"total":200000000,"available":199795712,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195112,"statfs":{"total":200000000,"available":199795690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:05:28.109 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:05:28.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:05:28.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 -- 172.21.15.118:0/1404659699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fae0 msgr2=0x7fce680d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 --2- 172.21.15.118:0/1404659699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fae0 0x7fce680d0e80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fce6815d7d0 tx=0x7fce5802a540 comp rx=0 tx=0).stop 2024-09-21T06:05:28.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 -- 172.21.15.118:0/1404659699 shutdown_connections 2024-09-21T06:05:28.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 --2- 172.21.15.118:0/1404659699 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce68142730 0x7fce68142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 --2- 172.21.15.118:0/1404659699 >> v2:172.21.15.149:3300/0 conn(0x7fce6813fef0 0x7fce680d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 --2- 172.21.15.118:0/1404659699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fae0 0x7fce680d0e80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 -- 172.21.15.118:0/1404659699 >> 172.21.15.118:0/1404659699 conn(0x7fce6806d110 msgr2=0x7fce6806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:28.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 -- 172.21.15.118:0/1404659699 shutdown_connections 2024-09-21T06:05:28.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.371+0000 7fce6d000640 1 -- 172.21.15.118:0/1404659699 wait complete. 2024-09-21T06:05:28.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.374+0000 7fce6d000640 1 Processor -- start 2024-09-21T06:05:28.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.374+0000 7fce6d000640 1 -- start start 2024-09-21T06:05:28.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.375+0000 7fce6d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce6813fae0 0x7fce68156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.375+0000 7fce6d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fef0 0x7fce68159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.375+0000 7fce6d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce68142730 0x7fce681f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.375+0000 7fce6d000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce6806f2e0 con 0x7fce6813fef0 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.375+0000 7fce6d000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce6806f160 con 0x7fce68142730 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.375+0000 7fce6d000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce6806f460 con 0x7fce6813fae0 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fef0 0x7fce68159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fef0 0x7fce68159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56188/0 (socket says 172.21.15.118:56188) 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 -- 172.21.15.118:0/4136188258 learned_addr learned my addr 172.21.15.118:0/4136188258 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65e00640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce6813fae0 0x7fce68156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce66800640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce68142730 0x7fce681f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 -- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce6813fae0 msgr2=0x7fce68156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce6813fae0 0x7fce68156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 -- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce68142730 msgr2=0x7fce681f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce68142730 0x7fce681f71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 -- 172.21.15.118:0/4136188258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce68156f60 con 0x7fce6813fef0 2024-09-21T06:05:28.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.376+0000 7fce65400640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fef0 0x7fce68159b20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce5400d740 tx=0x7fce5400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:28.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.377+0000 7fce5e000640 1 -- 172.21.15.118:0/4136188258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54017070 con 0x7fce6813fef0 2024-09-21T06:05:28.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.377+0000 7fce5e000640 1 -- 172.21.15.118:0/4136188258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce54009d20 con 0x7fce6813fef0 2024-09-21T06:05:28.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.377+0000 7fce5e000640 1 -- 172.21.15.118:0/4136188258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce540106c0 con 0x7fce6813fef0 2024-09-21T06:05:28.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.377+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce68157240 con 0x7fce6813fef0 2024-09-21T06:05:28.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.377+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce68157800 con 0x7fce6813fef0 2024-09-21T06:05:28.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.378+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6806f980 con 0x7fce6813fef0 2024-09-21T06:05:28.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.379+0000 7fce5e000640 1 -- 172.21.15.118:0/4136188258 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce5401a070 con 0x7fce6813fef0 2024-09-21T06:05:28.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.380+0000 7fce5e000640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.380+0000 7fce5e000640 1 -- 172.21.15.118:0/4136188258 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fce5409aed0 con 0x7fce6813fef0 2024-09-21T06:05:28.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.381+0000 7fce65e00640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.382+0000 7fce65e00640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce48078b90 0x7fce4807b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce58033000 tx=0x7fce58004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:28.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.385+0000 7fce5e000640 1 -- 172.21.15.118:0/4136188258 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fce54062c20 con 0x7fce6813fef0 2024-09-21T06:05:28.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.636+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fce6815fd40 con 0x7fce6813fef0 2024-09-21T06:05:28.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.639+0000 7fce5e000640 1 -- 172.21.15.118:0/4136188258 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fce54067650 con 0x7fce6813fef0 2024-09-21T06:05:28.641 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:05:28.641 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:05:28.641 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:05:28.641 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:05:28.641 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:05:28.642 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce48078b90 msgr2=0x7fce4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce48078b90 0x7fce4807b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce58033000 tx=0x7fce58004730 comp rx=0 tx=0).stop 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fef0 msgr2=0x7fce68159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fef0 0x7fce68159b20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce5400d740 tx=0x7fce5400dc00 comp rx=0 tx=0).stop 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 shutdown_connections 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce68142730 0x7fce681f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce6813fef0 0x7fce68159b20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 --2- 172.21.15.118:0/4136188258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce6813fae0 0x7fce68156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 >> 172.21.15.118:0/4136188258 conn(0x7fce6806d110 msgr2=0x7fce6815b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:28.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 shutdown_connections 2024-09-21T06:05:28.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.642+0000 7fce6d000640 1 -- 172.21.15.118:0/4136188258 wait complete. 2024-09-21T06:05:28.666 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:28.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 -- 172.21.15.118:0/3516802336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 msgr2=0x7fdfe415dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 --2- 172.21.15.118:0/3516802336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe415dc40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4005fd0 tx=0x7fdfd402a540 comp rx=0 tx=0).stop 2024-09-21T06:05:28.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 -- 172.21.15.118:0/3516802336 shutdown_connections 2024-09-21T06:05:28.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 --2- 172.21.15.118:0/3516802336 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfe40d0ea0 0x7fdfe40d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 --2- 172.21.15.118:0/3516802336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe415dc40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 -- 172.21.15.118:0/3516802336 >> 172.21.15.118:0/3516802336 conn(0x7fdfe406d110 msgr2=0x7fdfe406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:28.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 -- 172.21.15.118:0/3516802336 shutdown_connections 2024-09-21T06:05:28.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.884+0000 7fdfeae00640 1 -- 172.21.15.118:0/3516802336 wait complete. 2024-09-21T06:05:28.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.886+0000 7fdfeae00640 1 Processor -- start 2024-09-21T06:05:28.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.887+0000 7fdfeae00640 1 -- start start 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfeae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfe40d0ea0 0x7fdfe4155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfeae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe4135ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfeae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfe4160b20 0x7fdfe4137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfeae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe415e300 con 0x7fdfe413fd80 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfeae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe415e180 con 0x7fdfe40d0ea0 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfeae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe415d680 con 0x7fdfe4160b20 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfdb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe4135ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfdb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe4135ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56200/0 (socket says 172.21.15.118:56200) 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.888+0000 7fdfdb400640 1 -- 172.21.15.118:0/1464962803 learned_addr learned my addr 172.21.15.118:0/1464962803 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfe3e00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfe40d0ea0 0x7fdfe4155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfe8e00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfe4160b20 0x7fdfe4137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfdb400640 1 -- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfe4160b20 msgr2=0x7fdfe4137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfdb400640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfe4160b20 0x7fdfe4137700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfdb400640 1 -- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfe40d0ea0 msgr2=0x7fdfe4155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfdb400640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfe40d0ea0 0x7fdfe4155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfdb400640 1 -- 172.21.15.118:0/1464962803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe4136660 con 0x7fdfe413fd80 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfdb400640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe4135ba0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00d770 tx=0x7fdfcc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfe0c00640 1 -- 172.21.15.118:0/1464962803 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc017070 con 0x7fdfe413fd80 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfe0c00640 1 -- 172.21.15.118:0/1464962803 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfcc009d20 con 0x7fdfe413fd80 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe4136940 con 0x7fdfe413fd80 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.889+0000 7fdfe0c00640 1 -- 172.21.15.118:0/1464962803 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0106c0 con 0x7fdfe413fd80 2024-09-21T06:05:28.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.890+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe4136f00 con 0x7fdfe413fd80 2024-09-21T06:05:28.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.891+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe41363d0 con 0x7fdfe413fd80 2024-09-21T06:05:28.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.892+0000 7fdfe0c00640 1 -- 172.21.15.118:0/1464962803 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdfcc01a070 con 0x7fdfe413fd80 2024-09-21T06:05:28.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.893+0000 7fdfe0c00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfc0078b90 0x7fdfc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:28.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.894+0000 7fdfe0c00640 1 -- 172.21.15.118:0/1464962803 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fdfcc09af50 con 0x7fdfe413fd80 2024-09-21T06:05:28.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.894+0000 7fdfe3e00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfc0078b90 0x7fdfc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:28.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.895+0000 7fdfe3e00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfc0078b90 0x7fdfc007b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4033000 tx=0x7fdfd4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:28.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:28.898+0000 7fdfe0c00640 1 -- 172.21.15.118:0/1464962803 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdfcc0632f0 con 0x7fdfe413fd80 2024-09-21T06:05:29.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.122+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfe41616d0 con 0x7fdfe413fd80 2024-09-21T06:05:29.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.122+0000 7fdfe0c00640 1 -- 172.21.15.118:0/1464962803 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7fdfcc062bf0 con 0x7fdfe413fd80 2024-09-21T06:05:29.124 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:29.124 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:05:29.124 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfc0078b90 msgr2=0x7fdfc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfc0078b90 0x7fdfc007b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4033000 tx=0x7fdfd4004730 comp rx=0 tx=0).stop 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 msgr2=0x7fdfe4135ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe4135ba0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00d770 tx=0x7fdfcc00dc30 comp rx=0 tx=0).stop 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 shutdown_connections 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfc0078b90 0x7fdfc007b0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfe4160b20 0x7fdfe4137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfe413fd80 0x7fdfe4135ba0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 --2- 172.21.15.118:0/1464962803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfe40d0ea0 0x7fdfe4155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 >> 172.21.15.118:0/1464962803 conn(0x7fdfe406d110 msgr2=0x7fdfe40b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:29.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 shutdown_connections 2024-09-21T06:05:29.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.125+0000 7fdfeae00640 1 -- 172.21.15.118:0/1464962803 wait complete. 2024-09-21T06:05:29.136 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:05:29.135+0000 7f0e20e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:05:29.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:05:22.642022+0000', 'modified': '2024-09-21T06:05:25.676816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6834/1713169437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 1713169437}, {'type': 'v1', 'addr': '172.21.15.118:6834', 'nonce': 1713169437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5256, 'qdb_cluster': [5256]} 2024-09-21T06:05:29.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:05:29.552 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 -- 172.21.15.118:0/1962451437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff778146230 msgr2=0x7ff7780b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 --2- 172.21.15.118:0/1962451437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff778146230 0x7ff7780b5bb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff768009830 tx=0x7ff76802a510 comp rx=0 tx=0).stop 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 -- 172.21.15.118:0/1962451437 shutdown_connections 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 --2- 172.21.15.118:0/1962451437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7780b60f0 0x7ff77815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 --2- 172.21.15.118:0/1962451437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff778146230 0x7ff7780b5bb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 -- 172.21.15.118:0/1962451437 >> 172.21.15.118:0/1962451437 conn(0x7ff77806d6e0 msgr2=0x7ff7780b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 -- 172.21.15.118:0/1962451437 shutdown_connections 2024-09-21T06:05:29.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.773+0000 7ff77dc00640 1 -- 172.21.15.118:0/1962451437 wait complete. 2024-09-21T06:05:29.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.775+0000 7ff77dc00640 1 Processor -- start 2024-09-21T06:05:29.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.775+0000 7ff77dc00640 1 -- start start 2024-09-21T06:05:29.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7780b60f0 0x7ff778159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff778146230 0x7ff778142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff77815d770 0x7ff77815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff778160e50 con 0x7ff77815d770 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff778160260 con 0x7ff7780b60f0 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff778160fd0 con 0x7ff778146230 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff77815d770 0x7ff77815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff77815d770 0x7ff77815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56222/0 (socket says 172.21.15.118:56222) 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.777+0000 7ff77d200640 1 -- 172.21.15.118:0/2270435030 learned_addr learned my addr 172.21.15.118:0/2270435030 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff76f400640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff778146230 0x7ff778142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff777e00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7780b60f0 0x7ff778159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff77d200640 1 -- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff778146230 msgr2=0x7ff778142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff77d200640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff778146230 0x7ff778142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff77d200640 1 -- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7780b60f0 msgr2=0x7ff778159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff77d200640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7780b60f0 0x7ff778159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff77d200640 1 -- 172.21.15.118:0/2270435030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff778159a30 con 0x7ff77815d770 2024-09-21T06:05:29.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff76f400640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff778146230 0x7ff778142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:29.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff777e00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7780b60f0 0x7ff778159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:29.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff77d200640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff77815d770 0x7ff77815bdf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c730 tx=0x7ff77000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:29.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff774c00640 1 -- 172.21.15.118:0/2270435030 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770017070 con 0x7ff77815d770 2024-09-21T06:05:29.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff774c00640 1 -- 172.21.15.118:0/2270435030 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff770003c60 con 0x7ff77815d770 2024-09-21T06:05:29.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff778159d10 con 0x7ff77815d770 2024-09-21T06:05:29.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.778+0000 7ff774c00640 1 -- 172.21.15.118:0/2270435030 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7700052d0 con 0x7ff77815d770 2024-09-21T06:05:29.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.779+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77815a2d0 con 0x7ff77815d770 2024-09-21T06:05:29.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.781+0000 7ff774c00640 1 -- 172.21.15.118:0/2270435030 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff77001a070 con 0x7ff77815d770 2024-09-21T06:05:29.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.782+0000 7ff774c00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff754078b90 0x7ff75407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.782+0000 7ff774c00640 1 -- 172.21.15.118:0/2270435030 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff77009a540 con 0x7ff77815d770 2024-09-21T06:05:29.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.782+0000 7ff786427740 1 Processor -- start 2024-09-21T06:05:29.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.782+0000 7ff786427740 1 -- start start 2024-09-21T06:05:29.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.783+0000 7ff777e00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff754078b90 0x7ff75407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.783+0000 7ff777e00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff754078b90 0x7ff75407b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff768034000 tx=0x7ff768004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:29.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff786427740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662bdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f6628e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff786427740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x562f66217430 con 0x562f65eed270 2024-09-21T06:05:29.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x562f662075d0 con 0x562f65ec43b0 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x562f661f6a00 con 0x562f65ecc590 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff777e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662bdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff777e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662bdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56238/0 (socket says 172.21.15.118:56238) 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff777e00640 1 -- 172.21.15.118:0/389854285 learned_addr learned my addr 172.21.15.118:0/389854285 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff76f400640 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.784+0000 7ff77d200640 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f6628e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff777e00640 1 -- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 msgr2=0x562f6628e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff777e00640 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f6628e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff777e00640 1 -- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 msgr2=0x562f662be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff777e00640 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662be0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff777e00640 1 -- 172.21.15.118:0/389854285 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f661bf520 con 0x562f65eed270 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff76f400640 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662be0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:29.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff777e00640 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662bdb60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff768009920 tx=0x7ff76803d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8143a9577d3909ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff76cc00640 1 -- 172.21.15.118:0/389854285 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768003f00 con 0x562f65eed270 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff76cc00640 1 -- 172.21.15.118:0/389854285 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff768048420 con 0x562f65eed270 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.785+0000 7ff76cc00640 1 -- 172.21.15.118:0/389854285 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768048850 con 0x562f65eed270 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 -- 172.21.15.118:0/389854285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 msgr2=0x562f662bdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662bdb60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff768009920 tx=0x7ff76803d070 comp rx=0 tx=0).stop 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 -- 172.21.15.118:0/389854285 shutdown_connections 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f6628e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662be0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 --2- 172.21.15.118:0/389854285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662bdb60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 -- 172.21.15.118:0/389854285 >> 172.21.15.118:0/389854285 conn(0x562f65ee13c0 msgr2=0x562f66293b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 -- 172.21.15.118:0/389854285 shutdown_connections 2024-09-21T06:05:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.786+0000 7ff786427740 1 -- 172.21.15.118:0/389854285 wait complete. 2024-09-21T06:05:29.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.787+0000 7ff786427740 1 -- start start 2024-09-21T06:05:29.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.787+0000 7ff786427740 1 Processor -- start 2024-09-21T06:05:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ec43b0 0x562f662e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ecc590 0x562f662e8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff786427740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff786427740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x562f6619d330 con 0x562f65eed270 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x562f661fa810 con 0x562f65ecc590 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x562f65f67620 con 0x562f65ec43b0 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff786427740 10 client.0 _ll_register_callbacks cb 0x562f661a2420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff77d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff77d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662d2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56254/0 (socket says 172.21.15.118:56254) 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.789+0000 7ff77d200640 1 -- 172.21.15.118:0/103218382 learned_addr learned my addr 172.21.15.118:0/103218382 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff777e00640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ec43b0 0x562f662e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff76f400640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ecc590 0x562f662e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff77d200640 1 -- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ec43b0 msgr2=0x562f662e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff77d200640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ec43b0 0x562f662e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff77d200640 1 -- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ecc590 msgr2=0x562f662e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff77d200640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ecc590 0x562f662e8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff77d200640 1 -- 172.21.15.118:0/103218382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f65f58850 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff777e00640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ec43b0 0x562f662e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff76f400640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ecc590 0x562f662e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff77d200640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662d2f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff770062200 tx=0x7ff770061d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae626a84c52331c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff765600640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff765600640 1 -- 172.21.15.118:0/103218382 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77006b970 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff765600640 1 -- 172.21.15.118:0/103218382 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff77009a0d0 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff768048420 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff765600640 1 -- 172.21.15.118:0/103218382 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff770081050 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff786427740 10 client.5391 fetch_fsmap learned FSMap version 25 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x562f65fcf6b0 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.790+0000 7ff765600640 1 -- 172.21.15.118:0/103218382 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff768048420 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff765600640 1 -- 172.21.15.118:0/103218382 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7ff7700614d0 con 0x562f65eed270 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff786427740 10 client.5391 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:05:29.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff786427740 10 client.5391 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:05:29.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff786427740 20 client.5391 populate_metadata read hostname 'smithi118' 2024-09-21T06:05:29.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff786427740 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f65eabe40 0x562f662b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff786427740 4 client.5391 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:05:29.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 --> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f66209520 con 0x562f65eabe40 2024-09-21T06:05:29.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff777e00640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f65eabe40 0x562f662b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff765600640 10 client.5391 ms_handle_connect on v2:172.21.15.118:6832/1713169437 2024-09-21T06:05:29.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.791+0000 7ff777e00640 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f65eabe40 0x562f662b7660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59dcee6f87e15d81 server_cookie=ee5704f46cb452ca in_seq=0 out_seq=0 2024-09-21T06:05:29.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.792+0000 7ff765600640 1 -- 172.21.15.118:0/103218382 <== mds.0 v2:172.21.15.118:6832/1713169437 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f66209520 con 0x562f65eabe40 2024-09-21T06:05:29.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.792+0000 7ff765600640 10 client.5391 handle_command_reply: tid=0 2024-09-21T06:05:29.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.792+0000 7ff786427740 1 client.5391 shutdown 2024-09-21T06:05:29.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 msgr2=0x562f662d2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662d2f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff770062200 tx=0x7ff770061d80 comp rx=0 tx=0).stop 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 shutdown_connections 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f65eabe40 0x562f662b7660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662d2f30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ecc590 0x562f662e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 --2- 172.21.15.118:0/103218382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ec43b0 0x562f662e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff765600640 0 client.5391 ms_handle_reset on v2:172.21.15.118:6832/1713169437 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 >> 172.21.15.118:0/103218382 conn(0x562f65ee13c0 msgr2=0x562f662db630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 shutdown_connections 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 1 -- 172.21.15.118:0/103218382 wait complete. 2024-09-21T06:05:29.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.793+0000 7ff786427740 20 client.5391 trim_cache size 0 max 16384 2024-09-21T06:05:29.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.812+0000 7ff786427740 1 Processor -- start 2024-09-21T06:05:29.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.812+0000 7ff786427740 1 -- start start 2024-09-21T06:05:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.813+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.813+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662fb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.813+0000 7ff786427740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662fbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.813+0000 7ff786427740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780b4da0 con 0x562f65eed270 2024-09-21T06:05:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.813+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780ab260 con 0x562f65ec43b0 2024-09-21T06:05:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.813+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff7781f46c0 con 0x562f65ecc590 2024-09-21T06:05:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662fbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662fbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56264/0 (socket says 172.21.15.118:56264) 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 -- 172.21.15.118:0/4219141432 learned_addr learned my addr 172.21.15.118:0/4219141432 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff76f400640 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff777e00640 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 -- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 msgr2=0x562f662fb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662fb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 -- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 msgr2=0x562f662daeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662daeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 -- 172.21.15.118:0/4219141432 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f662d32a0 con 0x562f65eed270 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff76f400640 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff77d200640 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662fbdd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff77006b0a0 tx=0x7ff7700629f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb47676a2c995fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.814+0000 7ff767e00640 1 -- 172.21.15.118:0/4219141432 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77005e110 con 0x562f65eed270 2024-09-21T06:05:29.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff767e00640 1 -- 172.21.15.118:0/4219141432 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77006be50 con 0x562f65eed270 2024-09-21T06:05:29.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff767e00640 1 -- 172.21.15.118:0/4219141432 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77006b9d0 con 0x562f65eed270 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 -- 172.21.15.118:0/4219141432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 msgr2=0x562f662fbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662fbdd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff77006b0a0 tx=0x7ff7700629f0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 -- 172.21.15.118:0/4219141432 shutdown_connections 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65eed270 0x562f662fbdd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 --2- 172.21.15.118:0/4219141432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65ec43b0 0x562f662daeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 -- 172.21.15.118:0/4219141432 >> 172.21.15.118:0/4219141432 conn(0x562f65ee13c0 msgr2=0x562f662db630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 -- 172.21.15.118:0/4219141432 shutdown_connections 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.815+0000 7ff786427740 1 -- 172.21.15.118:0/4219141432 wait complete. 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.816+0000 7ff786427740 1 -- start start 2024-09-21T06:05:29.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.816+0000 7ff786427740 1 Processor -- start 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff786427740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65ec43b0 0x562f6634ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662b7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff786427740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65eed270 0x562f662b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff786427740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x562f662eb010 con 0x562f65ec43b0 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x562f662e88d0 con 0x562f65eed270 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff786427740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x562f662eb660 con 0x562f65ecc590 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff786427740 10 client.0 _ll_register_callbacks cb 0x7ff7700619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff777e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65ec43b0 0x562f6634ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff777e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65ec43b0 0x562f6634ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56274/0 (socket says 172.21.15.118:56274) 2024-09-21T06:05:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.818+0000 7ff777e00640 1 -- 172.21.15.118:0/2341514355 learned_addr learned my addr 172.21.15.118:0/2341514355 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff76f400640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff77d200640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65eed270 0x562f662b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff777e00640 1 -- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 msgr2=0x562f662b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff777e00640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff777e00640 1 -- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65eed270 msgr2=0x562f662b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff777e00640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65eed270 0x562f662b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff777e00640 1 -- 172.21.15.118:0/2341514355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f662d2aa0 con 0x562f65ec43b0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff77d200640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65eed270 0x562f662b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff777e00640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65ec43b0 0x562f6634ec90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff768003750 tx=0x7ff7680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfd13c7b8477e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff765600640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff765600640 1 -- 172.21.15.118:0/2341514355 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7680043a0 con 0x562f65ec43b0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff765600640 1 -- 172.21.15.118:0/2341514355 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff768063aa0 con 0x562f65ec43b0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.819+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff77006be50 con 0x562f65ec43b0 2024-09-21T06:05:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff765600640 1 -- 172.21.15.118:0/2341514355 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff768063ca0 con 0x562f65ec43b0 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 10 client.5397 fetch_fsmap learned FSMap version 25 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x562f6635b950 con 0x562f65ec43b0 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff765600640 1 -- 172.21.15.118:0/2341514355 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77006be50 con 0x562f65ec43b0 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff765600640 1 -- 172.21.15.118:0/2341514355 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7ff768063020 con 0x562f65ec43b0 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 10 client.5397 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 10 client.5397 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 20 client.5397 populate_metadata read hostname 'smithi118' 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f662b47b0 0x562f662e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 4 client.5397 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 --> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] -- command(tid 0: {"prefix": "status"}) -- 0x562f66204fd0 con 0x562f662b47b0 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.820+0000 7ff76f400640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f662b47b0 0x562f662e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff76f400640 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f662b47b0 0x562f662e75d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdafe564773e2006 server_cookie=17940a9b9238fd49 in_seq=0 out_seq=0 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff765600640 10 client.5397 ms_handle_connect on v2:172.21.15.118:6832/1713169437 2024-09-21T06:05:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff765600640 1 -- 172.21.15.118:0/2341514355 <== mds.0 v2:172.21.15.118:6832/1713169437 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562f66204fd0 con 0x562f662b47b0 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff765600640 10 client.5397 handle_command_reply: tid=0 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 client.5397 shutdown 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65ec43b0 msgr2=0x562f6634ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65ec43b0 0x562f6634ec90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff768003750 tx=0x7ff7680046c0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 shutdown_connections 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:6832/1713169437,v1:172.21.15.118:6834/1713169437] conn(0x562f662b47b0 0x562f662e75d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f65eed270 0x562f662b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f65ecc590 0x562f662b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 --2- 172.21.15.118:0/2341514355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f65ec43b0 0x562f6634ec90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 >> 172.21.15.118:0/2341514355 conn(0x562f65ee13c0 msgr2=0x562f662b88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff765600640 0 client.5397 ms_handle_reset on v2:172.21.15.118:6832/1713169437 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 shutdown_connections 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.821+0000 7ff786427740 1 -- 172.21.15.118:0/2341514355 wait complete. 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff786427740 20 client.5397 trim_cache size 0 max 16384 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 5256, 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:05:29.828 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:05:29.829 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 6.6490987949999996, 2024-09-21T06:05:29.829 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 25, 2024-09-21T06:05:29.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 44, 2024-09-21T06:05:29.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 44, 2024-09-21T06:05:29.829 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.579847735 2024-09-21T06:05:29.829 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff754078b90 msgr2=0x7ff75407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff754078b90 0x7ff75407b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff768034000 tx=0x7ff768004730 comp rx=0 tx=0).stop 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff77815d770 msgr2=0x7ff77815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff77815d770 0x7ff77815bdf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c730 tx=0x7ff77000cbf0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 shutdown_connections 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff77815d770 0x7ff77815bdf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff754078b90 0x7ff75407b0a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff778146230 0x7ff778142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 --2- 172.21.15.118:0/2270435030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7780b60f0 0x7ff778159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 >> 172.21.15.118:0/2270435030 conn(0x7ff77806d6e0 msgr2=0x7ff778072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 shutdown_connections 2024-09-21T06:05:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:29.822+0000 7ff77dc00640 1 -- 172.21.15.118:0/2270435030 wait complete. 2024-09-21T06:05:29.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 -- 172.21.15.118:0/618134531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b42f0 msgr2=0x7f61b80b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 --2- 172.21.15.118:0/618134531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b42f0 0x7f61b80b4700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f61b80a2a50 tx=0x7f61b002aa30 comp rx=0 tx=0).stop 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 -- 172.21.15.118:0/618134531 shutdown_connections 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 --2- 172.21.15.118:0/618134531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b42f0 0x7f61b80b4700 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 --2- 172.21.15.118:0/618134531 >> v2:172.21.15.149:3300/0 conn(0x7f61b80d1950 0x7f61b80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 -- 172.21.15.118:0/618134531 >> 172.21.15.118:0/618134531 conn(0x7f61b80d4bc0 msgr2=0x7f61b80d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 -- 172.21.15.118:0/618134531 shutdown_connections 2024-09-21T06:05:30.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.067+0000 7f61bde00640 1 -- 172.21.15.118:0/618134531 wait complete. 2024-09-21T06:05:30.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.069+0000 7f61bde00640 1 Processor -- start 2024-09-21T06:05:30.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.069+0000 7f61bde00640 1 -- start start 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bde00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b3ae0 0x7f61b809e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b80b42f0 0x7f61b81d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b80d1950 0x7f61b81e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bde00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80b4dc0 con 0x7f61b80b3ae0 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bde00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80b4c40 con 0x7f61b80b42f0 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bde00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61b80b4f40 con 0x7f61b80d1950 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b3ae0 0x7f61b809e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b3ae0 0x7f61b809e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56298/0 (socket says 172.21.15.118:56298) 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bca00640 1 -- 172.21.15.118:0/1408068214 learned_addr learned my addr 172.21.15.118:0/1408068214 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61afe00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b80b42f0 0x7f61b81d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:30.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.071+0000 7f61bd400640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b80d1950 0x7f61b81e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:30.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bca00640 1 -- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b80d1950 msgr2=0x7f61b81e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:30.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bca00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b80d1950 0x7f61b81e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bca00640 1 -- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b80b42f0 msgr2=0x7f61b81d7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:30.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bca00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b80b42f0 0x7f61b81d7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bca00640 1 -- 172.21.15.118:0/1408068214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b80a1d10 con 0x7f61b80b3ae0 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bca00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b3ae0 0x7f61b809e880 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c3c0 tx=0x7f61a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61b5600640 1 -- 172.21.15.118:0/1408068214 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8017070 con 0x7f61b80b3ae0 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61b5600640 1 -- 172.21.15.118:0/1408068214 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61a80053c0 con 0x7f61b80b3ae0 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61b5600640 1 -- 172.21.15.118:0/1408068214 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8003880 con 0x7f61b80b3ae0 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b80a1ff0 con 0x7f61b80b3ae0 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.072+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b80a25b0 con 0x7f61b80b3ae0 2024-09-21T06:05:30.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.073+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b80b4700 con 0x7f61b80b3ae0 2024-09-21T06:05:30.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.075+0000 7f61b5600640 1 -- 172.21.15.118:0/1408068214 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61a801a070 con 0x7f61b80b3ae0 2024-09-21T06:05:30.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.076+0000 7f61b5600640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6194078b90 0x7f619407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:30.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.076+0000 7f61b5600640 1 -- 172.21.15.118:0/1408068214 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f61a8099ff0 con 0x7f61b80b3ae0 2024-09-21T06:05:30.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.076+0000 7f61afe00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6194078b90 0x7f619407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:30.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.077+0000 7f61afe00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6194078b90 0x7f619407b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009b30 tx=0x7f61a0005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:30.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.080+0000 7f61b5600640 1 -- 172.21.15.118:0/1408068214 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f61a8061da0 con 0x7f61b80b3ae0 2024-09-21T06:05:30.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.308+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f61b80a2780 con 0x7f61b80b3ae0 2024-09-21T06:05:30.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.308+0000 7f61b5600640 1 -- 172.21.15.118:0/1408068214 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f61a80667d0 con 0x7f61b80b3ae0 2024-09-21T06:05:30.310 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6194078b90 msgr2=0x7f619407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6194078b90 0x7f619407b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009b30 tx=0x7f61a0005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b3ae0 msgr2=0x7f61b809e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b3ae0 0x7f61b809e880 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c3c0 tx=0x7f61a800c880 comp rx=0 tx=0).stop 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 shutdown_connections 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6194078b90 0x7f619407b0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61b80d1950 0x7f61b81e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61b80b42f0 0x7f61b81d7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 --2- 172.21.15.118:0/1408068214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b80b3ae0 0x7f61b809e880 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:30.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 >> 172.21.15.118:0/1408068214 conn(0x7f61b80d4bc0 msgr2=0x7f61b806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:30.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 shutdown_connections 2024-09-21T06:05:30.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30.311+0000 7f61bde00640 1 -- 172.21.15.118:0/1408068214 wait complete. 2024-09-21T06:05:30.337 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:05:30.337 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:05:30.337 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:05:30.337 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:05:30.338 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:05:30.338 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:05:30.338 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:05:30.338 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:05:30.338 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:05:30.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:30.338 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:05:30.374 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42654sec preferred_lft 42654sec 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:30.375 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:05:30.376 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:30.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:30.377 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:05:30.467 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:05:30.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:30.471 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:05:30.507 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:05:30.562 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:05:30.562 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:05:30.562 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:05:30.562 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:05:30.562 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:05:30.562 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:05:30.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:05:30.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:05:30.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:05:30.563 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:05:30.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:05:30.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:30.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:30.723 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:05:30.758 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:05:30.758 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:05:30.759 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:05:30.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:30.759 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:05:30.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:05:30.855 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:05:30.890 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:05:30.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:05:30.890 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:05:30.964 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:05:30.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:30.965 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:05:31.158 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:05:31.158 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:05:31.196 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:05:31.196 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:05:31.196 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:05:31.196 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:05:31.196 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:05:31.198 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:05:31.198 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:05:31.198 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:05:31.198 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:05:31.198 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:05:31.201 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:05:31.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:31.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:05:31.257 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:05:31.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:05:31.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:31.355 INFO:teuthology.orchestra.run.smithi118.stdout:client5406 2024-09-21T06:05:31.355 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:31.355 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:31.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:05:31.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 -- 172.21.15.118:0/797742841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0ccf80 msgr2=0x7f71fc073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:31.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 --2- 172.21.15.118:0/797742841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0ccf80 0x7f71fc073370 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0cd9d0 tx=0x7f71f402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 -- 172.21.15.118:0/797742841 shutdown_connections 2024-09-21T06:05:31.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 --2- 172.21.15.118:0/797742841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0ccf80 0x7f71fc073370 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 --2- 172.21.15.118:0/797742841 >> v2:172.21.15.149:3300/0 conn(0x7f71fc0b3a60 0x7f71fc0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 -- 172.21.15.118:0/797742841 >> 172.21.15.118:0/797742841 conn(0x7f71fc06d110 msgr2=0x7f71fc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:31.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 -- 172.21.15.118:0/797742841 shutdown_connections 2024-09-21T06:05:31.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.652+0000 7f7203a00640 1 -- 172.21.15.118:0/797742841 wait complete. 2024-09-21T06:05:31.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.654+0000 7f7203a00640 1 Processor -- start 2024-09-21T06:05:31.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.655+0000 7f7203a00640 1 -- start start 2024-09-21T06:05:31.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7203a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0b3a60 0x7f71fc131720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:31.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7203a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71fc0ccf80 0x7f71fc12fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:31.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7203a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71fc15cfd0 0x7f71fc1f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:31.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7203a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc073c40 con 0x7f71fc0b3a60 2024-09-21T06:05:31.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7203a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc073ac0 con 0x7f71fc0ccf80 2024-09-21T06:05:31.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7203a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc073dc0 con 0x7f71fc15cfd0 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7201000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0b3a60 0x7f71fc131720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7201000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0b3a60 0x7f71fc131720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56314/0 (socket says 172.21.15.118:56314) 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.656+0000 7f7201000640 1 -- 172.21.15.118:0/4013548648 learned_addr learned my addr 172.21.15.118:0/4013548648 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f71f3e00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71fc0ccf80 0x7f71fc12fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7201a00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71fc15cfd0 0x7f71fc1f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7201000640 1 -- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71fc15cfd0 msgr2=0x7f71fc1f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7201000640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71fc15cfd0 0x7f71fc1f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7201000640 1 -- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71fc0ccf80 msgr2=0x7f71fc12fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7201000640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71fc0ccf80 0x7f71fc12fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7201000640 1 -- 172.21.15.118:0/4013548648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc130680 con 0x7f71fc0b3a60 2024-09-21T06:05:31.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f71f3e00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71fc0ccf80 0x7f71fc12fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:31.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7201000640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0b3a60 0x7f71fc131720 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c3c0 tx=0x7f71ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:31.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f71f9600640 1 -- 172.21.15.118:0/4013548648 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec017070 con 0x7f71fc0b3a60 2024-09-21T06:05:31.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f71f9600640 1 -- 172.21.15.118:0/4013548648 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71ec0035f0 con 0x7f71fc0b3a60 2024-09-21T06:05:31.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f71f9600640 1 -- 172.21.15.118:0/4013548648 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec003a80 con 0x7f71fc0b3a60 2024-09-21T06:05:31.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc130960 con 0x7f71fc0b3a60 2024-09-21T06:05:31.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.657+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc130f20 con 0x7f71fc0b3a60 2024-09-21T06:05:31.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.658+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc0cca40 con 0x7f71fc0b3a60 2024-09-21T06:05:31.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.660+0000 7f71f9600640 1 -- 172.21.15.118:0/4013548648 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71ec01a070 con 0x7f71fc0b3a60 2024-09-21T06:05:31.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.661+0000 7f71f9600640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71d8078b90 0x7f71d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:31.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.661+0000 7f71f9600640 1 -- 172.21.15.118:0/4013548648 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f71ec09a060 con 0x7f71fc0b3a60 2024-09-21T06:05:31.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.661+0000 7f71f3e00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71d8078b90 0x7f71d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:31.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.662+0000 7f71f3e00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71d8078b90 0x7f71d807b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71fc1e7790 tx=0x7f71e4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:31.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.666+0000 7f71f9600640 1 -- 172.21.15.118:0/4013548648 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71ec062490 con 0x7f71fc0b3a60 2024-09-21T06:05:31.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.890+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f71fc1ea890 con 0x7f71fc0b3a60 2024-09-21T06:05:31.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.890+0000 7f71f9600640 1 -- 172.21.15.118:0/4013548648 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f71ec061d90 con 0x7f71fc0b3a60 2024-09-21T06:05:31.892 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71d8078b90 msgr2=0x7f71d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71d8078b90 0x7f71d807b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71fc1e7790 tx=0x7f71e4005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0b3a60 msgr2=0x7f71fc131720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0b3a60 0x7f71fc131720 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c3c0 tx=0x7f71ec00c880 comp rx=0 tx=0).stop 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 shutdown_connections 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71d8078b90 0x7f71d807b0a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71fc15cfd0 0x7f71fc1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71fc0ccf80 0x7f71fc12fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 --2- 172.21.15.118:0/4013548648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71fc0b3a60 0x7f71fc131720 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 >> 172.21.15.118:0/4013548648 conn(0x7f71fc06d110 msgr2=0x7f71fc1453e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 shutdown_connections 2024-09-21T06:05:31.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:31.893+0000 7f7203a00640 1 -- 172.21.15.118:0/4013548648 wait complete. 2024-09-21T06:05:31.920 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:05:31.920 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:05:31.920 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:05:31.920 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:05:31.920 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:05:31.920 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:05:31.921 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:05:31.921 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:05:31.921 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:05:31.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:31.921 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:05:31.961 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:05:31.962 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42627sec preferred_lft 42627sec 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:31.963 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:05:31.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:31.964 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:05:32.058 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:05:32.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:32.062 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:05:32.098 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:05:32.099 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:05:32.099 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:05:32.099 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:05:32.099 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:05:32.099 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:05:32.099 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:05:32.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:05:32.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:05:32.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:05:32.100 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:05:32.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:05:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:05:32.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:05:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:32.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:32.297 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:05:32.333 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:05:32.333 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:05:32.333 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:05:32.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:32.333 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:05:32.429 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:05:32.429 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:05:32.464 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:05:32.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:05:32.464 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:05:32.539 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:05:32.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:32.540 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:05:32.735 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:05:32.735 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:05:32.772 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:05:32.772 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:05:32.772 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:05:32.772 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:05:32.773 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:05:32.774 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:05:32.774 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:05:32.774 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:05:32.774 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:05:32.774 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:05:32.777 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:05:32.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:32.777 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:05:32.833 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:05:32.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:05:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:05:32.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:05:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:05:32.923 INFO:teuthology.orchestra.run.smithi149.stdout:client5263 2024-09-21T06:05:32.924 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:05:32.924 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:32.959 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 -- 172.21.15.118:0/2098823722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b25f0 msgr2=0x7f1fc40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 --2- 172.21.15.118:0/2098823722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b25f0 0x7f1fc40ce5e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40b2d00 tx=0x7f1fac02a530 comp rx=0 tx=0).stop 2024-09-21T06:05:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 -- 172.21.15.118:0/2098823722 shutdown_connections 2024-09-21T06:05:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 --2- 172.21.15.118:0/2098823722 >> v2:172.21.15.149:3300/0 conn(0x7f1fc40b1010 0x7f1fc40b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 --2- 172.21.15.118:0/2098823722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b25f0 0x7f1fc40ce5e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 -- 172.21.15.118:0/2098823722 >> 172.21.15.118:0/2098823722 conn(0x7f1fc40748d0 msgr2=0x7f1fc4074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 -- 172.21.15.118:0/2098823722 shutdown_connections 2024-09-21T06:05:33.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.197+0000 7f1fc9200640 1 -- 172.21.15.118:0/2098823722 wait complete. 2024-09-21T06:05:33.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.199+0000 7f1fc9200640 1 Processor -- start 2024-09-21T06:05:33.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.199+0000 7f1fc9200640 1 -- start start 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b1010 0x7f1fc415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc40cca00 0x7f1fc41f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc40d0660 0x7f1fc40cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc9200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40b6440 con 0x7f1fc40b1010 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40b62c0 con 0x7f1fc40cca00 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc40b65c0 con 0x7f1fc40d0660 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b1010 0x7f1fc415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b1010 0x7f1fc415ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56342/0 (socket says 172.21.15.118:56342) 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc1e00640 1 -- 172.21.15.118:0/292778532 learned_addr learned my addr 172.21.15.118:0/292778532 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:33.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fbbe00640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc40cca00 0x7f1fc41f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.201+0000 7f1fc2800640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc40d0660 0x7f1fc40cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc1e00640 1 -- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc40d0660 msgr2=0x7f1fc40cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc1e00640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc40d0660 0x7f1fc40cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc1e00640 1 -- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc40cca00 msgr2=0x7f1fc41f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc1e00640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc40cca00 0x7f1fc41f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc1e00640 1 -- 172.21.15.118:0/292778532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc415d3b0 con 0x7f1fc40b1010 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc1e00640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b1010 0x7f1fc415ce70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c3f0 tx=0x7f1fb400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fba000640 1 -- 172.21.15.118:0/292778532 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4017070 con 0x7f1fc40b1010 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fba000640 1 -- 172.21.15.118:0/292778532 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fb40035f0 con 0x7f1fc40b1010 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc415f020 con 0x7f1fc40b1010 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fba000640 1 -- 172.21.15.118:0/292778532 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4003a40 con 0x7f1fc40b1010 2024-09-21T06:05:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.202+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc41f66d0 con 0x7f1fc40b1010 2024-09-21T06:05:33.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.203+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc40b6ae0 con 0x7f1fc40b1010 2024-09-21T06:05:33.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.205+0000 7f1fba000640 1 -- 172.21.15.118:0/292778532 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fb401a070 con 0x7f1fc40b1010 2024-09-21T06:05:33.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.206+0000 7f1fba000640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fa0078b90 0x7f1fa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:33.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.206+0000 7f1fba000640 1 -- 172.21.15.118:0/292778532 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f1fb409a140 con 0x7f1fc40b1010 2024-09-21T06:05:33.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.206+0000 7f1fbbe00640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fa0078b90 0x7f1fa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:33.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.207+0000 7f1fbbe00640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fa0078b90 0x7f1fa007b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1fac034000 tx=0x7f1fac004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:33.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.210+0000 7f1fba000640 1 -- 172.21.15.118:0/292778532 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1fb4062570 con 0x7f1fc40b1010 2024-09-21T06:05:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.431+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fc4076730 con 0x7f1fc40b1010 2024-09-21T06:05:33.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.432+0000 7f1fba000640 1 -- 172.21.15.118:0/292778532 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f1fb4061e70 con 0x7f1fc40b1010 2024-09-21T06:05:33.433 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:33.433 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:05:33.433 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:05:33.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fa0078b90 msgr2=0x7f1fa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fa0078b90 0x7f1fa007b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1fac034000 tx=0x7f1fac004730 comp rx=0 tx=0).stop 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b1010 msgr2=0x7f1fc415ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b1010 0x7f1fc415ce70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c3f0 tx=0x7f1fb400c8b0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 shutdown_connections 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1fa0078b90 0x7f1fa007b0a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fc40d0660 0x7f1fc40cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fc40cca00 0x7f1fc41f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 --2- 172.21.15.118:0/292778532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fc40b1010 0x7f1fc415ce70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 >> 172.21.15.118:0/292778532 conn(0x7f1fc40748d0 msgr2=0x7f1fc415be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 shutdown_connections 2024-09-21T06:05:33.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:33.434+0000 7f1fc9200640 1 -- 172.21.15.118:0/292778532 wait complete. 2024-09-21T06:05:33.459 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:05:33.699 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":5256,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.50795244,"mdsmap_epoch":25,"osdmap_epoch":44,"osdmap_epoch_barrier":44,"uptime":15.438705058} 2024-09-21T06:05:33.699 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 5256, "mdsmap_epoch": 25, "osdmap_epoch": 44, "osdmap_epoch_barrier": 44, "rank_uptime": 10.50795244, "state": "up:active", "uptime": 15.438705058, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:05:33.700 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:05:33.934 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:05:33.935 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:05:33.935 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-21T06:05:33.935 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:33.935 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:33.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:33.970 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-21T06:05:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:265+0 records in 2024-09-21T06:05:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:265+0 records out 2024-09-21T06:05:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.85249 s, 150 MB/s 2024-09-21T06:05:35.902 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:35.902 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:35.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:35.939 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-21T06:05:38.015 INFO:teuthology.orchestra.run.smithi118.stderr:292+0 records in 2024-09-21T06:05:38.015 INFO:teuthology.orchestra.run.smithi118.stderr:292+0 records out 2024-09-21T06:05:38.015 INFO:teuthology.orchestra.run.smithi118.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.99883 s, 153 MB/s 2024-09-21T06:05:38.016 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-21T06:05:38.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:05:38.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.237+0000 7fab65800640 1 -- 172.21.15.118:0/67316491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 msgr2=0x7fab600d11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:38.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.237+0000 7fab65800640 1 --2- 172.21.15.118:0/67316491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab600d11f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fab600703b0 tx=0x7fab4c02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.237+0000 7fab65800640 1 -- 172.21.15.118:0/67316491 shutdown_connections 2024-09-21T06:05:38.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.237+0000 7fab65800640 1 --2- 172.21.15.118:0/67316491 >> v2:172.21.15.149:3300/0 conn(0x7fab600cf1e0 0x7fab600cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.237+0000 7fab65800640 1 --2- 172.21.15.118:0/67316491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab600d11f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.237+0000 7fab65800640 1 -- 172.21.15.118:0/67316491 >> 172.21.15.118:0/67316491 conn(0x7fab6006d110 msgr2=0x7fab6006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:38.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.237+0000 7fab65800640 1 -- 172.21.15.118:0/67316491 shutdown_connections 2024-09-21T06:05:38.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.238+0000 7fab65800640 1 -- 172.21.15.118:0/67316491 wait complete. 2024-09-21T06:05:38.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.240+0000 7fab65800640 1 Processor -- start 2024-09-21T06:05:38.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.240+0000 7fab65800640 1 -- start start 2024-09-21T06:05:38.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.241+0000 7fab65800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab600cf1e0 0x7fab6015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:38.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.241+0000 7fab65800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab601f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:38.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.241+0000 7fab65800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab6013fc50 0x7fab601f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.241+0000 7fab65800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab600cfcb0 con 0x7fab600d0de0 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.241+0000 7fab65800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab600cfb30 con 0x7fab6013fc50 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.241+0000 7fab65800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab600cfe30 con 0x7fab600cf1e0 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.241+0000 7fab5e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab601f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab601f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35490/0 (socket says 172.21.15.118:35490) 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 -- 172.21.15.118:0/2920327392 learned_addr learned my addr 172.21.15.118:0/2920327392 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5f400640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab6013fc50 0x7fab601f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5ea00640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab600cf1e0 0x7fab6015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 -- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab600cf1e0 msgr2=0x7fab6015fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab600cf1e0 0x7fab6015fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 -- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab6013fc50 msgr2=0x7fab601f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab6013fc50 0x7fab601f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 -- 172.21.15.118:0/2920327392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab60072cd0 con 0x7fab600d0de0 2024-09-21T06:05:38.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.242+0000 7fab5e000640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab601f5bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fab4c034040 tx=0x7fab4c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:38.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.243+0000 7fab56a00640 1 -- 172.21.15.118:0/2920327392 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c03e030 con 0x7fab600d0de0 2024-09-21T06:05:38.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.243+0000 7fab56a00640 1 -- 172.21.15.118:0/2920327392 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab4c003e00 con 0x7fab600d0de0 2024-09-21T06:05:38.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.243+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab601f6960 con 0x7fab600d0de0 2024-09-21T06:05:38.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.243+0000 7fab56a00640 1 -- 172.21.15.118:0/2920327392 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c035040 con 0x7fab600d0de0 2024-09-21T06:05:38.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.243+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab60073270 con 0x7fab600d0de0 2024-09-21T06:05:38.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.244+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab601f66d0 con 0x7fab600d0de0 2024-09-21T06:05:38.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.245+0000 7fab56a00640 1 -- 172.21.15.118:0/2920327392 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab4c041030 con 0x7fab600d0de0 2024-09-21T06:05:38.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.246+0000 7fab56a00640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab40078b90 0x7fab4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:38.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.246+0000 7fab56a00640 1 -- 172.21.15.118:0/2920327392 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fab4c0bb590 con 0x7fab600d0de0 2024-09-21T06:05:38.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.246+0000 7fab5ea00640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab40078b90 0x7fab4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:38.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.247+0000 7fab5ea00640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab40078b90 0x7fab4007b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab50001720 tx=0x7fab50009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:38.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.251+0000 7fab56a00640 1 -- 172.21.15.118:0/2920327392 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fab4c083370 con 0x7fab600d0de0 2024-09-21T06:05:38.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.437+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fab600d03f0 con 0x7fab600d0de0 2024-09-21T06:05:38.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.439+0000 7fab56a00640 1 -- 172.21.15.118:0/2920327392 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v44) ==== 81+0+34276 (secure 0 0 0) 0x7fab4c087da0 con 0x7fab600d0de0 2024-09-21T06:05:38.443 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:38.443 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:38.443 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 44, 2024-09-21T06:05:38.443 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:38.443 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:05:38.443 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:05:24.159394+0000", 2024-09-21T06:05:38.444 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:05:38.444 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:05:38.444 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:05:38.444 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:05:38.444 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:05:38.444 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:05:38.444 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:05:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:05:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:05:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:05:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:05:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:05:38.445 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 7, 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:05:38.446 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:38.447 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:38.448 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:38.448 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:38.448 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:38.448 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:38.448 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:38.448 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:38.448 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:38.449 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:38.449 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:38.449 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:05:38.449 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:05:38.449 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:05:38.449 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:05:38.450 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:05:38.450 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:38.450 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:38.450 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:38.450 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:38.450 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:38.451 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:38.451 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:38.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.451 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "16", 2024-09-21T06:05:38.451 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:38.451 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:38.451 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:38.452 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:38.453 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:38.454 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:38.455 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:38.455 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:38.455 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:38.455 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:38.455 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:38.455 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:38.455 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:38.456 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:38.456 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:38.456 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:38.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:05:38.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:05:38.456 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.456 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:38.457 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:05:38.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.457 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:38.457 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:38.457 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:05:38.457 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.458 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 6, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:20.575073+0000", 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:38.459 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:38.460 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "43", 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:38.461 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:38.462 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:38.463 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 7, 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:05:38.465 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:21.613973+0000", 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:38.466 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.467 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "44", 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:38.468 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:38.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:38.470 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:38.471 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:38.472 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.473 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.475 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.476 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:05:38.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.478 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.480 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.481 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:05:38.483 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.484 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.485 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.486 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.487 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:38.488 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.490 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.490 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:38.490 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.490 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.490 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.490 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.493 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:05:38.494 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:05:38.495 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.496 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.497 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.498 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.500 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.501 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:05:38.501 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:38.501 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.501 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.501 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.501 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:05:38.502 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:05:38.502 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:05:38.502 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:05:38.502 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.502 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.502 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.502 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.503 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.503 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:38.503 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.503 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.503 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.503 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.504 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.504 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.504 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.504 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.504 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.505 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.505 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.505 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.505 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.505 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:05:38.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.506 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:05:38.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.506 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.507 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:05:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:05:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.508 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.509 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:05:38.510 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.510 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:05:38.511 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.511 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.511 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.511 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.511 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:05:38.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:05:38.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:38.513 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.513 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.514 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:05:38.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:05:38.514 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:05:38.514 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:05:38.515 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.515 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.515 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.515 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.515 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.515 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:05:38.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.518 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.518 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:05:38.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.519 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.519 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.519 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.519 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.519 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.520 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:05:38.520 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.520 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.520 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.520 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:05:38.521 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.521 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.521 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.521 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.521 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.522 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.522 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:05:38.522 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.522 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.522 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.524 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.525 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.526 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.526 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.526 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:38.526 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:38.526 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:38.527 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:38.527 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:38.527 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:38.527 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:38.527 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:38.527 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.528 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:38.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.530 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.531 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:05:38.532 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:05:38.533 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.534 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:05:38.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.536 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.537 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:05:38.540 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:05:38.541 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:05:38.542 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:05:38.542 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:05:38.542 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:38.542 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:38.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab40078b90 msgr2=0x7fab4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:38.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab40078b90 0x7fab4007b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab50001720 tx=0x7fab50009040 comp rx=0 tx=0).stop 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 msgr2=0x7fab601f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab601f5bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fab4c034040 tx=0x7fab4c003910 comp rx=0 tx=0).stop 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 shutdown_connections 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab6013fc50 0x7fab601f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab600d0de0 0x7fab601f5bc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab40078b90 0x7fab4007b0a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 --2- 172.21.15.118:0/2920327392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab600cf1e0 0x7fab6015fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 >> 172.21.15.118:0/2920327392 conn(0x7fab6006d110 msgr2=0x7fab60157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 shutdown_connections 2024-09-21T06:05:38.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:38.441+0000 7fab65800640 1 -- 172.21.15.118:0/2920327392 wait complete. 2024-09-21T06:05:38.545 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:05:39.236 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:05:39.234+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-21T06:05:43.546 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 -- 172.21.15.118:0/2603835420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 msgr2=0x7fd0980b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 --2- 172.21.15.118:0/2603835420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980b5fc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd098072570 tx=0x7fd09002a980 comp rx=0 tx=0).stop 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 -- 172.21.15.118:0/2603835420 shutdown_connections 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 --2- 172.21.15.118:0/2603835420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980b5fc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 --2- 172.21.15.118:0/2603835420 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0980cfe30 0x7fd0980d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 --2- 172.21.15.118:0/2603835420 >> v2:172.21.15.149:3300/0 conn(0x7fd098073fa0 0x7fd0980749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 -- 172.21.15.118:0/2603835420 >> 172.21.15.118:0/2603835420 conn(0x7fd09806d6e0 msgr2=0x7fd0980b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 -- 172.21.15.118:0/2603835420 shutdown_connections 2024-09-21T06:05:43.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.786+0000 7fd09d400640 1 -- 172.21.15.118:0/2603835420 wait complete. 2024-09-21T06:05:43.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.788+0000 7fd09d400640 1 Processor -- start 2024-09-21T06:05:43.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.789+0000 7fd09d400640 1 -- start start 2024-09-21T06:05:43.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd09d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd098073fa0 0x7fd0981f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:43.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd09d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:43.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd09d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0980cfe30 0x7fd0980cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:43.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd09d400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd09815d7b0 con 0x7fd0980b5bb0 2024-09-21T06:05:43.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd09d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd09815d630 con 0x7fd0980cfe30 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd09d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd09815d930 con 0x7fd098073fa0 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd08f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd08f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35512/0 (socket says 172.21.15.118:35512) 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.790+0000 7fd08f400640 1 -- 172.21.15.118:0/2420681061 learned_addr learned my addr 172.21.15.118:0/2420681061 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd097e00640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd098073fa0 0x7fd0981f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd09ca00640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0980cfe30 0x7fd0980cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd08f400640 1 -- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd098073fa0 msgr2=0x7fd0981f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd08f400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd098073fa0 0x7fd0981f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd08f400640 1 -- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0980cfe30 msgr2=0x7fd0980cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd08f400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0980cfe30 0x7fd0980cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd08f400640 1 -- 172.21.15.118:0/2420681061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0980ca2c0 con 0x7fd0980b5bb0 2024-09-21T06:05:43.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd08f400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980c9d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd08000d680 tx=0x7fd08000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:43.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080017070 con 0x7fd0980b5bb0 2024-09-21T06:05:43.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd080005310 con 0x7fd0980b5bb0 2024-09-21T06:05:43.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.791+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0981f5420 con 0x7fd0980b5bb0 2024-09-21T06:05:43.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.792+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080009820 con 0x7fd0980b5bb0 2024-09-21T06:05:43.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.792+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0981f59e0 con 0x7fd0980b5bb0 2024-09-21T06:05:43.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.793+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0980cd0a0 con 0x7fd0980b5bb0 2024-09-21T06:05:43.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.794+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0800099c0 con 0x7fd0980b5bb0 2024-09-21T06:05:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.795+0000 7fd094c00640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.795+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fd08009ae10 con 0x7fd0980b5bb0 2024-09-21T06:05:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.795+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7fd074080830 con 0x7fd0980b5bb0 2024-09-21T06:05:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.795+0000 7fd097e00640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:43.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.796+0000 7fd097e00640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd088005fd0 tx=0x7fd08800f670 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:43.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.799+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd0980cd0a0 con 0x7fd0980b5bb0 2024-09-21T06:05:43.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.987+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fd0981f51b0 con 0x7fd0980b5bb0 2024-09-21T06:05:43.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.988+0000 7fd094c00640 1 -- 172.21.15.118:0/2420681061 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34789 (secure 0 0 0) 0x7fd08009e030 con 0x7fd0980b5bb0 2024-09-21T06:05:43.991 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:43.991 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:43.991 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 48, 2024-09-21T06:05:43.991 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:43.991 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:05:42.251375+0000", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:05:43.992 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 7, 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:05:43.993 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:43.994 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:43.995 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:43.996 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:43.997 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:05:43.998 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:43.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 6, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:20.575073+0000", 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:44.000 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:44.001 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:44.002 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:44.003 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:05:44.004 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:44.005 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 7, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:21.613973+0000", 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:44.006 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:44.007 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:44.008 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:44.009 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:44.010 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:44.011 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.5, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.5, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.5, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.5, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:44.012 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.014 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.015 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.016 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.018 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.019 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.020 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:05:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.022 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.023 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.024 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.025 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.026 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.030 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.031 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.032 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.033 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.036 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.037 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.038 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.040 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:05:44.041 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.043 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.044 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.045 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.046 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:44.047 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:05:44.048 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.049 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.050 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.051 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.052 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.053 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.054 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.056 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.057 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.058 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.059 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.060 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.062 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.063 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.064 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.065 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.066 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.067 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:44.068 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.069 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.070 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.071 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.072 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.073 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.6", 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 4 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.074 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.13", 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:05:44.075 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.076 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.077 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:44.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 msgr2=0x7fd07407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:44.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd088005fd0 tx=0x7fd08800f670 comp rx=0 tx=0).stop 2024-09-21T06:05:44.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 msgr2=0x7fd0980c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980c9d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd08000d680 tx=0x7fd08000db40 comp rx=0 tx=0).stop 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 shutdown_connections 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0980cfe30 0x7fd0980cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0980b5bb0 0x7fd0980c9d80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 --2- 172.21.15.118:0/2420681061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd098073fa0 0x7fd0981f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 >> 172.21.15.118:0/2420681061 conn(0x7fd09806d6e0 msgr2=0x7fd09815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 shutdown_connections 2024-09-21T06:05:44.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:43.991+0000 7fd09d400640 1 -- 172.21.15.118:0/2420681061 wait complete. 2024-09-21T06:05:44.081 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T06:05:44.081 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:44.081 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:44.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:44.118 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-21T06:05:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-21T06:05:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:05:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:05:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.267984 s, 196 MB/s 2024-09-21T06:05:44.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:05:44.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:05:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.692+0000 7f23dc800640 1 -- 172.21.15.118:0/2113052085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40d0de0 msgr2=0x7f23d40d11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.692+0000 7f23dc800640 1 --2- 172.21.15.118:0/2113052085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40d0de0 0x7f23d40d11f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009830 tx=0x7f23c402a500 comp rx=0 tx=0).stop 2024-09-21T06:05:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.693+0000 7f23dc800640 1 -- 172.21.15.118:0/2113052085 shutdown_connections 2024-09-21T06:05:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.693+0000 7f23dc800640 1 --2- 172.21.15.118:0/2113052085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23d40cf1e0 0x7f23d40cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.693+0000 7f23dc800640 1 --2- 172.21.15.118:0/2113052085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40d0de0 0x7f23d40d11f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.693+0000 7f23dc800640 1 -- 172.21.15.118:0/2113052085 >> 172.21.15.118:0/2113052085 conn(0x7f23d406d110 msgr2=0x7f23d406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.693+0000 7f23dc800640 1 -- 172.21.15.118:0/2113052085 shutdown_connections 2024-09-21T06:05:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.693+0000 7f23dc800640 1 -- 172.21.15.118:0/2113052085 wait complete. 2024-09-21T06:05:44.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.695+0000 7f23dc800640 1 Processor -- start 2024-09-21T06:05:44.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.695+0000 7f23dc800640 1 -- start start 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.696+0000 7f23dc800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40cf1e0 0x7f23d413f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.696+0000 7f23dc800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23d40d0de0 0x7f23d415f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.696+0000 7f23dc800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d413fc50 0x7f23d415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.696+0000 7f23dc800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f23d40cfcb0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.696+0000 7f23dc800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23d40cfb30 con 0x7f23d413fc50 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.696+0000 7f23dc800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23d40cfe30 con 0x7f23d40d0de0 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40cf1e0 0x7f23d413f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40cf1e0 0x7f23d413f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35526/0 (socket says 172.21.15.118:35526) 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 -- 172.21.15.118:0/505029026 learned_addr learned my addr 172.21.15.118:0/505029026 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9400640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23d40d0de0 0x7f23d415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23da800640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d413fc50 0x7f23d415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 -- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23d40d0de0 msgr2=0x7f23d415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:44.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23d40d0de0 0x7f23d415f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 -- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d413fc50 msgr2=0x7f23d415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:44.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d413fc50 0x7f23d415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 -- 172.21.15.118:0/505029026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d41f5ea0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.697+0000 7f23d9e00640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40cf1e0 0x7f23d413f090 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c3f0 tx=0x7f23c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:44.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.698+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8017070 con 0x7f23d40cf1e0 2024-09-21T06:05:44.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.698+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23c80035f0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.698+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8003a40 con 0x7f23d40cf1e0 2024-09-21T06:05:44.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.698+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d41f6180 con 0x7f23d40cf1e0 2024-09-21T06:05:44.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.698+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41f6740 con 0x7f23d40cf1e0 2024-09-21T06:05:44.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.699+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d40d0370 con 0x7f23d40cf1e0 2024-09-21T06:05:44.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.700+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23c801a070 con 0x7f23d40cf1e0 2024-09-21T06:05:44.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.701+0000 7f23ce000640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23b8078b90 0x7f23b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:44.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.701+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f23c8099ff0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.701+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f23b80807d0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.702+0000 7f23d9400640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23b8078b90 0x7f23b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:44.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.702+0000 7f23d9400640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23b8078b90 0x7f23b807b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23c4034000 tx=0x7f23c4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:44.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.705+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f23c8061db0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.891+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f23d41572b0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.892+0000 7f23ce000640 1 -- 172.21.15.118:0/505029026 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34789 (secure 0 0 0) 0x7f23c80667e0 con 0x7f23d40cf1e0 2024-09-21T06:05:44.895 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:44.895 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:44.895 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 48, 2024-09-21T06:05:44.895 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:44.895 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:05:44.895 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:05:42.251375+0000", 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:05:44.896 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 7, 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:05:44.897 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:05:44.898 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:44.899 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:44.900 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:05:44.902 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:44.903 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 6, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:20.575073+0000", 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:44.904 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:44.906 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:44.907 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:44.908 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.909 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 7, 2024-09-21T06:05:44.910 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:21.613973+0000", 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:44.911 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:44.912 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:44.913 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:44.914 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:44.915 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.5, 2024-09-21T06:05:44.916 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.5, 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.5, 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.5, 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.917 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.918 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.919 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.920 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.921 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.922 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.923 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.924 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.925 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.926 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.927 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:44.928 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.929 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.930 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.931 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.932 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:05:44.933 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:05:44.934 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.935 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:05:44.936 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.937 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.938 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:44.939 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.940 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.941 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.942 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.943 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.944 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:05:44.945 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.947 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.948 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.951 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.952 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.953 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.954 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.955 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:44.957 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.958 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.959 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:05:44.960 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:05:44.961 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:44.962 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:05:44.963 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:44.964 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.965 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.966 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.967 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:44.968 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.6", 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 4 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.969 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.13", 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:05:44.970 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:05:44.971 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:44.972 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:44.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23b8078b90 msgr2=0x7f23b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23b8078b90 0x7f23b807b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23c4034000 tx=0x7f23c4004730 comp rx=0 tx=0).stop 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40cf1e0 msgr2=0x7f23d413f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40cf1e0 0x7f23d413f090 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c3f0 tx=0x7f23c800c8b0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 shutdown_connections 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23d413fc50 0x7f23d415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f23b8078b90 0x7f23b807b0a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23d40d0de0 0x7f23d415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 --2- 172.21.15.118:0/505029026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d40cf1e0 0x7f23d413f090 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 >> 172.21.15.118:0/505029026 conn(0x7f23d406d110 msgr2=0x7f23d4140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 shutdown_connections 2024-09-21T06:05:44.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:44.895+0000 7f23dc800640 1 -- 172.21.15.118:0/505029026 wait complete. 2024-09-21T06:05:44.975 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:45.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 -- 172.21.15.118:0/3370109482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc15f660 msgr2=0x7f36cc06ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:45.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 --2- 172.21.15.118:0/3370109482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc15f660 0x7f36cc06ecd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0cd4b0 tx=0x7f36b802a510 comp rx=0 tx=0).stop 2024-09-21T06:05:45.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 -- 172.21.15.118:0/3370109482 shutdown_connections 2024-09-21T06:05:45.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 --2- 172.21.15.118:0/3370109482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36cc06f210 0x7f36cc15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 --2- 172.21.15.118:0/3370109482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc15f660 0x7f36cc06ecd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 -- 172.21.15.118:0/3370109482 >> 172.21.15.118:0/3370109482 conn(0x7f36cc06d110 msgr2=0x7f36cc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:45.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 -- 172.21.15.118:0/3370109482 shutdown_connections 2024-09-21T06:05:45.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.192+0000 7f36d2000640 1 -- 172.21.15.118:0/3370109482 wait complete. 2024-09-21T06:05:45.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.195+0000 7f36d2000640 1 Processor -- start 2024-09-21T06:05:45.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.195+0000 7f36d2000640 1 -- start start 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36d2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc06f210 0x7f36cc146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36d2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36cc0b44c0 0x7f36cc140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36d2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36cc15f660 0x7f36cc153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36d2000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc15c5d0 con 0x7f36cc06f210 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36d2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc15c450 con 0x7f36cc15f660 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36d2000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f36cc071010 con 0x7f36cc0b44c0 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36cb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc06f210 0x7f36cc146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36cb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc06f210 0x7f36cc146170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35546/0 (socket says 172.21.15.118:35546) 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.196+0000 7f36cb400640 1 -- 172.21.15.118:0/3806041055 learned_addr learned my addr 172.21.15.118:0/3806041055 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:45.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cbe00640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36cc15f660 0x7f36cc153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36caa00640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36cc0b44c0 0x7f36cc140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cb400640 1 -- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36cc0b44c0 msgr2=0x7f36cc140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cb400640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36cc0b44c0 0x7f36cc140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cb400640 1 -- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36cc15f660 msgr2=0x7f36cc153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cb400640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36cc15f660 0x7f36cc153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cb400640 1 -- 172.21.15.118:0/3806041055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc14c5a0 con 0x7f36cc06f210 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cbe00640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36cc15f660 0x7f36cc153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36cb400640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc06f210 0x7f36cc146170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00b3f0 tx=0x7f36bc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc015020 con 0x7f36cc06f210 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36bc011920 con 0x7f36cc06f210 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36cc145690 con 0x7f36cc06f210 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.197+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc011d70 con 0x7f36cc06f210 2024-09-21T06:05:45.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.198+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36cc145c50 con 0x7f36cc06f210 2024-09-21T06:05:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.199+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36cc15bd00 con 0x7f36cc06f210 2024-09-21T06:05:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.200+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36bc018020 con 0x7f36cc06f210 2024-09-21T06:05:45.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.201+0000 7f36c3400640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f36ac078bc0 0x7f36ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:45.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.201+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f36bc09a960 con 0x7f36cc06f210 2024-09-21T06:05:45.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.201+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f36ac080800 con 0x7f36cc06f210 2024-09-21T06:05:45.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.201+0000 7f36caa00640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f36ac078bc0 0x7f36ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:45.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.202+0000 7f36caa00640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f36ac078bc0 0x7f36ac07b0d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f36b8033000 tx=0x7f36b8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:45.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.206+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f36bc01f030 con 0x7f36cc06f210 2024-09-21T06:05:45.271 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:05:45.268+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2024-09-21T06:05:45.292 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:05:45.290+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-21T06:05:45.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.428+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36cc15d3d0 con 0x7f36cc06f210 2024-09-21T06:05:45.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.429+0000 7f36c3400640 1 -- 172.21.15.118:0/3806041055 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f36bc062d50 con 0x7f36cc06f210 2024-09-21T06:05:45.431 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:45.432 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:05:45.432 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f36ac078bc0 msgr2=0x7f36ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f36ac078bc0 0x7f36ac07b0d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f36b8033000 tx=0x7f36b8004730 comp rx=0 tx=0).stop 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc06f210 msgr2=0x7f36cc146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc06f210 0x7f36cc146170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00b3f0 tx=0x7f36bc00b8b0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 shutdown_connections 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36cc15f660 0x7f36cc153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f36ac078bc0 0x7f36ac07b0d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36cc0b44c0 0x7f36cc140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 --2- 172.21.15.118:0/3806041055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36cc06f210 0x7f36cc146170 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 >> 172.21.15.118:0/3806041055 conn(0x7f36cc06d110 msgr2=0x7f36cc151760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 shutdown_connections 2024-09-21T06:05:45.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:45.431+0000 7f36d2000640 1 -- 172.21.15.118:0/3806041055 wait complete. 2024-09-21T06:05:45.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:05:45.695 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":5256,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.505081354000001,"mdsmap_epoch":25,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":27.435833788} 2024-09-21T06:05:45.696 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 5256, "mdsmap_epoch": 25, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 22.505081354, "state": "up:active", "uptime": 27.435833788, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:05:45.696 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:05:45.696 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:45.696 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:45.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:45.731 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-21T06:05:45.806 INFO:teuthology.orchestra.run.smithi118.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-21T06:05:45.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:05:45.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:45.808 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-21T06:05:45.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:45.889 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-21T06:05:46.024 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:05:46.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.247+0000 7f38eb600640 1 -- 172.21.15.118:0/2673681385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 msgr2=0x7f38cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:46.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.247+0000 7f38eb600640 1 --2- 172.21.15.118:0/2673681385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38cc00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f38dc001ec0 tx=0x7f38cc005830 comp rx=0 tx=0).stop 2024-09-21T06:05:46.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.247+0000 7f38eb600640 1 -- 172.21.15.118:0/2673681385 shutdown_connections 2024-09-21T06:05:46.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.247+0000 7f38eb600640 1 --2- 172.21.15.118:0/2673681385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38cc00b9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.247+0000 7f38eb600640 1 -- 172.21.15.118:0/2673681385 >> 172.21.15.118:0/2673681385 conn(0x7f38e406d110 msgr2=0x7f38e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:46.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.247+0000 7f38eb600640 1 -- 172.21.15.118:0/2673681385 shutdown_connections 2024-09-21T06:05:46.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.247+0000 7f38eb600640 1 -- 172.21.15.118:0/2673681385 wait complete. 2024-09-21T06:05:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.249+0000 7f38eb600640 1 Processor -- start 2024-09-21T06:05:46.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.249+0000 7f38eb600640 1 -- start start 2024-09-21T06:05:46.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38eb600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38e415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:46.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38eb600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38e40cf200 0x7f38e40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:46.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38eb600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38e41f5ca0 0x7f38e41f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:46.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38eb600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f38e40d16a0 con 0x7f38cc005270 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38eb600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38e4142730 con 0x7f38e40cf200 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38eb600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38e413ac10 con 0x7f38e41f5ca0 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38e8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38e415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38e8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38e415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40368/0 (socket says 172.21.15.118:40368) 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.251+0000 7f38e8c00640 1 -- 172.21.15.118:0/199655233 learned_addr learned my addr 172.21.15.118:0/199655233 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e3e00640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38e40cf200 0x7f38e40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e9600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38e41f5ca0 0x7f38e41f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e8c00640 1 -- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38e41f5ca0 msgr2=0x7f38e41f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e8c00640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38e41f5ca0 0x7f38e41f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e8c00640 1 -- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38e40cf200 msgr2=0x7f38e40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e8c00640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38e40cf200 0x7f38e40cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e8c00640 1 -- 172.21.15.118:0/199655233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e40cfb50 con 0x7f38cc005270 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e9600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38e41f5ca0 0x7f38e41f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e8c00640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38e415a180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38d80066e0 tx=0x7f38d80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8015070 con 0x7f38cc005270 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38d8011900 con 0x7f38cc005270 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8011d30 con 0x7f38cc005270 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e4072e50 con 0x7f38cc005270 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.252+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e4073410 con 0x7f38cc005270 2024-09-21T06:05:46.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.254+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e4142c90 con 0x7f38cc005270 2024-09-21T06:05:46.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.255+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38d8018070 con 0x7f38cc005270 2024-09-21T06:05:46.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.256+0000 7f38e0c00640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38c4078b90 0x7f38c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.256+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f38d809bb60 con 0x7f38cc005270 2024-09-21T06:05:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.257+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f38c4080830 con 0x7f38cc005270 2024-09-21T06:05:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.257+0000 7f38e3e00640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38c4078b90 0x7f38c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.257+0000 7f38e3e00640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38c4078b90 0x7f38c407b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38e40cfd60 tx=0x7f38d0005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:46.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.261+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f38e40cfb50 con 0x7f38cc005270 2024-09-21T06:05:46.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.448+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f38e41532a0 con 0x7f38cc005270 2024-09-21T06:05:46.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.450+0000 7f38e0c00640 1 -- 172.21.15.118:0/199655233 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34789 (secure 0 0 0) 0x7f38d8063f60 con 0x7f38cc005270 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 48, 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:05:42.251375+0000", 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:05:46.453 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 7, 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:05:46.454 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:46.455 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:46.456 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:46.457 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:46.458 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:46.459 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:46.460 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.461 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 6, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:20.575073+0000", 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:46.462 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:46.463 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:46.464 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:46.465 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:46.466 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:46.467 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 7, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:21.613973+0000", 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:46.468 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:05:46.469 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:46.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:46.471 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:46.472 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:05:46.473 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.5, 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.5, 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.5, 2024-09-21T06:05:46.474 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.5, 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.475 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.477 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.478 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.479 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:46.480 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.481 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.484 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:05:46.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.486 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.487 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.489 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.490 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.491 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:46.492 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.493 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.494 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.495 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.496 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:05:46.497 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.498 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.500 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.501 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.502 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.504 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.506 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.507 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.508 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.509 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:05:46.510 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:05:46.511 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:05:46.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:05:46.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:05:46.514 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:46.515 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:46.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.520 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.521 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.522 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.524 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.525 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:46.526 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.6", 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 4 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.13", 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:46.527 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:05:46.528 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:05:46.529 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:05:46.530 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:05:46.530 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:05:46.530 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:46.530 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:46.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38c4078b90 msgr2=0x7f38c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:46.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38c4078b90 0x7f38c407b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38e40cfd60 tx=0x7f38d0005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:46.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 msgr2=0x7f38e415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38e415a180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38d80066e0 tx=0x7f38d80039c0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 shutdown_connections 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38c4078b90 0x7f38c407b0a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38e41f5ca0 0x7f38e41f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38e40cf200 0x7f38e40cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 --2- 172.21.15.118:0/199655233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38cc005270 0x7f38e415a180 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 >> 172.21.15.118:0/199655233 conn(0x7f38e406d110 msgr2=0x7f38e41537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 shutdown_connections 2024-09-21T06:05:46.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:46.452+0000 7f38eb600640 1 -- 172.21.15.118:0/199655233 wait complete. 2024-09-21T06:05:46.533 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:05:48.697 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:05:48.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:05:50.295 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:05:50.293+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-21T06:05:51.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:05:51.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.763+0000 7fc0ec600640 1 -- 172.21.15.118:0/4029729099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0cc004d40 msgr2=0x7fc0cc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:51.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.763+0000 7fc0ec600640 1 --2- 172.21.15.118:0/4029729099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0cc004d40 0x7fc0cc005150 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc005fd0 tx=0x7fc0cc005830 comp rx=0 tx=0).stop 2024-09-21T06:05:51.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.763+0000 7fc0ea600640 1 -- 172.21.15.118:0/4029729099 reap_dead start 2024-09-21T06:05:51.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.764+0000 7fc0ec600640 1 -- 172.21.15.118:0/4029729099 shutdown_connections 2024-09-21T06:05:51.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.764+0000 7fc0ec600640 1 -- 172.21.15.118:0/4029729099 >> 172.21.15.118:0/4029729099 conn(0x7fc0e406d110 msgr2=0x7fc0e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:51.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.764+0000 7fc0ec600640 1 -- 172.21.15.118:0/4029729099 shutdown_connections 2024-09-21T06:05:51.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.764+0000 7fc0ec600640 1 -- 172.21.15.118:0/4029729099 wait complete. 2024-09-21T06:05:51.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.766+0000 7fc0ec600640 1 Processor -- start 2024-09-21T06:05:51.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.766+0000 7fc0ec600640 1 -- start start 2024-09-21T06:05:51.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ec600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0cc004d40 0x7fc0e4159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ec600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e4157cc0 0x7fc0e41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ec600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0e4072cd0 0x7fc0e40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ec600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e40cf5d0 con 0x7fc0e4072cd0 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ec600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e40cf450 con 0x7fc0e4157cc0 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ec600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e40cf750 con 0x7fc0cc004d40 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0e4072cd0 0x7fc0e40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0e4072cd0 0x7fc0e40730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40394/0 (socket says 172.21.15.118:40394) 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 -- 172.21.15.118:0/743601804 learned_addr learned my addr 172.21.15.118:0/743601804 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0e9c00640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0cc004d40 0x7fc0e4159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0e9200640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e4157cc0 0x7fc0e41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:51.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 -- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0cc004d40 msgr2=0x7fc0e4159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:51.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0cc004d40 0x7fc0e4159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:51.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 -- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e4157cc0 msgr2=0x7fc0e41580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:51.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e4157cc0 0x7fc0e41580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:51.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.768+0000 7fc0ea600640 1 -- 172.21.15.118:0/743601804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e415a580 con 0x7fc0e4072cd0 2024-09-21T06:05:51.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.769+0000 7fc0ea600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0e4072cd0 0x7fc0e40730e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc02b340 tx=0x7fc0dc033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:51.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.769+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc042070 con 0x7fc0e4072cd0 2024-09-21T06:05:51.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.769+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0dc0336e0 con 0x7fc0e4072cd0 2024-09-21T06:05:51.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.769+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e415a860 con 0x7fc0e4072cd0 2024-09-21T06:05:51.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.769+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc038040 con 0x7fc0e4072cd0 2024-09-21T06:05:51.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.769+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e4074b20 con 0x7fc0e4072cd0 2024-09-21T06:05:51.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.770+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e40b5e60 con 0x7fc0e4072cd0 2024-09-21T06:05:51.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.771+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0dc033b10 con 0x7fc0e4072cd0 2024-09-21T06:05:51.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.772+0000 7fc0e1600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0c4078b90 0x7fc0c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:51.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.773+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5767+0+0 (secure 0 0 0) 0x7fc0dc0baa90 con 0x7fc0e4072cd0 2024-09-21T06:05:51.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.773+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7fc0c40807d0 con 0x7fc0e4072cd0 2024-09-21T06:05:51.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.773+0000 7fc0e9c00640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0c4078b90 0x7fc0c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:51.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.774+0000 7fc0e9c00640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0c4078b90 0x7fc0c407b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8006c30 tx=0x7fc0d80067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:51.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.777+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc0e40b5e60 con 0x7fc0e4072cd0 2024-09-21T06:05:51.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.962+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fc0e415cec0 con 0x7fc0e4072cd0 2024-09-21T06:05:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.963+0000 7fc0e1600640 1 -- 172.21.15.118:0/743601804 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) ==== 81+0+34717 (secure 0 0 0) 0x7fc0dc0827a0 con 0x7fc0e4072cd0 2024-09-21T06:05:51.966 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:51.966 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:51.966 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 50, 2024-09-21T06:05:51.966 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:05:51.292439+0000", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:05:51.967 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 7, 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:51.969 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:05:51.970 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:51.971 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:51.972 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:51.973 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.974 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 6, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:20.575073+0000", 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:51.977 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:51.978 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:51.979 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:51.980 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:05:51.981 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 7, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:21.613973+0000", 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:51.983 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:51.984 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "45", 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:51.987 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:51.988 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.5, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.5, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.5, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.5, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:51.990 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:51.991 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.992 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:51.992 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:51.993 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.993 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:51.993 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:05:51.993 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.993 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.993 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.994 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.995 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:51.996 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:51.997 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:51.998 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:51.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.001 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:52.002 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.003 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.004 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.004 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.004 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:05:52.004 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.004 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.004 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.005 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.006 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.007 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:52.008 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:52.009 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.011 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.012 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.013 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:52.014 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.015 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.018 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:52.020 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:52.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.022 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.023 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.024 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:52.025 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.026 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.029 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:52.031 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:52.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:52.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:05:52.035 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.036 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.037 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.038 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:05:52.041 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.6", 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 4 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.13", 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:05:52.043 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:05:52.044 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:05:52.045 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:05:52.045 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:05:52.045 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:05:52.045 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:05:52.045 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:52.045 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:52.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0c4078b90 msgr2=0x7fc0c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:52.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0c4078b90 0x7fc0c407b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8006c30 tx=0x7fc0d80067a0 comp rx=0 tx=0).stop 2024-09-21T06:05:52.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0e4072cd0 msgr2=0x7fc0e40730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:52.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0e4072cd0 0x7fc0e40730e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc02b340 tx=0x7fc0dc033670 comp rx=0 tx=0).stop 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 shutdown_connections 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0e4072cd0 0x7fc0e40730e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e4157cc0 0x7fc0e41580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc0c4078b90 0x7fc0c407b0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 --2- 172.21.15.118:0/743601804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0cc004d40 0x7fc0e4159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 >> 172.21.15.118:0/743601804 conn(0x7fc0e406d110 msgr2=0x7fc0e415b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 shutdown_connections 2024-09-21T06:05:52.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:51.966+0000 7fc0ec600640 1 -- 172.21.15.118:0/743601804 wait complete. 2024-09-21T06:05:52.048 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:05:57.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:05:57.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.278+0000 7f7aef400640 1 -- 172.21.15.118:0/2501396458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7acc004d40 msgr2=0x7f7acc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.278+0000 7f7aef400640 1 --2- 172.21.15.118:0/2501396458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7acc004d40 0x7f7acc005190 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0005fd0 tx=0x7f7acc005830 comp rx=0 tx=0).stop 2024-09-21T06:05:57.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.278+0000 7f7aed400640 1 -- 172.21.15.118:0/2501396458 reap_dead start 2024-09-21T06:05:57.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.278+0000 7f7aef400640 1 -- 172.21.15.118:0/2501396458 shutdown_connections 2024-09-21T06:05:57.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.278+0000 7f7aef400640 1 -- 172.21.15.118:0/2501396458 >> 172.21.15.118:0/2501396458 conn(0x7f7ae806d110 msgr2=0x7f7ae806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:57.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.278+0000 7f7aef400640 1 -- 172.21.15.118:0/2501396458 shutdown_connections 2024-09-21T06:05:57.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.278+0000 7f7aef400640 1 -- 172.21.15.118:0/2501396458 wait complete. 2024-09-21T06:05:57.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.281+0000 7f7aef400640 1 Processor -- start 2024-09-21T06:05:57.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.281+0000 7f7aef400640 1 -- start start 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.282+0000 7f7aef400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7acc004d40 0x7f7ae8143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.282+0000 7f7aef400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ae81407a0 0x7f7ae80c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.282+0000 7f7aef400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae80c5f10 0x7f7ae81f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.282+0000 7f7aef400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae8164e00 con 0x7f7ae80c5f10 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.282+0000 7f7aef400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae8164c80 con 0x7f7acc004d40 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.282+0000 7f7aef400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae8164f80 con 0x7f7ae81407a0 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae80c5f10 0x7f7ae81f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae80c5f10 0x7f7ae81f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40502/0 (socket says 172.21.15.118:40502) 2024-09-21T06:05:57.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 -- 172.21.15.118:0/634297193 learned_addr learned my addr 172.21.15.118:0/634297193 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:57.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aeca00640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7acc004d40 0x7f7ae8143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7adfe00640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ae81407a0 0x7f7ae80c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 -- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ae81407a0 msgr2=0x7f7ae80c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ae81407a0 0x7f7ae80c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 -- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7acc004d40 msgr2=0x7f7ae8143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7acc004d40 0x7f7ae8143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 -- 172.21.15.118:0/634297193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae8144080 con 0x7f7ae80c5f10 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.283+0000 7f7aed400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae80c5f10 0x7f7ae81f8fc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7ae002aea0 tx=0x7f7ae0033b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.284+0000 7f7ae5600640 1 -- 172.21.15.118:0/634297193 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0042070 con 0x7f7ae80c5f10 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.284+0000 7f7ae5600640 1 -- 172.21.15.118:0/634297193 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ae0003970 con 0x7f7ae80c5f10 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.284+0000 7f7ae5600640 1 -- 172.21.15.118:0/634297193 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0038040 con 0x7f7ae80c5f10 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.284+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae80c6320 con 0x7f7ae80c5f10 2024-09-21T06:05:57.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.284+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae81f62a0 con 0x7f7ae80c5f10 2024-09-21T06:05:57.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.285+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae8076b90 con 0x7f7ae80c5f10 2024-09-21T06:05:57.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.286+0000 7f7ae5600640 1 -- 172.21.15.118:0/634297193 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ae0004030 con 0x7f7ae80c5f10 2024-09-21T06:05:57.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.287+0000 7f7ae5600640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ac4078bc0 0x7f7ac407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.287+0000 7f7ae5600640 1 -- 172.21.15.118:0/634297193 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f7ae00bb3e0 con 0x7f7ae80c5f10 2024-09-21T06:05:57.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.288+0000 7f7aeca00640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ac4078bc0 0x7f7ac407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.288+0000 7f7aeca00640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ac4078bc0 0x7f7ac407b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80011a0 tx=0x7f7ad8006b10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:57.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.291+0000 7f7ae5600640 1 -- 172.21.15.118:0/634297193 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7ae8076b90 con 0x7f7ae80c5f10 2024-09-21T06:05:57.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.479+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f7ae80d1890 con 0x7f7ae80c5f10 2024-09-21T06:05:57.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.480+0000 7f7ae5600640 1 -- 172.21.15.118:0/634297193 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) ==== 81+0+34646 (secure 0 0 0) 0x7f7ae80c6320 con 0x7f7ae80c5f10 2024-09-21T06:05:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 52, 2024-09-21T06:05:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:05:53.301395+0000", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:05:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 7, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:05:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "52", 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 6, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:20.575073+0000", 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "52", 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:05:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 7, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:21.613973+0000", 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "52", 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.5, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.5, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.5, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.5, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:05:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:05:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:05:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:05:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:05:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:05:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:05:57.547 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.548 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.549 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.550 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.551 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:57.552 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.6", 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:57.553 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 4 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.13", 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.554 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.555 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.556 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.482+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ac4078bc0 msgr2=0x7f7ac407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.482+0000 7f7aef400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ac4078bc0 0x7f7ac407b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80011a0 tx=0x7f7ad8006b10 comp rx=0 tx=0).stop 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae80c5f10 msgr2=0x7f7ae81f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae80c5f10 0x7f7ae81f8fc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7ae002aea0 tx=0x7f7ae0033b80 comp rx=0 tx=0).stop 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 shutdown_connections 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae80c5f10 0x7f7ae81f8fc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ac4078bc0 0x7f7ac407b0d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ae81407a0 0x7f7ae80c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 --2- 172.21.15.118:0/634297193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7acc004d40 0x7f7ae8143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 >> 172.21.15.118:0/634297193 conn(0x7f7ae806d110 msgr2=0x7f7ae815e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 shutdown_connections 2024-09-21T06:05:57.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.483+0000 7f7aef400640 1 -- 172.21.15.118:0/634297193 wait complete. 2024-09-21T06:05:57.559 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-21T06:05:57.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:05:57.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.776+0000 7fc6a3600640 1 -- 172.21.15.118:0/1918056924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c142e40 msgr2=0x7fc69c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.776+0000 7fc6a3600640 1 --2- 172.21.15.118:0/1918056924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c142e40 0x7fc69c0d13c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc69c071c00 tx=0x7fc69402aa30 comp rx=0 tx=0).stop 2024-09-21T06:05:57.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.777+0000 7fc6a3600640 1 -- 172.21.15.118:0/1918056924 shutdown_connections 2024-09-21T06:05:57.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.777+0000 7fc6a3600640 1 --2- 172.21.15.118:0/1918056924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c142e40 0x7fc69c0d13c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.777+0000 7fc6a3600640 1 --2- 172.21.15.118:0/1918056924 >> v2:172.21.15.149:3300/0 conn(0x7fc69c13fae0 0x7fc69c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.777+0000 7fc6a3600640 1 -- 172.21.15.118:0/1918056924 >> 172.21.15.118:0/1918056924 conn(0x7fc69c06d110 msgr2=0x7fc69c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:57.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.777+0000 7fc6a3600640 1 -- 172.21.15.118:0/1918056924 shutdown_connections 2024-09-21T06:05:57.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.777+0000 7fc6a3600640 1 -- 172.21.15.118:0/1918056924 wait complete. 2024-09-21T06:05:57.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.779+0000 7fc6a3600640 1 Processor -- start 2024-09-21T06:05:57.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.779+0000 7fc6a3600640 1 -- start start 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.780+0000 7fc6a3600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c13fae0 0x7fc69c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.780+0000 7fc6a3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c13fef0 0x7fc69c074640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.780+0000 7fc6a3600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc69c142e40 0x7fc69c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.780+0000 7fc6a3600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c0cfa70 con 0x7fc69c13fae0 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.780+0000 7fc6a3600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c0cf8f0 con 0x7fc69c13fef0 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.780+0000 7fc6a3600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c0cfbf0 con 0x7fc69c142e40 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c13fae0 0x7fc69c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c13fae0 0x7fc69c157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40528/0 (socket says 172.21.15.118:40528) 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 -- 172.21.15.118:0/582162721 learned_addr learned my addr 172.21.15.118:0/582162721 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a1600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc69c142e40 0x7fc69c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc69be00640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c13fef0 0x7fc69c074640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 -- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc69c142e40 msgr2=0x7fc69c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc69c142e40 0x7fc69c15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 -- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c13fef0 msgr2=0x7fc69c074640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:57.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c13fef0 0x7fc69c074640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:57.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 -- 172.21.15.118:0/582162721 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c1552e0 con 0x7fc69c13fae0 2024-09-21T06:05:57.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a1600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc69c142e40 0x7fc69c15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:57.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.781+0000 7fc6a0c00640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c13fae0 0x7fc69c157520 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00e7c0 tx=0x7fc68c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:57.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.782+0000 7fc698c00640 1 -- 172.21.15.118:0/582162721 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c00ccc0 con 0x7fc69c13fae0 2024-09-21T06:05:57.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.782+0000 7fc698c00640 1 -- 172.21.15.118:0/582162721 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc68c010430 con 0x7fc69c13fae0 2024-09-21T06:05:57.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.782+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c1f9cb0 con 0x7fc69c13fae0 2024-09-21T06:05:57.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.782+0000 7fc698c00640 1 -- 172.21.15.118:0/582162721 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c010860 con 0x7fc69c13fae0 2024-09-21T06:05:57.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.782+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c073a90 con 0x7fc69c13fae0 2024-09-21T06:05:57.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.783+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c161360 con 0x7fc69c13fae0 2024-09-21T06:05:57.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.784+0000 7fc698c00640 1 -- 172.21.15.118:0/582162721 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc68c010a00 con 0x7fc69c13fae0 2024-09-21T06:05:57.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.785+0000 7fc698c00640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc67c078bc0 0x7fc67c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:57.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.785+0000 7fc698c00640 1 -- 172.21.15.118:0/582162721 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7fc68c09b8c0 con 0x7fc69c13fae0 2024-09-21T06:05:57.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.786+0000 7fc69be00640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc67c078bc0 0x7fc67c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:57.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.786+0000 7fc69be00640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc67c078bc0 0x7fc67c07b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc69c154ab0 tx=0x7fc688009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:57.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.789+0000 7fc698c00640 1 -- 172.21.15.118:0/582162721 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc69c161360 con 0x7fc69c13fae0 2024-09-21T06:05:57.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.972+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fc69c1424d0 con 0x7fc69c13fae0 2024-09-21T06:05:57.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.973+0000 7fc698c00640 1 -- 172.21.15.118:0/582162721 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) ==== 81+0+34646 (secure 0 0 0) 0x7fc69c1424d0 con 0x7fc69c13fae0 2024-09-21T06:05:57.976 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:57.976 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:05:57.976 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 52, 2024-09-21T06:05:57.976 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:05:57.976 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:05:53.301395+0000", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:05:57.977 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 7, 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:05:57.978 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:05:57.979 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "52", 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:57.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:57.981 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:57.982 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.983 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.984 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 6, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:20.575073+0000", 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:57.985 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:57.986 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "52", 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:57.987 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:57.988 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:05:57.989 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:05:57.990 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 7, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:05:21.613973+0000", 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:05:57.991 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:05:57.992 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "52", 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:05:57.993 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:05:57.994 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:05:57.995 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.996 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.5, 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.5, 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.5, 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.5, 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.997 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.998 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:57.999 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.001 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:05:58.002 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:58.003 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.006 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.007 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:58.009 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.010 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.011 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.012 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:05:58.013 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:58.014 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:05:58.015 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:05:58.016 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.017 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.018 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:58.019 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.020 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.021 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:05:58.022 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:05:58.023 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.024 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:58.025 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 47, 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.029 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:58.032 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.033 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:05:58.035 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:05:58.036 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 42, 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:05:58.039 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:05:58.040 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.042 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.045 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:05:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.6", 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 4 2024-09-21T06:05:58.047 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "7.13", 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:05:58.048 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:05:58.049 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:05:58.050 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:05:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc67c078bc0 msgr2=0x7fc67c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc67c078bc0 0x7fc67c07b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc69c154ab0 tx=0x7fc688009040 comp rx=0 tx=0).stop 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c13fae0 msgr2=0x7fc69c157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c13fae0 0x7fc69c157520 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00e7c0 tx=0x7fc68c00ec80 comp rx=0 tx=0).stop 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 shutdown_connections 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc67c078bc0 0x7fc67c07b0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc69c142e40 0x7fc69c15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c13fef0 0x7fc69c074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 --2- 172.21.15.118:0/582162721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc69c13fae0 0x7fc69c157520 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 >> 172.21.15.118:0/582162721 conn(0x7fc69c06d110 msgr2=0x7fc69c141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.975+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 shutdown_connections 2024-09-21T06:05:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:57.976+0000 7fc6a3600640 1 -- 172.21.15.118:0/582162721 wait complete. 2024-09-21T06:05:58.053 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 -- 172.21.15.118:0/2179798722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 msgr2=0x7f6e580d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 --2- 172.21.15.118:0/2179798722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e580d0240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009830 tx=0x7f6e4002a480 comp rx=0 tx=0).stop 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 -- 172.21.15.118:0/2179798722 shutdown_connections 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 --2- 172.21.15.118:0/2179798722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e580d0240 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 --2- 172.21.15.118:0/2179798722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e58073fa0 0x7f6e580749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 -- 172.21.15.118:0/2179798722 >> 172.21.15.118:0/2179798722 conn(0x7f6e5806d6e0 msgr2=0x7f6e580b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 -- 172.21.15.118:0/2179798722 shutdown_connections 2024-09-21T06:05:58.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.272+0000 7f6e57200640 1 -- 172.21.15.118:0/2179798722 wait complete. 2024-09-21T06:05:58.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.274+0000 7f6e57200640 1 Processor -- start 2024-09-21T06:05:58.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.274+0000 7f6e57200640 1 -- start start 2024-09-21T06:05:58.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e57200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e58073fa0 0x7f6e580c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e57200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e580b5bb0 0x7f6e581f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e57200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e581f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e57200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5815d9c0 con 0x7f6e580cfe30 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e57200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5815d840 con 0x7f6e58073fa0 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e57200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5815db40 con 0x7f6e580b5bb0 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e56800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e581f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e56800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e581f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40542/0 (socket says 172.21.15.118:40542) 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e56800640 1 -- 172.21.15.118:0/2412697304 learned_addr learned my addr 172.21.15.118:0/2412697304 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e4d400640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e580b5bb0 0x7f6e581f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.276+0000 7f6e55e00640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e58073fa0 0x7f6e580c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e56800640 1 -- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e580b5bb0 msgr2=0x7f6e581f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e56800640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e580b5bb0 0x7f6e581f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e56800640 1 -- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e58073fa0 msgr2=0x7f6e580c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e56800640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e58073fa0 0x7f6e580c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e56800640 1 -- 172.21.15.118:0/2412697304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e58132810 con 0x7f6e580cfe30 2024-09-21T06:05:58.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e56800640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e581f5f30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c730 tx=0x7f6e5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:58.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e4ea00640 1 -- 172.21.15.118:0/2412697304 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50017070 con 0x7f6e580cfe30 2024-09-21T06:05:58.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e4ea00640 1 -- 172.21.15.118:0/2412697304 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e50003c60 con 0x7f6e580cfe30 2024-09-21T06:05:58.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e4ea00640 1 -- 172.21.15.118:0/2412697304 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e500052d0 con 0x7f6e580cfe30 2024-09-21T06:05:58.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e581f6770 con 0x7f6e580cfe30 2024-09-21T06:05:58.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.277+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e580b3e20 con 0x7f6e580cfe30 2024-09-21T06:05:58.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.279+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5815f1b0 con 0x7f6e580cfe30 2024-09-21T06:05:58.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.280+0000 7f6e4ea00640 1 -- 172.21.15.118:0/2412697304 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e5001a070 con 0x7f6e580cfe30 2024-09-21T06:05:58.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.281+0000 7f6e4ea00640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e34078b90 0x7f6e3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.281+0000 7f6e4ea00640 1 -- 172.21.15.118:0/2412697304 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f6e5009a3f0 con 0x7f6e580cfe30 2024-09-21T06:05:58.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.281+0000 7f6e55e00640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e34078b90 0x7f6e3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.282+0000 7f6e55e00640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e34078b90 0x7f6e3407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800bb50 tx=0x7f6e4800b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:58.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.286+0000 7f6e4ea00640 1 -- 172.21.15.118:0/2412697304 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6e500622c0 con 0x7f6e580cfe30 2024-09-21T06:05:58.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.511+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e581f6500 con 0x7f6e580cfe30 2024-09-21T06:05:58.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.512+0000 7f6e4ea00640 1 -- 172.21.15.118:0/2412697304 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f6e50066cf0 con 0x7f6e580cfe30 2024-09-21T06:05:58.514 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:05:58.514 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:05:58.515 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e34078b90 msgr2=0x7f6e3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e34078b90 0x7f6e3407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800bb50 tx=0x7f6e4800b2e0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 msgr2=0x7f6e581f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e581f5f30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c730 tx=0x7f6e5000cbf0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 shutdown_connections 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e580cfe30 0x7f6e581f5f30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6e34078b90 0x7f6e3407b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e580b5bb0 0x7f6e581f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 --2- 172.21.15.118:0/2412697304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e58073fa0 0x7f6e580c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 >> 172.21.15.118:0/2412697304 conn(0x7f6e5806d6e0 msgr2=0x7f6e58146020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 shutdown_connections 2024-09-21T06:05:58.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:58.514+0000 7f6e57200640 1 -- 172.21.15.118:0/2412697304 wait complete. 2024-09-21T06:05:58.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:05:58.777 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":5256,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.585583798999998,"mdsmap_epoch":25,"osdmap_epoch":52,"osdmap_epoch_barrier":48,"uptime":40.516335914999999} 2024-09-21T06:05:58.777 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 5256, "mdsmap_epoch": 25, "osdmap_epoch": 52, "osdmap_epoch_barrier": 48, "rank_uptime": 35.585583799, "state": "up:active", "uptime": 40.516335915, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:05:58.778 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:05:58.778 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:58.778 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:58.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:58.813 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-21T06:05:59.241 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:05:59.241 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:05:59.241 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.35125 s, 149 MB/s 2024-09-21T06:05:59.242 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:05:59.242 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:05:59.330 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:05:59.413 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:05:59.413 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:05:59.413 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:59.414 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:59.449 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:05:59.449 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:59.525 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:05:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 -- 172.21.15.118:0/3247335493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fef0 msgr2=0x7f4054142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 --2- 172.21.15.118:0/3247335493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fef0 0x7f4054142c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f404c005fd0 tx=0x7f404c02a840 comp rx=0 tx=0).stop 2024-09-21T06:05:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 -- 172.21.15.118:0/3247335493 shutdown_connections 2024-09-21T06:05:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 --2- 172.21.15.118:0/3247335493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fef0 0x7f4054142c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 --2- 172.21.15.118:0/3247335493 >> v2:172.21.15.149:3300/0 conn(0x7f40540d1590 0x7f4054142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 -- 172.21.15.118:0/3247335493 >> 172.21.15.118:0/3247335493 conn(0x7f405406d110 msgr2=0x7f405406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 -- 172.21.15.118:0/3247335493 shutdown_connections 2024-09-21T06:05:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.785+0000 7f4059600640 1 -- 172.21.15.118:0/3247335493 wait complete. 2024-09-21T06:05:59.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.787+0000 7f4059600640 1 Processor -- start 2024-09-21T06:05:59.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.787+0000 7f4059600640 1 -- start start 2024-09-21T06:05:59.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4059600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fae0 0x7f4054158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:59.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4059600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f405413fef0 0x7f40540735a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4059600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405415a450 0x7f40541395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4059600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f40540cfac0 con 0x7f405413fef0 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4059600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40540cf940 con 0x7f405415a450 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4059600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f40540cfc40 con 0x7f405413fae0 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f405413fef0 0x7f40540735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f405413fef0 0x7f40540735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40558/0 (socket says 172.21.15.118:40558) 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 -- 172.21.15.118:0/2638016605 learned_addr learned my addr 172.21.15.118:0/2638016605 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4052a00640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fae0 0x7f4054158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f4053400640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405415a450 0x7f40541395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 -- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fae0 msgr2=0x7f4054158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:59.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fae0 0x7f4054158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 -- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405415a450 msgr2=0x7f40541395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405415a450 0x7f40541395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.789+0000 7f404a000640 1 -- 172.21.15.118:0/2638016605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40540b3c00 con 0x7f405413fef0 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.790+0000 7f404a000640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f405413fef0 0x7f40540735a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f403c00e9f0 tx=0x7f403c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.790+0000 7f404b400640 1 -- 172.21.15.118:0/2638016605 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c00cd80 con 0x7f405413fef0 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.790+0000 7f404b400640 1 -- 172.21.15.118:0/2638016605 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f403c004020 con 0x7f405413fef0 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.790+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40540b3ee0 con 0x7f405413fef0 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.790+0000 7f404b400640 1 -- 172.21.15.118:0/2638016605 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c004470 con 0x7f405413fef0 2024-09-21T06:05:59.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.790+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40540b44a0 con 0x7f405413fef0 2024-09-21T06:05:59.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.791+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405406f9f0 con 0x7f405413fef0 2024-09-21T06:05:59.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.792+0000 7f404b400640 1 -- 172.21.15.118:0/2638016605 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f403c0035f0 con 0x7f405413fef0 2024-09-21T06:05:59.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.793+0000 7f404b400640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4030078b90 0x7f403007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.793+0000 7f404b400640 1 -- 172.21.15.118:0/2638016605 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f403c09b6f0 con 0x7f405413fef0 2024-09-21T06:05:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.794+0000 7f4052a00640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4030078b90 0x7f403007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:59.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.795+0000 7f4052a00640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4030078b90 0x7f403007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4044007960 tx=0x7f4044001d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:59.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.798+0000 7f404b400640 1 -- 172.21.15.118:0/2638016605 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f403c063530 con 0x7f405413fef0 2024-09-21T06:05:59.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.993+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4054073b30 con 0x7f405413fef0 2024-09-21T06:05:59.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.994+0000 7f404b400640 1 -- 172.21.15.118:0/2638016605 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) ==== 80+0+0 (secure 0 0 0) 0x7f403c067f60 con 0x7f405413fef0 2024-09-21T06:05:59.996 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4030078b90 msgr2=0x7f403007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4030078b90 0x7f403007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4044007960 tx=0x7f4044001d50 comp rx=0 tx=0).stop 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f405413fef0 msgr2=0x7f40540735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f405413fef0 0x7f40540735a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f403c00e9f0 tx=0x7f403c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 shutdown_connections 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405415a450 0x7f40541395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f405413fef0 0x7f40540735a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4030078b90 0x7f403007b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:59.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 --2- 172.21.15.118:0/2638016605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f405413fae0 0x7f4054158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 >> 172.21.15.118:0/2638016605 conn(0x7f405406d110 msgr2=0x7f40540d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:00.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 shutdown_connections 2024-09-21T06:06:00.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:05:59.996+0000 7f4059600640 1 -- 172.21.15.118:0/2638016605 wait complete. 2024-09-21T06:06:00.022 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:06:00.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:00.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:06:00.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:06:00.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:00.129 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:06:00.172 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:06:00.172 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:06:00.172 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:00.208 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:06:00.208 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:00.283 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:06:00.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.503+0000 7f212e600640 1 -- 172.21.15.118:0/397276208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21280ccf80 msgr2=0x7f2128073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:00.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.503+0000 7f212e600640 1 --2- 172.21.15.118:0/397276208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21280ccf80 0x7f2128073370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2120005fd0 tx=0x7f212002aa10 comp rx=0 tx=0).stop 2024-09-21T06:06:00.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.504+0000 7f212e600640 1 -- 172.21.15.118:0/397276208 shutdown_connections 2024-09-21T06:06:00.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.504+0000 7f212e600640 1 --2- 172.21.15.118:0/397276208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21280ccf80 0x7f2128073370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.504+0000 7f212e600640 1 --2- 172.21.15.118:0/397276208 >> v2:172.21.15.149:3300/0 conn(0x7f21280b3a60 0x7f21280cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.504+0000 7f212e600640 1 -- 172.21.15.118:0/397276208 >> 172.21.15.118:0/397276208 conn(0x7f212806d110 msgr2=0x7f212806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:00.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.504+0000 7f212e600640 1 -- 172.21.15.118:0/397276208 shutdown_connections 2024-09-21T06:06:00.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.504+0000 7f212e600640 1 -- 172.21.15.118:0/397276208 wait complete. 2024-09-21T06:06:00.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.506+0000 7f212e600640 1 Processor -- start 2024-09-21T06:06:00.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.506+0000 7f212e600640 1 -- start start 2024-09-21T06:06:00.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.507+0000 7f212e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21280b3a60 0x7f21281f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:00.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f212e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21280ccf80 0x7f21281e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:00.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f212e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212815cfd0 0x7f21281e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:00.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f212e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2128073c40 con 0x7f21280b3a60 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f212e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2128073ac0 con 0x7f21280ccf80 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f212e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2128073dc0 con 0x7f212815cfd0 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21280b3a60 0x7f21281f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f211ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21280ccf80 0x7f21281e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21280b3a60 0x7f21281f8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40572/0 (socket says 172.21.15.118:40572) 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 -- 172.21.15.118:0/742628067 learned_addr learned my addr 172.21.15.118:0/742628067 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127e00640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212815cfd0 0x7f21281e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 -- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212815cfd0 msgr2=0x7f21281e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212815cfd0 0x7f21281e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 -- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21280ccf80 msgr2=0x7f21281e6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21280ccf80 0x7f21281e6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.508+0000 7f2127400640 1 -- 172.21.15.118:0/742628067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21281f60b0 con 0x7f21280b3a60 2024-09-21T06:06:00.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.509+0000 7f2127400640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21280b3a60 0x7f21281f8cf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f211800c430 tx=0x7f211800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:00.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.509+0000 7f211fe00640 1 -- 172.21.15.118:0/742628067 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2118017070 con 0x7f21280b3a60 2024-09-21T06:06:00.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.509+0000 7f211fe00640 1 -- 172.21.15.118:0/742628067 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21180053e0 con 0x7f21280b3a60 2024-09-21T06:06:00.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.509+0000 7f211fe00640 1 -- 172.21.15.118:0/742628067 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2118003850 con 0x7f21280b3a60 2024-09-21T06:06:00.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.509+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21281f6390 con 0x7f21280b3a60 2024-09-21T06:06:00.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.509+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21281f6950 con 0x7f21280b3a60 2024-09-21T06:06:00.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.510+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21281f6d30 con 0x7f21280b3a60 2024-09-21T06:06:00.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.511+0000 7f211fe00640 1 -- 172.21.15.118:0/742628067 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f211801a070 con 0x7f21280b3a60 2024-09-21T06:06:00.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.512+0000 7f211fe00640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2104078b90 0x7f210407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:00.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.512+0000 7f211fe00640 1 -- 172.21.15.118:0/742628067 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f2118099f70 con 0x7f21280b3a60 2024-09-21T06:06:00.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.513+0000 7f211ea00640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2104078b90 0x7f210407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:00.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.513+0000 7f211ea00640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2104078b90 0x7f210407b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21100095f0 tx=0x7f2110005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:00.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.517+0000 7f211fe00640 1 -- 172.21.15.118:0/742628067 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2118061e40 con 0x7f21280b3a60 2024-09-21T06:06:00.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.710+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2128145a10 con 0x7f21280b3a60 2024-09-21T06:06:00.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.711+0000 7f211fe00640 1 -- 172.21.15.118:0/742628067 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) ==== 80+0+0 (secure 0 0 0) 0x7f2128145a10 con 0x7f21280b3a60 2024-09-21T06:06:00.713 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2104078b90 msgr2=0x7f210407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2104078b90 0x7f210407b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21100095f0 tx=0x7f2110005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21280b3a60 msgr2=0x7f21281f8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21280b3a60 0x7f21281f8cf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f211800c430 tx=0x7f211800c8f0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 shutdown_connections 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2104078b90 0x7f210407b0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212815cfd0 0x7f21281e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21280ccf80 0x7f21281e6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 --2- 172.21.15.118:0/742628067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21280b3a60 0x7f21281f8cf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:00.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.713+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 >> 172.21.15.118:0/742628067 conn(0x7f212806d110 msgr2=0x7f2128074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:00.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.714+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 shutdown_connections 2024-09-21T06:06:00.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:00.714+0000 7f212e600640 1 -- 172.21.15.118:0/742628067 wait complete. 2024-09-21T06:06:00.737 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:06:00.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:00.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:06:00.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:06:00.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:00.799 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:06:00.834 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:06:00.835 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:06:00.835 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:00.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:06:00.870 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:06:00.870 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:06:00.870 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:00.910 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:06:00.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:01.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 -- 172.21.15.118:0/3693976012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1140163900 msgr2=0x7f114015f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 --2- 172.21.15.118:0/3693976012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1140163900 0x7f114015f660 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f11400b7880 tx=0x7f112802a510 comp rx=0 tx=0).stop 2024-09-21T06:06:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 -- 172.21.15.118:0/3693976012 shutdown_connections 2024-09-21T06:06:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 --2- 172.21.15.118:0/3693976012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1140163900 0x7f114015f660 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 --2- 172.21.15.118:0/3693976012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11401634f0 0x7f11400d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 -- 172.21.15.118:0/3693976012 >> 172.21.15.118:0/3693976012 conn(0x7f114006d1c0 msgr2=0x7f114006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 -- 172.21.15.118:0/3693976012 shutdown_connections 2024-09-21T06:06:01.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.129+0000 7f113fe00640 1 -- 172.21.15.118:0/3693976012 wait complete. 2024-09-21T06:06:01.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.131+0000 7f113fe00640 1 Processor -- start 2024-09-21T06:06:01.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.131+0000 7f113fe00640 1 -- start start 2024-09-21T06:06:01.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f114015fba0 0x7f114015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11401634f0 0x7f11401582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1140163900 0x7f11401f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f11400d3aa0 con 0x7f114015fba0 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11400d3920 con 0x7f11401634f0 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11400d3c20 con 0x7f1140163900 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f114015fba0 0x7f114015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f114015fba0 0x7f114015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40586/0 (socket says 172.21.15.118:40586) 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 -- 172.21.15.118:0/3662667890 learned_addr learned my addr 172.21.15.118:0/3662667890 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f1137e00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11401634f0 0x7f11401582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113f400640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1140163900 0x7f11401f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 -- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1140163900 msgr2=0x7f11401f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1140163900 0x7f11401f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 -- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11401634f0 msgr2=0x7f11401582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11401634f0 0x7f11401582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 -- 172.21.15.118:0/3662667890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11400cdf80 con 0x7f114015fba0 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113ea00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f114015fba0 0x7f114015b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f113000d700 tx=0x7f113000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f1136a00640 1 -- 172.21.15.118:0/3662667890 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130017070 con 0x7f114015fba0 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f1136a00640 1 -- 172.21.15.118:0/3662667890 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1130005310 con 0x7f114015fba0 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f1136a00640 1 -- 172.21.15.118:0/3662667890 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130009820 con 0x7f114015fba0 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11401f6f10 con 0x7f114015fba0 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.134+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114015b180 con 0x7f114015fba0 2024-09-21T06:06:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.135+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114015f660 con 0x7f114015fba0 2024-09-21T06:06:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.136+0000 7f1136a00640 1 -- 172.21.15.118:0/3662667890 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11300099c0 con 0x7f114015fba0 2024-09-21T06:06:01.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.137+0000 7f1136a00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f111c078bc0 0x7f111c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.137+0000 7f1136a00640 1 -- 172.21.15.118:0/3662667890 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f113009ada0 con 0x7f114015fba0 2024-09-21T06:06:01.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.138+0000 7f1137e00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f111c078bc0 0x7f111c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.138+0000 7f1137e00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f111c078bc0 0x7f111c07b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1128033000 tx=0x7f1128004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:01.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.142+0000 7f1136a00640 1 -- 172.21.15.118:0/3662667890 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f11400cdf80 con 0x7f114015fba0 2024-09-21T06:06:01.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.362+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f114006d670 con 0x7f114015fba0 2024-09-21T06:06:01.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.364+0000 7f1136a00640 1 -- 172.21.15.118:0/3662667890 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f1130062b40 con 0x7f114015fba0 2024-09-21T06:06:01.366 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:01.366 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:06:01.366 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:06:01.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f111c078bc0 msgr2=0x7f111c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f111c078bc0 0x7f111c07b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1128033000 tx=0x7f1128004730 comp rx=0 tx=0).stop 2024-09-21T06:06:01.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f114015fba0 msgr2=0x7f114015b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f114015fba0 0x7f114015b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f113000d700 tx=0x7f113000dbc0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 shutdown_connections 2024-09-21T06:06:01.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f111c078bc0 0x7f111c07b0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1140163900 0x7f11401f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11401634f0 0x7f11401582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 --2- 172.21.15.118:0/3662667890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f114015fba0 0x7f114015b980 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.366+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 >> 172.21.15.118:0/3662667890 conn(0x7f114006d1c0 msgr2=0x7f114015d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:01.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.367+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 shutdown_connections 2024-09-21T06:06:01.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.367+0000 7f113fe00640 1 -- 172.21.15.118:0/3662667890 wait complete. 2024-09-21T06:06:01.394 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 -- 172.21.15.118:0/2436305999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0b62c0 msgr2=0x7f6b3c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 --2- 172.21.15.118:0/2436305999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0b62c0 0x7f6b3c0d0240 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6b34005fd0 tx=0x7f6b3402a820 comp rx=0 tx=0).stop 2024-09-21T06:06:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 -- 172.21.15.118:0/2436305999 shutdown_connections 2024-09-21T06:06:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 --2- 172.21.15.118:0/2436305999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0b62c0 0x7f6b3c0d0240 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 --2- 172.21.15.118:0/2436305999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c073fa0 0x7f6b3c0749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 -- 172.21.15.118:0/2436305999 >> 172.21.15.118:0/2436305999 conn(0x7f6b3c06d6e0 msgr2=0x7f6b3c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:01.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 -- 172.21.15.118:0/2436305999 shutdown_connections 2024-09-21T06:06:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.612+0000 7f6b41800640 1 -- 172.21.15.118:0/2436305999 wait complete. 2024-09-21T06:06:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.614+0000 7f6b41800640 1 Processor -- start 2024-09-21T06:06:01.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.614+0000 7f6b41800640 1 -- start start 2024-09-21T06:06:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b41800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c073fa0 0x7f6b3c1e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b41800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0cfe30 0x7f6b3c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b41800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c1e6de0 0x7f6b3c1e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b41800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c15d9c0 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b41800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c15d840 con 0x7f6b3c1e6de0 2024-09-21T06:06:01.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b41800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3c15db40 con 0x7f6b3c073fa0 2024-09-21T06:06:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0cfe30 0x7f6b3c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0cfe30 0x7f6b3c0cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40600/0 (socket says 172.21.15.118:40600) 2024-09-21T06:06:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 -- 172.21.15.118:0/3879333365 learned_addr learned my addr 172.21.15.118:0/3879333365 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b3be00640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c073fa0 0x7f6b3c1e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b40e00640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c1e6de0 0x7f6b3c1e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 -- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c073fa0 msgr2=0x7f6b3c1e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c073fa0 0x7f6b3c1e8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 -- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c1e6de0 msgr2=0x7f6b3c1e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c1e6de0 0x7f6b3c1e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b33400640 1 -- 172.21.15.118:0/3879333365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c0cc5e0 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.616+0000 7f6b3be00640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c073fa0 0x7f6b3c1e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.617+0000 7f6b33400640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0cfe30 0x7f6b3c0cbc70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c3f0 tx=0x7f6b2400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.617+0000 7f6b38c00640 1 -- 172.21.15.118:0/3879333365 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24017070 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.617+0000 7f6b38c00640 1 -- 172.21.15.118:0/3879333365 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b240035f0 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.617+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3c0cc8c0 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.617+0000 7f6b38c00640 1 -- 172.21.15.118:0/3879333365 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24003a40 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.617+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3c0cce80 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.618+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3c15e060 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.619+0000 7f6b38c00640 1 -- 172.21.15.118:0/3879333365 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b2401a070 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.620+0000 7f6b38c00640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b18078b90 0x7f6b1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:01.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.620+0000 7f6b38c00640 1 -- 172.21.15.118:0/3879333365 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f6b2409a0d0 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.621+0000 7f6b3be00640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b18078b90 0x7f6b1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:01.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.621+0000 7f6b3be00640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b18078b90 0x7f6b1807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009b80 tx=0x7f6b2c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:01.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.624+0000 7f6b38c00640 1 -- 172.21.15.118:0/3879333365 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6b240624f0 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.846+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b3c0cc370 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.846+0000 7f6b38c00640 1 -- 172.21.15.118:0/3879333365 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f6b24061df0 con 0x7f6b3c0cfe30 2024-09-21T06:06:01.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:06:01.848 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b18078b90 msgr2=0x7f6b1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b18078b90 0x7f6b1807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009b80 tx=0x7f6b2c005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0cfe30 msgr2=0x7f6b3c0cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0cfe30 0x7f6b3c0cbc70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c3f0 tx=0x7f6b2400c8b0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 shutdown_connections 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c1e6de0 0x7f6b3c1e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b3c0cfe30 0x7f6b3c0cbc70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b18078b90 0x7f6b1807b0a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 --2- 172.21.15.118:0/3879333365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c073fa0 0x7f6b3c1e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 >> 172.21.15.118:0/3879333365 conn(0x7f6b3c06d6e0 msgr2=0x7f6b3c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 shutdown_connections 2024-09-21T06:06:01.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:01.849+0000 7f6b41800640 1 -- 172.21.15.118:0/3879333365 wait complete. 2024-09-21T06:06:01.871 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 -- 172.21.15.118:0/2123930188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5500cfa00 msgr2=0x7fb5500b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 --2- 172.21.15.118:0/2123930188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5500cfa00 0x7fb5500b4140 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb54c005fd0 tx=0x7fb54c02aa90 comp rx=0 tx=0).stop 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 -- 172.21.15.118:0/2123930188 shutdown_connections 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 --2- 172.21.15.118:0/2123930188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5500cfa00 0x7fb5500b4140 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 --2- 172.21.15.118:0/2123930188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb550144760 0x7fb5500cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 -- 172.21.15.118:0/2123930188 >> 172.21.15.118:0/2123930188 conn(0x7fb55006d6e0 msgr2=0x7fb5500b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 -- 172.21.15.118:0/2123930188 shutdown_connections 2024-09-21T06:06:02.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.088+0000 7fb557200640 1 -- 172.21.15.118:0/2123930188 wait complete. 2024-09-21T06:06:02.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.090+0000 7fb557200640 1 Processor -- start 2024-09-21T06:06:02.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.091+0000 7fb557200640 1 -- start start 2024-09-21T06:06:02.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb557200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5500cfa00 0x7fb55015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb557200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb550144760 0x7fb5501f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb557200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb550144ea0 0x7fb5501f9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb557200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb5500b4bb0 con 0x7fb550144ea0 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb557200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb5500b4a30 con 0x7fb550144760 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb557200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb5500b4d30 con 0x7fb5500cfa00 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb556800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb550144ea0 0x7fb5501f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb556800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb550144ea0 0x7fb5501f9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40608/0 (socket says 172.21.15.118:40608) 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.092+0000 7fb556800640 1 -- 172.21.15.118:0/1117691757 learned_addr learned my addr 172.21.15.118:0/1117691757 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb555400640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb550144760 0x7fb5501f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb555e00640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5500cfa00 0x7fb55015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb556800640 1 -- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5500cfa00 msgr2=0x7fb55015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb556800640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5500cfa00 0x7fb55015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb556800640 1 -- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb550144760 msgr2=0x7fb5501f93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb556800640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb550144760 0x7fb5501f93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb556800640 1 -- 172.21.15.118:0/1117691757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55015e380 con 0x7fb550144ea0 2024-09-21T06:06:02.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb556800640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb550144ea0 0x7fb5501f9900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009d90 tx=0x7fb54c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:02.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb54a000640 1 -- 172.21.15.118:0/1117691757 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c044070 con 0x7fb550144ea0 2024-09-21T06:06:02.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb54a000640 1 -- 172.21.15.118:0/1117691757 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb54c004040 con 0x7fb550144ea0 2024-09-21T06:06:02.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55015e880 con 0x7fb550144ea0 2024-09-21T06:06:02.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.093+0000 7fb54a000640 1 -- 172.21.15.118:0/1117691757 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c004430 con 0x7fb550144ea0 2024-09-21T06:06:02.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.094+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55015ee40 con 0x7fb550144ea0 2024-09-21T06:06:02.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.095+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55015e5f0 con 0x7fb550144ea0 2024-09-21T06:06:02.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.096+0000 7fb54a000640 1 -- 172.21.15.118:0/1117691757 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb54c047070 con 0x7fb550144ea0 2024-09-21T06:06:02.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.097+0000 7fb54a000640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb534078bc0 0x7fb53407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.097+0000 7fb54a000640 1 -- 172.21.15.118:0/1117691757 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7fb54c0bbba0 con 0x7fb550144ea0 2024-09-21T06:06:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.097+0000 7fb555e00640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb534078bc0 0x7fb53407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.098+0000 7fb555e00640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb534078bc0 0x7fb53407b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb544001720 tx=0x7fb544009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:02.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.101+0000 7fb54a000640 1 -- 172.21.15.118:0/1117691757 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb54c032030 con 0x7fb550144ea0 2024-09-21T06:06:02.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.290+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5500b5250 con 0x7fb550144ea0 2024-09-21T06:06:02.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.291+0000 7fb54a000640 1 -- 172.21.15.118:0/1117691757 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+16836 (secure 0 0 0) 0x7fb54c0838b0 con 0x7fb550144ea0 2024-09-21T06:06:02.293 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:02.293 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":52,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:53.301395+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:05:20.575073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T06:05:21.613973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":4}]},{"pgid":"7.13","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:06:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.294+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb534078bc0 msgr2=0x7fb53407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.294+0000 7fb557200640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb534078bc0 0x7fb53407b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb544001720 tx=0x7fb544009040 comp rx=0 tx=0).stop 2024-09-21T06:06:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.294+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb550144ea0 msgr2=0x7fb5501f9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.294+0000 7fb557200640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb550144ea0 0x7fb5501f9900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009d90 tx=0x7fb54c003ce0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 shutdown_connections 2024-09-21T06:06:02.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb550144ea0 0x7fb5501f9900 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb550144760 0x7fb5501f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb534078bc0 0x7fb53407b0d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 --2- 172.21.15.118:0/1117691757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5500cfa00 0x7fb55015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 >> 172.21.15.118:0/1117691757 conn(0x7fb55006d6e0 msgr2=0x7fb55013ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 shutdown_connections 2024-09-21T06:06:02.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.295+0000 7fb557200640 1 -- 172.21.15.118:0/1117691757 wait complete. 2024-09-21T06:06:02.320 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:06:02.321 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:02.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 -- 172.21.15.118:0/3406484990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc0d1590 msgr2=0x7f39bc142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 --2- 172.21.15.118:0/3406484990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc0d1590 0x7f39bc142730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f39a8005fd0 tx=0x7f39a802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 -- 172.21.15.118:0/3406484990 shutdown_connections 2024-09-21T06:06:02.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 --2- 172.21.15.118:0/3406484990 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39bc13fef0 0x7f39bc142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 --2- 172.21.15.118:0/3406484990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc0d1590 0x7f39bc142730 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 -- 172.21.15.118:0/3406484990 >> 172.21.15.118:0/3406484990 conn(0x7f39bc06d110 msgr2=0x7f39bc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:02.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 -- 172.21.15.118:0/3406484990 shutdown_connections 2024-09-21T06:06:02.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.540+0000 7f39c1600640 1 -- 172.21.15.118:0/3406484990 wait complete. 2024-09-21T06:06:02.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.542+0000 7f39c1600640 1 Processor -- start 2024-09-21T06:06:02.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.543+0000 7f39c1600640 1 -- start start 2024-09-21T06:06:02.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39c1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39bc13fae0 0x7f39bc139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39c1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc13fef0 0x7f39bc1f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39c1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39bc13ac30 0x7f39bc1f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39c1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0cfac0 con 0x7f39bc13fef0 2024-09-21T06:06:02.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39c1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0cf940 con 0x7f39bc13ac30 2024-09-21T06:06:02.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39c1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc0cfc40 con 0x7f39bc13fae0 2024-09-21T06:06:02.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39ba000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc13fef0 0x7f39bc1f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39ba000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc13fef0 0x7f39bc1f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40630/0 (socket says 172.21.15.118:40630) 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39ba000640 1 -- 172.21.15.118:0/235871016 learned_addr learned my addr 172.21.15.118:0/235871016 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39baa00640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39bc13fae0 0x7f39bc139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.544+0000 7f39bb400640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39bc13ac30 0x7f39bc1f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39ba000640 1 -- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39bc13fae0 msgr2=0x7f39bc139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39ba000640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39bc13fae0 0x7f39bc139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39ba000640 1 -- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39bc13ac30 msgr2=0x7f39bc1f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39ba000640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39bc13ac30 0x7f39bc1f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39ba000640 1 -- 172.21.15.118:0/235871016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc13b680 con 0x7f39bc13fef0 2024-09-21T06:06:02.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39bb400640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39bc13ac30 0x7f39bc1f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:02.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39ba000640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc13fef0 0x7f39bc1f98b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f39a8034040 tx=0x7f39a80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:02.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39b2a00640 1 -- 172.21.15.118:0/235871016 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a803e030 con 0x7f39bc13fef0 2024-09-21T06:06:02.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39b2a00640 1 -- 172.21.15.118:0/235871016 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a8003ca0 con 0x7f39bc13fef0 2024-09-21T06:06:02.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39bc13b960 con 0x7f39bc13fef0 2024-09-21T06:06:02.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39b2a00640 1 -- 172.21.15.118:0/235871016 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8035040 con 0x7f39bc13fef0 2024-09-21T06:06:02.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.545+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39bc1f90b0 con 0x7f39bc13fef0 2024-09-21T06:06:02.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.546+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39bc0d00f0 con 0x7f39bc13fef0 2024-09-21T06:06:02.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.548+0000 7f39b2a00640 1 -- 172.21.15.118:0/235871016 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39a8041030 con 0x7f39bc13fef0 2024-09-21T06:06:02.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.549+0000 7f39b2a00640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f399c078b90 0x7f399c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:02.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.549+0000 7f39b2a00640 1 -- 172.21.15.118:0/235871016 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f39a80bb300 con 0x7f39bc13fef0 2024-09-21T06:06:02.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.549+0000 7f39baa00640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f399c078b90 0x7f399c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:02.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.550+0000 7f39baa00640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f399c078b90 0x7f399c07b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39ac001720 tx=0x7f39ac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:02.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.553+0000 7f39b2a00640 1 -- 172.21.15.118:0/235871016 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f39a8083030 con 0x7f39bc13fef0 2024-09-21T06:06:02.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.776+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39bc1532a0 con 0x7f39bc13fef0 2024-09-21T06:06:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.777+0000 7f39b2a00640 1 -- 172.21.15.118:0/235871016 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f39a8087a60 con 0x7f39bc13fef0 2024-09-21T06:06:02.778 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:02.778 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:06:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f399c078b90 msgr2=0x7f399c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f399c078b90 0x7f399c07b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39ac001720 tx=0x7f39ac009040 comp rx=0 tx=0).stop 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc13fef0 msgr2=0x7f39bc1f98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc13fef0 0x7f39bc1f98b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f39a8034040 tx=0x7f39a80038a0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 shutdown_connections 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39bc13ac30 0x7f39bc1f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39bc13fef0 0x7f39bc1f98b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f399c078b90 0x7f399c07b0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 --2- 172.21.15.118:0/235871016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39bc13fae0 0x7f39bc139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:02.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 >> 172.21.15.118:0/235871016 conn(0x7f39bc06d110 msgr2=0x7f39bc15e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:02.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 shutdown_connections 2024-09-21T06:06:02.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:02.779+0000 7f39c1600640 1 -- 172.21.15.118:0/235871016 wait complete. 2024-09-21T06:06:02.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:03.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 -- 172.21.15.118:0/1546930349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0d1960 msgr2=0x7fe46c06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 --2- 172.21.15.118:0/1546930349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0d1960 0x7fe46c06d200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe464005fd0 tx=0x7fe46402a620 comp rx=0 tx=0).stop 2024-09-21T06:06:03.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 -- 172.21.15.118:0/1546930349 shutdown_connections 2024-09-21T06:06:03.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 --2- 172.21.15.118:0/1546930349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0d1960 0x7fe46c06d200 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 --2- 172.21.15.118:0/1546930349 >> v2:172.21.15.149:3300/0 conn(0x7fe46c0d38d0 0x7fe46c0d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 -- 172.21.15.118:0/1546930349 >> 172.21.15.118:0/1546930349 conn(0x7fe46c0d4c00 msgr2=0x7fe46c0d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:03.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 -- 172.21.15.118:0/1546930349 shutdown_connections 2024-09-21T06:06:03.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.022+0000 7fe471800640 1 -- 172.21.15.118:0/1546930349 wait complete. 2024-09-21T06:06:03.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.024+0000 7fe471800640 1 Processor -- start 2024-09-21T06:06:03.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.024+0000 7fe471800640 1 -- start start 2024-09-21T06:06:03.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe471800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe46c0d29e0 0x7fe46c0ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe471800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe46c0d38d0 0x7fe46c15de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe471800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0cab80 0x7fe46c15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe471800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c06d740 con 0x7fe46c0cab80 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe471800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c0d2020 con 0x7fe46c0d38d0 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe471800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe46c06d8c0 con 0x7fe46c0d29e0 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe470e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0cab80 0x7fe46c15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe470e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0cab80 0x7fe46c15e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40650/0 (socket says 172.21.15.118:40650) 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe470e00640 1 -- 172.21.15.118:0/410052750 learned_addr learned my addr 172.21.15.118:0/410052750 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe46be00640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe46c0d29e0 0x7fe46c0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe46b400640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe46c0d38d0 0x7fe46c15de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.026+0000 7fe470e00640 1 -- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe46c0d29e0 msgr2=0x7fe46c0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe470e00640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe46c0d29e0 0x7fe46c0ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe470e00640 1 -- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe46c0d38d0 msgr2=0x7fe46c15de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe470e00640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe46c0d38d0 0x7fe46c15de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe470e00640 1 -- 172.21.15.118:0/410052750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46c160330 con 0x7fe46c0cab80 2024-09-21T06:06:03.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe470e00640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0cab80 0x7fe46c15e360 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe464034040 tx=0x7fe4640043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:03.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe463e00640 1 -- 172.21.15.118:0/410052750 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46403e030 con 0x7fe46c0cab80 2024-09-21T06:06:03.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe463e00640 1 -- 172.21.15.118:0/410052750 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe464004aa0 con 0x7fe46c0cab80 2024-09-21T06:06:03.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46c160610 con 0x7fe46c0cab80 2024-09-21T06:06:03.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe463e00640 1 -- 172.21.15.118:0/410052750 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464035040 con 0x7fe46c0cab80 2024-09-21T06:06:03.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.027+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46c160bd0 con 0x7fe46c0cab80 2024-09-21T06:06:03.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.028+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46c06dc90 con 0x7fe46c0cab80 2024-09-21T06:06:03.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.029+0000 7fe463e00640 1 -- 172.21.15.118:0/410052750 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe464041030 con 0x7fe46c0cab80 2024-09-21T06:06:03.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.030+0000 7fe463e00640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe44c078b90 0x7fe44c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.030+0000 7fe463e00640 1 -- 172.21.15.118:0/410052750 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7fe4640bb210 con 0x7fe46c0cab80 2024-09-21T06:06:03.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.031+0000 7fe46be00640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe44c078b90 0x7fe44c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.032+0000 7fe46be00640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe44c078b90 0x7fe44c07b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005fd0 tx=0x7fe45c0094a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:03.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.035+0000 7fe463e00640 1 -- 172.21.15.118:0/410052750 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe464083690 con 0x7fe46c0cab80 2024-09-21T06:06:03.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.261+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe46c0c82b0 con 0x7fe46c0cab80 2024-09-21T06:06:03.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.261+0000 7fe463e00640 1 -- 172.21.15.118:0/410052750 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7fe464082f90 con 0x7fe46c0cab80 2024-09-21T06:06:03.263 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:03.263 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"btime":"2024-09-21T06:05:26:193109+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:05:22.642022+0000","modified":"2024-09-21T06:05:25.676816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1713169437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1713169437},{"type":"v1","addr":"172.21.15.118:6834","nonce":1713169437}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-21T06:06:03.264 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 25 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe44c078b90 msgr2=0x7fe44c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe44c078b90 0x7fe44c07b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005fd0 tx=0x7fe45c0094a0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0cab80 msgr2=0x7fe46c15e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0cab80 0x7fe46c15e360 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe464034040 tx=0x7fe4640043c0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 shutdown_connections 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe46c0cab80 0x7fe46c15e360 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe46c0d38d0 0x7fe46c15de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe44c078b90 0x7fe44c07b0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 --2- 172.21.15.118:0/410052750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe46c0d29e0 0x7fe46c0ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 >> 172.21.15.118:0/410052750 conn(0x7fe46c0d4c00 msgr2=0x7fe46c0b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:03.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 shutdown_connections 2024-09-21T06:06:03.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.264+0000 7fe471800640 1 -- 172.21.15.118:0/410052750 wait complete. 2024-09-21T06:06:03.289 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:06:03.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 -- 172.21.15.118:0/3461904517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc0d1590 msgr2=0x7f03fc142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 --2- 172.21.15.118:0/3461904517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc0d1590 0x7f03fc142730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f03e4005fd0 tx=0x7f03e402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 -- 172.21.15.118:0/3461904517 shutdown_connections 2024-09-21T06:06:03.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 --2- 172.21.15.118:0/3461904517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03fc13fef0 0x7f03fc142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 --2- 172.21.15.118:0/3461904517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc0d1590 0x7f03fc142730 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 -- 172.21.15.118:0/3461904517 >> 172.21.15.118:0/3461904517 conn(0x7f03fc06d110 msgr2=0x7f03fc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:03.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 -- 172.21.15.118:0/3461904517 shutdown_connections 2024-09-21T06:06:03.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.511+0000 7f0401800640 1 -- 172.21.15.118:0/3461904517 wait complete. 2024-09-21T06:06:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.514+0000 7f0401800640 1 Processor -- start 2024-09-21T06:06:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.514+0000 7f0401800640 1 -- start start 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f0401800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc13fae0 0x7f03fc139380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f0401800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03fc13fef0 0x7f03fc15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f0401800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03fc13b820 0x7f03fc15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f0401800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc0cfac0 con 0x7f03fc13fae0 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f0401800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc0cf940 con 0x7f03fc13b820 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f0401800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f03fc0cfc40 con 0x7f03fc13fef0 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f03faa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc13fae0 0x7f03fc139380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f03faa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc13fae0 0x7f03fc139380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40672/0 (socket says 172.21.15.118:40672) 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.515+0000 7f03faa00640 1 -- 172.21.15.118:0/954904626 learned_addr learned my addr 172.21.15.118:0/954904626 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03f3e00640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03fc13fef0 0x7f03fc15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03fb400640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03fc13b820 0x7f03fc15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03faa00640 1 -- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03fc13fef0 msgr2=0x7f03fc15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03faa00640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03fc13fef0 0x7f03fc15b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03faa00640 1 -- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03fc13b820 msgr2=0x7f03fc15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03faa00640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03fc13b820 0x7f03fc15bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03faa00640 1 -- 172.21.15.118:0/954904626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc13b1f0 con 0x7f03fc13fae0 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03fb400640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03fc13b820 0x7f03fc15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03faa00640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc13fae0 0x7f03fc139380 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c3c0 tx=0x7f03ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03f2a00640 1 -- 172.21.15.118:0/954904626 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec017070 con 0x7f03fc13fae0 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.516+0000 7f03f2a00640 1 -- 172.21.15.118:0/954904626 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03ec0035f0 con 0x7f03fc13fae0 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.517+0000 7f03f2a00640 1 -- 172.21.15.118:0/954904626 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec003a40 con 0x7f03fc13fae0 2024-09-21T06:06:03.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.517+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03fc141dc0 con 0x7f03fc13fae0 2024-09-21T06:06:03.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.517+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03fc1398c0 con 0x7f03fc13fae0 2024-09-21T06:06:03.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.518+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03fc0d00f0 con 0x7f03fc13fae0 2024-09-21T06:06:03.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.519+0000 7f03f2a00640 1 -- 172.21.15.118:0/954904626 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03ec01a070 con 0x7f03fc13fae0 2024-09-21T06:06:03.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.520+0000 7f03f2a00640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03d8078b90 0x7f03d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.520+0000 7f03f2a00640 1 -- 172.21.15.118:0/954904626 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7f03ec099f20 con 0x7f03fc13fae0 2024-09-21T06:06:03.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.520+0000 7f03f3e00640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03d8078b90 0x7f03d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.521+0000 7f03f3e00640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03d8078b90 0x7f03d807b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03e4033000 tx=0x7f03e4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:03.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.524+0000 7f03f2a00640 1 -- 172.21.15.118:0/954904626 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f03ec061d50 con 0x7f03fc13fae0 2024-09-21T06:06:03.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.708+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03fc15ed60 con 0x7f03fc13fae0 2024-09-21T06:06:03.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.709+0000 7f03f2a00640 1 -- 172.21.15.118:0/954904626 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+16836 (secure 0 0 0) 0x7f03ec066780 con 0x7f03fc13fae0 2024-09-21T06:06:03.711 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:03.711 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":52,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:05:53.301395+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:05:20.575073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T06:05:21.613973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":4}]},{"pgid":"7.13","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03d8078b90 msgr2=0x7f03d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03d8078b90 0x7f03d807b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03e4033000 tx=0x7f03e4004730 comp rx=0 tx=0).stop 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc13fae0 msgr2=0x7f03fc139380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc13fae0 0x7f03fc139380 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c3c0 tx=0x7f03ec00c880 comp rx=0 tx=0).stop 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 shutdown_connections 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03fc13b820 0x7f03fc15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f03d8078b90 0x7f03d807b0a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03fc13fef0 0x7f03fc15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 --2- 172.21.15.118:0/954904626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03fc13fae0 0x7f03fc139380 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 >> 172.21.15.118:0/954904626 conn(0x7f03fc06d110 msgr2=0x7f03fc153710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:03.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 shutdown_connections 2024-09-21T06:06:03.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.712+0000 7f0401800640 1 -- 172.21.15.118:0/954904626 wait complete. 2024-09-21T06:06:03.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:06:03.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 -- 172.21.15.118:0/2871585594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc0d1590 msgr2=0x7fdffc142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 --2- 172.21.15.118:0/2871585594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc0d1590 0x7fdffc142730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4005fd0 tx=0x7fdfe402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 -- 172.21.15.118:0/2871585594 shutdown_connections 2024-09-21T06:06:03.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 --2- 172.21.15.118:0/2871585594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdffc13fef0 0x7fdffc142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 --2- 172.21.15.118:0/2871585594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc0d1590 0x7fdffc142730 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 -- 172.21.15.118:0/2871585594 >> 172.21.15.118:0/2871585594 conn(0x7fdffc06d110 msgr2=0x7fdffc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:03.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 -- 172.21.15.118:0/2871585594 shutdown_connections 2024-09-21T06:06:03.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.954+0000 7fe002e00640 1 -- 172.21.15.118:0/2871585594 wait complete. 2024-09-21T06:06:03.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.956+0000 7fe002e00640 1 Processor -- start 2024-09-21T06:06:03.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.957+0000 7fe002e00640 1 -- start start 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fe002e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc13fae0 0x7fdffc1419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fe002e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdffc13fef0 0x7fdffc1f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fe002e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdffc1e9140 0x7fdffc1f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fe002e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc0cfac0 con 0x7fdffc13fae0 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fe002e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc0cf940 con 0x7fdffc13fef0 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fe002e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdffc0cfc40 con 0x7fdffc1e9140 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fdffbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc13fae0 0x7fdffc1419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fdffbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc13fae0 0x7fdffc1419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40686/0 (socket says 172.21.15.118:40686) 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.958+0000 7fdffbe00640 1 -- 172.21.15.118:0/1862866604 learned_addr learned my addr 172.21.15.118:0/1862866604 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:03.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdff3400640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdffc13fef0 0x7fdffc1f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fe000e00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdffc1e9140 0x7fdffc1f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdffbe00640 1 -- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdffc1e9140 msgr2=0x7fdffc1f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdffbe00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdffc1e9140 0x7fdffc1f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdffbe00640 1 -- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdffc13fef0 msgr2=0x7fdffc1f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdffbe00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdffc13fef0 0x7fdffc1f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdffbe00640 1 -- 172.21.15.118:0/1862866604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc141f00 con 0x7fdffc13fae0 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdffbe00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc13fae0 0x7fdffc1419c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c3d0 tx=0x7fdfec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdff8c00640 1 -- 172.21.15.118:0/1862866604 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec017070 con 0x7fdffc13fae0 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdff8c00640 1 -- 172.21.15.118:0/1862866604 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfec0053c0 con 0x7fdffc13fae0 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fdff8c00640 1 -- 172.21.15.118:0/1862866604 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec003850 con 0x7fdffc13fae0 2024-09-21T06:06:03.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdffc073970 con 0x7fdffc13fae0 2024-09-21T06:06:03.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.959+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdffc0749d0 con 0x7fdffc13fae0 2024-09-21T06:06:03.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.960+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdffc0d00f0 con 0x7fdffc13fae0 2024-09-21T06:06:03.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.962+0000 7fdff8c00640 1 -- 172.21.15.118:0/1862866604 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdfec01a070 con 0x7fdffc13fae0 2024-09-21T06:06:03.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.962+0000 7fdff8c00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfd8078bc0 0x7fdfd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:03.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.963+0000 7fdff8c00640 1 -- 172.21.15.118:0/1862866604 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5767+0+0 (secure 0 0 0) 0x7fdfec09a0d0 con 0x7fdffc13fae0 2024-09-21T06:06:03.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.963+0000 7fdff3400640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfd8078bc0 0x7fdfd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:03.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.964+0000 7fdff3400640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfd8078bc0 0x7fdfd807b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4033000 tx=0x7fdfe4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:03.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:03.967+0000 7fdff8c00640 1 -- 172.21.15.118:0/1862866604 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdffc073970 con 0x7fdffc13fae0 2024-09-21T06:06:04.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.187+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdffc1542f0 con 0x7fdffc13fae0 2024-09-21T06:06:04.189 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:06:04.188+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:06:04.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.190+0000 7fdff8c00640 1 -- 172.21.15.118:0/1862866604 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7fdfec062560 con 0x7fdffc13fae0 2024-09-21T06:06:04.192 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfd8078bc0 msgr2=0x7fdfd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfd8078bc0 0x7fdfd807b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4033000 tx=0x7fdfe4004730 comp rx=0 tx=0).stop 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc13fae0 msgr2=0x7fdffc1419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc13fae0 0x7fdffc1419c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c3d0 tx=0x7fdfec00c890 comp rx=0 tx=0).stop 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 shutdown_connections 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdfd8078bc0 0x7fdfd807b0d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdffc1e9140 0x7fdffc1f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdffc13fef0 0x7fdffc1f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 --2- 172.21.15.118:0/1862866604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdffc13fae0 0x7fdffc1419c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 >> 172.21.15.118:0/1862866604 conn(0x7fdffc06d110 msgr2=0x7fdffc153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:04.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 shutdown_connections 2024-09-21T06:06:04.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.195+0000 7fe002e00640 1 -- 172.21.15.118:0/1862866604 wait complete. 2024-09-21T06:06:04.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:06:04.349 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:06:04.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.456+0000 7f24e6800640 1 -- 172.21.15.118:0/2412487461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e00b62c0 msgr2=0x7f24e015d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:04.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.456+0000 7f24e6800640 1 --2- 172.21.15.118:0/2412487461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e00b62c0 0x7f24e015d230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009860 tx=0x7f24cc02a530 comp rx=0 tx=0).stop 2024-09-21T06:06:04.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.456+0000 7f24e6800640 1 -- 172.21.15.118:0/2412487461 shutdown_connections 2024-09-21T06:06:04.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.456+0000 7f24e6800640 1 --2- 172.21.15.118:0/2412487461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e00b62c0 0x7f24e015d230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:04.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.456+0000 7f24e6800640 1 -- 172.21.15.118:0/2412487461 >> 172.21.15.118:0/2412487461 conn(0x7f24e006d6e0 msgr2=0x7f24e00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:04.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.456+0000 7f24e6800640 1 -- 172.21.15.118:0/2412487461 shutdown_connections 2024-09-21T06:06:04.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.456+0000 7f24e6800640 1 -- 172.21.15.118:0/2412487461 wait complete. 2024-09-21T06:06:04.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.458+0000 7f24e6800640 1 Processor -- start 2024-09-21T06:06:04.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.459+0000 7f24e6800640 1 -- start start 2024-09-21T06:06:04.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24e0146230 0x7f24e01f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:04.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e015d770 0x7f24e0141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:04.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0142330 0x7f24e015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:04.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e6800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f24e015fca0 con 0x7f24e0146230 2024-09-21T06:06:04.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24e015fb20 con 0x7f24e0142330 2024-09-21T06:06:04.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24e015fe20 con 0x7f24e015d770 2024-09-21T06:06:04.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24e0146230 0x7f24e01f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24e0146230 0x7f24e01f9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40708/0 (socket says 172.21.15.118:40708) 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.460+0000 7f24e5400640 1 -- 172.21.15.118:0/511018148 learned_addr learned my addr 172.21.15.118:0/511018148 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e4a00640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e015d770 0x7f24e0141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5e00640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0142330 0x7f24e015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5400640 1 -- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e015d770 msgr2=0x7f24e0141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5400640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e015d770 0x7f24e0141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5400640 1 -- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0142330 msgr2=0x7f24e015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5400640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0142330 0x7f24e015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5400640 1 -- 172.21.15.118:0/511018148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e01f6170 con 0x7f24e0146230 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e4a00640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e015d770 0x7f24e0141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5e00640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0142330 0x7f24e015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e5400640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24e0146230 0x7f24e01f9de0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c4d0 tx=0x7f24d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:04.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24dd600640 1 -- 172.21.15.118:0/511018148 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4016020 con 0x7f24e0146230 2024-09-21T06:06:04.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e01f6430 con 0x7f24e0146230 2024-09-21T06:06:04.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.461+0000 7f24dd600640 1 -- 172.21.15.118:0/511018148 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24d4012920 con 0x7f24e0146230 2024-09-21T06:06:04.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.462+0000 7f24dd600640 1 -- 172.21.15.118:0/511018148 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4012d30 con 0x7f24e0146230 2024-09-21T06:06:04.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.462+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e01f69f0 con 0x7f24e0146230 2024-09-21T06:06:04.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.463+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e00d04b0 con 0x7f24e0146230 2024-09-21T06:06:04.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.464+0000 7f24dd600640 1 -- 172.21.15.118:0/511018148 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24d4019020 con 0x7f24e0146230 2024-09-21T06:06:04.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.465+0000 7f24dd600640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f24c0078b90 0x7f24c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:04.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.465+0000 7f24dd600640 1 -- 172.21.15.118:0/511018148 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5853+0+0 (secure 0 0 0) 0x7f24d409abe0 con 0x7f24e0146230 2024-09-21T06:06:04.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.465+0000 7f24e4a00640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f24c0078b90 0x7f24c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:04.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.466+0000 7f24e4a00640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f24c0078b90 0x7f24c007b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24cc034000 tx=0x7f24cc004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:04.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.469+0000 7f24dd600640 1 -- 172.21.15.118:0/511018148 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f24e00d04b0 con 0x7f24e0146230 2024-09-21T06:06:04.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:04.690+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f24e015d540 con 0x7f24e0146230 2024-09-21T06:06:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.193+0000 7f24dd600640 1 -- 172.21.15.118:0/511018148 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f24e015d540 con 0x7f24e0146230 2024-09-21T06:06:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f24c0078b90 msgr2=0x7f24c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f24c0078b90 0x7f24c007b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24cc034000 tx=0x7f24cc004730 comp rx=0 tx=0).stop 2024-09-21T06:06:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24e0146230 msgr2=0x7f24e01f9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24e0146230 0x7f24e01f9de0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c4d0 tx=0x7f24d400c990 comp rx=0 tx=0).stop 2024-09-21T06:06:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 shutdown_connections 2024-09-21T06:06:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0142330 0x7f24e015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f24c0078b90 0x7f24c007b0a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:05.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e015d770 0x7f24e0141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:05.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 --2- 172.21.15.118:0/511018148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24e0146230 0x7f24e01f9de0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:05.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.195+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 >> 172.21.15.118:0/511018148 conn(0x7f24e006d6e0 msgr2=0x7f24e0145480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:05.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.196+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 shutdown_connections 2024-09-21T06:06:05.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.196+0000 7f24e6800640 1 -- 172.21.15.118:0/511018148 wait complete. 2024-09-21T06:06:05.220 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:06:05.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.447+0000 7f3dbf200640 1 -- 172.21.15.118:0/3008871473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3da0003a30 msgr2=0x7f3da0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:05.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.447+0000 7f3dbf200640 1 --2- 172.21.15.118:0/3008871473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3da0003a30 0x7f3da0003ea0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0016c0 tx=0x7f3da0005830 comp rx=0 tx=0).stop 2024-09-21T06:06:05.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.447+0000 7f3dbe800640 1 -- 172.21.15.118:0/3008871473 reap_dead start 2024-09-21T06:06:05.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.447+0000 7f3dbf200640 1 -- 172.21.15.118:0/3008871473 shutdown_connections 2024-09-21T06:06:05.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.447+0000 7f3dbf200640 1 -- 172.21.15.118:0/3008871473 >> 172.21.15.118:0/3008871473 conn(0x7f3db806d420 msgr2=0x7f3db80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:05.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.447+0000 7f3dbf200640 1 -- 172.21.15.118:0/3008871473 shutdown_connections 2024-09-21T06:06:05.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.447+0000 7f3dbf200640 1 -- 172.21.15.118:0/3008871473 wait complete. 2024-09-21T06:06:05.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.450+0000 7f3dbf200640 1 Processor -- start 2024-09-21T06:06:05.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.450+0000 7f3dbf200640 1 -- start start 2024-09-21T06:06:05.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.451+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da0003a30 0x7f3db8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:05.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.451+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db815a280 0x7f3db8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.451+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8157c60 0x7f3db80b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.451+0000 7f3dbf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8165a60 con 0x7f3db8157c60 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.451+0000 7f3dbf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8161000 con 0x7f3da0003a30 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.451+0000 7f3dbf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3db8165be0 con 0x7f3db815a280 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8157c60 0x7f3db80b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8157c60 0x7f3db80b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40734/0 (socket says 172.21.15.118:40734) 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 -- 172.21.15.118:0/1096015454 learned_addr learned my addr 172.21.15.118:0/1096015454 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbde00640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da0003a30 0x7f3db8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbd400640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db815a280 0x7f3db8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 -- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db815a280 msgr2=0x7f3db8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db815a280 0x7f3db8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:05.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 -- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da0003a30 msgr2=0x7f3db8142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:05.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da0003a30 0x7f3db8142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:05.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 -- 172.21.15.118:0/1096015454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db8158070 con 0x7f3db8157c60 2024-09-21T06:06:05.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbde00640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da0003a30 0x7f3db8142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:05.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3dbe800640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8157c60 0x7f3db80b45a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3db80ce2b0 tx=0x7f3db400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:05.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.452+0000 7f3db2000640 1 -- 172.21.15.118:0/1096015454 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4004b20 con 0x7f3db8157c60 2024-09-21T06:06:05.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.453+0000 7f3db2000640 1 -- 172.21.15.118:0/1096015454 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3db4004cc0 con 0x7f3db8157c60 2024-09-21T06:06:05.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.453+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db80b0990 con 0x7f3db8157c60 2024-09-21T06:06:05.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.453+0000 7f3db2000640 1 -- 172.21.15.118:0/1096015454 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4003bd0 con 0x7f3db8157c60 2024-09-21T06:06:05.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.453+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db80b37e0 con 0x7f3db8157c60 2024-09-21T06:06:05.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.454+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db81606e0 con 0x7f3db8157c60 2024-09-21T06:06:05.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.455+0000 7f3db2000640 1 -- 172.21.15.118:0/1096015454 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3db4004030 con 0x7f3db8157c60 2024-09-21T06:06:05.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.456+0000 7f3db2000640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:05.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.456+0000 7f3db2000640 1 -- 172.21.15.118:0/1096015454 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5853+0+0 (secure 0 0 0) 0x7f3db409b6b0 con 0x7f3db8157c60 2024-09-21T06:06:05.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.456+0000 7f3dbde00640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:05.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.457+0000 7f3dbde00640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3dac032000 tx=0x7f3dac001190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:05.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.460+0000 7f3db2000640 1 -- 172.21.15.118:0/1096015454 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3db8158070 con 0x7f3db8157c60 2024-09-21T06:06:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:05.646+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3db80b30f0 con 0x7f3db8157c60 2024-09-21T06:06:06.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.390+0000 7f3db2000640 1 -- 172.21.15.118:0/1096015454 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) ==== 181+0+0 (secure 0 0 0) 0x7f3db40639c0 con 0x7f3db8157c60 2024-09-21T06:06:06.392 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:06:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d9c078b90 msgr2=0x7f3d9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:06.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3dac032000 tx=0x7f3dac001190 comp rx=0 tx=0).stop 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8157c60 msgr2=0x7f3db80b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8157c60 0x7f3db80b45a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3db80ce2b0 tx=0x7f3db400f3c0 comp rx=0 tx=0).stop 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 shutdown_connections 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3db8157c60 0x7f3db80b45a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db815a280 0x7f3db8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 --2- 172.21.15.118:0/1096015454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da0003a30 0x7f3db8142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 >> 172.21.15.118:0/1096015454 conn(0x7f3db806d420 msgr2=0x7f3db8154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 shutdown_connections 2024-09-21T06:06:06.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.394+0000 7f3dbf200640 1 -- 172.21.15.118:0/1096015454 wait complete. 2024-09-21T06:06:06.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:06:06.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.648+0000 7f1530a00640 1 -- 172.21.15.118:0/9499593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1510003a00 msgr2=0x7f1510003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:06.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.648+0000 7f1530a00640 1 --2- 172.21.15.118:0/9499593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1510003a00 0x7f1510003e70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f151c009b20 tx=0x7f1510005830 comp rx=0 tx=0).stop 2024-09-21T06:06:06.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.648+0000 7f152b200640 1 -- 172.21.15.118:0/9499593 reap_dead start 2024-09-21T06:06:06.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.648+0000 7f1530a00640 1 -- 172.21.15.118:0/9499593 shutdown_connections 2024-09-21T06:06:06.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.648+0000 7f1530a00640 1 -- 172.21.15.118:0/9499593 >> 172.21.15.118:0/9499593 conn(0x7f152c06d420 msgr2=0x7f152c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:06.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.649+0000 7f1530a00640 1 -- 172.21.15.118:0/9499593 shutdown_connections 2024-09-21T06:06:06.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.649+0000 7f1530a00640 1 -- 172.21.15.118:0/9499593 wait complete. 2024-09-21T06:06:06.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.651+0000 7f1530a00640 1 Processor -- start 2024-09-21T06:06:06.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.651+0000 7f1530a00640 1 -- start start 2024-09-21T06:06:06.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.652+0000 7f1530a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510003a00 0x7f152c1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:06.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.652+0000 7f1530a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1f10d0 0x7f152c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:06.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.652+0000 7f1530a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f152c0ae8f0 0x7f152c0aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:06.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.652+0000 7f1530a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f152c0af880 con 0x7f152c1f10d0 2024-09-21T06:06:06.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.652+0000 7f1530a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f152c0af700 con 0x7f1510003a00 2024-09-21T06:06:06.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.652+0000 7f1530a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f152c0afa00 con 0x7f152c0ae8f0 2024-09-21T06:06:06.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1f10d0 0x7f152c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:06.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1f10d0 0x7f152c0ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33340/0 (socket says 172.21.15.118:33340) 2024-09-21T06:06:06.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 -- 172.21.15.118:0/2977234273 learned_addr learned my addr 172.21.15.118:0/2977234273 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f152a800640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510003a00 0x7f152c1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 -- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f152c0ae8f0 msgr2=0x7f152c0aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f152c0ae8f0 0x7f152c0aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 -- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510003a00 msgr2=0x7f152c1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510003a00 0x7f152c1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 -- 172.21.15.118:0/2977234273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c0ad3a0 con 0x7f152c1f10d0 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f152a800640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510003a00 0x7f152c1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:06:06.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.653+0000 7f1521e00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1f10d0 0x7f152c0ace60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1514011ae0 tx=0x7f1514009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:06.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.654+0000 7f1523400640 1 -- 172.21.15.118:0/2977234273 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151401e070 con 0x7f152c1f10d0 2024-09-21T06:06:06.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.654+0000 7f1523400640 1 -- 172.21.15.118:0/2977234273 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f151400fbf0 con 0x7f152c1f10d0 2024-09-21T06:06:06.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.654+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c0af240 con 0x7f152c1f10d0 2024-09-21T06:06:06.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.654+0000 7f1523400640 1 -- 172.21.15.118:0/2977234273 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514019410 con 0x7f152c1f10d0 2024-09-21T06:06:06.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.654+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c1552a0 con 0x7f152c1f10d0 2024-09-21T06:06:06.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.655+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152c0aff60 con 0x7f152c1f10d0 2024-09-21T06:06:06.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.656+0000 7f1523400640 1 -- 172.21.15.118:0/2977234273 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1514021070 con 0x7f152c1f10d0 2024-09-21T06:06:06.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.657+0000 7f1523400640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1508078b90 0x7f150807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:06.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.657+0000 7f1523400640 1 -- 172.21.15.118:0/2977234273 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5415+0+0 (secure 0 0 0) 0x7f151409b320 con 0x7f152c1f10d0 2024-09-21T06:06:06.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.658+0000 7f152a800640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1508078b90 0x7f150807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:06.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.659+0000 7f152a800640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1508078b90 0x7f150807b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f151c009b20 tx=0x7f151c02d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:06.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.662+0000 7f1523400640 1 -- 172.21.15.118:0/2977234273 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f152c0af240 con 0x7f152c1f10d0 2024-09-21T06:06:06.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:06.852+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f152c154ce0 con 0x7f152c1f10d0 2024-09-21T06:06:07.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.396+0000 7f1523400640 1 -- 172.21.15.118:0/2977234273 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) ==== 169+0+0 (secure 0 0 0) 0x7f15140632c0 con 0x7f152c1f10d0 2024-09-21T06:06:07.397 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.400+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1508078b90 msgr2=0x7f150807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.400+0000 7f1530a00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1508078b90 0x7f150807b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f151c009b20 tx=0x7f151c02d040 comp rx=0 tx=0).stop 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.400+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1f10d0 msgr2=0x7f152c0ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.400+0000 7f1530a00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1f10d0 0x7f152c0ace60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1514011ae0 tx=0x7f1514009eb0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.401+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 shutdown_connections 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.401+0000 7f1530a00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1508078b90 0x7f150807b0a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.401+0000 7f1530a00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f152c0ae8f0 0x7f152c0aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.401+0000 7f1530a00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1f10d0 0x7f152c0ace60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.401+0000 7f1530a00640 1 --2- 172.21.15.118:0/2977234273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510003a00 0x7f152c1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.401+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 >> 172.21.15.118:0/2977234273 conn(0x7f152c06d420 msgr2=0x7f152c15d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:07.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.402+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 shutdown_connections 2024-09-21T06:06:07.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.402+0000 7f1530a00640 1 -- 172.21.15.118:0/2977234273 wait complete. 2024-09-21T06:06:07.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:06:07.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.655+0000 7fe916a00640 1 -- 172.21.15.118:0/1405758127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f8003a50 msgr2=0x7fe8f8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:07.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.655+0000 7fe916a00640 1 --2- 172.21.15.118:0/1405758127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f8003a50 0x7fe8f8003ec0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c310 tx=0x7fe8f8005830 comp rx=0 tx=0).stop 2024-09-21T06:06:07.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.655+0000 7fe916a00640 1 -- 172.21.15.118:0/1405758127 shutdown_connections 2024-09-21T06:06:07.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.655+0000 7fe916a00640 1 --2- 172.21.15.118:0/1405758127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8f8003a50 0x7fe8f8003ec0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.655+0000 7fe916a00640 1 -- 172.21.15.118:0/1405758127 >> 172.21.15.118:0/1405758127 conn(0x7fe91006d6e0 msgr2=0x7fe9100b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:07.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.655+0000 7fe916a00640 1 -- 172.21.15.118:0/1405758127 shutdown_connections 2024-09-21T06:06:07.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.655+0000 7fe916a00640 1 -- 172.21.15.118:0/1405758127 wait complete. 2024-09-21T06:06:07.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.657+0000 7fe916a00640 1 Processor -- start 2024-09-21T06:06:07.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.658+0000 7fe916a00640 1 -- start start 2024-09-21T06:06:07.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8003a50 0x7fe91013cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:07.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9100b45e0 0x7fe9101f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:07.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91015bde0 0x7fe91015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:07.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100d05d0 con 0x7fe91015bde0 2024-09-21T06:06:07.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100d0450 con 0x7fe8f8003a50 2024-09-21T06:06:07.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100749f0 con 0x7fe9100b45e0 2024-09-21T06:06:07.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91015bde0 0x7fe91015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91015bde0 0x7fe91015c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33360/0 (socket says 172.21.15.118:33360) 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe916000640 1 -- 172.21.15.118:0/2461105620 learned_addr learned my addr 172.21.15.118:0/2461105620 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe914c00640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9100b45e0 0x7fe9101f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.659+0000 7fe915600640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8003a50 0x7fe91013cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916000640 1 -- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9100b45e0 msgr2=0x7fe9101f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916000640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9100b45e0 0x7fe9101f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916000640 1 -- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8003a50 msgr2=0x7fe91013cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916000640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8003a50 0x7fe91013cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916000640 1 -- 172.21.15.118:0/2461105620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9101f62a0 con 0x7fe91015bde0 2024-09-21T06:06:07.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916000640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91015bde0 0x7fe91015c1f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe908005fd0 tx=0x7fe908010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:07.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe90d600640 1 -- 172.21.15.118:0/2461105620 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908017070 con 0x7fe91015bde0 2024-09-21T06:06:07.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe90d600640 1 -- 172.21.15.118:0/2461105620 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe908015070 con 0x7fe91015bde0 2024-09-21T06:06:07.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe90d600640 1 -- 172.21.15.118:0/2461105620 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90801c6c0 con 0x7fe91015bde0 2024-09-21T06:06:07.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91015c730 con 0x7fe91015bde0 2024-09-21T06:06:07.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.660+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9100b57b0 con 0x7fe91015bde0 2024-09-21T06:06:07.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.661+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9100b5510 con 0x7fe91015bde0 2024-09-21T06:06:07.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.663+0000 7fe90d600640 1 -- 172.21.15.118:0/2461105620 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe90801c860 con 0x7fe91015bde0 2024-09-21T06:06:07.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.664+0000 7fe90d600640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8f0078bc0 0x7fe8f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:07.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.664+0000 7fe90d600640 1 -- 172.21.15.118:0/2461105620 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7fe90809b6f0 con 0x7fe91015bde0 2024-09-21T06:06:07.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.664+0000 7fe915600640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8f0078bc0 0x7fe8f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:07.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.665+0000 7fe915600640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8f0078bc0 0x7fe8f007b0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe904033000 tx=0x7fe9100b34d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:07.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.668+0000 7fe90d600640 1 -- 172.21.15.118:0/2461105620 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe9100b5510 con 0x7fe91015bde0 2024-09-21T06:06:07.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.853+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fe910157640 con 0x7fe91015bde0 2024-09-21T06:06:07.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.857+0000 7fe90d600640 1 -- 172.21.15.118:0/2461105620 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v27) ==== 71+0+0 (secure 0 0 0) 0x7fe91015c730 con 0x7fe91015bde0 2024-09-21T06:06:07.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8f0078bc0 msgr2=0x7fe8f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:07.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8f0078bc0 0x7fe8f007b0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe904033000 tx=0x7fe9100b34d0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91015bde0 msgr2=0x7fe91015c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91015bde0 0x7fe91015c1f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe908005fd0 tx=0x7fe908010f40 comp rx=0 tx=0).stop 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 shutdown_connections 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe91015bde0 0x7fe91015c1f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe8f0078bc0 0x7fe8f007b0d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9100b45e0 0x7fe9101f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 --2- 172.21.15.118:0/2461105620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f8003a50 0x7fe91013cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 >> 172.21.15.118:0/2461105620 conn(0x7fe91006d6e0 msgr2=0x7fe91015f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 shutdown_connections 2024-09-21T06:06:07.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:07.860+0000 7fe916a00640 1 -- 172.21.15.118:0/2461105620 wait complete. 2024-09-21T06:06:07.882 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-21T06:06:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 -- 172.21.15.118:0/1054536568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 msgr2=0x7fef140d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 --2- 172.21.15.118:0/1054536568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 0x7fef140d1290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef08009830 tx=0x7fef0802a480 comp rx=0 tx=0).stop 2024-09-21T06:06:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 -- 172.21.15.118:0/1054536568 shutdown_connections 2024-09-21T06:06:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 --2- 172.21.15.118:0/1054536568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef1406d400 0x7fef140b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 --2- 172.21.15.118:0/1054536568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 0x7fef140d1290 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 -- 172.21.15.118:0/1054536568 >> 172.21.15.118:0/1054536568 conn(0x7fef140b38e0 msgr2=0x7fef140b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:08.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 -- 172.21.15.118:0/1054536568 shutdown_connections 2024-09-21T06:06:08.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.103+0000 7fef1c400640 1 -- 172.21.15.118:0/1054536568 wait complete. 2024-09-21T06:06:08.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.105+0000 7fef1c400640 1 Processor -- start 2024-09-21T06:06:08.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.105+0000 7fef1c400640 1 -- start start 2024-09-21T06:06:08.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef1c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 0x7fef140ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef1c400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef140d07f0 0x7fef140abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef1c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef1406fe70 0x7fef14070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef1c400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fef140b6d70 con 0x7fef140d07f0 2024-09-21T06:06:08.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef1c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef140b6bf0 con 0x7fef140d03e0 2024-09-21T06:06:08.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef1c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef140b6ef0 con 0x7fef1406fe70 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef19000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef140d07f0 0x7fef140abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef19000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef140d07f0 0x7fef140abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33374/0 (socket says 172.21.15.118:33374) 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef19000640 1 -- 172.21.15.118:0/3643104291 learned_addr learned my addr 172.21.15.118:0/3643104291 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef19a00640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 0x7fef140ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.107+0000 7fef1a400640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef1406fe70 0x7fef14070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef19000640 1 -- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef1406fe70 msgr2=0x7fef14070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef19000640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef1406fe70 0x7fef14070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef19000640 1 -- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 msgr2=0x7fef140ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef19000640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 0x7fef140ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef19000640 1 -- 172.21.15.118:0/3643104291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef140ac0c0 con 0x7fef140d07f0 2024-09-21T06:06:08.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef19000640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef140d07f0 0x7fef140abb80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fef0000c3d0 tx=0x7fef0000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:08.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef11600640 1 -- 172.21.15.118:0/3643104291 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00017070 con 0x7fef140d07f0 2024-09-21T06:06:08.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef11600640 1 -- 172.21.15.118:0/3643104291 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef000053c0 con 0x7fef140d07f0 2024-09-21T06:06:08.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef140aa4a0 con 0x7fef140d07f0 2024-09-21T06:06:08.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.108+0000 7fef11600640 1 -- 172.21.15.118:0/3643104291 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00003850 con 0x7fef140d07f0 2024-09-21T06:06:08.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.109+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef140aaa60 con 0x7fef140d07f0 2024-09-21T06:06:08.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.109+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef140ac340 con 0x7fef140d07f0 2024-09-21T06:06:08.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.111+0000 7fef11600640 1 -- 172.21.15.118:0/3643104291 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef0001a070 con 0x7fef140d07f0 2024-09-21T06:06:08.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.112+0000 7fef11600640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feef4078b90 0x7feef407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.112+0000 7fef11600640 1 -- 172.21.15.118:0/3643104291 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7fef00099d20 con 0x7fef140d07f0 2024-09-21T06:06:08.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.112+0000 7fef19a00640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feef4078b90 0x7feef407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:08.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.113+0000 7fef19a00640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feef4078b90 0x7feef407b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef08034000 tx=0x7fef08004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:08.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.116+0000 7fef11600640 1 -- 172.21.15.118:0/3643104291 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fef00061e00 con 0x7fef140d07f0 2024-09-21T06:06:08.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.368+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7fef140b73a0 con 0x7fef140d07f0 2024-09-21T06:06:08.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.398+0000 7fef11600640 1 -- 172.21.15.118:0/3643104291 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v141) ==== 142+0+0 (secure 0 0 0) 0x7fef00066830 con 0x7fef140d07f0 2024-09-21T06:06:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feef4078b90 msgr2=0x7feef407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feef4078b90 0x7feef407b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef08034000 tx=0x7fef08004730 comp rx=0 tx=0).stop 2024-09-21T06:06:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef140d07f0 msgr2=0x7fef140abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef140d07f0 0x7fef140abb80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fef0000c3d0 tx=0x7fef0000c890 comp rx=0 tx=0).stop 2024-09-21T06:06:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 shutdown_connections 2024-09-21T06:06:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feef4078b90 0x7feef407b0a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef1406fe70 0x7fef14070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef140d07f0 0x7fef140abb80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 --2- 172.21.15.118:0/3643104291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef140d03e0 0x7fef140ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 >> 172.21.15.118:0/3643104291 conn(0x7fef140b38e0 msgr2=0x7fef1415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 shutdown_connections 2024-09-21T06:06:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.400+0000 7fef1c400640 1 -- 172.21.15.118:0/3643104291 wait complete. 2024-09-21T06:06:08.426 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-21T06:06:08.426 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2024-09-21T06:06:08.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:06:08.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.646+0000 7f14b2c00640 1 -- 172.21.15.118:0/382863540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 msgr2=0x7f149000ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.646+0000 7f14b2c00640 1 --2- 172.21.15.118:0/382863540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f149000ba50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f14a4001d90 tx=0x7f1490005830 comp rx=0 tx=0).stop 2024-09-21T06:06:08.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.646+0000 7f14b2c00640 1 -- 172.21.15.118:0/382863540 shutdown_connections 2024-09-21T06:06:08.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.646+0000 7f14b2c00640 1 --2- 172.21.15.118:0/382863540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f149000ba50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.646+0000 7f14b2c00640 1 -- 172.21.15.118:0/382863540 >> 172.21.15.118:0/382863540 conn(0x7f14ac0b38e0 msgr2=0x7f14ac0b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:08.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.647+0000 7f14b2c00640 1 -- 172.21.15.118:0/382863540 shutdown_connections 2024-09-21T06:06:08.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.647+0000 7f14b2c00640 1 -- 172.21.15.118:0/382863540 wait complete. 2024-09-21T06:06:08.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.649+0000 7f14b2c00640 1 Processor -- start 2024-09-21T06:06:08.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.649+0000 7f14b2c00640 1 -- start start 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.650+0000 7f14b2c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f14ac0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.650+0000 7f14b2c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ac0c6b50 0x7f14ac1424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.650+0000 7f14b2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14ac1f8cf0 0x7f14ac1f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.650+0000 7f14b2c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac06d080 con 0x7f14900053a0 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.650+0000 7f14b2c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac06cf00 con 0x7f14ac0c6b50 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.650+0000 7f14b2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f14ac06d200 con 0x7f14ac1f8cf0 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.650+0000 7f14abe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f14ac0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:08.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f14ac0ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33398/0 (socket says 172.21.15.118:33398) 2024-09-21T06:06:08.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 -- 172.21.15.118:0/3646390926 learned_addr learned my addr 172.21.15.118:0/3646390926 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 -- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14ac1f8cf0 msgr2=0x7f14ac1f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14ac1f8cf0 0x7f14ac1f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 -- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ac0c6b50 msgr2=0x7f14ac1424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14a3e00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ac0c6b50 0x7f14ac1424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ac0c6b50 0x7f14ac1424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 -- 172.21.15.118:0/3646390926 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ac1f9640 con 0x7f14900053a0 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14a3e00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ac0c6b50 0x7f14ac1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14abe00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f14ac0ce9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f149c011ae0 tx=0x7f149c009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.651+0000 7f14a8c00640 1 -- 172.21.15.118:0/3646390926 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c01e070 con 0x7f14900053a0 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.652+0000 7f14a8c00640 1 -- 172.21.15.118:0/3646390926 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f149c004480 con 0x7f14900053a0 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.652+0000 7f14a8c00640 1 -- 172.21.15.118:0/3646390926 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c00fc60 con 0x7f14900053a0 2024-09-21T06:06:08.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.652+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ac143640 con 0x7f14900053a0 2024-09-21T06:06:08.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.652+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ac143c00 con 0x7f14900053a0 2024-09-21T06:06:08.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.653+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ac0b4be0 con 0x7f14900053a0 2024-09-21T06:06:08.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.654+0000 7f14a8c00640 1 -- 172.21.15.118:0/3646390926 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f149c021070 con 0x7f14900053a0 2024-09-21T06:06:08.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.655+0000 7f14a8c00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1488078b90 0x7f148807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:08.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.655+0000 7f14a8c00640 1 -- 172.21.15.118:0/3646390926 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7f149c09b440 con 0x7f14900053a0 2024-09-21T06:06:08.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.656+0000 7f14a3e00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1488078b90 0x7f148807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:08.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.656+0000 7f14a3e00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1488078b90 0x7f148807b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0b7d40 tx=0x7f14940067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:08.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.660+0000 7f14a8c00640 1 -- 172.21.15.118:0/3646390926 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f14ac1f9640 con 0x7f14900053a0 2024-09-21T06:06:08.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.846+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14ac0b7320 con 0x7f14900053a0 2024-09-21T06:06:08.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.847+0000 7f14a8c00640 1 -- 172.21.15.118:0/3646390926 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+13106 (secure 0 0 0) 0x7f149c0635b0 con 0x7f14900053a0 2024-09-21T06:06:08.849 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:08.849 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":55,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:06:07.391128+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/1713169437":"2024-09-22T06:06:04.188781+0000","172.21.15.118:6832/1713169437":"2024-09-22T06:06:04.188781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:06:08.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1488078b90 msgr2=0x7f148807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1488078b90 0x7f148807b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0b7d40 tx=0x7f14940067a0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 msgr2=0x7f14ac0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f14ac0ce9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f149c011ae0 tx=0x7f149c009e40 comp rx=0 tx=0).stop 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 shutdown_connections 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1488078b90 0x7f148807b0a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14ac1f8cf0 0x7f14ac1f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ac0c6b50 0x7f14ac1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 --2- 172.21.15.118:0/3646390926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14900053a0 0x7f14ac0ce9c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 >> 172.21.15.118:0/3646390926 conn(0x7f14ac0b38e0 msgr2=0x7f14ac071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 shutdown_connections 2024-09-21T06:06:08.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:08.850+0000 7f14b2c00640 1 -- 172.21.15.118:0/3646390926 wait complete. 2024-09-21T06:06:08.873 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:06:08.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:06:09.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.094+0000 7f368c000640 1 -- 172.21.15.118:0/3764593379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36840af900 msgr2=0x7f36840afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.094+0000 7f368c000640 1 --2- 172.21.15.118:0/3764593379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36840af900 0x7f36840afd10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f367c005fd0 tx=0x7f367c02a8b0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.094+0000 7f368c000640 1 -- 172.21.15.118:0/3764593379 shutdown_connections 2024-09-21T06:06:09.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.094+0000 7f368c000640 1 --2- 172.21.15.118:0/3764593379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36840af900 0x7f36840afd10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.094+0000 7f368c000640 1 -- 172.21.15.118:0/3764593379 >> 172.21.15.118:0/3764593379 conn(0x7f36840b2860 msgr2=0x7f36840b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:09.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.094+0000 7f368c000640 1 -- 172.21.15.118:0/3764593379 shutdown_connections 2024-09-21T06:06:09.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.094+0000 7f368c000640 1 -- 172.21.15.118:0/3764593379 wait complete. 2024-09-21T06:06:09.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.096+0000 7f368c000640 1 Processor -- start 2024-09-21T06:06:09.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.096+0000 7f368c000640 1 -- start start 2024-09-21T06:06:09.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f368c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36840af900 0x7f368415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f368c000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36840b5840 0x7f368415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f368c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3684152cf0 0x7f368415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f368c000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f36840730e0 con 0x7f36840b5840 2024-09-21T06:06:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f368c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3684072f60 con 0x7f3684152cf0 2024-09-21T06:06:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f368c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3684073260 con 0x7f36840af900 2024-09-21T06:06:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f3688c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36840b5840 0x7f368415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f3688c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36840b5840 0x7f368415ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33410/0 (socket says 172.21.15.118:33410) 2024-09-21T06:06:09.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f3688c00640 1 -- 172.21.15.118:0/1585925267 learned_addr learned my addr 172.21.15.118:0/1585925267 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:09.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f368a000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3684152cf0 0x7f368415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.098+0000 7f3689600640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36840af900 0x7f368415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3688c00640 1 -- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36840af900 msgr2=0x7f368415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3688c00640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36840af900 0x7f368415eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3688c00640 1 -- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3684152cf0 msgr2=0x7f368415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3688c00640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3684152cf0 0x7f368415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3688c00640 1 -- 172.21.15.118:0/1585925267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36841f9870 con 0x7f36840b5840 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f368a000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3684152cf0 0x7f368415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3689600640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36840af900 0x7f368415eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3688c00640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36840b5840 0x7f368415ad40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f367000c390 tx=0x7f367000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3681600640 1 -- 172.21.15.118:0/1585925267 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670011790 con 0x7f36840b5840 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3681600640 1 -- 172.21.15.118:0/1585925267 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3670017070 con 0x7f36840b5840 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f3681600640 1 -- 172.21.15.118:0/1585925267 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670011d00 con 0x7f36840b5840 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36841f9b10 con 0x7f36840b5840 2024-09-21T06:06:09.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.099+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368415f070 con 0x7f36840b5840 2024-09-21T06:06:09.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.100+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368415f320 con 0x7f36840b5840 2024-09-21T06:06:09.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.102+0000 7f3681600640 1 -- 172.21.15.118:0/1585925267 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f367001c460 con 0x7f36840b5840 2024-09-21T06:06:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.103+0000 7f3681600640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3664078bc0 0x7f366407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.103+0000 7f3681600640 1 -- 172.21.15.118:0/1585925267 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7f367009a680 con 0x7f36840b5840 2024-09-21T06:06:09.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.103+0000 7f3689600640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3664078bc0 0x7f366407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.104+0000 7f3689600640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3664078bc0 0x7f366407b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3678000f60 tx=0x7f3678009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:09.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.107+0000 7f3681600640 1 -- 172.21.15.118:0/1585925267 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3670062e50 con 0x7f36840b5840 2024-09-21T06:06:09.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.290+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f36840afd10 con 0x7f36840b5840 2024-09-21T06:06:09.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.290+0000 7f3681600640 1 -- 172.21.15.118:0/1585925267 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) ==== 93+0+10 (secure 0 0 0) 0x7f3670062750 con 0x7f36840b5840 2024-09-21T06:06:09.292 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:06:09.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.292+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3664078bc0 msgr2=0x7f366407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.292+0000 7f368c000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3664078bc0 0x7f366407b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3678000f60 tx=0x7f3678009040 comp rx=0 tx=0).stop 2024-09-21T06:06:09.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.292+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36840b5840 msgr2=0x7f368415ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.292+0000 7f368c000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36840b5840 0x7f368415ad40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f367000c390 tx=0x7f367000c850 comp rx=0 tx=0).stop 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 shutdown_connections 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3684152cf0 0x7f368415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36840b5840 0x7f368415ad40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3664078bc0 0x7f366407b0d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 --2- 172.21.15.118:0/1585925267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36840af900 0x7f368415eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 >> 172.21.15.118:0/1585925267 conn(0x7f36840b2860 msgr2=0x7f3684150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 shutdown_connections 2024-09-21T06:06:09.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.293+0000 7f368c000640 1 -- 172.21.15.118:0/1585925267 wait complete. 2024-09-21T06:06:09.316 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-21T06:06:09.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.534+0000 7fe94b600640 1 -- 172.21.15.118:0/3376554113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe94413fef0 msgr2=0x7fe944142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.534+0000 7fe94b600640 1 --2- 172.21.15.118:0/3376554113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe94413fef0 0x7fe944142e40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005fd0 tx=0x7fe93c02a820 comp rx=0 tx=0).stop 2024-09-21T06:06:09.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.535+0000 7fe94b600640 1 -- 172.21.15.118:0/3376554113 shutdown_connections 2024-09-21T06:06:09.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.535+0000 7fe94b600640 1 --2- 172.21.15.118:0/3376554113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe94413fef0 0x7fe944142e40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.535+0000 7fe94b600640 1 -- 172.21.15.118:0/3376554113 >> 172.21.15.118:0/3376554113 conn(0x7fe94406d110 msgr2=0x7fe94406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:09.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.535+0000 7fe94b600640 1 -- 172.21.15.118:0/3376554113 shutdown_connections 2024-09-21T06:06:09.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.535+0000 7fe94b600640 1 -- 172.21.15.118:0/3376554113 wait complete. 2024-09-21T06:06:09.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.537+0000 7fe94b600640 1 Processor -- start 2024-09-21T06:06:09.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.537+0000 7fe94b600640 1 -- start start 2024-09-21T06:06:09.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.538+0000 7fe94b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94413fae0 0x7fe9441533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.538+0000 7fe94b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe94413fef0 0x7fe94415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.538+0000 7fe94b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9440b5700 0x7fe94415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.538+0000 7fe94b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe9441682e0 con 0x7fe9440b5700 2024-09-21T06:06:09.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.538+0000 7fe94b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe944168160 con 0x7fe94413fae0 2024-09-21T06:06:09.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.538+0000 7fe94b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe944168460 con 0x7fe94413fef0 2024-09-21T06:06:09.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9440b5700 0x7fe94415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9440b5700 0x7fe94415c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33438/0 (socket says 172.21.15.118:33438) 2024-09-21T06:06:09.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 -- 172.21.15.118:0/4141846779 learned_addr learned my addr 172.21.15.118:0/4141846779 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe948c00640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94413fae0 0x7fe9441533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe93be00640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe94413fef0 0x7fe94415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 -- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe94413fef0 msgr2=0x7fe94415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe94413fef0 0x7fe94415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 -- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94413fae0 msgr2=0x7fe9441533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94413fae0 0x7fe9441533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.539+0000 7fe949600640 1 -- 172.21.15.118:0/4141846779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94413e0b0 con 0x7fe9440b5700 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.540+0000 7fe949600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9440b5700 0x7fe94415c6e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009b30 tx=0x7fe93c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.540+0000 7fe941600640 1 -- 172.21.15.118:0/4141846779 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c037040 con 0x7fe9440b5700 2024-09-21T06:06:09.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.540+0000 7fe941600640 1 -- 172.21.15.118:0/4141846779 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe93c042070 con 0x7fe9440b5700 2024-09-21T06:06:09.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.540+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9440b3cb0 con 0x7fe9440b5700 2024-09-21T06:06:09.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.540+0000 7fe941600640 1 -- 172.21.15.118:0/4141846779 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0042a0 con 0x7fe9440b5700 2024-09-21T06:06:09.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.540+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9440b4670 con 0x7fe9440b5700 2024-09-21T06:06:09.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.541+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9440d0e80 con 0x7fe9440b5700 2024-09-21T06:06:09.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.542+0000 7fe941600640 1 -- 172.21.15.118:0/4141846779 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe93c004440 con 0x7fe9440b5700 2024-09-21T06:06:09.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.543+0000 7fe941600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe920078b90 0x7fe92007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:09.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.543+0000 7fe941600640 1 -- 172.21.15.118:0/4141846779 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7fe93c0bb8d0 con 0x7fe9440b5700 2024-09-21T06:06:09.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.544+0000 7fe948c00640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe920078b90 0x7fe92007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:09.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.545+0000 7fe948c00640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe920078b90 0x7fe92007b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe934007fd0 tx=0x7fe934009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:09.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.548+0000 7fe941600640 1 -- 172.21.15.118:0/4141846779 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe93c084000 con 0x7fe9440b5700 2024-09-21T06:06:09.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:09.802+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7fe94415e7a0 con 0x7fe9440b5700 2024-09-21T06:06:10.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.406+0000 7fe941600640 1 -- 172.21.15.118:0/4141846779 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v143) ==== 137+0+0 (secure 0 0 0) 0x7fe93c083900 con 0x7fe9440b5700 2024-09-21T06:06:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe920078b90 msgr2=0x7fe92007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe920078b90 0x7fe92007b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe934007fd0 tx=0x7fe934009040 comp rx=0 tx=0).stop 2024-09-21T06:06:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9440b5700 msgr2=0x7fe94415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9440b5700 0x7fe94415c6e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009b30 tx=0x7fe93c032c90 comp rx=0 tx=0).stop 2024-09-21T06:06:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 shutdown_connections 2024-09-21T06:06:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9440b5700 0x7fe94415c6e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe920078b90 0x7fe92007b0a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe94413fef0 0x7fe94415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 --2- 172.21.15.118:0/4141846779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe94413fae0 0x7fe9441533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.408+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 >> 172.21.15.118:0/4141846779 conn(0x7fe94406d110 msgr2=0x7fe94413c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:10.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.409+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 shutdown_connections 2024-09-21T06:06:10.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.409+0000 7fe94b600640 1 -- 172.21.15.118:0/4141846779 wait complete. 2024-09-21T06:06:10.433 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-21T06:06:10.665 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_objectstore":"memstore"} 2024-09-21T06:06:10.665 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-21T06:06:10.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:06:10.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 -- 172.21.15.118:0/2037685467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f81461d0 msgr2=0x7fd4f80b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:10.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/2037685467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f81461d0 0x7fd4f80b5bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8005fd0 tx=0x7fd4e802a540 comp rx=0 tx=0).stop 2024-09-21T06:06:10.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 -- 172.21.15.118:0/2037685467 shutdown_connections 2024-09-21T06:06:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/2037685467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4f80b60f0 0x7fd4f815d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/2037685467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f81461d0 0x7fd4f80b5bb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 -- 172.21.15.118:0/2037685467 >> 172.21.15.118:0/2037685467 conn(0x7fd4f806d6e0 msgr2=0x7fd4f80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 -- 172.21.15.118:0/2037685467 shutdown_connections 2024-09-21T06:06:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.883+0000 7fd4f7e00640 1 -- 172.21.15.118:0/2037685467 wait complete. 2024-09-21T06:06:10.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.886+0000 7fd4f7e00640 1 Processor -- start 2024-09-21T06:06:10.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.886+0000 7fd4f7e00640 1 -- start start 2024-09-21T06:06:10.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.887+0000 7fd4f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80b60f0 0x7fd4f80c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:10.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.887+0000 7fd4f7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4f81461d0 0x7fd4f8156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:10.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.887+0000 7fd4f7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f815d690 0x7fd4f80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:10.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.887+0000 7fd4f7e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f8160e50 con 0x7fd4f80b60f0 2024-09-21T06:06:10.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.887+0000 7fd4f7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f81601d0 con 0x7fd4f815d690 2024-09-21T06:06:10.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.887+0000 7fd4f7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f8160fd0 con 0x7fd4f81461d0 2024-09-21T06:06:10.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.887+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80b60f0 0x7fd4f80c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:10.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80b60f0 0x7fd4f80c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33446/0 (socket says 172.21.15.118:33446) 2024-09-21T06:06:10.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 -- 172.21.15.118:0/1101687473 learned_addr learned my addr 172.21.15.118:0/1101687473 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:10.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4ee000640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4f81461d0 0x7fd4f8156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:10.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f7400640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f815d690 0x7fd4f80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 -- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4f81461d0 msgr2=0x7fd4f8156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4f81461d0 0x7fd4f8156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 -- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f815d690 msgr2=0x7fd4f80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f815d690 0x7fd4f80cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 -- 172.21.15.118:0/1101687473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f80ca2a0 con 0x7fd4f80b60f0 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.888+0000 7fd4f6a00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80b60f0 0x7fd4f80c9c20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8034040 tx=0x7fd4e80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.889+0000 7fd4efe00640 1 -- 172.21.15.118:0/1101687473 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e803e030 con 0x7fd4f80b60f0 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.889+0000 7fd4efe00640 1 -- 172.21.15.118:0/1101687473 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4e8003d90 con 0x7fd4f80b60f0 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.889+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f80ca580 con 0x7fd4f80b60f0 2024-09-21T06:06:10.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.889+0000 7fd4efe00640 1 -- 172.21.15.118:0/1101687473 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8035040 con 0x7fd4f80b60f0 2024-09-21T06:06:10.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.889+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f80cab40 con 0x7fd4f80b60f0 2024-09-21T06:06:10.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.890+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f81614f0 con 0x7fd4f80b60f0 2024-09-21T06:06:10.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.891+0000 7fd4efe00640 1 -- 172.21.15.118:0/1101687473 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4e8041030 con 0x7fd4f80b60f0 2024-09-21T06:06:10.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.892+0000 7fd4efe00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd4d4078b90 0x7fd4d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:10.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.892+0000 7fd4efe00640 1 -- 172.21.15.118:0/1101687473 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7fd4e80bb470 con 0x7fd4f80b60f0 2024-09-21T06:06:10.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.892+0000 7fd4ee000640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd4d4078b90 0x7fd4d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:10.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.893+0000 7fd4ee000640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd4d4078b90 0x7fd4d407b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8144ff0 tx=0x7fd4e0005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:10.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:10.897+0000 7fd4efe00640 1 -- 172.21.15.118:0/1101687473 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd4e8083560 con 0x7fd4f80b60f0 2024-09-21T06:06:11.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.083+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd4f8074fa0 con 0x7fd4f80b60f0 2024-09-21T06:06:11.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.083+0000 7fd4efe00640 1 -- 172.21.15.118:0/1101687473 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1472 (secure 0 0 0) 0x7fd4e8087f90 con 0x7fd4f80b60f0 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:06:11.085 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:06:11.086 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:06:11.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd4d4078b90 msgr2=0x7fd4d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:11.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd4d4078b90 0x7fd4d407b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8144ff0 tx=0x7fd4e0005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:11.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80b60f0 msgr2=0x7fd4f80c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80b60f0 0x7fd4f80c9c20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8034040 tx=0x7fd4e80038a0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 shutdown_connections 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4f815d690 0x7fd4f80cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd4d4078b90 0x7fd4d407b0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4f81461d0 0x7fd4f8156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 --2- 172.21.15.118:0/1101687473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80b60f0 0x7fd4f80c9c20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 >> 172.21.15.118:0/1101687473 conn(0x7fd4f806d6e0 msgr2=0x7fd4f815ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 shutdown_connections 2024-09-21T06:06:11.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.086+0000 7fd4f7e00640 1 -- 172.21.15.118:0/1101687473 wait complete. 2024-09-21T06:06:11.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:06:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.332+0000 7efc1e200640 1 -- 172.21.15.118:0/2946622266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbfc003a30 msgr2=0x7efbfc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.332+0000 7efc1e200640 1 --2- 172.21.15.118:0/2946622266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbfc003a30 0x7efbfc003ea0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c310 tx=0x7efbfc005830 comp rx=0 tx=0).stop 2024-09-21T06:06:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.332+0000 7efc1d800640 1 -- 172.21.15.118:0/2946622266 reap_dead start 2024-09-21T06:06:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.332+0000 7efc1e200640 1 -- 172.21.15.118:0/2946622266 shutdown_connections 2024-09-21T06:06:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.332+0000 7efc1e200640 1 -- 172.21.15.118:0/2946622266 >> 172.21.15.118:0/2946622266 conn(0x7efc1806d6e0 msgr2=0x7efc180b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.332+0000 7efc1e200640 1 -- 172.21.15.118:0/2946622266 shutdown_connections 2024-09-21T06:06:11.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.332+0000 7efc1e200640 1 -- 172.21.15.118:0/2946622266 wait complete. 2024-09-21T06:06:11.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.334+0000 7efc1e200640 1 Processor -- start 2024-09-21T06:06:11.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.334+0000 7efc1e200640 1 -- start start 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbfc003a30 0x7efc1815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc181f5d50 0x7efc1815e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc181f9900 0x7efc181f9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efc18164a20 con 0x7efc181f5d50 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc181648a0 con 0x7efbfc003a30 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efc18164ba0 con 0x7efc181f9900 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc0fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc181f5d50 0x7efc1815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:11.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc0fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc181f5d50 0x7efc1815e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33460/0 (socket says 172.21.15.118:33460) 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc0fe00640 1 -- 172.21.15.118:0/904462004 learned_addr learned my addr 172.21.15.118:0/904462004 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1d800640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc181f9900 0x7efc181f9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.336+0000 7efc1ce00640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbfc003a30 0x7efc1815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc0fe00640 1 -- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc181f9900 msgr2=0x7efc181f9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc0fe00640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc181f9900 0x7efc181f9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc0fe00640 1 -- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbfc003a30 msgr2=0x7efc1815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc0fe00640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbfc003a30 0x7efc1815bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc0fe00640 1 -- 172.21.15.118:0/904462004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc181fa250 con 0x7efc181f5d50 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc1d800640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc181f9900 0x7efc181f9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc1ce00640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbfc003a30 0x7efc1815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:11.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc0fe00640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc181f5d50 0x7efc1815e060 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efc00003f50 tx=0x7efc000016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc15600640 1 -- 172.21.15.118:0/904462004 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00011640 con 0x7efc181f5d50 2024-09-21T06:06:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc15600640 1 -- 172.21.15.118:0/904462004 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc00016020 con 0x7efc181f5d50 2024-09-21T06:06:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc15600640 1 -- 172.21.15.118:0/904462004 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00011a60 con 0x7efc181f5d50 2024-09-21T06:06:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc180b0af0 con 0x7efc181f5d50 2024-09-21T06:06:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.337+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc180b10b0 con 0x7efc181f5d50 2024-09-21T06:06:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.338+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc180cedb0 con 0x7efc181f5d50 2024-09-21T06:06:11.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.339+0000 7efc15600640 1 -- 172.21.15.118:0/904462004 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc00011c00 con 0x7efc181f5d50 2024-09-21T06:06:11.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.340+0000 7efc15600640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efbf4078b90 0x7efbf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:11.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.340+0000 7efc15600640 1 -- 172.21.15.118:0/904462004 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7efc0009b6d0 con 0x7efc181f5d50 2024-09-21T06:06:11.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.341+0000 7efc1ce00640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efbf4078b90 0x7efbf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:11.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.341+0000 7efc1ce00640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efbf4078b90 0x7efbf407b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc08033000 tx=0x7efc18074b00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.345+0000 7efc15600640 1 -- 172.21.15.118:0/904462004 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efc00020020 con 0x7efc181f5d50 2024-09-21T06:06:11.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.530+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efc180b0880 con 0x7efc181f5d50 2024-09-21T06:06:11.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.534+0000 7efc15600640 1 -- 172.21.15.118:0/904462004 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7efc00063d70 con 0x7efc181f5d50 2024-09-21T06:06:11.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efbf4078b90 msgr2=0x7efbf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efbf4078b90 0x7efbf407b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc08033000 tx=0x7efc18074b00 comp rx=0 tx=0).stop 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc181f5d50 msgr2=0x7efc1815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc181f5d50 0x7efc1815e060 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efc00003f50 tx=0x7efc000016f0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 shutdown_connections 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efbf4078b90 0x7efbf407b0a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc181f9900 0x7efc181f9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc181f5d50 0x7efc1815e060 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 --2- 172.21.15.118:0/904462004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbfc003a30 0x7efc1815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 >> 172.21.15.118:0/904462004 conn(0x7efc1806d6e0 msgr2=0x7efc180af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:11.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 shutdown_connections 2024-09-21T06:06:11.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:11.537+0000 7efc1e200640 1 -- 172.21.15.118:0/904462004 wait complete. 2024-09-21T06:06:11.559 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:06:11.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:06:11.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:06:11.740 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:06:11.740 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:06:11.740 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:11.776 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:06:11.777 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:06:11.777 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:11.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:06:11.814 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:06:11.814 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:11.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:06:11.854 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:06:11.854 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:11.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:06:11.890 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:06:11.890 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:12.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 -- 172.21.15.118:0/1823816555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec142e40 msgr2=0x7f58ec0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 --2- 172.21.15.118:0/1823816555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec142e40 0x7f58ec0d13c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f58e4005fd0 tx=0x7f58e402a820 comp rx=0 tx=0).stop 2024-09-21T06:06:12.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 -- 172.21.15.118:0/1823816555 shutdown_connections 2024-09-21T06:06:12.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 --2- 172.21.15.118:0/1823816555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec142e40 0x7f58ec0d13c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 --2- 172.21.15.118:0/1823816555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ec13fae0 0x7f58ec0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 -- 172.21.15.118:0/1823816555 >> 172.21.15.118:0/1823816555 conn(0x7f58ec06d110 msgr2=0x7f58ec06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:12.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 -- 172.21.15.118:0/1823816555 shutdown_connections 2024-09-21T06:06:12.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.113+0000 7f58f1600640 1 -- 172.21.15.118:0/1823816555 wait complete. 2024-09-21T06:06:12.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.115+0000 7f58f1600640 1 Processor -- start 2024-09-21T06:06:12.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.115+0000 7f58f1600640 1 -- start start 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58f1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58ec13fae0 0x7f58ec1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58f1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec13fef0 0x7f58ec15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58f1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ec142e40 0x7f58ec15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58f1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0cfb10 con 0x7f58ec13fef0 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58f1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0cf990 con 0x7f58ec13fae0 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58f1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58ec0cfc90 con 0x7f58ec142e40 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec13fef0 0x7f58ec15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec13fef0 0x7f58ec15b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33476/0 (socket says 172.21.15.118:33476) 2024-09-21T06:06:12.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 -- 172.21.15.118:0/2382326703 learned_addr learned my addr 172.21.15.118:0/2382326703 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58eaa00640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58ec13fae0 0x7f58ec1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58eb400640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ec142e40 0x7f58ec15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 -- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ec142e40 msgr2=0x7f58ec15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ec142e40 0x7f58ec15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 -- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58ec13fae0 msgr2=0x7f58ec1f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58ec13fae0 0x7f58ec1f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.117+0000 7f58ea000640 1 -- 172.21.15.118:0/2382326703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec1f66f0 con 0x7f58ec13fef0 2024-09-21T06:06:12.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.118+0000 7f58ea000640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec13fef0 0x7f58ec15b9a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f58d800c3c0 tx=0x7f58d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:12.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.118+0000 7f58e2a00640 1 -- 172.21.15.118:0/2382326703 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8017070 con 0x7f58ec13fef0 2024-09-21T06:06:12.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.118+0000 7f58e2a00640 1 -- 172.21.15.118:0/2382326703 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58d80035f0 con 0x7f58ec13fef0 2024-09-21T06:06:12.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.118+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec1f69d0 con 0x7f58ec13fef0 2024-09-21T06:06:12.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.118+0000 7f58e2a00640 1 -- 172.21.15.118:0/2382326703 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8003a40 con 0x7f58ec13fef0 2024-09-21T06:06:12.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.118+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec13e4c0 con 0x7f58ec13fef0 2024-09-21T06:06:12.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.119+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ec0cdaf0 con 0x7f58ec13fef0 2024-09-21T06:06:12.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.120+0000 7f58e2a00640 1 -- 172.21.15.118:0/2382326703 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58d801a070 con 0x7f58ec13fef0 2024-09-21T06:06:12.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.122+0000 7f58e2a00640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58cc078b90 0x7f58cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.122+0000 7f58e2a00640 1 -- 172.21.15.118:0/2382326703 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7f58d8099b40 con 0x7f58ec13fef0 2024-09-21T06:06:12.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.122+0000 7f58eaa00640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58cc078b90 0x7f58cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.123+0000 7f58eaa00640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58cc078b90 0x7f58cc07b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009b30 tx=0x7f58dc005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:12.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.127+0000 7f58e2a00640 1 -- 172.21.15.118:0/2382326703 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58d8061d50 con 0x7f58ec13fef0 2024-09-21T06:06:12.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.350+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58ec0d0140 con 0x7f58ec13fef0 2024-09-21T06:06:12.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.351+0000 7f58e2a00640 1 -- 172.21.15.118:0/2382326703 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3917 (secure 0 0 0) 0x7f58d8066780 con 0x7f58ec13fef0 2024-09-21T06:06:12.353 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:12.353 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"btime":"2024-09-21T06:06:05:191102+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5131,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2777427694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2777427694},{"type":"v1","addr":"172.21.15.149:6836","nonce":2777427694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2078582711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2078582711},{"type":"v1","addr":"172.21.15.118:6835","nonce":2078582711}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/288056978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":288056978},{"type":"v1","addr":"172.21.15.149:6837","nonce":288056978}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/847153203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":847153203},{"type":"v1","addr":"172.21.15.118:6834","nonce":847153203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-09-21T06:06:12.353 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 27 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58cc078b90 msgr2=0x7f58cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58cc078b90 0x7f58cc07b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009b30 tx=0x7f58dc005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec13fef0 msgr2=0x7f58ec15b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec13fef0 0x7f58ec15b9a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f58d800c3c0 tx=0x7f58d800c880 comp rx=0 tx=0).stop 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 shutdown_connections 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58cc078b90 0x7f58cc07b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ec142e40 0x7f58ec15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ec13fef0 0x7f58ec15b9a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 --2- 172.21.15.118:0/2382326703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58ec13fae0 0x7f58ec1f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 >> 172.21.15.118:0/2382326703 conn(0x7f58ec06d110 msgr2=0x7f58ec155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:12.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 shutdown_connections 2024-09-21T06:06:12.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.353+0000 7f58f1600640 1 -- 172.21.15.118:0/2382326703 wait complete. 2024-09-21T06:06:12.376 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:06:12.377 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:06:12.377 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:06:12.377 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:06:12.377 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:06:12.377 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:06:12.377 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:06:12.377 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:06:12.378 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:06:12.378 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:06:12.378 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:06:12.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:06:12.378 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:06:12.378 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:06:12.378 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:06:12.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:06:12.400 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:06:12.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:06:12.401 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:06:12.401 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:06:12.402 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:06:12.402 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:06:12.403 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:06:12.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:06:12.445 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:06:12.445 DEBUG:teuthology.parallel:result is None 2024-09-21T06:06:12.446 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:06:12.447 DEBUG:teuthology.parallel:result is None 2024-09-21T06:06:12.447 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:06:12.447 DEBUG:teuthology.parallel:result is None 2024-09-21T06:06:12.449 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:06:12.450 DEBUG:teuthology.parallel:result is None 2024-09-21T06:06:12.450 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:06:12.641 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:06:12.641 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:06:12.642 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:06:12.644 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:06:12.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.681+0000 7f43e5800640 1 -- 172.21.15.118:0/3751844086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fef0 msgr2=0x7f43e0142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.681+0000 7f43e5800640 1 --2- 172.21.15.118:0/3751844086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fef0 0x7f43e0142e40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43d8005fd0 tx=0x7f43d802a8b0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.681+0000 7f43e5800640 1 -- 172.21.15.118:0/3751844086 shutdown_connections 2024-09-21T06:06:12.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.681+0000 7f43e5800640 1 --2- 172.21.15.118:0/3751844086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fef0 0x7f43e0142e40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.681+0000 7f43e5800640 1 -- 172.21.15.118:0/3751844086 >> 172.21.15.118:0/3751844086 conn(0x7f43e006d110 msgr2=0x7f43e006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:12.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.681+0000 7f43e5800640 1 -- 172.21.15.118:0/3751844086 shutdown_connections 2024-09-21T06:06:12.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.682+0000 7f43e5800640 1 -- 172.21.15.118:0/3751844086 wait complete. 2024-09-21T06:06:12.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.684+0000 7f43e5800640 1 Processor -- start 2024-09-21T06:06:12.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.684+0000 7f43e5800640 1 -- start start 2024-09-21T06:06:12.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.685+0000 7f43e5800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fae0 0x7f43e0141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.685+0000 7f43e5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43e013fef0 0x7f43e0139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.685+0000 7f43e5800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e0153d20 0x7f43e015c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.685+0000 7f43e5800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0168280 con 0x7f43e0153d20 2024-09-21T06:06:12.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.685+0000 7f43e5800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0168100 con 0x7f43e013fae0 2024-09-21T06:06:12.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.685+0000 7f43e5800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f43e0168400 con 0x7f43e013fef0 2024-09-21T06:06:12.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e0153d20 0x7f43e015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e0153d20 0x7f43e015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33504/0 (socket says 172.21.15.118:33504) 2024-09-21T06:06:12.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 -- 172.21.15.118:0/2396380040 learned_addr learned my addr 172.21.15.118:0/2396380040 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:12.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43dea00640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fae0 0x7f43e0141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43d6000640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43e013fef0 0x7f43e0139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 -- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43e013fef0 msgr2=0x7f43e0139280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43e013fef0 0x7f43e0139280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 -- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fae0 msgr2=0x7f43e0141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fae0 0x7f43e0141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 -- 172.21.15.118:0/2396380040 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e0156850 con 0x7f43e0153d20 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.686+0000 7f43df400640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e0153d20 0x7f43e015c070 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f43d802aea0 tx=0x7f43d8031670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.687+0000 7f43d7400640 1 -- 172.21.15.118:0/2396380040 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8031e60 con 0x7f43e0153d20 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.687+0000 7f43d7400640 1 -- 172.21.15.118:0/2396380040 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d8003a60 con 0x7f43e0153d20 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.687+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e0156b30 con 0x7f43e0153d20 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.687+0000 7f43d7400640 1 -- 172.21.15.118:0/2396380040 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d80330d0 con 0x7f43e0153d20 2024-09-21T06:06:12.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.687+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e01570f0 con 0x7f43e0153d20 2024-09-21T06:06:12.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.688+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e01541c0 con 0x7f43e0153d20 2024-09-21T06:06:12.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.689+0000 7f43d7400640 1 -- 172.21.15.118:0/2396380040 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43d8033270 con 0x7f43e0153d20 2024-09-21T06:06:12.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.690+0000 7f43d7400640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43bc078b90 0x7f43bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:12.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.690+0000 7f43d7400640 1 -- 172.21.15.118:0/2396380040 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7f43d80bbed0 con 0x7f43e0153d20 2024-09-21T06:06:12.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.690+0000 7f43dea00640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43bc078b90 0x7f43bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:12.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.691+0000 7f43dea00640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43bc078b90 0x7f43bc07b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f43d0007f30 tx=0x7f43d0007ec0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:12.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.695+0000 7f43d7400640 1 -- 172.21.15.118:0/2396380040 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f43d803f030 con 0x7f43e0153d20 2024-09-21T06:06:12.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:12.892+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f43e00d0e80 con 0x7f43e0153d20 2024-09-21T06:06:13.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.425+0000 7f43d7400640 1 -- 172.21.15.118:0/2396380040 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) ==== 97+0+0 (secure 0 0 0) 0x7f43d8083ea0 con 0x7f43e0153d20 2024-09-21T06:06:13.427 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43bc078b90 msgr2=0x7f43bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43bc078b90 0x7f43bc07b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f43d0007f30 tx=0x7f43d0007ec0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e0153d20 msgr2=0x7f43e015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e0153d20 0x7f43e015c070 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f43d802aea0 tx=0x7f43d8031670 comp rx=0 tx=0).stop 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 shutdown_connections 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e0153d20 0x7f43e015c070 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43bc078b90 0x7f43bc07b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43e013fef0 0x7f43e0139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 --2- 172.21.15.118:0/2396380040 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43e013fae0 0x7f43e0141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 >> 172.21.15.118:0/2396380040 conn(0x7f43e006d110 msgr2=0x7f43e0142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:13.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 shutdown_connections 2024-09-21T06:06:13.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.428+0000 7f43e5800640 1 -- 172.21.15.118:0/2396380040 wait complete. 2024-09-21T06:06:13.459 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:06:13.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 -- 172.21.15.118:0/2575966262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0064142730 msgr2=0x7f0064142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:13.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 --2- 172.21.15.118:0/2575966262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0064142730 0x7f0064142b40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0064071c00 tx=0x7f005c02a560 comp rx=0 tx=0).stop 2024-09-21T06:06:13.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 -- 172.21.15.118:0/2575966262 shutdown_connections 2024-09-21T06:06:13.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 --2- 172.21.15.118:0/2575966262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0064142730 0x7f0064142b40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 --2- 172.21.15.118:0/2575966262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f006413fef0 0x7f00640d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 --2- 172.21.15.118:0/2575966262 >> v2:172.21.15.149:3300/0 conn(0x7f006413fae0 0x7f00640d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 -- 172.21.15.118:0/2575966262 >> 172.21.15.118:0/2575966262 conn(0x7f006406d110 msgr2=0x7f006406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.677+0000 7f006ac00640 1 -- 172.21.15.118:0/2575966262 shutdown_connections 2024-09-21T06:06:13.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.678+0000 7f006ac00640 1 -- 172.21.15.118:0/2575966262 wait complete. 2024-09-21T06:06:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.680+0000 7f006ac00640 1 Processor -- start 2024-09-21T06:06:13.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.680+0000 7f006ac00640 1 -- start start 2024-09-21T06:06:13.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.681+0000 7f006ac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f006413fae0 0x7f0064139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.681+0000 7f006ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f006413fef0 0x7f0064073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.681+0000 7f006ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0064142730 0x7f00640cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.681+0000 7f006ac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f006406f330 con 0x7f006413fae0 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.681+0000 7f006ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f006406f1b0 con 0x7f006413fef0 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.681+0000 7f006ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f006406f4b0 con 0x7f0064142730 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f006413fae0 0x7f0064139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f006413fae0 0x7f0064139be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33524/0 (socket says 172.21.15.118:33524) 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 -- 172.21.15.118:0/2351987263 learned_addr learned my addr 172.21.15.118:0/2351987263 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063400640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f006413fef0 0x7f0064073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0068c00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0064142730 0x7f00640cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 -- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0064142730 msgr2=0x7f00640cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0064142730 0x7f00640cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 -- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f006413fef0 msgr2=0x7f0064073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:13.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f006413fef0 0x7f0064073cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 -- 172.21.15.118:0/2351987263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00641f97b0 con 0x7f006413fae0 2024-09-21T06:06:13.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.682+0000 7f0063e00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f006413fae0 0x7f0064139be0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f005400ea50 tx=0x7f005400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:13.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.683+0000 7f005be00640 1 -- 172.21.15.118:0/2351987263 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005400cdc0 con 0x7f006413fae0 2024-09-21T06:06:13.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.683+0000 7f005be00640 1 -- 172.21.15.118:0/2351987263 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0054011560 con 0x7f006413fae0 2024-09-21T06:06:13.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.683+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00641f9a90 con 0x7f006413fae0 2024-09-21T06:06:13.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.683+0000 7f005be00640 1 -- 172.21.15.118:0/2351987263 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054011990 con 0x7f006413fae0 2024-09-21T06:06:13.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.683+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00641fa050 con 0x7f006413fae0 2024-09-21T06:06:13.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.684+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f006406f9d0 con 0x7f006413fae0 2024-09-21T06:06:13.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.685+0000 7f005be00640 1 -- 172.21.15.118:0/2351987263 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0054011b30 con 0x7f006413fae0 2024-09-21T06:06:13.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.686+0000 7f005be00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0044078b90 0x7f004407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:13.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.686+0000 7f005be00640 1 -- 172.21.15.118:0/2351987263 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7f005409b5c0 con 0x7f006413fae0 2024-09-21T06:06:13.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.686+0000 7f0063400640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0044078b90 0x7f004407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:13.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.687+0000 7f0063400640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0044078b90 0x7f004407b0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f006413bf40 tx=0x7f005000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:13.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.690+0000 7f005be00640 1 -- 172.21.15.118:0/2351987263 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0054016030 con 0x7f006413fae0 2024-09-21T06:06:13.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.940+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0064153be0 con 0x7f006413fae0 2024-09-21T06:06:13.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.941+0000 7f005be00640 1 -- 172.21.15.118:0/2351987263 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f0054011e20 con 0x7f006413fae0 2024-09-21T06:06:13.942 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:13.942 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:06:13.942 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:06:13.942 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.943 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.944 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:06:13.945 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.946 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:06:13.947 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.949 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.950 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:06:13.951 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.952 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:06:13.953 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:13.954 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:06:13.955 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:06:13.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0044078b90 msgr2=0x7f004407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:13.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0044078b90 0x7f004407b0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f006413bf40 tx=0x7f005000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f006413fae0 msgr2=0x7f0064139be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:13.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f006413fae0 0x7f0064139be0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f005400ea50 tx=0x7f005400ef10 comp rx=0 tx=0).stop 2024-09-21T06:06:13.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 shutdown_connections 2024-09-21T06:06:13.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0044078b90 0x7f004407b0a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0064142730 0x7f00640cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f006413fef0 0x7f0064073cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 --2- 172.21.15.118:0/2351987263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f006413fae0 0x7f0064139be0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:13.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 >> 172.21.15.118:0/2351987263 conn(0x7f006406d110 msgr2=0x7f006415f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:13.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 shutdown_connections 2024-09-21T06:06:13.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:13.943+0000 7f006ac00640 1 -- 172.21.15.118:0/2351987263 wait complete. 2024-09-21T06:06:13.971 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:06:14.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 -- 172.21.15.118:0/93778895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 msgr2=0x7fa228142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 --2- 172.21.15.118:0/93778895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 0x7fa228142c70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa220005fd0 tx=0x7fa22002aa10 comp rx=0 tx=0).stop 2024-09-21T06:06:14.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 -- 172.21.15.118:0/93778895 shutdown_connections 2024-09-21T06:06:14.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 --2- 172.21.15.118:0/93778895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 0x7fa228142c70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 --2- 172.21.15.118:0/93778895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2280d1590 0x7fa228142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 -- 172.21.15.118:0/93778895 >> 172.21.15.118:0/93778895 conn(0x7fa22806d110 msgr2=0x7fa22806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:14.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 -- 172.21.15.118:0/93778895 shutdown_connections 2024-09-21T06:06:14.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.188+0000 7fa230600640 1 -- 172.21.15.118:0/93778895 wait complete. 2024-09-21T06:06:14.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.190+0000 7fa230600640 1 Processor -- start 2024-09-21T06:06:14.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.190+0000 7fa230600640 1 -- start start 2024-09-21T06:06:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa230600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa22813fae0 0x7fa228140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa230600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 0x7fa2281f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa230600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2280734c0 0x7fa2280738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa230600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa2280cfb10 con 0x7fa22813fae0 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa230600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2280cf990 con 0x7fa22813fef0 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa230600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa2280cfc90 con 0x7fa2280734c0 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa22813fae0 0x7fa228140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa22813fae0 0x7fa228140eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33536/0 (socket says 172.21.15.118:33536) 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 -- 172.21.15.118:0/3517443482 learned_addr learned my addr 172.21.15.118:0/3517443482 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22d200640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 0x7fa2281f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22e600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2280734c0 0x7fa2280738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 -- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2280734c0 msgr2=0x7fa2280738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2280734c0 0x7fa2280738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 -- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 msgr2=0x7fa2281f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 0x7fa2281f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22dc00640 1 -- 172.21.15.118:0/3517443482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa228073e10 con 0x7fa22813fae0 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.192+0000 7fa22e600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2280734c0 0x7fa2280738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.193+0000 7fa22dc00640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa22813fae0 0x7fa228140eb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c3d0 tx=0x7fa21c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.193+0000 7fa225600640 1 -- 172.21.15.118:0/3517443482 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c017070 con 0x7fa22813fae0 2024-09-21T06:06:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.193+0000 7fa225600640 1 -- 172.21.15.118:0/3517443482 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa21c0053c0 con 0x7fa22813fae0 2024-09-21T06:06:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.193+0000 7fa225600640 1 -- 172.21.15.118:0/3517443482 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c003850 con 0x7fa22813fae0 2024-09-21T06:06:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.193+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2281413f0 con 0x7fa22813fae0 2024-09-21T06:06:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.193+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa228141b50 con 0x7fa22813fae0 2024-09-21T06:06:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.194+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2280d0140 con 0x7fa22813fae0 2024-09-21T06:06:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.195+0000 7fa225600640 1 -- 172.21.15.118:0/3517443482 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa21c01a070 con 0x7fa22813fae0 2024-09-21T06:06:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.197+0000 7fa225600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa208078b90 0x7fa20807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.197+0000 7fa225600640 1 -- 172.21.15.118:0/3517443482 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7fa21c099de0 con 0x7fa22813fae0 2024-09-21T06:06:14.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.197+0000 7fa22d200640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa208078b90 0x7fa20807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.198+0000 7fa22d200640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa208078b90 0x7fa20807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa228139ac0 tx=0x7fa214005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.201+0000 7fa225600640 1 -- 172.21.15.118:0/3517443482 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa228073e10 con 0x7fa22813fae0 2024-09-21T06:06:14.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.389+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa228154090 con 0x7fa22813fae0 2024-09-21T06:06:14.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.390+0000 7fa225600640 1 -- 172.21.15.118:0/3517443482 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) ==== 84+0+65 (secure 0 0 0) 0x7fa21c061e80 con 0x7fa22813fae0 2024-09-21T06:06:14.391 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:14.391 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:06:14.391 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:06:14.391 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:06:14.392 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:06:14.392 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:06:14.392 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa208078b90 msgr2=0x7fa20807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa208078b90 0x7fa20807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa228139ac0 tx=0x7fa214005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa22813fae0 msgr2=0x7fa228140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa22813fae0 0x7fa228140eb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c3d0 tx=0x7fa21c00c890 comp rx=0 tx=0).stop 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 shutdown_connections 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa208078b90 0x7fa20807b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2280734c0 0x7fa2280738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa22813fef0 0x7fa2281f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 --2- 172.21.15.118:0/3517443482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa22813fae0 0x7fa228140eb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 >> 172.21.15.118:0/3517443482 conn(0x7fa22806d110 msgr2=0x7fa228152810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:14.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 shutdown_connections 2024-09-21T06:06:14.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.392+0000 7fa230600640 1 -- 172.21.15.118:0/3517443482 wait complete. 2024-09-21T06:06:14.416 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:06:14.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:06:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.644+0000 7f392be00640 1 -- 172.21.15.118:0/540577763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 msgr2=0x7f3910004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.644+0000 7f392be00640 1 --2- 172.21.15.118:0/540577763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 0x7f3910004c10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f39140016c0 tx=0x7f3910005830 comp rx=0 tx=0).stop 2024-09-21T06:06:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.644+0000 7f392b400640 1 -- 172.21.15.118:0/540577763 reap_dead start 2024-09-21T06:06:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.644+0000 7f392be00640 1 -- 172.21.15.118:0/540577763 shutdown_connections 2024-09-21T06:06:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.644+0000 7f392be00640 1 -- 172.21.15.118:0/540577763 >> 172.21.15.118:0/540577763 conn(0x7f392c06d420 msgr2=0x7f392c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:14.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.644+0000 7f392be00640 1 -- 172.21.15.118:0/540577763 shutdown_connections 2024-09-21T06:06:14.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.644+0000 7f392be00640 1 -- 172.21.15.118:0/540577763 wait complete. 2024-09-21T06:06:14.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.647+0000 7f392be00640 1 Processor -- start 2024-09-21T06:06:14.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.647+0000 7f392be00640 1 -- start start 2024-09-21T06:06:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 0x7f392c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f392c14f220 0x7f392c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f392c14f630 0x7f392c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0b5070 con 0x7f3910004800 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0b4ef0 con 0x7f392c14f630 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0b51f0 con 0x7f392c14f220 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 0x7f392c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 0x7f392c1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33552/0 (socket says 172.21.15.118:33552) 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.648+0000 7f392aa00640 1 -- 172.21.15.118:0/2206496486 learned_addr learned my addr 172.21.15.118:0/2206496486 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f3922000640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f392c14f220 0x7f392c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392b400640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f392c14f630 0x7f392c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392aa00640 1 -- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f392c14f220 msgr2=0x7f392c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392aa00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f392c14f220 0x7f392c1557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392aa00640 1 -- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f392c14f630 msgr2=0x7f392c155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392aa00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f392c14f630 0x7f392c155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392aa00640 1 -- 172.21.15.118:0/2206496486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c153ad0 con 0x7f3910004800 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f3922000640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f392c14f220 0x7f392c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392aa00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 0x7f392c1530f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f391c011ab0 tx=0x7f391c011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f3923e00640 1 -- 172.21.15.118:0/2206496486 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c01e070 con 0x7f3910004800 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f3923e00640 1 -- 172.21.15.118:0/2206496486 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f391c00fc70 con 0x7f3910004800 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.649+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c153db0 con 0x7f3910004800 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.650+0000 7f3923e00640 1 -- 172.21.15.118:0/2206496486 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c019670 con 0x7f3910004800 2024-09-21T06:06:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.650+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c154370 con 0x7f3910004800 2024-09-21T06:06:14.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.650+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c070920 con 0x7f3910004800 2024-09-21T06:06:14.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.652+0000 7f3923e00640 1 -- 172.21.15.118:0/2206496486 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f391c021070 con 0x7f3910004800 2024-09-21T06:06:14.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.653+0000 7f3923e00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3908078b90 0x7f390807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:14.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.653+0000 7f3923e00640 1 -- 172.21.15.118:0/2206496486 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 4857+0+0 (secure 0 0 0) 0x7f391c09ba30 con 0x7f3910004800 2024-09-21T06:06:14.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.653+0000 7f3922000640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3908078b90 0x7f390807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:14.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.654+0000 7f3922000640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3908078b90 0x7f390807b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3914032000 tx=0x7f3914001190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:14.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.656+0000 7f3923e00640 1 -- 172.21.15.118:0/2206496486 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f392c070920 con 0x7f3910004800 2024-09-21T06:06:14.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:14.841+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f392c0cd760 con 0x7f3910004800 2024-09-21T06:06:15.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.435+0000 7f3923e00640 1 -- 172.21.15.118:0/2206496486 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) ==== 138+0+0 (secure 0 0 0) 0x7f392c0cd760 con 0x7f3910004800 2024-09-21T06:06:15.437 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:06:15.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.438+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3908078b90 msgr2=0x7f390807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:15.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.438+0000 7f392be00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3908078b90 0x7f390807b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3914032000 tx=0x7f3914001190 comp rx=0 tx=0).stop 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.438+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 msgr2=0x7f392c1530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.438+0000 7f392be00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 0x7f392c1530f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f391c011ab0 tx=0x7f391c011f70 comp rx=0 tx=0).stop 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.439+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 shutdown_connections 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.439+0000 7f392be00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f392c14f630 0x7f392c155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.439+0000 7f392be00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3908078b90 0x7f390807b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.439+0000 7f392be00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f392c14f220 0x7f392c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.439+0000 7f392be00640 1 --2- 172.21.15.118:0/2206496486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3910004800 0x7f392c1530f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.439+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 >> 172.21.15.118:0/2206496486 conn(0x7f392c06d420 msgr2=0x7f392c0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:15.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.439+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 shutdown_connections 2024-09-21T06:06:15.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.440+0000 7f392be00640 1 -- 172.21.15.118:0/2206496486 wait complete. 2024-09-21T06:06:15.467 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 -- 172.21.15.118:0/3755416729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac880b4f20 msgr2=0x7fac880b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 --2- 172.21.15.118:0/3755416729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac880b4f20 0x7fac880b5330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac70009830 tx=0x7fac7002a510 comp rx=0 tx=0).stop 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 -- 172.21.15.118:0/3755416729 shutdown_connections 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 --2- 172.21.15.118:0/3755416729 >> v2:172.21.15.149:3300/0 conn(0x7fac880ae8b0 0x7fac880aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 --2- 172.21.15.118:0/3755416729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac880b4f20 0x7fac880b5330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 -- 172.21.15.118:0/3755416729 >> 172.21.15.118:0/3755416729 conn(0x7fac880b2dd0 msgr2=0x7fac880d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 -- 172.21.15.118:0/3755416729 shutdown_connections 2024-09-21T06:06:15.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.694+0000 7fac8d800640 1 -- 172.21.15.118:0/3755416729 wait complete. 2024-09-21T06:06:15.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.696+0000 7fac8d800640 1 Processor -- start 2024-09-21T06:06:15.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.696+0000 7fac8d800640 1 -- start start 2024-09-21T06:06:15.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.697+0000 7fac8d800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac880ae8b0 0x7fac880c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:15.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.697+0000 7fac8d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac880b4f20 0x7fac880b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.697+0000 7fac8d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac8815ed20 0x7fac881616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.697+0000 7fac8d800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fac880afac0 con 0x7fac880b4f20 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.697+0000 7fac8d800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac880af940 con 0x7fac880ae8b0 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.697+0000 7fac8d800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac880afc40 con 0x7fac8815ed20 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac880b4f20 0x7fac880b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac880b4f20 0x7fac880b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33562/0 (socket says 172.21.15.118:33562) 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 -- 172.21.15.118:0/379525767 learned_addr learned my addr 172.21.15.118:0/379525767 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac87e00640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac880ae8b0 0x7fac880c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:15.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac8ce00640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac8815ed20 0x7fac881616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 -- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac8815ed20 msgr2=0x7fac881616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac8815ed20 0x7fac881616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 -- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac880ae8b0 msgr2=0x7fac880c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac880ae8b0 0x7fac880c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.698+0000 7fac7f400640 1 -- 172.21.15.118:0/379525767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac880c5d00 con 0x7fac880b4f20 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.699+0000 7fac7f400640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac880b4f20 0x7fac880b1aa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fac70009950 tx=0x7fac70033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.699+0000 7fac84c00640 1 -- 172.21.15.118:0/379525767 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70005c90 con 0x7fac880b4f20 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.699+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac880c6180 con 0x7fac880b4f20 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.699+0000 7fac84c00640 1 -- 172.21.15.118:0/379525767 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac70031e50 con 0x7fac880b4f20 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.699+0000 7fac84c00640 1 -- 172.21.15.118:0/379525767 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70005260 con 0x7fac880b4f20 2024-09-21T06:06:15.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.699+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac880c6740 con 0x7fac880b4f20 2024-09-21T06:06:15.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.700+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac880b00f0 con 0x7fac880b4f20 2024-09-21T06:06:15.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.702+0000 7fac84c00640 1 -- 172.21.15.118:0/379525767 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac70005400 con 0x7fac880b4f20 2024-09-21T06:06:15.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.703+0000 7fac84c00640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac64078b90 0x7fac6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:15.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.703+0000 7fac84c00640 1 -- 172.21.15.118:0/379525767 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5227+0+0 (secure 0 0 0) 0x7fac700bc080 con 0x7fac880b4f20 2024-09-21T06:06:15.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.704+0000 7fac87e00640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac64078b90 0x7fac6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:15.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.704+0000 7fac87e00640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac64078b90 0x7fac6407b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac78007d60 tx=0x7fac78007cf0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:15.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.707+0000 7fac84c00640 1 -- 172.21.15.118:0/379525767 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fac7003f030 con 0x7fac880b4f20 2024-09-21T06:06:15.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:15.893+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fac8806a090 con 0x7fac880b4f20 2024-09-21T06:06:16.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.438+0000 7fac84c00640 1 -- 172.21.15.118:0/379525767 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) ==== 170+0+0 (secure 0 0 0) 0x7fac70083fb0 con 0x7fac880b4f20 2024-09-21T06:06:16.440 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:06:16.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.443+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac64078b90 msgr2=0x7fac6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:16.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.443+0000 7fac8d800640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac64078b90 0x7fac6407b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac78007d60 tx=0x7fac78007cf0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.443+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac880b4f20 msgr2=0x7fac880b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:16.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.443+0000 7fac8d800640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac880b4f20 0x7fac880b1aa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fac70009950 tx=0x7fac70033c20 comp rx=0 tx=0).stop 2024-09-21T06:06:16.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.444+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 shutdown_connections 2024-09-21T06:06:16.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.444+0000 7fac8d800640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac64078b90 0x7fac6407b0a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.444+0000 7fac8d800640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac8815ed20 0x7fac881616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.444+0000 7fac8d800640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac880b4f20 0x7fac880b1aa0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.444+0000 7fac8d800640 1 --2- 172.21.15.118:0/379525767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac880ae8b0 0x7fac880c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.444+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 >> 172.21.15.118:0/379525767 conn(0x7fac880b2dd0 msgr2=0x7fac8815b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:16.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.448+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 shutdown_connections 2024-09-21T06:06:16.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.448+0000 7fac8d800640 1 -- 172.21.15.118:0/379525767 wait complete. 2024-09-21T06:06:16.481 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 -- 172.21.15.118:0/1766927657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f473013fd80 msgr2=0x7f473015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 --2- 172.21.15.118:0/1766927657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f473013fd80 0x7f473015dc40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f473015d530 tx=0x7f472002a560 comp rx=0 tx=0).stop 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 -- 172.21.15.118:0/1766927657 shutdown_connections 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 --2- 172.21.15.118:0/1766927657 >> v2:172.21.15.149:3300/0 conn(0x7f47300cf170 0x7f47300cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 --2- 172.21.15.118:0/1766927657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f473013fd80 0x7f473015dc40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 -- 172.21.15.118:0/1766927657 >> 172.21.15.118:0/1766927657 conn(0x7f473006d110 msgr2=0x7f473006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 -- 172.21.15.118:0/1766927657 shutdown_connections 2024-09-21T06:06:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.704+0000 7f4735000640 1 -- 172.21.15.118:0/1766927657 wait complete. 2024-09-21T06:06:16.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.706+0000 7f4735000640 1 Processor -- start 2024-09-21T06:06:16.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.706+0000 7f4735000640 1 -- start start 2024-09-21T06:06:16.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4735000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47300cf170 0x7f473013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4735000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47300d0ea0 0x7f47300cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4735000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f473013fd80 0x7f4730142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4735000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f473015d890 con 0x7f47300cf170 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4735000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47300cfac0 con 0x7f47300d0ea0 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4735000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f473015e990 con 0x7f473013fd80 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47300cf170 0x7f473013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47300cf170 0x7f473013acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53256/0 (socket says 172.21.15.118:53256) 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 -- 172.21.15.118:0/1431528273 learned_addr learned my addr 172.21.15.118:0/1431528273 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472e800640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f473013fd80 0x7f4730142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4725400640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47300d0ea0 0x7f47300cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 -- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f473013fd80 msgr2=0x7f4730142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f473013fd80 0x7f4730142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 -- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47300d0ea0 msgr2=0x7f47300cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47300d0ea0 0x7f47300cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f472de00640 1 -- 172.21.15.118:0/1431528273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47301f6140 con 0x7f47300cf170 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.708+0000 7f4725400640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47300d0ea0 0x7f47300cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.709+0000 7f472de00640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47300cf170 0x7f473013acb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4720000c00 tx=0x7f4720003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.709+0000 7f4726a00640 1 -- 172.21.15.118:0/1431528273 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472003e030 con 0x7f47300cf170 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.709+0000 7f4726a00640 1 -- 172.21.15.118:0/1431528273 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4720003d10 con 0x7f47300cf170 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.709+0000 7f4726a00640 1 -- 172.21.15.118:0/1431528273 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720035040 con 0x7f47300cf170 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.709+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47301f6420 con 0x7f47300cf170 2024-09-21T06:06:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.709+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47301f69e0 con 0x7f47300cf170 2024-09-21T06:06:16.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.710+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47300cf580 con 0x7f47300cf170 2024-09-21T06:06:16.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.711+0000 7f4726a00640 1 -- 172.21.15.118:0/1431528273 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4720041030 con 0x7f47300cf170 2024-09-21T06:06:16.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.712+0000 7f4726a00640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f470c078bc0 0x7f470c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:16.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.712+0000 7f4726a00640 1 -- 172.21.15.118:0/1431528273 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5609+0+0 (secure 0 0 0) 0x7f47200bb400 con 0x7f47300cf170 2024-09-21T06:06:16.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.713+0000 7f4725400640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f470c078bc0 0x7f470c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:16.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.714+0000 7f4725400640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f470c078bc0 0x7f470c07b0d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f47301f7010 tx=0x7f4718009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:16.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.717+0000 7f4726a00640 1 -- 172.21.15.118:0/1431528273 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f47200831b0 con 0x7f47300cf170 2024-09-21T06:06:16.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:16.939+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f473013f5c0 con 0x7f47300cf170 2024-09-21T06:06:17.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.467+0000 7f4726a00640 1 -- 172.21.15.118:0/1431528273 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) ==== 172+0+0 (secure 0 0 0) 0x7f4720087be0 con 0x7f47300cf170 2024-09-21T06:06:17.469 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 8 and data pool 9 2024-09-21T06:06:17.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.476+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f470c078bc0 msgr2=0x7f470c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:17.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.476+0000 7f4735000640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f470c078bc0 0x7f470c07b0d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f47301f7010 tx=0x7f4718009040 comp rx=0 tx=0).stop 2024-09-21T06:06:17.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.476+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47300cf170 msgr2=0x7f473013acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:17.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.476+0000 7f4735000640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47300cf170 0x7f473013acb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4720000c00 tx=0x7f4720003820 comp rx=0 tx=0).stop 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 shutdown_connections 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f470c078bc0 0x7f470c07b0d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f473013fd80 0x7f4730142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47300d0ea0 0x7f47300cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 --2- 172.21.15.118:0/1431528273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47300cf170 0x7f473013acb0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 >> 172.21.15.118:0/1431528273 conn(0x7f473006d110 msgr2=0x7f4730074710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 shutdown_connections 2024-09-21T06:06:17.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.478+0000 7f4735000640 1 -- 172.21.15.118:0/1431528273 wait complete. 2024-09-21T06:06:17.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:06:17.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 -- 172.21.15.118:0/57539226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a013fae0 msgr2=0x7ff5a00d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:17.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/57539226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a013fae0 0x7ff5a00d0e80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff5a015d7d0 tx=0x7ff59002a540 comp rx=0 tx=0).stop 2024-09-21T06:06:17.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 -- 172.21.15.118:0/57539226 shutdown_connections 2024-09-21T06:06:17.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/57539226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5a0142730 0x7ff5a0142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/57539226 >> v2:172.21.15.149:3300/0 conn(0x7ff5a013fef0 0x7ff5a00d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/57539226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a013fae0 0x7ff5a00d0e80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 -- 172.21.15.118:0/57539226 >> 172.21.15.118:0/57539226 conn(0x7ff5a006d110 msgr2=0x7ff5a006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:17.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 -- 172.21.15.118:0/57539226 shutdown_connections 2024-09-21T06:06:17.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.731+0000 7ff5a5e00640 1 -- 172.21.15.118:0/57539226 wait complete. 2024-09-21T06:06:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.734+0000 7ff5a5e00640 1 Processor -- start 2024-09-21T06:06:17.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.734+0000 7ff5a5e00640 1 -- start start 2024-09-21T06:06:17.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.735+0000 7ff5a5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a013fae0 0x7ff5a0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:17.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.735+0000 7ff5a5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5a013fef0 0x7ff5a0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:17.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.735+0000 7ff5a5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0142730 0x7ff5a0155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:17.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.735+0000 7ff5a5e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a006f2e0 con 0x7ff5a0142730 2024-09-21T06:06:17.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.735+0000 7ff5a5e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a006f160 con 0x7ff5a013fae0 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.735+0000 7ff5a5e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a006f460 con 0x7ff5a013fef0 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0142730 0x7ff5a0155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0142730 0x7ff5a0155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53268/0 (socket says 172.21.15.118:53268) 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 -- 172.21.15.118:0/1288779964 learned_addr learned my addr 172.21.15.118:0/1288779964 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff596000640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5a013fef0 0x7ff5a0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59ea00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a013fae0 0x7ff5a0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 -- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5a013fef0 msgr2=0x7ff5a0154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5a013fef0 0x7ff5a0154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 -- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a013fae0 msgr2=0x7ff5a0152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a013fae0 0x7ff5a0152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 -- 172.21.15.118:0/1288779964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a013ea60 con 0x7ff5a0142730 2024-09-21T06:06:17.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59ea00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a013fae0 0x7ff5a0152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:17.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff59f400640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0142730 0x7ff5a0155380 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff59800ea40 tx=0x7ff59800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:17.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.736+0000 7ff597e00640 1 -- 172.21.15.118:0/1288779964 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800ce40 con 0x7ff5a0142730 2024-09-21T06:06:17.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.737+0000 7ff597e00640 1 -- 172.21.15.118:0/1288779964 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff598004c10 con 0x7ff5a0142730 2024-09-21T06:06:17.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.737+0000 7ff597e00640 1 -- 172.21.15.118:0/1288779964 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598005020 con 0x7ff5a0142730 2024-09-21T06:06:17.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.737+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a013ed40 con 0x7ff5a0142730 2024-09-21T06:06:17.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.737+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a013f300 con 0x7ff5a0142730 2024-09-21T06:06:17.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.738+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a006f980 con 0x7ff5a0142730 2024-09-21T06:06:17.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.739+0000 7ff597e00640 1 -- 172.21.15.118:0/1288779964 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5980051c0 con 0x7ff5a0142730 2024-09-21T06:06:17.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.740+0000 7ff597e00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff57c078b90 0x7ff57c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:17.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.740+0000 7ff597e00640 1 -- 172.21.15.118:0/1288779964 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7ff59809baf0 con 0x7ff5a0142730 2024-09-21T06:06:17.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.741+0000 7ff59ea00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff57c078b90 0x7ff57c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:17.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.741+0000 7ff59ea00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff57c078b90 0x7ff57c07b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff590033000 tx=0x7ff590004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:17.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.745+0000 7ff597e00640 1 -- 172.21.15.118:0/1288779964 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff598063f10 con 0x7ff5a0142730 2024-09-21T06:06:17.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.932+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5a00cf200 con 0x7ff5a0142730 2024-09-21T06:06:17.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.934+0000 7ff597e00640 1 -- 172.21.15.118:0/1288779964 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16810 (secure 0 0 0) 0x7ff598063810 con 0x7ff5a0142730 2024-09-21T06:06:17.935 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:17.935 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":62,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:06:16.940295+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:06:14.853192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:06:15.905084+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:06:17.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff57c078b90 msgr2=0x7ff57c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:17.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff57c078b90 0x7ff57c07b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff590033000 tx=0x7ff590004730 comp rx=0 tx=0).stop 2024-09-21T06:06:17.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0142730 msgr2=0x7ff5a0155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:17.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0142730 0x7ff5a0155380 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff59800ea40 tx=0x7ff59800ef00 comp rx=0 tx=0).stop 2024-09-21T06:06:17.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 shutdown_connections 2024-09-21T06:06:17.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5a0142730 0x7ff5a0155380 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff57c078b90 0x7ff57c07b0a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5a013fef0 0x7ff5a0154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 --2- 172.21.15.118:0/1288779964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5a013fae0 0x7ff5a0152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:17.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.936+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 >> 172.21.15.118:0/1288779964 conn(0x7ff5a006d110 msgr2=0x7ff5a015bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:17.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.937+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 shutdown_connections 2024-09-21T06:06:17.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:17.937+0000 7ff5a5e00640 1 -- 172.21.15.118:0/1288779964 wait complete. 2024-09-21T06:06:17.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:06:18.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 -- 172.21.15.118:0/2212224100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 msgr2=0x7fa9e415f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/2212224100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 0x7fa9e415f660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009830 tx=0x7fa9d002a510 comp rx=0 tx=0).stop 2024-09-21T06:06:18.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 -- 172.21.15.118:0/2212224100 shutdown_connections 2024-09-21T06:06:18.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/2212224100 >> v2:172.21.15.149:3300/0 conn(0x7fa9e415fba0 0x7fa9e40d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/2212224100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 0x7fa9e415f660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 -- 172.21.15.118:0/2212224100 >> 172.21.15.118:0/2212224100 conn(0x7fa9e406d1c0 msgr2=0x7fa9e406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:18.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 -- 172.21.15.118:0/2212224100 shutdown_connections 2024-09-21T06:06:18.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.179+0000 7fa9eaa00640 1 -- 172.21.15.118:0/2212224100 wait complete. 2024-09-21T06:06:18.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.181+0000 7fa9eaa00640 1 Processor -- start 2024-09-21T06:06:18.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.182+0000 7fa9eaa00640 1 -- start start 2024-09-21T06:06:18.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9eaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9e415fba0 0x7fa9e4154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9eaa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e41634f0 0x7fa9e41eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9eaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 0x7fa9e415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9eaa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e40d3920 con 0x7fa9e415fba0 2024-09-21T06:06:18.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9eaa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e40d1d80 con 0x7fa9e41634f0 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9eaa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e40d3aa0 con 0x7fa9e4163900 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9e9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9e415fba0 0x7fa9e4154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9e9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9e415fba0 0x7fa9e4154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53272/0 (socket says 172.21.15.118:53272) 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.183+0000 7fa9e9600640 1 -- 172.21.15.118:0/208346632 learned_addr learned my addr 172.21.15.118:0/208346632 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9ea000640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 0x7fa9e415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e8c00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e41634f0 0x7fa9e41eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e9600640 1 -- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 msgr2=0x7fa9e415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e9600640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 0x7fa9e415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e9600640 1 -- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e41634f0 msgr2=0x7fa9e41eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e9600640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e41634f0 0x7fa9e41eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e9600640 1 -- 172.21.15.118:0/208346632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e41f9330 con 0x7fa9e415fba0 2024-09-21T06:06:18.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9ea000640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 0x7fa9e415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:18.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e9600640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9e415fba0 0x7fa9e4154120 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800c410 tx=0x7fa9d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:18.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e1600640 1 -- 172.21.15.118:0/208346632 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011790 con 0x7fa9e415fba0 2024-09-21T06:06:18.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e1600640 1 -- 172.21.15.118:0/208346632 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9d8017070 con 0x7fa9e415fba0 2024-09-21T06:06:18.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e41f9610 con 0x7fa9e415fba0 2024-09-21T06:06:18.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9e1600640 1 -- 172.21.15.118:0/208346632 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011ca0 con 0x7fa9e415fba0 2024-09-21T06:06:18.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.184+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e41f9bd0 con 0x7fa9e415fba0 2024-09-21T06:06:18.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.185+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e40d1330 con 0x7fa9e415fba0 2024-09-21T06:06:18.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.187+0000 7fa9e1600640 1 -- 172.21.15.118:0/208346632 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9d801c460 con 0x7fa9e415fba0 2024-09-21T06:06:18.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.188+0000 7fa9e1600640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa9c4078b90 0x7fa9c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.188+0000 7fa9e1600640 1 -- 172.21.15.118:0/208346632 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fa9d809aa80 con 0x7fa9e415fba0 2024-09-21T06:06:18.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.188+0000 7fa9e8c00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa9c4078b90 0x7fa9c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.189+0000 7fa9e8c00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa9c4078b90 0x7fa9c407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0034000 tx=0x7fa9d0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:18.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.192+0000 7fa9e1600640 1 -- 172.21.15.118:0/208346632 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa9d8063010 con 0x7fa9e415fba0 2024-09-21T06:06:18.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.376+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9e4161690 con 0x7fa9e415fba0 2024-09-21T06:06:18.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.377+0000 7fa9e1600640 1 -- 172.21.15.118:0/208346632 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16810 (secure 0 0 0) 0x7fa9d8062910 con 0x7fa9e415fba0 2024-09-21T06:06:18.379 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:18.379 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":62,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:06:16.940295+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:06:14.853192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:06:15.905084+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:06:18.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa9c4078b90 msgr2=0x7fa9c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa9c4078b90 0x7fa9c407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0034000 tx=0x7fa9d0004730 comp rx=0 tx=0).stop 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9e415fba0 msgr2=0x7fa9e4154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9e415fba0 0x7fa9e4154120 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800c410 tx=0x7fa9d800c8d0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 shutdown_connections 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa9c4078b90 0x7fa9c407b0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9e4163900 0x7fa9e415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e41634f0 0x7fa9e41eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 --2- 172.21.15.118:0/208346632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9e415fba0 0x7fa9e4154120 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 >> 172.21.15.118:0/208346632 conn(0x7fa9e406d1c0 msgr2=0x7fa9e4161e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 shutdown_connections 2024-09-21T06:06:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.380+0000 7fa9eaa00640 1 -- 172.21.15.118:0/208346632 wait complete. 2024-09-21T06:06:18.404 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:06:18.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 -- 172.21.15.118:0/1564030190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8140d0ea0 msgr2=0x7ff8140d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 --2- 172.21.15.118:0/1564030190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8140d0ea0 0x7ff8140d12b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc005fd0 tx=0x7ff7fc02a540 comp rx=0 tx=0).stop 2024-09-21T06:06:18.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 -- 172.21.15.118:0/1564030190 shutdown_connections 2024-09-21T06:06:18.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 --2- 172.21.15.118:0/1564030190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8140d0ea0 0x7ff8140d12b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 --2- 172.21.15.118:0/1564030190 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff81413fd80 0x7ff81415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 -- 172.21.15.118:0/1564030190 >> 172.21.15.118:0/1564030190 conn(0x7ff81406d110 msgr2=0x7ff81406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:18.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 -- 172.21.15.118:0/1564030190 shutdown_connections 2024-09-21T06:06:18.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.632+0000 7ff819c00640 1 -- 172.21.15.118:0/1564030190 wait complete. 2024-09-21T06:06:18.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.635+0000 7ff819c00640 1 Processor -- start 2024-09-21T06:06:18.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.635+0000 7ff819c00640 1 -- start start 2024-09-21T06:06:18.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.636+0000 7ff819c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8140d0ea0 0x7ff81415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.636+0000 7ff819c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff81413fd80 0x7ff81415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.636+0000 7ff819c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff814160b20 0x7ff8141f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.636+0000 7ff819c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff81415e300 con 0x7ff814160b20 2024-09-21T06:06:18.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.636+0000 7ff819c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff81415e180 con 0x7ff8140d0ea0 2024-09-21T06:06:18.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.636+0000 7ff819c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff81415d680 con 0x7ff81413fd80 2024-09-21T06:06:18.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.636+0000 7ff813400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff814160b20 0x7ff8141f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff814160b20 0x7ff8141f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53300/0 (socket says 172.21.15.118:53300) 2024-09-21T06:06:18.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 -- 172.21.15.118:0/1894303310 learned_addr learned my addr 172.21.15.118:0/1894303310 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:18.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff812a00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8140d0ea0 0x7ff81415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff80a000640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff81413fd80 0x7ff81415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 -- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff81413fd80 msgr2=0x7ff81415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff81413fd80 0x7ff81415c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 -- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8140d0ea0 msgr2=0x7ff81415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8140d0ea0 0x7ff81415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 -- 172.21.15.118:0/1894303310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81413a400 con 0x7ff814160b20 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff813400640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff814160b20 0x7ff8141f75a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00c760 tx=0x7ff80c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.637+0000 7ff80b400640 1 -- 172.21.15.118:0/1894303310 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c017070 con 0x7ff814160b20 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.638+0000 7ff80b400640 1 -- 172.21.15.118:0/1894303310 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff80c00ce10 con 0x7ff814160b20 2024-09-21T06:06:18.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.638+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81413a6e0 con 0x7ff814160b20 2024-09-21T06:06:18.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.638+0000 7ff80b400640 1 -- 172.21.15.118:0/1894303310 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0052b0 con 0x7ff814160b20 2024-09-21T06:06:18.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.638+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81413aca0 con 0x7ff814160b20 2024-09-21T06:06:18.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.639+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8141616d0 con 0x7ff814160b20 2024-09-21T06:06:18.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.640+0000 7ff80b400640 1 -- 172.21.15.118:0/1894303310 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff80c01a070 con 0x7ff814160b20 2024-09-21T06:06:18.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.641+0000 7ff80b400640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff7f0078b90 0x7ff7f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:18.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.641+0000 7ff80b400640 1 -- 172.21.15.118:0/1894303310 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7ff80c09a300 con 0x7ff814160b20 2024-09-21T06:06:18.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.641+0000 7ff812a00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff7f0078b90 0x7ff7f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:18.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.642+0000 7ff812a00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff7f0078b90 0x7ff7f007b0a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff804009b30 tx=0x7ff804005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:18.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.645+0000 7ff80b400640 1 -- 172.21.15.118:0/1894303310 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8140d17f0 con 0x7ff814160b20 2024-09-21T06:06:18.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:06:18.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:06:18.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:18.873+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff814154080 con 0x7ff814160b20 2024-09-21T06:06:19.435 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:06:19.433+0000 7f01b8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:06:19.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.487+0000 7ff80b400640 1 -- 172.21.15.118:0/1894303310 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7ff80c062050 con 0x7ff814160b20 2024-09-21T06:06:19.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff7f0078b90 msgr2=0x7ff7f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:19.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff7f0078b90 0x7ff7f007b0a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff804009b30 tx=0x7ff804005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:19.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff814160b20 msgr2=0x7ff8141f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:19.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff814160b20 0x7ff8141f75a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00c760 tx=0x7ff80c00cc20 comp rx=0 tx=0).stop 2024-09-21T06:06:19.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 shutdown_connections 2024-09-21T06:06:19.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff814160b20 0x7ff8141f75a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff7f0078b90 0x7ff7f007b0a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff81413fd80 0x7ff81415c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 --2- 172.21.15.118:0/1894303310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8140d0ea0 0x7ff81415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.490+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 >> 172.21.15.118:0/1894303310 conn(0x7ff81406d110 msgr2=0x7ff8140b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:19.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.491+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 shutdown_connections 2024-09-21T06:06:19.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.491+0000 7ff819c00640 1 -- 172.21.15.118:0/1894303310 wait complete. 2024-09-21T06:06:19.515 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:06:19.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:06:19.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 -- 172.21.15.118:0/1635817093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fae0 msgr2=0x7f00700d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:19.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 --2- 172.21.15.118:0/1635817093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fae0 0x7f00700d0e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0060009830 tx=0x7f006002a510 comp rx=0 tx=0).stop 2024-09-21T06:06:19.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 -- 172.21.15.118:0/1635817093 shutdown_connections 2024-09-21T06:06:19.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 --2- 172.21.15.118:0/1635817093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0070142e40 0x7f00700d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 --2- 172.21.15.118:0/1635817093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fae0 0x7f00700d0e80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 -- 172.21.15.118:0/1635817093 >> 172.21.15.118:0/1635817093 conn(0x7f007006d110 msgr2=0x7f007006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:19.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 -- 172.21.15.118:0/1635817093 shutdown_connections 2024-09-21T06:06:19.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.737+0000 7f0076c00640 1 -- 172.21.15.118:0/1635817093 wait complete. 2024-09-21T06:06:19.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.739+0000 7f0076c00640 1 Processor -- start 2024-09-21T06:06:19.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.739+0000 7f0076c00640 1 -- start start 2024-09-21T06:06:19.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0076c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f007013fae0 0x7f0070132430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:19.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0076c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fef0 0x7f00701582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:19.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0076c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0070142e40 0x7f007013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0076c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f00700cfa90 con 0x7f0070142e40 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0076c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f00700cf910 con 0x7f007013fef0 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0076c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00700cfc10 con 0x7f007013fae0 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0070142e40 0x7f007013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0070142e40 0x7f007013e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53302/0 (socket says 172.21.15.118:53302) 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 -- 172.21.15.118:0/685413176 learned_addr learned my addr 172.21.15.118:0/685413176 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f006fe00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f007013fae0 0x7f0070132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0067400640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fef0 0x7f00701582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 -- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f007013fae0 msgr2=0x7f0070132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f007013fae0 0x7f0070132430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 -- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fef0 msgr2=0x7f00701582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fef0 0x7f00701582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.741+0000 7f0074c00640 1 -- 172.21.15.118:0/685413176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0070158810 con 0x7f0070142e40 2024-09-21T06:06:19.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.742+0000 7f0074c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0070142e40 0x7f007013e1b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f006800ea70 tx=0x7f006800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:19.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.742+0000 7f006cc00640 1 -- 172.21.15.118:0/685413176 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006800ce40 con 0x7f0070142e40 2024-09-21T06:06:19.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.742+0000 7f006cc00640 1 -- 172.21.15.118:0/685413176 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0068004c10 con 0x7f0070142e40 2024-09-21T06:06:19.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.742+0000 7f006cc00640 1 -- 172.21.15.118:0/685413176 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068005020 con 0x7f0070142e40 2024-09-21T06:06:19.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.742+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007013b700 con 0x7f0070142e40 2024-09-21T06:06:19.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.742+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007013f000 con 0x7f0070142e40 2024-09-21T06:06:19.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.743+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007013f200 con 0x7f0070142e40 2024-09-21T06:06:19.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.744+0000 7f006cc00640 1 -- 172.21.15.118:0/685413176 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00680051c0 con 0x7f0070142e40 2024-09-21T06:06:19.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.745+0000 7f006cc00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f004c078b90 0x7f004c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:19.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.746+0000 7f006cc00640 1 -- 172.21.15.118:0/685413176 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f006809b970 con 0x7f0070142e40 2024-09-21T06:06:19.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.746+0000 7f006fe00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f004c078b90 0x7f004c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:19.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.747+0000 7f006fe00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f004c078b90 0x7f004c07b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0060034000 tx=0x7f0060004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:19.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.750+0000 7f006cc00640 1 -- 172.21.15.118:0/685413176 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f00680637f0 con 0x7f0070142e40 2024-09-21T06:06:19.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:19.972+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f00700d0130 con 0x7f0070142e40 2024-09-21T06:06:20.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.488+0000 7f006cc00640 1 -- 172.21.15.118:0/685413176 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f0068068220 con 0x7f0070142e40 2024-09-21T06:06:20.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f004c078b90 msgr2=0x7f004c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:20.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f004c078b90 0x7f004c07b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0060034000 tx=0x7f0060004730 comp rx=0 tx=0).stop 2024-09-21T06:06:20.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0070142e40 msgr2=0x7f007013e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:20.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0070142e40 0x7f007013e1b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f006800ea70 tx=0x7f006800ef30 comp rx=0 tx=0).stop 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 shutdown_connections 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0070142e40 0x7f007013e1b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f007013fef0 0x7f00701582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f004c078b90 0x7f004c07b0a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 --2- 172.21.15.118:0/685413176 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f007013fae0 0x7f0070132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 >> 172.21.15.118:0/685413176 conn(0x7f007006d110 msgr2=0x7f007013c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 shutdown_connections 2024-09-21T06:06:20.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.491+0000 7f0076c00640 1 -- 172.21.15.118:0/685413176 wait complete. 2024-09-21T06:06:20.519 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:06:20.519 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:20.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 -- 172.21.15.118:0/2396124903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac142e40 msgr2=0x7f2cac0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:20.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2396124903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac142e40 0x7f2cac0d13c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8005fd0 tx=0x7f2ca802aa10 comp rx=0 tx=0).stop 2024-09-21T06:06:20.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 -- 172.21.15.118:0/2396124903 shutdown_connections 2024-09-21T06:06:20.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2396124903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac142e40 0x7f2cac0d13c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2396124903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cac13fae0 0x7f2cac0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 -- 172.21.15.118:0/2396124903 >> 172.21.15.118:0/2396124903 conn(0x7f2cac06d110 msgr2=0x7f2cac06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:20.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 -- 172.21.15.118:0/2396124903 shutdown_connections 2024-09-21T06:06:20.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.738+0000 7f2cb4800640 1 -- 172.21.15.118:0/2396124903 wait complete. 2024-09-21T06:06:20.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.740+0000 7f2cb4800640 1 Processor -- start 2024-09-21T06:06:20.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.740+0000 7f2cb4800640 1 -- start start 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb4800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac13fae0 0x7f2cac138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb4800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cac13fef0 0x7f2cac1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb4800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac142e40 0x7f2cac13d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb4800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0cfac0 con 0x7f2cac13fae0 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb4800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0cf940 con 0x7f2cac142e40 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb4800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac0cfc40 con 0x7f2cac13fef0 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac13fae0 0x7f2cac138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac13fae0 0x7f2cac138c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53328/0 (socket says 172.21.15.118:53328) 2024-09-21T06:06:20.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb1e00640 1 -- 172.21.15.118:0/2327961984 learned_addr learned my addr 172.21.15.118:0/2327961984 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb2800640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac142e40 0x7f2cac13d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.742+0000 7f2cb1400640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cac13fef0 0x7f2cac1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb1e00640 1 -- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cac13fef0 msgr2=0x7f2cac1413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb1e00640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cac13fef0 0x7f2cac1413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb1e00640 1 -- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac142e40 msgr2=0x7f2cac13d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb1e00640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac142e40 0x7f2cac13d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb1e00640 1 -- 172.21.15.118:0/2327961984 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac13ecf0 con 0x7f2cac13fae0 2024-09-21T06:06:20.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb1e00640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac13fae0 0x7f2cac138c90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000e7c0 tx=0x7f2ca000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:20.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2ca6000640 1 -- 172.21.15.118:0/2327961984 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000ccc0 con 0x7f2cac13fae0 2024-09-21T06:06:20.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2ca6000640 1 -- 172.21.15.118:0/2327961984 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ca0010430 con 0x7f2cac13fae0 2024-09-21T06:06:20.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac140330 con 0x7f2cac13fae0 2024-09-21T06:06:20.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2ca6000640 1 -- 172.21.15.118:0/2327961984 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0010860 con 0x7f2cac13fae0 2024-09-21T06:06:20.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.743+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac1408f0 con 0x7f2cac13fae0 2024-09-21T06:06:20.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.744+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cac15f820 con 0x7f2cac13fae0 2024-09-21T06:06:20.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.746+0000 7f2ca6000640 1 -- 172.21.15.118:0/2327961984 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ca0010a00 con 0x7f2cac13fae0 2024-09-21T06:06:20.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.747+0000 7f2ca6000640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2c90078bc0 0x7f2c9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:20.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.747+0000 7f2ca6000640 1 -- 172.21.15.118:0/2327961984 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f2ca009b7d0 con 0x7f2cac13fae0 2024-09-21T06:06:20.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.748+0000 7f2cb1400640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2c90078bc0 0x7f2c9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:20.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.748+0000 7f2cb1400640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2c90078bc0 0x7f2c9007b0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cac1f8480 tx=0x7f2c9c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:20.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.752+0000 7f2ca6000640 1 -- 172.21.15.118:0/2327961984 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2cac15f820 con 0x7f2cac13fae0 2024-09-21T06:06:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.971+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cac0d00f0 con 0x7f2cac13fae0 2024-09-21T06:06:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.971+0000 7f2ca6000640 1 -- 172.21.15.118:0/2327961984 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7f2ca0063520 con 0x7f2cac13fae0 2024-09-21T06:06:20.973 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:20.973 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T06:06:20:487542+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:06:16.940252+0000","modified":"2024-09-21T06:06:19.973048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2029341341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2029341341},{"type":"v1","addr":"172.21.15.118:6835","nonce":2029341341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T06:06:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T06:06:20.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2c90078bc0 msgr2=0x7f2c9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2c90078bc0 0x7f2c9007b0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cac1f8480 tx=0x7f2c9c009040 comp rx=0 tx=0).stop 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac13fae0 msgr2=0x7f2cac138c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac13fae0 0x7f2cac138c90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000e7c0 tx=0x7f2ca000ec80 comp rx=0 tx=0).stop 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 shutdown_connections 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cac142e40 0x7f2cac13d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2c90078bc0 0x7f2c9007b0d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2cac13fef0 0x7f2cac1413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 --2- 172.21.15.118:0/2327961984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cac13fae0 0x7f2cac138c90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 >> 172.21.15.118:0/2327961984 conn(0x7f2cac06d110 msgr2=0x7f2cac06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 shutdown_connections 2024-09-21T06:06:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:20.974+0000 7f2cb4800640 1 -- 172.21.15.118:0/2327961984 wait complete. 2024-09-21T06:06:20.998 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:06:21.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.216+0000 7fa8a9000640 1 -- 172.21.15.118:0/1277826926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa888004800 msgr2=0x7fa888004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.216+0000 7fa8a9000640 1 --2- 172.21.15.118:0/1277826926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa888004800 0x7fa888004c10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa88c001830 tx=0x7fa888005830 comp rx=0 tx=0).stop 2024-09-21T06:06:21.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.216+0000 7fa8a9000640 1 -- 172.21.15.118:0/1277826926 shutdown_connections 2024-09-21T06:06:21.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.216+0000 7fa8a9000640 1 --2- 172.21.15.118:0/1277826926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa888004800 0x7fa888004c10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.216+0000 7fa8a9000640 1 -- 172.21.15.118:0/1277826926 >> 172.21.15.118:0/1277826926 conn(0x7fa8a406d110 msgr2=0x7fa8a406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:21.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.216+0000 7fa8a9000640 1 -- 172.21.15.118:0/1277826926 shutdown_connections 2024-09-21T06:06:21.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.216+0000 7fa8a9000640 1 -- 172.21.15.118:0/1277826926 wait complete. 2024-09-21T06:06:21.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.218+0000 7fa8a9000640 1 Processor -- start 2024-09-21T06:06:21.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.219+0000 7fa8a9000640 1 -- start start 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa888004800 0x7fa8a40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a9000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a41533e0 0x7fa8a4143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a4143b50 0x7fa8a41375e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a9000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40d1000 con 0x7fa8a41533e0 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40d0e80 con 0x7fa8a4143b50 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a40d1180 con 0x7fa888004800 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa899400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a41533e0 0x7fa8a4143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa899400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a41533e0 0x7fa8a4143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53338/0 (socket says 172.21.15.118:53338) 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa899400640 1 -- 172.21.15.118:0/3856105496 learned_addr learned my addr 172.21.15.118:0/3856105496 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a1e00640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa888004800 0x7fa8a40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.220+0000 7fa8a2800640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a4143b50 0x7fa8a41375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa899400640 1 -- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa888004800 msgr2=0x7fa8a40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa899400640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa888004800 0x7fa8a40cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa899400640 1 -- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a4143b50 msgr2=0x7fa8a41375e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa899400640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a4143b50 0x7fa8a41375e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa899400640 1 -- 172.21.15.118:0/3856105496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a4143f60 con 0x7fa8a41533e0 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa899400640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a41533e0 0x7fa8a4143610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa88c001950 tx=0x7fa88c0060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa89aa00640 1 -- 172.21.15.118:0/3856105496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c043070 con 0x7fa8a41533e0 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa89aa00640 1 -- 172.21.15.118:0/3856105496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa88c0038e0 con 0x7fa8a41533e0 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a415fa60 con 0x7fa8a41533e0 2024-09-21T06:06:21.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.221+0000 7fa89aa00640 1 -- 172.21.15.118:0/3856105496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c003d30 con 0x7fa8a41533e0 2024-09-21T06:06:21.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.222+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a4136de0 con 0x7fa8a41533e0 2024-09-21T06:06:21.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.222+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a415f7d0 con 0x7fa8a41533e0 2024-09-21T06:06:21.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.224+0000 7fa89aa00640 1 -- 172.21.15.118:0/3856105496 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa88c046070 con 0x7fa8a41533e0 2024-09-21T06:06:21.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.225+0000 7fa89aa00640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.225+0000 7fa89aa00640 1 -- 172.21.15.118:0/3856105496 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7fa88c0bab40 con 0x7fa8a41533e0 2024-09-21T06:06:21.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.225+0000 7fa8a1e00640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.226+0000 7fa8a1e00640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8a406bd50 tx=0x7fa894005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:21.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.229+0000 7fa89aa00640 1 -- 172.21.15.118:0/3856105496 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa8a4143f60 con 0x7fa8a41533e0 2024-09-21T06:06:21.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.418+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8a415ff80 con 0x7fa8a41533e0 2024-09-21T06:06:21.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.419+0000 7fa89aa00640 1 -- 172.21.15.118:0/3856105496 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16797 (secure 0 0 0) 0x7fa8a415ff80 con 0x7fa8a41533e0 2024-09-21T06:06:21.421 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:21.421 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":63,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:06:18.467599+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:06:14.853192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:06:15.905084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 msgr2=0x7fa88007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8a406bd50 tx=0x7fa894005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a41533e0 msgr2=0x7fa8a4143610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a41533e0 0x7fa8a4143610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa88c001950 tx=0x7fa88c0060e0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 shutdown_connections 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a4143b50 0x7fa8a41375e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a41533e0 0x7fa8a4143610 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 --2- 172.21.15.118:0/3856105496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa888004800 0x7fa8a40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 >> 172.21.15.118:0/3856105496 conn(0x7fa8a406d110 msgr2=0x7fa8a40cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 shutdown_connections 2024-09-21T06:06:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.422+0000 7fa8a9000640 1 -- 172.21.15.118:0/3856105496 wait complete. 2024-09-21T06:06:21.445 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:06:21.445 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:06:21.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 -- 172.21.15.118:0/547458734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fef0 msgr2=0x7feb4c142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 --2- 172.21.15.118:0/547458734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fef0 0x7feb4c142c70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0ceaa0 tx=0x7feb4402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 -- 172.21.15.118:0/547458734 shutdown_connections 2024-09-21T06:06:21.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 --2- 172.21.15.118:0/547458734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fef0 0x7feb4c142c70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 --2- 172.21.15.118:0/547458734 >> v2:172.21.15.149:3300/0 conn(0x7feb4c0d1590 0x7feb4c142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 -- 172.21.15.118:0/547458734 >> 172.21.15.118:0/547458734 conn(0x7feb4c06d110 msgr2=0x7feb4c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:21.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 -- 172.21.15.118:0/547458734 shutdown_connections 2024-09-21T06:06:21.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.662+0000 7feb52800640 1 -- 172.21.15.118:0/547458734 wait complete. 2024-09-21T06:06:21.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.664+0000 7feb52800640 1 Processor -- start 2024-09-21T06:06:21.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.664+0000 7feb52800640 1 -- start start 2024-09-21T06:06:21.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb52800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fae0 0x7feb4c1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb52800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb4c13fef0 0x7feb4c138980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb52800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c139290 0x7feb4c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb52800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0cfa90 con 0x7feb4c13fae0 2024-09-21T06:06:21.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb52800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0cf910 con 0x7feb4c139290 2024-09-21T06:06:21.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb52800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feb4c0cfc10 con 0x7feb4c13fef0 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb4b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fae0 0x7feb4c1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb4b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fae0 0x7feb4c1409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53356/0 (socket says 172.21.15.118:53356) 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb4b400640 1 -- 172.21.15.118:0/3251463076 learned_addr learned my addr 172.21.15.118:0/3251463076 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb4be00640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c139290 0x7feb4c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.666+0000 7feb42a00640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb4c13fef0 0x7feb4c138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb4b400640 1 -- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb4c13fef0 msgr2=0x7feb4c138980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb4b400640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb4c13fef0 0x7feb4c138980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb4b400640 1 -- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c139290 msgr2=0x7feb4c0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb4b400640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c139290 0x7feb4c0b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb4b400640 1 -- 172.21.15.118:0/3251463076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c140f10 con 0x7feb4c13fae0 2024-09-21T06:06:21.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb4b400640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fae0 0x7feb4c1409d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00ba80 tx=0x7feb3c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:21.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb43e00640 1 -- 172.21.15.118:0/3251463076 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c019070 con 0x7feb4c13fae0 2024-09-21T06:06:21.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb43e00640 1 -- 172.21.15.118:0/3251463076 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb3c00cd80 con 0x7feb4c13fae0 2024-09-21T06:06:21.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.667+0000 7feb43e00640 1 -- 172.21.15.118:0/3251463076 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0146a0 con 0x7feb4c13fae0 2024-09-21T06:06:21.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.668+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c1518b0 con 0x7feb4c13fae0 2024-09-21T06:06:21.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.668+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c1f74b0 con 0x7feb4c13fae0 2024-09-21T06:06:21.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.669+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c1410e0 con 0x7feb4c13fae0 2024-09-21T06:06:21.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.670+0000 7feb43e00640 1 -- 172.21.15.118:0/3251463076 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb3c01d3f0 con 0x7feb4c13fae0 2024-09-21T06:06:21.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.671+0000 7feb43e00640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feb28078bc0 0x7feb2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:21.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.671+0000 7feb43e00640 1 -- 172.21.15.118:0/3251463076 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7feb3c09a890 con 0x7feb4c13fae0 2024-09-21T06:06:21.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.671+0000 7feb42a00640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feb28078bc0 0x7feb2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:21.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.672+0000 7feb42a00640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feb28078bc0 0x7feb2807b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb4c153220 tx=0x7feb34009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:21.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.675+0000 7feb43e00640 1 -- 172.21.15.118:0/3251463076 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feb3c062710 con 0x7feb4c13fae0 2024-09-21T06:06:21.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.856+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb4c0d01b0 con 0x7feb28078bc0 2024-09-21T06:06:21.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.861+0000 7feb43e00640 1 -- 172.21.15.118:0/3251463076 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247480 (secure 0 0 0) 0x7feb4c0d01b0 con 0x7feb28078bc0 2024-09-21T06:06:21.865 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:21.866 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feb28078bc0 msgr2=0x7feb2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feb28078bc0 0x7feb2807b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb4c153220 tx=0x7feb34009060 comp rx=0 tx=0).stop 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fae0 msgr2=0x7feb4c1409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fae0 0x7feb4c1409d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00ba80 tx=0x7feb3c00bf40 comp rx=0 tx=0).stop 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 shutdown_connections 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c139290 0x7feb4c0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7feb28078bc0 0x7feb2807b0d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb4c13fef0 0x7feb4c138980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 --2- 172.21.15.118:0/3251463076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb4c13fae0 0x7feb4c1409d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 >> 172.21.15.118:0/3251463076 conn(0x7feb4c06d110 msgr2=0x7feb4c15c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 shutdown_connections 2024-09-21T06:06:21.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:21.865+0000 7feb52800640 1 -- 172.21.15.118:0/3251463076 wait complete. 2024-09-21T06:06:21.887 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-21T06:06:20.492142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558853,"statfs":{"total":1600000000,"available":1596266392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.055035"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698751+0000","last_change":"2024-09-21T06:06:17.467704+0000","last_active":"2024-09-21T06:06:18.698751+0000","last_peered":"2024-09-21T06:06:18.698751+0000","last_clean":"2024-09-21T06:06:18.698751+0000","last_became_active":"2024-09-21T06:06:17.467372+0000","last_became_peered":"2024-09-21T06:06:17.467372+0000","last_unstale":"2024-09-21T06:06:18.698751+0000","last_undegraded":"2024-09-21T06:06:18.698751+0000","last_fullsized":"2024-09-21T06:06:18.698751+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:31.279241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.470908+0000","last_change":"2024-09-21T06:06:17.477329+0000","last_active":"2024-09-21T06:06:18.470908+0000","last_peered":"2024-09-21T06:06:18.470908+0000","last_clean":"2024-09-21T06:06:18.470908+0000","last_became_active":"2024-09-21T06:06:17.474568+0000","last_became_peered":"2024-09-21T06:06:17.474568+0000","last_unstale":"2024-09-21T06:06:18.470908+0000","last_undegraded":"2024-09-21T06:06:18.470908+0000","last_fullsized":"2024-09-21T06:06:18.470908+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:45.136645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473166+0000","last_change":"2024-09-21T06:06:17.467556+0000","last_active":"2024-09-21T06:06:18.473166+0000","last_peered":"2024-09-21T06:06:18.473166+0000","last_clean":"2024-09-21T06:06:18.473166+0000","last_became_active":"2024-09-21T06:06:17.467264+0000","last_became_peered":"2024-09-21T06:06:17.467264+0000","last_unstale":"2024-09-21T06:06:18.473166+0000","last_undegraded":"2024-09-21T06:06:18.473166+0000","last_fullsized":"2024-09-21T06:06:18.473166+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:13.647152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471901+0000","last_change":"2024-09-21T06:06:17.473805+0000","last_active":"2024-09-21T06:06:18.471901+0000","last_peered":"2024-09-21T06:06:18.471901+0000","last_clean":"2024-09-21T06:06:18.471901+0000","last_became_active":"2024-09-21T06:06:17.472506+0000","last_became_peered":"2024-09-21T06:06:17.472506+0000","last_unstale":"2024-09-21T06:06:18.471901+0000","last_undegraded":"2024-09-21T06:06:18.471901+0000","last_fullsized":"2024-09-21T06:06:18.471901+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:26.476400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698758+0000","last_change":"2024-09-21T06:06:17.471767+0000","last_active":"2024-09-21T06:06:18.698758+0000","last_peered":"2024-09-21T06:06:18.698758+0000","last_clean":"2024-09-21T06:06:18.698758+0000","last_became_active":"2024-09-21T06:06:17.471517+0000","last_became_peered":"2024-09-21T06:06:17.471517+0000","last_unstale":"2024-09-21T06:06:18.698758+0000","last_undegraded":"2024-09-21T06:06:18.698758+0000","last_fullsized":"2024-09-21T06:06:18.698758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:31.958153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486343+0000","last_change":"2024-09-21T06:06:17.486646+0000","last_active":"2024-09-21T06:06:18.486343+0000","last_peered":"2024-09-21T06:06:18.486343+0000","last_clean":"2024-09-21T06:06:18.486343+0000","last_became_active":"2024-09-21T06:06:17.485155+0000","last_became_peered":"2024-09-21T06:06:17.485155+0000","last_unstale":"2024-09-21T06:06:18.486343+0000","last_undegraded":"2024-09-21T06:06:18.486343+0000","last_fullsized":"2024-09-21T06:06:18.486343+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:48.001516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498472+0000","last_change":"2024-09-21T06:06:17.469571+0000","last_active":"2024-09-21T06:06:18.498472+0000","last_peered":"2024-09-21T06:06:18.498472+0000","last_clean":"2024-09-21T06:06:18.498472+0000","last_became_active":"2024-09-21T06:06:17.469257+0000","last_became_peered":"2024-09-21T06:06:17.469257+0000","last_unstale":"2024-09-21T06:06:18.498472+0000","last_undegraded":"2024-09-21T06:06:18.498472+0000","last_fullsized":"2024-09-21T06:06:18.498472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:26.241640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.470915+0000","last_change":"2024-09-21T06:06:17.470540+0000","last_active":"2024-09-21T06:06:18.470915+0000","last_peered":"2024-09-21T06:06:18.470915+0000","last_clean":"2024-09-21T06:06:18.470915+0000","last_became_active":"2024-09-21T06:06:17.470256+0000","last_became_peered":"2024-09-21T06:06:17.470256+0000","last_unstale":"2024-09-21T06:06:18.470915+0000","last_undegraded":"2024-09-21T06:06:18.470915+0000","last_fullsized":"2024-09-21T06:06:18.470915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:49.358131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498530+0000","last_change":"2024-09-21T06:06:17.476054+0000","last_active":"2024-09-21T06:06:18.498530+0000","last_peered":"2024-09-21T06:06:18.498530+0000","last_clean":"2024-09-21T06:06:18.498530+0000","last_became_active":"2024-09-21T06:06:17.471758+0000","last_became_peered":"2024-09-21T06:06:17.471758+0000","last_unstale":"2024-09-21T06:06:18.498530+0000","last_undegraded":"2024-09-21T06:06:18.498530+0000","last_fullsized":"2024-09-21T06:06:18.498530+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:38.917068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499019+0000","last_change":"2024-09-21T06:06:17.477124+0000","last_active":"2024-09-21T06:06:18.499019+0000","last_peered":"2024-09-21T06:06:18.499019+0000","last_clean":"2024-09-21T06:06:18.499019+0000","last_became_active":"2024-09-21T06:06:17.475642+0000","last_became_peered":"2024-09-21T06:06:17.475642+0000","last_unstale":"2024-09-21T06:06:18.499019+0000","last_undegraded":"2024-09-21T06:06:18.499019+0000","last_fullsized":"2024-09-21T06:06:18.499019+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:06.693112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499190+0000","last_change":"2024-09-21T06:06:17.477093+0000","last_active":"2024-09-21T06:06:18.499190+0000","last_peered":"2024-09-21T06:06:18.499190+0000","last_clean":"2024-09-21T06:06:18.499190+0000","last_became_active":"2024-09-21T06:06:17.476671+0000","last_became_peered":"2024-09-21T06:06:17.476671+0000","last_unstale":"2024-09-21T06:06:18.499190+0000","last_undegraded":"2024-09-21T06:06:18.499190+0000","last_fullsized":"2024-09-21T06:06:18.499190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:20.440039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472415+0000","last_change":"2024-09-21T06:06:17.471299+0000","last_active":"2024-09-21T06:06:18.472415+0000","last_peered":"2024-09-21T06:06:18.472415+0000","last_clean":"2024-09-21T06:06:18.472415+0000","last_became_active":"2024-09-21T06:06:17.471013+0000","last_became_peered":"2024-09-21T06:06:17.471013+0000","last_unstale":"2024-09-21T06:06:18.472415+0000","last_undegraded":"2024-09-21T06:06:18.472415+0000","last_fullsized":"2024-09-21T06:06:18.472415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:08.927181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488476+0000","last_change":"2024-09-21T06:06:17.482914+0000","last_active":"2024-09-21T06:06:18.488476+0000","last_peered":"2024-09-21T06:06:18.488476+0000","last_clean":"2024-09-21T06:06:18.488476+0000","last_became_active":"2024-09-21T06:06:17.482546+0000","last_became_peered":"2024-09-21T06:06:17.482546+0000","last_unstale":"2024-09-21T06:06:18.488476+0000","last_undegraded":"2024-09-21T06:06:18.488476+0000","last_fullsized":"2024-09-21T06:06:18.488476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:19.755141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498779+0000","last_change":"2024-09-21T06:06:17.467398+0000","last_active":"2024-09-21T06:06:18.498779+0000","last_peered":"2024-09-21T06:06:18.498779+0000","last_clean":"2024-09-21T06:06:18.498779+0000","last_became_active":"2024-09-21T06:06:17.467108+0000","last_became_peered":"2024-09-21T06:06:17.467108+0000","last_unstale":"2024-09-21T06:06:18.498779+0000","last_undegraded":"2024-09-21T06:06:18.498779+0000","last_fullsized":"2024-09-21T06:06:18.498779+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.366044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498885+0000","last_change":"2024-09-21T06:06:17.476680+0000","last_active":"2024-09-21T06:06:18.498885+0000","last_peered":"2024-09-21T06:06:18.498885+0000","last_clean":"2024-09-21T06:06:18.498885+0000","last_became_active":"2024-09-21T06:06:17.476419+0000","last_became_peered":"2024-09-21T06:06:17.476419+0000","last_unstale":"2024-09-21T06:06:18.498885+0000","last_undegraded":"2024-09-21T06:06:18.498885+0000","last_fullsized":"2024-09-21T06:06:18.498885+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:15.561180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486755+0000","last_change":"2024-09-21T06:06:17.480799+0000","last_active":"2024-09-21T06:06:18.486755+0000","last_peered":"2024-09-21T06:06:18.486755+0000","last_clean":"2024-09-21T06:06:18.486755+0000","last_became_active":"2024-09-21T06:06:17.480459+0000","last_became_peered":"2024-09-21T06:06:17.480459+0000","last_unstale":"2024-09-21T06:06:18.486755+0000","last_undegraded":"2024-09-21T06:06:18.486755+0000","last_fullsized":"2024-09-21T06:06:18.486755+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:08.442516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471189+0000","last_change":"2024-09-21T06:06:17.478318+0000","last_active":"2024-09-21T06:06:18.471189+0000","last_peered":"2024-09-21T06:06:18.471189+0000","last_clean":"2024-09-21T06:06:18.471189+0000","last_became_active":"2024-09-21T06:06:17.477724+0000","last_became_peered":"2024-09-21T06:06:17.477724+0000","last_unstale":"2024-09-21T06:06:18.471189+0000","last_undegraded":"2024-09-21T06:06:18.471189+0000","last_fullsized":"2024-09-21T06:06:18.471189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:05.009795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473328+0000","last_change":"2024-09-21T06:06:17.474236+0000","last_active":"2024-09-21T06:06:18.473328+0000","last_peered":"2024-09-21T06:06:18.473328+0000","last_clean":"2024-09-21T06:06:18.473328+0000","last_became_active":"2024-09-21T06:06:17.473953+0000","last_became_peered":"2024-09-21T06:06:17.473953+0000","last_unstale":"2024-09-21T06:06:18.473328+0000","last_undegraded":"2024-09-21T06:06:18.473328+0000","last_fullsized":"2024-09-21T06:06:18.473328+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:19.927800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698745+0000","last_change":"2024-09-21T06:06:17.466614+0000","last_active":"2024-09-21T06:06:18.698745+0000","last_peered":"2024-09-21T06:06:18.698745+0000","last_clean":"2024-09-21T06:06:18.698745+0000","last_became_active":"2024-09-21T06:06:17.466332+0000","last_became_peered":"2024-09-21T06:06:17.466332+0000","last_unstale":"2024-09-21T06:06:18.698745+0000","last_undegraded":"2024-09-21T06:06:18.698745+0000","last_fullsized":"2024-09-21T06:06:18.698745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:45.226342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471032+0000","last_change":"2024-09-21T06:06:17.487208+0000","last_active":"2024-09-21T06:06:18.471032+0000","last_peered":"2024-09-21T06:06:18.471032+0000","last_clean":"2024-09-21T06:06:18.471032+0000","last_became_active":"2024-09-21T06:06:17.486932+0000","last_became_peered":"2024-09-21T06:06:17.486932+0000","last_unstale":"2024-09-21T06:06:18.471032+0000","last_undegraded":"2024-09-21T06:06:18.471032+0000","last_fullsized":"2024-09-21T06:06:18.471032+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:13.446457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472256+0000","last_change":"2024-09-21T06:06:17.473831+0000","last_active":"2024-09-21T06:06:18.472256+0000","last_peered":"2024-09-21T06:06:18.472256+0000","last_clean":"2024-09-21T06:06:18.472256+0000","last_became_active":"2024-09-21T06:06:17.473547+0000","last_became_peered":"2024-09-21T06:06:17.473547+0000","last_unstale":"2024-09-21T06:06:18.472256+0000","last_undegraded":"2024-09-21T06:06:18.472256+0000","last_fullsized":"2024-09-21T06:06:18.472256+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:22.506588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471413+0000","last_change":"2024-09-21T06:06:17.466403+0000","last_active":"2024-09-21T06:06:18.471413+0000","last_peered":"2024-09-21T06:06:18.471413+0000","last_clean":"2024-09-21T06:06:18.471413+0000","last_became_active":"2024-09-21T06:06:17.466064+0000","last_became_peered":"2024-09-21T06:06:17.466064+0000","last_unstale":"2024-09-21T06:06:18.471413+0000","last_undegraded":"2024-09-21T06:06:18.471413+0000","last_fullsized":"2024-09-21T06:06:18.471413+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:20.274131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473564+0000","last_change":"2024-09-21T06:06:17.466792+0000","last_active":"2024-09-21T06:06:18.473564+0000","last_peered":"2024-09-21T06:06:18.473564+0000","last_clean":"2024-09-21T06:06:18.473564+0000","last_became_active":"2024-09-21T06:06:17.466529+0000","last_became_peered":"2024-09-21T06:06:17.466529+0000","last_unstale":"2024-09-21T06:06:18.473564+0000","last_undegraded":"2024-09-21T06:06:18.473564+0000","last_fullsized":"2024-09-21T06:06:18.473564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:26.182801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488267+0000","last_change":"2024-09-21T06:06:17.478470+0000","last_active":"2024-09-21T06:06:18.488267+0000","last_peered":"2024-09-21T06:06:18.488267+0000","last_clean":"2024-09-21T06:06:18.488267+0000","last_became_active":"2024-09-21T06:06:17.477860+0000","last_became_peered":"2024-09-21T06:06:17.477860+0000","last_unstale":"2024-09-21T06:06:18.488267+0000","last_undegraded":"2024-09-21T06:06:18.488267+0000","last_fullsized":"2024-09-21T06:06:18.488267+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:03.023545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698978+0000","last_change":"2024-09-21T06:06:17.478875+0000","last_active":"2024-09-21T06:06:18.698978+0000","last_peered":"2024-09-21T06:06:18.698978+0000","last_clean":"2024-09-21T06:06:18.698978+0000","last_became_active":"2024-09-21T06:06:17.478622+0000","last_became_peered":"2024-09-21T06:06:17.478622+0000","last_unstale":"2024-09-21T06:06:18.698978+0000","last_undegraded":"2024-09-21T06:06:18.698978+0000","last_fullsized":"2024-09-21T06:06:18.698978+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:12.061171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472719+0000","last_change":"2024-09-21T06:06:17.474400+0000","last_active":"2024-09-21T06:06:18.472719+0000","last_peered":"2024-09-21T06:06:18.472719+0000","last_clean":"2024-09-21T06:06:18.472719+0000","last_became_active":"2024-09-21T06:06:17.473609+0000","last_became_peered":"2024-09-21T06:06:17.473609+0000","last_unstale":"2024-09-21T06:06:18.472719+0000","last_undegraded":"2024-09-21T06:06:18.472719+0000","last_fullsized":"2024-09-21T06:06:18.472719+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:12.278202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486281+0000","last_change":"2024-09-21T06:06:17.478551+0000","last_active":"2024-09-21T06:06:18.486281+0000","last_peered":"2024-09-21T06:06:18.486281+0000","last_clean":"2024-09-21T06:06:18.486281+0000","last_became_active":"2024-09-21T06:06:17.477502+0000","last_became_peered":"2024-09-21T06:06:17.477502+0000","last_unstale":"2024-09-21T06:06:18.486281+0000","last_undegraded":"2024-09-21T06:06:18.486281+0000","last_fullsized":"2024-09-21T06:06:18.486281+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:11.350714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698710+0000","last_change":"2024-09-21T06:06:17.470590+0000","last_active":"2024-09-21T06:06:18.698710+0000","last_peered":"2024-09-21T06:06:18.698710+0000","last_clean":"2024-09-21T06:06:18.698710+0000","last_became_active":"2024-09-21T06:06:17.470320+0000","last_became_peered":"2024-09-21T06:06:17.470320+0000","last_unstale":"2024-09-21T06:06:18.698710+0000","last_undegraded":"2024-09-21T06:06:18.698710+0000","last_fullsized":"2024-09-21T06:06:18.698710+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:43.229984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.470907+0000","last_change":"2024-09-21T06:06:17.471580+0000","last_active":"2024-09-21T06:06:18.470907+0000","last_peered":"2024-09-21T06:06:18.470907+0000","last_clean":"2024-09-21T06:06:18.470907+0000","last_became_active":"2024-09-21T06:06:17.471295+0000","last_became_peered":"2024-09-21T06:06:17.471295+0000","last_unstale":"2024-09-21T06:06:18.470907+0000","last_undegraded":"2024-09-21T06:06:18.470907+0000","last_fullsized":"2024-09-21T06:06:18.470907+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:25.109665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472595+0000","last_change":"2024-09-21T06:06:17.464483+0000","last_active":"2024-09-21T06:06:18.472595+0000","last_peered":"2024-09-21T06:06:18.472595+0000","last_clean":"2024-09-21T06:06:18.472595+0000","last_became_active":"2024-09-21T06:06:17.464215+0000","last_became_peered":"2024-09-21T06:06:17.464215+0000","last_unstale":"2024-09-21T06:06:18.472595+0000","last_undegraded":"2024-09-21T06:06:18.472595+0000","last_fullsized":"2024-09-21T06:06:18.472595+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:50.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698981+0000","last_change":"2024-09-21T06:06:17.476318+0000","last_active":"2024-09-21T06:06:18.698981+0000","last_peered":"2024-09-21T06:06:18.698981+0000","last_clean":"2024-09-21T06:06:18.698981+0000","last_became_active":"2024-09-21T06:06:17.476016+0000","last_became_peered":"2024-09-21T06:06:17.476016+0000","last_unstale":"2024-09-21T06:06:18.698981+0000","last_undegraded":"2024-09-21T06:06:18.698981+0000","last_fullsized":"2024-09-21T06:06:18.698981+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:04.996679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486524+0000","last_change":"2024-09-21T06:06:17.485301+0000","last_active":"2024-09-21T06:06:18.486524+0000","last_peered":"2024-09-21T06:06:18.486524+0000","last_clean":"2024-09-21T06:06:18.486524+0000","last_became_active":"2024-09-21T06:06:17.485048+0000","last_became_peered":"2024-09-21T06:06:17.485048+0000","last_unstale":"2024-09-21T06:06:18.486524+0000","last_undegraded":"2024-09-21T06:06:18.486524+0000","last_fullsized":"2024-09-21T06:06:18.486524+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:29.437373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486297+0000","last_change":"2024-09-21T06:06:17.483797+0000","last_active":"2024-09-21T06:06:18.486297+0000","last_peered":"2024-09-21T06:06:18.486297+0000","last_clean":"2024-09-21T06:06:18.486297+0000","last_became_active":"2024-09-21T06:06:17.483162+0000","last_became_peered":"2024-09-21T06:06:17.483162+0000","last_unstale":"2024-09-21T06:06:18.486297+0000","last_undegraded":"2024-09-21T06:06:18.486297+0000","last_fullsized":"2024-09-21T06:06:18.486297+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:51.299725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"62'4","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486575+0000","last_change":"2024-09-21T06:06:16.457136+0000","last_active":"2024-09-21T06:06:18.486575+0000","last_peered":"2024-09-21T06:06:18.486575+0000","last_clean":"2024-09-21T06:06:18.486575+0000","last_became_active":"2024-09-21T06:06:16.456118+0000","last_became_peered":"2024-09-21T06:06:16.456118+0000","last_unstale":"2024-09-21T06:06:18.486575+0000","last_undegraded":"2024-09-21T06:06:18.486575+0000","last_fullsized":"2024-09-21T06:06:18.486575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.264614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499083+0000","last_change":"2024-09-21T06:06:17.473176+0000","last_active":"2024-09-21T06:06:18.499083+0000","last_peered":"2024-09-21T06:06:18.499083+0000","last_clean":"2024-09-21T06:06:18.499083+0000","last_became_active":"2024-09-21T06:06:17.472883+0000","last_became_peered":"2024-09-21T06:06:17.472883+0000","last_unstale":"2024-09-21T06:06:18.499083+0000","last_undegraded":"2024-09-21T06:06:18.499083+0000","last_fullsized":"2024-09-21T06:06:18.499083+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471330+0000","last_change":"2024-09-21T06:06:16.452915+0000","last_active":"2024-09-21T06:06:18.471330+0000","last_peered":"2024-09-21T06:06:18.471330+0000","last_clean":"2024-09-21T06:06:18.471330+0000","last_became_active":"2024-09-21T06:06:16.451077+0000","last_became_peered":"2024-09-21T06:06:16.451077+0000","last_unstale":"2024-09-21T06:06:18.471330+0000","last_undegraded":"2024-09-21T06:06:18.471330+0000","last_fullsized":"2024-09-21T06:06:18.471330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:28.829851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486614+0000","last_change":"2024-09-21T06:06:17.486185+0000","last_active":"2024-09-21T06:06:18.486614+0000","last_peered":"2024-09-21T06:06:18.486614+0000","last_clean":"2024-09-21T06:06:18.486614+0000","last_became_active":"2024-09-21T06:06:17.484432+0000","last_became_peered":"2024-09-21T06:06:17.484432+0000","last_unstale":"2024-09-21T06:06:18.486614+0000","last_undegraded":"2024-09-21T06:06:18.486614+0000","last_fullsized":"2024-09-21T06:06:18.486614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.744514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486744+0000","last_change":"2024-09-21T06:06:16.454084+0000","last_active":"2024-09-21T06:06:18.486744+0000","last_peered":"2024-09-21T06:06:18.486744+0000","last_clean":"2024-09-21T06:06:18.486744+0000","last_became_active":"2024-09-21T06:06:16.453901+0000","last_became_peered":"2024-09-21T06:06:16.453901+0000","last_unstale":"2024-09-21T06:06:18.486744+0000","last_undegraded":"2024-09-21T06:06:18.486744+0000","last_fullsized":"2024-09-21T06:06:18.486744+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:01.830388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486392+0000","last_change":"2024-09-21T06:06:17.486539+0000","last_active":"2024-09-21T06:06:18.486392+0000","last_peered":"2024-09-21T06:06:18.486392+0000","last_clean":"2024-09-21T06:06:18.486392+0000","last_became_active":"2024-09-21T06:06:17.485809+0000","last_became_peered":"2024-09-21T06:06:17.485809+0000","last_unstale":"2024-09-21T06:06:18.486392+0000","last_undegraded":"2024-09-21T06:06:18.486392+0000","last_fullsized":"2024-09-21T06:06:18.486392+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:57.469111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473064+0000","last_change":"2024-09-21T06:06:16.456266+0000","last_active":"2024-09-21T06:06:18.473064+0000","last_peered":"2024-09-21T06:06:18.473064+0000","last_clean":"2024-09-21T06:06:18.473064+0000","last_became_active":"2024-09-21T06:06:16.455158+0000","last_became_peered":"2024-09-21T06:06:16.455158+0000","last_unstale":"2024-09-21T06:06:18.473064+0000","last_undegraded":"2024-09-21T06:06:18.473064+0000","last_fullsized":"2024-09-21T06:06:18.473064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:31.000868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471242+0000","last_change":"2024-09-21T06:06:17.466500+0000","last_active":"2024-09-21T06:06:18.471242+0000","last_peered":"2024-09-21T06:06:18.471242+0000","last_clean":"2024-09-21T06:06:18.471242+0000","last_became_active":"2024-09-21T06:06:17.466199+0000","last_became_peered":"2024-09-21T06:06:17.466199+0000","last_unstale":"2024-09-21T06:06:18.471242+0000","last_undegraded":"2024-09-21T06:06:18.471242+0000","last_fullsized":"2024-09-21T06:06:18.471242+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:06.115431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498777+0000","last_change":"2024-09-21T06:06:16.451684+0000","last_active":"2024-09-21T06:06:18.498777+0000","last_peered":"2024-09-21T06:06:18.498777+0000","last_clean":"2024-09-21T06:06:18.498777+0000","last_became_active":"2024-09-21T06:06:16.451366+0000","last_became_peered":"2024-09-21T06:06:16.451366+0000","last_unstale":"2024-09-21T06:06:18.498777+0000","last_undegraded":"2024-09-21T06:06:18.498777+0000","last_fullsized":"2024-09-21T06:06:18.498777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:08.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471616+0000","last_change":"2024-09-21T06:06:17.478103+0000","last_active":"2024-09-21T06:06:18.471616+0000","last_peered":"2024-09-21T06:06:18.471616+0000","last_clean":"2024-09-21T06:06:18.471616+0000","last_became_active":"2024-09-21T06:06:17.476835+0000","last_became_peered":"2024-09-21T06:06:17.476835+0000","last_unstale":"2024-09-21T06:06:18.471616+0000","last_undegraded":"2024-09-21T06:06:18.471616+0000","last_fullsized":"2024-09-21T06:06:18.471616+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.068905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486706+0000","last_change":"2024-09-21T06:06:16.458404+0000","last_active":"2024-09-21T06:06:18.486706+0000","last_peered":"2024-09-21T06:06:18.486706+0000","last_clean":"2024-09-21T06:06:18.486706+0000","last_became_active":"2024-09-21T06:06:16.457934+0000","last_became_peered":"2024-09-21T06:06:16.457934+0000","last_unstale":"2024-09-21T06:06:18.486706+0000","last_undegraded":"2024-09-21T06:06:18.486706+0000","last_fullsized":"2024-09-21T06:06:18.486706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:55.223405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488312+0000","last_change":"2024-09-21T06:06:17.478072+0000","last_active":"2024-09-21T06:06:18.488312+0000","last_peered":"2024-09-21T06:06:18.488312+0000","last_clean":"2024-09-21T06:06:18.488312+0000","last_became_active":"2024-09-21T06:06:17.477803+0000","last_became_peered":"2024-09-21T06:06:17.477803+0000","last_unstale":"2024-09-21T06:06:18.488312+0000","last_undegraded":"2024-09-21T06:06:18.488312+0000","last_fullsized":"2024-09-21T06:06:18.488312+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:45.778291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472685+0000","last_change":"2024-09-21T06:06:16.451630+0000","last_active":"2024-09-21T06:06:18.472685+0000","last_peered":"2024-09-21T06:06:18.472685+0000","last_clean":"2024-09-21T06:06:18.472685+0000","last_became_active":"2024-09-21T06:06:16.451348+0000","last_became_peered":"2024-09-21T06:06:16.451348+0000","last_unstale":"2024-09-21T06:06:18.472685+0000","last_undegraded":"2024-09-21T06:06:18.472685+0000","last_fullsized":"2024-09-21T06:06:18.472685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:53.877783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471223+0000","last_change":"2024-09-21T06:06:17.476574+0000","last_active":"2024-09-21T06:06:18.471223+0000","last_peered":"2024-09-21T06:06:18.471223+0000","last_clean":"2024-09-21T06:06:18.471223+0000","last_became_active":"2024-09-21T06:06:17.476318+0000","last_became_peered":"2024-09-21T06:06:17.476318+0000","last_unstale":"2024-09-21T06:06:18.471223+0000","last_undegraded":"2024-09-21T06:06:18.471223+0000","last_fullsized":"2024-09-21T06:06:18.471223+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:19.536064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498988+0000","last_change":"2024-09-21T06:06:16.454438+0000","last_active":"2024-09-21T06:06:18.498988+0000","last_peered":"2024-09-21T06:06:18.498988+0000","last_clean":"2024-09-21T06:06:18.498988+0000","last_became_active":"2024-09-21T06:06:16.454172+0000","last_became_peered":"2024-09-21T06:06:16.454172+0000","last_unstale":"2024-09-21T06:06:18.498988+0000","last_undegraded":"2024-09-21T06:06:18.498988+0000","last_fullsized":"2024-09-21T06:06:18.498988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:31.953070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498695+0000","last_change":"2024-09-21T06:06:17.475664+0000","last_active":"2024-09-21T06:06:18.498695+0000","last_peered":"2024-09-21T06:06:18.498695+0000","last_clean":"2024-09-21T06:06:18.498695+0000","last_became_active":"2024-09-21T06:06:17.475327+0000","last_became_peered":"2024-09-21T06:06:17.475327+0000","last_unstale":"2024-09-21T06:06:18.498695+0000","last_undegraded":"2024-09-21T06:06:18.498695+0000","last_fullsized":"2024-09-21T06:06:18.498695+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:46.481901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.474127+0000","last_change":"2024-09-21T06:06:16.458109+0000","last_active":"2024-09-21T06:06:18.474127+0000","last_peered":"2024-09-21T06:06:18.474127+0000","last_clean":"2024-09-21T06:06:18.474127+0000","last_became_active":"2024-09-21T06:06:16.457941+0000","last_became_peered":"2024-09-21T06:06:16.457941+0000","last_unstale":"2024-09-21T06:06:18.474127+0000","last_undegraded":"2024-09-21T06:06:18.474127+0000","last_fullsized":"2024-09-21T06:06:18.474127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:10.941214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472492+0000","last_change":"2024-09-21T06:06:17.478069+0000","last_active":"2024-09-21T06:06:18.472492+0000","last_peered":"2024-09-21T06:06:18.472492+0000","last_clean":"2024-09-21T06:06:18.472492+0000","last_became_active":"2024-09-21T06:06:17.477512+0000","last_became_peered":"2024-09-21T06:06:17.477512+0000","last_unstale":"2024-09-21T06:06:18.472492+0000","last_undegraded":"2024-09-21T06:06:18.472492+0000","last_fullsized":"2024-09-21T06:06:18.472492+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:42.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472030+0000","last_change":"2024-09-21T06:06:16.443126+0000","last_active":"2024-09-21T06:06:18.472030+0000","last_peered":"2024-09-21T06:06:18.472030+0000","last_clean":"2024-09-21T06:06:18.472030+0000","last_became_active":"2024-09-21T06:06:16.442830+0000","last_became_peered":"2024-09-21T06:06:16.442830+0000","last_unstale":"2024-09-21T06:06:18.472030+0000","last_undegraded":"2024-09-21T06:06:18.472030+0000","last_fullsized":"2024-09-21T06:06:18.472030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:33.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499028+0000","last_change":"2024-09-21T06:06:17.480088+0000","last_active":"2024-09-21T06:06:18.499028+0000","last_peered":"2024-09-21T06:06:18.499028+0000","last_clean":"2024-09-21T06:06:18.499028+0000","last_became_active":"2024-09-21T06:06:17.479846+0000","last_became_peered":"2024-09-21T06:06:17.479846+0000","last_unstale":"2024-09-21T06:06:18.499028+0000","last_undegraded":"2024-09-21T06:06:18.499028+0000","last_fullsized":"2024-09-21T06:06:18.499028+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.178656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'3","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473780+0000","last_change":"2024-09-21T06:06:16.452257+0000","last_active":"2024-09-21T06:06:18.473780+0000","last_peered":"2024-09-21T06:06:18.473780+0000","last_clean":"2024-09-21T06:06:18.473780+0000","last_became_active":"2024-09-21T06:06:16.451716+0000","last_became_peered":"2024-09-21T06:06:16.451716+0000","last_unstale":"2024-09-21T06:06:18.473780+0000","last_undegraded":"2024-09-21T06:06:18.473780+0000","last_fullsized":"2024-09-21T06:06:18.473780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:05.986152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473703+0000","last_change":"2024-09-21T06:06:17.474888+0000","last_active":"2024-09-21T06:06:18.473703+0000","last_peered":"2024-09-21T06:06:18.473703+0000","last_clean":"2024-09-21T06:06:18.473703+0000","last_became_active":"2024-09-21T06:06:17.474630+0000","last_became_peered":"2024-09-21T06:06:17.474630+0000","last_unstale":"2024-09-21T06:06:18.473703+0000","last_undegraded":"2024-09-21T06:06:18.473703+0000","last_fullsized":"2024-09-21T06:06:18.473703+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:56.149081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'6","reported_seq":21,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498918+0000","last_change":"2024-09-21T06:06:16.456054+0000","last_active":"2024-09-21T06:06:18.498918+0000","last_peered":"2024-09-21T06:06:18.498918+0000","last_clean":"2024-09-21T06:06:18.498918+0000","last_became_active":"2024-09-21T06:06:16.455650+0000","last_became_peered":"2024-09-21T06:06:16.455650+0000","last_unstale":"2024-09-21T06:06:18.498918+0000","last_undegraded":"2024-09-21T06:06:18.498918+0000","last_fullsized":"2024-09-21T06:06:18.498918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:19.897287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472937+0000","last_change":"2024-09-21T06:06:17.477968+0000","last_active":"2024-09-21T06:06:18.472937+0000","last_peered":"2024-09-21T06:06:18.472937+0000","last_clean":"2024-09-21T06:06:18.472937+0000","last_became_active":"2024-09-21T06:06:17.477650+0000","last_became_peered":"2024-09-21T06:06:17.477650+0000","last_unstale":"2024-09-21T06:06:18.472937+0000","last_undegraded":"2024-09-21T06:06:18.472937+0000","last_fullsized":"2024-09-21T06:06:18.472937+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:18.276445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471150+0000","last_change":"2024-09-21T06:06:16.445526+0000","last_active":"2024-09-21T06:06:18.471150+0000","last_peered":"2024-09-21T06:06:18.471150+0000","last_clean":"2024-09-21T06:06:18.471150+0000","last_became_active":"2024-09-21T06:06:16.445235+0000","last_became_peered":"2024-09-21T06:06:16.445235+0000","last_unstale":"2024-09-21T06:06:18.471150+0000","last_undegraded":"2024-09-21T06:06:18.471150+0000","last_fullsized":"2024-09-21T06:06:18.471150+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:28.570781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472897+0000","last_change":"2024-09-21T06:06:17.476509+0000","last_active":"2024-09-21T06:06:18.472897+0000","last_peered":"2024-09-21T06:06:18.472897+0000","last_clean":"2024-09-21T06:06:18.472897+0000","last_became_active":"2024-09-21T06:06:17.475681+0000","last_became_peered":"2024-09-21T06:06:17.475681+0000","last_unstale":"2024-09-21T06:06:18.472897+0000","last_undegraded":"2024-09-21T06:06:18.472897+0000","last_fullsized":"2024-09-21T06:06:18.472897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:50.639245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488115+0000","last_change":"2024-09-21T06:06:16.453165+0000","last_active":"2024-09-21T06:06:18.488115+0000","last_peered":"2024-09-21T06:06:18.488115+0000","last_clean":"2024-09-21T06:06:18.488115+0000","last_became_active":"2024-09-21T06:06:16.452903+0000","last_became_peered":"2024-09-21T06:06:16.452903+0000","last_unstale":"2024-09-21T06:06:18.488115+0000","last_undegraded":"2024-09-21T06:06:18.488115+0000","last_fullsized":"2024-09-21T06:06:18.488115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:13.092465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498635+0000","last_change":"2024-09-21T06:06:17.471023+0000","last_active":"2024-09-21T06:06:18.498635+0000","last_peered":"2024-09-21T06:06:18.498635+0000","last_clean":"2024-09-21T06:06:18.498635+0000","last_became_active":"2024-09-21T06:06:17.468522+0000","last_became_peered":"2024-09-21T06:06:17.468522+0000","last_unstale":"2024-09-21T06:06:18.498635+0000","last_undegraded":"2024-09-21T06:06:18.498635+0000","last_fullsized":"2024-09-21T06:06:18.498635+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.084659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472780+0000","last_change":"2024-09-21T06:06:16.453466+0000","last_active":"2024-09-21T06:06:18.472780+0000","last_peered":"2024-09-21T06:06:18.472780+0000","last_clean":"2024-09-21T06:06:18.472780+0000","last_became_active":"2024-09-21T06:06:16.451422+0000","last_became_peered":"2024-09-21T06:06:16.451422+0000","last_unstale":"2024-09-21T06:06:18.472780+0000","last_undegraded":"2024-09-21T06:06:18.472780+0000","last_fullsized":"2024-09-21T06:06:18.472780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:09.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472226+0000","last_change":"2024-09-21T06:06:17.464212+0000","last_active":"2024-09-21T06:06:18.472226+0000","last_peered":"2024-09-21T06:06:18.472226+0000","last_clean":"2024-09-21T06:06:18.472226+0000","last_became_active":"2024-09-21T06:06:17.463940+0000","last_became_peered":"2024-09-21T06:06:17.463940+0000","last_unstale":"2024-09-21T06:06:18.472226+0000","last_undegraded":"2024-09-21T06:06:18.472226+0000","last_fullsized":"2024-09-21T06:06:18.472226+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"62'8","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473846+0000","last_change":"2024-09-21T06:06:16.451989+0000","last_active":"2024-09-21T06:06:18.473846+0000","last_peered":"2024-09-21T06:06:18.473846+0000","last_clean":"2024-09-21T06:06:18.473846+0000","last_became_active":"2024-09-21T06:06:16.451367+0000","last_became_peered":"2024-09-21T06:06:16.451367+0000","last_unstale":"2024-09-21T06:06:18.473846+0000","last_undegraded":"2024-09-21T06:06:18.473846+0000","last_fullsized":"2024-09-21T06:06:18.473846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:20.275970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.474062+0000","last_change":"2024-09-21T06:06:17.468012+0000","last_active":"2024-09-21T06:06:18.474062+0000","last_peered":"2024-09-21T06:06:18.474062+0000","last_clean":"2024-09-21T06:06:18.474062+0000","last_became_active":"2024-09-21T06:06:17.465401+0000","last_became_peered":"2024-09-21T06:06:17.465401+0000","last_unstale":"2024-09-21T06:06:18.474062+0000","last_undegraded":"2024-09-21T06:06:18.474062+0000","last_fullsized":"2024-09-21T06:06:18.474062+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:11.927768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471438+0000","last_change":"2024-09-21T06:06:16.445511+0000","last_active":"2024-09-21T06:06:18.471438+0000","last_peered":"2024-09-21T06:06:18.471438+0000","last_clean":"2024-09-21T06:06:18.471438+0000","last_became_active":"2024-09-21T06:06:16.445208+0000","last_became_peered":"2024-09-21T06:06:16.445208+0000","last_unstale":"2024-09-21T06:06:18.471438+0000","last_undegraded":"2024-09-21T06:06:18.471438+0000","last_fullsized":"2024-09-21T06:06:18.471438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:25.786066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472146+0000","last_change":"2024-09-21T06:06:17.478371+0000","last_active":"2024-09-21T06:06:18.472146+0000","last_peered":"2024-09-21T06:06:18.472146+0000","last_clean":"2024-09-21T06:06:18.472146+0000","last_became_active":"2024-09-21T06:06:17.477514+0000","last_became_peered":"2024-09-21T06:06:17.477514+0000","last_unstale":"2024-09-21T06:06:18.472146+0000","last_undegraded":"2024-09-21T06:06:18.472146+0000","last_fullsized":"2024-09-21T06:06:18.472146+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:59.191514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486813+0000","last_change":"2024-09-21T06:06:16.457336+0000","last_active":"2024-09-21T06:06:18.486813+0000","last_peered":"2024-09-21T06:06:18.486813+0000","last_clean":"2024-09-21T06:06:18.486813+0000","last_became_active":"2024-09-21T06:06:16.457069+0000","last_became_peered":"2024-09-21T06:06:16.457069+0000","last_unstale":"2024-09-21T06:06:18.486813+0000","last_undegraded":"2024-09-21T06:06:18.486813+0000","last_fullsized":"2024-09-21T06:06:18.486813+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:03.450277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471723+0000","last_change":"2024-09-21T06:06:17.469580+0000","last_active":"2024-09-21T06:06:18.471723+0000","last_peered":"2024-09-21T06:06:18.471723+0000","last_clean":"2024-09-21T06:06:18.471723+0000","last_became_active":"2024-09-21T06:06:17.469243+0000","last_became_peered":"2024-09-21T06:06:17.469243+0000","last_unstale":"2024-09-21T06:06:18.471723+0000","last_undegraded":"2024-09-21T06:06:18.471723+0000","last_fullsized":"2024-09-21T06:06:18.471723+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:32.439912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473184+0000","last_change":"2024-09-21T06:06:16.455911+0000","last_active":"2024-09-21T06:06:18.473184+0000","last_peered":"2024-09-21T06:06:18.473184+0000","last_clean":"2024-09-21T06:06:18.473184+0000","last_became_active":"2024-09-21T06:06:16.454578+0000","last_became_peered":"2024-09-21T06:06:16.454578+0000","last_unstale":"2024-09-21T06:06:18.473184+0000","last_undegraded":"2024-09-21T06:06:18.473184+0000","last_fullsized":"2024-09-21T06:06:18.473184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:18.538555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472724+0000","last_change":"2024-09-21T06:06:17.477775+0000","last_active":"2024-09-21T06:06:18.472724+0000","last_peered":"2024-09-21T06:06:18.472724+0000","last_clean":"2024-09-21T06:06:18.472724+0000","last_became_active":"2024-09-21T06:06:17.477108+0000","last_became_peered":"2024-09-21T06:06:17.477108+0000","last_unstale":"2024-09-21T06:06:18.472724+0000","last_undegraded":"2024-09-21T06:06:18.472724+0000","last_fullsized":"2024-09-21T06:06:18.472724+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:10.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486756+0000","last_change":"2024-09-21T06:06:16.455154+0000","last_active":"2024-09-21T06:06:18.486756+0000","last_peered":"2024-09-21T06:06:18.486756+0000","last_clean":"2024-09-21T06:06:18.486756+0000","last_became_active":"2024-09-21T06:06:16.454769+0000","last_became_peered":"2024-09-21T06:06:16.454769+0000","last_unstale":"2024-09-21T06:06:18.486756+0000","last_undegraded":"2024-09-21T06:06:18.486756+0000","last_fullsized":"2024-09-21T06:06:18.486756+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:43.965340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472472+0000","last_change":"2024-09-21T06:06:17.477775+0000","last_active":"2024-09-21T06:06:18.472472+0000","last_peered":"2024-09-21T06:06:18.472472+0000","last_clean":"2024-09-21T06:06:18.472472+0000","last_became_active":"2024-09-21T06:06:17.477166+0000","last_became_peered":"2024-09-21T06:06:17.477166+0000","last_unstale":"2024-09-21T06:06:18.472472+0000","last_undegraded":"2024-09-21T06:06:18.472472+0000","last_fullsized":"2024-09-21T06:06:18.472472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:24.022782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471601+0000","last_change":"2024-09-21T06:06:16.451546+0000","last_active":"2024-09-21T06:06:18.471601+0000","last_peered":"2024-09-21T06:06:18.471601+0000","last_clean":"2024-09-21T06:06:18.471601+0000","last_became_active":"2024-09-21T06:06:16.451092+0000","last_became_peered":"2024-09-21T06:06:16.451092+0000","last_unstale":"2024-09-21T06:06:18.471601+0000","last_undegraded":"2024-09-21T06:06:18.471601+0000","last_fullsized":"2024-09-21T06:06:18.471601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:02.982320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486337+0000","last_change":"2024-09-21T06:06:17.481862+0000","last_active":"2024-09-21T06:06:18.486337+0000","last_peered":"2024-09-21T06:06:18.486337+0000","last_clean":"2024-09-21T06:06:18.486337+0000","last_became_active":"2024-09-21T06:06:17.481282+0000","last_became_peered":"2024-09-21T06:06:17.481282+0000","last_unstale":"2024-09-21T06:06:18.486337+0000","last_undegraded":"2024-09-21T06:06:18.486337+0000","last_fullsized":"2024-09-21T06:06:18.486337+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:19.839382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499356+0000","last_change":"2024-09-21T06:06:16.447820+0000","last_active":"2024-09-21T06:06:18.499356+0000","last_peered":"2024-09-21T06:06:18.499356+0000","last_clean":"2024-09-21T06:06:18.499356+0000","last_became_active":"2024-09-21T06:06:16.447400+0000","last_became_peered":"2024-09-21T06:06:16.447400+0000","last_unstale":"2024-09-21T06:06:18.499356+0000","last_undegraded":"2024-09-21T06:06:18.499356+0000","last_fullsized":"2024-09-21T06:06:18.499356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:32.851303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486618+0000","last_change":"2024-09-21T06:06:17.483219+0000","last_active":"2024-09-21T06:06:18.486618+0000","last_peered":"2024-09-21T06:06:18.486618+0000","last_clean":"2024-09-21T06:06:18.486618+0000","last_became_active":"2024-09-21T06:06:17.482891+0000","last_became_peered":"2024-09-21T06:06:17.482891+0000","last_unstale":"2024-09-21T06:06:18.486618+0000","last_undegraded":"2024-09-21T06:06:18.486618+0000","last_fullsized":"2024-09-21T06:06:18.486618+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:15.509344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473299+0000","last_change":"2024-09-21T06:06:16.455475+0000","last_active":"2024-09-21T06:06:18.473299+0000","last_peered":"2024-09-21T06:06:18.473299+0000","last_clean":"2024-09-21T06:06:18.473299+0000","last_became_active":"2024-09-21T06:06:16.454191+0000","last_became_peered":"2024-09-21T06:06:16.454191+0000","last_unstale":"2024-09-21T06:06:18.473299+0000","last_undegraded":"2024-09-21T06:06:18.473299+0000","last_fullsized":"2024-09-21T06:06:18.473299+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:52.013564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472197+0000","last_change":"2024-09-21T06:06:17.470477+0000","last_active":"2024-09-21T06:06:18.472197+0000","last_peered":"2024-09-21T06:06:18.472197+0000","last_clean":"2024-09-21T06:06:18.472197+0000","last_became_active":"2024-09-21T06:06:17.470197+0000","last_became_peered":"2024-09-21T06:06:17.470197+0000","last_unstale":"2024-09-21T06:06:18.472197+0000","last_undegraded":"2024-09-21T06:06:18.472197+0000","last_fullsized":"2024-09-21T06:06:18.472197+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:00.885408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499010+0000","last_change":"2024-09-21T06:06:16.453086+0000","last_active":"2024-09-21T06:06:18.499010+0000","last_peered":"2024-09-21T06:06:18.499010+0000","last_clean":"2024-09-21T06:06:18.499010+0000","last_became_active":"2024-09-21T06:06:16.452835+0000","last_became_peered":"2024-09-21T06:06:16.452835+0000","last_unstale":"2024-09-21T06:06:18.499010+0000","last_undegraded":"2024-09-21T06:06:18.499010+0000","last_fullsized":"2024-09-21T06:06:18.499010+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.456020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472664+0000","last_change":"2024-09-21T06:06:17.470610+0000","last_active":"2024-09-21T06:06:18.472664+0000","last_peered":"2024-09-21T06:06:18.472664+0000","last_clean":"2024-09-21T06:06:18.472664+0000","last_became_active":"2024-09-21T06:06:17.470224+0000","last_became_peered":"2024-09-21T06:06:17.470224+0000","last_unstale":"2024-09-21T06:06:18.472664+0000","last_undegraded":"2024-09-21T06:06:18.472664+0000","last_fullsized":"2024-09-21T06:06:18.472664+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:24.014467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"63'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488271+0000","last_change":"2024-09-21T06:06:16.458137+0000","last_active":"2024-09-21T06:06:18.488271+0000","last_peered":"2024-09-21T06:06:18.488271+0000","last_clean":"2024-09-21T06:06:18.488271+0000","last_became_active":"2024-09-21T06:06:16.457453+0000","last_became_peered":"2024-09-21T06:06:16.457453+0000","last_unstale":"2024-09-21T06:06:18.488271+0000","last_undegraded":"2024-09-21T06:06:18.488271+0000","last_fullsized":"2024-09-21T06:06:18.488271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:31.210119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499147+0000","last_change":"2024-09-21T06:06:17.478164+0000","last_active":"2024-09-21T06:06:18.499147+0000","last_peered":"2024-09-21T06:06:18.499147+0000","last_clean":"2024-09-21T06:06:18.499147+0000","last_became_active":"2024-09-21T06:06:17.477927+0000","last_became_peered":"2024-09-21T06:06:17.477927+0000","last_unstale":"2024-09-21T06:06:18.499147+0000","last_undegraded":"2024-09-21T06:06:18.499147+0000","last_fullsized":"2024-09-21T06:06:18.499147+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:01.232770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488376+0000","last_change":"2024-09-21T06:06:16.454251+0000","last_active":"2024-09-21T06:06:18.488376+0000","last_peered":"2024-09-21T06:06:18.488376+0000","last_clean":"2024-09-21T06:06:18.488376+0000","last_became_active":"2024-09-21T06:06:16.453659+0000","last_became_peered":"2024-09-21T06:06:16.453659+0000","last_unstale":"2024-09-21T06:06:18.488376+0000","last_undegraded":"2024-09-21T06:06:18.488376+0000","last_fullsized":"2024-09-21T06:06:18.488376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:49.254156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486522+0000","last_change":"2024-09-21T06:06:17.484067+0000","last_active":"2024-09-21T06:06:18.486522+0000","last_peered":"2024-09-21T06:06:18.486522+0000","last_clean":"2024-09-21T06:06:18.486522+0000","last_became_active":"2024-09-21T06:06:17.483554+0000","last_became_peered":"2024-09-21T06:06:17.483554+0000","last_unstale":"2024-09-21T06:06:18.486522+0000","last_undegraded":"2024-09-21T06:06:18.486522+0000","last_fullsized":"2024-09-21T06:06:18.486522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:53.201183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473428+0000","last_change":"2024-09-21T06:06:16.450795+0000","last_active":"2024-09-21T06:06:18.473428+0000","last_peered":"2024-09-21T06:06:18.473428+0000","last_clean":"2024-09-21T06:06:18.473428+0000","last_became_active":"2024-09-21T06:06:16.450456+0000","last_became_peered":"2024-09-21T06:06:16.450456+0000","last_unstale":"2024-09-21T06:06:18.473428+0000","last_undegraded":"2024-09-21T06:06:18.473428+0000","last_fullsized":"2024-09-21T06:06:18.473428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:45.366777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471943+0000","last_change":"2024-09-21T06:06:17.477028+0000","last_active":"2024-09-21T06:06:18.471943+0000","last_peered":"2024-09-21T06:06:18.471943+0000","last_clean":"2024-09-21T06:06:18.471943+0000","last_became_active":"2024-09-21T06:06:17.473187+0000","last_became_peered":"2024-09-21T06:06:17.473187+0000","last_unstale":"2024-09-21T06:06:18.471943+0000","last_undegraded":"2024-09-21T06:06:18.471943+0000","last_fullsized":"2024-09-21T06:06:18.471943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:14.212729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499254+0000","last_change":"2024-09-21T06:06:16.450729+0000","last_active":"2024-09-21T06:06:18.499254+0000","last_peered":"2024-09-21T06:06:18.499254+0000","last_clean":"2024-09-21T06:06:18.499254+0000","last_became_active":"2024-09-21T06:06:16.450465+0000","last_became_peered":"2024-09-21T06:06:16.450465+0000","last_unstale":"2024-09-21T06:06:18.499254+0000","last_undegraded":"2024-09-21T06:06:18.499254+0000","last_fullsized":"2024-09-21T06:06:18.499254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:34.434655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472942+0000","last_change":"2024-09-21T06:06:17.465763+0000","last_active":"2024-09-21T06:06:18.472942+0000","last_peered":"2024-09-21T06:06:18.472942+0000","last_clean":"2024-09-21T06:06:18.472942+0000","last_became_active":"2024-09-21T06:06:17.465473+0000","last_became_peered":"2024-09-21T06:06:17.465473+0000","last_unstale":"2024-09-21T06:06:18.472942+0000","last_undegraded":"2024-09-21T06:06:18.472942+0000","last_fullsized":"2024-09-21T06:06:18.472942+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:07.460938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498842+0000","last_change":"2024-09-21T06:06:16.454328+0000","last_active":"2024-09-21T06:06:18.498842+0000","last_peered":"2024-09-21T06:06:18.498842+0000","last_clean":"2024-09-21T06:06:18.498842+0000","last_became_active":"2024-09-21T06:06:16.454038+0000","last_became_peered":"2024-09-21T06:06:16.454038+0000","last_unstale":"2024-09-21T06:06:18.498842+0000","last_undegraded":"2024-09-21T06:06:18.498842+0000","last_fullsized":"2024-09-21T06:06:18.498842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:54.918022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499249+0000","last_change":"2024-09-21T06:06:17.475979+0000","last_active":"2024-09-21T06:06:18.499249+0000","last_peered":"2024-09-21T06:06:18.499249+0000","last_clean":"2024-09-21T06:06:18.499249+0000","last_became_active":"2024-09-21T06:06:17.475716+0000","last_became_peered":"2024-09-21T06:06:17.475716+0000","last_unstale":"2024-09-21T06:06:18.499249+0000","last_undegraded":"2024-09-21T06:06:18.499249+0000","last_fullsized":"2024-09-21T06:06:18.499249+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:18.153238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499228+0000","last_change":"2024-09-21T06:06:16.457402+0000","last_active":"2024-09-21T06:06:18.499228+0000","last_peered":"2024-09-21T06:06:18.499228+0000","last_clean":"2024-09-21T06:06:18.499228+0000","last_became_active":"2024-09-21T06:06:16.457138+0000","last_became_peered":"2024-09-21T06:06:16.457138+0000","last_unstale":"2024-09-21T06:06:18.499228+0000","last_undegraded":"2024-09-21T06:06:18.499228+0000","last_fullsized":"2024-09-21T06:06:18.499228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.820746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471458+0000","last_change":"2024-09-21T06:06:17.472767+0000","last_active":"2024-09-21T06:06:18.471458+0000","last_peered":"2024-09-21T06:06:18.471458+0000","last_clean":"2024-09-21T06:06:18.471458+0000","last_became_active":"2024-09-21T06:06:17.472549+0000","last_became_peered":"2024-09-21T06:06:17.472549+0000","last_unstale":"2024-09-21T06:06:18.471458+0000","last_undegraded":"2024-09-21T06:06:18.471458+0000","last_fullsized":"2024-09-21T06:06:18.471458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:15.379861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471544+0000","last_change":"2024-09-21T06:06:16.453128+0000","last_active":"2024-09-21T06:06:18.471544+0000","last_peered":"2024-09-21T06:06:18.471544+0000","last_clean":"2024-09-21T06:06:18.471544+0000","last_became_active":"2024-09-21T06:06:16.452659+0000","last_became_peered":"2024-09-21T06:06:16.452659+0000","last_unstale":"2024-09-21T06:06:18.471544+0000","last_undegraded":"2024-09-21T06:06:18.471544+0000","last_fullsized":"2024-09-21T06:06:18.471544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:06.888234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471203+0000","last_change":"2024-09-21T06:06:17.484115+0000","last_active":"2024-09-21T06:06:18.471203+0000","last_peered":"2024-09-21T06:06:18.471203+0000","last_clean":"2024-09-21T06:06:18.471203+0000","last_became_active":"2024-09-21T06:06:17.483716+0000","last_became_peered":"2024-09-21T06:06:17.483716+0000","last_unstale":"2024-09-21T06:06:18.471203+0000","last_undegraded":"2024-09-21T06:06:18.471203+0000","last_fullsized":"2024-09-21T06:06:18.471203+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:34.770359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488457+0000","last_change":"2024-09-21T06:06:16.452257+0000","last_active":"2024-09-21T06:06:18.488457+0000","last_peered":"2024-09-21T06:06:18.488457+0000","last_clean":"2024-09-21T06:06:18.488457+0000","last_became_active":"2024-09-21T06:06:16.450812+0000","last_became_peered":"2024-09-21T06:06:16.450812+0000","last_unstale":"2024-09-21T06:06:18.488457+0000","last_undegraded":"2024-09-21T06:06:18.488457+0000","last_fullsized":"2024-09-21T06:06:18.488457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:04.069268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":198,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471780+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:06:18.471780+0000","last_peered":"2024-09-21T06:06:18.471780+0000","last_clean":"2024-09-21T06:06:18.471780+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:06:18.471780+0000","last_undegraded":"2024-09-21T06:06:18.471780+0000","last_fullsized":"2024-09-21T06:06:18.471780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:48.572395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":314,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194997,"statfs":{"total":200000000,"available":199677500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084994,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":885,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194427,"statfs":{"total":200000000,"available":199093328,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683856,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683204,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":310,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195002,"statfs":{"total":200000000,"available":199682244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":314,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194997,"statfs":{"total":200000000,"available":199677500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:06:21.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:06:22.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 -- 172.21.15.118:0/2057736881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4006ecd0 msgr2=0x7f7c4006f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 --2- 172.21.15.118:0/2057736881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4006ecd0 0x7f7c4006f0e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c40071c00 tx=0x7f7c3802aa10 comp rx=0 tx=0).stop 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 -- 172.21.15.118:0/2057736881 shutdown_connections 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 --2- 172.21.15.118:0/2057736881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c4006ecd0 0x7f7c4006f0e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 --2- 172.21.15.118:0/2057736881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c400d0e80 0x7f7c400d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 --2- 172.21.15.118:0/2057736881 >> v2:172.21.15.149:3300/0 conn(0x7f7c40073e30 0x7f7c401635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 -- 172.21.15.118:0/2057736881 >> 172.21.15.118:0/2057736881 conn(0x7f7c4006d110 msgr2=0x7f7c4006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.143+0000 7f7c48200640 1 -- 172.21.15.118:0/2057736881 shutdown_connections 2024-09-21T06:06:22.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.144+0000 7f7c48200640 1 -- 172.21.15.118:0/2057736881 wait complete. 2024-09-21T06:06:22.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.146+0000 7f7c48200640 1 Processor -- start 2024-09-21T06:06:22.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.146+0000 7f7c48200640 1 -- start start 2024-09-21T06:06:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.147+0000 7f7c48200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c4006ecd0 0x7f7c400b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.147+0000 7f7c48200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c40073e30 0x7f7c4014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.147+0000 7f7c48200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c400d0e80 0x7f7c400b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.147+0000 7f7c48200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4006f620 con 0x7f7c40073e30 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.147+0000 7f7c48200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c40156530 con 0x7f7c400d0e80 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.147+0000 7f7c48200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4006f7a0 con 0x7f7c4006ecd0 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c40073e30 0x7f7c4014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c40073e30 0x7f7c4014b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53360/0 (socket says 172.21.15.118:53360) 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 -- 172.21.15.118:0/3893821414 learned_addr learned my addr 172.21.15.118:0/3893821414 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c45800640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c4006ecd0 0x7f7c400b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c46200640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c400d0e80 0x7f7c400b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 -- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c4006ecd0 msgr2=0x7f7c400b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c4006ecd0 0x7f7c400b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 -- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c400d0e80 msgr2=0x7f7c400b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c400d0e80 0x7f7c400b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 -- 172.21.15.118:0/3893821414 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4014c0d0 con 0x7f7c40073e30 2024-09-21T06:06:22.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.148+0000 7f7c44e00640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c40073e30 0x7f7c4014b480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e780 tx=0x7f7c2c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:22.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.149+0000 7f7c3d600640 1 -- 172.21.15.118:0/3893821414 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00ccc0 con 0x7f7c40073e30 2024-09-21T06:06:22.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.149+0000 7f7c3d600640 1 -- 172.21.15.118:0/3893821414 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c2c00ee90 con 0x7f7c40073e30 2024-09-21T06:06:22.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.149+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c400b29b0 con 0x7f7c40073e30 2024-09-21T06:06:22.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.149+0000 7f7c3d600640 1 -- 172.21.15.118:0/3893821414 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c005280 con 0x7f7c40073e30 2024-09-21T06:06:22.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.149+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4014c650 con 0x7f7c40073e30 2024-09-21T06:06:22.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.150+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c401635c0 con 0x7f7c40073e30 2024-09-21T06:06:22.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.151+0000 7f7c3d600640 1 -- 172.21.15.118:0/3893821414 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c2c005420 con 0x7f7c40073e30 2024-09-21T06:06:22.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.152+0000 7f7c3d600640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c20078b90 0x7f7c2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.152+0000 7f7c3d600640 1 -- 172.21.15.118:0/3893821414 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f7c2c09b590 con 0x7f7c40073e30 2024-09-21T06:06:22.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.152+0000 7f7c45800640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c20078b90 0x7f7c2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.153+0000 7f7c45800640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c20078b90 0x7f7c2007b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009ab0 tx=0x7f7c34005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:22.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.156+0000 7f7c3d600640 1 -- 172.21.15.118:0/3893821414 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7c2c063380 con 0x7f7c40073e30 2024-09-21T06:06:22.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.339+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c40160b10 con 0x7f7c20078b90 2024-09-21T06:06:22.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.344+0000 7f7c3d600640 1 -- 172.21.15.118:0/3893821414 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247480 (secure 0 0 0) 0x7f7c40160b10 con 0x7f7c20078b90 2024-09-21T06:06:22.349 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:22.355 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:06:22.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.348+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c20078b90 msgr2=0x7f7c2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.348+0000 7f7c48200640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c20078b90 0x7f7c2007b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009ab0 tx=0x7f7c34005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:22.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.348+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c40073e30 msgr2=0x7f7c4014b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.348+0000 7f7c48200640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c40073e30 0x7f7c4014b480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e780 tx=0x7f7c2c00ec40 comp rx=0 tx=0).stop 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 shutdown_connections 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c400d0e80 0x7f7c400b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c40073e30 0x7f7c4014b480 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c20078b90 0x7f7c2007b0a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 --2- 172.21.15.118:0/3893821414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c4006ecd0 0x7f7c400b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 >> 172.21.15.118:0/3893821414 conn(0x7f7c4006d110 msgr2=0x7f7c401555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 shutdown_connections 2024-09-21T06:06:22.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.349+0000 7f7c48200640 1 -- 172.21.15.118:0/3893821414 wait complete. 2024-09-21T06:06:22.372 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-21T06:06:20.492142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558853,"statfs":{"total":1600000000,"available":1596266392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.055035"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698751+0000","last_change":"2024-09-21T06:06:17.467704+0000","last_active":"2024-09-21T06:06:18.698751+0000","last_peered":"2024-09-21T06:06:18.698751+0000","last_clean":"2024-09-21T06:06:18.698751+0000","last_became_active":"2024-09-21T06:06:17.467372+0000","last_became_peered":"2024-09-21T06:06:17.467372+0000","last_unstale":"2024-09-21T06:06:18.698751+0000","last_undegraded":"2024-09-21T06:06:18.698751+0000","last_fullsized":"2024-09-21T06:06:18.698751+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:31.279241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.470908+0000","last_change":"2024-09-21T06:06:17.477329+0000","last_active":"2024-09-21T06:06:18.470908+0000","last_peered":"2024-09-21T06:06:18.470908+0000","last_clean":"2024-09-21T06:06:18.470908+0000","last_became_active":"2024-09-21T06:06:17.474568+0000","last_became_peered":"2024-09-21T06:06:17.474568+0000","last_unstale":"2024-09-21T06:06:18.470908+0000","last_undegraded":"2024-09-21T06:06:18.470908+0000","last_fullsized":"2024-09-21T06:06:18.470908+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:45.136645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473166+0000","last_change":"2024-09-21T06:06:17.467556+0000","last_active":"2024-09-21T06:06:18.473166+0000","last_peered":"2024-09-21T06:06:18.473166+0000","last_clean":"2024-09-21T06:06:18.473166+0000","last_became_active":"2024-09-21T06:06:17.467264+0000","last_became_peered":"2024-09-21T06:06:17.467264+0000","last_unstale":"2024-09-21T06:06:18.473166+0000","last_undegraded":"2024-09-21T06:06:18.473166+0000","last_fullsized":"2024-09-21T06:06:18.473166+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:13.647152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471901+0000","last_change":"2024-09-21T06:06:17.473805+0000","last_active":"2024-09-21T06:06:18.471901+0000","last_peered":"2024-09-21T06:06:18.471901+0000","last_clean":"2024-09-21T06:06:18.471901+0000","last_became_active":"2024-09-21T06:06:17.472506+0000","last_became_peered":"2024-09-21T06:06:17.472506+0000","last_unstale":"2024-09-21T06:06:18.471901+0000","last_undegraded":"2024-09-21T06:06:18.471901+0000","last_fullsized":"2024-09-21T06:06:18.471901+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:26.476400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698758+0000","last_change":"2024-09-21T06:06:17.471767+0000","last_active":"2024-09-21T06:06:18.698758+0000","last_peered":"2024-09-21T06:06:18.698758+0000","last_clean":"2024-09-21T06:06:18.698758+0000","last_became_active":"2024-09-21T06:06:17.471517+0000","last_became_peered":"2024-09-21T06:06:17.471517+0000","last_unstale":"2024-09-21T06:06:18.698758+0000","last_undegraded":"2024-09-21T06:06:18.698758+0000","last_fullsized":"2024-09-21T06:06:18.698758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:31.958153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486343+0000","last_change":"2024-09-21T06:06:17.486646+0000","last_active":"2024-09-21T06:06:18.486343+0000","last_peered":"2024-09-21T06:06:18.486343+0000","last_clean":"2024-09-21T06:06:18.486343+0000","last_became_active":"2024-09-21T06:06:17.485155+0000","last_became_peered":"2024-09-21T06:06:17.485155+0000","last_unstale":"2024-09-21T06:06:18.486343+0000","last_undegraded":"2024-09-21T06:06:18.486343+0000","last_fullsized":"2024-09-21T06:06:18.486343+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:48.001516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498472+0000","last_change":"2024-09-21T06:06:17.469571+0000","last_active":"2024-09-21T06:06:18.498472+0000","last_peered":"2024-09-21T06:06:18.498472+0000","last_clean":"2024-09-21T06:06:18.498472+0000","last_became_active":"2024-09-21T06:06:17.469257+0000","last_became_peered":"2024-09-21T06:06:17.469257+0000","last_unstale":"2024-09-21T06:06:18.498472+0000","last_undegraded":"2024-09-21T06:06:18.498472+0000","last_fullsized":"2024-09-21T06:06:18.498472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:26.241640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.470915+0000","last_change":"2024-09-21T06:06:17.470540+0000","last_active":"2024-09-21T06:06:18.470915+0000","last_peered":"2024-09-21T06:06:18.470915+0000","last_clean":"2024-09-21T06:06:18.470915+0000","last_became_active":"2024-09-21T06:06:17.470256+0000","last_became_peered":"2024-09-21T06:06:17.470256+0000","last_unstale":"2024-09-21T06:06:18.470915+0000","last_undegraded":"2024-09-21T06:06:18.470915+0000","last_fullsized":"2024-09-21T06:06:18.470915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:49.358131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498530+0000","last_change":"2024-09-21T06:06:17.476054+0000","last_active":"2024-09-21T06:06:18.498530+0000","last_peered":"2024-09-21T06:06:18.498530+0000","last_clean":"2024-09-21T06:06:18.498530+0000","last_became_active":"2024-09-21T06:06:17.471758+0000","last_became_peered":"2024-09-21T06:06:17.471758+0000","last_unstale":"2024-09-21T06:06:18.498530+0000","last_undegraded":"2024-09-21T06:06:18.498530+0000","last_fullsized":"2024-09-21T06:06:18.498530+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:38.917068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499019+0000","last_change":"2024-09-21T06:06:17.477124+0000","last_active":"2024-09-21T06:06:18.499019+0000","last_peered":"2024-09-21T06:06:18.499019+0000","last_clean":"2024-09-21T06:06:18.499019+0000","last_became_active":"2024-09-21T06:06:17.475642+0000","last_became_peered":"2024-09-21T06:06:17.475642+0000","last_unstale":"2024-09-21T06:06:18.499019+0000","last_undegraded":"2024-09-21T06:06:18.499019+0000","last_fullsized":"2024-09-21T06:06:18.499019+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:06.693112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499190+0000","last_change":"2024-09-21T06:06:17.477093+0000","last_active":"2024-09-21T06:06:18.499190+0000","last_peered":"2024-09-21T06:06:18.499190+0000","last_clean":"2024-09-21T06:06:18.499190+0000","last_became_active":"2024-09-21T06:06:17.476671+0000","last_became_peered":"2024-09-21T06:06:17.476671+0000","last_unstale":"2024-09-21T06:06:18.499190+0000","last_undegraded":"2024-09-21T06:06:18.499190+0000","last_fullsized":"2024-09-21T06:06:18.499190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:20.440039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472415+0000","last_change":"2024-09-21T06:06:17.471299+0000","last_active":"2024-09-21T06:06:18.472415+0000","last_peered":"2024-09-21T06:06:18.472415+0000","last_clean":"2024-09-21T06:06:18.472415+0000","last_became_active":"2024-09-21T06:06:17.471013+0000","last_became_peered":"2024-09-21T06:06:17.471013+0000","last_unstale":"2024-09-21T06:06:18.472415+0000","last_undegraded":"2024-09-21T06:06:18.472415+0000","last_fullsized":"2024-09-21T06:06:18.472415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:08.927181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488476+0000","last_change":"2024-09-21T06:06:17.482914+0000","last_active":"2024-09-21T06:06:18.488476+0000","last_peered":"2024-09-21T06:06:18.488476+0000","last_clean":"2024-09-21T06:06:18.488476+0000","last_became_active":"2024-09-21T06:06:17.482546+0000","last_became_peered":"2024-09-21T06:06:17.482546+0000","last_unstale":"2024-09-21T06:06:18.488476+0000","last_undegraded":"2024-09-21T06:06:18.488476+0000","last_fullsized":"2024-09-21T06:06:18.488476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:19.755141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498779+0000","last_change":"2024-09-21T06:06:17.467398+0000","last_active":"2024-09-21T06:06:18.498779+0000","last_peered":"2024-09-21T06:06:18.498779+0000","last_clean":"2024-09-21T06:06:18.498779+0000","last_became_active":"2024-09-21T06:06:17.467108+0000","last_became_peered":"2024-09-21T06:06:17.467108+0000","last_unstale":"2024-09-21T06:06:18.498779+0000","last_undegraded":"2024-09-21T06:06:18.498779+0000","last_fullsized":"2024-09-21T06:06:18.498779+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.366044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498885+0000","last_change":"2024-09-21T06:06:17.476680+0000","last_active":"2024-09-21T06:06:18.498885+0000","last_peered":"2024-09-21T06:06:18.498885+0000","last_clean":"2024-09-21T06:06:18.498885+0000","last_became_active":"2024-09-21T06:06:17.476419+0000","last_became_peered":"2024-09-21T06:06:17.476419+0000","last_unstale":"2024-09-21T06:06:18.498885+0000","last_undegraded":"2024-09-21T06:06:18.498885+0000","last_fullsized":"2024-09-21T06:06:18.498885+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:15.561180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486755+0000","last_change":"2024-09-21T06:06:17.480799+0000","last_active":"2024-09-21T06:06:18.486755+0000","last_peered":"2024-09-21T06:06:18.486755+0000","last_clean":"2024-09-21T06:06:18.486755+0000","last_became_active":"2024-09-21T06:06:17.480459+0000","last_became_peered":"2024-09-21T06:06:17.480459+0000","last_unstale":"2024-09-21T06:06:18.486755+0000","last_undegraded":"2024-09-21T06:06:18.486755+0000","last_fullsized":"2024-09-21T06:06:18.486755+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:08.442516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471189+0000","last_change":"2024-09-21T06:06:17.478318+0000","last_active":"2024-09-21T06:06:18.471189+0000","last_peered":"2024-09-21T06:06:18.471189+0000","last_clean":"2024-09-21T06:06:18.471189+0000","last_became_active":"2024-09-21T06:06:17.477724+0000","last_became_peered":"2024-09-21T06:06:17.477724+0000","last_unstale":"2024-09-21T06:06:18.471189+0000","last_undegraded":"2024-09-21T06:06:18.471189+0000","last_fullsized":"2024-09-21T06:06:18.471189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:05.009795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473328+0000","last_change":"2024-09-21T06:06:17.474236+0000","last_active":"2024-09-21T06:06:18.473328+0000","last_peered":"2024-09-21T06:06:18.473328+0000","last_clean":"2024-09-21T06:06:18.473328+0000","last_became_active":"2024-09-21T06:06:17.473953+0000","last_became_peered":"2024-09-21T06:06:17.473953+0000","last_unstale":"2024-09-21T06:06:18.473328+0000","last_undegraded":"2024-09-21T06:06:18.473328+0000","last_fullsized":"2024-09-21T06:06:18.473328+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:19.927800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698745+0000","last_change":"2024-09-21T06:06:17.466614+0000","last_active":"2024-09-21T06:06:18.698745+0000","last_peered":"2024-09-21T06:06:18.698745+0000","last_clean":"2024-09-21T06:06:18.698745+0000","last_became_active":"2024-09-21T06:06:17.466332+0000","last_became_peered":"2024-09-21T06:06:17.466332+0000","last_unstale":"2024-09-21T06:06:18.698745+0000","last_undegraded":"2024-09-21T06:06:18.698745+0000","last_fullsized":"2024-09-21T06:06:18.698745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:45.226342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471032+0000","last_change":"2024-09-21T06:06:17.487208+0000","last_active":"2024-09-21T06:06:18.471032+0000","last_peered":"2024-09-21T06:06:18.471032+0000","last_clean":"2024-09-21T06:06:18.471032+0000","last_became_active":"2024-09-21T06:06:17.486932+0000","last_became_peered":"2024-09-21T06:06:17.486932+0000","last_unstale":"2024-09-21T06:06:18.471032+0000","last_undegraded":"2024-09-21T06:06:18.471032+0000","last_fullsized":"2024-09-21T06:06:18.471032+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:13.446457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472256+0000","last_change":"2024-09-21T06:06:17.473831+0000","last_active":"2024-09-21T06:06:18.472256+0000","last_peered":"2024-09-21T06:06:18.472256+0000","last_clean":"2024-09-21T06:06:18.472256+0000","last_became_active":"2024-09-21T06:06:17.473547+0000","last_became_peered":"2024-09-21T06:06:17.473547+0000","last_unstale":"2024-09-21T06:06:18.472256+0000","last_undegraded":"2024-09-21T06:06:18.472256+0000","last_fullsized":"2024-09-21T06:06:18.472256+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:22.506588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471413+0000","last_change":"2024-09-21T06:06:17.466403+0000","last_active":"2024-09-21T06:06:18.471413+0000","last_peered":"2024-09-21T06:06:18.471413+0000","last_clean":"2024-09-21T06:06:18.471413+0000","last_became_active":"2024-09-21T06:06:17.466064+0000","last_became_peered":"2024-09-21T06:06:17.466064+0000","last_unstale":"2024-09-21T06:06:18.471413+0000","last_undegraded":"2024-09-21T06:06:18.471413+0000","last_fullsized":"2024-09-21T06:06:18.471413+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:20.274131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473564+0000","last_change":"2024-09-21T06:06:17.466792+0000","last_active":"2024-09-21T06:06:18.473564+0000","last_peered":"2024-09-21T06:06:18.473564+0000","last_clean":"2024-09-21T06:06:18.473564+0000","last_became_active":"2024-09-21T06:06:17.466529+0000","last_became_peered":"2024-09-21T06:06:17.466529+0000","last_unstale":"2024-09-21T06:06:18.473564+0000","last_undegraded":"2024-09-21T06:06:18.473564+0000","last_fullsized":"2024-09-21T06:06:18.473564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:26.182801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488267+0000","last_change":"2024-09-21T06:06:17.478470+0000","last_active":"2024-09-21T06:06:18.488267+0000","last_peered":"2024-09-21T06:06:18.488267+0000","last_clean":"2024-09-21T06:06:18.488267+0000","last_became_active":"2024-09-21T06:06:17.477860+0000","last_became_peered":"2024-09-21T06:06:17.477860+0000","last_unstale":"2024-09-21T06:06:18.488267+0000","last_undegraded":"2024-09-21T06:06:18.488267+0000","last_fullsized":"2024-09-21T06:06:18.488267+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:03.023545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698978+0000","last_change":"2024-09-21T06:06:17.478875+0000","last_active":"2024-09-21T06:06:18.698978+0000","last_peered":"2024-09-21T06:06:18.698978+0000","last_clean":"2024-09-21T06:06:18.698978+0000","last_became_active":"2024-09-21T06:06:17.478622+0000","last_became_peered":"2024-09-21T06:06:17.478622+0000","last_unstale":"2024-09-21T06:06:18.698978+0000","last_undegraded":"2024-09-21T06:06:18.698978+0000","last_fullsized":"2024-09-21T06:06:18.698978+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:12.061171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472719+0000","last_change":"2024-09-21T06:06:17.474400+0000","last_active":"2024-09-21T06:06:18.472719+0000","last_peered":"2024-09-21T06:06:18.472719+0000","last_clean":"2024-09-21T06:06:18.472719+0000","last_became_active":"2024-09-21T06:06:17.473609+0000","last_became_peered":"2024-09-21T06:06:17.473609+0000","last_unstale":"2024-09-21T06:06:18.472719+0000","last_undegraded":"2024-09-21T06:06:18.472719+0000","last_fullsized":"2024-09-21T06:06:18.472719+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:12.278202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486281+0000","last_change":"2024-09-21T06:06:17.478551+0000","last_active":"2024-09-21T06:06:18.486281+0000","last_peered":"2024-09-21T06:06:18.486281+0000","last_clean":"2024-09-21T06:06:18.486281+0000","last_became_active":"2024-09-21T06:06:17.477502+0000","last_became_peered":"2024-09-21T06:06:17.477502+0000","last_unstale":"2024-09-21T06:06:18.486281+0000","last_undegraded":"2024-09-21T06:06:18.486281+0000","last_fullsized":"2024-09-21T06:06:18.486281+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:11.350714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698710+0000","last_change":"2024-09-21T06:06:17.470590+0000","last_active":"2024-09-21T06:06:18.698710+0000","last_peered":"2024-09-21T06:06:18.698710+0000","last_clean":"2024-09-21T06:06:18.698710+0000","last_became_active":"2024-09-21T06:06:17.470320+0000","last_became_peered":"2024-09-21T06:06:17.470320+0000","last_unstale":"2024-09-21T06:06:18.698710+0000","last_undegraded":"2024-09-21T06:06:18.698710+0000","last_fullsized":"2024-09-21T06:06:18.698710+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:43.229984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.470907+0000","last_change":"2024-09-21T06:06:17.471580+0000","last_active":"2024-09-21T06:06:18.470907+0000","last_peered":"2024-09-21T06:06:18.470907+0000","last_clean":"2024-09-21T06:06:18.470907+0000","last_became_active":"2024-09-21T06:06:17.471295+0000","last_became_peered":"2024-09-21T06:06:17.471295+0000","last_unstale":"2024-09-21T06:06:18.470907+0000","last_undegraded":"2024-09-21T06:06:18.470907+0000","last_fullsized":"2024-09-21T06:06:18.470907+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:25.109665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472595+0000","last_change":"2024-09-21T06:06:17.464483+0000","last_active":"2024-09-21T06:06:18.472595+0000","last_peered":"2024-09-21T06:06:18.472595+0000","last_clean":"2024-09-21T06:06:18.472595+0000","last_became_active":"2024-09-21T06:06:17.464215+0000","last_became_peered":"2024-09-21T06:06:17.464215+0000","last_unstale":"2024-09-21T06:06:18.472595+0000","last_undegraded":"2024-09-21T06:06:18.472595+0000","last_fullsized":"2024-09-21T06:06:18.472595+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:50.884786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.698981+0000","last_change":"2024-09-21T06:06:17.476318+0000","last_active":"2024-09-21T06:06:18.698981+0000","last_peered":"2024-09-21T06:06:18.698981+0000","last_clean":"2024-09-21T06:06:18.698981+0000","last_became_active":"2024-09-21T06:06:17.476016+0000","last_became_peered":"2024-09-21T06:06:17.476016+0000","last_unstale":"2024-09-21T06:06:18.698981+0000","last_undegraded":"2024-09-21T06:06:18.698981+0000","last_fullsized":"2024-09-21T06:06:18.698981+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:29:04.996679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486524+0000","last_change":"2024-09-21T06:06:17.485301+0000","last_active":"2024-09-21T06:06:18.486524+0000","last_peered":"2024-09-21T06:06:18.486524+0000","last_clean":"2024-09-21T06:06:18.486524+0000","last_became_active":"2024-09-21T06:06:17.485048+0000","last_became_peered":"2024-09-21T06:06:17.485048+0000","last_unstale":"2024-09-21T06:06:18.486524+0000","last_undegraded":"2024-09-21T06:06:18.486524+0000","last_fullsized":"2024-09-21T06:06:18.486524+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:29.437373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486297+0000","last_change":"2024-09-21T06:06:17.483797+0000","last_active":"2024-09-21T06:06:18.486297+0000","last_peered":"2024-09-21T06:06:18.486297+0000","last_clean":"2024-09-21T06:06:18.486297+0000","last_became_active":"2024-09-21T06:06:17.483162+0000","last_became_peered":"2024-09-21T06:06:17.483162+0000","last_unstale":"2024-09-21T06:06:18.486297+0000","last_undegraded":"2024-09-21T06:06:18.486297+0000","last_fullsized":"2024-09-21T06:06:18.486297+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:51.299725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"62'4","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486575+0000","last_change":"2024-09-21T06:06:16.457136+0000","last_active":"2024-09-21T06:06:18.486575+0000","last_peered":"2024-09-21T06:06:18.486575+0000","last_clean":"2024-09-21T06:06:18.486575+0000","last_became_active":"2024-09-21T06:06:16.456118+0000","last_became_peered":"2024-09-21T06:06:16.456118+0000","last_unstale":"2024-09-21T06:06:18.486575+0000","last_undegraded":"2024-09-21T06:06:18.486575+0000","last_fullsized":"2024-09-21T06:06:18.486575+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.264614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499083+0000","last_change":"2024-09-21T06:06:17.473176+0000","last_active":"2024-09-21T06:06:18.499083+0000","last_peered":"2024-09-21T06:06:18.499083+0000","last_clean":"2024-09-21T06:06:18.499083+0000","last_became_active":"2024-09-21T06:06:17.472883+0000","last_became_peered":"2024-09-21T06:06:17.472883+0000","last_unstale":"2024-09-21T06:06:18.499083+0000","last_undegraded":"2024-09-21T06:06:18.499083+0000","last_fullsized":"2024-09-21T06:06:18.499083+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.102629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471330+0000","last_change":"2024-09-21T06:06:16.452915+0000","last_active":"2024-09-21T06:06:18.471330+0000","last_peered":"2024-09-21T06:06:18.471330+0000","last_clean":"2024-09-21T06:06:18.471330+0000","last_became_active":"2024-09-21T06:06:16.451077+0000","last_became_peered":"2024-09-21T06:06:16.451077+0000","last_unstale":"2024-09-21T06:06:18.471330+0000","last_undegraded":"2024-09-21T06:06:18.471330+0000","last_fullsized":"2024-09-21T06:06:18.471330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:28.829851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486614+0000","last_change":"2024-09-21T06:06:17.486185+0000","last_active":"2024-09-21T06:06:18.486614+0000","last_peered":"2024-09-21T06:06:18.486614+0000","last_clean":"2024-09-21T06:06:18.486614+0000","last_became_active":"2024-09-21T06:06:17.484432+0000","last_became_peered":"2024-09-21T06:06:17.484432+0000","last_unstale":"2024-09-21T06:06:18.486614+0000","last_undegraded":"2024-09-21T06:06:18.486614+0000","last_fullsized":"2024-09-21T06:06:18.486614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:05.744514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486744+0000","last_change":"2024-09-21T06:06:16.454084+0000","last_active":"2024-09-21T06:06:18.486744+0000","last_peered":"2024-09-21T06:06:18.486744+0000","last_clean":"2024-09-21T06:06:18.486744+0000","last_became_active":"2024-09-21T06:06:16.453901+0000","last_became_peered":"2024-09-21T06:06:16.453901+0000","last_unstale":"2024-09-21T06:06:18.486744+0000","last_undegraded":"2024-09-21T06:06:18.486744+0000","last_fullsized":"2024-09-21T06:06:18.486744+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:01.830388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486392+0000","last_change":"2024-09-21T06:06:17.486539+0000","last_active":"2024-09-21T06:06:18.486392+0000","last_peered":"2024-09-21T06:06:18.486392+0000","last_clean":"2024-09-21T06:06:18.486392+0000","last_became_active":"2024-09-21T06:06:17.485809+0000","last_became_peered":"2024-09-21T06:06:17.485809+0000","last_unstale":"2024-09-21T06:06:18.486392+0000","last_undegraded":"2024-09-21T06:06:18.486392+0000","last_fullsized":"2024-09-21T06:06:18.486392+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:57.469111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473064+0000","last_change":"2024-09-21T06:06:16.456266+0000","last_active":"2024-09-21T06:06:18.473064+0000","last_peered":"2024-09-21T06:06:18.473064+0000","last_clean":"2024-09-21T06:06:18.473064+0000","last_became_active":"2024-09-21T06:06:16.455158+0000","last_became_peered":"2024-09-21T06:06:16.455158+0000","last_unstale":"2024-09-21T06:06:18.473064+0000","last_undegraded":"2024-09-21T06:06:18.473064+0000","last_fullsized":"2024-09-21T06:06:18.473064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:31.000868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471242+0000","last_change":"2024-09-21T06:06:17.466500+0000","last_active":"2024-09-21T06:06:18.471242+0000","last_peered":"2024-09-21T06:06:18.471242+0000","last_clean":"2024-09-21T06:06:18.471242+0000","last_became_active":"2024-09-21T06:06:17.466199+0000","last_became_peered":"2024-09-21T06:06:17.466199+0000","last_unstale":"2024-09-21T06:06:18.471242+0000","last_undegraded":"2024-09-21T06:06:18.471242+0000","last_fullsized":"2024-09-21T06:06:18.471242+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:06.115431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498777+0000","last_change":"2024-09-21T06:06:16.451684+0000","last_active":"2024-09-21T06:06:18.498777+0000","last_peered":"2024-09-21T06:06:18.498777+0000","last_clean":"2024-09-21T06:06:18.498777+0000","last_became_active":"2024-09-21T06:06:16.451366+0000","last_became_peered":"2024-09-21T06:06:16.451366+0000","last_unstale":"2024-09-21T06:06:18.498777+0000","last_undegraded":"2024-09-21T06:06:18.498777+0000","last_fullsized":"2024-09-21T06:06:18.498777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:08.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471616+0000","last_change":"2024-09-21T06:06:17.478103+0000","last_active":"2024-09-21T06:06:18.471616+0000","last_peered":"2024-09-21T06:06:18.471616+0000","last_clean":"2024-09-21T06:06:18.471616+0000","last_became_active":"2024-09-21T06:06:17.476835+0000","last_became_peered":"2024-09-21T06:06:17.476835+0000","last_unstale":"2024-09-21T06:06:18.471616+0000","last_undegraded":"2024-09-21T06:06:18.471616+0000","last_fullsized":"2024-09-21T06:06:18.471616+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:16.068905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486706+0000","last_change":"2024-09-21T06:06:16.458404+0000","last_active":"2024-09-21T06:06:18.486706+0000","last_peered":"2024-09-21T06:06:18.486706+0000","last_clean":"2024-09-21T06:06:18.486706+0000","last_became_active":"2024-09-21T06:06:16.457934+0000","last_became_peered":"2024-09-21T06:06:16.457934+0000","last_unstale":"2024-09-21T06:06:18.486706+0000","last_undegraded":"2024-09-21T06:06:18.486706+0000","last_fullsized":"2024-09-21T06:06:18.486706+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:55.223405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488312+0000","last_change":"2024-09-21T06:06:17.478072+0000","last_active":"2024-09-21T06:06:18.488312+0000","last_peered":"2024-09-21T06:06:18.488312+0000","last_clean":"2024-09-21T06:06:18.488312+0000","last_became_active":"2024-09-21T06:06:17.477803+0000","last_became_peered":"2024-09-21T06:06:17.477803+0000","last_unstale":"2024-09-21T06:06:18.488312+0000","last_undegraded":"2024-09-21T06:06:18.488312+0000","last_fullsized":"2024-09-21T06:06:18.488312+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:45.778291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472685+0000","last_change":"2024-09-21T06:06:16.451630+0000","last_active":"2024-09-21T06:06:18.472685+0000","last_peered":"2024-09-21T06:06:18.472685+0000","last_clean":"2024-09-21T06:06:18.472685+0000","last_became_active":"2024-09-21T06:06:16.451348+0000","last_became_peered":"2024-09-21T06:06:16.451348+0000","last_unstale":"2024-09-21T06:06:18.472685+0000","last_undegraded":"2024-09-21T06:06:18.472685+0000","last_fullsized":"2024-09-21T06:06:18.472685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:53.877783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471223+0000","last_change":"2024-09-21T06:06:17.476574+0000","last_active":"2024-09-21T06:06:18.471223+0000","last_peered":"2024-09-21T06:06:18.471223+0000","last_clean":"2024-09-21T06:06:18.471223+0000","last_became_active":"2024-09-21T06:06:17.476318+0000","last_became_peered":"2024-09-21T06:06:17.476318+0000","last_unstale":"2024-09-21T06:06:18.471223+0000","last_undegraded":"2024-09-21T06:06:18.471223+0000","last_fullsized":"2024-09-21T06:06:18.471223+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:19.536064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498988+0000","last_change":"2024-09-21T06:06:16.454438+0000","last_active":"2024-09-21T06:06:18.498988+0000","last_peered":"2024-09-21T06:06:18.498988+0000","last_clean":"2024-09-21T06:06:18.498988+0000","last_became_active":"2024-09-21T06:06:16.454172+0000","last_became_peered":"2024-09-21T06:06:16.454172+0000","last_unstale":"2024-09-21T06:06:18.498988+0000","last_undegraded":"2024-09-21T06:06:18.498988+0000","last_fullsized":"2024-09-21T06:06:18.498988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:31.953070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498695+0000","last_change":"2024-09-21T06:06:17.475664+0000","last_active":"2024-09-21T06:06:18.498695+0000","last_peered":"2024-09-21T06:06:18.498695+0000","last_clean":"2024-09-21T06:06:18.498695+0000","last_became_active":"2024-09-21T06:06:17.475327+0000","last_became_peered":"2024-09-21T06:06:17.475327+0000","last_unstale":"2024-09-21T06:06:18.498695+0000","last_undegraded":"2024-09-21T06:06:18.498695+0000","last_fullsized":"2024-09-21T06:06:18.498695+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:46.481901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.474127+0000","last_change":"2024-09-21T06:06:16.458109+0000","last_active":"2024-09-21T06:06:18.474127+0000","last_peered":"2024-09-21T06:06:18.474127+0000","last_clean":"2024-09-21T06:06:18.474127+0000","last_became_active":"2024-09-21T06:06:16.457941+0000","last_became_peered":"2024-09-21T06:06:16.457941+0000","last_unstale":"2024-09-21T06:06:18.474127+0000","last_undegraded":"2024-09-21T06:06:18.474127+0000","last_fullsized":"2024-09-21T06:06:18.474127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:10.941214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472492+0000","last_change":"2024-09-21T06:06:17.478069+0000","last_active":"2024-09-21T06:06:18.472492+0000","last_peered":"2024-09-21T06:06:18.472492+0000","last_clean":"2024-09-21T06:06:18.472492+0000","last_became_active":"2024-09-21T06:06:17.477512+0000","last_became_peered":"2024-09-21T06:06:17.477512+0000","last_unstale":"2024-09-21T06:06:18.472492+0000","last_undegraded":"2024-09-21T06:06:18.472492+0000","last_fullsized":"2024-09-21T06:06:18.472492+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:42.770758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472030+0000","last_change":"2024-09-21T06:06:16.443126+0000","last_active":"2024-09-21T06:06:18.472030+0000","last_peered":"2024-09-21T06:06:18.472030+0000","last_clean":"2024-09-21T06:06:18.472030+0000","last_became_active":"2024-09-21T06:06:16.442830+0000","last_became_peered":"2024-09-21T06:06:16.442830+0000","last_unstale":"2024-09-21T06:06:18.472030+0000","last_undegraded":"2024-09-21T06:06:18.472030+0000","last_fullsized":"2024-09-21T06:06:18.472030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:33.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499028+0000","last_change":"2024-09-21T06:06:17.480088+0000","last_active":"2024-09-21T06:06:18.499028+0000","last_peered":"2024-09-21T06:06:18.499028+0000","last_clean":"2024-09-21T06:06:18.499028+0000","last_became_active":"2024-09-21T06:06:17.479846+0000","last_became_peered":"2024-09-21T06:06:17.479846+0000","last_unstale":"2024-09-21T06:06:18.499028+0000","last_undegraded":"2024-09-21T06:06:18.499028+0000","last_fullsized":"2024-09-21T06:06:18.499028+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:33.178656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'3","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473780+0000","last_change":"2024-09-21T06:06:16.452257+0000","last_active":"2024-09-21T06:06:18.473780+0000","last_peered":"2024-09-21T06:06:18.473780+0000","last_clean":"2024-09-21T06:06:18.473780+0000","last_became_active":"2024-09-21T06:06:16.451716+0000","last_became_peered":"2024-09-21T06:06:16.451716+0000","last_unstale":"2024-09-21T06:06:18.473780+0000","last_undegraded":"2024-09-21T06:06:18.473780+0000","last_fullsized":"2024-09-21T06:06:18.473780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:05.986152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473703+0000","last_change":"2024-09-21T06:06:17.474888+0000","last_active":"2024-09-21T06:06:18.473703+0000","last_peered":"2024-09-21T06:06:18.473703+0000","last_clean":"2024-09-21T06:06:18.473703+0000","last_became_active":"2024-09-21T06:06:17.474630+0000","last_became_peered":"2024-09-21T06:06:17.474630+0000","last_unstale":"2024-09-21T06:06:18.473703+0000","last_undegraded":"2024-09-21T06:06:18.473703+0000","last_fullsized":"2024-09-21T06:06:18.473703+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:56.149081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'6","reported_seq":21,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498918+0000","last_change":"2024-09-21T06:06:16.456054+0000","last_active":"2024-09-21T06:06:18.498918+0000","last_peered":"2024-09-21T06:06:18.498918+0000","last_clean":"2024-09-21T06:06:18.498918+0000","last_became_active":"2024-09-21T06:06:16.455650+0000","last_became_peered":"2024-09-21T06:06:16.455650+0000","last_unstale":"2024-09-21T06:06:18.498918+0000","last_undegraded":"2024-09-21T06:06:18.498918+0000","last_fullsized":"2024-09-21T06:06:18.498918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:19.897287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472937+0000","last_change":"2024-09-21T06:06:17.477968+0000","last_active":"2024-09-21T06:06:18.472937+0000","last_peered":"2024-09-21T06:06:18.472937+0000","last_clean":"2024-09-21T06:06:18.472937+0000","last_became_active":"2024-09-21T06:06:17.477650+0000","last_became_peered":"2024-09-21T06:06:17.477650+0000","last_unstale":"2024-09-21T06:06:18.472937+0000","last_undegraded":"2024-09-21T06:06:18.472937+0000","last_fullsized":"2024-09-21T06:06:18.472937+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:18.276445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471150+0000","last_change":"2024-09-21T06:06:16.445526+0000","last_active":"2024-09-21T06:06:18.471150+0000","last_peered":"2024-09-21T06:06:18.471150+0000","last_clean":"2024-09-21T06:06:18.471150+0000","last_became_active":"2024-09-21T06:06:16.445235+0000","last_became_peered":"2024-09-21T06:06:16.445235+0000","last_unstale":"2024-09-21T06:06:18.471150+0000","last_undegraded":"2024-09-21T06:06:18.471150+0000","last_fullsized":"2024-09-21T06:06:18.471150+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:28.570781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472897+0000","last_change":"2024-09-21T06:06:17.476509+0000","last_active":"2024-09-21T06:06:18.472897+0000","last_peered":"2024-09-21T06:06:18.472897+0000","last_clean":"2024-09-21T06:06:18.472897+0000","last_became_active":"2024-09-21T06:06:17.475681+0000","last_became_peered":"2024-09-21T06:06:17.475681+0000","last_unstale":"2024-09-21T06:06:18.472897+0000","last_undegraded":"2024-09-21T06:06:18.472897+0000","last_fullsized":"2024-09-21T06:06:18.472897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:50.639245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488115+0000","last_change":"2024-09-21T06:06:16.453165+0000","last_active":"2024-09-21T06:06:18.488115+0000","last_peered":"2024-09-21T06:06:18.488115+0000","last_clean":"2024-09-21T06:06:18.488115+0000","last_became_active":"2024-09-21T06:06:16.452903+0000","last_became_peered":"2024-09-21T06:06:16.452903+0000","last_unstale":"2024-09-21T06:06:18.488115+0000","last_undegraded":"2024-09-21T06:06:18.488115+0000","last_fullsized":"2024-09-21T06:06:18.488115+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:13.092465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498635+0000","last_change":"2024-09-21T06:06:17.471023+0000","last_active":"2024-09-21T06:06:18.498635+0000","last_peered":"2024-09-21T06:06:18.498635+0000","last_clean":"2024-09-21T06:06:18.498635+0000","last_became_active":"2024-09-21T06:06:17.468522+0000","last_became_peered":"2024-09-21T06:06:17.468522+0000","last_unstale":"2024-09-21T06:06:18.498635+0000","last_undegraded":"2024-09-21T06:06:18.498635+0000","last_fullsized":"2024-09-21T06:06:18.498635+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:30.084659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472780+0000","last_change":"2024-09-21T06:06:16.453466+0000","last_active":"2024-09-21T06:06:18.472780+0000","last_peered":"2024-09-21T06:06:18.472780+0000","last_clean":"2024-09-21T06:06:18.472780+0000","last_became_active":"2024-09-21T06:06:16.451422+0000","last_became_peered":"2024-09-21T06:06:16.451422+0000","last_unstale":"2024-09-21T06:06:18.472780+0000","last_undegraded":"2024-09-21T06:06:18.472780+0000","last_fullsized":"2024-09-21T06:06:18.472780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:09.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472226+0000","last_change":"2024-09-21T06:06:17.464212+0000","last_active":"2024-09-21T06:06:18.472226+0000","last_peered":"2024-09-21T06:06:18.472226+0000","last_clean":"2024-09-21T06:06:18.472226+0000","last_became_active":"2024-09-21T06:06:17.463940+0000","last_became_peered":"2024-09-21T06:06:17.463940+0000","last_unstale":"2024-09-21T06:06:18.472226+0000","last_undegraded":"2024-09-21T06:06:18.472226+0000","last_fullsized":"2024-09-21T06:06:18.472226+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:53.083219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"62'8","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473846+0000","last_change":"2024-09-21T06:06:16.451989+0000","last_active":"2024-09-21T06:06:18.473846+0000","last_peered":"2024-09-21T06:06:18.473846+0000","last_clean":"2024-09-21T06:06:18.473846+0000","last_became_active":"2024-09-21T06:06:16.451367+0000","last_became_peered":"2024-09-21T06:06:16.451367+0000","last_unstale":"2024-09-21T06:06:18.473846+0000","last_undegraded":"2024-09-21T06:06:18.473846+0000","last_fullsized":"2024-09-21T06:06:18.473846+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:20.275970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.474062+0000","last_change":"2024-09-21T06:06:17.468012+0000","last_active":"2024-09-21T06:06:18.474062+0000","last_peered":"2024-09-21T06:06:18.474062+0000","last_clean":"2024-09-21T06:06:18.474062+0000","last_became_active":"2024-09-21T06:06:17.465401+0000","last_became_peered":"2024-09-21T06:06:17.465401+0000","last_unstale":"2024-09-21T06:06:18.474062+0000","last_undegraded":"2024-09-21T06:06:18.474062+0000","last_fullsized":"2024-09-21T06:06:18.474062+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:11.927768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471438+0000","last_change":"2024-09-21T06:06:16.445511+0000","last_active":"2024-09-21T06:06:18.471438+0000","last_peered":"2024-09-21T06:06:18.471438+0000","last_clean":"2024-09-21T06:06:18.471438+0000","last_became_active":"2024-09-21T06:06:16.445208+0000","last_became_peered":"2024-09-21T06:06:16.445208+0000","last_unstale":"2024-09-21T06:06:18.471438+0000","last_undegraded":"2024-09-21T06:06:18.471438+0000","last_fullsized":"2024-09-21T06:06:18.471438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:25.786066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472146+0000","last_change":"2024-09-21T06:06:17.478371+0000","last_active":"2024-09-21T06:06:18.472146+0000","last_peered":"2024-09-21T06:06:18.472146+0000","last_clean":"2024-09-21T06:06:18.472146+0000","last_became_active":"2024-09-21T06:06:17.477514+0000","last_became_peered":"2024-09-21T06:06:17.477514+0000","last_unstale":"2024-09-21T06:06:18.472146+0000","last_undegraded":"2024-09-21T06:06:18.472146+0000","last_fullsized":"2024-09-21T06:06:18.472146+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:59.191514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486813+0000","last_change":"2024-09-21T06:06:16.457336+0000","last_active":"2024-09-21T06:06:18.486813+0000","last_peered":"2024-09-21T06:06:18.486813+0000","last_clean":"2024-09-21T06:06:18.486813+0000","last_became_active":"2024-09-21T06:06:16.457069+0000","last_became_peered":"2024-09-21T06:06:16.457069+0000","last_unstale":"2024-09-21T06:06:18.486813+0000","last_undegraded":"2024-09-21T06:06:18.486813+0000","last_fullsized":"2024-09-21T06:06:18.486813+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:03.450277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471723+0000","last_change":"2024-09-21T06:06:17.469580+0000","last_active":"2024-09-21T06:06:18.471723+0000","last_peered":"2024-09-21T06:06:18.471723+0000","last_clean":"2024-09-21T06:06:18.471723+0000","last_became_active":"2024-09-21T06:06:17.469243+0000","last_became_peered":"2024-09-21T06:06:17.469243+0000","last_unstale":"2024-09-21T06:06:18.471723+0000","last_undegraded":"2024-09-21T06:06:18.471723+0000","last_fullsized":"2024-09-21T06:06:18.471723+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:32.439912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473184+0000","last_change":"2024-09-21T06:06:16.455911+0000","last_active":"2024-09-21T06:06:18.473184+0000","last_peered":"2024-09-21T06:06:18.473184+0000","last_clean":"2024-09-21T06:06:18.473184+0000","last_became_active":"2024-09-21T06:06:16.454578+0000","last_became_peered":"2024-09-21T06:06:16.454578+0000","last_unstale":"2024-09-21T06:06:18.473184+0000","last_undegraded":"2024-09-21T06:06:18.473184+0000","last_fullsized":"2024-09-21T06:06:18.473184+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:18.538555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472724+0000","last_change":"2024-09-21T06:06:17.477775+0000","last_active":"2024-09-21T06:06:18.472724+0000","last_peered":"2024-09-21T06:06:18.472724+0000","last_clean":"2024-09-21T06:06:18.472724+0000","last_became_active":"2024-09-21T06:06:17.477108+0000","last_became_peered":"2024-09-21T06:06:17.477108+0000","last_unstale":"2024-09-21T06:06:18.472724+0000","last_undegraded":"2024-09-21T06:06:18.472724+0000","last_fullsized":"2024-09-21T06:06:18.472724+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:10.928444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486756+0000","last_change":"2024-09-21T06:06:16.455154+0000","last_active":"2024-09-21T06:06:18.486756+0000","last_peered":"2024-09-21T06:06:18.486756+0000","last_clean":"2024-09-21T06:06:18.486756+0000","last_became_active":"2024-09-21T06:06:16.454769+0000","last_became_peered":"2024-09-21T06:06:16.454769+0000","last_unstale":"2024-09-21T06:06:18.486756+0000","last_undegraded":"2024-09-21T06:06:18.486756+0000","last_fullsized":"2024-09-21T06:06:18.486756+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:43.965340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472472+0000","last_change":"2024-09-21T06:06:17.477775+0000","last_active":"2024-09-21T06:06:18.472472+0000","last_peered":"2024-09-21T06:06:18.472472+0000","last_clean":"2024-09-21T06:06:18.472472+0000","last_became_active":"2024-09-21T06:06:17.477166+0000","last_became_peered":"2024-09-21T06:06:17.477166+0000","last_unstale":"2024-09-21T06:06:18.472472+0000","last_undegraded":"2024-09-21T06:06:18.472472+0000","last_fullsized":"2024-09-21T06:06:18.472472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:24.022782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471601+0000","last_change":"2024-09-21T06:06:16.451546+0000","last_active":"2024-09-21T06:06:18.471601+0000","last_peered":"2024-09-21T06:06:18.471601+0000","last_clean":"2024-09-21T06:06:18.471601+0000","last_became_active":"2024-09-21T06:06:16.451092+0000","last_became_peered":"2024-09-21T06:06:16.451092+0000","last_unstale":"2024-09-21T06:06:18.471601+0000","last_undegraded":"2024-09-21T06:06:18.471601+0000","last_fullsized":"2024-09-21T06:06:18.471601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:02.982320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486337+0000","last_change":"2024-09-21T06:06:17.481862+0000","last_active":"2024-09-21T06:06:18.486337+0000","last_peered":"2024-09-21T06:06:18.486337+0000","last_clean":"2024-09-21T06:06:18.486337+0000","last_became_active":"2024-09-21T06:06:17.481282+0000","last_became_peered":"2024-09-21T06:06:17.481282+0000","last_unstale":"2024-09-21T06:06:18.486337+0000","last_undegraded":"2024-09-21T06:06:18.486337+0000","last_fullsized":"2024-09-21T06:06:18.486337+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:19.839382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499356+0000","last_change":"2024-09-21T06:06:16.447820+0000","last_active":"2024-09-21T06:06:18.499356+0000","last_peered":"2024-09-21T06:06:18.499356+0000","last_clean":"2024-09-21T06:06:18.499356+0000","last_became_active":"2024-09-21T06:06:16.447400+0000","last_became_peered":"2024-09-21T06:06:16.447400+0000","last_unstale":"2024-09-21T06:06:18.499356+0000","last_undegraded":"2024-09-21T06:06:18.499356+0000","last_fullsized":"2024-09-21T06:06:18.499356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:32.851303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486618+0000","last_change":"2024-09-21T06:06:17.483219+0000","last_active":"2024-09-21T06:06:18.486618+0000","last_peered":"2024-09-21T06:06:18.486618+0000","last_clean":"2024-09-21T06:06:18.486618+0000","last_became_active":"2024-09-21T06:06:17.482891+0000","last_became_peered":"2024-09-21T06:06:17.482891+0000","last_unstale":"2024-09-21T06:06:18.486618+0000","last_undegraded":"2024-09-21T06:06:18.486618+0000","last_fullsized":"2024-09-21T06:06:18.486618+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:15.509344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473299+0000","last_change":"2024-09-21T06:06:16.455475+0000","last_active":"2024-09-21T06:06:18.473299+0000","last_peered":"2024-09-21T06:06:18.473299+0000","last_clean":"2024-09-21T06:06:18.473299+0000","last_became_active":"2024-09-21T06:06:16.454191+0000","last_became_peered":"2024-09-21T06:06:16.454191+0000","last_unstale":"2024-09-21T06:06:18.473299+0000","last_undegraded":"2024-09-21T06:06:18.473299+0000","last_fullsized":"2024-09-21T06:06:18.473299+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:52.013564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472197+0000","last_change":"2024-09-21T06:06:17.470477+0000","last_active":"2024-09-21T06:06:18.472197+0000","last_peered":"2024-09-21T06:06:18.472197+0000","last_clean":"2024-09-21T06:06:18.472197+0000","last_became_active":"2024-09-21T06:06:17.470197+0000","last_became_peered":"2024-09-21T06:06:17.470197+0000","last_unstale":"2024-09-21T06:06:18.472197+0000","last_undegraded":"2024-09-21T06:06:18.472197+0000","last_fullsized":"2024-09-21T06:06:18.472197+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:00.885408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499010+0000","last_change":"2024-09-21T06:06:16.453086+0000","last_active":"2024-09-21T06:06:18.499010+0000","last_peered":"2024-09-21T06:06:18.499010+0000","last_clean":"2024-09-21T06:06:18.499010+0000","last_became_active":"2024-09-21T06:06:16.452835+0000","last_became_peered":"2024-09-21T06:06:16.452835+0000","last_unstale":"2024-09-21T06:06:18.499010+0000","last_undegraded":"2024-09-21T06:06:18.499010+0000","last_fullsized":"2024-09-21T06:06:18.499010+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.456020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472664+0000","last_change":"2024-09-21T06:06:17.470610+0000","last_active":"2024-09-21T06:06:18.472664+0000","last_peered":"2024-09-21T06:06:18.472664+0000","last_clean":"2024-09-21T06:06:18.472664+0000","last_became_active":"2024-09-21T06:06:17.470224+0000","last_became_peered":"2024-09-21T06:06:17.470224+0000","last_unstale":"2024-09-21T06:06:18.472664+0000","last_undegraded":"2024-09-21T06:06:18.472664+0000","last_fullsized":"2024-09-21T06:06:18.472664+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:24.014467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"63'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488271+0000","last_change":"2024-09-21T06:06:16.458137+0000","last_active":"2024-09-21T06:06:18.488271+0000","last_peered":"2024-09-21T06:06:18.488271+0000","last_clean":"2024-09-21T06:06:18.488271+0000","last_became_active":"2024-09-21T06:06:16.457453+0000","last_became_peered":"2024-09-21T06:06:16.457453+0000","last_unstale":"2024-09-21T06:06:18.488271+0000","last_undegraded":"2024-09-21T06:06:18.488271+0000","last_fullsized":"2024-09-21T06:06:18.488271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:31.210119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499147+0000","last_change":"2024-09-21T06:06:17.478164+0000","last_active":"2024-09-21T06:06:18.499147+0000","last_peered":"2024-09-21T06:06:18.499147+0000","last_clean":"2024-09-21T06:06:18.499147+0000","last_became_active":"2024-09-21T06:06:17.477927+0000","last_became_peered":"2024-09-21T06:06:17.477927+0000","last_unstale":"2024-09-21T06:06:18.499147+0000","last_undegraded":"2024-09-21T06:06:18.499147+0000","last_fullsized":"2024-09-21T06:06:18.499147+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:01.232770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488376+0000","last_change":"2024-09-21T06:06:16.454251+0000","last_active":"2024-09-21T06:06:18.488376+0000","last_peered":"2024-09-21T06:06:18.488376+0000","last_clean":"2024-09-21T06:06:18.488376+0000","last_became_active":"2024-09-21T06:06:16.453659+0000","last_became_peered":"2024-09-21T06:06:16.453659+0000","last_unstale":"2024-09-21T06:06:18.488376+0000","last_undegraded":"2024-09-21T06:06:18.488376+0000","last_fullsized":"2024-09-21T06:06:18.488376+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:49.254156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.486522+0000","last_change":"2024-09-21T06:06:17.484067+0000","last_active":"2024-09-21T06:06:18.486522+0000","last_peered":"2024-09-21T06:06:18.486522+0000","last_clean":"2024-09-21T06:06:18.486522+0000","last_became_active":"2024-09-21T06:06:17.483554+0000","last_became_peered":"2024-09-21T06:06:17.483554+0000","last_unstale":"2024-09-21T06:06:18.486522+0000","last_undegraded":"2024-09-21T06:06:18.486522+0000","last_fullsized":"2024-09-21T06:06:18.486522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:53.201183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.473428+0000","last_change":"2024-09-21T06:06:16.450795+0000","last_active":"2024-09-21T06:06:18.473428+0000","last_peered":"2024-09-21T06:06:18.473428+0000","last_clean":"2024-09-21T06:06:18.473428+0000","last_became_active":"2024-09-21T06:06:16.450456+0000","last_became_peered":"2024-09-21T06:06:16.450456+0000","last_unstale":"2024-09-21T06:06:18.473428+0000","last_undegraded":"2024-09-21T06:06:18.473428+0000","last_fullsized":"2024-09-21T06:06:18.473428+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:45.366777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471943+0000","last_change":"2024-09-21T06:06:17.477028+0000","last_active":"2024-09-21T06:06:18.471943+0000","last_peered":"2024-09-21T06:06:18.471943+0000","last_clean":"2024-09-21T06:06:18.471943+0000","last_became_active":"2024-09-21T06:06:17.473187+0000","last_became_peered":"2024-09-21T06:06:17.473187+0000","last_unstale":"2024-09-21T06:06:18.471943+0000","last_undegraded":"2024-09-21T06:06:18.471943+0000","last_fullsized":"2024-09-21T06:06:18.471943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:14.212729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499254+0000","last_change":"2024-09-21T06:06:16.450729+0000","last_active":"2024-09-21T06:06:18.499254+0000","last_peered":"2024-09-21T06:06:18.499254+0000","last_clean":"2024-09-21T06:06:18.499254+0000","last_became_active":"2024-09-21T06:06:16.450465+0000","last_became_peered":"2024-09-21T06:06:16.450465+0000","last_unstale":"2024-09-21T06:06:18.499254+0000","last_undegraded":"2024-09-21T06:06:18.499254+0000","last_fullsized":"2024-09-21T06:06:18.499254+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:34.434655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.472942+0000","last_change":"2024-09-21T06:06:17.465763+0000","last_active":"2024-09-21T06:06:18.472942+0000","last_peered":"2024-09-21T06:06:18.472942+0000","last_clean":"2024-09-21T06:06:18.472942+0000","last_became_active":"2024-09-21T06:06:17.465473+0000","last_became_peered":"2024-09-21T06:06:17.465473+0000","last_unstale":"2024-09-21T06:06:18.472942+0000","last_undegraded":"2024-09-21T06:06:18.472942+0000","last_fullsized":"2024-09-21T06:06:18.472942+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:07.460938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.498842+0000","last_change":"2024-09-21T06:06:16.454328+0000","last_active":"2024-09-21T06:06:18.498842+0000","last_peered":"2024-09-21T06:06:18.498842+0000","last_clean":"2024-09-21T06:06:18.498842+0000","last_became_active":"2024-09-21T06:06:16.454038+0000","last_became_peered":"2024-09-21T06:06:16.454038+0000","last_unstale":"2024-09-21T06:06:18.498842+0000","last_undegraded":"2024-09-21T06:06:18.498842+0000","last_fullsized":"2024-09-21T06:06:18.498842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:54.918022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499249+0000","last_change":"2024-09-21T06:06:17.475979+0000","last_active":"2024-09-21T06:06:18.499249+0000","last_peered":"2024-09-21T06:06:18.499249+0000","last_clean":"2024-09-21T06:06:18.499249+0000","last_became_active":"2024-09-21T06:06:17.475716+0000","last_became_peered":"2024-09-21T06:06:17.475716+0000","last_unstale":"2024-09-21T06:06:18.499249+0000","last_undegraded":"2024-09-21T06:06:18.499249+0000","last_fullsized":"2024-09-21T06:06:18.499249+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:18.153238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.499228+0000","last_change":"2024-09-21T06:06:16.457402+0000","last_active":"2024-09-21T06:06:18.499228+0000","last_peered":"2024-09-21T06:06:18.499228+0000","last_clean":"2024-09-21T06:06:18.499228+0000","last_became_active":"2024-09-21T06:06:16.457138+0000","last_became_peered":"2024-09-21T06:06:16.457138+0000","last_unstale":"2024-09-21T06:06:18.499228+0000","last_undegraded":"2024-09-21T06:06:18.499228+0000","last_fullsized":"2024-09-21T06:06:18.499228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:14.820746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471458+0000","last_change":"2024-09-21T06:06:17.472767+0000","last_active":"2024-09-21T06:06:18.471458+0000","last_peered":"2024-09-21T06:06:18.471458+0000","last_clean":"2024-09-21T06:06:18.471458+0000","last_became_active":"2024-09-21T06:06:17.472549+0000","last_became_peered":"2024-09-21T06:06:17.472549+0000","last_unstale":"2024-09-21T06:06:18.471458+0000","last_undegraded":"2024-09-21T06:06:18.471458+0000","last_fullsized":"2024-09-21T06:06:18.471458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:15.379861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471544+0000","last_change":"2024-09-21T06:06:16.453128+0000","last_active":"2024-09-21T06:06:18.471544+0000","last_peered":"2024-09-21T06:06:18.471544+0000","last_clean":"2024-09-21T06:06:18.471544+0000","last_became_active":"2024-09-21T06:06:16.452659+0000","last_became_peered":"2024-09-21T06:06:16.452659+0000","last_unstale":"2024-09-21T06:06:18.471544+0000","last_undegraded":"2024-09-21T06:06:18.471544+0000","last_fullsized":"2024-09-21T06:06:18.471544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:06.888234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471203+0000","last_change":"2024-09-21T06:06:17.484115+0000","last_active":"2024-09-21T06:06:18.471203+0000","last_peered":"2024-09-21T06:06:18.471203+0000","last_clean":"2024-09-21T06:06:18.471203+0000","last_became_active":"2024-09-21T06:06:17.483716+0000","last_became_peered":"2024-09-21T06:06:17.483716+0000","last_unstale":"2024-09-21T06:06:18.471203+0000","last_undegraded":"2024-09-21T06:06:18.471203+0000","last_fullsized":"2024-09-21T06:06:18.471203+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:16.435794+0000","last_clean_scrub_stamp":"2024-09-21T06:06:16.435794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:34.770359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.488457+0000","last_change":"2024-09-21T06:06:16.452257+0000","last_active":"2024-09-21T06:06:18.488457+0000","last_peered":"2024-09-21T06:06:18.488457+0000","last_clean":"2024-09-21T06:06:18.488457+0000","last_became_active":"2024-09-21T06:06:16.450812+0000","last_became_peered":"2024-09-21T06:06:16.450812+0000","last_unstale":"2024-09-21T06:06:18.488457+0000","last_undegraded":"2024-09-21T06:06:18.488457+0000","last_fullsized":"2024-09-21T06:06:18.488457+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:06:15.425663+0000","last_clean_scrub_stamp":"2024-09-21T06:06:15.425663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:04.069268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":198,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-21T06:06:18.471780+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:06:18.471780+0000","last_peered":"2024-09-21T06:06:18.471780+0000","last_clean":"2024-09-21T06:06:18.471780+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:06:18.471780+0000","last_undegraded":"2024-09-21T06:06:18.471780+0000","last_fullsized":"2024-09-21T06:06:18.471780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:48.572395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":314,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194997,"statfs":{"total":200000000,"available":199677500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194418,"statfs":{"total":200000000,"available":199084994,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":885,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194427,"statfs":{"total":200000000,"available":199093328,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683856,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683204,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":310,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195002,"statfs":{"total":200000000,"available":199682244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":314,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194997,"statfs":{"total":200000000,"available":199677500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:06:22.376 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:06:22.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 -- 172.21.15.118:0/1795192006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480d1590 msgr2=0x7f7848142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 --2- 172.21.15.118:0/1795192006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480d1590 0x7f7848142730 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7834009830 tx=0x7f783402a510 comp rx=0 tx=0).stop 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 -- 172.21.15.118:0/1795192006 shutdown_connections 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 --2- 172.21.15.118:0/1795192006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784813fef0 0x7f7848142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 --2- 172.21.15.118:0/1795192006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480d1590 0x7f7848142730 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 -- 172.21.15.118:0/1795192006 >> 172.21.15.118:0/1795192006 conn(0x7f784806d110 msgr2=0x7f784806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 -- 172.21.15.118:0/1795192006 shutdown_connections 2024-09-21T06:06:22.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.645+0000 7f784f400640 1 -- 172.21.15.118:0/1795192006 wait complete. 2024-09-21T06:06:22.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.647+0000 7f784f400640 1 Processor -- start 2024-09-21T06:06:22.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.647+0000 7f784f400640 1 -- start start 2024-09-21T06:06:22.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784813fae0 0x7f78481f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784813fef0 0x7f78480b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480b5690 0x7f784813ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f78480cfac0 con 0x7f78480b5690 2024-09-21T06:06:22.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f78480cf940 con 0x7f784813fef0 2024-09-21T06:06:22.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f78480cfc40 con 0x7f784813fae0 2024-09-21T06:06:22.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480b5690 0x7f784813ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480b5690 0x7f784813ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53376/0 (socket says 172.21.15.118:53376) 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784d400640 1 -- 172.21.15.118:0/2733121422 learned_addr learned my addr 172.21.15.118:0/2733121422 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f784ca00640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784813fae0 0x7f78481f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.649+0000 7f7847e00640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784813fef0 0x7f78480b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784d400640 1 -- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784813fae0 msgr2=0x7f78481f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784d400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784813fae0 0x7f78481f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784d400640 1 -- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784813fef0 msgr2=0x7f78480b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784d400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784813fef0 0x7f78480b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784d400640 1 -- 172.21.15.118:0/2733121422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7848074b10 con 0x7f78480b5690 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f7847e00640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784813fef0 0x7f78480b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784ca00640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784813fae0 0x7f78481f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:22.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784d400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480b5690 0x7f784813ad60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f784000ea40 tx=0x7f784000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:22.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f7844c00640 1 -- 172.21.15.118:0/2733121422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784000cde0 con 0x7f78480b5690 2024-09-21T06:06:22.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f7844c00640 1 -- 172.21.15.118:0/2733121422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7840004b20 con 0x7f78480b5690 2024-09-21T06:06:22.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f7844c00640 1 -- 172.21.15.118:0/2733121422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840005020 con 0x7f78480b5690 2024-09-21T06:06:22.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7848153520 con 0x7f78480b5690 2024-09-21T06:06:22.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.650+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78481f9460 con 0x7f78480b5690 2024-09-21T06:06:22.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.651+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78481f9290 con 0x7f78480b5690 2024-09-21T06:06:22.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.653+0000 7f7844c00640 1 -- 172.21.15.118:0/2733121422 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78400051c0 con 0x7f78480b5690 2024-09-21T06:06:22.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.654+0000 7f7844c00640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:22.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.654+0000 7f7844c00640 1 -- 172.21.15.118:0/2733121422 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f784009bb50 con 0x7f78480b5690 2024-09-21T06:06:22.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.654+0000 7f784ca00640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:22.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.655+0000 7f784ca00640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f783c007a50 tx=0x7f783c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:22.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.658+0000 7f7844c00640 1 -- 172.21.15.118:0/2733121422 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7840064010 con 0x7f78480b5690 2024-09-21T06:06:22.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.913+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f78480b4ab0 con 0x7f78480b5690 2024-09-21T06:06:22.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.916+0000 7f7844c00640 1 -- 172.21.15.118:0/2733121422 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f7840063910 con 0x7f78480b5690 2024-09-21T06:06:22.918 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:06:22.918 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:06:22.918 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:06:22.918 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:06:22.918 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:06:22.918 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:06:22.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 msgr2=0x7f782807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f783c007a50 tx=0x7f783c009040 comp rx=0 tx=0).stop 2024-09-21T06:06:22.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480b5690 msgr2=0x7f784813ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480b5690 0x7f784813ad60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f784000ea40 tx=0x7f784000ef00 comp rx=0 tx=0).stop 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 shutdown_connections 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480b5690 0x7f784813ad60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784813fef0 0x7f78480b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7828078b90 0x7f782807b0a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 --2- 172.21.15.118:0/2733121422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f784813fae0 0x7f78481f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 >> 172.21.15.118:0/2733121422 conn(0x7f784806d110 msgr2=0x7f78480d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 shutdown_connections 2024-09-21T06:06:22.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:22.919+0000 7f784f400640 1 -- 172.21.15.118:0/2733121422 wait complete. 2024-09-21T06:06:22.942 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 -- 172.21.15.118:0/2177598218 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad413fd80 msgr2=0x7f7ad415dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 --2- 172.21.15.118:0/2177598218 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad413fd80 0x7f7ad415dc40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009830 tx=0x7f7ac402a480 comp rx=0 tx=0).stop 2024-09-21T06:06:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 -- 172.21.15.118:0/2177598218 shutdown_connections 2024-09-21T06:06:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 --2- 172.21.15.118:0/2177598218 >> v2:172.21.15.149:3300/0 conn(0x7f7ad40d0ea0 0x7f7ad40d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 --2- 172.21.15.118:0/2177598218 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad413fd80 0x7f7ad415dc40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 -- 172.21.15.118:0/2177598218 >> 172.21.15.118:0/2177598218 conn(0x7f7ad406d110 msgr2=0x7f7ad406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:23.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 -- 172.21.15.118:0/2177598218 shutdown_connections 2024-09-21T06:06:23.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.157+0000 7f7ada000640 1 -- 172.21.15.118:0/2177598218 wait complete. 2024-09-21T06:06:23.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.159+0000 7f7ada000640 1 Processor -- start 2024-09-21T06:06:23.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.159+0000 7f7ada000640 1 -- start start 2024-09-21T06:06:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ada000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad40d0ea0 0x7f7ad413a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ada000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad413fd80 0x7f7ad415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ada000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad4160b20 0x7f7ad415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ada000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad415e300 con 0x7f7ad4160b20 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ada000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad415e180 con 0x7f7ad413fd80 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ada000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad415d680 con 0x7f7ad40d0ea0 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ad3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad4160b20 0x7f7ad415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ad3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad4160b20 0x7f7ad415c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53388/0 (socket says 172.21.15.118:53388) 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ad3e00640 1 -- 172.21.15.118:0/1667594640 learned_addr learned my addr 172.21.15.118:0/1667594640 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ad2a00640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad413fd80 0x7f7ad415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ad3400640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad40d0ea0 0x7f7ad413a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.161+0000 7f7ad3e00640 1 -- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad40d0ea0 msgr2=0x7f7ad413a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7ad3e00640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad40d0ea0 0x7f7ad413a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7ad3e00640 1 -- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad413fd80 msgr2=0x7f7ad415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7ad3e00640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad413fd80 0x7f7ad415bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7ad3e00640 1 -- 172.21.15.118:0/1667594640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad41f9660 con 0x7f7ad4160b20 2024-09-21T06:06:23.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7ad3e00640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad4160b20 0x7f7ad415c4b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00caa0 tx=0x7f7acc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:23.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7acb400640 1 -- 172.21.15.118:0/1667594640 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc016020 con 0x7f7ad4160b20 2024-09-21T06:06:23.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7acb400640 1 -- 172.21.15.118:0/1667594640 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7acc00acf0 con 0x7f7ad4160b20 2024-09-21T06:06:23.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad41f9900 con 0x7f7ad4160b20 2024-09-21T06:06:23.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7acb400640 1 -- 172.21.15.118:0/1667594640 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc012680 con 0x7f7ad4160b20 2024-09-21T06:06:23.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.162+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad41f9ec0 con 0x7f7ad4160b20 2024-09-21T06:06:23.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.163+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad41616d0 con 0x7f7ad4160b20 2024-09-21T06:06:23.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.164+0000 7f7acb400640 1 -- 172.21.15.118:0/1667594640 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7acc019020 con 0x7f7ad4160b20 2024-09-21T06:06:23.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.165+0000 7f7acb400640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ab4078bc0 0x7f7ab407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.165+0000 7f7acb400640 1 -- 172.21.15.118:0/1667594640 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f7acc09b1d0 con 0x7f7ad4160b20 2024-09-21T06:06:23.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.166+0000 7f7ad3400640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ab4078bc0 0x7f7ab407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:23.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.166+0000 7f7ad3400640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ab4078bc0 0x7f7ab407b0d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4034000 tx=0x7f7ac4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:23.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.170+0000 7f7acb400640 1 -- 172.21.15.118:0/1667594640 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7acc020020 con 0x7f7ad4160b20 2024-09-21T06:06:23.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.391+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ad4161110 con 0x7f7ad4160b20 2024-09-21T06:06:23.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.392+0000 7f7acb400640 1 -- 172.21.15.118:0/1667594640 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7f7ad40d17f0 con 0x7f7ad4160b20 2024-09-21T06:06:23.395 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:23.395 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T06:06:20:487542+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:06:16.940252+0000","modified":"2024-09-21T06:06:19.973048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2029341341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2029341341},{"type":"v1","addr":"172.21.15.118:6835","nonce":2029341341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T06:06:23.395 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ab4078bc0 msgr2=0x7f7ab407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ab4078bc0 0x7f7ab407b0d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4034000 tx=0x7f7ac4004730 comp rx=0 tx=0).stop 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad4160b20 msgr2=0x7f7ad415c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad4160b20 0x7f7ad415c4b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00caa0 tx=0x7f7acc00cf60 comp rx=0 tx=0).stop 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 shutdown_connections 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad4160b20 0x7f7ad415c4b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad413fd80 0x7f7ad415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7ab4078bc0 0x7f7ab407b0d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 --2- 172.21.15.118:0/1667594640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad40d0ea0 0x7f7ad413a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 >> 172.21.15.118:0/1667594640 conn(0x7f7ad406d110 msgr2=0x7f7ad413c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:23.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.394+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 shutdown_connections 2024-09-21T06:06:23.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:23.395+0000 7f7ada000640 1 -- 172.21.15.118:0/1667594640 wait complete. 2024-09-21T06:06:23.825 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:06:16.940252+0000', 'modified': '2024-09-21T06:06:19.973048+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5643}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5643': {'gid': 5643, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/2029341341', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 2029341341}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 2029341341}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5643, 'qdb_cluster': [5643]} 2024-09-21T06:06:23.825 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:06:23.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 -- 172.21.15.118:0/2447229549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fae0 msgr2=0x7fa0640d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 --2- 172.21.15.118:0/2447229549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fae0 0x7fa0640d0e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa058005fd0 tx=0x7fa05802a540 comp rx=0 tx=0).stop 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 -- 172.21.15.118:0/2447229549 shutdown_connections 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 --2- 172.21.15.118:0/2447229549 >> v2:172.21.15.149:3300/0 conn(0x7fa064142e40 0x7fa0640d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 --2- 172.21.15.118:0/2447229549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fae0 0x7fa0640d0e80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 -- 172.21.15.118:0/2447229549 >> 172.21.15.118:0/2447229549 conn(0x7fa06406d110 msgr2=0x7fa06406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 -- 172.21.15.118:0/2447229549 shutdown_connections 2024-09-21T06:06:24.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.044+0000 7fa06be00640 1 -- 172.21.15.118:0/2447229549 wait complete. 2024-09-21T06:06:24.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.046+0000 7fa06be00640 1 Processor -- start 2024-09-21T06:06:24.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.046+0000 7fa06be00640 1 -- start start 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa06be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa06413fae0 0x7fa0640741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa06be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fef0 0x7fa0641562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa06be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa064142e40 0x7fa064158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa06be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa0640cfac0 con 0x7fa064142e40 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa06be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa0640cf940 con 0x7fa06413fae0 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa06be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa0640cfc40 con 0x7fa06413fef0 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa069e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa064142e40 0x7fa064158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa069e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa064142e40 0x7fa064158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53396/0 (socket says 172.21.15.118:53396) 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa069e00640 1 -- 172.21.15.118:0/1220014678 learned_addr learned my addr 172.21.15.118:0/1220014678 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa069400640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa06413fae0 0x7fa0640741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.048+0000 7fa068a00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fef0 0x7fa0641562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa069e00640 1 -- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fef0 msgr2=0x7fa0641562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa069e00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fef0 0x7fa0641562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa069e00640 1 -- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa06413fae0 msgr2=0x7fa0640741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa069e00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa06413fae0 0x7fa0640741e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa069e00640 1 -- 172.21.15.118:0/1220014678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa064156810 con 0x7fa064142e40 2024-09-21T06:06:24.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa069e00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa064142e40 0x7fa064158580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00ea40 tx=0x7fa05c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa061600640 1 -- 172.21.15.118:0/1220014678 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00cde0 con 0x7fa064142e40 2024-09-21T06:06:24.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa061600640 1 -- 172.21.15.118:0/1220014678 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa05c004c10 con 0x7fa064142e40 2024-09-21T06:06:24.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa061600640 1 -- 172.21.15.118:0/1220014678 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c005020 con 0x7fa064142e40 2024-09-21T06:06:24.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa064072cd0 con 0x7fa064142e40 2024-09-21T06:06:24.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.049+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa064073420 con 0x7fa064142e40 2024-09-21T06:06:24.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.052+0000 7fa061600640 1 -- 172.21.15.118:0/1220014678 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa05c0051c0 con 0x7fa064142e40 2024-09-21T06:06:24.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.053+0000 7fa061600640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa044078b90 0x7fa04407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.053+0000 7fa061600640 1 -- 172.21.15.118:0/1220014678 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7fa05c09ba50 con 0x7fa064142e40 2024-09-21T06:06:24.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.053+0000 7fa072ebf740 1 Processor -- start 2024-09-21T06:06:24.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.053+0000 7fa072ebf740 1 -- start start 2024-09-21T06:06:24.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.053+0000 7fa069400640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa044078b90 0x7fa04407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.054+0000 7fa069400640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa044078b90 0x7fa04407b0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa058033000 tx=0x7fa058004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac852970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac852eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac822f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa072ebf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x561fac7ac430 con 0x561fac482270 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561fac79c5d0 con 0x561fac461590 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x561fac78ba00 con 0x561fac4593b0 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac852970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac852970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53400/0 (socket says 172.21.15.118:53400) 2024-09-21T06:06:24.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 -- 172.21.15.118:0/1308869242 learned_addr learned my addr 172.21.15.118:0/1308869242 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa068a00640 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac852eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069e00640 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac822f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 -- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 msgr2=0x561fac852eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac852eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 -- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 msgr2=0x561fac822f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac822f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069400640 1 -- 172.21.15.118:0/1308869242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fac754520 con 0x561fac482270 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.055+0000 7fa069e00640 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac822f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:24.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.056+0000 7fa069400640 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac852970 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa058006010 tx=0x7fa05803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c655ed33cd3b4751 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.056+0000 7fa055c00640 1 -- 172.21.15.118:0/1308869242 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058035040 con 0x561fac482270 2024-09-21T06:06:24.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.056+0000 7fa055c00640 1 -- 172.21.15.118:0/1308869242 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa05804d070 con 0x561fac482270 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.056+0000 7fa055c00640 1 -- 172.21.15.118:0/1308869242 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058003940 con 0x561fac482270 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 -- 172.21.15.118:0/1308869242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 msgr2=0x561fac852970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac852970 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa058006010 tx=0x7fa05803d000 comp rx=0 tx=0).stop 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 -- 172.21.15.118:0/1308869242 shutdown_connections 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac822f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac852eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1308869242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac852970 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 -- 172.21.15.118:0/1308869242 >> 172.21.15.118:0/1308869242 conn(0x561fac4763c0 msgr2=0x561fac828970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 -- 172.21.15.118:0/1308869242 shutdown_connections 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.057+0000 7fa072ebf740 1 -- 172.21.15.118:0/1308869242 wait complete. 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.058+0000 7fa072ebf740 1 -- start start 2024-09-21T06:06:24.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.058+0000 7fa072ebf740 1 Processor -- start 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac848250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac84c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac84cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa072ebf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x561fac732330 con 0x561fac482270 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561fac78f810 con 0x561fac461590 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x561fac4fc620 con 0x561fac4593b0 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa072ebf740 10 client.0 _ll_register_callbacks cb 0x561fac737420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac84cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac84cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53416/0 (socket says 172.21.15.118:53416) 2024-09-21T06:06:24.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 -- 172.21.15.118:0/1624626560 learned_addr learned my addr 172.21.15.118:0/1624626560 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069400640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac848250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa068a00640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac84c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 -- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 msgr2=0x561fac848250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac848250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 -- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 msgr2=0x561fac84c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac84c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa069e00640 1 -- 172.21.15.118:0/1624626560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fac4ed850 con 0x561fac482270 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.060+0000 7fa068a00640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac84c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa069e00640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac84cca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c760 tx=0x7fa05c063dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7bf3c67f94c160 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa04a000640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa04a000640 1 -- 172.21.15.118:0/1624626560 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c063340 con 0x561fac482270 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa04a000640 1 -- 172.21.15.118:0/1624626560 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7fa05c064ab0 con 0x561fac482270 2024-09-21T06:06:24.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05804d070 con 0x561fac482270 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa04a000640 1 -- 172.21.15.118:0/1624626560 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa05c063830 con 0x561fac482270 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 10 client.5742 fetch_fsmap learned FSMap version 34 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x561fac5646b0 con 0x561fac482270 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa04a000640 1 -- 172.21.15.118:0/1624626560 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa05804d070 con 0x561fac482270 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa04a000640 1 -- 172.21.15.118:0/1624626560 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7fa05c020030 con 0x561fac482270 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 10 client.5742 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 10 client.5742 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 20 client.5742 populate_metadata read hostname 'smithi118' 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac440e40 0x561fac880760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 4 client.5742 mds_command: new command op to 5643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.061+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 --> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fac79e520 con 0x561fac440e40 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.062+0000 7fa069400640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac440e40 0x561fac880760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.062+0000 7fa069400640 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac440e40 0x561fac880760 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c77b27abaf1572 server_cookie=4ea5d7dc99679282 in_seq=0 out_seq=0 2024-09-21T06:06:24.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.062+0000 7fa04a000640 10 client.5742 ms_handle_connect on v2:172.21.15.118:6834/2029341341 2024-09-21T06:06:24.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.063+0000 7fa04a000640 1 -- 172.21.15.118:0/1624626560 <== mds.0 v2:172.21.15.118:6834/2029341341 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561fac79e520 con 0x561fac440e40 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.063+0000 7fa04a000640 10 client.5742 handle_command_reply: tid=0 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.063+0000 7fa072ebf740 1 client.5742 shutdown 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.063+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 msgr2=0x561fac84cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.063+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac84cca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c760 tx=0x7fa05c063dd0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 shutdown_connections 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac440e40 0x561fac880760 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac84cca0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac84c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 --2- 172.21.15.118:0/1624626560 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac848250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa04a000640 0 client.5742 ms_handle_reset on v2:172.21.15.118:6834/2029341341 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 >> 172.21.15.118:0/1624626560 conn(0x561fac4763c0 msgr2=0x561fac852970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 shutdown_connections 2024-09-21T06:06:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 1 -- 172.21.15.118:0/1624626560 wait complete. 2024-09-21T06:06:24.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.064+0000 7fa072ebf740 20 client.5742 trim_cache size 0 max 16384 2024-09-21T06:06:24.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.083+0000 7fa072ebf740 1 Processor -- start 2024-09-21T06:06:24.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.083+0000 7fa072ebf740 1 -- start start 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac8670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac867630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac890a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa072ebf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa064201610 con 0x561fac482270 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa06413df10 con 0x561fac461590 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa0641f66f0 con 0x561fac4593b0 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa069e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac890a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa069e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac890a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53430/0 (socket says 172.21.15.118:53430) 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.084+0000 7fa069e00640 1 -- 172.21.15.118:0/2251835284 learned_addr learned my addr 172.21.15.118:0/2251835284 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa068a00640 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac867630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa069400640 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac8670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa069e00640 1 -- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 msgr2=0x561fac8670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa069e00640 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac8670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa069e00640 1 -- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 msgr2=0x561fac867630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa069e00640 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac867630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa069e00640 1 -- 172.21.15.118:0/2251835284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fac829650 con 0x561fac482270 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa069e00640 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac890a90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa05c063530 tx=0x7fa05c05f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2528e58aab8295e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa055200640 1 -- 172.21.15.118:0/2251835284 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c06d110 con 0x561fac482270 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa055200640 1 -- 172.21.15.118:0/2251835284 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa05c089070 con 0x561fac482270 2024-09-21T06:06:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.085+0000 7fa055200640 1 -- 172.21.15.118:0/2251835284 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c062500 con 0x561fac482270 2024-09-21T06:06:24.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 -- 172.21.15.118:0/2251835284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 msgr2=0x561fac890a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac890a90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa05c063530 tx=0x7fa05c05f6d0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 -- 172.21.15.118:0/2251835284 shutdown_connections 2024-09-21T06:06:24.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac482270 0x561fac890a90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac461590 0x561fac867630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 --2- 172.21.15.118:0/2251835284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac4593b0 0x561fac8670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 -- 172.21.15.118:0/2251835284 >> 172.21.15.118:0/2251835284 conn(0x561fac4763c0 msgr2=0x561fac847e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 -- 172.21.15.118:0/2251835284 shutdown_connections 2024-09-21T06:06:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.086+0000 7fa072ebf740 1 -- 172.21.15.118:0/2251835284 wait complete. 2024-09-21T06:06:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.087+0000 7fa072ebf740 1 -- start start 2024-09-21T06:06:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.087+0000 7fa072ebf740 1 Processor -- start 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac4593b0 0x561fac865490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac461590 0x561fac8670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa072ebf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac482270 0x561fac867610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa072ebf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x561fac848830 con 0x561fac4593b0 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561fac87dc00 con 0x561fac482270 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa072ebf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x561fac84b220 con 0x561fac461590 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa072ebf740 10 client.0 _ll_register_callbacks cb 0x7fa05c063180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac4593b0 0x561fac865490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac4593b0 0x561fac865490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53440/0 (socket says 172.21.15.118:53440) 2024-09-21T06:06:24.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 -- 172.21.15.118:0/16593386 learned_addr learned my addr 172.21.15.118:0/16593386 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa068a00640 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac461590 0x561fac8670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069e00640 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac482270 0x561fac867610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 -- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac461590 msgr2=0x561fac8670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac461590 0x561fac8670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 -- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac482270 msgr2=0x561fac867610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac482270 0x561fac867610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.089+0000 7fa069400640 1 -- 172.21.15.118:0/16593386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fac8801f0 con 0x561fac4593b0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa069400640 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac4593b0 0x561fac865490 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa0580099f0 tx=0x7fa058005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0996395ea50023b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa04a000640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa04a000640 1 -- 172.21.15.118:0/16593386 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058040040 con 0x561fac4593b0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa04a000640 1 -- 172.21.15.118:0/16593386 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7fa058003e30 con 0x561fac4593b0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05c089070 con 0x561fac4593b0 2024-09-21T06:06:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa04a000640 1 -- 172.21.15.118:0/16593386 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa05806f050 con 0x561fac4593b0 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa072ebf740 10 client.5748 fetch_fsmap learned FSMap version 34 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x561fac866b20 con 0x561fac4593b0 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa04a000640 1 -- 172.21.15.118:0/16593386 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa05c089070 con 0x561fac4593b0 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa04a000640 1 -- 172.21.15.118:0/16593386 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7fa058072020 con 0x561fac4593b0 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.090+0000 7fa072ebf740 10 client.5748 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa072ebf740 10 client.5748 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa072ebf740 20 client.5748 populate_metadata read hostname 'smithi118' 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa072ebf740 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac852240 0x561fac852650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa072ebf740 4 client.5748 mds_command: new command op to 5643 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 --> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] -- command(tid 0: {"prefix": "status"}) -- 0x561fac799fd0 con 0x561fac852240 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa068a00640 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac852240 0x561fac852650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa068a00640 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac852240 0x561fac852650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ec99d3971d5d4d server_cookie=131836cfe90c9d5d in_seq=0 out_seq=0 2024-09-21T06:06:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.091+0000 7fa04a000640 10 client.5748 ms_handle_connect on v2:172.21.15.118:6834/2029341341 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa04a000640 1 -- 172.21.15.118:0/16593386 <== mds.0 v2:172.21.15.118:6834/2029341341 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x561fac799fd0 con 0x561fac852240 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa04a000640 10 client.5748 handle_command_reply: tid=0 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 client.5748 shutdown 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac4593b0 msgr2=0x561fac865490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac4593b0 0x561fac865490 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa0580099f0 tx=0x7fa058005a60 comp rx=0 tx=0).stop 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 shutdown_connections 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:6834/2029341341,v1:172.21.15.118:6835/2029341341] conn(0x561fac852240 0x561fac852650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561fac482270 0x561fac867610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x561fac461590 0x561fac8670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa04a000640 0 client.5748 ms_handle_reset on v2:172.21.15.118:6834/2029341341 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 --2- 172.21.15.118:0/16593386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561fac4593b0 0x561fac865490 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 >> 172.21.15.118:0/16593386 conn(0x561fac4763c0 msgr2=0x561fac850a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 shutdown_connections 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 1 -- 172.21.15.118:0/16593386 wait complete. 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.092+0000 7fa072ebf740 20 client.5748 trim_cache size 0 max 16384 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 5643, 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 6.623243456, 2024-09-21T06:06:24.100 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 34, 2024-09-21T06:06:24.101 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 63, 2024-09-21T06:06:24.101 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 63, 2024-09-21T06:06:24.101 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.444440411 2024-09-21T06:06:24.101 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:06:24.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa044078b90 msgr2=0x7fa04407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa044078b90 0x7fa04407b0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa058033000 tx=0x7fa058004730 comp rx=0 tx=0).stop 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa064142e40 msgr2=0x7fa064158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa064142e40 0x7fa064158580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00ea40 tx=0x7fa05c00ef00 comp rx=0 tx=0).stop 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 shutdown_connections 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa064142e40 0x7fa064158580 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa044078b90 0x7fa04407b0a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa06413fef0 0x7fa0641562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 --2- 172.21.15.118:0/1220014678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa06413fae0 0x7fa0640741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 >> 172.21.15.118:0/1220014678 conn(0x7fa06406d110 msgr2=0x7fa06413c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 shutdown_connections 2024-09-21T06:06:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.093+0000 7fa06be00640 1 -- 172.21.15.118:0/1220014678 wait complete. 2024-09-21T06:06:24.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:06:24.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.335+0000 7eff96a00640 1 -- 172.21.15.118:0/2985656273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900b3a60 msgr2=0x7eff900cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.335+0000 7eff96a00640 1 --2- 172.21.15.118:0/2985656273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900b3a60 0x7eff900cca40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7eff900b5db0 tx=0x7eff7c02a530 comp rx=0 tx=0).stop 2024-09-21T06:06:24.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.335+0000 7eff96a00640 1 -- 172.21.15.118:0/2985656273 shutdown_connections 2024-09-21T06:06:24.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.335+0000 7eff96a00640 1 --2- 172.21.15.118:0/2985656273 >> v2:172.21.15.149:3300/0 conn(0x7eff900ccf80 0x7eff90073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.335+0000 7eff96a00640 1 --2- 172.21.15.118:0/2985656273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900b3a60 0x7eff900cca40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.335+0000 7eff96a00640 1 -- 172.21.15.118:0/2985656273 >> 172.21.15.118:0/2985656273 conn(0x7eff9006d110 msgr2=0x7eff9006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.336+0000 7eff96a00640 1 -- 172.21.15.118:0/2985656273 shutdown_connections 2024-09-21T06:06:24.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.336+0000 7eff96a00640 1 -- 172.21.15.118:0/2985656273 wait complete. 2024-09-21T06:06:24.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.338+0000 7eff96a00640 1 Processor -- start 2024-09-21T06:06:24.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.338+0000 7eff96a00640 1 -- start start 2024-09-21T06:06:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.339+0000 7eff96a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff900b3a60 0x7eff901556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.339+0000 7eff96a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900ccf80 0x7eff9013f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.339+0000 7eff96a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff9015cfd0 0x7eff9013fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.339+0000 7eff96a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7eff90073c40 con 0x7eff900ccf80 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.339+0000 7eff96a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff90073ac0 con 0x7eff900b3a60 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.339+0000 7eff96a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff90073dc0 con 0x7eff9015cfd0 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900ccf80 0x7eff9013f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900ccf80 0x7eff9013f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53454/0 (socket says 172.21.15.118:53454) 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 -- 172.21.15.118:0/1730847715 learned_addr learned my addr 172.21.15.118:0/1730847715 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff94a00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff9015cfd0 0x7eff9013fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8fe00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff900b3a60 0x7eff901556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 -- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff9015cfd0 msgr2=0x7eff9013fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff9015cfd0 0x7eff9013fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 -- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff900b3a60 msgr2=0x7eff901556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff900b3a60 0x7eff901556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 -- 172.21.15.118:0/1730847715 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff90155bf0 con 0x7eff900ccf80 2024-09-21T06:06:24.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.340+0000 7eff8f400640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900ccf80 0x7eff9013f8b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009920 tx=0x7eff7c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.341+0000 7eff87e00640 1 -- 172.21.15.118:0/1730847715 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c005c90 con 0x7eff900ccf80 2024-09-21T06:06:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.341+0000 7eff87e00640 1 -- 172.21.15.118:0/1730847715 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff7c031e50 con 0x7eff900ccf80 2024-09-21T06:06:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.341+0000 7eff87e00640 1 -- 172.21.15.118:0/1730847715 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c005220 con 0x7eff900ccf80 2024-09-21T06:06:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.341+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff901f63f0 con 0x7eff900ccf80 2024-09-21T06:06:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.341+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff901f69b0 con 0x7eff900ccf80 2024-09-21T06:06:24.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.342+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff901f6160 con 0x7eff900ccf80 2024-09-21T06:06:24.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.343+0000 7eff87e00640 1 -- 172.21.15.118:0/1730847715 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff7c0053c0 con 0x7eff900ccf80 2024-09-21T06:06:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.344+0000 7eff87e00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff70078b90 0x7eff7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.344+0000 7eff87e00640 1 -- 172.21.15.118:0/1730847715 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7eff7c0bbd90 con 0x7eff900ccf80 2024-09-21T06:06:24.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.345+0000 7eff8fe00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff70078b90 0x7eff7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:24.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.346+0000 7eff8fe00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff70078b90 0x7eff7007b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7eff80001610 tx=0x7eff80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:24.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.349+0000 7eff87e00640 1 -- 172.21.15.118:0/1730847715 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7eff90155bf0 con 0x7eff900ccf80 2024-09-21T06:06:24.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.575+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7eff900cca40 con 0x7eff900ccf80 2024-09-21T06:06:24.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.575+0000 7eff87e00640 1 -- 172.21.15.118:0/1730847715 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7eff7c03f030 con 0x7eff900ccf80 2024-09-21T06:06:24.578 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:06:24.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.577+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff70078b90 msgr2=0x7eff7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.577+0000 7eff96a00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff70078b90 0x7eff7007b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7eff80001610 tx=0x7eff80009040 comp rx=0 tx=0).stop 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900ccf80 msgr2=0x7eff9013f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900ccf80 0x7eff9013f8b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009920 tx=0x7eff7c033c20 comp rx=0 tx=0).stop 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 shutdown_connections 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff70078b90 0x7eff7007b0a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff9015cfd0 0x7eff9013fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff900ccf80 0x7eff9013f8b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 --2- 172.21.15.118:0/1730847715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff900b3a60 0x7eff901556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 >> 172.21.15.118:0/1730847715 conn(0x7eff9006d110 msgr2=0x7eff900b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 shutdown_connections 2024-09-21T06:06:24.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24.578+0000 7eff96a00640 1 -- 172.21.15.118:0/1730847715 wait complete. 2024-09-21T06:06:24.604 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:06:24.604 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:06:24.604 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:06:24.604 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:06:24.604 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:06:24.604 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:06:24.604 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:06:24.605 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:06:24.605 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:06:24.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:24.605 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:06:24.640 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:06:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42600sec preferred_lft 42600sec 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:24.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:24.644 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:06:24.734 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:06:24.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:24.738 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:06:24.774 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:06:24.774 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:06:24.774 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:06:24.774 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:06:24.774 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:06:24.774 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:06:24.774 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:06:24.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:06:24.775 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:06:24.775 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:06:24.775 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:06:24.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:06:24.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:06:24.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:24.971 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:06:25.007 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:06:25.007 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:06:25.007 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:06:25.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:25.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:06:25.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:06:25.104 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:06:25.139 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:06:25.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:06:25.140 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:06:25.215 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:06:25.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:25.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:06:25.409 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:06:25.409 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:06:25.443 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:06:25.443 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:06:25.443 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:06:25.444 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:06:25.444 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:06:25.445 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:06:25.445 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:06:25.445 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:06:25.445 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:06:25.445 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:06:25.448 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:06:25.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:25.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:06:25.507 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:06:25.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:06:25.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:06:25.601 INFO:teuthology.orchestra.run.smithi118.stdout:client5602 2024-09-21T06:06:25.602 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:06:25.602 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:25.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:06:25.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.894+0000 7f871fc00640 1 -- 172.21.15.118:0/3375721485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 msgr2=0x7f8700003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:25.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.894+0000 7f871fc00640 1 --2- 172.21.15.118:0/3375721485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 0x7f8700003e70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f870c009b50 tx=0x7f8700005830 comp rx=0 tx=0).stop 2024-09-21T06:06:25.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.894+0000 7f871dc00640 1 -- 172.21.15.118:0/3375721485 reap_dead start 2024-09-21T06:06:25.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.894+0000 7f871fc00640 1 -- 172.21.15.118:0/3375721485 shutdown_connections 2024-09-21T06:06:25.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.894+0000 7f871fc00640 1 -- 172.21.15.118:0/3375721485 >> 172.21.15.118:0/3375721485 conn(0x7f871806d110 msgr2=0x7f871806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:25.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.894+0000 7f871fc00640 1 -- 172.21.15.118:0/3375721485 shutdown_connections 2024-09-21T06:06:25.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.895+0000 7f871fc00640 1 -- 172.21.15.118:0/3375721485 wait complete. 2024-09-21T06:06:25.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.897+0000 7f871fc00640 1 Processor -- start 2024-09-21T06:06:25.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.897+0000 7f871fc00640 1 -- start start 2024-09-21T06:06:25.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871fc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 0x7f87181545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:25.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871fc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87181e63a0 0x7f8718154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:25.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871fc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718155400 0x7f871815e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871fc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f871806f060 con 0x7f8700003a00 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871fc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f871806eee0 con 0x7f8718155400 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871fc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f871806f1e0 con 0x7f87181e63a0 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 0x7f87181545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 0x7f87181545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47518/0 (socket says 172.21.15.118:47518) 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.898+0000 7f871d200640 1 -- 172.21.15.118:0/101586851 learned_addr learned my addr 172.21.15.118:0/101586851 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871dc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718155400 0x7f871815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f8717e00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87181e63a0 0x7f8718154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871d200640 1 -- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87181e63a0 msgr2=0x7f8718154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871d200640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87181e63a0 0x7f8718154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871d200640 1 -- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718155400 msgr2=0x7f871815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871d200640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718155400 0x7f871815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:25.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871d200640 1 -- 172.21.15.118:0/101586851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8718155b40 con 0x7f8700003a00 2024-09-21T06:06:25.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871dc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718155400 0x7f871815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:25.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f871d200640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 0x7f87181545a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f870c009a70 tx=0x7f870c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:25.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f8714c00640 1 -- 172.21.15.118:0/101586851 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c038040 con 0x7f8700003a00 2024-09-21T06:06:25.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.899+0000 7f8714c00640 1 -- 172.21.15.118:0/101586851 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870c004110 con 0x7f8700003a00 2024-09-21T06:06:25.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.900+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87181e58c0 con 0x7f8700003a00 2024-09-21T06:06:25.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.900+0000 7f8714c00640 1 -- 172.21.15.118:0/101586851 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0337e0 con 0x7f8700003a00 2024-09-21T06:06:25.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.900+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87181411e0 con 0x7f8700003a00 2024-09-21T06:06:25.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.901+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87180b3a60 con 0x7f8700003a00 2024-09-21T06:06:25.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.902+0000 7f8714c00640 1 -- 172.21.15.118:0/101586851 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f870c045020 con 0x7f8700003a00 2024-09-21T06:06:25.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.903+0000 7f8714c00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f86f8078b90 0x7f86f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:25.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.903+0000 7f8714c00640 1 -- 172.21.15.118:0/101586851 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f870c0bb840 con 0x7f8700003a00 2024-09-21T06:06:25.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.903+0000 7f8717e00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f86f8078b90 0x7f86f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:25.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.904+0000 7f8717e00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f86f8078b90 0x7f86f807b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f871815c560 tx=0x7f8704005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:25.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:25.907+0000 7f8714c00640 1 -- 172.21.15.118:0/101586851 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f870c083c70 con 0x7f8700003a00 2024-09-21T06:06:26.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.128+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8718141410 con 0x7f8700003a00 2024-09-21T06:06:26.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.128+0000 7f8714c00640 1 -- 172.21.15.118:0/101586851 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7f870c083570 con 0x7f8700003a00 2024-09-21T06:06:26.131 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:06:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f86f8078b90 msgr2=0x7f86f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f86f8078b90 0x7f86f807b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f871815c560 tx=0x7f8704005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 msgr2=0x7f87181545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 0x7f87181545a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f870c009a70 tx=0x7f870c033670 comp rx=0 tx=0).stop 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 shutdown_connections 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8718155400 0x7f871815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f86f8078b90 0x7f86f807b0a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87181e63a0 0x7f8718154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 --2- 172.21.15.118:0/101586851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8700003a00 0x7f87181545a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 >> 172.21.15.118:0/101586851 conn(0x7f871806d110 msgr2=0x7f871815b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 shutdown_connections 2024-09-21T06:06:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:26.131+0000 7f871fc00640 1 -- 172.21.15.118:0/101586851 wait complete. 2024-09-21T06:06:26.159 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:06:26.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:06:26.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:06:26.159 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:06:26.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:06:26.160 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:06:26.160 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:06:26.160 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:06:26.160 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:06:26.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:26.160 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:06:26.199 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:06:26.199 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:06:26.199 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:06:26.199 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:06:26.200 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42573sec preferred_lft 42573sec 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:06:26.201 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:06:26.202 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:06:26.202 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:06:26.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:26.202 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:06:26.300 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:06:26.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:26.304 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:06:26.340 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:06:26.341 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:06:26.341 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:06:26.341 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:06:26.341 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:06:26.341 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:06:26.341 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:06:26.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:06:26.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:06:26.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:06:26.341 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:06:26.459 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:06:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:06:26.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:06:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:06:26.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:26.540 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:06:26.576 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:06:26.576 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:06:26.576 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:06:26.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:26.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:06:26.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:06:26.672 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:06:26.707 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:06:26.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:06:26.707 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:06:26.781 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:06:26.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:26.782 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:06:26.975 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:06:26.975 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:06:27.008 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:06:27.008 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:06:27.008 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:06:27.008 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:06:27.008 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:06:27.010 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:06:27.010 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:06:27.010 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:06:27.010 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:06:27.010 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:06:27.013 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:06:27.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:06:27.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:06:27.069 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:06:27.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:06:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:06:27.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:06:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:06:27.158 INFO:teuthology.orchestra.run.smithi149.stdout:client5237 2024-09-21T06:06:27.159 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:06:27.159 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:06:27.194 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:06:27.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 -- 172.21.15.118:0/2818148372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 msgr2=0x7f23ac15fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:27.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 --2- 172.21.15.118:0/2818148372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 0x7f23ac15fe10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23a4005fd0 tx=0x7f23a402aa00 comp rx=0 tx=0).stop 2024-09-21T06:06:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 -- 172.21.15.118:0/2818148372 shutdown_connections 2024-09-21T06:06:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 --2- 172.21.15.118:0/2818148372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 0x7f23ac15fe10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 --2- 172.21.15.118:0/2818148372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0d0ec0 0x7f23ac0d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 -- 172.21.15.118:0/2818148372 >> 172.21.15.118:0/2818148372 conn(0x7f23ac06d110 msgr2=0x7f23ac06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 -- 172.21.15.118:0/2818148372 shutdown_connections 2024-09-21T06:06:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.414+0000 7f23b1200640 1 -- 172.21.15.118:0/2818148372 wait complete. 2024-09-21T06:06:27.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.417+0000 7f23b1200640 1 Processor -- start 2024-09-21T06:06:27.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.417+0000 7f23b1200640 1 -- start start 2024-09-21T06:06:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.418+0000 7f23b1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0ce0c0 0x7f23ac15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.418+0000 7f23b1200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23ac0d0ec0 0x7f23ac0cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.418+0000 7f23b1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 0x7f23ac0af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.418+0000 7f23b1200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac073f20 con 0x7f23ac0d0ec0 2024-09-21T06:06:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.418+0000 7f23b1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac073da0 con 0x7f23ac15fa00 2024-09-21T06:06:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.418+0000 7f23b1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac0740a0 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0ce0c0 0x7f23ac15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23ac0d0ec0 0x7f23ac0cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0ce0c0 0x7f23ac15aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:59156/0 (socket says 172.21.15.118:59156) 2024-09-21T06:06:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 -- 172.21.15.118:0/658869067 learned_addr learned my addr 172.21.15.118:0/658869067 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:06:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23aa800640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 0x7f23ac0af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:27.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 -- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 msgr2=0x7f23ac0af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:27.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 0x7f23ac0af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 -- 172.21.15.118:0/658869067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23ac0d0ec0 msgr2=0x7f23ac0cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:27.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23ac0d0ec0 0x7f23ac0cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 -- 172.21.15.118:0/658869067 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac15af40 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a1400640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23ac0d0ec0 0x7f23ac0cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.419+0000 7f23a9e00640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0ce0c0 0x7f23ac15aa00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c3d0 tx=0x7f239c00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.420+0000 7f23a2a00640 1 -- 172.21.15.118:0/658869067 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c017070 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.420+0000 7f23a2a00640 1 -- 172.21.15.118:0/658869067 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f239c0053c0 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.420+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac0ce610 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.420+0000 7f23a2a00640 1 -- 172.21.15.118:0/658869067 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c003850 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.420+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac1f68a0 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.421+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac074550 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.422+0000 7f23a2a00640 1 -- 172.21.15.118:0/658869067 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f239c01a070 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.423+0000 7f23a2a00640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2388078b90 0x7f238807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.423+0000 7f23a2a00640 1 -- 172.21.15.118:0/658869067 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 5709+0+0 (secure 0 0 0) 0x7f239c09a080 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.423+0000 7f23a1400640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2388078b90 0x7f238807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:27.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.424+0000 7f23a1400640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2388078b90 0x7f238807b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0b5580 tx=0x7f2394005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:27.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.428+0000 7f23a2a00640 1 -- 172.21.15.118:0/658869067 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f23ac0d1810 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.650+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23ac0b0f50 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.651+0000 7f23a2a00640 1 -- 172.21.15.118:0/658869067 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7f239c061e60 con 0x7f23ac0ce0c0 2024-09-21T06:06:27.654 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:06:27.654 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T06:06:20:487542+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:06:16.940252+0000","modified":"2024-09-21T06:06:19.973048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2029341341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2029341341},{"type":"v1","addr":"172.21.15.118:6835","nonce":2029341341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T06:06:27.654 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T06:06:27.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.653+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2388078b90 msgr2=0x7f238807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:27.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.653+0000 7f23b1200640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2388078b90 0x7f238807b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0b5580 tx=0x7f2394005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:27.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.653+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0ce0c0 msgr2=0x7f23ac15aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:27.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.653+0000 7f23b1200640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0ce0c0 0x7f23ac15aa00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c3d0 tx=0x7f239c00c890 comp rx=0 tx=0).stop 2024-09-21T06:06:27.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 shutdown_connections 2024-09-21T06:06:27.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23ac15fa00 0x7f23ac0af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23ac0d0ec0 0x7f23ac0cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2388078b90 0x7f238807b0a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 --2- 172.21.15.118:0/658869067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23ac0ce0c0 0x7f23ac15aa00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:27.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 >> 172.21.15.118:0/658869067 conn(0x7f23ac06d110 msgr2=0x7f23ac15c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:27.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 shutdown_connections 2024-09-21T06:06:27.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:06:27.654+0000 7f23b1200640 1 -- 172.21.15.118:0/658869067 wait complete. 2024-09-21T06:06:27.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:06:27.918 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":5643,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.428824326999999,"mdsmap_epoch":34,"osdmap_epoch":63,"osdmap_epoch_barrier":63,"uptime":15.250023349999999} 2024-09-21T06:06:27.919 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 5643, "mdsmap_epoch": 34, "osdmap_epoch": 63, "osdmap_epoch_barrier": 63, "rank_uptime": 10.428824327, "state": "up:active", "uptime": 15.25002335, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:06:27.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:06:28.151 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:06:28.152 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:06:28.152 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-21T06:06:28.379 INFO:teuthology.orchestra.run.smithi118.stdout:{"mon_tick_interval":"5"} 2024-09-21T06:06:28.379 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-21T06:06:28.379 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> import time 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> import datetime 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> # Write some buffered data through before going full, all should be well 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> print("writing some data through which we expect to succeed") 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> bytes = 0 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-21T06:06:28.380 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> # buffered IO, the error should always only appear from fsync and not 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> # from write 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> full = False 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> for n in range(0, int(531 * 0.9)): 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> print("done writing {0} bytes".format(bytes)) 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> # OK, now we should sneak in under the full condition 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> # due to the time it takes the OSDs to report to the 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> # mons, and get a successful fsync on our full-making data 2024-09-21T06:06:28.381 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> # buffered write, add more dirty data to the buffer 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> print("starting buffered write") 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> for n in range(0, int(531 * 0.2)): 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> time.sleep(15.0) 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> except OSError: 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> pass; 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.382 DEBUG:teuthology.orchestra.run.smithi118:> # Wait long enough for a background flush that should fail 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> time.sleep(30) 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> if False: 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> # ...and check that the failed background flush is reflected in fclose 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> os.close(f) 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> except OSError: 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> print("close() returned an error as expected") 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("close() failed to raise error") 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> # The kernel cephfs client does not raise errors on fclose 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> os.close(f) 2024-09-21T06:06:28.383 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:06:28.384 DEBUG:teuthology.orchestra.run.smithi118:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-21T06:06:28.384 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:06:32.834 INFO:teuthology.orchestra.run.smithi118.stdout:writing some data through which we expect to succeed 2024-09-21T06:06:32.834 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-21T06:06:32.834 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-21T06:06:32.834 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-21T06:06:32.834 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-21T06:06:32.834 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-21T06:06:32.836 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 30932992 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 31981568 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 33030144 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 34078720 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 35127296 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 36175872 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 37224448 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 38273024 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 39321600 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 40370176 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 41418752 bytes via buffered write, may repeat 2024-09-21T06:06:32.837 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 42467328 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 43515904 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 44564480 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 45613056 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 46661632 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 47710208 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 48758784 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 49807360 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 50855936 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 51904512 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 52953088 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 54001664 bytes via buffered write, may repeat 2024-09-21T06:06:32.838 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 55050240 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 56098816 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 57147392 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 58195968 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 59244544 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 60293120 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 61341696 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 62390272 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 63438848 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 64487424 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 65536000 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 66584576 bytes via buffered write, may repeat 2024-09-21T06:06:32.839 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 67633152 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 68681728 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 69730304 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 70778880 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 71827456 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 72876032 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 73924608 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 74973184 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 76021760 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 77070336 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 78118912 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 79167488 bytes via buffered write, may repeat 2024-09-21T06:06:32.840 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 80216064 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 81264640 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 82313216 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 83361792 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 84410368 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 85458944 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 86507520 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 87556096 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 88604672 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 89653248 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 90701824 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 91750400 bytes via buffered write, may repeat 2024-09-21T06:06:32.841 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 92798976 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 93847552 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 94896128 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 95944704 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 96993280 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 98041856 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 99090432 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 100139008 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 101187584 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 102236160 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 103284736 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 104333312 bytes via buffered write, may repeat 2024-09-21T06:06:32.842 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 105381888 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 106430464 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 107479040 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 108527616 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 109576192 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 110624768 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 111673344 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 112721920 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 113770496 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 114819072 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 115867648 bytes via buffered write, may repeat 2024-09-21T06:06:32.843 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 116916224 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 117964800 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 119013376 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 120061952 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 121110528 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 122159104 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 123207680 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 124256256 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 125304832 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 126353408 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 127401984 bytes via buffered write, may repeat 2024-09-21T06:06:32.844 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 128450560 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 129499136 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 130547712 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 131596288 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 132644864 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 133693440 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 134742016 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 135790592 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 136839168 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 137887744 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 138936320 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 139984896 bytes via buffered write, may repeat 2024-09-21T06:06:32.845 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 141033472 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 142082048 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 143130624 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 144179200 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 145227776 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 146276352 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 147324928 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 148373504 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 149422080 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 150470656 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 151519232 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 152567808 bytes via buffered write, may repeat 2024-09-21T06:06:32.846 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 153616384 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 154664960 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 155713536 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 156762112 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 157810688 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 158859264 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 159907840 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 160956416 bytes via buffered write, may repeat 2024-09-21T06:06:32.847 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 162004992 bytes via buffered write, may repeat 2024-09-21T06:06:32.981 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 163053568 bytes via buffered write, may repeat 2024-09-21T06:06:32.981 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 164102144 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 165150720 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 166199296 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 167247872 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 168296448 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 169345024 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 170393600 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 171442176 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 172490752 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 173539328 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 174587904 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 175636480 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 176685056 bytes via buffered write, may repeat 2024-09-21T06:06:32.982 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 177733632 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 178782208 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 179830784 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 180879360 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 181927936 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 182976512 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 184025088 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 185073664 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 186122240 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 187170816 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 188219392 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 189267968 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 190316544 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 191365120 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 192413696 bytes via buffered write, may repeat 2024-09-21T06:06:32.983 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 193462272 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 194510848 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 195559424 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 196608000 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 197656576 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 198705152 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 199753728 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 200802304 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 201850880 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 202899456 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 203948032 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 204996608 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 206045184 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 207093760 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 208142336 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 209190912 bytes via buffered write, may repeat 2024-09-21T06:06:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 210239488 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 211288064 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 212336640 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 213385216 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 214433792 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 215482368 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 216530944 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 217579520 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 218628096 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 219676672 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 220725248 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 221773824 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 222822400 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 223870976 bytes via buffered write, may repeat 2024-09-21T06:06:32.985 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 224919552 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 225968128 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 227016704 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 228065280 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 229113856 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 230162432 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 231211008 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 232259584 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 233308160 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 234356736 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 235405312 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 236453888 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 237502464 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 238551040 bytes via buffered write, may repeat 2024-09-21T06:06:32.986 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 239599616 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 240648192 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 241696768 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 242745344 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 243793920 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 244842496 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 245891072 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 246939648 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 247988224 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 249036800 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 250085376 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 251133952 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 252182528 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 253231104 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 254279680 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 255328256 bytes via buffered write, may repeat 2024-09-21T06:06:32.987 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 256376832 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 257425408 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 258473984 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 259522560 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 260571136 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 261619712 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 262668288 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 263716864 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 264765440 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 265814016 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 266862592 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 267911168 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 268959744 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 270008320 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 271056896 bytes via buffered write, may repeat 2024-09-21T06:06:32.988 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 272105472 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 273154048 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 274202624 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 275251200 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 276299776 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 277348352 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 278396928 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 279445504 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 280494080 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 281542656 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 282591232 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 283639808 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 284688384 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 285736960 bytes via buffered write, may repeat 2024-09-21T06:06:32.989 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 286785536 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 287834112 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 288882688 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 289931264 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 290979840 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 292028416 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 293076992 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 294125568 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 295174144 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 296222720 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 297271296 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 298319872 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 299368448 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 300417024 bytes via buffered write, may repeat 2024-09-21T06:06:32.990 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 301465600 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 302514176 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 303562752 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 304611328 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 305659904 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 306708480 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 307757056 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 308805632 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 309854208 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 310902784 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 311951360 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 312999936 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 314048512 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 315097088 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 316145664 bytes via buffered write, may repeat 2024-09-21T06:06:32.991 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 317194240 bytes via buffered write, may repeat 2024-09-21T06:06:32.992 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 318242816 bytes via buffered write, may repeat 2024-09-21T06:06:32.992 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 319291392 bytes via buffered write, may repeat 2024-09-21T06:06:32.992 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 320339968 bytes via buffered write, may repeat 2024-09-21T06:06:32.992 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 321388544 bytes via buffered write, may repeat 2024-09-21T06:06:32.992 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 322437120 bytes via buffered write, may repeat 2024-09-21T06:06:32.992 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 323485696 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 324534272 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 325582848 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 326631424 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 327680000 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 328728576 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 329777152 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 330825728 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 331874304 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 332922880 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 333971456 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 335020032 bytes via buffered write, may repeat 2024-09-21T06:06:33.127 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 336068608 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 337117184 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 338165760 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 339214336 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 340262912 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 341311488 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 342360064 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 343408640 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 344457216 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 345505792 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 346554368 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 347602944 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 348651520 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 349700096 bytes via buffered write, may repeat 2024-09-21T06:06:33.128 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 350748672 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 351797248 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 352845824 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 353894400 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 354942976 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 355991552 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 357040128 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 358088704 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 359137280 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 360185856 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 361234432 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 362283008 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 363331584 bytes via buffered write, may repeat 2024-09-21T06:06:33.129 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 364380160 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 365428736 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 366477312 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 367525888 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 368574464 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 369623040 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 370671616 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 371720192 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 372768768 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 373817344 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 374865920 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 375914496 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 376963072 bytes via buffered write, may repeat 2024-09-21T06:06:33.130 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 378011648 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 379060224 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 380108800 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 381157376 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 382205952 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 383254528 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 384303104 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 385351680 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 386400256 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 387448832 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 388497408 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 389545984 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 390594560 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 391643136 bytes via buffered write, may repeat 2024-09-21T06:06:33.131 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 392691712 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 393740288 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 394788864 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 395837440 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 396886016 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 397934592 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 398983168 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 400031744 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 401080320 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 402128896 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 403177472 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 404226048 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 405274624 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 406323200 bytes via buffered write, may repeat 2024-09-21T06:06:33.132 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 407371776 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 408420352 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 409468928 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 410517504 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 411566080 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 412614656 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 413663232 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 414711808 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 415760384 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 416808960 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 417857536 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 418906112 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 419954688 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 421003264 bytes via buffered write, may repeat 2024-09-21T06:06:33.133 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 422051840 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 423100416 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 424148992 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 425197568 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 426246144 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 427294720 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 428343296 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 429391872 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 430440448 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 431489024 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 432537600 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 433586176 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 434634752 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 435683328 bytes via buffered write, may repeat 2024-09-21T06:06:33.134 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 436731904 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 437780480 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 438829056 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 439877632 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 440926208 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 441974784 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 443023360 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 444071936 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 445120512 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 446169088 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 447217664 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 448266240 bytes via buffered write, may repeat 2024-09-21T06:06:33.135 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 449314816 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 450363392 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 451411968 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 452460544 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 453509120 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 454557696 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 455606272 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 456654848 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 457703424 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 458752000 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 459800576 bytes via buffered write, may repeat 2024-09-21T06:06:33.136 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 460849152 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 461897728 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 462946304 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 463994880 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 465043456 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 466092032 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 467140608 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 468189184 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 469237760 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 470286336 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 471334912 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 472383488 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 473432064 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 474480640 bytes via buffered write, may repeat 2024-09-21T06:06:33.137 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 475529216 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 476577792 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 477626368 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 478674944 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 479723520 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 480772096 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 481820672 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 482869248 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 483917824 bytes via buffered write, may repeat 2024-09-21T06:06:33.138 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 484966400 bytes via buffered write, may repeat 2024-09-21T06:06:36.554 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:06:36.552+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2024-09-21T06:06:41.584 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:06:41.582+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-21T06:06:48.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:06:48.906 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:19.020 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:19.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:34.487 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 486014976 bytes via buffered write, may repeat 2024-09-21T06:07:34.487 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 487063552 bytes via buffered write, may repeat 2024-09-21T06:07:34.487 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 488112128 bytes via buffered write, may repeat 2024-09-21T06:07:34.487 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 489160704 bytes via buffered write, may repeat 2024-09-21T06:07:34.487 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 490209280 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 491257856 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 492306432 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 493355008 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 494403584 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 495452160 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 496500736 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 497549312 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 498597888 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 499646464 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 500695040 bytes via buffered write, may repeat 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:done writing 500695040 bytes 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:successfully fsync'ed prior to getting full state reported 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:starting buffered write 2024-09-21T06:07:34.488 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:07:34.489 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:07:34.489 INFO:teuthology.orchestra.run.smithi118.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-21T06:07:34.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:07:34.501 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:07:34.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:07:34.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:07:34.683 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:07:34.683 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:07:34.684 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:07:34.684 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:34.719 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:07:34.719 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:34.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:07:35.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.053+0000 7f273be00640 1 -- 172.21.15.118:0/2706663184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271c005150 msgr2=0x7f271c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.053+0000 7f273be00640 1 --2- 172.21.15.118:0/2706663184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271c005150 0x7f271c00b9c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f272c001dc0 tx=0x7f271c005830 comp rx=0 tx=0).stop 2024-09-21T06:07:35.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.053+0000 7f2739e00640 1 -- 172.21.15.118:0/2706663184 reap_dead start 2024-09-21T06:07:35.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.053+0000 7f273be00640 1 -- 172.21.15.118:0/2706663184 shutdown_connections 2024-09-21T06:07:35.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.053+0000 7f273be00640 1 -- 172.21.15.118:0/2706663184 >> 172.21.15.118:0/2706663184 conn(0x7f273406d110 msgr2=0x7f273406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.054+0000 7f273be00640 1 -- 172.21.15.118:0/2706663184 shutdown_connections 2024-09-21T06:07:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.054+0000 7f273be00640 1 -- 172.21.15.118:0/2706663184 wait complete. 2024-09-21T06:07:35.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.056+0000 7f273be00640 1 Processor -- start 2024-09-21T06:07:35.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.056+0000 7f273be00640 1 -- start start 2024-09-21T06:07:35.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.057+0000 7f273be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c005150 0x7f2734140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.057+0000 7f273be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2734155d80 0x7f27340cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.057+0000 7f273be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27341f7360 0x7f273415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.057+0000 7f273be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2734142ac0 con 0x7f27341f7360 2024-09-21T06:07:35.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.057+0000 7f273be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2734142940 con 0x7f271c005150 2024-09-21T06:07:35.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.057+0000 7f273be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2734163b70 con 0x7f2734155d80 2024-09-21T06:07:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27341f7360 0x7f273415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27341f7360 0x7f273415f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37746/0 (socket says 172.21.15.118:37746) 2024-09-21T06:07:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 -- 172.21.15.118:0/423769862 learned_addr learned my addr 172.21.15.118:0/423769862 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739400640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c005150 0x7f2734140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2738a00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2734155d80 0x7f27340cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 -- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2734155d80 msgr2=0x7f27340cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2734155d80 0x7f27340cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 -- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c005150 msgr2=0x7f2734140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c005150 0x7f2734140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 -- 172.21.15.118:0/423769862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2734140b50 con 0x7f27341f7360 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.058+0000 7f2739e00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27341f7360 0x7f273415f8b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f272c02acc0 tx=0x7f272c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.059+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c0060b0 con 0x7f27341f7360 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.059+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f272c006250 con 0x7f27341f7360 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.059+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27341f6b80 con 0x7f27341f7360 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.059+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c006660 con 0x7f27341f7360 2024-09-21T06:07:35.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.059+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2734158920 con 0x7f27341f7360 2024-09-21T06:07:35.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.060+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27341583b0 con 0x7f27341f7360 2024-09-21T06:07:35.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.061+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f272c033480 con 0x7f27341f7360 2024-09-21T06:07:35.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.062+0000 7f2731600640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2714078b90 0x7f271407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.062+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f272c0ba840 con 0x7f27341f7360 2024-09-21T06:07:35.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.062+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=68}) -- 0x7f2714080770 con 0x7f27341f7360 2024-09-21T06:07:35.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.063+0000 7f2739400640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2714078b90 0x7f271407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.063+0000 7f2739400640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2714078b90 0x7f271407b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2728001220 tx=0x7f27280067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:35.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.067+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f272c082620 con 0x7f27341f7360 2024-09-21T06:07:35.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.266+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27340d0e80 con 0x7f27341f7360 2024-09-21T06:07:35.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.266+0000 7f2731600640 1 -- 172.21.15.118:0/423769862 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7f272c087050 con 0x7f27341f7360 2024-09-21T06:07:35.268 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:07:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2714078b90 msgr2=0x7f271407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2714078b90 0x7f271407b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2728001220 tx=0x7f27280067a0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27341f7360 msgr2=0x7f273415f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27341f7360 0x7f273415f8b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f272c02acc0 tx=0x7f272c001b10 comp rx=0 tx=0).stop 2024-09-21T06:07:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 shutdown_connections 2024-09-21T06:07:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27341f7360 0x7f273415f8b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2714078b90 0x7f271407b0a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2734155d80 0x7f27340cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 --2- 172.21.15.118:0/423769862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f271c005150 0x7f2734140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.268+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 >> 172.21.15.118:0/423769862 conn(0x7f273406d110 msgr2=0x7f2734162e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.269+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 shutdown_connections 2024-09-21T06:07:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.269+0000 7f273be00640 1 -- 172.21.15.118:0/423769862 wait complete. 2024-09-21T06:07:35.295 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:07:35.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:07:35.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:07:35.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:07:35.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:07:35.360 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:07:35.396 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:07:35.396 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:07:35.396 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:35.436 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:07:35.436 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:35.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:07:35.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.818+0000 7f61c1400640 1 -- 172.21.15.118:0/3072539074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc073fa0 msgr2=0x7f61bc0749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.818+0000 7f61c1400640 1 --2- 172.21.15.118:0/3072539074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc073fa0 0x7f61bc0749f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f61bc072570 tx=0x7f61ac02a4b0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.818+0000 7f61c1400640 1 -- 172.21.15.118:0/3072539074 shutdown_connections 2024-09-21T06:07:35.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.818+0000 7f61c1400640 1 --2- 172.21.15.118:0/3072539074 >> v2:172.21.15.118:3300/0 conn(0x7f61bc0cfe30 0x7f61bc0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.818+0000 7f61c1400640 1 --2- 172.21.15.118:0/3072539074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc073fa0 0x7f61bc0749f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.818+0000 7f61c1400640 1 -- 172.21.15.118:0/3072539074 >> 172.21.15.118:0/3072539074 conn(0x7f61bc06d6e0 msgr2=0x7f61bc0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:35.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.819+0000 7f61c1400640 1 -- 172.21.15.118:0/3072539074 shutdown_connections 2024-09-21T06:07:35.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.819+0000 7f61c1400640 1 -- 172.21.15.118:0/3072539074 wait complete. 2024-09-21T06:07:35.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.821+0000 7f61c1400640 1 Processor -- start 2024-09-21T06:07:35.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.821+0000 7f61c1400640 1 -- start start 2024-09-21T06:07:35.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.822+0000 7f61c1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61bc073fa0 0x7f61bc1f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.822+0000 7f61c1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc0b5bb0 0x7f61bc13a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.822+0000 7f61c1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0cfe30 0x7f61bc0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.822+0000 7f61c1400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc15da00 con 0x7f61bc073fa0 2024-09-21T06:07:35.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.822+0000 7f61c1400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc15d880 con 0x7f61bc0cfe30 2024-09-21T06:07:35.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.822+0000 7f61c1400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc15db80 con 0x7f61bc0b5bb0 2024-09-21T06:07:35.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61bc073fa0 0x7f61bc1f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61bc073fa0 0x7f61bc1f9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33524/0 (socket says 172.21.15.118:33524) 2024-09-21T06:07:35.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 -- 172.21.15.118:0/1502772720 learned_addr learned my addr 172.21.15.118:0/1502772720 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:35.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61c0a00640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0cfe30 0x7f61bc0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61b3400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc0b5bb0 0x7f61bc13a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 -- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc0b5bb0 msgr2=0x7f61bc13a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc0b5bb0 0x7f61bc13a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 -- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0cfe30 msgr2=0x7f61bc0cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0cfe30 0x7f61bc0cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 -- 172.21.15.118:0/1502772720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc1f9da0 con 0x7f61bc073fa0 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61bbe00640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61bc073fa0 0x7f61bc1f9450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0098f0 tx=0x7f61ac033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.823+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac005c90 con 0x7f61bc073fa0 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.824+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61ac031e50 con 0x7f61bc073fa0 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.824+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac005260 con 0x7f61bc073fa0 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.824+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc1fa080 con 0x7f61bc073fa0 2024-09-21T06:07:35.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.824+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc1f62a0 con 0x7f61bc073fa0 2024-09-21T06:07:35.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.825+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc15e030 con 0x7f61bc073fa0 2024-09-21T06:07:35.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.826+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61ac005400 con 0x7f61bc073fa0 2024-09-21T06:07:35.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.827+0000 7f61b8c00640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6198078b90 0x7f619807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:35.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.827+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f61ac0bbd60 con 0x7f61bc073fa0 2024-09-21T06:07:35.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.827+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=68}) -- 0x7f6198080710 con 0x7f61bc073fa0 2024-09-21T06:07:35.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.827+0000 7f61b3400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6198078b90 0x7f619807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:35.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.828+0000 7f61b3400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6198078b90 0x7f619807b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f61bc157480 tx=0x7f61a4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:35.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:35.831+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f61ac03f030 con 0x7f61bc073fa0 2024-09-21T06:07:36.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.029+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61bc158580 con 0x7f61bc073fa0 2024-09-21T06:07:36.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.029+0000 7f61b8c00640 1 -- 172.21.15.118:0/1502772720 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7f61ac031770 con 0x7f61bc073fa0 2024-09-21T06:07:36.031 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6198078b90 msgr2=0x7f619807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6198078b90 0x7f619807b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f61bc157480 tx=0x7f61a4005f90 comp rx=0 tx=0).stop 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61bc073fa0 msgr2=0x7f61bc1f9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61bc073fa0 0x7f61bc1f9450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0098f0 tx=0x7f61ac033c20 comp rx=0 tx=0).stop 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 shutdown_connections 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0cfe30 0x7f61bc0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6198078b90 0x7f619807b0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc0b5bb0 0x7f61bc13a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 --2- 172.21.15.118:0/1502772720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61bc073fa0 0x7f61bc1f9450 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 >> 172.21.15.118:0/1502772720 conn(0x7f61bc06d6e0 msgr2=0x7f61bc157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 shutdown_connections 2024-09-21T06:07:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.032+0000 7f61c1400640 1 -- 172.21.15.118:0/1502772720 wait complete. 2024-09-21T06:07:36.058 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:07:36.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:07:36.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:07:36.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:07:36.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:07:36.121 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:07:36.157 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:07:36.157 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:07:36.157 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:36.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:07:36.193 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:07:36.193 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:07:36.193 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:36.232 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:07:36.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:07:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.454+0000 7f93b7a00640 1 -- 172.21.15.118:0/1441074597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9394004800 msgr2=0x7f9394004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.454+0000 7f93b7a00640 1 --2- 172.21.15.118:0/1441074597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9394004800 0x7f9394004c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9398006f60 tx=0x7f9394005830 comp rx=0 tx=0).stop 2024-09-21T06:07:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.454+0000 7f93b5a00640 1 -- 172.21.15.118:0/1441074597 reap_dead start 2024-09-21T06:07:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.455+0000 7f93b7a00640 1 -- 172.21.15.118:0/1441074597 shutdown_connections 2024-09-21T06:07:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.455+0000 7f93b7a00640 1 -- 172.21.15.118:0/1441074597 >> 172.21.15.118:0/1441074597 conn(0x7f93b006d110 msgr2=0x7f93b006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.455+0000 7f93b7a00640 1 -- 172.21.15.118:0/1441074597 shutdown_connections 2024-09-21T06:07:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.455+0000 7f93b7a00640 1 -- 172.21.15.118:0/1441074597 wait complete. 2024-09-21T06:07:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.457+0000 7f93b7a00640 1 Processor -- start 2024-09-21T06:07:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.457+0000 7f93b7a00640 1 -- start start 2024-09-21T06:07:36.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b7a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9394004800 0x7f93b013cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b7a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b013d600 0x7f93b015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b7a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b013dae0 0x7f93b015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b7a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0164e00 con 0x7f9394004800 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b7a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0164c80 con 0x7f93b013dae0 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b7a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f93b0164f80 con 0x7f93b013d600 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b5000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9394004800 0x7f93b013cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b5000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9394004800 0x7f93b013cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33532/0 (socket says 172.21.15.118:33532) 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b5000640 1 -- 172.21.15.118:0/3424781486 learned_addr learned my addr 172.21.15.118:0/3424781486 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93a7e00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b013d600 0x7f93b015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.459+0000 7f93b5a00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b013dae0 0x7f93b015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b5000640 1 -- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b013d600 msgr2=0x7f93b015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b5000640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b013d600 0x7f93b015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b5000640 1 -- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b013dae0 msgr2=0x7f93b015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b5000640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b013dae0 0x7f93b015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b5000640 1 -- 172.21.15.118:0/3424781486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b0163210 con 0x7f9394004800 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b5000640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9394004800 0x7f93b013cf90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93a0003d30 tx=0x7f93a0001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0015070 con 0x7f9394004800 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93a0011840 con 0x7f9394004800 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b01634f0 con 0x7f9394004800 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a0011c70 con 0x7f9394004800 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.460+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b0163ab0 con 0x7f9394004800 2024-09-21T06:07:36.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.462+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b00cca40 con 0x7f9394004800 2024-09-21T06:07:36.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.463+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93a0018070 con 0x7f9394004800 2024-09-21T06:07:36.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.464+0000 7f93ad600640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f938c078bc0 0x7f938c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.464+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f93a009b970 con 0x7f9394004800 2024-09-21T06:07:36.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.464+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=68}) -- 0x7f938c080740 con 0x7f9394004800 2024-09-21T06:07:36.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.464+0000 7f93a7e00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f938c078bc0 0x7f938c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.465+0000 7f93a7e00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f938c078bc0 0x7f938c07b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9398033000 tx=0x7f939803b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.468+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f93a0063750 con 0x7f9394004800 2024-09-21T06:07:36.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.690+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93b006dd00 con 0x7f9394004800 2024-09-21T06:07:36.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.691+0000 7f93ad600640 1 -- 172.21.15.118:0/3424781486 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7f93a0068180 con 0x7f9394004800 2024-09-21T06:07:36.693 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:36.693 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T06:06:20:487542+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:06:16.940252+0000","modified":"2024-09-21T06:06:19.973048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2029341341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2029341341},{"type":"v1","addr":"172.21.15.118:6835","nonce":2029341341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T06:07:36.693 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f938c078bc0 msgr2=0x7f938c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f938c078bc0 0x7f938c07b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9398033000 tx=0x7f939803b040 comp rx=0 tx=0).stop 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9394004800 msgr2=0x7f93b013cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9394004800 0x7f93b013cf90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93a0003d30 tx=0x7f93a0001800 comp rx=0 tx=0).stop 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 shutdown_connections 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b013dae0 0x7f93b015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f938c078bc0 0x7f938c07b0d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b013d600 0x7f93b015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 --2- 172.21.15.118:0/3424781486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9394004800 0x7f93b013cf90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 >> 172.21.15.118:0/3424781486 conn(0x7f93b006d110 msgr2=0x7f93b015fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:36.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.693+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 shutdown_connections 2024-09-21T06:07:36.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.694+0000 7f93b7a00640 1 -- 172.21.15.118:0/3424781486 wait complete. 2024-09-21T06:07:36.713 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:07:36.712+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-21T06:07:36.722 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:07:36.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.945+0000 7ff65b200640 1 -- 172.21.15.118:0/3596230168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 msgr2=0x7ff640005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.945+0000 7ff65b200640 1 --2- 172.21.15.118:0/3596230168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 0x7ff640005150 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff654005fd0 tx=0x7ff640005830 comp rx=0 tx=0).stop 2024-09-21T06:07:36.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.945+0000 7ff65a800640 1 -- 172.21.15.118:0/3596230168 reap_dead start 2024-09-21T06:07:36.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.945+0000 7ff65b200640 1 -- 172.21.15.118:0/3596230168 shutdown_connections 2024-09-21T06:07:36.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.945+0000 7ff65b200640 1 -- 172.21.15.118:0/3596230168 >> 172.21.15.118:0/3596230168 conn(0x7ff65c0d2900 msgr2=0x7ff65c0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:36.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.945+0000 7ff65b200640 1 -- 172.21.15.118:0/3596230168 shutdown_connections 2024-09-21T06:07:36.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.945+0000 7ff65b200640 1 -- 172.21.15.118:0/3596230168 wait complete. 2024-09-21T06:07:36.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.947+0000 7ff65b200640 1 Processor -- start 2024-09-21T06:07:36.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.947+0000 7ff65b200640 1 -- start start 2024-09-21T06:07:36.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff65b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 0x7ff65c09cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff65b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff65c1e5a90 0x7ff65c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff65b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c0cbdd0 0x7ff65c1e6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff65b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0b23c0 con 0x7ff640004d40 2024-09-21T06:07:36.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff65b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0b2240 con 0x7ff65c1e5a90 2024-09-21T06:07:36.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff65b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c0b2540 con 0x7ff65c0cbdd0 2024-09-21T06:07:36.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 0x7ff65c09cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 0x7ff65c09cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33564/0 (socket says 172.21.15.118:33564) 2024-09-21T06:07:36.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 -- 172.21.15.118:0/3958288237 learned_addr learned my addr 172.21.15.118:0/3958288237 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff65a800640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c0cbdd0 0x7ff65c1e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659400640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff65c1e5a90 0x7ff65c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 -- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c0cbdd0 msgr2=0x7ff65c1e6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c0cbdd0 0x7ff65c1e6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 -- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff65c1e5a90 msgr2=0x7ff65c0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff65c1e5a90 0x7ff65c0cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659e00640 1 -- 172.21.15.118:0/3958288237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c0cc1e0 con 0x7ff640004d40 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.949+0000 7ff659400640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff65c1e5a90 0x7ff65c0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.950+0000 7ff659e00640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 0x7ff65c09cf20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011c90 tx=0x7ff64c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:36.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.950+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c01e070 con 0x7ff640004d40 2024-09-21T06:07:36.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.950+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff64c00e7c0 con 0x7ff640004d40 2024-09-21T06:07:36.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.950+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00ebf0 con 0x7ff640004d40 2024-09-21T06:07:36.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.950+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65c1e88f0 con 0x7ff640004d40 2024-09-21T06:07:36.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.950+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65c09f4b0 con 0x7ff640004d40 2024-09-21T06:07:36.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.951+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65c0b2ad0 con 0x7ff640004d40 2024-09-21T06:07:36.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.952+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff64c021070 con 0x7ff640004d40 2024-09-21T06:07:36.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.953+0000 7ff652000640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff63c078bc0 0x7ff63c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:36.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.953+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7ff64c09be60 con 0x7ff640004d40 2024-09-21T06:07:36.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.953+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=69}) -- 0x7ff63c080740 con 0x7ff640004d40 2024-09-21T06:07:36.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.954+0000 7ff659400640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff63c078bc0 0x7ff63c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:36.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.954+0000 7ff659400640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff63c078bc0 0x7ff63c07b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff65c09cd80 tx=0x7ff6480067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:36.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:36.958+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff65c0cc1e0 con 0x7ff640004d40 2024-09-21T06:07:37.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.179+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff65c0ced10 con 0x7ff640004d40 2024-09-21T06:07:37.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.180+0000 7ff652000640 1 -- 172.21.15.118:0/3958288237 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7ff64c063bb0 con 0x7ff640004d40 2024-09-21T06:07:37.181 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:37.181 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T06:06:20:487542+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:06:16.940252+0000","modified":"2024-09-21T06:06:19.973048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2029341341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2029341341},{"type":"v1","addr":"172.21.15.118:6835","nonce":2029341341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T06:07:37.182 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T06:07:37.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff63c078bc0 msgr2=0x7ff63c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff63c078bc0 0x7ff63c07b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff65c09cd80 tx=0x7ff6480067a0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 msgr2=0x7ff65c09cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 0x7ff65c09cf20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011c90 tx=0x7ff64c00f790 comp rx=0 tx=0).stop 2024-09-21T06:07:37.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 shutdown_connections 2024-09-21T06:07:37.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff63c078bc0 0x7ff63c07b0d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c0cbdd0 0x7ff65c1e6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff65c1e5a90 0x7ff65c0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 --2- 172.21.15.118:0/3958288237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff640004d40 0x7ff65c09cf20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 >> 172.21.15.118:0/3958288237 conn(0x7ff65c0d2900 msgr2=0x7ff65c0cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:37.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 shutdown_connections 2024-09-21T06:07:37.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.182+0000 7ff65b200640 1 -- 172.21.15.118:0/3958288237 wait complete. 2024-09-21T06:07:37.206 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 -- 172.21.15.118:0/1460760837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 msgr2=0x7f458c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 --2- 172.21.15.118:0/1460760837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c0d0e80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4580005fd0 tx=0x7f458002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 -- 172.21.15.118:0/1460760837 shutdown_connections 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 --2- 172.21.15.118:0/1460760837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f458c142e40 0x7f458c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 --2- 172.21.15.118:0/1460760837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c0d0e80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 -- 172.21.15.118:0/1460760837 >> 172.21.15.118:0/1460760837 conn(0x7f458c06d110 msgr2=0x7f458c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 -- 172.21.15.118:0/1460760837 shutdown_connections 2024-09-21T06:07:37.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.425+0000 7f4594800640 1 -- 172.21.15.118:0/1460760837 wait complete. 2024-09-21T06:07:37.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.427+0000 7f4594800640 1 Processor -- start 2024-09-21T06:07:37.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.428+0000 7f4594800640 1 -- start start 2024-09-21T06:07:37.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4594800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4594800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f458c13fef0 0x7f458c13e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4594800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f458c142e40 0x7f458c141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4594800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0cfa90 con 0x7f458c13fae0 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4594800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0cf910 con 0x7f458c13fef0 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4594800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f458c0cfc10 con 0x7f458c142e40 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4591e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4591e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c15a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33586/0 (socket says 172.21.15.118:33586) 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4591e00640 1 -- 172.21.15.118:0/146892667 learned_addr learned my addr 172.21.15.118:0/146892667 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4591400640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f458c13fef0 0x7f458c13e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.429+0000 7f4592800640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f458c142e40 0x7f458c141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4591e00640 1 -- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f458c142e40 msgr2=0x7f458c141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4591e00640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f458c142e40 0x7f458c141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4591e00640 1 -- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f458c13fef0 msgr2=0x7f458c13e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4591e00640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f458c13fef0 0x7f458c13e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4591e00640 1 -- 172.21.15.118:0/146892667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c15adb0 con 0x7f458c13fae0 2024-09-21T06:07:37.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4591e00640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c15a410 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4580034040 tx=0x7f4580005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458003e030 con 0x7f458c13fae0 2024-09-21T06:07:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4580003a70 con 0x7f458c13fae0 2024-09-21T06:07:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.430+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580035040 con 0x7f458c13fae0 2024-09-21T06:07:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.431+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c1403a0 con 0x7f458c13fae0 2024-09-21T06:07:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.431+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c140960 con 0x7f458c13fae0 2024-09-21T06:07:37.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.432+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458c0d0130 con 0x7f458c13fae0 2024-09-21T06:07:37.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.433+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4580041030 con 0x7f458c13fae0 2024-09-21T06:07:37.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.434+0000 7f4586000640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4570078b90 0x7f457007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.434+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f45800bb150 con 0x7f458c13fae0 2024-09-21T06:07:37.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.434+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=69}) -- 0x7f4570080710 con 0x7f458c13fae0 2024-09-21T06:07:37.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.434+0000 7f4591400640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4570078b90 0x7f457007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.435+0000 7f4591400640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4570078b90 0x7f457007b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f457c007fd0 tx=0x7f457c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:37.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.438+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4580082f30 con 0x7f458c13fae0 2024-09-21T06:07:37.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.628+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f458c15b4a0 con 0x7f458c13fae0 2024-09-21T06:07:37.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.629+0000 7f4586000640 1 -- 172.21.15.118:0/146892667 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16863 (secure 0 0 0) 0x7f4580087960 con 0x7f458c13fae0 2024-09-21T06:07:37.631 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:37.631 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:07:36.712936+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:06:14.853192+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:06:15.905084+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:07:37.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4570078b90 msgr2=0x7f457007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4570078b90 0x7f457007b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f457c007fd0 tx=0x7f457c009040 comp rx=0 tx=0).stop 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 msgr2=0x7f458c15a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c15a410 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4580034040 tx=0x7f4580005770 comp rx=0 tx=0).stop 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 shutdown_connections 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4570078b90 0x7f457007b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f458c142e40 0x7f458c141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f458c13fef0 0x7f458c13e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 --2- 172.21.15.118:0/146892667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f458c13fae0 0x7f458c15a410 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 >> 172.21.15.118:0/146892667 conn(0x7f458c06d110 msgr2=0x7f458c142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 shutdown_connections 2024-09-21T06:07:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.632+0000 7f4594800640 1 -- 172.21.15.118:0/146892667 wait complete. 2024-09-21T06:07:37.659 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:07:37.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 -- 172.21.15.118:0/3729607151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b013fae0 msgr2=0x7f00b00d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 --2- 172.21.15.118:0/3729607151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b013fae0 0x7f00b00d0e80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f00b00ceaa0 tx=0x7f00a002a560 comp rx=0 tx=0).stop 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 -- 172.21.15.118:0/3729607151 shutdown_connections 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 --2- 172.21.15.118:0/3729607151 >> v2:172.21.15.149:3300/0 conn(0x7f00b0142730 0x7f00b0142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 --2- 172.21.15.118:0/3729607151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b013fef0 0x7f00b00d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 --2- 172.21.15.118:0/3729607151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b013fae0 0x7f00b00d0e80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 -- 172.21.15.118:0/3729607151 >> 172.21.15.118:0/3729607151 conn(0x7f00b006d110 msgr2=0x7f00b006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:37.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 -- 172.21.15.118:0/3729607151 shutdown_connections 2024-09-21T06:07:37.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.880+0000 7f00b4c00640 1 -- 172.21.15.118:0/3729607151 wait complete. 2024-09-21T06:07:37.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.882+0000 7f00b4c00640 1 Processor -- start 2024-09-21T06:07:37.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.882+0000 7f00b4c00640 1 -- start start 2024-09-21T06:07:37.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00b4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b013fae0 0x7f00b0156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00b4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b013fef0 0x7f00b0141560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00b4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b0142730 0x7f00b01efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00b4c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f00b006f370 con 0x7f00b0142730 2024-09-21T06:07:37.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00b4c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f00b006f1f0 con 0x7f00b013fef0 2024-09-21T06:07:37.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00b4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00b006f4f0 con 0x7f00b013fae0 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00ae800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b0142730 0x7f00b01efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00ae800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b0142730 0x7f00b01efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33590/0 (socket says 172.21.15.118:33590) 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00ae800640 1 -- 172.21.15.118:0/1986403217 learned_addr learned my addr 172.21.15.118:0/1986403217 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.884+0000 7f00ade00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b013fae0 0x7f00b0156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00ad400640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b013fef0 0x7f00b0141560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00ae800640 1 -- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b013fae0 msgr2=0x7f00b0156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00ae800640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b013fae0 0x7f00b0156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00ae800640 1 -- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b013fef0 msgr2=0x7f00b0141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00ae800640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b013fef0 0x7f00b0141560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00ae800640 1 -- 172.21.15.118:0/1986403217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b01f9880 con 0x7f00b0142730 2024-09-21T06:07:37.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00ae800640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b0142730 0x7f00b01efb10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f00a800e960 tx=0x7f00a800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:37.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004d20 con 0x7f00b0142730 2024-09-21T06:07:37.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00a800cb20 con 0x7f00b0142730 2024-09-21T06:07:37.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b01f9b60 con 0x7f00b0142730 2024-09-21T06:07:37.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.885+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8005020 con 0x7f00b0142730 2024-09-21T06:07:37.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.886+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b01fa120 con 0x7f00b0142730 2024-09-21T06:07:37.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.887+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b006fa10 con 0x7f00b0142730 2024-09-21T06:07:37.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.888+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00a80051c0 con 0x7f00b0142730 2024-09-21T06:07:37.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.889+0000 7f00a6000640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0090078bc0 0x7f009007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:37.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.889+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f00a809b570 con 0x7f00b0142730 2024-09-21T06:07:37.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.890+0000 7f00ade00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0090078bc0 0x7f009007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:37.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.890+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7f0090080740 con 0x7f00b0142730 2024-09-21T06:07:37.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.890+0000 7f00ade00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0090078bc0 0x7f009007b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f00a0033000 tx=0x7f00a0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:37.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:37.894+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f00a8099e20 con 0x7f00b0142730 2024-09-21T06:07:38.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.113+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00b015c950 con 0x7f00b0142730 2024-09-21T06:07:38.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.113+0000 7f00a6000640 1 -- 172.21.15.118:0/1986403217 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7f00a8016030 con 0x7f00b0142730 2024-09-21T06:07:38.115 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:38.115 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T06:06:20:487542+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:06:16.940252+0000","modified":"2024-09-21T06:06:19.973048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2029341341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2029341341},{"type":"v1","addr":"172.21.15.118:6835","nonce":2029341341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T06:07:38.115 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0090078bc0 msgr2=0x7f009007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0090078bc0 0x7f009007b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f00a0033000 tx=0x7f00a0004730 comp rx=0 tx=0).stop 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b0142730 msgr2=0x7f00b01efb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b0142730 0x7f00b01efb10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f00a800e960 tx=0x7f00a800ee20 comp rx=0 tx=0).stop 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 shutdown_connections 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00b0142730 0x7f00b01efb10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b013fef0 0x7f00b0141560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0090078bc0 0x7f009007b0d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 --2- 172.21.15.118:0/1986403217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b013fae0 0x7f00b0156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 >> 172.21.15.118:0/1986403217 conn(0x7f00b006d110 msgr2=0x7f00b01609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:38.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 shutdown_connections 2024-09-21T06:07:38.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.116+0000 7f00b4c00640 1 -- 172.21.15.118:0/1986403217 wait complete. 2024-09-21T06:07:38.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:07:38.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 -- 172.21.15.118:0/3964971592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0b2030 msgr2=0x7fd83c0b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 --2- 172.21.15.118:0/3964971592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0b2030 0x7fd83c0b2440 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0747a0 tx=0x7fd83402a980 comp rx=0 tx=0).stop 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 -- 172.21.15.118:0/3964971592 shutdown_connections 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 --2- 172.21.15.118:0/3964971592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0b2030 0x7fd83c0b2440 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 --2- 172.21.15.118:0/3964971592 >> v2:172.21.15.149:3300/0 conn(0x7fd83c0cf140 0x7fd83c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 --2- 172.21.15.118:0/3964971592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c0b7b90 0x7fd83c0d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 -- 172.21.15.118:0/3964971592 >> 172.21.15.118:0/3964971592 conn(0x7fd83c0d2900 msgr2=0x7fd83c0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 -- 172.21.15.118:0/3964971592 shutdown_connections 2024-09-21T06:07:38.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.364+0000 7fd842a00640 1 -- 172.21.15.118:0/3964971592 wait complete. 2024-09-21T06:07:38.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.366+0000 7fd842a00640 1 Processor -- start 2024-09-21T06:07:38.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.366+0000 7fd842a00640 1 -- start start 2024-09-21T06:07:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c0b2030 0x7fd83c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd83c0b7b90 0x7fd83c1e0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0cf140 0x7fd83c1e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0b2d10 con 0x7fd83c0cf140 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c0b2b90 con 0x7fd83c0b7b90 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd83c0cd410 con 0x7fd83c0b2030 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0cf140 0x7fd83c1e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd841600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c0b2030 0x7fd83c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0cf140 0x7fd83c1e3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33594/0 (socket says 172.21.15.118:33594) 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 -- 172.21.15.118:0/2625237037 learned_addr learned my addr 172.21.15.118:0/2625237037 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd840c00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd83c0b7b90 0x7fd83c1e0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 -- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c0b2030 msgr2=0x7fd83c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c0b2030 0x7fd83c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 -- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd83c0b7b90 msgr2=0x7fd83c1e0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd83c0b7b90 0x7fd83c1e0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.368+0000 7fd842000640 1 -- 172.21.15.118:0/2625237037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c1f6780 con 0x7fd83c0cf140 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.369+0000 7fd840c00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd83c0b7b90 0x7fd83c1e0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.369+0000 7fd842000640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0cf140 0x7fd83c1e3f00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd834033040 tx=0x7fd834003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.369+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834034040 con 0x7fd83c0cf140 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.369+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd834004540 con 0x7fd83c0cf140 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.369+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c1f6a60 con 0x7fd83c0cf140 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.369+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834045480 con 0x7fd83c0cf140 2024-09-21T06:07:38.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.369+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c06e4f0 con 0x7fd83c0cf140 2024-09-21T06:07:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.370+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83c1e98e0 con 0x7fd83c0cf140 2024-09-21T06:07:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.371+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd834037020 con 0x7fd83c0cf140 2024-09-21T06:07:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.372+0000 7fd839600640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd81c078b90 0x7fd81c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.372+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fd8340bc4f0 con 0x7fd83c0cf140 2024-09-21T06:07:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.373+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7fd81c080770 con 0x7fd83c0cf140 2024-09-21T06:07:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.373+0000 7fd841600640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd81c078b90 0x7fd81c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.374+0000 7fd841600640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd81c078b90 0x7fd81c07b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd830009b80 tx=0x7fd830005f30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:38.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.376+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd8340848a0 con 0x7fd83c0cf140 2024-09-21T06:07:38.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.598+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd83c06e750 con 0x7fd83c0cf140 2024-09-21T06:07:38.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.599+0000 7fd839600640 1 -- 172.21.15.118:0/2625237037 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7fd8340841a0 con 0x7fd83c0cf140 2024-09-21T06:07:38.600 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:38.600 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"btime":"2024-09-21T06:06:20:487542+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:06:16.940252+0000","modified":"2024-09-21T06:06:19.973048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2029341341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2029341341},{"type":"v1","addr":"172.21.15.118:6835","nonce":2029341341}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T06:07:38.601 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 34 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd81c078b90 msgr2=0x7fd81c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd81c078b90 0x7fd81c07b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd830009b80 tx=0x7fd830005f30 comp rx=0 tx=0).stop 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0cf140 msgr2=0x7fd83c1e3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0cf140 0x7fd83c1e3f00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd834033040 tx=0x7fd834003f10 comp rx=0 tx=0).stop 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 shutdown_connections 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd83c0cf140 0x7fd83c1e3f00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd83c0b7b90 0x7fd83c1e0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd81c078b90 0x7fd81c07b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 --2- 172.21.15.118:0/2625237037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd83c0b2030 0x7fd83c0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 >> 172.21.15.118:0/2625237037 conn(0x7fd83c0d2900 msgr2=0x7fd83c1e5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:38.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 shutdown_connections 2024-09-21T06:07:38.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.601+0000 7fd842a00640 1 -- 172.21.15.118:0/2625237037 wait complete. 2024-09-21T06:07:38.625 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:07:38.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 -- 172.21.15.118:0/3050460345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 msgr2=0x7f9b200d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 --2- 172.21.15.118:0/3050460345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b200d0ee0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9b20154510 tx=0x7f9b1402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 -- 172.21.15.118:0/3050460345 shutdown_connections 2024-09-21T06:07:38.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 --2- 172.21.15.118:0/3050460345 >> v2:172.21.15.149:3300/0 conn(0x7f9b200d1420 0x7f9b201426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 --2- 172.21.15.118:0/3050460345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b200d0ee0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 -- 172.21.15.118:0/3050460345 >> 172.21.15.118:0/3050460345 conn(0x7f9b2006d110 msgr2=0x7f9b2006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:38.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 -- 172.21.15.118:0/3050460345 shutdown_connections 2024-09-21T06:07:38.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.846+0000 7f9b28800640 1 -- 172.21.15.118:0/3050460345 wait complete. 2024-09-21T06:07:38.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.848+0000 7f9b28800640 1 Processor -- start 2024-09-21T06:07:38.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.849+0000 7f9b28800640 1 -- start start 2024-09-21T06:07:38.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b28800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b200d1420 0x7f9b2013b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b28800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b201f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b28800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b20142c00 0x7f9b200b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b28800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9b201431b0 con 0x7f9b2013fe10 2024-09-21T06:07:38.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b28800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9b200d0460 con 0x7f9b200d1420 2024-09-21T06:07:38.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b28800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2006f3e0 con 0x7f9b20142c00 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b25400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b201f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b25400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b201f9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33620/0 (socket says 172.21.15.118:33620) 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b25400640 1 -- 172.21.15.118:0/3302099631 learned_addr learned my addr 172.21.15.118:0/3302099631 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.850+0000 7f9b25e00640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b200d1420 0x7f9b2013b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b26800640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b20142c00 0x7f9b200b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b25400640 1 -- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b20142c00 msgr2=0x7f9b200b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b25400640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b20142c00 0x7f9b200b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b25400640 1 -- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b200d1420 msgr2=0x7f9b2013b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b25400640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b200d1420 0x7f9b2013b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:38.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b25400640 1 -- 172.21.15.118:0/3302099631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b201fa7a0 con 0x7f9b2013fe10 2024-09-21T06:07:38.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b25400640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b201f9be0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000d650 tx=0x7f9b1000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:38.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10017070 con 0x7f9b2013fe10 2024-09-21T06:07:38.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b10005310 con 0x7f9b2013fe10 2024-09-21T06:07:38.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10009820 con 0x7f9b2013fe10 2024-09-21T06:07:38.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.851+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b201f6790 con 0x7f9b2013fe10 2024-09-21T06:07:38.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.852+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b201f6d50 con 0x7f9b2013fe10 2024-09-21T06:07:38.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.853+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b200b35c0 con 0x7f9b2013fe10 2024-09-21T06:07:38.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.854+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b100099c0 con 0x7f9b2013fe10 2024-09-21T06:07:38.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.855+0000 7f9b1a000640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b04078b90 0x7f9b0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:38.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.855+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f9b1009ad80 con 0x7f9b2013fe10 2024-09-21T06:07:38.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.855+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7f9b04080710 con 0x7f9b2013fe10 2024-09-21T06:07:38.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.855+0000 7f9b25e00640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b04078b90 0x7f9b0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:38.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.856+0000 7f9b25e00640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b04078b90 0x7f9b0407b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b14033000 tx=0x7f9b14004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:38.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:38.859+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9b200b35c0 con 0x7f9b2013fe10 2024-09-21T06:07:39.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.045+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b2006f8c0 con 0x7f9b2013fe10 2024-09-21T06:07:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.047+0000 7f9b1a000640 1 -- 172.21.15.118:0/3302099631 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16819 (secure 0 0 0) 0x7f9b10062b70 con 0x7f9b2013fe10 2024-09-21T06:07:39.048 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:39.049 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":70,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:07:38.728735+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:06:14.853192+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:06:15.905084+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b04078b90 msgr2=0x7f9b0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b04078b90 0x7f9b0407b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b14033000 tx=0x7f9b14004730 comp rx=0 tx=0).stop 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 msgr2=0x7f9b201f9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b201f9be0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000d650 tx=0x7f9b1000db10 comp rx=0 tx=0).stop 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 shutdown_connections 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9b04078b90 0x7f9b0407b0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b20142c00 0x7f9b200b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b2013fe10 0x7f9b201f9be0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 --2- 172.21.15.118:0/3302099631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b200d1420 0x7f9b2013b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 >> 172.21.15.118:0/3302099631 conn(0x7f9b2006d110 msgr2=0x7f9b2015eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:39.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 shutdown_connections 2024-09-21T06:07:39.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.049+0000 7f9b28800640 1 -- 172.21.15.118:0/3302099631 wait complete. 2024-09-21T06:07:39.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:07:39.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.294+0000 7f0baea00640 1 -- 172.21.15.118:0/4153319405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 msgr2=0x7f0b8c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.294+0000 7f0baea00640 1 --2- 172.21.15.118:0/4153319405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0b8c004c10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009b50 tx=0x7f0b8c005830 comp rx=0 tx=0).stop 2024-09-21T06:07:39.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.294+0000 7f0baea00640 1 -- 172.21.15.118:0/4153319405 shutdown_connections 2024-09-21T06:07:39.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.294+0000 7f0baea00640 1 --2- 172.21.15.118:0/4153319405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0b8c004c10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.294+0000 7f0baea00640 1 -- 172.21.15.118:0/4153319405 >> 172.21.15.118:0/4153319405 conn(0x7f0ba806d110 msgr2=0x7f0ba806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:39.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.294+0000 7f0baea00640 1 -- 172.21.15.118:0/4153319405 shutdown_connections 2024-09-21T06:07:39.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.294+0000 7f0baea00640 1 -- 172.21.15.118:0/4153319405 wait complete. 2024-09-21T06:07:39.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.297+0000 7f0baea00640 1 Processor -- start 2024-09-21T06:07:39.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.297+0000 7f0baea00640 1 -- start start 2024-09-21T06:07:39.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0baea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0ba81f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0baea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba8155910 0x7f0ba813b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0baea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba815f9d0 0x7f0ba815fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0baea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba8160ff0 con 0x7f0b8c004800 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0baea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba80d1450 con 0x7f0ba8155910 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0baea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba8161170 con 0x7f0ba815f9d0 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0ba81f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0ba81f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33630/0 (socket says 172.21.15.118:33630) 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 -- 172.21.15.118:0/3993952087 learned_addr learned my addr 172.21.15.118:0/3993952087 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0baca00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba815f9d0 0x7f0ba815fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7400640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba8155910 0x7f0ba813b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 -- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba815f9d0 msgr2=0x7f0ba815fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba815f9d0 0x7f0ba815fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 -- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba8155910 msgr2=0x7f0ba813b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba8155910 0x7f0ba813b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7e00640 1 -- 172.21.15.118:0/3993952087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba8160320 con 0x7f0b8c004800 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.299+0000 7f0ba7400640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba8155910 0x7f0ba813b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.300+0000 7f0ba7e00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0ba81f8de0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0b980062c0 tx=0x7f0b980066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.300+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800f930 con 0x7f0b8c004800 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.300+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b98016020 con 0x7f0b8c004800 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.300+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba813bdc0 con 0x7f0b8c004800 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.300+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800fd90 con 0x7f0b8c004800 2024-09-21T06:07:39.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.300+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba81f99c0 con 0x7f0b8c004800 2024-09-21T06:07:39.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.301+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba81616d0 con 0x7f0b8c004800 2024-09-21T06:07:39.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.302+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b98011430 con 0x7f0b8c004800 2024-09-21T06:07:39.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.303+0000 7f0b9fe00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b88078b90 0x7f0b8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.303+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f0b9809bb80 con 0x7f0b8c004800 2024-09-21T06:07:39.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.303+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7f0b88080710 con 0x7f0b8c004800 2024-09-21T06:07:39.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.304+0000 7f0ba7400640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b88078b90 0x7f0b8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.304+0000 7f0ba7400640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b88078b90 0x7f0b8807b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0b94035000 tx=0x7f0b940046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:39.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.308+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b98020020 con 0x7f0b8c004800 2024-09-21T06:07:39.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.534+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0ba80d03e0 con 0x7f0b8c004800 2024-09-21T06:07:39.537 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:07:39.535+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:07:39.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.538+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f0ba8160320 con 0x7f0b8c004800 2024-09-21T06:07:39.539 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:07:39.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.538+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(71..71 src has 1..71) ==== 1554+0+0 (secure 0 0 0) 0x7f0b9800ada0 con 0x7f0b8c004800 2024-09-21T06:07:39.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.538+0000 7f0b9fe00640 1 -- 172.21.15.118:0/3993952087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=72}) -- 0x7f0b88081ab0 con 0x7f0b8c004800 2024-09-21T06:07:39.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.542+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b88078b90 msgr2=0x7f0b8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.542+0000 7f0baea00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b88078b90 0x7f0b8807b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0b94035000 tx=0x7f0b940046c0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.542+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 msgr2=0x7f0ba81f8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.542+0000 7f0baea00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0ba81f8de0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0b980062c0 tx=0x7f0b980066c0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 shutdown_connections 2024-09-21T06:07:39.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b88078b90 0x7f0b8807b0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba815f9d0 0x7f0ba815fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba8155910 0x7f0ba813b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 --2- 172.21.15.118:0/3993952087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b8c004800 0x7f0ba81f8de0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 >> 172.21.15.118:0/3993952087 conn(0x7f0ba806d110 msgr2=0x7f0ba81414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:39.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 shutdown_connections 2024-09-21T06:07:39.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.545+0000 7f0baea00640 1 -- 172.21.15.118:0/3993952087 wait complete. 2024-09-21T06:07:39.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:07:39.683 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:07:39.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.801+0000 7f8822800640 1 -- 172.21.15.118:0/2835395963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c0d0ea0 msgr2=0x7f881c0d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.801+0000 7f8822800640 1 --2- 172.21.15.118:0/2835395963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c0d0ea0 0x7f881c0d12b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8808005fd0 tx=0x7f880802a540 comp rx=0 tx=0).stop 2024-09-21T06:07:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.802+0000 7f8822800640 1 -- 172.21.15.118:0/2835395963 shutdown_connections 2024-09-21T06:07:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.802+0000 7f8822800640 1 --2- 172.21.15.118:0/2835395963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c0d0ea0 0x7f881c0d12b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.802+0000 7f8822800640 1 --2- 172.21.15.118:0/2835395963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f881c13fd80 0x7f881c15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.802+0000 7f8822800640 1 -- 172.21.15.118:0/2835395963 >> 172.21.15.118:0/2835395963 conn(0x7f881c06d110 msgr2=0x7f881c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.802+0000 7f8822800640 1 -- 172.21.15.118:0/2835395963 shutdown_connections 2024-09-21T06:07:39.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.802+0000 7f8822800640 1 -- 172.21.15.118:0/2835395963 wait complete. 2024-09-21T06:07:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.804+0000 7f8822800640 1 Processor -- start 2024-09-21T06:07:39.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.804+0000 7f8822800640 1 -- start start 2024-09-21T06:07:39.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.805+0000 7f8822800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f881c0d0ea0 0x7f881c1f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.805+0000 7f8822800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f881c13fd80 0x7f881c13aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.805+0000 7f8822800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c160b20 0x7f881c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.805+0000 7f8822800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f881c15e300 con 0x7f881c160b20 2024-09-21T06:07:39.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.805+0000 7f8822800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f881c15e180 con 0x7f881c13fd80 2024-09-21T06:07:39.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.805+0000 7f8822800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f881c15d680 con 0x7f881c0d0ea0 2024-09-21T06:07:39.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c160b20 0x7f881c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c160b20 0x7f881c13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33666/0 (socket says 172.21.15.118:33666) 2024-09-21T06:07:39.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 -- 172.21.15.118:0/2374789737 learned_addr learned my addr 172.21.15.118:0/2374789737 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:39.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881b400640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f881c0d0ea0 0x7f881c1f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881aa00640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f881c13fd80 0x7f881c13aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 -- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f881c0d0ea0 msgr2=0x7f881c1f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f881c0d0ea0 0x7f881c1f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 -- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f881c13fd80 msgr2=0x7f881c13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:39.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f881c13fd80 0x7f881c13aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:39.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 -- 172.21.15.118:0/2374789737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c0b5c70 con 0x7f881c160b20 2024-09-21T06:07:39.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.806+0000 7f881be00640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c160b20 0x7f881c13b410 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f881400c760 tx=0x7f881400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:39.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.807+0000 7f8813400640 1 -- 172.21.15.118:0/2374789737 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814003b70 con 0x7f881c160b20 2024-09-21T06:07:39.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.807+0000 7f8813400640 1 -- 172.21.15.118:0/2374789737 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8814003d10 con 0x7f881c160b20 2024-09-21T06:07:39.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.807+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c152420 con 0x7f881c160b20 2024-09-21T06:07:39.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.807+0000 7f8813400640 1 -- 172.21.15.118:0/2374789737 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814005330 con 0x7f881c160b20 2024-09-21T06:07:39.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.807+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c140800 con 0x7f881c160b20 2024-09-21T06:07:39.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.808+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c1616d0 con 0x7f881c160b20 2024-09-21T06:07:39.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.809+0000 7f8813400640 1 -- 172.21.15.118:0/2374789737 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88140054d0 con 0x7f881c160b20 2024-09-21T06:07:39.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.811+0000 7f8813400640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f87fc078b90 0x7f87fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:39.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.811+0000 7f8813400640 1 -- 172.21.15.118:0/2374789737 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5795+0+0 (secure 0 0 0) 0x7f881409aac0 con 0x7f881c160b20 2024-09-21T06:07:39.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.811+0000 7f881b400640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f87fc078b90 0x7f87fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:39.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.812+0000 7f881b400640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f87fc078b90 0x7f87fc07b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f880c004630 tx=0x7f880c00b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:39.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:39.815+0000 7f8813400640 1 -- 172.21.15.118:0/2374789737 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f881c0d17f0 con 0x7f881c160b20 2024-09-21T06:07:40.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.039+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f881c06dd00 con 0x7f881c160b20 2024-09-21T06:07:40.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.540+0000 7f8813400640 1 -- 172.21.15.118:0/2374789737 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7f88140627b0 con 0x7f881c160b20 2024-09-21T06:07:40.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.542+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f87fc078b90 msgr2=0x7f87fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:40.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.542+0000 7f8822800640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f87fc078b90 0x7f87fc07b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f880c004630 tx=0x7f880c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c160b20 msgr2=0x7f881c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:40.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c160b20 0x7f881c13b410 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f881400c760 tx=0x7f881400cb60 comp rx=0 tx=0).stop 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 shutdown_connections 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f881c160b20 0x7f881c13b410 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f881c13fd80 0x7f881c13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f87fc078b90 0x7f87fc07b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 --2- 172.21.15.118:0/2374789737 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f881c0d0ea0 0x7f881c1f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 >> 172.21.15.118:0/2374789737 conn(0x7f881c06d110 msgr2=0x7f881c13d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 shutdown_connections 2024-09-21T06:07:40.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.543+0000 7f8822800640 1 -- 172.21.15.118:0/2374789737 wait complete. 2024-09-21T06:07:40.571 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:07:40.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.797+0000 7f7e11000640 1 -- 172.21.15.118:0/3316497704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 msgr2=0x7f7e0c0b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:40.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.797+0000 7f7e11000640 1 --2- 172.21.15.118:0/3316497704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c0b5e10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009830 tx=0x7f7dfc02a5b0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.797+0000 7f7e11000640 1 -- 172.21.15.118:0/3316497704 shutdown_connections 2024-09-21T06:07:40.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.797+0000 7f7e11000640 1 --2- 172.21.15.118:0/3316497704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c0b5e10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.797+0000 7f7e11000640 1 -- 172.21.15.118:0/3316497704 >> 172.21.15.118:0/3316497704 conn(0x7f7e0c0b4800 msgr2=0x7f7e0c0b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:40.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.797+0000 7f7e11000640 1 -- 172.21.15.118:0/3316497704 shutdown_connections 2024-09-21T06:07:40.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.797+0000 7f7e11000640 1 -- 172.21.15.118:0/3316497704 wait complete. 2024-09-21T06:07:40.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.799+0000 7f7e11000640 1 Processor -- start 2024-09-21T06:07:40.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.799+0000 7f7e11000640 1 -- start start 2024-09-21T06:07:40.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e11000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e0c0d13f0 0x7f7e0c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e11000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e11000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e0c160b50 0x7f7e0c0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e11000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0d2090 con 0x7f7e0c1465d0 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e11000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0d1f10 con 0x7f7e0c160b50 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e11000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c0d2210 con 0x7f7e0c0d13f0 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e01400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e01400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33682/0 (socket says 172.21.15.118:33682) 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e01400640 1 -- 172.21.15.118:0/3548445204 learned_addr learned my addr 172.21.15.118:0/3548445204 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e09e00640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e0c0d13f0 0x7f7e0c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:40.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.801+0000 7f7e0a800640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e0c160b50 0x7f7e0c0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:40.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e01400640 1 -- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e0c0d13f0 msgr2=0x7f7e0c0b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:40.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e01400640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e0c0d13f0 0x7f7e0c0b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e01400640 1 -- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e0c160b50 msgr2=0x7f7e0c0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e01400640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e0c160b50 0x7f7e0c0b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e01400640 1 -- 172.21.15.118:0/3548445204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c155560 con 0x7f7e0c1465d0 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e01400640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c145320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c430 tx=0x7f7df400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e02a00640 1 -- 172.21.15.118:0/3548445204 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4011790 con 0x7f7e0c1465d0 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e02a00640 1 -- 172.21.15.118:0/3548445204 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df4017070 con 0x7f7e0c1465d0 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c155840 con 0x7f7e0c1465d0 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e02a00640 1 -- 172.21.15.118:0/3548445204 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4011ce0 con 0x7f7e0c1465d0 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.802+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c1560e0 con 0x7f7e0c1465d0 2024-09-21T06:07:40.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.803+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c0d2730 con 0x7f7e0c1465d0 2024-09-21T06:07:40.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.804+0000 7f7e02a00640 1 -- 172.21.15.118:0/3548445204 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7df401c460 con 0x7f7e0c1465d0 2024-09-21T06:07:40.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.806+0000 7f7e02a00640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7de8078b90 0x7f7de807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:40.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.806+0000 7f7e02a00640 1 -- 172.21.15.118:0/3548445204 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5795+0+0 (secure 0 0 0) 0x7f7df409aa60 con 0x7f7e0c1465d0 2024-09-21T06:07:40.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.806+0000 7f7e09e00640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7de8078b90 0x7f7de807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:40.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.807+0000 7f7e09e00640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7de8078b90 0x7f7de807b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:40.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.810+0000 7f7e02a00640 1 -- 172.21.15.118:0/3548445204 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7df40627f0 con 0x7f7e0c1465d0 2024-09-21T06:07:40.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:40.995+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7e0c155a10 con 0x7f7e0c1465d0 2024-09-21T06:07:41.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.749+0000 7f7e02a00640 1 -- 172.21.15.118:0/3548445204 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) ==== 181+0+0 (secure 0 0 0) 0x7f7df4067220 con 0x7f7e0c1465d0 2024-09-21T06:07:41.751 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:07:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7de8078b90 msgr2=0x7f7de807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7de8078b90 0x7f7de807b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc004730 comp rx=0 tx=0).stop 2024-09-21T06:07:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 msgr2=0x7f7e0c145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c145320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c430 tx=0x7f7df400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:07:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 shutdown_connections 2024-09-21T06:07:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e0c160b50 0x7f7e0c0b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e0c1465d0 0x7f7e0c145320 secure :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c430 tx=0x7f7df400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:07:41.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7de8078b90 0x7f7de807b0a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:41.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 --2- 172.21.15.118:0/3548445204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e0c0d13f0 0x7f7e0c0b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:41.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.755+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 >> 172.21.15.118:0/3548445204 conn(0x7f7e0c0b4800 msgr2=0x7f7e0c15b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:41.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.758+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 shutdown_connections 2024-09-21T06:07:41.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:41.758+0000 7f7e11000640 1 -- 172.21.15.118:0/3548445204 wait complete. 2024-09-21T06:07:41.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:07:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.009+0000 7f0b95600640 1 -- 172.21.15.118:0/1378419448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900701f0 msgr2=0x7f0b900ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.009+0000 7f0b95600640 1 --2- 172.21.15.118:0/1378419448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900701f0 0x7f0b900ce1e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0b80005fd0 tx=0x7f0b8002a940 comp rx=0 tx=0).stop 2024-09-21T06:07:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.009+0000 7f0b95600640 1 -- 172.21.15.118:0/1378419448 shutdown_connections 2024-09-21T06:07:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.009+0000 7f0b95600640 1 --2- 172.21.15.118:0/1378419448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900701f0 0x7f0b900ce1e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.009+0000 7f0b95600640 1 -- 172.21.15.118:0/1378419448 >> 172.21.15.118:0/1378419448 conn(0x7f0b9006cf30 msgr2=0x7f0b9006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.009+0000 7f0b95600640 1 -- 172.21.15.118:0/1378419448 shutdown_connections 2024-09-21T06:07:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.009+0000 7f0b95600640 1 -- 172.21.15.118:0/1378419448 wait complete. 2024-09-21T06:07:42.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.011+0000 7f0b95600640 1 Processor -- start 2024-09-21T06:07:42.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.011+0000 7f0b95600640 1 -- start start 2024-09-21T06:07:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b95600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b900701f0 0x7f0b9013fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b95600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900b3e00 0x7f0b90135150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b95600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b90160a50 0x7f0b901f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b95600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b900cf210 con 0x7f0b900b3e00 2024-09-21T06:07:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b95600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b900cf090 con 0x7f0b900701f0 2024-09-21T06:07:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b95600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0b900cf390 con 0x7f0b90160a50 2024-09-21T06:07:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b8e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900b3e00 0x7f0b90135150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b8e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900b3e00 0x7f0b90135150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33702/0 (socket says 172.21.15.118:33702) 2024-09-21T06:07:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b8e000640 1 -- 172.21.15.118:0/795287350 learned_addr learned my addr 172.21.15.118:0/795287350 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b8ea00640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b900701f0 0x7f0b9013fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b8e000640 1 -- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b90160a50 msgr2=0x7f0b901f94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b8e000640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b90160a50 0x7f0b901f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.013+0000 7f0b8e000640 1 -- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b900701f0 msgr2=0x7f0b9013fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b8e000640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b900701f0 0x7f0b9013fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b8e000640 1 -- 172.21.15.118:0/795287350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9013d190 con 0x7f0b900b3e00 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b8ea00640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b900701f0 0x7f0b9013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b8e000640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900b3e00 0x7f0b90135150 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c430 tx=0x7f0b7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b86a00640 1 -- 172.21.15.118:0/795287350 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c017070 con 0x7f0b900b3e00 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b86a00640 1 -- 172.21.15.118:0/795287350 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b7c0053c0 con 0x7f0b900b3e00 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9013d470 con 0x7f0b900b3e00 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b86a00640 1 -- 172.21.15.118:0/795287350 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c003850 con 0x7f0b900b3e00 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.014+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b90140310 con 0x7f0b900b3e00 2024-09-21T06:07:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.015+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b900742b0 con 0x7f0b900b3e00 2024-09-21T06:07:42.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.017+0000 7f0b86a00640 1 -- 172.21.15.118:0/795287350 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b7c01a070 con 0x7f0b900b3e00 2024-09-21T06:07:42.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.017+0000 7f0b86a00640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b70078b90 0x7f0b7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.018+0000 7f0b86a00640 1 -- 172.21.15.118:0/795287350 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5357+0+0 (secure 0 0 0) 0x7f0b7c09a080 con 0x7f0b900b3e00 2024-09-21T06:07:42.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.018+0000 7f0b8ea00640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b70078b90 0x7f0b7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:42.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.019+0000 7f0b8ea00640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b70078b90 0x7f0b7007b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0b80034000 tx=0x7f0b80004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:42.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.022+0000 7f0b86a00640 1 -- 172.21.15.118:0/795287350 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b7c062580 con 0x7f0b900b3e00 2024-09-21T06:07:42.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.204+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b900ce1e0 con 0x7f0b900b3e00 2024-09-21T06:07:42.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.755+0000 7f0b86a00640 1 -- 172.21.15.118:0/795287350 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) ==== 169+0+0 (secure 0 0 0) 0x7f0b7c061e80 con 0x7f0b900b3e00 2024-09-21T06:07:42.758 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b70078b90 msgr2=0x7f0b7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b70078b90 0x7f0b7007b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0b80034000 tx=0x7f0b80004ab0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900b3e00 msgr2=0x7f0b90135150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900b3e00 0x7f0b90135150 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c430 tx=0x7f0b7c00c8f0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 shutdown_connections 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b70078b90 0x7f0b7007b0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b90160a50 0x7f0b901f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b900b3e00 0x7f0b90135150 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 --2- 172.21.15.118:0/795287350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b900701f0 0x7f0b9013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 >> 172.21.15.118:0/795287350 conn(0x7f0b9006cf30 msgr2=0x7f0b9015f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 shutdown_connections 2024-09-21T06:07:42.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:42.759+0000 7f0b95600640 1 -- 172.21.15.118:0/795287350 wait complete. 2024-09-21T06:07:42.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 -- 172.21.15.118:0/2297532680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624013fae0 msgr2=0x7f62400d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 --2- 172.21.15.118:0/2297532680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624013fae0 0x7f62400d0e80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f62400ce7c0 tx=0x7f623402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 -- 172.21.15.118:0/2297532680 shutdown_connections 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 --2- 172.21.15.118:0/2297532680 >> v2:172.21.15.149:3300/0 conn(0x7f6240142e40 0x7f62400d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 --2- 172.21.15.118:0/2297532680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624013fae0 0x7f62400d0e80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 -- 172.21.15.118:0/2297532680 >> 172.21.15.118:0/2297532680 conn(0x7f624006d110 msgr2=0x7f624006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 -- 172.21.15.118:0/2297532680 shutdown_connections 2024-09-21T06:07:43.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.009+0000 7f6248200640 1 -- 172.21.15.118:0/2297532680 wait complete. 2024-09-21T06:07:43.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.011+0000 7f6248200640 1 Processor -- start 2024-09-21T06:07:43.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.012+0000 7f6248200640 1 -- start start 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6248200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624013fae0 0x7f62401f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6248200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624013fef0 0x7f624013b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6248200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6240142e40 0x7f62401f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6248200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f62400cfa70 con 0x7f6240142e40 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6248200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f62400cf8f0 con 0x7f624013fae0 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6248200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62400cfbf0 con 0x7f624013fef0 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6246200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6240142e40 0x7f62401f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6246200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6240142e40 0x7f62401f96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33710/0 (socket says 172.21.15.118:33710) 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6246200640 1 -- 172.21.15.118:0/3560962125 learned_addr learned my addr 172.21.15.118:0/3560962125 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6245800640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624013fae0 0x7f62401f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.013+0000 7f6244e00640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624013fef0 0x7f624013b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f6246200640 1 -- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624013fef0 msgr2=0x7f624013b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f6246200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624013fef0 0x7f624013b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f6246200640 1 -- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624013fae0 msgr2=0x7f62401f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f6246200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624013fae0 0x7f62401f6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f6246200640 1 -- 172.21.15.118:0/3560962125 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62401f61c0 con 0x7f6240142e40 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f6246200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6240142e40 0x7f62401f96a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f623800e960 tx=0x7f623800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f623d600640 1 -- 172.21.15.118:0/3560962125 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238004d20 con 0x7f6240142e40 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f623d600640 1 -- 172.21.15.118:0/3560962125 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f623800cb20 con 0x7f6240142e40 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624015cd00 con 0x7f6240142e40 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.014+0000 7f623d600640 1 -- 172.21.15.118:0/3560962125 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238005020 con 0x7f6240142e40 2024-09-21T06:07:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.015+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62401fa1e0 con 0x7f6240142e40 2024-09-21T06:07:43.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.016+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62400d0130 con 0x7f6240142e40 2024-09-21T06:07:43.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.017+0000 7f623d600640 1 -- 172.21.15.118:0/3560962125 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62380051c0 con 0x7f6240142e40 2024-09-21T06:07:43.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.018+0000 7f623d600640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6220078bc0 0x7f622007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.018+0000 7f623d600640 1 -- 172.21.15.118:0/3560962125 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7f623809b2b0 con 0x7f6240142e40 2024-09-21T06:07:43.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.019+0000 7f6245800640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6220078bc0 0x7f622007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.019+0000 7f6245800640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6220078bc0 0x7f622007b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6234033000 tx=0x7f6234004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:43.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.022+0000 7f623d600640 1 -- 172.21.15.118:0/3560962125 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6238016030 con 0x7f6240142e40 2024-09-21T06:07:43.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.210+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f62400b3630 con 0x7f6240142e40 2024-09-21T06:07:43.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.215+0000 7f623d600640 1 -- 172.21.15.118:0/3560962125 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f6238063300 con 0x7f6240142e40 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6220078bc0 msgr2=0x7f622007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6220078bc0 0x7f622007b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6234033000 tx=0x7f6234004730 comp rx=0 tx=0).stop 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6240142e40 msgr2=0x7f62401f96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6240142e40 0x7f62401f96a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f623800e960 tx=0x7f623800ee20 comp rx=0 tx=0).stop 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 shutdown_connections 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6240142e40 0x7f62401f96a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6220078bc0 0x7f622007b0d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624013fef0 0x7f624013b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 --2- 172.21.15.118:0/3560962125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624013fae0 0x7f62401f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 >> 172.21.15.118:0/3560962125 conn(0x7f624006d110 msgr2=0x7f62401609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:43.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 shutdown_connections 2024-09-21T06:07:43.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.217+0000 7f6248200640 1 -- 172.21.15.118:0/3560962125 wait complete. 2024-09-21T06:07:43.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-21T06:07:43.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 -- 172.21.15.118:0/330893705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc415cfd0 msgr2=0x7fdcc40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 --2- 172.21.15.118:0/330893705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc415cfd0 0x7fdcc40b3a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4005fd0 tx=0x7fdcb402a540 comp rx=0 tx=0).stop 2024-09-21T06:07:43.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 -- 172.21.15.118:0/330893705 shutdown_connections 2024-09-21T06:07:43.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 --2- 172.21.15.118:0/330893705 >> v2:172.21.15.149:3300/0 conn(0x7fdcc40b5450 0x7fdcc40cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 --2- 172.21.15.118:0/330893705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc415cfd0 0x7fdcc40b3a60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 -- 172.21.15.118:0/330893705 >> 172.21.15.118:0/330893705 conn(0x7fdcc406d110 msgr2=0x7fdcc406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:43.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 -- 172.21.15.118:0/330893705 shutdown_connections 2024-09-21T06:07:43.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.466+0000 7fdcca600640 1 -- 172.21.15.118:0/330893705 wait complete. 2024-09-21T06:07:43.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.468+0000 7fdcca600640 1 Processor -- start 2024-09-21T06:07:43.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.468+0000 7fdcca600640 1 -- start start 2024-09-21T06:07:43.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.469+0000 7fdcca600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcc40b5040 0x7fdcc4142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.469+0000 7fdcca600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc40b5450 0x7fdcc4152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcca600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcc415cfd0 0x7fdcc41531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcca600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4073c10 con 0x7fdcc40b5040 2024-09-21T06:07:43.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcca600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4073a90 con 0x7fdcc415cfd0 2024-09-21T06:07:43.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcca600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc4073d90 con 0x7fdcc40b5450 2024-09-21T06:07:43.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcc40b5040 0x7fdcc4142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcc40b5040 0x7fdcc4142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33726/0 (socket says 172.21.15.118:33726) 2024-09-21T06:07:43.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 -- 172.21.15.118:0/97069153 learned_addr learned my addr 172.21.15.118:0/97069153 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:43.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3e00640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcc415cfd0 0x7fdcc41531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcbaa00640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc40b5450 0x7fdcc4152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 -- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc40b5450 msgr2=0x7fdcc4152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc40b5450 0x7fdcc4152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 -- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcc415cfd0 msgr2=0x7fdcc41531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcc415cfd0 0x7fdcc41531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.470+0000 7fdcc3400640 1 -- 172.21.15.118:0/97069153 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc41e7010 con 0x7fdcc40b5040 2024-09-21T06:07:43.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.471+0000 7fdcc3400640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcc40b5040 0x7fdcc4142b70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4034040 tx=0x7fdcb40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:43.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.471+0000 7fdcbbe00640 1 -- 172.21.15.118:0/97069153 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb403e030 con 0x7fdcc40b5040 2024-09-21T06:07:43.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.471+0000 7fdcbbe00640 1 -- 172.21.15.118:0/97069153 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb4003d90 con 0x7fdcc40b5040 2024-09-21T06:07:43.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.471+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc41e7280 con 0x7fdcc40b5040 2024-09-21T06:07:43.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.471+0000 7fdcbbe00640 1 -- 172.21.15.118:0/97069153 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4035040 con 0x7fdcc40b5040 2024-09-21T06:07:43.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.471+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41529e0 con 0x7fdcc40b5040 2024-09-21T06:07:43.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.472+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc40b3a60 con 0x7fdcc40b5040 2024-09-21T06:07:43.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.473+0000 7fdcbbe00640 1 -- 172.21.15.118:0/97069153 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdcb4041030 con 0x7fdcc40b5040 2024-09-21T06:07:43.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.474+0000 7fdcbbe00640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdca0078bc0 0x7fdca007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:43.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.474+0000 7fdcbbe00640 1 -- 172.21.15.118:0/97069153 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7fdcb40bb430 con 0x7fdcc40b5040 2024-09-21T06:07:43.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.475+0000 7fdcbaa00640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdca0078bc0 0x7fdca007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:43.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.475+0000 7fdcbaa00640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdca0078bc0 0x7fdca007b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40c6ce0 tx=0x7fdcac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:43.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.479+0000 7fdcbbe00640 1 -- 172.21.15.118:0/97069153 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdcb40835b0 con 0x7fdcc40b5040 2024-09-21T06:07:43.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.732+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7fdcc406fad0 con 0x7fdcc40b5040 2024-09-21T06:07:43.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.757+0000 7fdcbbe00640 1 -- 172.21.15.118:0/97069153 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v205) ==== 134+0+0 (secure 0 0 0) 0x7fdcb4087fe0 con 0x7fdcc40b5040 2024-09-21T06:07:43.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.759+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdca0078bc0 msgr2=0x7fdca007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.759+0000 7fdcca600640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdca0078bc0 0x7fdca007b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40c6ce0 tx=0x7fdcac009040 comp rx=0 tx=0).stop 2024-09-21T06:07:43.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.759+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcc40b5040 msgr2=0x7fdcc4142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.759+0000 7fdcca600640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcc40b5040 0x7fdcc4142b70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4034040 tx=0x7fdcb40038a0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 shutdown_connections 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcc415cfd0 0x7fdcc41531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdca0078bc0 0x7fdca007b0d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcc40b5450 0x7fdcc4152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 --2- 172.21.15.118:0/97069153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcc40b5040 0x7fdcc4142b70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 >> 172.21.15.118:0/97069153 conn(0x7fdcc406d110 msgr2=0x7fdcc406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 shutdown_connections 2024-09-21T06:07:43.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:43.760+0000 7fdcca600640 1 -- 172.21.15.118:0/97069153 wait complete. 2024-09-21T06:07:43.783 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-21T06:07:43.783 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2024-09-21T06:07:43.783 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2024-09-21T06:07:43.784 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:07:44.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.002+0000 7f0c93200640 1 -- 172.21.15.118:0/1269363923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940ce660 msgr2=0x7f0c94167840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.002+0000 7f0c93200640 1 --2- 172.21.15.118:0/1269363923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940ce660 0x7f0c94167840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c005fd0 tx=0x7f0c8c02a940 comp rx=0 tx=0).stop 2024-09-21T06:07:44.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.002+0000 7f0c93200640 1 -- 172.21.15.118:0/1269363923 shutdown_connections 2024-09-21T06:07:44.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.002+0000 7f0c93200640 1 --2- 172.21.15.118:0/1269363923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940ce660 0x7f0c94167840 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.002+0000 7f0c93200640 1 -- 172.21.15.118:0/1269363923 >> 172.21.15.118:0/1269363923 conn(0x7f0c9406d6e0 msgr2=0x7f0c940b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:44.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.002+0000 7f0c93200640 1 -- 172.21.15.118:0/1269363923 shutdown_connections 2024-09-21T06:07:44.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.002+0000 7f0c93200640 1 -- 172.21.15.118:0/1269363923 wait complete. 2024-09-21T06:07:44.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.004+0000 7f0c93200640 1 Processor -- start 2024-09-21T06:07:44.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.005+0000 7f0c93200640 1 -- start start 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c93200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c940cfe70 0x7f0c940ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c93200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c9415d080 0x7f0c941f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c93200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c941f95a0 0x7f0c940cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c93200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0c94168110 con 0x7f0c941f95a0 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c93200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0c94167f90 con 0x7f0c940cfe70 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c93200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0c94168290 con 0x7f0c9415d080 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c92800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c941f95a0 0x7f0c940cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c92800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c941f95a0 0x7f0c940cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33758/0 (socket says 172.21.15.118:33758) 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.006+0000 7f0c92800640 1 -- 172.21.15.118:0/998822835 learned_addr learned my addr 172.21.15.118:0/998822835 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c91e00640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c940cfe70 0x7f0c940ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c89400640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c9415d080 0x7f0c941f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c92800640 1 -- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c9415d080 msgr2=0x7f0c941f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c92800640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c9415d080 0x7f0c941f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c92800640 1 -- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c940cfe70 msgr2=0x7f0c940ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c92800640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c940cfe70 0x7f0c940ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c92800640 1 -- 172.21.15.118:0/998822835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c941f99b0 con 0x7f0c941f95a0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c92800640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c941f95a0 0x7f0c940cad70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009cd0 tx=0x7f0c8c031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c8aa00640 1 -- 172.21.15.118:0/998822835 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c03e070 con 0x7f0c941f95a0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c8aa00640 1 -- 172.21.15.118:0/998822835 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c8c004540 con 0x7f0c941f95a0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c8aa00640 1 -- 172.21.15.118:0/998822835 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c043460 con 0x7f0c941f95a0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.007+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c940b5520 con 0x7f0c941f95a0 2024-09-21T06:07:44.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.008+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c940c9ff0 con 0x7f0c941f95a0 2024-09-21T06:07:44.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.008+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c94146080 con 0x7f0c941f95a0 2024-09-21T06:07:44.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.010+0000 7f0c8aa00640 1 -- 172.21.15.118:0/998822835 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c8c043600 con 0x7f0c941f95a0 2024-09-21T06:07:44.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.011+0000 7f0c8aa00640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0c70078b90 0x7f0c7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.011+0000 7f0c8aa00640 1 -- 172.21.15.118:0/998822835 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7f0c8c0bc720 con 0x7f0c941f95a0 2024-09-21T06:07:44.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.011+0000 7f0c91e00640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0c70078b90 0x7f0c7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.012+0000 7f0c91e00640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0c70078b90 0x7f0c7007b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000f60 tx=0x7f0c84009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:44.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.015+0000 7f0c8aa00640 1 -- 172.21.15.118:0/998822835 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0c941f99b0 con 0x7f0c941f95a0 2024-09-21T06:07:44.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.201+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c940b5270 con 0x7f0c941f95a0 2024-09-21T06:07:44.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.202+0000 7f0c8aa00640 1 -- 172.21.15.118:0/998822835 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+13106 (secure 0 0 0) 0x7f0c8c084e50 con 0x7f0c941f95a0 2024-09-21T06:07:44.204 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:44.204 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":73,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:07:42.750508+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6835/2029341341":"2024-09-22T06:07:39.535862+0000","172.21.15.118:6834/2029341341":"2024-09-22T06:07:39.535862+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:07:44.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0c70078b90 msgr2=0x7f0c7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0c70078b90 0x7f0c7007b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000f60 tx=0x7f0c84009040 comp rx=0 tx=0).stop 2024-09-21T06:07:44.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c941f95a0 msgr2=0x7f0c940cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c941f95a0 0x7f0c940cad70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009cd0 tx=0x7f0c8c031e20 comp rx=0 tx=0).stop 2024-09-21T06:07:44.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 shutdown_connections 2024-09-21T06:07:44.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c941f95a0 0x7f0c940cad70 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0c70078b90 0x7f0c7007b0a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c9415d080 0x7f0c941f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 --2- 172.21.15.118:0/998822835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c940cfe70 0x7f0c940ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 >> 172.21.15.118:0/998822835 conn(0x7f0c9406d6e0 msgr2=0x7f0c9415c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:44.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 shutdown_connections 2024-09-21T06:07:44.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.205+0000 7f0c93200640 1 -- 172.21.15.118:0/998822835 wait complete. 2024-09-21T06:07:44.231 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:07:44.231 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:07:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 -- 172.21.15.118:0/1617297110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 msgr2=0x7f98e00cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 --2- 172.21.15.118:0/1617297110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00cf100 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f98e00b5c40 tx=0x7f98d802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 -- 172.21.15.118:0/1617297110 shutdown_connections 2024-09-21T06:07:44.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 --2- 172.21.15.118:0/1617297110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00cf100 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 --2- 172.21.15.118:0/1617297110 >> v2:172.21.15.149:3300/0 conn(0x7f98e0145840 0x7f98e0073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 -- 172.21.15.118:0/1617297110 >> 172.21.15.118:0/1617297110 conn(0x7f98e006d5a0 msgr2=0x7f98e00d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:44.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 -- 172.21.15.118:0/1617297110 shutdown_connections 2024-09-21T06:07:44.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.452+0000 7f98e4e00640 1 -- 172.21.15.118:0/1617297110 wait complete. 2024-09-21T06:07:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.455+0000 7f98e4e00640 1 Processor -- start 2024-09-21T06:07:44.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.455+0000 7f98e4e00640 1 -- start start 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98e4e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e006ff20 0x7f98e015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98e4e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98e4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98e0145840 0x7f98e00b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98e4e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f98e00cf9d0 con 0x7f98e00cecf0 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98e4e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f98e00cf850 con 0x7f98e006ff20 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98e4e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f98e00cfb50 con 0x7f98e0145840 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98d6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98d6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33780/0 (socket says 172.21.15.118:33780) 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.456+0000 7f98d6a00640 1 -- 172.21.15.118:0/2951289763 learned_addr learned my addr 172.21.15.118:0/2951289763 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98df400640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e006ff20 0x7f98e015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98dfe00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98e0145840 0x7f98e00b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d6a00640 1 -- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98e0145840 msgr2=0x7f98e00b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d6a00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98e0145840 0x7f98e00b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d6a00640 1 -- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e006ff20 msgr2=0x7f98e015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d6a00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e006ff20 0x7f98e015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d6a00640 1 -- 172.21.15.118:0/2951289763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e00b42a0 con 0x7f98e00cecf0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d6a00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00b19d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f98c800eb60 tx=0x7f98c800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d7e00640 1 -- 172.21.15.118:0/2951289763 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8010630 con 0x7f98e00cecf0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.457+0000 7f98d7e00640 1 -- 172.21.15.118:0/2951289763 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98c80108c0 con 0x7f98e00cecf0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.458+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e00b10a0 con 0x7f98e00cecf0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.458+0000 7f98d7e00640 1 -- 172.21.15.118:0/2951289763 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8010d10 con 0x7f98e00cecf0 2024-09-21T06:07:44.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.458+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e015e770 con 0x7f98e00cecf0 2024-09-21T06:07:44.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.459+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e00b0e10 con 0x7f98e00cecf0 2024-09-21T06:07:44.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.460+0000 7f98d7e00640 1 -- 172.21.15.118:0/2951289763 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98c8018420 con 0x7f98e00cecf0 2024-09-21T06:07:44.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.461+0000 7f98d7e00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98bc078b90 0x7f98bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.462+0000 7f98d7e00640 1 -- 172.21.15.118:0/2951289763 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7f98c809b7d0 con 0x7f98e00cecf0 2024-09-21T06:07:44.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.462+0000 7f98df400640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98bc078b90 0x7f98bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.463+0000 7f98df400640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98bc078b90 0x7f98bc07b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f98d00015e0 tx=0x7f98d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.466+0000 7f98d7e00640 1 -- 172.21.15.118:0/2951289763 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f98e00b42a0 con 0x7f98e00cecf0 2024-09-21T06:07:44.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.652+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98e00d0070 con 0x7f98e00cecf0 2024-09-21T06:07:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.652+0000 7f98d7e00640 1 -- 172.21.15.118:0/2951289763 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f98c800ee60 con 0x7f98e00cecf0 2024-09-21T06:07:44.654 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:07:44.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98bc078b90 msgr2=0x7f98bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98bc078b90 0x7f98bc07b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f98d00015e0 tx=0x7f98d0009040 comp rx=0 tx=0).stop 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 msgr2=0x7f98e00b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00b19d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f98c800eb60 tx=0x7f98c800c6a0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 shutdown_connections 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f98bc078b90 0x7f98bc07b0a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98e0145840 0x7f98e00b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98e00cecf0 0x7f98e00b19d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 --2- 172.21.15.118:0/2951289763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e006ff20 0x7f98e015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 >> 172.21.15.118:0/2951289763 conn(0x7f98e006d5a0 msgr2=0x7f98e0072940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 shutdown_connections 2024-09-21T06:07:44.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.655+0000 7f98e4e00640 1 -- 172.21.15.118:0/2951289763 wait complete. 2024-09-21T06:07:44.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-21T06:07:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.899+0000 7f7660e00640 1 -- 172.21.15.118:0/2834373035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7640003c30 msgr2=0x7f7640004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.899+0000 7f7660e00640 1 --2- 172.21.15.118:0/2834373035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7640003c30 0x7f7640004080 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f764c001830 tx=0x7f7640005830 comp rx=0 tx=0).stop 2024-09-21T06:07:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.899+0000 7f7660e00640 1 -- 172.21.15.118:0/2834373035 shutdown_connections 2024-09-21T06:07:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.899+0000 7f7660e00640 1 --2- 172.21.15.118:0/2834373035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7640003c30 0x7f7640004080 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.899+0000 7f7660e00640 1 -- 172.21.15.118:0/2834373035 >> 172.21.15.118:0/2834373035 conn(0x7f765c06d6e0 msgr2=0x7f765c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.899+0000 7f7660e00640 1 -- 172.21.15.118:0/2834373035 shutdown_connections 2024-09-21T06:07:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.899+0000 7f7660e00640 1 -- 172.21.15.118:0/2834373035 wait complete. 2024-09-21T06:07:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.901+0000 7f7660e00640 1 Processor -- start 2024-09-21T06:07:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.902+0000 7f7660e00640 1 -- start start 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7660e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7640003c30 0x7f765c13e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7660e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c1f7ac0 0x7f765c13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7660e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c14dd40 0x7f765c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7660e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f765c0cf1f0 con 0x7f765c1f7ac0 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7660e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f765c0cf070 con 0x7f7640003c30 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7660e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f765c0cf370 con 0x7f765c14dd40 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7652a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c1f7ac0 0x7f765c13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7652a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c1f7ac0 0x7f765c13eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33806/0 (socket says 172.21.15.118:33806) 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.903+0000 7f7652a00640 1 -- 172.21.15.118:0/2422833623 learned_addr learned my addr 172.21.15.118:0/2422833623 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f765b400640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7640003c30 0x7f765c13e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7652a00640 1 -- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c14dd40 msgr2=0x7f765c14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f765be00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c14dd40 0x7f765c14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7652a00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c14dd40 0x7f765c14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7652a00640 1 -- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7640003c30 msgr2=0x7f765c13e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7652a00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7640003c30 0x7f765c13e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7652a00640 1 -- 172.21.15.118:0/2422833623 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c13bd60 con 0x7f765c1f7ac0 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f765b400640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7640003c30 0x7f765c13e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f765be00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c14dd40 0x7f765c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7652a00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c1f7ac0 0x7f765c13eed0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7644011a40 tx=0x7f7644011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7653e00640 1 -- 172.21.15.118:0/2422833623 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764401e070 con 0x7f765c1f7ac0 2024-09-21T06:07:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7653e00640 1 -- 172.21.15.118:0/2422833623 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7644004460 con 0x7f765c1f7ac0 2024-09-21T06:07:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7653e00640 1 -- 172.21.15.118:0/2422833623 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764400fba0 con 0x7f765c1f7ac0 2024-09-21T06:07:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.904+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c14e690 con 0x7f765c1f7ac0 2024-09-21T06:07:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.905+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c1f6fe0 con 0x7f765c1f7ac0 2024-09-21T06:07:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.906+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765c15f730 con 0x7f765c1f7ac0 2024-09-21T06:07:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.907+0000 7f7653e00640 1 -- 172.21.15.118:0/2422833623 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7644021070 con 0x7f765c1f7ac0 2024-09-21T06:07:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.908+0000 7f7653e00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.908+0000 7f7653e00640 1 -- 172.21.15.118:0/2422833623 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7f764409b480 con 0x7f765c1f7ac0 2024-09-21T06:07:44.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.909+0000 7f765b400640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:44.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.909+0000 7f765b400640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7638078b90 0x7f763807b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f764c032000 tx=0x7f764c001360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:44.913+0000 7f7653e00640 1 -- 172.21.15.118:0/2422833623 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f765c13bd60 con 0x7f765c1f7ac0 2024-09-21T06:07:45.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.166+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7f765c140250 con 0x7f765c1f7ac0 2024-09-21T06:07:45.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.767+0000 7f7653e00640 1 -- 172.21.15.118:0/2422833623 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v207) ==== 136+0+0 (secure 0 0 0) 0x7f7644063570 con 0x7f765c1f7ac0 2024-09-21T06:07:45.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7638078b90 msgr2=0x7f763807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7638078b90 0x7f763807b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f764c032000 tx=0x7f764c001360 comp rx=0 tx=0).stop 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c1f7ac0 msgr2=0x7f765c13eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c1f7ac0 0x7f765c13eed0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7644011a40 tx=0x7f7644011f00 comp rx=0 tx=0).stop 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 shutdown_connections 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c14dd40 0x7f765c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765c1f7ac0 0x7f765c13eed0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 --2- 172.21.15.118:0/2422833623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7640003c30 0x7f765c13e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 >> 172.21.15.118:0/2422833623 conn(0x7f765c06d6e0 msgr2=0x7f765c15c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 shutdown_connections 2024-09-21T06:07:45.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:45.770+0000 7f7660e00640 1 -- 172.21.15.118:0/2422833623 wait complete. 2024-09-21T06:07:45.796 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-21T06:07:46.033 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_objectstore":"memstore"} 2024-09-21T06:07:46.033 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-21T06:07:46.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:07:46.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.252+0000 7f9741c00640 1 -- 172.21.15.118:0/4141111912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 msgr2=0x7f972000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.252+0000 7f9741c00640 1 --2- 172.21.15.118:0/4141111912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 0x7f972000b9c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f973c0b3630 tx=0x7f9720005830 comp rx=0 tx=0).stop 2024-09-21T06:07:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.252+0000 7f9741200640 1 -- 172.21.15.118:0/4141111912 reap_dead start 2024-09-21T06:07:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.252+0000 7f9741c00640 1 -- 172.21.15.118:0/4141111912 shutdown_connections 2024-09-21T06:07:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.252+0000 7f9741c00640 1 -- 172.21.15.118:0/4141111912 >> 172.21.15.118:0/4141111912 conn(0x7f973c06d6e0 msgr2=0x7f973c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.252+0000 7f9741c00640 1 -- 172.21.15.118:0/4141111912 shutdown_connections 2024-09-21T06:07:46.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.252+0000 7f9741c00640 1 -- 172.21.15.118:0/4141111912 wait complete. 2024-09-21T06:07:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.254+0000 7f9741c00640 1 Processor -- start 2024-09-21T06:07:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.254+0000 7f9741c00640 1 -- start start 2024-09-21T06:07:46.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f9741c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 0x7f973c145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f9741c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c159680 0x7f973c0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f9741c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c0cc520 0x7f973c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f9741c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f973c15e0a0 con 0x7f9720005210 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f9741c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f973c15df20 con 0x7f973c0cc520 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f9741c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f973c0b5bb0 con 0x7f973c159680 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 0x7f973c145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 0x7f973c145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34486/0 (socket says 172.21.15.118:34486) 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 -- 172.21.15.118:0/3103513782 learned_addr learned my addr 172.21.15.118:0/3103513782 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f9741200640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c0cc520 0x7f973c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973b400640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c159680 0x7f973c0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 -- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c159680 msgr2=0x7f973c0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c159680 0x7f973c0cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 -- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c0cc520 msgr2=0x7f973c157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c0cc520 0x7f973c157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.256+0000 7f973be00640 1 -- 172.21.15.118:0/3103513782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c0cc930 con 0x7f9720005210 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f9741200640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c0cc520 0x7f973c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f973b400640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c159680 0x7f973c0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f973be00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 0x7f973c145200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f972c00e8f0 tx=0x7f972c00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f9733e00640 1 -- 172.21.15.118:0/3103513782 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c015070 con 0x7f9720005210 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f9733e00640 1 -- 172.21.15.118:0/3103513782 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f972c00cd40 con 0x7f9720005210 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c1f95a0 con 0x7f9720005210 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f9733e00640 1 -- 172.21.15.118:0/3103513782 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0116c0 con 0x7f9720005210 2024-09-21T06:07:46.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.257+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c1e6ac0 con 0x7f9720005210 2024-09-21T06:07:46.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.258+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973c1e65d0 con 0x7f9720005210 2024-09-21T06:07:46.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.259+0000 7f9733e00640 1 -- 172.21.15.118:0/3103513782 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f972c018070 con 0x7f9720005210 2024-09-21T06:07:46.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.261+0000 7f9733e00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f971c078b90 0x7f971c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.261+0000 7f9733e00640 1 -- 172.21.15.118:0/3103513782 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7f972c09b260 con 0x7f9720005210 2024-09-21T06:07:46.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.261+0000 7f973b400640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f971c078b90 0x7f971c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:46.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.262+0000 7f973b400640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f971c078b90 0x7f971c07b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9728006930 tx=0x7f9728006a60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:46.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.266+0000 7f9733e00640 1 -- 172.21.15.118:0/3103513782 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f973c0cc930 con 0x7f9720005210 2024-09-21T06:07:46.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.454+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f973c0b3290 con 0x7f9720005210 2024-09-21T06:07:46.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.455+0000 7f9733e00640 1 -- 172.21.15.118:0/3103513782 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1472 (secure 0 0 0) 0x7f972c063990 con 0x7f9720005210 2024-09-21T06:07:46.456 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:07:46.456 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:07:46.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:07:46.458 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:07:46.458 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:07:46.458 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:07:46.458 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:07:46.458 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:07:46.458 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:07:46.458 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:07:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f971c078b90 msgr2=0x7f971c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f971c078b90 0x7f971c07b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9728006930 tx=0x7f9728006a60 comp rx=0 tx=0).stop 2024-09-21T06:07:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 msgr2=0x7f973c145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 0x7f973c145200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f972c00e8f0 tx=0x7f972c00edb0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 shutdown_connections 2024-09-21T06:07:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f973c0cc520 0x7f973c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f971c078b90 0x7f971c07b0a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f973c159680 0x7f973c0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 --2- 172.21.15.118:0/3103513782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9720005210 0x7f973c145200 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 >> 172.21.15.118:0/3103513782 conn(0x7f973c06d6e0 msgr2=0x7f973c0cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 shutdown_connections 2024-09-21T06:07:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.457+0000 7f9741c00640 1 -- 172.21.15.118:0/3103513782 wait complete. 2024-09-21T06:07:46.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:07:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.703+0000 7f01d9200640 1 -- 172.21.15.118:0/1019423555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d40b62c0 msgr2=0x7f01d40d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.703+0000 7f01d9200640 1 --2- 172.21.15.118:0/1019423555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d40b62c0 0x7f01d40d0240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f01cc005fd0 tx=0x7f01cc02a8b0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.703+0000 7f01d9200640 1 -- 172.21.15.118:0/1019423555 shutdown_connections 2024-09-21T06:07:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.703+0000 7f01d9200640 1 --2- 172.21.15.118:0/1019423555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d40b62c0 0x7f01d40d0240 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.703+0000 7f01d9200640 1 -- 172.21.15.118:0/1019423555 >> 172.21.15.118:0/1019423555 conn(0x7f01d406d6e0 msgr2=0x7f01d40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.703+0000 7f01d9200640 1 -- 172.21.15.118:0/1019423555 shutdown_connections 2024-09-21T06:07:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.703+0000 7f01d9200640 1 -- 172.21.15.118:0/1019423555 wait complete. 2024-09-21T06:07:46.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.705+0000 7f01d9200640 1 Processor -- start 2024-09-21T06:07:46.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.705+0000 7f01d9200640 1 -- start start 2024-09-21T06:07:46.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4073fa0 0x7f01d4159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d40cfe30 0x7f01d4158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01d4158ed0 0x7f01d41592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d9200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f01d415dad0 con 0x7f01d4073fa0 2024-09-21T06:07:46.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f01d415d950 con 0x7f01d40cfe30 2024-09-21T06:07:46.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f01d415dc50 con 0x7f01d4158ed0 2024-09-21T06:07:46.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4073fa0 0x7f01d4159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:46.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4073fa0 0x7f01d4159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34508/0 (socket says 172.21.15.118:34508) 2024-09-21T06:07:46.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d3400640 1 -- 172.21.15.118:0/944342883 learned_addr learned my addr 172.21.15.118:0/944342883 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:46.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d3400640 1 -- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01d4158ed0 msgr2=0x7f01d41592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d3400640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01d4158ed0 0x7f01d41592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d3400640 1 -- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d40cfe30 msgr2=0x7f01d4158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.707+0000 7f01d2a00640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d40cfe30 0x7f01d4158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01d3400640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d40cfe30 0x7f01d4158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01d3400640 1 -- 172.21.15.118:0/944342883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d4132dd0 con 0x7f01d4073fa0 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01d2a00640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d40cfe30 0x7f01d4158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01d3400640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4073fa0 0x7f01d4159db0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f01c400c3a0 tx=0x7f01c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01cb400640 1 -- 172.21.15.118:0/944342883 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4017070 con 0x7f01d4073fa0 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01cb400640 1 -- 172.21.15.118:0/944342883 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01c40053c0 con 0x7f01d4073fa0 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01cb400640 1 -- 172.21.15.118:0/944342883 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4003850 con 0x7f01d4073fa0 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d41e6af0 con 0x7f01d4073fa0 2024-09-21T06:07:46.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.708+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d4133350 con 0x7f01d4073fa0 2024-09-21T06:07:46.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.709+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d41e82f0 con 0x7f01d4073fa0 2024-09-21T06:07:46.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.711+0000 7f01cb400640 1 -- 172.21.15.118:0/944342883 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01c401a070 con 0x7f01d4073fa0 2024-09-21T06:07:46.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.711+0000 7f01cb400640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01b4078bc0 0x7f01b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:46.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.712+0000 7f01cb400640 1 -- 172.21.15.118:0/944342883 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7f01c4099e80 con 0x7f01d4073fa0 2024-09-21T06:07:46.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.712+0000 7f01d2a00640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01b4078bc0 0x7f01b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:46.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.713+0000 7f01d2a00640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01b4078bc0 0x7f01b407b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f01d40ca380 tx=0x7f01c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:46.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.716+0000 7f01cb400640 1 -- 172.21.15.118:0/944342883 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f01c4062520 con 0x7f01d4073fa0 2024-09-21T06:07:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.904+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f01d415c730 con 0x7f01d4073fa0 2024-09-21T06:07:46.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.908+0000 7f01cb400640 1 -- 172.21.15.118:0/944342883 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f01c4061e20 con 0x7f01d4073fa0 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01b4078bc0 msgr2=0x7f01b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01b4078bc0 0x7f01b407b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f01d40ca380 tx=0x7f01c0009040 comp rx=0 tx=0).stop 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4073fa0 msgr2=0x7f01d4159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4073fa0 0x7f01d4159db0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f01c400c3a0 tx=0x7f01c400c860 comp rx=0 tx=0).stop 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 shutdown_connections 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01b4078bc0 0x7f01b407b0d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01d4158ed0 0x7f01d41592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d40cfe30 0x7f01d4158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 --2- 172.21.15.118:0/944342883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d4073fa0 0x7f01d4159db0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 >> 172.21.15.118:0/944342883 conn(0x7f01d406d6e0 msgr2=0x7f01d4146170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 shutdown_connections 2024-09-21T06:07:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:46.911+0000 7f01d9200640 1 -- 172.21.15.118:0/944342883 wait complete. 2024-09-21T06:07:46.933 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:07:46.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:07:47.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:07:47.132 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:07:47.133 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:07:47.133 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:47.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:07:47.168 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:07:47.168 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:47.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:07:47.204 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:07:47.205 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:47.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:07:47.244 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:07:47.244 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:07:47.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:07:47.281 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:07:47.281 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 -- 172.21.15.118:0/800375848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 msgr2=0x7fd58c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 --2- 172.21.15.118:0/800375848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0d0240 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd574009830 tx=0x7fd57402a480 comp rx=0 tx=0).stop 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 -- 172.21.15.118:0/800375848 shutdown_connections 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 --2- 172.21.15.118:0/800375848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0d0240 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 --2- 172.21.15.118:0/800375848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd58c073fa0 0x7fd58c0749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 -- 172.21.15.118:0/800375848 >> 172.21.15.118:0/800375848 conn(0x7fd58c06d6e0 msgr2=0x7fd58c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 -- 172.21.15.118:0/800375848 shutdown_connections 2024-09-21T06:07:47.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.505+0000 7fd58be00640 1 -- 172.21.15.118:0/800375848 wait complete. 2024-09-21T06:07:47.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.507+0000 7fd58be00640 1 Processor -- start 2024-09-21T06:07:47.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.507+0000 7fd58be00640 1 -- start start 2024-09-21T06:07:47.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd58c073fa0 0x7fd58c1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:47.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd58c0b5bb0 0x7fd58c0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:47.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c15d9c0 con 0x7fd58c0cfe30 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c15d840 con 0x7fd58c073fa0 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd58c15db40 con 0x7fd58c0b5bb0 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34516/0 (socket says 172.21.15.118:34516) 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58b400640 1 -- 172.21.15.118:0/1513364037 learned_addr learned my addr 172.21.15.118:0/1513364037 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.509+0000 7fd58aa00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd58c073fa0 0x7fd58c1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd582000640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd58c0b5bb0 0x7fd58c0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58b400640 1 -- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd58c0b5bb0 msgr2=0x7fd58c0c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58b400640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd58c0b5bb0 0x7fd58c0c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58b400640 1 -- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd58c073fa0 msgr2=0x7fd58c1454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58b400640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd58c073fa0 0x7fd58c1454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58b400640 1 -- 172.21.15.118:0/1513364037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c0cba00 con 0x7fd58c0cfe30 2024-09-21T06:07:47.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58b400640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0c9cd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c730 tx=0x7fd58400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:47.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd583400640 1 -- 172.21.15.118:0/1513364037 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584017070 con 0x7fd58c0cfe30 2024-09-21T06:07:47.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd583400640 1 -- 172.21.15.118:0/1513364037 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd584003c60 con 0x7fd58c0cfe30 2024-09-21T06:07:47.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58c0c8cb0 con 0x7fd58c0cfe30 2024-09-21T06:07:47.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd583400640 1 -- 172.21.15.118:0/1513364037 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5840052d0 con 0x7fd58c0cfe30 2024-09-21T06:07:47.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.510+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58c0aa640 con 0x7fd58c0cfe30 2024-09-21T06:07:47.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.512+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58c0cb770 con 0x7fd58c0cfe30 2024-09-21T06:07:47.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.513+0000 7fd583400640 1 -- 172.21.15.118:0/1513364037 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd58401a070 con 0x7fd58c0cfe30 2024-09-21T06:07:47.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.514+0000 7fd583400640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd568078bc0 0x7fd56807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:47.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.514+0000 7fd583400640 1 -- 172.21.15.118:0/1513364037 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7fd58409a150 con 0x7fd58c0cfe30 2024-09-21T06:07:47.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.514+0000 7fd58aa00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd568078bc0 0x7fd56807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:47.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.515+0000 7fd58aa00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd568078bc0 0x7fd56807b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009b30 tx=0x7fd57c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:47.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.518+0000 7fd583400640 1 -- 172.21.15.118:0/1513364037 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd5840622c0 con 0x7fd58c0cfe30 2024-09-21T06:07:47.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.740+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd58c15e030 con 0x7fd58c0cfe30 2024-09-21T06:07:47.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.741+0000 7fd583400640 1 -- 172.21.15.118:0/1513364037 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3923 (secure 0 0 0) 0x7fd584066cf0 con 0x7fd58c0cfe30 2024-09-21T06:07:47.743 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:47.743 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":36,"btime":"2024-09-21T06:07:40:538551+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3011271517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3011271517},{"type":"v1","addr":"172.21.15.149:6836","nonce":3011271517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2921288651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2921288651},{"type":"v1","addr":"172.21.15.149:6837","nonce":2921288651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1884295259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1884295259},{"type":"v1","addr":"172.21.15.118:6833","nonce":1884295259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3665967584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3665967584},{"type":"v1","addr":"172.21.15.118:6835","nonce":3665967584}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[]} 2024-09-21T06:07:47.743 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 36 2024-09-21T06:07:47.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd568078bc0 msgr2=0x7fd56807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:47.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd568078bc0 0x7fd56807b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009b30 tx=0x7fd57c005f90 comp rx=0 tx=0).stop 2024-09-21T06:07:47.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 msgr2=0x7fd58c0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0c9cd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c730 tx=0x7fd58400cbf0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 shutdown_connections 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58c0cfe30 0x7fd58c0c9cd0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd568078bc0 0x7fd56807b0d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd58c0b5bb0 0x7fd58c0c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 --2- 172.21.15.118:0/1513364037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd58c073fa0 0x7fd58c1454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 >> 172.21.15.118:0/1513364037 conn(0x7fd58c06d6e0 msgr2=0x7fd58c156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 shutdown_connections 2024-09-21T06:07:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:47.744+0000 7fd58be00640 1 -- 172.21.15.118:0/1513364037 wait complete. 2024-09-21T06:07:47.766 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:07:47.766 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:07:47.767 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:07:47.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:07:47.767 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:07:47.767 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:07:47.767 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:07:47.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:07:47.767 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:07:47.767 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:07:47.768 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:07:47.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:07:47.768 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:07:47.768 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:07:47.768 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:07:47.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:07:47.795 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:07:47.795 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:07:47.798 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:07:47.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:07:47.800 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:07:47.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:07:47.801 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:07:47.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:07:47.843 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:07:47.843 DEBUG:teuthology.parallel:result is None 2024-09-21T06:07:47.845 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:07:47.845 DEBUG:teuthology.parallel:result is None 2024-09-21T06:07:47.846 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:07:47.846 DEBUG:teuthology.parallel:result is None 2024-09-21T06:07:47.847 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:07:47.848 DEBUG:teuthology.parallel:result is None 2024-09-21T06:07:47.848 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:07:48.039 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:07:48.040 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:07:48.042 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:07:48.042 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:07:48.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 -- 172.21.15.118:0/1991192069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 msgr2=0x7f27d80d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 --2- 172.21.15.118:0/1991192069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80d0990 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009c90 tx=0x7f27c802aa30 comp rx=0 tx=0).stop 2024-09-21T06:07:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 -- 172.21.15.118:0/1991192069 shutdown_connections 2024-09-21T06:07:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 --2- 172.21.15.118:0/1991192069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27d80d1960 0x7f27d806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 --2- 172.21.15.118:0/1991192069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80d0990 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 -- 172.21.15.118:0/1991192069 >> 172.21.15.118:0/1991192069 conn(0x7f27d80d4c00 msgr2=0x7f27d80d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 -- 172.21.15.118:0/1991192069 shutdown_connections 2024-09-21T06:07:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.078+0000 7f27dd600640 1 -- 172.21.15.118:0/1991192069 wait complete. 2024-09-21T06:07:48.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.080+0000 7f27dd600640 1 Processor -- start 2024-09-21T06:07:48.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.080+0000 7f27dd600640 1 -- start start 2024-09-21T06:07:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27dd600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27d80d29e0 0x7f27d80cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27dd600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27dd600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d80cae50 0x7f27d8153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27dd600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f27d806d8c0 con 0x7f27d80d38d0 2024-09-21T06:07:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27dd600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f27d806d740 con 0x7f27d80cae50 2024-09-21T06:07:48.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27dd600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f27d806da40 con 0x7f27d80d29e0 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27d7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27d7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27d80d29e0 0x7f27d80cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27d7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34582/0 (socket says 172.21.15.118:34582) 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27d7400640 1 -- 172.21.15.118:0/3397585146 learned_addr learned my addr 172.21.15.118:0/3397585146 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.082+0000 7f27dcc00640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d80cae50 0x7f27d8153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27d7e00640 1 -- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d80cae50 msgr2=0x7f27d8153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27d7e00640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d80cae50 0x7f27d8153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27d7e00640 1 -- 172.21.15.118:0/3397585146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 msgr2=0x7f27d80ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27d7e00640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27d7e00640 1 -- 172.21.15.118:0/3397585146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d80ce070 con 0x7f27d80d29e0 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27d7400640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:07:48.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27d7e00640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27d80d29e0 0x7f27d80cdb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f27c8032000 tx=0x7f27c8003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27cfe00640 1 -- 172.21.15.118:0/3397585146 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8033050 con 0x7f27d80d29e0 2024-09-21T06:07:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27cfe00640 1 -- 172.21.15.118:0/3397585146 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27c8004450 con 0x7f27d80d29e0 2024-09-21T06:07:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d8151d60 con 0x7f27d80d29e0 2024-09-21T06:07:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27cfe00640 1 -- 172.21.15.118:0/3397585146 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8038450 con 0x7f27d80d29e0 2024-09-21T06:07:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.083+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d8152320 con 0x7f27d80d29e0 2024-09-21T06:07:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.084+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d806de60 con 0x7f27d80d29e0 2024-09-21T06:07:48.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.086+0000 7f27cfe00640 1 -- 172.21.15.118:0/3397585146 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27c8036070 con 0x7f27d80d29e0 2024-09-21T06:07:48.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.087+0000 7f27cfe00640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f27b8078b90 0x7f27b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:48.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.087+0000 7f27cfe00640 1 -- 172.21.15.118:0/3397585146 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(73..73 src has 1..73) ==== 4943+0+0 (secure 0 0 0) 0x7f27c80bbed0 con 0x7f27d80d29e0 2024-09-21T06:07:48.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.087+0000 7f27d7400640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f27b8078b90 0x7f27b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:48.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.088+0000 7f27d7400640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f27b8078b90 0x7f27b807b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f27d80cb780 tx=0x7f27c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.091+0000 7f27cfe00640 1 -- 172.21.15.118:0/3397585146 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f27c80840c0 con 0x7f27d80d29e0 2024-09-21T06:07:48.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.287+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f27d80c82b0 con 0x7f27d80d29e0 2024-09-21T06:07:48.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.924+0000 7f27cfe00640 1 -- 172.21.15.118:0/3397585146 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) ==== 97+0+0 (secure 0 0 0) 0x7f27c8088af0 con 0x7f27d80d29e0 2024-09-21T06:07:48.925 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f27b8078b90 msgr2=0x7f27b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f27b8078b90 0x7f27b807b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f27d80cb780 tx=0x7f27c4009040 comp rx=0 tx=0).stop 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27d80d29e0 msgr2=0x7f27d80cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27d80d29e0 0x7f27d80cdb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f27c8032000 tx=0x7f27c8003f10 comp rx=0 tx=0).stop 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 shutdown_connections 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27d80cae50 0x7f27d8153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27d80d38d0 0x7f27d80ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f27b8078b90 0x7f27b807b0a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 --2- 172.21.15.118:0/3397585146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27d80d29e0 0x7f27d80cdb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:48.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.926+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 >> 172.21.15.118:0/3397585146 conn(0x7f27d80d4c00 msgr2=0x7f27d80d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:48.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.928+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 shutdown_connections 2024-09-21T06:07:48.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:48.928+0000 7f27dd600640 1 -- 172.21.15.118:0/3397585146 wait complete. 2024-09-21T06:07:48.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:07:49.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:49.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.176+0000 7f033da00640 1 -- 172.21.15.118:0/4222408247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c003c10 msgr2=0x7f031c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.176+0000 7f033da00640 1 --2- 172.21.15.118:0/4222408247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f031c003c10 0x7f031c004060 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0328006b20 tx=0x7f031c005830 comp rx=0 tx=0).stop 2024-09-21T06:07:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.176+0000 7f0337400640 1 -- 172.21.15.118:0/4222408247 reap_dead start 2024-09-21T06:07:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.176+0000 7f033da00640 1 -- 172.21.15.118:0/4222408247 shutdown_connections 2024-09-21T06:07:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.176+0000 7f033da00640 1 -- 172.21.15.118:0/4222408247 >> 172.21.15.118:0/4222408247 conn(0x7f03380d1780 msgr2=0x7f03380d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.177+0000 7f033da00640 1 -- 172.21.15.118:0/4222408247 shutdown_connections 2024-09-21T06:07:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.177+0000 7f033da00640 1 -- 172.21.15.118:0/4222408247 wait complete. 2024-09-21T06:07:49.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.179+0000 7f033da00640 1 Processor -- start 2024-09-21T06:07:49.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.179+0000 7f033da00640 1 -- start start 2024-09-21T06:07:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.180+0000 7f033da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f031c003c10 0x7f033814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.180+0000 7f033da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03381f9140 0x7f03381f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.180+0000 7f033da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f033815ffa0 0x7f03380b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.180+0000 7f033da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03380d24b0 con 0x7f03381f9140 2024-09-21T06:07:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.180+0000 7f033da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f033808ed10 con 0x7f031c003c10 2024-09-21T06:07:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.180+0000 7f033da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f03380d2630 con 0x7f033815ffa0 2024-09-21T06:07:49.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.180+0000 7f0336000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03381f9140 0x7f03381f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03381f9140 0x7f03381f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34600/0 (socket says 172.21.15.118:34600) 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 -- 172.21.15.118:0/4060846818 learned_addr learned my addr 172.21.15.118:0/4060846818 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336a00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f031c003c10 0x7f033814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0337400640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f033815ffa0 0x7f03380b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 -- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f033815ffa0 msgr2=0x7f03380b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f033815ffa0 0x7f03380b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 -- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f031c003c10 msgr2=0x7f033814d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f031c003c10 0x7f033814d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 -- 172.21.15.118:0/4060846818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03381f9b20 con 0x7f03381f9140 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f0336000640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03381f9140 0x7f03381f6560 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0324011830 tx=0x7f0324011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.181+0000 7f032ea00640 1 -- 172.21.15.118:0/4060846818 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324004460 con 0x7f03381f9140 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.182+0000 7f032ea00640 1 -- 172.21.15.118:0/4060846818 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0324016070 con 0x7f03381f9140 2024-09-21T06:07:49.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.182+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03381f9e00 con 0x7f03381f9140 2024-09-21T06:07:49.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.182+0000 7f032ea00640 1 -- 172.21.15.118:0/4060846818 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032400fb40 con 0x7f03381f9140 2024-09-21T06:07:49.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.182+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03381f6aa0 con 0x7f03381f9140 2024-09-21T06:07:49.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.183+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03381f9890 con 0x7f03381f9140 2024-09-21T06:07:49.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.184+0000 7f032ea00640 1 -- 172.21.15.118:0/4060846818 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0324018030 con 0x7f03381f9140 2024-09-21T06:07:49.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.185+0000 7f032ea00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0318078b90 0x7f031807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.185+0000 7f032ea00640 1 -- 172.21.15.118:0/4060846818 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f032409b150 con 0x7f03381f9140 2024-09-21T06:07:49.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.185+0000 7f0336a00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0318078b90 0x7f031807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.186+0000 7f0336a00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0318078b90 0x7f031807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0328032000 tx=0x7f0328001530 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.189+0000 7f032ea00640 1 -- 172.21.15.118:0/4060846818 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0324063280 con 0x7f03381f9140 2024-09-21T06:07:49.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.444+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f03381f5b50 con 0x7f03381f9140 2024-09-21T06:07:49.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.445+0000 7f032ea00640 1 -- 172.21.15.118:0/4060846818 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f0324067cb0 con 0x7f03381f9140 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:07:49.448 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:07:49.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.452 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.453 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:07:49.454 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.456 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:07:49.457 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:07:49.458 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:07:49.459 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.460 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.460 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:07:49.460 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:07:49.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0318078b90 msgr2=0x7f031807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0318078b90 0x7f031807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0328032000 tx=0x7f0328001530 comp rx=0 tx=0).stop 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03381f9140 msgr2=0x7f03381f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03381f9140 0x7f03381f6560 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0324011830 tx=0x7f0324011c30 comp rx=0 tx=0).stop 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 shutdown_connections 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0318078b90 0x7f031807b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f033815ffa0 0x7f03380b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.447+0000 7f033da00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03381f9140 0x7f03381f6560 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.448+0000 7f033da00640 1 --2- 172.21.15.118:0/4060846818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f031c003c10 0x7f033814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.448+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 >> 172.21.15.118:0/4060846818 conn(0x7f03380d1780 msgr2=0x7f03380cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.448+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 shutdown_connections 2024-09-21T06:07:49.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.448+0000 7f033da00640 1 -- 172.21.15.118:0/4060846818 wait complete. 2024-09-21T06:07:49.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 -- 172.21.15.118:0/2860971408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fef0 msgr2=0x7f8ddc0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 --2- 172.21.15.118:0/2860971408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fef0 0x7f8ddc0d13c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009830 tx=0x7f8dc402a480 comp rx=0 tx=0).stop 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 -- 172.21.15.118:0/2860971408 shutdown_connections 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 --2- 172.21.15.118:0/2860971408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fef0 0x7f8ddc0d13c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 --2- 172.21.15.118:0/2860971408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ddc13fae0 0x7f8ddc0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 -- 172.21.15.118:0/2860971408 >> 172.21.15.118:0/2860971408 conn(0x7f8ddc06d110 msgr2=0x7f8ddc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 -- 172.21.15.118:0/2860971408 shutdown_connections 2024-09-21T06:07:49.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.692+0000 7f8de1600640 1 -- 172.21.15.118:0/2860971408 wait complete. 2024-09-21T06:07:49.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.694+0000 7f8de1600640 1 Processor -- start 2024-09-21T06:07:49.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.694+0000 7f8de1600640 1 -- start start 2024-09-21T06:07:49.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8de1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fae0 0x7f8ddc148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8de1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ddc13fef0 0x7f8ddc141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8de1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ddc142730 0x7f8ddc141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8de1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc0cfac0 con 0x7f8ddc13fae0 2024-09-21T06:07:49.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8de1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc0cf940 con 0x7f8ddc142730 2024-09-21T06:07:49.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8de1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc0cfc40 con 0x7f8ddc13fef0 2024-09-21T06:07:49.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8ddaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fae0 0x7f8ddc148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8ddaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fae0 0x7f8ddc148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34614/0 (socket says 172.21.15.118:34614) 2024-09-21T06:07:49.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8ddaa00640 1 -- 172.21.15.118:0/522655875 learned_addr learned my addr 172.21.15.118:0/522655875 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:49.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8ddaa00640 1 -- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ddc13fef0 msgr2=0x7f8ddc141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8dd2000640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ddc13fef0 0x7f8ddc141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.696+0000 7f8ddb400640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ddc142730 0x7f8ddc141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8ddaa00640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ddc13fef0 0x7f8ddc141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8ddaa00640 1 -- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ddc142730 msgr2=0x7f8ddc141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8ddaa00640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ddc142730 0x7f8ddc141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8ddaa00640 1 -- 172.21.15.118:0/522655875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc13bb10 con 0x7f8ddc13fae0 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8dd2000640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ddc13fef0 0x7f8ddc141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8ddb400640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ddc142730 0x7f8ddc141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8ddaa00640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fae0 0x7f8ddc148fd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00d740 tx=0x7f8dcc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8dd3400640 1 -- 172.21.15.118:0/522655875 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc017070 con 0x7f8ddc13fae0 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8dd3400640 1 -- 172.21.15.118:0/522655875 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dcc009d20 con 0x7f8ddc13fae0 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc13dcf0 con 0x7f8ddc13fae0 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8dd3400640 1 -- 172.21.15.118:0/522655875 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc0106c0 con 0x7f8ddc13fae0 2024-09-21T06:07:49.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.697+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc0b4ab0 con 0x7f8ddc13fae0 2024-09-21T06:07:49.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.698+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ddc0d00f0 con 0x7f8ddc13fae0 2024-09-21T06:07:49.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.700+0000 7f8dd3400640 1 -- 172.21.15.118:0/522655875 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8dcc01a070 con 0x7f8ddc13fae0 2024-09-21T06:07:49.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.701+0000 7f8dd3400640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8db8078bc0 0x7f8db807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:49.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.701+0000 7f8dd3400640 1 -- 172.21.15.118:0/522655875 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f8dcc09ac50 con 0x7f8ddc13fae0 2024-09-21T06:07:49.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.701+0000 7f8dd2000640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8db8078bc0 0x7f8db807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:49.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.702+0000 7f8dd2000640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8db8078bc0 0x7f8db807b0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4034000 tx=0x7f8dc4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:49.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.705+0000 7f8dd3400640 1 -- 172.21.15.118:0/522655875 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8dcc063340 con 0x7f8ddc13fae0 2024-09-21T06:07:49.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.894+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8ddc076700 con 0x7f8ddc13fae0 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.894+0000 7f8dd3400640 1 -- 172.21.15.118:0/522655875 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f8dcc062c40 con 0x7f8ddc13fae0 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:07:49.896 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:07:49.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8db8078bc0 msgr2=0x7f8db807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8db8078bc0 0x7f8db807b0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4034000 tx=0x7f8dc4004730 comp rx=0 tx=0).stop 2024-09-21T06:07:49.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fae0 msgr2=0x7f8ddc148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:49.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fae0 0x7f8ddc148fd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00d740 tx=0x7f8dcc00dc00 comp rx=0 tx=0).stop 2024-09-21T06:07:49.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 shutdown_connections 2024-09-21T06:07:49.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ddc142730 0x7f8ddc141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8db8078bc0 0x7f8db807b0d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ddc13fef0 0x7f8ddc141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 --2- 172.21.15.118:0/522655875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ddc13fae0 0x7f8ddc148fd0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:49.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.896+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 >> 172.21.15.118:0/522655875 conn(0x7f8ddc06d110 msgr2=0x7f8ddc155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:49.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.897+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 shutdown_connections 2024-09-21T06:07:49.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:49.897+0000 7f8de1600640 1 -- 172.21.15.118:0/522655875 wait complete. 2024-09-21T06:07:49.923 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:07:49.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 -- 172.21.15.118:0/3035591619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4162cc0 msgr2=0x7fd1e415f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 --2- 172.21.15.118:0/3035591619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4162cc0 0x7fd1e415f680 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4005fd0 tx=0x7fd1d402aa90 comp rx=0 tx=0).stop 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 -- 172.21.15.118:0/3035591619 shutdown_connections 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 --2- 172.21.15.118:0/3035591619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1e40cd8b0 0x7fd1e40cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 --2- 172.21.15.118:0/3035591619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e4162cc0 0x7fd1e415f680 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 -- 172.21.15.118:0/3035591619 >> 172.21.15.118:0/3035591619 conn(0x7fd1e406cf30 msgr2=0x7fd1e406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 -- 172.21.15.118:0/3035591619 shutdown_connections 2024-09-21T06:07:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.148+0000 7fd1ea800640 1 -- 172.21.15.118:0/3035591619 wait complete. 2024-09-21T06:07:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.150+0000 7fd1ea800640 1 Processor -- start 2024-09-21T06:07:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.151+0000 7fd1ea800640 1 -- start start 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1ea800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e40cd8b0 0x7fd1e4145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1ea800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1e4156230 0x7fd1e40cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1ea800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4162cc0 0x7fd1e41f9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1ea800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40cf1f0 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1ea800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40cf070 con 0x7fd1e4162cc0 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1ea800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e40cf370 con 0x7fd1e4156230 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1e3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e40cd8b0 0x7fd1e4145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1e3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e40cd8b0 0x7fd1e4145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34638/0 (socket says 172.21.15.118:34638) 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.152+0000 7fd1e3400640 1 -- 172.21.15.118:0/81175512 learned_addr learned my addr 172.21.15.118:0/81175512 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3400640 1 -- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1e4156230 msgr2=0x7fd1e40cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e2a00640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1e4156230 0x7fd1e40cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3e00640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4162cc0 0x7fd1e41f9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3400640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1e4156230 0x7fd1e40cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3400640 1 -- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4162cc0 msgr2=0x7fd1e41f9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3400640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4162cc0 0x7fd1e41f9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3400640 1 -- 172.21.15.118:0/81175512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e4146500 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3e00640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4162cc0 0x7fd1e41f9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e2a00640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1e4156230 0x7fd1e40cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1e3400640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e40cd8b0 0x7fd1e4145c70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4000f80 tx=0x7fd1d4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1db400640 1 -- 172.21.15.118:0/81175512 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4044070 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1db400640 1 -- 172.21.15.118:0/81175512 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1d4004250 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1db400640 1 -- 172.21.15.118:0/81175512 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4004660 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.153+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e40c6cc0 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.154+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e40c7280 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.155+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e406a260 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.156+0000 7fd1db400640 1 -- 172.21.15.118:0/81175512 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd1d4047070 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.157+0000 7fd1db400640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd1c4078b90 0x7fd1c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.157+0000 7fd1db400640 1 -- 172.21.15.118:0/81175512 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7fd1d40bbe90 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.158+0000 7fd1e2a00640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd1c4078b90 0x7fd1c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:50.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.158+0000 7fd1e2a00640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd1c4078b90 0x7fd1c407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd1e415eb10 tx=0x7fd1d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.160+0000 7fd1db400640 1 -- 172.21.15.118:0/81175512 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd1d4032030 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.349+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd1e40cd2b0 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.933+0000 7fd1db400640 1 -- 172.21.15.118:0/81175512 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7fd1d4084790 con 0x7fd1e40cd8b0 2024-09-21T06:07:50.935 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd1c4078b90 msgr2=0x7fd1c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd1c4078b90 0x7fd1c407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd1e415eb10 tx=0x7fd1d0009040 comp rx=0 tx=0).stop 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e40cd8b0 msgr2=0x7fd1e4145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e40cd8b0 0x7fd1e4145c70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4000f80 tx=0x7fd1d4003f10 comp rx=0 tx=0).stop 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 shutdown_connections 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1e4162cc0 0x7fd1e41f9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd1c4078b90 0x7fd1c407b0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1e4156230 0x7fd1e40cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 --2- 172.21.15.118:0/81175512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1e40cd8b0 0x7fd1e4145c70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.936+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 >> 172.21.15.118:0/81175512 conn(0x7fd1e406cf30 msgr2=0x7fd1e40b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:50.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.937+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 shutdown_connections 2024-09-21T06:07:50.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:50.937+0000 7fd1ea800640 1 -- 172.21.15.118:0/81175512 wait complete. 2024-09-21T06:07:50.966 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:07:51.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 -- 172.21.15.118:0/2707796206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 msgr2=0x7fe818163600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:51.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 --2- 172.21.15.118:0/2707796206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe818163600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe8180b27c0 tx=0x7fe80802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 -- 172.21.15.118:0/2707796206 shutdown_connections 2024-09-21T06:07:51.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 --2- 172.21.15.118:0/2707796206 >> v2:172.21.15.149:3300/0 conn(0x7fe8180b4830 0x7fe8180cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 --2- 172.21.15.118:0/2707796206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe818163600 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 -- 172.21.15.118:0/2707796206 >> 172.21.15.118:0/2707796206 conn(0x7fe818071070 msgr2=0x7fe818071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:51.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 -- 172.21.15.118:0/2707796206 shutdown_connections 2024-09-21T06:07:51.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.192+0000 7fe81dc00640 1 -- 172.21.15.118:0/2707796206 wait complete. 2024-09-21T06:07:51.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.194+0000 7fe81dc00640 1 Processor -- start 2024-09-21T06:07:51.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.194+0000 7fe81dc00640 1 -- start start 2024-09-21T06:07:51.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe81dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8180b4830 0x7fe8181450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:51.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe81dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8180b4c40 0x7fe8180b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:51.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe81dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe8180d1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:51.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe81dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180cfed0 con 0x7fe818148a00 2024-09-21T06:07:51.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe81dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180cfd50 con 0x7fe8180b4830 2024-09-21T06:07:51.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe81dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe81806e110 con 0x7fe8180b4c40 2024-09-21T06:07:51.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe8180d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe8180d1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34658/0 (socket says 172.21.15.118:34658) 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 -- 172.21.15.118:0/824378847 learned_addr learned my addr 172.21.15.118:0/824378847 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe816a00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8180b4830 0x7fe8181450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe80e000640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8180b4c40 0x7fe8180b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 -- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8180b4c40 msgr2=0x7fe8180b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8180b4c40 0x7fe8180b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 -- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8180b4830 msgr2=0x7fe8181450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8180b4830 0x7fe8181450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe817400640 1 -- 172.21.15.118:0/824378847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8181f95f0 con 0x7fe818148a00 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.196+0000 7fe816a00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8180b4830 0x7fe8181450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.197+0000 7fe817400640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe8180d1840 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b970 tx=0x7fe81000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.197+0000 7fe80f400640 1 -- 172.21.15.118:0/824378847 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810019070 con 0x7fe818148a00 2024-09-21T06:07:51.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.197+0000 7fe80f400640 1 -- 172.21.15.118:0/824378847 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe81000cc30 con 0x7fe818148a00 2024-09-21T06:07:51.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.197+0000 7fe80f400640 1 -- 172.21.15.118:0/824378847 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100146a0 con 0x7fe818148a00 2024-09-21T06:07:51.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.197+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8181f98d0 con 0x7fe818148a00 2024-09-21T06:07:51.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.197+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8181f9e90 con 0x7fe818148a00 2024-09-21T06:07:51.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.198+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe818160090 con 0x7fe818148a00 2024-09-21T06:07:51.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.200+0000 7fe80f400640 1 -- 172.21.15.118:0/824378847 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe81001c070 con 0x7fe818148a00 2024-09-21T06:07:51.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.201+0000 7fe80f400640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7f4078b90 0x7fe7f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:51.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.201+0000 7fe80f400640 1 -- 172.21.15.118:0/824378847 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5227+0+0 (secure 0 0 0) 0x7fe81009aca0 con 0x7fe818148a00 2024-09-21T06:07:51.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.201+0000 7fe816a00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7f4078b90 0x7fe7f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:51.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.202+0000 7fe816a00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7f4078b90 0x7fe7f407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe808033000 tx=0x7fe808004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:51.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.205+0000 7fe80f400640 1 -- 172.21.15.118:0/824378847 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8100632a0 con 0x7fe818148a00 2024-09-21T06:07:51.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.393+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe8180cef10 con 0x7fe818148a00 2024-09-21T06:07:51.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.936+0000 7fe80f400640 1 -- 172.21.15.118:0/824378847 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fe810062ba0 con 0x7fe818148a00 2024-09-21T06:07:51.938 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:07:51.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.940+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7f4078b90 msgr2=0x7fe7f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:51.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.940+0000 7fe81dc00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7f4078b90 0x7fe7f407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe808033000 tx=0x7fe808004730 comp rx=0 tx=0).stop 2024-09-21T06:07:51.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.940+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 msgr2=0x7fe8180d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:51.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.940+0000 7fe81dc00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe8180d1840 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b970 tx=0x7fe81000be30 comp rx=0 tx=0).stop 2024-09-21T06:07:51.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.941+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 shutdown_connections 2024-09-21T06:07:51.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.941+0000 7fe81dc00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe818148a00 0x7fe8180d1840 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.941+0000 7fe81dc00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe7f4078b90 0x7fe7f407b0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.941+0000 7fe81dc00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8180b4c40 0x7fe8180b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.941+0000 7fe81dc00640 1 --2- 172.21.15.118:0/824378847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8180b4830 0x7fe8181450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:51.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.941+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 >> 172.21.15.118:0/824378847 conn(0x7fe818071070 msgr2=0x7fe8180725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:51.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.941+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 shutdown_connections 2024-09-21T06:07:51.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:51.942+0000 7fe81dc00640 1 -- 172.21.15.118:0/824378847 wait complete. 2024-09-21T06:07:51.977 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:07:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.201+0000 7f1168200640 1 -- 172.21.15.118:0/1124015589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 msgr2=0x7f114800ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.201+0000 7f1168200640 1 --2- 172.21.15.118:0/1124015589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f114800ba50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f115800c610 tx=0x7f1148005830 comp rx=0 tx=0).stop 2024-09-21T06:07:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.201+0000 7f1168200640 1 -- 172.21.15.118:0/1124015589 shutdown_connections 2024-09-21T06:07:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.201+0000 7f1168200640 1 --2- 172.21.15.118:0/1124015589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f114800ba50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.201+0000 7f1168200640 1 -- 172.21.15.118:0/1124015589 >> 172.21.15.118:0/1124015589 conn(0x7f116006d110 msgr2=0x7f116006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.201+0000 7f1168200640 1 -- 172.21.15.118:0/1124015589 shutdown_connections 2024-09-21T06:07:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.201+0000 7f1168200640 1 -- 172.21.15.118:0/1124015589 wait complete. 2024-09-21T06:07:52.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.203+0000 7f1168200640 1 Processor -- start 2024-09-21T06:07:52.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.203+0000 7f1168200640 1 -- start start 2024-09-21T06:07:52.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1168200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f11601e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:52.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1168200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11601e8170 0x7f11601e6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:52.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1168200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11601e6d90 0x7f11601f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:52.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1168200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f11600d1000 con 0x7f11480053a0 2024-09-21T06:07:52.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1168200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11600d0e80 con 0x7f11601e8170 2024-09-21T06:07:52.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1168200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11600d1180 con 0x7f11601e6d90 2024-09-21T06:07:52.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f11601e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f11601e7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34678/0 (socket says 172.21.15.118:34678) 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 -- 172.21.15.118:0/1647923992 learned_addr learned my addr 172.21.15.118:0/1647923992 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1166200640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11601e6d90 0x7f11601f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1164e00640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11601e8170 0x7f11601e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 -- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11601e6d90 msgr2=0x7f11601f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11601e6d90 0x7f11601f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 -- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11601e8170 msgr2=0x7f11601e6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11601e8170 0x7f11601e6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1165800640 1 -- 172.21.15.118:0/1647923992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1160074c50 con 0x7f11480053a0 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.205+0000 7f1164e00640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11601e8170 0x7f11601e6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.206+0000 7f1165800640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f11601e7c30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1154005fd0 tx=0x7f115400fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.206+0000 7f115d600640 1 -- 172.21.15.118:0/1647923992 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115400bcb0 con 0x7f11480053a0 2024-09-21T06:07:52.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.206+0000 7f115d600640 1 -- 172.21.15.118:0/1647923992 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1154011440 con 0x7f11480053a0 2024-09-21T06:07:52.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.206+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116013dc60 con 0x7f11480053a0 2024-09-21T06:07:52.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.206+0000 7f115d600640 1 -- 172.21.15.118:0/1647923992 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154011890 con 0x7f11480053a0 2024-09-21T06:07:52.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.206+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116013e220 con 0x7f11480053a0 2024-09-21T06:07:52.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.207+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11600d16e0 con 0x7f11480053a0 2024-09-21T06:07:52.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.209+0000 7f115d600640 1 -- 172.21.15.118:0/1647923992 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1154019020 con 0x7f11480053a0 2024-09-21T06:07:52.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.210+0000 7f115d600640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1140078b90 0x7f114007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:52.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.210+0000 7f115d600640 1 -- 172.21.15.118:0/1647923992 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5609+0+0 (secure 0 0 0) 0x7f115409bc10 con 0x7f11480053a0 2024-09-21T06:07:52.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.210+0000 7f1164e00640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1140078b90 0x7f114007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:52.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.211+0000 7f1164e00640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1140078b90 0x7f114007b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f11600738e0 tx=0x7f114c006b70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:52.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.213+0000 7f115d600640 1 -- 172.21.15.118:0/1647923992 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1154029020 con 0x7f11480053a0 2024-09-21T06:07:52.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.439+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f11600b56f0 con 0x7f11480053a0 2024-09-21T06:07:52.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.956+0000 7f115d600640 1 -- 172.21.15.118:0/1647923992 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v39) ==== 174+0+0 (secure 0 0 0) 0x7f1154063ad0 con 0x7f11480053a0 2024-09-21T06:07:52.958 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 10 and data pool 11 2024-09-21T06:07:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1140078b90 msgr2=0x7f114007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1140078b90 0x7f114007b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f11600738e0 tx=0x7f114c006b70 comp rx=0 tx=0).stop 2024-09-21T06:07:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 msgr2=0x7f11601e7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f11601e7c30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1154005fd0 tx=0x7f115400fe60 comp rx=0 tx=0).stop 2024-09-21T06:07:52.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 shutdown_connections 2024-09-21T06:07:52.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1140078b90 0x7f114007b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:52.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11601e6d90 0x7f11601f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:52.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11601e8170 0x7f11601e6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:52.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 --2- 172.21.15.118:0/1647923992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11480053a0 0x7f11601e7c30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:52.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 >> 172.21.15.118:0/1647923992 conn(0x7f116006d110 msgr2=0x7f11600b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:52.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.960+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 shutdown_connections 2024-09-21T06:07:52.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:52.961+0000 7f1168200640 1 -- 172.21.15.118:0/1647923992 wait complete. 2024-09-21T06:07:52.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 -- 172.21.15.118:0/765598939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80cfe30 msgr2=0x7fa6e80d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/765598939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80cfe30 0x7fa6e80d0240 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0005fd0 tx=0x7fa6d002a540 comp rx=0 tx=0).stop 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 -- 172.21.15.118:0/765598939 shutdown_connections 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/765598939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80cfe30 0x7fa6e80d0240 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/765598939 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e8073fa0 0x7fa6e80749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 -- 172.21.15.118:0/765598939 >> 172.21.15.118:0/765598939 conn(0x7fa6e806d6e0 msgr2=0x7fa6e80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 -- 172.21.15.118:0/765598939 shutdown_connections 2024-09-21T06:07:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.219+0000 7fa6e7e00640 1 -- 172.21.15.118:0/765598939 wait complete. 2024-09-21T06:07:53.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.221+0000 7fa6e7e00640 1 Processor -- start 2024-09-21T06:07:53.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.222+0000 7fa6e7e00640 1 -- start start 2024-09-21T06:07:53.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e8073fa0 0x7fa6e81f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80b5bb0 0x7fa6e813b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6e7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e80cfe30 0x7fa6e81409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6e7e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e815d9c0 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6e7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e815d840 con 0x7fa6e80cfe30 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6e7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e815db40 con 0x7fa6e8073fa0 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6de000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80b5bb0 0x7fa6e813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6de000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80b5bb0 0x7fa6e813b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34698/0 (socket says 172.21.15.118:34698) 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.223+0000 7fa6de000640 1 -- 172.21.15.118:0/3047746096 learned_addr learned my addr 172.21.15.118:0/3047746096 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6e6a00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e8073fa0 0x7fa6e81f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6e7400640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e80cfe30 0x7fa6e81409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6de000640 1 -- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e8073fa0 msgr2=0x7fa6e81f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6de000640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e8073fa0 0x7fa6e81f7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6de000640 1 -- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e80cfe30 msgr2=0x7fa6e81409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6de000640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e80cfe30 0x7fa6e81409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6de000640 1 -- 172.21.15.118:0/3047746096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e813e0f0 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6de000640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80b5bb0 0x7fa6e813b210 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000c00 tx=0x7fa6d00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.224+0000 7fa6dfe00640 1 -- 172.21.15.118:0/3047746096 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d003e030 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.225+0000 7fa6dfe00640 1 -- 172.21.15.118:0/3047746096 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6d0003db0 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.225+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e81f7850 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.225+0000 7fa6dfe00640 1 -- 172.21.15.118:0/3047746096 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0035040 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.225+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e81f7e10 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.226+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e81f75c0 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.227+0000 7fa6dfe00640 1 -- 172.21.15.118:0/3047746096 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6d0041030 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.228+0000 7fa6dfe00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6c4078bc0 0x7fa6c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.228+0000 7fa6dfe00640 1 -- 172.21.15.118:0/3047746096 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fa6d00bb390 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.229+0000 7fa6e6a00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6c4078bc0 0x7fa6c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.229+0000 7fa6e6a00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6c4078bc0 0x7fa6c407b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8005fd0 tx=0x7fa6d8009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:53.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.233+0000 7fa6dfe00640 1 -- 172.21.15.118:0/3047746096 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa6d0083180 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.419+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6e815e030 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.420+0000 7fa6dfe00640 1 -- 172.21.15.118:0/3047746096 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16813 (secure 0 0 0) 0x7fa6d0087bb0 con 0x7fa6e80b5bb0 2024-09-21T06:07:53.422 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:53.423 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":80,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:07:52.440840+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:07:50.361302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T06:07:51.405276+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:07:53.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6c4078bc0 msgr2=0x7fa6c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6c4078bc0 0x7fa6c407b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8005fd0 tx=0x7fa6d8009500 comp rx=0 tx=0).stop 2024-09-21T06:07:53.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80b5bb0 msgr2=0x7fa6e813b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80b5bb0 0x7fa6e813b210 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000c00 tx=0x7fa6d00038a0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 shutdown_connections 2024-09-21T06:07:53.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6e80cfe30 0x7fa6e81409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e80b5bb0 0x7fa6e813b210 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6c4078bc0 0x7fa6c407b0d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 --2- 172.21.15.118:0/3047746096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6e8073fa0 0x7fa6e81f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 >> 172.21.15.118:0/3047746096 conn(0x7fa6e806d6e0 msgr2=0x7fa6e8157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 shutdown_connections 2024-09-21T06:07:53.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.423+0000 7fa6e7e00640 1 -- 172.21.15.118:0/3047746096 wait complete. 2024-09-21T06:07:53.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 -- 172.21.15.118:0/2619598568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c40d1590 msgr2=0x7ff0c4142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 --2- 172.21.15.118:0/2619598568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c40d1590 0x7ff0c4142730 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff0c415d420 tx=0x7ff0b402a4b0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 -- 172.21.15.118:0/2619598568 shutdown_connections 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 --2- 172.21.15.118:0/2619598568 >> v2:172.21.15.149:3300/0 conn(0x7ff0c413fef0 0x7ff0c4142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 --2- 172.21.15.118:0/2619598568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c40d1590 0x7ff0c4142730 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 -- 172.21.15.118:0/2619598568 >> 172.21.15.118:0/2619598568 conn(0x7ff0c406d110 msgr2=0x7ff0c406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 -- 172.21.15.118:0/2619598568 shutdown_connections 2024-09-21T06:07:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.668+0000 7ff0cc800640 1 -- 172.21.15.118:0/2619598568 wait complete. 2024-09-21T06:07:53.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.670+0000 7ff0cc800640 1 Processor -- start 2024-09-21T06:07:53.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.671+0000 7ff0cc800640 1 -- start start 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0cc800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c413fae0 0x7ff0c4072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0cc800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c413fef0 0x7ff0c41f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0cc800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c41f6760 0x7ff0c413a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0cc800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c40cfa70 con 0x7ff0c41f6760 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0cc800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c40cf8f0 con 0x7ff0c413fae0 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0cc800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c40cfbf0 con 0x7ff0c413fef0 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0ca800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c41f6760 0x7ff0c413a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0ca800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c41f6760 0x7ff0c413a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34704/0 (socket says 172.21.15.118:34704) 2024-09-21T06:07:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.672+0000 7ff0ca800640 1 -- 172.21.15.118:0/4025591553 learned_addr learned my addr 172.21.15.118:0/4025591553 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0c9400640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c413fef0 0x7ff0c41f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0c9e00640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c413fae0 0x7ff0c4072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0ca800640 1 -- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c413fef0 msgr2=0x7ff0c41f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0ca800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c413fef0 0x7ff0c41f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0ca800640 1 -- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c413fae0 msgr2=0x7ff0c4072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0ca800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c413fae0 0x7ff0c4072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0ca800640 1 -- 172.21.15.118:0/4025591553 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c41f9770 con 0x7ff0c41f6760 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0ca800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c41f6760 0x7ff0c413a060 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000cad0 tx=0x7ff0c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0be000640 1 -- 172.21.15.118:0/4025591553 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000ae20 con 0x7ff0c41f6760 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0be000640 1 -- 172.21.15.118:0/4025591553 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0c000f450 con 0x7ff0c41f6760 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0be000640 1 -- 172.21.15.118:0/4025591553 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000f8c0 con 0x7ff0c41f6760 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c41f9a50 con 0x7ff0c41f6760 2024-09-21T06:07:53.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.673+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c41f5d20 con 0x7ff0c41f6760 2024-09-21T06:07:53.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.674+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c40d0110 con 0x7ff0c41f6760 2024-09-21T06:07:53.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.676+0000 7ff0be000640 1 -- 172.21.15.118:0/4025591553 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0c000fa60 con 0x7ff0c41f6760 2024-09-21T06:07:53.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.677+0000 7ff0be000640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0a8078bc0 0x7ff0a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:53.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.677+0000 7ff0be000640 1 -- 172.21.15.118:0/4025591553 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7ff0c009b970 con 0x7ff0c41f6760 2024-09-21T06:07:53.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.677+0000 7ff0c9e00640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0a8078bc0 0x7ff0a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:53.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.678+0000 7ff0c9e00640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0a8078bc0 0x7ff0a807b0d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8007fd0 tx=0x7ff0b8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:53.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.681+0000 7ff0be000640 1 -- 172.21.15.118:0/4025591553 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff0c0014030 con 0x7ff0c41f6760 2024-09-21T06:07:53.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.866+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0c4160f40 con 0x7ff0c41f6760 2024-09-21T06:07:53.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.867+0000 7ff0be000640 1 -- 172.21.15.118:0/4025591553 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16813 (secure 0 0 0) 0x7ff0c0063d10 con 0x7ff0c41f6760 2024-09-21T06:07:53.868 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:53.869 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":80,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:07:52.440840+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:07:50.361302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T06:07:51.405276+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0a8078bc0 msgr2=0x7ff0a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0a8078bc0 0x7ff0a807b0d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8007fd0 tx=0x7ff0b8009040 comp rx=0 tx=0).stop 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c41f6760 msgr2=0x7ff0c413a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c41f6760 0x7ff0c413a060 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000cad0 tx=0x7ff0c000cf90 comp rx=0 tx=0).stop 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 shutdown_connections 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0c41f6760 0x7ff0c413a060 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff0a8078bc0 0x7ff0a807b0d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c413fef0 0x7ff0c41f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 --2- 172.21.15.118:0/4025591553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c413fae0 0x7ff0c4072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:53.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 >> 172.21.15.118:0/4025591553 conn(0x7ff0c406d110 msgr2=0x7ff0c40d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:53.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 shutdown_connections 2024-09-21T06:07:53.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:53.869+0000 7ff0cc800640 1 -- 172.21.15.118:0/4025591553 wait complete. 2024-09-21T06:07:53.893 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:07:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 -- 172.21.15.118:0/3201463208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c0aea60 msgr2=0x7fbb5c0aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 --2- 172.21.15.118:0/3201463208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c0aea60 0x7fbb5c0aee70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c071c00 tx=0x7fbb5402aa30 comp rx=0 tx=0).stop 2024-09-21T06:07:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 -- 172.21.15.118:0/3201463208 shutdown_connections 2024-09-21T06:07:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 --2- 172.21.15.118:0/3201463208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c0aea60 0x7fbb5c0aee70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 --2- 172.21.15.118:0/3201463208 >> v2:172.21.15.149:3300/0 conn(0x7fbb5c073e30 0x7fbb5c1635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 -- 172.21.15.118:0/3201463208 >> 172.21.15.118:0/3201463208 conn(0x7fbb5c06d110 msgr2=0x7fbb5c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 -- 172.21.15.118:0/3201463208 shutdown_connections 2024-09-21T06:07:54.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.118+0000 7fbb64200640 1 -- 172.21.15.118:0/3201463208 wait complete. 2024-09-21T06:07:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.121+0000 7fbb64200640 1 Processor -- start 2024-09-21T06:07:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.121+0000 7fbb64200640 1 -- start start 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb64200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c073e30 0x7fbb5c1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb64200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb5c0aea60 0x7fbb5c14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb64200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb5c0d0e80 0x7fbb5c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb64200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0af530 con 0x7fbb5c073e30 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb64200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0af3b0 con 0x7fbb5c0aea60 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb64200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c0af6b0 con 0x7fbb5c0d0e80 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb61800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c073e30 0x7fbb5c1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb61800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c073e30 0x7fbb5c1519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34728/0 (socket says 172.21.15.118:34728) 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.122+0000 7fbb61800640 1 -- 172.21.15.118:0/868784235 learned_addr learned my addr 172.21.15.118:0/868784235 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb62200640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb5c0d0e80 0x7fbb5c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:54.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb60e00640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb5c0aea60 0x7fbb5c14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:54.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb61800640 1 -- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb5c0d0e80 msgr2=0x7fbb5c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb61800640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb5c0d0e80 0x7fbb5c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb61800640 1 -- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb5c0aea60 msgr2=0x7fbb5c14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb61800640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb5c0aea60 0x7fbb5c14ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb61800640 1 -- 172.21.15.118:0/868784235 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c152b30 con 0x7fbb5c073e30 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.123+0000 7fbb61800640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c073e30 0x7fbb5c1519f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000d700 tx=0x7fbb5000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.124+0000 7fbb59600640 1 -- 172.21.15.118:0/868784235 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50017070 con 0x7fbb5c073e30 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.124+0000 7fbb59600640 1 -- 172.21.15.118:0/868784235 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb50005310 con 0x7fbb5c073e30 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.124+0000 7fbb59600640 1 -- 172.21.15.118:0/868784235 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50009820 con 0x7fbb5c073e30 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.124+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c152850 con 0x7fbb5c073e30 2024-09-21T06:07:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.124+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c1511f0 con 0x7fbb5c073e30 2024-09-21T06:07:54.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.125+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c158050 con 0x7fbb5c073e30 2024-09-21T06:07:54.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.126+0000 7fbb59600640 1 -- 172.21.15.118:0/868784235 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb500099c0 con 0x7fbb5c073e30 2024-09-21T06:07:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.127+0000 7fbb59600640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb3c078b90 0x7fbb3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.127+0000 7fbb59600640 1 -- 172.21.15.118:0/868784235 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fbb5009adb0 con 0x7fbb5c073e30 2024-09-21T06:07:54.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.128+0000 7fbb60e00640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb3c078b90 0x7fbb3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:54.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.128+0000 7fbb60e00640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb3c078b90 0x7fbb3c07b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c162320 tx=0x7fbb48009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:54.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.131+0000 7fbb59600640 1 -- 172.21.15.118:0/868784235 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbb5009f070 con 0x7fbb5c073e30 2024-09-21T06:07:54.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.355+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbb5c0afb60 con 0x7fbb5c073e30 2024-09-21T06:07:54.935 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:07:54.933+0000 7f66b2200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:07:54.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.993+0000 7fbb59600640 1 -- 172.21.15.118:0/868784235 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) ==== 118+0+0 (secure 0 0 0) 0x7fbb50062b90 con 0x7fbb5c073e30 2024-09-21T06:07:55.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb3c078b90 msgr2=0x7fbb3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:55.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb3c078b90 0x7fbb3c07b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c162320 tx=0x7fbb48009060 comp rx=0 tx=0).stop 2024-09-21T06:07:55.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c073e30 msgr2=0x7fbb5c1519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:55.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c073e30 0x7fbb5c1519f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000d700 tx=0x7fbb5000dbc0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 shutdown_connections 2024-09-21T06:07:55.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb3c078b90 0x7fbb3c07b0a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb5c0d0e80 0x7fbb5c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb5c0aea60 0x7fbb5c14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 --2- 172.21.15.118:0/868784235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5c073e30 0x7fbb5c1519f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 >> 172.21.15.118:0/868784235 conn(0x7fbb5c06d110 msgr2=0x7fbb5c076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:55.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 shutdown_connections 2024-09-21T06:07:55.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:54.996+0000 7fbb64200640 1 -- 172.21.15.118:0/868784235 wait complete. 2024-09-21T06:07:55.028 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:07:55.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:07:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.262+0000 7f2d03200640 1 -- 172.21.15.118:0/1140946052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ce0004800 msgr2=0x7f2ce0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.262+0000 7f2d03200640 1 --2- 172.21.15.118:0/1140946052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ce0004800 0x7f2ce0004c10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800bb20 tx=0x7f2ce0005830 comp rx=0 tx=0).stop 2024-09-21T06:07:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.262+0000 7f2d03200640 1 -- 172.21.15.118:0/1140946052 shutdown_connections 2024-09-21T06:07:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.262+0000 7f2d03200640 1 --2- 172.21.15.118:0/1140946052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ce0004800 0x7f2ce0004c10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.262+0000 7f2d03200640 1 -- 172.21.15.118:0/1140946052 >> 172.21.15.118:0/1140946052 conn(0x7f2cfc06d110 msgr2=0x7f2cfc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.262+0000 7f2d03200640 1 -- 172.21.15.118:0/1140946052 shutdown_connections 2024-09-21T06:07:55.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.262+0000 7f2d03200640 1 -- 172.21.15.118:0/1140946052 wait complete. 2024-09-21T06:07:55.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.265+0000 7f2d03200640 1 Processor -- start 2024-09-21T06:07:55.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.265+0000 7f2d03200640 1 -- start start 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d03200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ce0004800 0x7f2cfc141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d03200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cfc142070 0x7f2cfc1f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d03200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc0b56b0 0x7f2cfc1f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d03200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc0d16a0 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d03200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc142730 con 0x7f2cfc142070 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d03200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2cfc073bb0 con 0x7f2ce0004800 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d01200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc0b56b0 0x7f2cfc1f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d01200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc0b56b0 0x7f2cfc1f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:34746/0 (socket says 172.21.15.118:34746) 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.266+0000 7f2d01200640 1 -- 172.21.15.118:0/3163255901 learned_addr learned my addr 172.21.15.118:0/3163255901 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2cfbe00640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ce0004800 0x7f2cfc141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2cfb400640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cfc142070 0x7f2cfc1f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:55.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2d01200640 1 -- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ce0004800 msgr2=0x7f2cfc141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2d01200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ce0004800 0x7f2cfc141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2d01200640 1 -- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cfc142070 msgr2=0x7f2cfc1f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2d01200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cfc142070 0x7f2cfc1f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2d01200640 1 -- 172.21.15.118:0/3163255901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc159de0 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2cfbe00640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ce0004800 0x7f2cfc141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2cfb400640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cfc142070 0x7f2cfc1f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2d01200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc0b56b0 0x7f2cfc1f5130 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc140340 tx=0x7f2cf400d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2cf3e00640 1 -- 172.21.15.118:0/3163255901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400f880 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2cf3e00640 1 -- 172.21.15.118:0/3163255901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cf4017070 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2cf3e00640 1 -- 172.21.15.118:0/3163255901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400fdb0 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.267+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc15a0c0 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.268+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc0738f0 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.269+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cfc140570 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.270+0000 7f2cf3e00640 1 -- 172.21.15.118:0/3163255901 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2cf401c460 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.271+0000 7f2cf3e00640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2cdc078b90 0x7f2cdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:55.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.271+0000 7f2cf3e00640 1 -- 172.21.15.118:0/3163255901 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f2cf409ae80 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.272+0000 7f2cfbe00640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2cdc078b90 0x7f2cdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:55.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.272+0000 7f2cfbe00640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2cdc078b90 0x7f2cdc07b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2cec006cd0 tx=0x7f2cec0067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:55.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.276+0000 7f2cf3e00640 1 -- 172.21.15.118:0/3163255901 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2cf4062d10 con 0x7f2cfc0b56b0 2024-09-21T06:07:55.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:55.498+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2cfc142c90 con 0x7f2cfc0b56b0 2024-09-21T06:07:56.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.002+0000 7f2cf3e00640 1 -- 172.21.15.118:0/3163255901 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7f2cf4067740 con 0x7f2cfc0b56b0 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2cdc078b90 msgr2=0x7f2cdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2cdc078b90 0x7f2cdc07b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2cec006cd0 tx=0x7f2cec0067a0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc0b56b0 msgr2=0x7f2cfc1f5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc0b56b0 0x7f2cfc1f5130 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc140340 tx=0x7f2cf400d970 comp rx=0 tx=0).stop 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 shutdown_connections 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cfc0b56b0 0x7f2cfc1f5130 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cfc142070 0x7f2cfc1f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2cdc078b90 0x7f2cdc07b0a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 --2- 172.21.15.118:0/3163255901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ce0004800 0x7f2cfc141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 >> 172.21.15.118:0/3163255901 conn(0x7f2cfc06d110 msgr2=0x7f2cfc139320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 shutdown_connections 2024-09-21T06:07:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.005+0000 7f2d03200640 1 -- 172.21.15.118:0/3163255901 wait complete. 2024-09-21T06:07:56.032 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:07:56.032 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:07:56.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 -- 172.21.15.118:0/1372232224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf0073250 msgr2=0x7f5cf0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 --2- 172.21.15.118:0/1372232224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf0073250 0x7f5cf0070630 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8005fd0 tx=0x7f5ce802a980 comp rx=0 tx=0).stop 2024-09-21T06:07:56.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 -- 172.21.15.118:0/1372232224 shutdown_connections 2024-09-21T06:07:56.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 --2- 172.21.15.118:0/1372232224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf0073250 0x7f5cf0070630 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 --2- 172.21.15.118:0/1372232224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf00af560 0x7f5cf00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 -- 172.21.15.118:0/1372232224 >> 172.21.15.118:0/1372232224 conn(0x7f5cf00d0f80 msgr2=0x7f5cf00d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:56.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 -- 172.21.15.118:0/1372232224 shutdown_connections 2024-09-21T06:07:56.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.255+0000 7f5cefe00640 1 -- 172.21.15.118:0/1372232224 wait complete. 2024-09-21T06:07:56.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.257+0000 7f5cefe00640 1 Processor -- start 2024-09-21T06:07:56.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.257+0000 7f5cefe00640 1 -- start start 2024-09-21T06:07:56.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf0073250 0x7f5cf01ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf00af560 0x7f5cf0144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf015ed10 0x7f5cf015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cefe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf00737e0 con 0x7f5cf015ed10 2024-09-21T06:07:56.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cefe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0073660 con 0x7f5cf0073250 2024-09-21T06:07:56.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cefe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf0073960 con 0x7f5cf00af560 2024-09-21T06:07:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cef400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf015ed10 0x7f5cf015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cef400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf015ed10 0x7f5cf015b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47970/0 (socket says 172.21.15.118:47970) 2024-09-21T06:07:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5cef400640 1 -- 172.21.15.118:0/2875623011 learned_addr learned my addr 172.21.15.118:0/2875623011 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5ceea00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf0073250 0x7f5cf01ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.259+0000 7f5ce6000640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf00af560 0x7f5cf0144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cef400640 1 -- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf00af560 msgr2=0x7f5cf0144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cef400640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf00af560 0x7f5cf0144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cef400640 1 -- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf0073250 msgr2=0x7f5cf01ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cef400640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf0073250 0x7f5cf01ebb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cef400640 1 -- 172.21.15.118:0/2875623011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf01ec070 con 0x7f5cf015ed10 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cef400640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf015ed10 0x7f5cf015b120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8033040 tx=0x7f5ce8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5ce7400640 1 -- 172.21.15.118:0/2875623011 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8034040 con 0x7f5cf015ed10 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5ce7400640 1 -- 172.21.15.118:0/2875623011 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ce8004540 con 0x7f5cf015ed10 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf01457a0 con 0x7f5cf015ed10 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5ce7400640 1 -- 172.21.15.118:0/2875623011 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8045480 con 0x7f5cf015ed10 2024-09-21T06:07:56.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.260+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf0145d60 con 0x7f5cf015ed10 2024-09-21T06:07:56.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.261+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf00afc80 con 0x7f5cf015ed10 2024-09-21T06:07:56.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.263+0000 7f5ce7400640 1 -- 172.21.15.118:0/2875623011 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ce8037020 con 0x7f5cf015ed10 2024-09-21T06:07:56.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.264+0000 7f5ce7400640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ccc078b90 0x7f5ccc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.264+0000 7f5ce7400640 1 -- 172.21.15.118:0/2875623011 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5ce80bc4e0 con 0x7f5cf015ed10 2024-09-21T06:07:56.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.265+0000 7f5ceea00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ccc078b90 0x7f5ccc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.265+0000 7f5ceea00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ccc078b90 0x7f5ccc07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0004630 tx=0x7f5ce000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:56.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.269+0000 7f5ce7400640 1 -- 172.21.15.118:0/2875623011 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5cf00afc80 con 0x7f5cf015ed10 2024-09-21T06:07:56.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.489+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cf0070e80 con 0x7f5cf015ed10 2024-09-21T06:07:56.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.489+0000 7f5ce7400640 1 -- 172.21.15.118:0/2875623011 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f5cf01ec070 con 0x7f5cf015ed10 2024-09-21T06:07:56.492 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:56.492 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"btime":"2024-09-21T06:07:55:995571+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:07:52.440795+0000","modified":"2024-09-21T06:07:55.500401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5928},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5928":{"gid":5928,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/186206042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":186206042},{"type":"v1","addr":"172.21.15.118:6835","nonce":186206042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5928,"qdb_cluster":[5928]},"id":5}]} 2024-09-21T06:07:56.492 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 43 2024-09-21T06:07:56.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ccc078b90 msgr2=0x7f5ccc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ccc078b90 0x7f5ccc07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0004630 tx=0x7f5ce000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf015ed10 msgr2=0x7f5cf015b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf015ed10 0x7f5cf015b120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8033040 tx=0x7f5ce8003f10 comp rx=0 tx=0).stop 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 shutdown_connections 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf015ed10 0x7f5cf015b120 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5ccc078b90 0x7f5ccc07b0a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf00af560 0x7f5cf0144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 --2- 172.21.15.118:0/2875623011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf0073250 0x7f5cf01ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 >> 172.21.15.118:0/2875623011 conn(0x7f5cf00d0f80 msgr2=0x7f5cf00d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 shutdown_connections 2024-09-21T06:07:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.492+0000 7f5cefe00640 1 -- 172.21.15.118:0/2875623011 wait complete. 2024-09-21T06:07:56.519 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:07:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.737+0000 7f415cc00640 1 -- 172.21.15.118:0/4208394215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f413c004800 msgr2=0x7f413c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.737+0000 7f415cc00640 1 --2- 172.21.15.118:0/4208394215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f413c004800 0x7f413c004c10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f414000c260 tx=0x7f413c005830 comp rx=0 tx=0).stop 2024-09-21T06:07:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.737+0000 7f4156800640 1 -- 172.21.15.118:0/4208394215 reap_dead start 2024-09-21T06:07:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.737+0000 7f415cc00640 1 -- 172.21.15.118:0/4208394215 shutdown_connections 2024-09-21T06:07:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.737+0000 7f415cc00640 1 -- 172.21.15.118:0/4208394215 >> 172.21.15.118:0/4208394215 conn(0x7f415806d110 msgr2=0x7f415806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.737+0000 7f415cc00640 1 -- 172.21.15.118:0/4208394215 shutdown_connections 2024-09-21T06:07:56.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.737+0000 7f415cc00640 1 -- 172.21.15.118:0/4208394215 wait complete. 2024-09-21T06:07:56.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.739+0000 7f415cc00640 1 Processor -- start 2024-09-21T06:07:56.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.739+0000 7f415cc00640 1 -- start start 2024-09-21T06:07:56.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f415cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f413c004800 0x7f41580c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f415cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41580c68d0 0x7f415815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f415cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815b900 0x7f4158147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f415cc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4158073700 con 0x7f41580c68d0 2024-09-21T06:07:56.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f415cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4158073580 con 0x7f413c004800 2024-09-21T06:07:56.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f415cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4158073880 con 0x7f415815b900 2024-09-21T06:07:56.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f414d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41580c68d0 0x7f415815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f414d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41580c68d0 0x7f415815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47994/0 (socket says 172.21.15.118:47994) 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f414d400640 1 -- 172.21.15.118:0/938730373 learned_addr learned my addr 172.21.15.118:0/938730373 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f4156800640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815b900 0x7f4158147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.741+0000 7f4155e00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f413c004800 0x7f41580c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414d400640 1 -- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815b900 msgr2=0x7f4158147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414d400640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815b900 0x7f4158147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414d400640 1 -- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f413c004800 msgr2=0x7f41580c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414d400640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f413c004800 0x7f41580c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414d400640 1 -- 172.21.15.118:0/938730373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41581f4670 con 0x7f41580c68d0 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f4155e00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f413c004800 0x7f41580c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f4156800640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815b900 0x7f4158147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:56.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414d400640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41580c68d0 0x7f415815b3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f414000c350 tx=0x7f4140001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:56.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414ea00640 1 -- 172.21.15.118:0/938730373 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140031040 con 0x7f41580c68d0 2024-09-21T06:07:56.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414ea00640 1 -- 172.21.15.118:0/938730373 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41400035f0 con 0x7f41580c68d0 2024-09-21T06:07:56.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f414ea00640 1 -- 172.21.15.118:0/938730373 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140003a20 con 0x7f41580c68d0 2024-09-21T06:07:56.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41580c6fe0 con 0x7f41580c68d0 2024-09-21T06:07:56.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.742+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41581f3b90 con 0x7f41580c68d0 2024-09-21T06:07:56.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.743+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41580c6d50 con 0x7f41580c68d0 2024-09-21T06:07:56.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.744+0000 7f414ea00640 1 -- 172.21.15.118:0/938730373 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4140034070 con 0x7f41580c68d0 2024-09-21T06:07:56.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.745+0000 7f414ea00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4134078b90 0x7f413407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:56.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.745+0000 7f414ea00640 1 -- 172.21.15.118:0/938730373 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f41400baf20 con 0x7f41580c68d0 2024-09-21T06:07:56.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.746+0000 7f4155e00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4134078b90 0x7f413407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:56.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.747+0000 7f4155e00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4134078b90 0x7f413407b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4148005eb0 tx=0x7f4148005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:56.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.750+0000 7f414ea00640 1 -- 172.21.15.118:0/938730373 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f41400832c0 con 0x7f41580c68d0 2024-09-21T06:07:56.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.935+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4158073e10 con 0x7f41580c68d0 2024-09-21T06:07:56.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.936+0000 7f414ea00640 1 -- 172.21.15.118:0/938730373 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16800 (secure 0 0 0) 0x7f4140082bc0 con 0x7f41580c68d0 2024-09-21T06:07:56.939 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:56.939 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":81,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:07:53.969936+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:07:50.361302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T06:07:51.405276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4134078b90 msgr2=0x7f413407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4134078b90 0x7f413407b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4148005eb0 tx=0x7f4148005f90 comp rx=0 tx=0).stop 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41580c68d0 msgr2=0x7f415815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41580c68d0 0x7f415815b3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f414000c350 tx=0x7f4140001d40 comp rx=0 tx=0).stop 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 shutdown_connections 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4134078b90 0x7f413407b0a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815b900 0x7f4158147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41580c68d0 0x7f415815b3c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 --2- 172.21.15.118:0/938730373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f413c004800 0x7f41580c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:56.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 >> 172.21.15.118:0/938730373 conn(0x7f415806d110 msgr2=0x7f4158157650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:56.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 shutdown_connections 2024-09-21T06:07:56.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:56.938+0000 7f415cc00640 1 -- 172.21.15.118:0/938730373 wait complete. 2024-09-21T06:07:56.964 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:07:56.964 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:07:57.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.185+0000 7fac07e00640 1 -- 172.21.15.118:0/3870296490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabec004d40 msgr2=0x7fabec005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.185+0000 7fac07e00640 1 --2- 172.21.15.118:0/3870296490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabec004d40 0x7fabec005150 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fac0815d320 tx=0x7fabec005830 comp rx=0 tx=0).stop 2024-09-21T06:07:57.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.185+0000 7fac07400640 1 -- 172.21.15.118:0/3870296490 reap_dead start 2024-09-21T06:07:57.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.185+0000 7fac07e00640 1 -- 172.21.15.118:0/3870296490 shutdown_connections 2024-09-21T06:07:57.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.185+0000 7fac07e00640 1 -- 172.21.15.118:0/3870296490 >> 172.21.15.118:0/3870296490 conn(0x7fac0806d6e0 msgr2=0x7fac080b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:57.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.185+0000 7fac07e00640 1 -- 172.21.15.118:0/3870296490 shutdown_connections 2024-09-21T06:07:57.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.185+0000 7fac07e00640 1 -- 172.21.15.118:0/3870296490 wait complete. 2024-09-21T06:07:57.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.187+0000 7fac07e00640 1 Processor -- start 2024-09-21T06:07:57.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.187+0000 7fac07e00640 1 -- start start 2024-09-21T06:07:57.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabec004d40 0x7fac080b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac08156d50 0x7fac080b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac0813d790 0x7fac0813dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fac08074d80 con 0x7fac0813d790 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac08074c00 con 0x7fac08156d50 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac0815d630 con 0x7fabec004d40 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac0813d790 0x7fac0813dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac0813d790 0x7fac0813dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48002/0 (socket says 172.21.15.118:48002) 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac07400640 1 -- 172.21.15.118:0/1322082949 learned_addr learned my addr 172.21.15.118:0/1322082949 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fac06a00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabec004d40 0x7fac080b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.189+0000 7fabfe000640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac08156d50 0x7fac080b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07400640 1 -- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabec004d40 msgr2=0x7fac080b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07400640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabec004d40 0x7fac080b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07400640 1 -- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac08156d50 msgr2=0x7fac080b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07400640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac08156d50 0x7fac080b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07400640 1 -- 172.21.15.118:0/1322082949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0813e0e0 con 0x7fac0813d790 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fabfe000640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac08156d50 0x7fac080b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07400640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac0813d790 0x7fac0813dba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fac0002b0f0 tx=0x7fac00006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fabff400640 1 -- 172.21.15.118:0/1322082949 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00031070 con 0x7fac0813d790 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fabff400640 1 -- 172.21.15.118:0/1322082949 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac00036660 con 0x7fac0813d790 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fabff400640 1 -- 172.21.15.118:0/1322082949 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00006c50 con 0x7fac0813d790 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac080b5310 con 0x7fac0813d790 2024-09-21T06:07:57.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.190+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac080b58d0 con 0x7fac0813d790 2024-09-21T06:07:57.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.191+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac080d0240 con 0x7fac0813d790 2024-09-21T06:07:57.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.193+0000 7fabff400640 1 -- 172.21.15.118:0/1322082949 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac00034070 con 0x7fac0813d790 2024-09-21T06:07:57.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.194+0000 7fabff400640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.194+0000 7fabff400640 1 -- 172.21.15.118:0/1322082949 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fac000ba610 con 0x7fac0813d790 2024-09-21T06:07:57.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.194+0000 7fac06a00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.195+0000 7fac06a00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009c50 tx=0x7fabf8005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:57.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.199+0000 7fabff400640 1 -- 172.21.15.118:0/1322082949 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fac0813e0e0 con 0x7fac0813d790 2024-09-21T06:07:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.382+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac080b2fe0 con 0x7fabe4078bc0 2024-09-21T06:07:57.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.388+0000 7fabff400640 1 -- 172.21.15.118:0/1322082949 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247575 (secure 0 0 0) 0x7fabf805d730 con 0x7fabe4078bc0 2024-09-21T06:07:57.393 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:57.395 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:07:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 msgr2=0x7fabe407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009c50 tx=0x7fabf8005f90 comp rx=0 tx=0).stop 2024-09-21T06:07:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac0813d790 msgr2=0x7fac0813dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac0813d790 0x7fac0813dba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fac0002b0f0 tx=0x7fac00006650 comp rx=0 tx=0).stop 2024-09-21T06:07:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 shutdown_connections 2024-09-21T06:07:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac0813d790 0x7fac0813dba0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac08156d50 0x7fac080b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 --2- 172.21.15.118:0/1322082949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabec004d40 0x7fac080b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 >> 172.21.15.118:0/1322082949 conn(0x7fac0806d6e0 msgr2=0x7fac080cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 shutdown_connections 2024-09-21T06:07:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.392+0000 7fac07e00640 1 -- 172.21.15.118:0/1322082949 wait complete. 2024-09-21T06:07:57.419 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-21T06:07:56.518634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4485,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558014,"statfs":{"total":1600000000,"available":1595407292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.583705"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988705+0000","last_change":"2024-09-21T06:07:52.986792+0000","last_active":"2024-09-21T06:07:52.988705+0000","last_peered":"2024-09-21T06:07:52.988705+0000","last_clean":"2024-09-21T06:07:52.988705+0000","last_became_active":"2024-09-21T06:07:52.983244+0000","last_became_peered":"2024-09-21T06:07:52.983244+0000","last_unstale":"2024-09-21T06:07:52.988705+0000","last_undegraded":"2024-09-21T06:07:52.988705+0000","last_fullsized":"2024-09-21T06:07:52.988705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:32.024533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.971161+0000","last_change":"2024-09-21T06:07:52.970973+0000","last_active":"2024-09-21T06:07:52.971161+0000","last_peered":"2024-09-21T06:07:52.971161+0000","last_clean":"2024-09-21T06:07:52.971161+0000","last_became_active":"2024-09-21T06:07:52.969488+0000","last_became_peered":"2024-09-21T06:07:52.969488+0000","last_unstale":"2024-09-21T06:07:52.971161+0000","last_undegraded":"2024-09-21T06:07:52.971161+0000","last_fullsized":"2024-09-21T06:07:52.971161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:37.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980065+0000","last_change":"2024-09-21T06:07:52.971342+0000","last_active":"2024-09-21T06:07:53.980065+0000","last_peered":"2024-09-21T06:07:53.980065+0000","last_clean":"2024-09-21T06:07:53.980065+0000","last_became_active":"2024-09-21T06:07:52.970274+0000","last_became_peered":"2024-09-21T06:07:52.970274+0000","last_unstale":"2024-09-21T06:07:53.980065+0000","last_undegraded":"2024-09-21T06:07:53.980065+0000","last_fullsized":"2024-09-21T06:07:53.980065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:53.595989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982641+0000","last_change":"2024-09-21T06:07:52.976622+0000","last_active":"2024-09-21T06:07:53.982641+0000","last_peered":"2024-09-21T06:07:53.982641+0000","last_clean":"2024-09-21T06:07:53.982641+0000","last_became_active":"2024-09-21T06:07:52.975358+0000","last_became_peered":"2024-09-21T06:07:52.975358+0000","last_unstale":"2024-09-21T06:07:53.982641+0000","last_undegraded":"2024-09-21T06:07:53.982641+0000","last_fullsized":"2024-09-21T06:07:53.982641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:54.369909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984011+0000","last_change":"2024-09-21T06:07:52.983454+0000","last_active":"2024-09-21T06:07:52.984011+0000","last_peered":"2024-09-21T06:07:52.984011+0000","last_clean":"2024-09-21T06:07:52.984011+0000","last_became_active":"2024-09-21T06:07:52.983165+0000","last_became_peered":"2024-09-21T06:07:52.983165+0000","last_unstale":"2024-09-21T06:07:52.984011+0000","last_undegraded":"2024-09-21T06:07:52.984011+0000","last_fullsized":"2024-09-21T06:07:52.984011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:48.669893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.974822+0000","last_change":"2024-09-21T06:07:52.974009+0000","last_active":"2024-09-21T06:07:52.974822+0000","last_peered":"2024-09-21T06:07:52.974822+0000","last_clean":"2024-09-21T06:07:52.974822+0000","last_became_active":"2024-09-21T06:07:52.973779+0000","last_became_peered":"2024-09-21T06:07:52.973779+0000","last_unstale":"2024-09-21T06:07:52.974822+0000","last_undegraded":"2024-09-21T06:07:52.974822+0000","last_fullsized":"2024-09-21T06:07:52.974822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:42.726028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.982812+0000","last_change":"2024-09-21T06:07:52.980553+0000","last_active":"2024-09-21T06:07:52.982812+0000","last_peered":"2024-09-21T06:07:52.982812+0000","last_clean":"2024-09-21T06:07:52.982812+0000","last_became_active":"2024-09-21T06:07:52.980266+0000","last_became_peered":"2024-09-21T06:07:52.980266+0000","last_unstale":"2024-09-21T06:07:52.982812+0000","last_undegraded":"2024-09-21T06:07:52.982812+0000","last_fullsized":"2024-09-21T06:07:52.982812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:42.910630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984877+0000","last_change":"2024-09-21T06:07:52.984518+0000","last_active":"2024-09-21T06:07:52.984877+0000","last_peered":"2024-09-21T06:07:52.984877+0000","last_clean":"2024-09-21T06:07:52.984877+0000","last_became_active":"2024-09-21T06:07:52.981282+0000","last_became_peered":"2024-09-21T06:07:52.981282+0000","last_unstale":"2024-09-21T06:07:52.984877+0000","last_undegraded":"2024-09-21T06:07:52.984877+0000","last_fullsized":"2024-09-21T06:07:52.984877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:25.034088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.974554+0000","last_change":"2024-09-21T06:07:52.973171+0000","last_active":"2024-09-21T06:07:52.974554+0000","last_peered":"2024-09-21T06:07:52.974554+0000","last_clean":"2024-09-21T06:07:52.974554+0000","last_became_active":"2024-09-21T06:07:52.972920+0000","last_became_peered":"2024-09-21T06:07:52.972920+0000","last_unstale":"2024-09-21T06:07:52.974554+0000","last_undegraded":"2024-09-21T06:07:52.974554+0000","last_fullsized":"2024-09-21T06:07:52.974554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:20.844052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017050+0000","last_change":"2024-09-21T06:07:52.984788+0000","last_active":"2024-09-21T06:07:54.017050+0000","last_peered":"2024-09-21T06:07:54.017050+0000","last_clean":"2024-09-21T06:07:54.017050+0000","last_became_active":"2024-09-21T06:07:52.975431+0000","last_became_peered":"2024-09-21T06:07:52.975431+0000","last_unstale":"2024-09-21T06:07:54.017050+0000","last_undegraded":"2024-09-21T06:07:54.017050+0000","last_fullsized":"2024-09-21T06:07:54.017050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:48.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988896+0000","last_change":"2024-09-21T06:07:52.988463+0000","last_active":"2024-09-21T06:07:52.988896+0000","last_peered":"2024-09-21T06:07:52.988896+0000","last_clean":"2024-09-21T06:07:52.988896+0000","last_became_active":"2024-09-21T06:07:52.986551+0000","last_became_peered":"2024-09-21T06:07:52.986551+0000","last_unstale":"2024-09-21T06:07:52.988896+0000","last_undegraded":"2024-09-21T06:07:52.988896+0000","last_fullsized":"2024-09-21T06:07:52.988896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:07.709792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983442+0000","last_change":"2024-09-21T06:07:52.975463+0000","last_active":"2024-09-21T06:07:53.983442+0000","last_peered":"2024-09-21T06:07:53.983442+0000","last_clean":"2024-09-21T06:07:53.983442+0000","last_became_active":"2024-09-21T06:07:52.973050+0000","last_became_peered":"2024-09-21T06:07:52.973050+0000","last_unstale":"2024-09-21T06:07:53.983442+0000","last_undegraded":"2024-09-21T06:07:53.983442+0000","last_fullsized":"2024-09-21T06:07:53.983442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.492934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982643+0000","last_change":"2024-09-21T06:07:52.975054+0000","last_active":"2024-09-21T06:07:53.982643+0000","last_peered":"2024-09-21T06:07:53.982643+0000","last_clean":"2024-09-21T06:07:53.982643+0000","last_became_active":"2024-09-21T06:07:52.974235+0000","last_became_peered":"2024-09-21T06:07:52.974235+0000","last_unstale":"2024-09-21T06:07:53.982643+0000","last_undegraded":"2024-09-21T06:07:53.982643+0000","last_fullsized":"2024-09-21T06:07:53.982643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:25.985682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.972532+0000","last_change":"2024-09-21T06:07:52.970699+0000","last_active":"2024-09-21T06:07:52.972532+0000","last_peered":"2024-09-21T06:07:52.972532+0000","last_clean":"2024-09-21T06:07:52.972532+0000","last_became_active":"2024-09-21T06:07:52.970397+0000","last_became_peered":"2024-09-21T06:07:52.970397+0000","last_unstale":"2024-09-21T06:07:52.972532+0000","last_undegraded":"2024-09-21T06:07:52.972532+0000","last_fullsized":"2024-09-21T06:07:52.972532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:13.324439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982645+0000","last_change":"2024-09-21T06:07:52.977013+0000","last_active":"2024-09-21T06:07:53.982645+0000","last_peered":"2024-09-21T06:07:53.982645+0000","last_clean":"2024-09-21T06:07:53.982645+0000","last_became_active":"2024-09-21T06:07:52.971850+0000","last_became_peered":"2024-09-21T06:07:52.971850+0000","last_unstale":"2024-09-21T06:07:53.982645+0000","last_undegraded":"2024-09-21T06:07:53.982645+0000","last_fullsized":"2024-09-21T06:07:53.982645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:40.721371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017105+0000","last_change":"2024-09-21T06:07:52.980353+0000","last_active":"2024-09-21T06:07:54.017105+0000","last_peered":"2024-09-21T06:07:54.017105+0000","last_clean":"2024-09-21T06:07:54.017105+0000","last_became_active":"2024-09-21T06:07:52.979910+0000","last_became_peered":"2024-09-21T06:07:52.979910+0000","last_unstale":"2024-09-21T06:07:54.017105+0000","last_undegraded":"2024-09-21T06:07:54.017105+0000","last_fullsized":"2024-09-21T06:07:54.017105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:45.830566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.987493+0000","last_change":"2024-09-21T06:07:52.987188+0000","last_active":"2024-09-21T06:07:52.987493+0000","last_peered":"2024-09-21T06:07:52.987493+0000","last_clean":"2024-09-21T06:07:52.987493+0000","last_became_active":"2024-09-21T06:07:52.985865+0000","last_became_peered":"2024-09-21T06:07:52.985865+0000","last_unstale":"2024-09-21T06:07:52.987493+0000","last_undegraded":"2024-09-21T06:07:52.987493+0000","last_fullsized":"2024-09-21T06:07:52.987493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:10.523059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983205+0000","last_change":"2024-09-21T06:07:52.975061+0000","last_active":"2024-09-21T06:07:53.983205+0000","last_peered":"2024-09-21T06:07:53.983205+0000","last_clean":"2024-09-21T06:07:53.983205+0000","last_became_active":"2024-09-21T06:07:52.974564+0000","last_became_peered":"2024-09-21T06:07:52.974564+0000","last_unstale":"2024-09-21T06:07:53.983205+0000","last_undegraded":"2024-09-21T06:07:53.983205+0000","last_fullsized":"2024-09-21T06:07:53.983205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:41.773079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984157+0000","last_change":"2024-09-21T06:07:52.982610+0000","last_active":"2024-09-21T06:07:52.984157+0000","last_peered":"2024-09-21T06:07:52.984157+0000","last_clean":"2024-09-21T06:07:52.984157+0000","last_became_active":"2024-09-21T06:07:52.977404+0000","last_became_peered":"2024-09-21T06:07:52.977404+0000","last_unstale":"2024-09-21T06:07:52.984157+0000","last_undegraded":"2024-09-21T06:07:52.984157+0000","last_fullsized":"2024-09-21T06:07:52.984157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:46.948034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982870+0000","last_change":"2024-09-21T06:07:52.977304+0000","last_active":"2024-09-21T06:07:53.982870+0000","last_peered":"2024-09-21T06:07:53.982870+0000","last_clean":"2024-09-21T06:07:53.982870+0000","last_became_active":"2024-09-21T06:07:52.972867+0000","last_became_peered":"2024-09-21T06:07:52.972867+0000","last_unstale":"2024-09-21T06:07:53.982870+0000","last_undegraded":"2024-09-21T06:07:53.982870+0000","last_fullsized":"2024-09-21T06:07:53.982870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:50.963629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017478+0000","last_change":"2024-09-21T06:07:52.969050+0000","last_active":"2024-09-21T06:07:54.017478+0000","last_peered":"2024-09-21T06:07:54.017478+0000","last_clean":"2024-09-21T06:07:54.017478+0000","last_became_active":"2024-09-21T06:07:52.968746+0000","last_became_peered":"2024-09-21T06:07:52.968746+0000","last_unstale":"2024-09-21T06:07:54.017478+0000","last_undegraded":"2024-09-21T06:07:54.017478+0000","last_fullsized":"2024-09-21T06:07:54.017478+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:49.495738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017130+0000","last_change":"2024-09-21T06:07:52.976083+0000","last_active":"2024-09-21T06:07:54.017130+0000","last_peered":"2024-09-21T06:07:54.017130+0000","last_clean":"2024-09-21T06:07:54.017130+0000","last_became_active":"2024-09-21T06:07:52.975817+0000","last_became_peered":"2024-09-21T06:07:52.975817+0000","last_unstale":"2024-09-21T06:07:54.017130+0000","last_undegraded":"2024-09-21T06:07:54.017130+0000","last_fullsized":"2024-09-21T06:07:54.017130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:09.785287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983381+0000","last_change":"2024-09-21T06:07:52.981250+0000","last_active":"2024-09-21T06:07:52.983381+0000","last_peered":"2024-09-21T06:07:52.983381+0000","last_clean":"2024-09-21T06:07:52.983381+0000","last_became_active":"2024-09-21T06:07:52.978853+0000","last_became_peered":"2024-09-21T06:07:52.978853+0000","last_unstale":"2024-09-21T06:07:52.983381+0000","last_undegraded":"2024-09-21T06:07:52.983381+0000","last_fullsized":"2024-09-21T06:07:52.983381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:15.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984826+0000","last_change":"2024-09-21T06:07:52.984641+0000","last_active":"2024-09-21T06:07:52.984826+0000","last_peered":"2024-09-21T06:07:52.984826+0000","last_clean":"2024-09-21T06:07:52.984826+0000","last_became_active":"2024-09-21T06:07:52.984392+0000","last_became_peered":"2024-09-21T06:07:52.984392+0000","last_unstale":"2024-09-21T06:07:52.984826+0000","last_undegraded":"2024-09-21T06:07:52.984826+0000","last_fullsized":"2024-09-21T06:07:52.984826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:42.933875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017199+0000","last_change":"2024-09-21T06:07:52.982564+0000","last_active":"2024-09-21T06:07:54.017199+0000","last_peered":"2024-09-21T06:07:54.017199+0000","last_clean":"2024-09-21T06:07:54.017199+0000","last_became_active":"2024-09-21T06:07:52.974548+0000","last_became_peered":"2024-09-21T06:07:52.974548+0000","last_unstale":"2024-09-21T06:07:54.017199+0000","last_undegraded":"2024-09-21T06:07:54.017199+0000","last_fullsized":"2024-09-21T06:07:54.017199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:27.134532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.980171+0000","last_change":"2024-09-21T06:07:52.979496+0000","last_active":"2024-09-21T06:07:52.980171+0000","last_peered":"2024-09-21T06:07:52.980171+0000","last_clean":"2024-09-21T06:07:52.980171+0000","last_became_active":"2024-09-21T06:07:52.979234+0000","last_became_peered":"2024-09-21T06:07:52.979234+0000","last_unstale":"2024-09-21T06:07:52.980171+0000","last_undegraded":"2024-09-21T06:07:52.980171+0000","last_fullsized":"2024-09-21T06:07:52.980171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:05.750991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980162+0000","last_change":"2024-09-21T06:07:52.981407+0000","last_active":"2024-09-21T06:07:53.980162+0000","last_peered":"2024-09-21T06:07:53.980162+0000","last_clean":"2024-09-21T06:07:53.980162+0000","last_became_active":"2024-09-21T06:07:52.980592+0000","last_became_peered":"2024-09-21T06:07:52.980592+0000","last_unstale":"2024-09-21T06:07:53.980162+0000","last_undegraded":"2024-09-21T06:07:53.980162+0000","last_fullsized":"2024-09-21T06:07:53.980162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:10.714288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.016909+0000","last_change":"2024-09-21T06:07:52.975227+0000","last_active":"2024-09-21T06:07:54.016909+0000","last_peered":"2024-09-21T06:07:54.016909+0000","last_clean":"2024-09-21T06:07:54.016909+0000","last_became_active":"2024-09-21T06:07:52.974930+0000","last_became_peered":"2024-09-21T06:07:52.974930+0000","last_unstale":"2024-09-21T06:07:54.016909+0000","last_undegraded":"2024-09-21T06:07:54.016909+0000","last_fullsized":"2024-09-21T06:07:54.016909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:25.364476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980149+0000","last_change":"2024-09-21T06:07:52.968694+0000","last_active":"2024-09-21T06:07:53.980149+0000","last_peered":"2024-09-21T06:07:53.980149+0000","last_clean":"2024-09-21T06:07:53.980149+0000","last_became_active":"2024-09-21T06:07:52.968411+0000","last_became_peered":"2024-09-21T06:07:52.968411+0000","last_unstale":"2024-09-21T06:07:53.980149+0000","last_undegraded":"2024-09-21T06:07:53.980149+0000","last_fullsized":"2024-09-21T06:07:53.980149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:26.450665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.972138+0000","last_change":"2024-09-21T06:07:52.971837+0000","last_active":"2024-09-21T06:07:52.972138+0000","last_peered":"2024-09-21T06:07:52.972138+0000","last_clean":"2024-09-21T06:07:52.972138+0000","last_became_active":"2024-09-21T06:07:52.971570+0000","last_became_peered":"2024-09-21T06:07:52.971570+0000","last_unstale":"2024-09-21T06:07:52.972138+0000","last_undegraded":"2024-09-21T06:07:52.972138+0000","last_fullsized":"2024-09-21T06:07:52.972138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:15.487152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.974097+0000","last_change":"2024-09-21T06:07:52.973905+0000","last_active":"2024-09-21T06:07:52.974097+0000","last_peered":"2024-09-21T06:07:52.974097+0000","last_clean":"2024-09-21T06:07:52.974097+0000","last_became_active":"2024-09-21T06:07:52.973534+0000","last_became_peered":"2024-09-21T06:07:52.973534+0000","last_unstale":"2024-09-21T06:07:52.974097+0000","last_undegraded":"2024-09-21T06:07:52.974097+0000","last_fullsized":"2024-09-21T06:07:52.974097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:57.840713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988395+0000","last_change":"2024-09-21T06:07:52.988188+0000","last_active":"2024-09-21T06:07:52.988395+0000","last_peered":"2024-09-21T06:07:52.988395+0000","last_clean":"2024-09-21T06:07:52.988395+0000","last_became_active":"2024-09-21T06:07:52.987602+0000","last_became_peered":"2024-09-21T06:07:52.987602+0000","last_unstale":"2024-09-21T06:07:52.988395+0000","last_undegraded":"2024-09-21T06:07:52.988395+0000","last_fullsized":"2024-09-21T06:07:52.988395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:32.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.990208+0000","last_change":"2024-09-21T06:07:52.989419+0000","last_active":"2024-09-21T06:07:52.990208+0000","last_peered":"2024-09-21T06:07:52.990208+0000","last_clean":"2024-09-21T06:07:52.990208+0000","last_became_active":"2024-09-21T06:07:52.988305+0000","last_became_peered":"2024-09-21T06:07:52.988305+0000","last_unstale":"2024-09-21T06:07:52.990208+0000","last_undegraded":"2024-09-21T06:07:52.990208+0000","last_fullsized":"2024-09-21T06:07:52.990208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:54.551163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986400+0000","last_change":"2024-09-21T06:07:51.955361+0000","last_active":"2024-09-21T06:07:52.986400+0000","last_peered":"2024-09-21T06:07:52.986400+0000","last_clean":"2024-09-21T06:07:52.986400+0000","last_became_active":"2024-09-21T06:07:51.955084+0000","last_became_peered":"2024-09-21T06:07:51.955084+0000","last_unstale":"2024-09-21T06:07:52.986400+0000","last_undegraded":"2024-09-21T06:07:52.986400+0000","last_fullsized":"2024-09-21T06:07:52.986400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:15.029873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984038+0000","last_change":"2024-09-21T06:07:52.983496+0000","last_active":"2024-09-21T06:07:52.984038+0000","last_peered":"2024-09-21T06:07:52.984038+0000","last_clean":"2024-09-21T06:07:52.984038+0000","last_became_active":"2024-09-21T06:07:52.981607+0000","last_became_peered":"2024-09-21T06:07:52.981607+0000","last_unstale":"2024-09-21T06:07:52.984038+0000","last_undegraded":"2024-09-21T06:07:52.984038+0000","last_fullsized":"2024-09-21T06:07:52.984038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:16.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982865+0000","last_change":"2024-09-21T06:07:51.952710+0000","last_active":"2024-09-21T06:07:53.982865+0000","last_peered":"2024-09-21T06:07:53.982865+0000","last_clean":"2024-09-21T06:07:53.982865+0000","last_became_active":"2024-09-21T06:07:51.951543+0000","last_became_peered":"2024-09-21T06:07:51.951543+0000","last_unstale":"2024-09-21T06:07:53.982865+0000","last_undegraded":"2024-09-21T06:07:53.982865+0000","last_fullsized":"2024-09-21T06:07:53.982865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:29.097748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988735+0000","last_change":"2024-09-21T06:07:52.988356+0000","last_active":"2024-09-21T06:07:52.988735+0000","last_peered":"2024-09-21T06:07:52.988735+0000","last_clean":"2024-09-21T06:07:52.988735+0000","last_became_active":"2024-09-21T06:07:52.987367+0000","last_became_peered":"2024-09-21T06:07:52.987367+0000","last_unstale":"2024-09-21T06:07:52.988735+0000","last_undegraded":"2024-09-21T06:07:52.988735+0000","last_fullsized":"2024-09-21T06:07:52.988735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:10.452726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017518+0000","last_change":"2024-09-21T06:07:51.954304+0000","last_active":"2024-09-21T06:07:54.017518+0000","last_peered":"2024-09-21T06:07:54.017518+0000","last_clean":"2024-09-21T06:07:54.017518+0000","last_became_active":"2024-09-21T06:07:51.953675+0000","last_became_peered":"2024-09-21T06:07:51.953675+0000","last_unstale":"2024-09-21T06:07:54.017518+0000","last_undegraded":"2024-09-21T06:07:54.017518+0000","last_fullsized":"2024-09-21T06:07:54.017518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:42.389685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983516+0000","last_change":"2024-09-21T06:07:52.982382+0000","last_active":"2024-09-21T06:07:52.983516+0000","last_peered":"2024-09-21T06:07:52.983516+0000","last_clean":"2024-09-21T06:07:52.983516+0000","last_became_active":"2024-09-21T06:07:52.982005+0000","last_became_peered":"2024-09-21T06:07:52.982005+0000","last_unstale":"2024-09-21T06:07:52.983516+0000","last_undegraded":"2024-09-21T06:07:52.983516+0000","last_fullsized":"2024-09-21T06:07:52.983516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:55.956473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984046+0000","last_change":"2024-09-21T06:07:51.951660+0000","last_active":"2024-09-21T06:07:52.984046+0000","last_peered":"2024-09-21T06:07:52.984046+0000","last_clean":"2024-09-21T06:07:52.984046+0000","last_became_active":"2024-09-21T06:07:51.951377+0000","last_became_peered":"2024-09-21T06:07:51.951377+0000","last_unstale":"2024-09-21T06:07:52.984046+0000","last_undegraded":"2024-09-21T06:07:52.984046+0000","last_fullsized":"2024-09-21T06:07:52.984046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:22.442771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.971095+0000","last_change":"2024-09-21T06:07:52.970844+0000","last_active":"2024-09-21T06:07:52.971095+0000","last_peered":"2024-09-21T06:07:52.971095+0000","last_clean":"2024-09-21T06:07:52.971095+0000","last_became_active":"2024-09-21T06:07:52.970591+0000","last_became_peered":"2024-09-21T06:07:52.970591+0000","last_unstale":"2024-09-21T06:07:52.971095+0000","last_undegraded":"2024-09-21T06:07:52.971095+0000","last_fullsized":"2024-09-21T06:07:52.971095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:02.896843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980543+0000","last_change":"2024-09-21T06:07:51.948610+0000","last_active":"2024-09-21T06:07:53.980543+0000","last_peered":"2024-09-21T06:07:53.980543+0000","last_clean":"2024-09-21T06:07:53.980543+0000","last_became_active":"2024-09-21T06:07:51.948355+0000","last_became_peered":"2024-09-21T06:07:51.948355+0000","last_unstale":"2024-09-21T06:07:53.980543+0000","last_undegraded":"2024-09-21T06:07:53.980543+0000","last_fullsized":"2024-09-21T06:07:53.980543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:29.702792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017401+0000","last_change":"2024-09-21T06:07:52.974100+0000","last_active":"2024-09-21T06:07:54.017401+0000","last_peered":"2024-09-21T06:07:54.017401+0000","last_clean":"2024-09-21T06:07:54.017401+0000","last_became_active":"2024-09-21T06:07:52.973836+0000","last_became_peered":"2024-09-21T06:07:52.973836+0000","last_unstale":"2024-09-21T06:07:54.017401+0000","last_undegraded":"2024-09-21T06:07:54.017401+0000","last_fullsized":"2024-09-21T06:07:54.017401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:26.116036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.981493+0000","last_change":"2024-09-21T06:07:51.949938+0000","last_active":"2024-09-21T06:07:52.981493+0000","last_peered":"2024-09-21T06:07:52.981493+0000","last_clean":"2024-09-21T06:07:52.981493+0000","last_became_active":"2024-09-21T06:07:51.949643+0000","last_became_peered":"2024-09-21T06:07:51.949643+0000","last_unstale":"2024-09-21T06:07:52.981493+0000","last_undegraded":"2024-09-21T06:07:52.981493+0000","last_fullsized":"2024-09-21T06:07:52.981493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:58.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986344+0000","last_change":"2024-09-21T06:07:52.986177+0000","last_active":"2024-09-21T06:07:52.986344+0000","last_peered":"2024-09-21T06:07:52.986344+0000","last_clean":"2024-09-21T06:07:52.986344+0000","last_became_active":"2024-09-21T06:07:52.985785+0000","last_became_peered":"2024-09-21T06:07:52.985785+0000","last_unstale":"2024-09-21T06:07:52.986344+0000","last_undegraded":"2024-09-21T06:07:52.986344+0000","last_fullsized":"2024-09-21T06:07:52.986344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:14.423122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983328+0000","last_change":"2024-09-21T06:07:51.946291+0000","last_active":"2024-09-21T06:07:53.983328+0000","last_peered":"2024-09-21T06:07:53.983328+0000","last_clean":"2024-09-21T06:07:53.983328+0000","last_became_active":"2024-09-21T06:07:51.946035+0000","last_became_peered":"2024-09-21T06:07:51.946035+0000","last_unstale":"2024-09-21T06:07:53.983328+0000","last_undegraded":"2024-09-21T06:07:53.983328+0000","last_fullsized":"2024-09-21T06:07:53.983328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:43.117693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982739+0000","last_change":"2024-09-21T06:07:52.981848+0000","last_active":"2024-09-21T06:07:53.982739+0000","last_peered":"2024-09-21T06:07:53.982739+0000","last_clean":"2024-09-21T06:07:53.982739+0000","last_became_active":"2024-09-21T06:07:52.981527+0000","last_became_peered":"2024-09-21T06:07:52.981527+0000","last_unstale":"2024-09-21T06:07:53.982739+0000","last_undegraded":"2024-09-21T06:07:53.982739+0000","last_fullsized":"2024-09-21T06:07:53.982739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:02.590270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.969767+0000","last_change":"2024-09-21T06:07:51.950620+0000","last_active":"2024-09-21T06:07:52.969767+0000","last_peered":"2024-09-21T06:07:52.969767+0000","last_clean":"2024-09-21T06:07:52.969767+0000","last_became_active":"2024-09-21T06:07:51.949799+0000","last_became_peered":"2024-09-21T06:07:51.949799+0000","last_unstale":"2024-09-21T06:07:52.969767+0000","last_undegraded":"2024-09-21T06:07:52.969767+0000","last_fullsized":"2024-09-21T06:07:52.969767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:13.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.982860+0000","last_change":"2024-09-21T06:07:52.981661+0000","last_active":"2024-09-21T06:07:52.982860+0000","last_peered":"2024-09-21T06:07:52.982860+0000","last_clean":"2024-09-21T06:07:52.982860+0000","last_became_active":"2024-09-21T06:07:52.981303+0000","last_became_peered":"2024-09-21T06:07:52.981303+0000","last_unstale":"2024-09-21T06:07:52.982860+0000","last_undegraded":"2024-09-21T06:07:52.982860+0000","last_fullsized":"2024-09-21T06:07:52.982860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:30.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017588+0000","last_change":"2024-09-21T06:07:51.945975+0000","last_active":"2024-09-21T06:07:54.017588+0000","last_peered":"2024-09-21T06:07:54.017588+0000","last_clean":"2024-09-21T06:07:54.017588+0000","last_became_active":"2024-09-21T06:07:51.945664+0000","last_became_peered":"2024-09-21T06:07:51.945664+0000","last_unstale":"2024-09-21T06:07:54.017588+0000","last_undegraded":"2024-09-21T06:07:54.017588+0000","last_fullsized":"2024-09-21T06:07:54.017588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:22.994891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983410+0000","last_change":"2024-09-21T06:07:52.981225+0000","last_active":"2024-09-21T06:07:52.983410+0000","last_peered":"2024-09-21T06:07:52.983410+0000","last_clean":"2024-09-21T06:07:52.983410+0000","last_became_active":"2024-09-21T06:07:52.980918+0000","last_became_peered":"2024-09-21T06:07:52.980918+0000","last_unstale":"2024-09-21T06:07:52.983410+0000","last_undegraded":"2024-09-21T06:07:52.983410+0000","last_fullsized":"2024-09-21T06:07:52.983410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:24.968498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.965985+0000","last_change":"2024-09-21T06:07:51.958802+0000","last_active":"2024-09-21T06:07:52.965985+0000","last_peered":"2024-09-21T06:07:52.965985+0000","last_clean":"2024-09-21T06:07:52.965985+0000","last_became_active":"2024-09-21T06:07:51.958525+0000","last_became_peered":"2024-09-21T06:07:51.958525+0000","last_unstale":"2024-09-21T06:07:52.965985+0000","last_undegraded":"2024-09-21T06:07:52.965985+0000","last_fullsized":"2024-09-21T06:07:52.965985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:09.149952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.970956+0000","last_change":"2024-09-21T06:07:52.969882+0000","last_active":"2024-09-21T06:07:52.970956+0000","last_peered":"2024-09-21T06:07:52.970956+0000","last_clean":"2024-09-21T06:07:52.970956+0000","last_became_active":"2024-09-21T06:07:52.969610+0000","last_became_peered":"2024-09-21T06:07:52.969610+0000","last_unstale":"2024-09-21T06:07:52.970956+0000","last_undegraded":"2024-09-21T06:07:52.970956+0000","last_fullsized":"2024-09-21T06:07:52.970956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:18.922978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"80'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980262+0000","last_change":"2024-09-21T06:07:51.957729+0000","last_active":"2024-09-21T06:07:53.980262+0000","last_peered":"2024-09-21T06:07:53.980262+0000","last_clean":"2024-09-21T06:07:53.980262+0000","last_became_active":"2024-09-21T06:07:51.957412+0000","last_became_peered":"2024-09-21T06:07:51.957412+0000","last_unstale":"2024-09-21T06:07:53.980262+0000","last_undegraded":"2024-09-21T06:07:53.980262+0000","last_fullsized":"2024-09-21T06:07:53.980262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984060+0000","last_change":"2024-09-21T06:07:52.983833+0000","last_active":"2024-09-21T06:07:52.984060+0000","last_peered":"2024-09-21T06:07:52.984060+0000","last_clean":"2024-09-21T06:07:52.984060+0000","last_became_active":"2024-09-21T06:07:52.982403+0000","last_became_peered":"2024-09-21T06:07:52.982403+0000","last_unstale":"2024-09-21T06:07:52.984060+0000","last_undegraded":"2024-09-21T06:07:52.984060+0000","last_fullsized":"2024-09-21T06:07:52.984060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.850647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"80'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983522+0000","last_change":"2024-09-21T06:07:51.951196+0000","last_active":"2024-09-21T06:07:53.983522+0000","last_peered":"2024-09-21T06:07:53.983522+0000","last_clean":"2024-09-21T06:07:53.983522+0000","last_became_active":"2024-09-21T06:07:51.950880+0000","last_became_peered":"2024-09-21T06:07:51.950880+0000","last_unstale":"2024-09-21T06:07:53.983522+0000","last_undegraded":"2024-09-21T06:07:53.983522+0000","last_fullsized":"2024-09-21T06:07:53.983522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:17.682994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988752+0000","last_change":"2024-09-21T06:07:52.987046+0000","last_active":"2024-09-21T06:07:52.988752+0000","last_peered":"2024-09-21T06:07:52.988752+0000","last_clean":"2024-09-21T06:07:52.988752+0000","last_became_active":"2024-09-21T06:07:52.984178+0000","last_became_peered":"2024-09-21T06:07:52.984178+0000","last_unstale":"2024-09-21T06:07:52.988752+0000","last_undegraded":"2024-09-21T06:07:52.988752+0000","last_fullsized":"2024-09-21T06:07:52.988752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:45.815496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982995+0000","last_change":"2024-09-21T06:07:51.952924+0000","last_active":"2024-09-21T06:07:53.982995+0000","last_peered":"2024-09-21T06:07:53.982995+0000","last_clean":"2024-09-21T06:07:53.982995+0000","last_became_active":"2024-09-21T06:07:51.952683+0000","last_became_peered":"2024-09-21T06:07:51.952683+0000","last_unstale":"2024-09-21T06:07:53.982995+0000","last_undegraded":"2024-09-21T06:07:53.982995+0000","last_fullsized":"2024-09-21T06:07:53.982995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:24.643834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.977201+0000","last_change":"2024-09-21T06:07:52.976762+0000","last_active":"2024-09-21T06:07:52.977201+0000","last_peered":"2024-09-21T06:07:52.977201+0000","last_clean":"2024-09-21T06:07:52.977201+0000","last_became_active":"2024-09-21T06:07:52.976501+0000","last_became_peered":"2024-09-21T06:07:52.976501+0000","last_unstale":"2024-09-21T06:07:52.977201+0000","last_undegraded":"2024-09-21T06:07:52.977201+0000","last_fullsized":"2024-09-21T06:07:52.977201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:36.512844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.970644+0000","last_change":"2024-09-21T06:07:51.953749+0000","last_active":"2024-09-21T06:07:52.970644+0000","last_peered":"2024-09-21T06:07:52.970644+0000","last_clean":"2024-09-21T06:07:52.970644+0000","last_became_active":"2024-09-21T06:07:51.953146+0000","last_became_peered":"2024-09-21T06:07:51.953146+0000","last_unstale":"2024-09-21T06:07:52.970644+0000","last_undegraded":"2024-09-21T06:07:52.970644+0000","last_fullsized":"2024-09-21T06:07:52.970644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.637309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982869+0000","last_change":"2024-09-21T06:07:52.974764+0000","last_active":"2024-09-21T06:07:53.982869+0000","last_peered":"2024-09-21T06:07:53.982869+0000","last_clean":"2024-09-21T06:07:53.982869+0000","last_became_active":"2024-09-21T06:07:52.973915+0000","last_became_peered":"2024-09-21T06:07:52.973915+0000","last_unstale":"2024-09-21T06:07:53.982869+0000","last_undegraded":"2024-09-21T06:07:53.982869+0000","last_fullsized":"2024-09-21T06:07:53.982869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.935041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968715+0000","last_change":"2024-09-21T06:07:51.958198+0000","last_active":"2024-09-21T06:07:52.968715+0000","last_peered":"2024-09-21T06:07:52.968715+0000","last_clean":"2024-09-21T06:07:52.968715+0000","last_became_active":"2024-09-21T06:07:51.957578+0000","last_became_peered":"2024-09-21T06:07:51.957578+0000","last_unstale":"2024-09-21T06:07:52.968715+0000","last_undegraded":"2024-09-21T06:07:52.968715+0000","last_fullsized":"2024-09-21T06:07:52.968715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:52.741020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986731+0000","last_change":"2024-09-21T06:07:52.986406+0000","last_active":"2024-09-21T06:07:52.986731+0000","last_peered":"2024-09-21T06:07:52.986731+0000","last_clean":"2024-09-21T06:07:52.986731+0000","last_became_active":"2024-09-21T06:07:52.985362+0000","last_became_peered":"2024-09-21T06:07:52.985362+0000","last_unstale":"2024-09-21T06:07:52.986731+0000","last_undegraded":"2024-09-21T06:07:52.986731+0000","last_fullsized":"2024-09-21T06:07:52.986731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:21.749571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"80'8","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017065+0000","last_change":"2024-09-21T06:07:51.956399+0000","last_active":"2024-09-21T06:07:54.017065+0000","last_peered":"2024-09-21T06:07:54.017065+0000","last_clean":"2024-09-21T06:07:54.017065+0000","last_became_active":"2024-09-21T06:07:51.955705+0000","last_became_peered":"2024-09-21T06:07:51.955705+0000","last_unstale":"2024-09-21T06:07:54.017065+0000","last_undegraded":"2024-09-21T06:07:54.017065+0000","last_fullsized":"2024-09-21T06:07:54.017065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:45.072710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017425+0000","last_change":"2024-09-21T06:07:52.966249+0000","last_active":"2024-09-21T06:07:54.017425+0000","last_peered":"2024-09-21T06:07:54.017425+0000","last_clean":"2024-09-21T06:07:54.017425+0000","last_became_active":"2024-09-21T06:07:52.965969+0000","last_became_peered":"2024-09-21T06:07:52.965969+0000","last_unstale":"2024-09-21T06:07:54.017425+0000","last_undegraded":"2024-09-21T06:07:54.017425+0000","last_fullsized":"2024-09-21T06:07:54.017425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:24.381592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983076+0000","last_change":"2024-09-21T06:07:51.954442+0000","last_active":"2024-09-21T06:07:52.983076+0000","last_peered":"2024-09-21T06:07:52.983076+0000","last_clean":"2024-09-21T06:07:52.983076+0000","last_became_active":"2024-09-21T06:07:51.951514+0000","last_became_peered":"2024-09-21T06:07:51.951514+0000","last_unstale":"2024-09-21T06:07:52.983076+0000","last_undegraded":"2024-09-21T06:07:52.983076+0000","last_fullsized":"2024-09-21T06:07:52.983076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:52.521048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983713+0000","last_change":"2024-09-21T06:07:52.983519+0000","last_active":"2024-09-21T06:07:52.983713+0000","last_peered":"2024-09-21T06:07:52.983713+0000","last_clean":"2024-09-21T06:07:52.983713+0000","last_became_active":"2024-09-21T06:07:52.983172+0000","last_became_peered":"2024-09-21T06:07:52.983172+0000","last_unstale":"2024-09-21T06:07:52.983713+0000","last_undegraded":"2024-09-21T06:07:52.983713+0000","last_fullsized":"2024-09-21T06:07:52.983713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:41.992494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017597+0000","last_change":"2024-09-21T06:07:51.953969+0000","last_active":"2024-09-21T06:07:54.017597+0000","last_peered":"2024-09-21T06:07:54.017597+0000","last_clean":"2024-09-21T06:07:54.017597+0000","last_became_active":"2024-09-21T06:07:51.953310+0000","last_became_peered":"2024-09-21T06:07:51.953310+0000","last_unstale":"2024-09-21T06:07:54.017597+0000","last_undegraded":"2024-09-21T06:07:54.017597+0000","last_fullsized":"2024-09-21T06:07:54.017597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:12.246981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983623+0000","last_change":"2024-09-21T06:07:52.973269+0000","last_active":"2024-09-21T06:07:53.983623+0000","last_peered":"2024-09-21T06:07:53.983623+0000","last_clean":"2024-09-21T06:07:53.983623+0000","last_became_active":"2024-09-21T06:07:52.972744+0000","last_became_peered":"2024-09-21T06:07:52.972744+0000","last_unstale":"2024-09-21T06:07:53.983623+0000","last_undegraded":"2024-09-21T06:07:53.983623+0000","last_fullsized":"2024-09-21T06:07:53.983623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:38.102428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.989625+0000","last_change":"2024-09-21T06:07:51.950054+0000","last_active":"2024-09-21T06:07:52.989625+0000","last_peered":"2024-09-21T06:07:52.989625+0000","last_clean":"2024-09-21T06:07:52.989625+0000","last_became_active":"2024-09-21T06:07:51.949606+0000","last_became_peered":"2024-09-21T06:07:51.949606+0000","last_unstale":"2024-09-21T06:07:52.989625+0000","last_undegraded":"2024-09-21T06:07:52.989625+0000","last_fullsized":"2024-09-21T06:07:52.989625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:07.505421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.976268+0000","last_change":"2024-09-21T06:07:52.975743+0000","last_active":"2024-09-21T06:07:52.976268+0000","last_peered":"2024-09-21T06:07:52.976268+0000","last_clean":"2024-09-21T06:07:52.976268+0000","last_became_active":"2024-09-21T06:07:52.975010+0000","last_became_peered":"2024-09-21T06:07:52.975010+0000","last_unstale":"2024-09-21T06:07:52.976268+0000","last_undegraded":"2024-09-21T06:07:52.976268+0000","last_fullsized":"2024-09-21T06:07:52.976268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:40.510521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968839+0000","last_change":"2024-09-21T06:07:51.956974+0000","last_active":"2024-09-21T06:07:52.968839+0000","last_peered":"2024-09-21T06:07:52.968839+0000","last_clean":"2024-09-21T06:07:52.968839+0000","last_became_active":"2024-09-21T06:07:51.956312+0000","last_became_peered":"2024-09-21T06:07:51.956312+0000","last_unstale":"2024-09-21T06:07:52.968839+0000","last_undegraded":"2024-09-21T06:07:52.968839+0000","last_fullsized":"2024-09-21T06:07:52.968839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:26.549967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980190+0000","last_change":"2024-09-21T06:07:52.968124+0000","last_active":"2024-09-21T06:07:53.980190+0000","last_peered":"2024-09-21T06:07:53.980190+0000","last_clean":"2024-09-21T06:07:53.980190+0000","last_became_active":"2024-09-21T06:07:52.967337+0000","last_became_peered":"2024-09-21T06:07:52.967337+0000","last_unstale":"2024-09-21T06:07:53.980190+0000","last_undegraded":"2024-09-21T06:07:53.980190+0000","last_fullsized":"2024-09-21T06:07:53.980190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:46.827943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.966287+0000","last_change":"2024-09-21T06:07:51.955119+0000","last_active":"2024-09-21T06:07:52.966287+0000","last_peered":"2024-09-21T06:07:52.966287+0000","last_clean":"2024-09-21T06:07:52.966287+0000","last_became_active":"2024-09-21T06:07:51.952748+0000","last_became_peered":"2024-09-21T06:07:51.952748+0000","last_unstale":"2024-09-21T06:07:52.966287+0000","last_undegraded":"2024-09-21T06:07:52.966287+0000","last_fullsized":"2024-09-21T06:07:52.966287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:18.711754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980292+0000","last_change":"2024-09-21T06:07:52.980274+0000","last_active":"2024-09-21T06:07:53.980292+0000","last_peered":"2024-09-21T06:07:53.980292+0000","last_clean":"2024-09-21T06:07:53.980292+0000","last_became_active":"2024-09-21T06:07:52.979875+0000","last_became_peered":"2024-09-21T06:07:52.979875+0000","last_unstale":"2024-09-21T06:07:53.980292+0000","last_undegraded":"2024-09-21T06:07:53.980292+0000","last_fullsized":"2024-09-21T06:07:53.980292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:57.426831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968950+0000","last_change":"2024-09-21T06:07:51.957576+0000","last_active":"2024-09-21T06:07:52.968950+0000","last_peered":"2024-09-21T06:07:52.968950+0000","last_clean":"2024-09-21T06:07:52.968950+0000","last_became_active":"2024-09-21T06:07:51.956909+0000","last_became_peered":"2024-09-21T06:07:51.956909+0000","last_unstale":"2024-09-21T06:07:52.968950+0000","last_undegraded":"2024-09-21T06:07:52.968950+0000","last_fullsized":"2024-09-21T06:07:52.968950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:33.456224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980343+0000","last_change":"2024-09-21T06:07:52.972620+0000","last_active":"2024-09-21T06:07:53.980343+0000","last_peered":"2024-09-21T06:07:53.980343+0000","last_clean":"2024-09-21T06:07:53.980343+0000","last_became_active":"2024-09-21T06:07:52.972342+0000","last_became_peered":"2024-09-21T06:07:52.972342+0000","last_unstale":"2024-09-21T06:07:53.980343+0000","last_undegraded":"2024-09-21T06:07:53.980343+0000","last_fullsized":"2024-09-21T06:07:53.980343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:50.296717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982379+0000","last_change":"2024-09-21T06:07:51.950466+0000","last_active":"2024-09-21T06:07:53.982379+0000","last_peered":"2024-09-21T06:07:53.982379+0000","last_clean":"2024-09-21T06:07:53.982379+0000","last_became_active":"2024-09-21T06:07:51.950177+0000","last_became_peered":"2024-09-21T06:07:51.950177+0000","last_unstale":"2024-09-21T06:07:53.982379+0000","last_undegraded":"2024-09-21T06:07:53.982379+0000","last_fullsized":"2024-09-21T06:07:53.982379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:52.944267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983070+0000","last_change":"2024-09-21T06:07:52.973529+0000","last_active":"2024-09-21T06:07:53.983070+0000","last_peered":"2024-09-21T06:07:53.983070+0000","last_clean":"2024-09-21T06:07:53.983070+0000","last_became_active":"2024-09-21T06:07:52.970226+0000","last_became_peered":"2024-09-21T06:07:52.970226+0000","last_unstale":"2024-09-21T06:07:53.983070+0000","last_undegraded":"2024-09-21T06:07:53.983070+0000","last_fullsized":"2024-09-21T06:07:53.983070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:29.139100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988012+0000","last_change":"2024-09-21T06:07:51.951387+0000","last_active":"2024-09-21T06:07:52.988012+0000","last_peered":"2024-09-21T06:07:52.988012+0000","last_clean":"2024-09-21T06:07:52.988012+0000","last_became_active":"2024-09-21T06:07:51.950908+0000","last_became_peered":"2024-09-21T06:07:51.950908+0000","last_unstale":"2024-09-21T06:07:52.988012+0000","last_undegraded":"2024-09-21T06:07:52.988012+0000","last_fullsized":"2024-09-21T06:07:52.988012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:17.841269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.978936+0000","last_change":"2024-09-21T06:07:52.978507+0000","last_active":"2024-09-21T06:07:52.978936+0000","last_peered":"2024-09-21T06:07:52.978936+0000","last_clean":"2024-09-21T06:07:52.978936+0000","last_became_active":"2024-09-21T06:07:52.978190+0000","last_became_peered":"2024-09-21T06:07:52.978190+0000","last_unstale":"2024-09-21T06:07:52.978936+0000","last_undegraded":"2024-09-21T06:07:52.978936+0000","last_fullsized":"2024-09-21T06:07:52.978936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:49.979534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.967833+0000","last_change":"2024-09-21T06:07:51.957101+0000","last_active":"2024-09-21T06:07:52.967833+0000","last_peered":"2024-09-21T06:07:52.967833+0000","last_clean":"2024-09-21T06:07:52.967833+0000","last_became_active":"2024-09-21T06:07:51.956777+0000","last_became_peered":"2024-09-21T06:07:51.956777+0000","last_unstale":"2024-09-21T06:07:52.967833+0000","last_undegraded":"2024-09-21T06:07:52.967833+0000","last_fullsized":"2024-09-21T06:07:52.967833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:50.668497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983442+0000","last_change":"2024-09-21T06:07:52.981081+0000","last_active":"2024-09-21T06:07:52.983442+0000","last_peered":"2024-09-21T06:07:52.983442+0000","last_clean":"2024-09-21T06:07:52.983442+0000","last_became_active":"2024-09-21T06:07:52.979397+0000","last_became_peered":"2024-09-21T06:07:52.979397+0000","last_unstale":"2024-09-21T06:07:52.983442+0000","last_undegraded":"2024-09-21T06:07:52.983442+0000","last_fullsized":"2024-09-21T06:07:52.983442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:05.330037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968657+0000","last_change":"2024-09-21T06:07:51.953659+0000","last_active":"2024-09-21T06:07:52.968657+0000","last_peered":"2024-09-21T06:07:52.968657+0000","last_clean":"2024-09-21T06:07:52.968657+0000","last_became_active":"2024-09-21T06:07:51.953393+0000","last_became_peered":"2024-09-21T06:07:51.953393+0000","last_unstale":"2024-09-21T06:07:52.968657+0000","last_undegraded":"2024-09-21T06:07:52.968657+0000","last_fullsized":"2024-09-21T06:07:52.968657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:05.894429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.990279+0000","last_change":"2024-09-21T06:07:52.989711+0000","last_active":"2024-09-21T06:07:52.990279+0000","last_peered":"2024-09-21T06:07:52.990279+0000","last_clean":"2024-09-21T06:07:52.990279+0000","last_became_active":"2024-09-21T06:07:52.988668+0000","last_became_peered":"2024-09-21T06:07:52.988668+0000","last_unstale":"2024-09-21T06:07:52.990279+0000","last_undegraded":"2024-09-21T06:07:52.990279+0000","last_fullsized":"2024-09-21T06:07:52.990279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:33.878767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982997+0000","last_change":"2024-09-21T06:07:51.947928+0000","last_active":"2024-09-21T06:07:53.982997+0000","last_peered":"2024-09-21T06:07:53.982997+0000","last_clean":"2024-09-21T06:07:53.982997+0000","last_became_active":"2024-09-21T06:07:51.947659+0000","last_became_peered":"2024-09-21T06:07:51.947659+0000","last_unstale":"2024-09-21T06:07:53.982997+0000","last_undegraded":"2024-09-21T06:07:53.982997+0000","last_fullsized":"2024-09-21T06:07:53.982997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:36.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986317+0000","last_change":"2024-09-21T06:07:52.986126+0000","last_active":"2024-09-21T06:07:52.986317+0000","last_peered":"2024-09-21T06:07:52.986317+0000","last_clean":"2024-09-21T06:07:52.986317+0000","last_became_active":"2024-09-21T06:07:52.984866+0000","last_became_peered":"2024-09-21T06:07:52.984866+0000","last_unstale":"2024-09-21T06:07:52.986317+0000","last_undegraded":"2024-09-21T06:07:52.986317+0000","last_fullsized":"2024-09-21T06:07:52.986317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:46.302864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.969634+0000","last_change":"2024-09-21T06:07:51.957375+0000","last_active":"2024-09-21T06:07:52.969634+0000","last_peered":"2024-09-21T06:07:52.969634+0000","last_clean":"2024-09-21T06:07:52.969634+0000","last_became_active":"2024-09-21T06:07:51.957091+0000","last_became_peered":"2024-09-21T06:07:51.957091+0000","last_unstale":"2024-09-21T06:07:52.969634+0000","last_undegraded":"2024-09-21T06:07:52.969634+0000","last_fullsized":"2024-09-21T06:07:52.969634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:14.971094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988292+0000","last_change":"2024-09-21T06:07:52.988022+0000","last_active":"2024-09-21T06:07:52.988292+0000","last_peered":"2024-09-21T06:07:52.988292+0000","last_clean":"2024-09-21T06:07:52.988292+0000","last_became_active":"2024-09-21T06:07:52.985087+0000","last_became_peered":"2024-09-21T06:07:52.985087+0000","last_unstale":"2024-09-21T06:07:52.988292+0000","last_undegraded":"2024-09-21T06:07:52.988292+0000","last_fullsized":"2024-09-21T06:07:52.988292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:43.939431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983687+0000","last_change":"2024-09-21T06:07:51.945686+0000","last_active":"2024-09-21T06:07:53.983687+0000","last_peered":"2024-09-21T06:07:53.983687+0000","last_clean":"2024-09-21T06:07:53.983687+0000","last_became_active":"2024-09-21T06:07:51.945411+0000","last_became_peered":"2024-09-21T06:07:51.945411+0000","last_unstale":"2024-09-21T06:07:53.983687+0000","last_undegraded":"2024-09-21T06:07:53.983687+0000","last_fullsized":"2024-09-21T06:07:53.983687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:56.234917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983217+0000","last_change":"2024-09-21T06:07:52.976898+0000","last_active":"2024-09-21T06:07:53.983217+0000","last_peered":"2024-09-21T06:07:53.983217+0000","last_clean":"2024-09-21T06:07:53.983217+0000","last_became_active":"2024-09-21T06:07:52.975776+0000","last_became_peered":"2024-09-21T06:07:52.975776+0000","last_unstale":"2024-09-21T06:07:53.983217+0000","last_undegraded":"2024-09-21T06:07:53.983217+0000","last_fullsized":"2024-09-21T06:07:53.983217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:32.631007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017193+0000","last_change":"2024-09-21T06:07:51.956017+0000","last_active":"2024-09-21T06:07:54.017193+0000","last_peered":"2024-09-21T06:07:54.017193+0000","last_clean":"2024-09-21T06:07:54.017193+0000","last_became_active":"2024-09-21T06:07:51.954297+0000","last_became_peered":"2024-09-21T06:07:51.954297+0000","last_unstale":"2024-09-21T06:07:54.017193+0000","last_undegraded":"2024-09-21T06:07:54.017193+0000","last_fullsized":"2024-09-21T06:07:54.017193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:51.266233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984107+0000","last_change":"2024-09-21T06:07:52.981709+0000","last_active":"2024-09-21T06:07:52.984107+0000","last_peered":"2024-09-21T06:07:52.984107+0000","last_clean":"2024-09-21T06:07:52.984107+0000","last_became_active":"2024-09-21T06:07:52.980673+0000","last_became_peered":"2024-09-21T06:07:52.980673+0000","last_unstale":"2024-09-21T06:07:52.984107+0000","last_undegraded":"2024-09-21T06:07:52.984107+0000","last_fullsized":"2024-09-21T06:07:52.984107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:37.278827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.966804+0000","last_change":"2024-09-21T06:07:51.955577+0000","last_active":"2024-09-21T06:07:52.966804+0000","last_peered":"2024-09-21T06:07:52.966804+0000","last_clean":"2024-09-21T06:07:52.966804+0000","last_became_active":"2024-09-21T06:07:51.953965+0000","last_became_peered":"2024-09-21T06:07:51.953965+0000","last_unstale":"2024-09-21T06:07:52.966804+0000","last_undegraded":"2024-09-21T06:07:52.966804+0000","last_fullsized":"2024-09-21T06:07:52.966804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:15.502095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980404+0000","last_change":"2024-09-21T06:07:52.973417+0000","last_active":"2024-09-21T06:07:53.980404+0000","last_peered":"2024-09-21T06:07:53.980404+0000","last_clean":"2024-09-21T06:07:53.980404+0000","last_became_active":"2024-09-21T06:07:52.973166+0000","last_became_peered":"2024-09-21T06:07:52.973166+0000","last_unstale":"2024-09-21T06:07:53.980404+0000","last_undegraded":"2024-09-21T06:07:53.980404+0000","last_fullsized":"2024-09-21T06:07:53.980404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:41.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.981013+0000","last_change":"2024-09-21T06:07:51.952754+0000","last_active":"2024-09-21T06:07:52.981013+0000","last_peered":"2024-09-21T06:07:52.981013+0000","last_clean":"2024-09-21T06:07:52.981013+0000","last_became_active":"2024-09-21T06:07:51.952486+0000","last_became_peered":"2024-09-21T06:07:51.952486+0000","last_unstale":"2024-09-21T06:07:52.981013+0000","last_undegraded":"2024-09-21T06:07:52.981013+0000","last_fullsized":"2024-09-21T06:07:52.981013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:46.858630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":235,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.979364+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:07:52.979364+0000","last_peered":"2024-09-21T06:07:52.979364+0000","last_clean":"2024-09-21T06:07:52.979364+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:07:52.979364+0000","last_undegraded":"2024-09-21T06:07:52.979364+0000","last_fullsized":"2024-09-21T06:07:52.979364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:25.067726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":420,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194891,"statfs":{"total":200000000,"available":199569269,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198979013,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":991,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194320,"statfs":{"total":200000000,"available":198984697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199575589,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199575591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199575611,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":415,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194896,"statfs":{"total":200000000,"available":199574069,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":416,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194895,"statfs":{"total":200000000,"available":199573453,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:07:57.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:07:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 -- 172.21.15.118:0/2157125809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 msgr2=0x7f9c840d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 --2- 172.21.15.118:0/2157125809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c840d13c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9c8415d7d0 tx=0x7f9c7002a540 comp rx=0 tx=0).stop 2024-09-21T06:07:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 -- 172.21.15.118:0/2157125809 shutdown_connections 2024-09-21T06:07:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 --2- 172.21.15.118:0/2157125809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c840d13c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 --2- 172.21.15.118:0/2157125809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c84142730 0x7f9c84142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 --2- 172.21.15.118:0/2157125809 >> v2:172.21.15.149:3300/0 conn(0x7f9c8413fae0 0x7f9c840d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 -- 172.21.15.118:0/2157125809 >> 172.21.15.118:0/2157125809 conn(0x7f9c8406d110 msgr2=0x7f9c8406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 -- 172.21.15.118:0/2157125809 shutdown_connections 2024-09-21T06:07:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.676+0000 7f9c8b000640 1 -- 172.21.15.118:0/2157125809 wait complete. 2024-09-21T06:07:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.679+0000 7f9c8b000640 1 Processor -- start 2024-09-21T06:07:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.679+0000 7f9c8b000640 1 -- start start 2024-09-21T06:07:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.680+0000 7f9c8b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c8413fae0 0x7f9c841530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.680+0000 7f9c8b000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c841f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.680+0000 7f9c8b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c84142730 0x7f9c84158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.680+0000 7f9c8b000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8406f300 con 0x7f9c8413fef0 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.680+0000 7f9c8b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8406f180 con 0x7f9c8413fae0 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.680+0000 7f9c8b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8406f480 con 0x7f9c84142730 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c841f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c841f4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48028/0 (socket says 172.21.15.118:48028) 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 -- 172.21.15.118:0/1364574368 learned_addr learned my addr 172.21.15.118:0/1364574368 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83e00640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c8413fae0 0x7f9c841530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c89000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c84142730 0x7f9c84158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 -- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c84142730 msgr2=0x7f9c84158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c84142730 0x7f9c84158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 -- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c8413fae0 msgr2=0x7f9c841530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c8413fae0 0x7f9c841530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 -- 172.21.15.118:0/1364574368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c84142120 con 0x7f9c8413fef0 2024-09-21T06:07:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c89000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c84142730 0x7f9c84158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.681+0000 7f9c83400640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c841f4100 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9c70034040 tx=0x7f9c700038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.682+0000 7f9c7be00640 1 -- 172.21.15.118:0/1364574368 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7003e030 con 0x7f9c8413fef0 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.682+0000 7f9c7be00640 1 -- 172.21.15.118:0/1364574368 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c70003db0 con 0x7f9c8413fef0 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.682+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8413b280 con 0x7f9c8413fef0 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.682+0000 7f9c7be00640 1 -- 172.21.15.118:0/1364574368 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70035040 con 0x7f9c8413fef0 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.682+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c84158670 con 0x7f9c8413fef0 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.683+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8406f9a0 con 0x7f9c8413fef0 2024-09-21T06:07:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.684+0000 7f9c7be00640 1 -- 172.21.15.118:0/1364574368 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c70041030 con 0x7f9c8413fef0 2024-09-21T06:07:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.685+0000 7f9c7be00640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c64078b90 0x7f9c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.685+0000 7f9c7be00640 1 -- 172.21.15.118:0/1364574368 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f9c700bb700 con 0x7f9c8413fef0 2024-09-21T06:07:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.686+0000 7f9c83e00640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c64078b90 0x7f9c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.686+0000 7f9c83e00640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c64078b90 0x7f9c6407b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c74005fd0 tx=0x7f9c7400b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:57.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.689+0000 7f9c7be00640 1 -- 172.21.15.118:0/1364574368 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9c70083580 con 0x7f9c8413fef0 2024-09-21T06:07:57.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.871+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c8415b830 con 0x7f9c64078b90 2024-09-21T06:07:57.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.877+0000 7f9c7be00640 1 -- 172.21.15.118:0/1364574368 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247575 (secure 0 0 0) 0x7f9c8415b830 con 0x7f9c64078b90 2024-09-21T06:07:57.882 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:57.883 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:07:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.880+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c64078b90 msgr2=0x7f9c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.880+0000 7f9c8b000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c64078b90 0x7f9c6407b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c74005fd0 tx=0x7f9c7400b2e0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 msgr2=0x7f9c841f4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c841f4100 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9c70034040 tx=0x7f9c700038a0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 shutdown_connections 2024-09-21T06:07:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c64078b90 0x7f9c6407b0a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c84142730 0x7f9c84158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8413fef0 0x7f9c841f4100 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 --2- 172.21.15.118:0/1364574368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c8413fae0 0x7f9c841530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 >> 172.21.15.118:0/1364574368 conn(0x7f9c8406d110 msgr2=0x7f9c84160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 shutdown_connections 2024-09-21T06:07:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:57.881+0000 7f9c8b000640 1 -- 172.21.15.118:0/1364574368 wait complete. 2024-09-21T06:07:57.905 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-21T06:07:56.518634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4485,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558014,"statfs":{"total":1600000000,"available":1595407292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.583705"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988705+0000","last_change":"2024-09-21T06:07:52.986792+0000","last_active":"2024-09-21T06:07:52.988705+0000","last_peered":"2024-09-21T06:07:52.988705+0000","last_clean":"2024-09-21T06:07:52.988705+0000","last_became_active":"2024-09-21T06:07:52.983244+0000","last_became_peered":"2024-09-21T06:07:52.983244+0000","last_unstale":"2024-09-21T06:07:52.988705+0000","last_undegraded":"2024-09-21T06:07:52.988705+0000","last_fullsized":"2024-09-21T06:07:52.988705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:32.024533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.971161+0000","last_change":"2024-09-21T06:07:52.970973+0000","last_active":"2024-09-21T06:07:52.971161+0000","last_peered":"2024-09-21T06:07:52.971161+0000","last_clean":"2024-09-21T06:07:52.971161+0000","last_became_active":"2024-09-21T06:07:52.969488+0000","last_became_peered":"2024-09-21T06:07:52.969488+0000","last_unstale":"2024-09-21T06:07:52.971161+0000","last_undegraded":"2024-09-21T06:07:52.971161+0000","last_fullsized":"2024-09-21T06:07:52.971161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:37.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980065+0000","last_change":"2024-09-21T06:07:52.971342+0000","last_active":"2024-09-21T06:07:53.980065+0000","last_peered":"2024-09-21T06:07:53.980065+0000","last_clean":"2024-09-21T06:07:53.980065+0000","last_became_active":"2024-09-21T06:07:52.970274+0000","last_became_peered":"2024-09-21T06:07:52.970274+0000","last_unstale":"2024-09-21T06:07:53.980065+0000","last_undegraded":"2024-09-21T06:07:53.980065+0000","last_fullsized":"2024-09-21T06:07:53.980065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:53.595989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982641+0000","last_change":"2024-09-21T06:07:52.976622+0000","last_active":"2024-09-21T06:07:53.982641+0000","last_peered":"2024-09-21T06:07:53.982641+0000","last_clean":"2024-09-21T06:07:53.982641+0000","last_became_active":"2024-09-21T06:07:52.975358+0000","last_became_peered":"2024-09-21T06:07:52.975358+0000","last_unstale":"2024-09-21T06:07:53.982641+0000","last_undegraded":"2024-09-21T06:07:53.982641+0000","last_fullsized":"2024-09-21T06:07:53.982641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:54.369909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984011+0000","last_change":"2024-09-21T06:07:52.983454+0000","last_active":"2024-09-21T06:07:52.984011+0000","last_peered":"2024-09-21T06:07:52.984011+0000","last_clean":"2024-09-21T06:07:52.984011+0000","last_became_active":"2024-09-21T06:07:52.983165+0000","last_became_peered":"2024-09-21T06:07:52.983165+0000","last_unstale":"2024-09-21T06:07:52.984011+0000","last_undegraded":"2024-09-21T06:07:52.984011+0000","last_fullsized":"2024-09-21T06:07:52.984011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:48.669893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.974822+0000","last_change":"2024-09-21T06:07:52.974009+0000","last_active":"2024-09-21T06:07:52.974822+0000","last_peered":"2024-09-21T06:07:52.974822+0000","last_clean":"2024-09-21T06:07:52.974822+0000","last_became_active":"2024-09-21T06:07:52.973779+0000","last_became_peered":"2024-09-21T06:07:52.973779+0000","last_unstale":"2024-09-21T06:07:52.974822+0000","last_undegraded":"2024-09-21T06:07:52.974822+0000","last_fullsized":"2024-09-21T06:07:52.974822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:42.726028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.982812+0000","last_change":"2024-09-21T06:07:52.980553+0000","last_active":"2024-09-21T06:07:52.982812+0000","last_peered":"2024-09-21T06:07:52.982812+0000","last_clean":"2024-09-21T06:07:52.982812+0000","last_became_active":"2024-09-21T06:07:52.980266+0000","last_became_peered":"2024-09-21T06:07:52.980266+0000","last_unstale":"2024-09-21T06:07:52.982812+0000","last_undegraded":"2024-09-21T06:07:52.982812+0000","last_fullsized":"2024-09-21T06:07:52.982812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:42.910630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984877+0000","last_change":"2024-09-21T06:07:52.984518+0000","last_active":"2024-09-21T06:07:52.984877+0000","last_peered":"2024-09-21T06:07:52.984877+0000","last_clean":"2024-09-21T06:07:52.984877+0000","last_became_active":"2024-09-21T06:07:52.981282+0000","last_became_peered":"2024-09-21T06:07:52.981282+0000","last_unstale":"2024-09-21T06:07:52.984877+0000","last_undegraded":"2024-09-21T06:07:52.984877+0000","last_fullsized":"2024-09-21T06:07:52.984877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:25.034088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.974554+0000","last_change":"2024-09-21T06:07:52.973171+0000","last_active":"2024-09-21T06:07:52.974554+0000","last_peered":"2024-09-21T06:07:52.974554+0000","last_clean":"2024-09-21T06:07:52.974554+0000","last_became_active":"2024-09-21T06:07:52.972920+0000","last_became_peered":"2024-09-21T06:07:52.972920+0000","last_unstale":"2024-09-21T06:07:52.974554+0000","last_undegraded":"2024-09-21T06:07:52.974554+0000","last_fullsized":"2024-09-21T06:07:52.974554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:20.844052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017050+0000","last_change":"2024-09-21T06:07:52.984788+0000","last_active":"2024-09-21T06:07:54.017050+0000","last_peered":"2024-09-21T06:07:54.017050+0000","last_clean":"2024-09-21T06:07:54.017050+0000","last_became_active":"2024-09-21T06:07:52.975431+0000","last_became_peered":"2024-09-21T06:07:52.975431+0000","last_unstale":"2024-09-21T06:07:54.017050+0000","last_undegraded":"2024-09-21T06:07:54.017050+0000","last_fullsized":"2024-09-21T06:07:54.017050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:48.944853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988896+0000","last_change":"2024-09-21T06:07:52.988463+0000","last_active":"2024-09-21T06:07:52.988896+0000","last_peered":"2024-09-21T06:07:52.988896+0000","last_clean":"2024-09-21T06:07:52.988896+0000","last_became_active":"2024-09-21T06:07:52.986551+0000","last_became_peered":"2024-09-21T06:07:52.986551+0000","last_unstale":"2024-09-21T06:07:52.988896+0000","last_undegraded":"2024-09-21T06:07:52.988896+0000","last_fullsized":"2024-09-21T06:07:52.988896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:07.709792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983442+0000","last_change":"2024-09-21T06:07:52.975463+0000","last_active":"2024-09-21T06:07:53.983442+0000","last_peered":"2024-09-21T06:07:53.983442+0000","last_clean":"2024-09-21T06:07:53.983442+0000","last_became_active":"2024-09-21T06:07:52.973050+0000","last_became_peered":"2024-09-21T06:07:52.973050+0000","last_unstale":"2024-09-21T06:07:53.983442+0000","last_undegraded":"2024-09-21T06:07:53.983442+0000","last_fullsized":"2024-09-21T06:07:53.983442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.492934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982643+0000","last_change":"2024-09-21T06:07:52.975054+0000","last_active":"2024-09-21T06:07:53.982643+0000","last_peered":"2024-09-21T06:07:53.982643+0000","last_clean":"2024-09-21T06:07:53.982643+0000","last_became_active":"2024-09-21T06:07:52.974235+0000","last_became_peered":"2024-09-21T06:07:52.974235+0000","last_unstale":"2024-09-21T06:07:53.982643+0000","last_undegraded":"2024-09-21T06:07:53.982643+0000","last_fullsized":"2024-09-21T06:07:53.982643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:25.985682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.972532+0000","last_change":"2024-09-21T06:07:52.970699+0000","last_active":"2024-09-21T06:07:52.972532+0000","last_peered":"2024-09-21T06:07:52.972532+0000","last_clean":"2024-09-21T06:07:52.972532+0000","last_became_active":"2024-09-21T06:07:52.970397+0000","last_became_peered":"2024-09-21T06:07:52.970397+0000","last_unstale":"2024-09-21T06:07:52.972532+0000","last_undegraded":"2024-09-21T06:07:52.972532+0000","last_fullsized":"2024-09-21T06:07:52.972532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:13.324439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982645+0000","last_change":"2024-09-21T06:07:52.977013+0000","last_active":"2024-09-21T06:07:53.982645+0000","last_peered":"2024-09-21T06:07:53.982645+0000","last_clean":"2024-09-21T06:07:53.982645+0000","last_became_active":"2024-09-21T06:07:52.971850+0000","last_became_peered":"2024-09-21T06:07:52.971850+0000","last_unstale":"2024-09-21T06:07:53.982645+0000","last_undegraded":"2024-09-21T06:07:53.982645+0000","last_fullsized":"2024-09-21T06:07:53.982645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:40.721371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017105+0000","last_change":"2024-09-21T06:07:52.980353+0000","last_active":"2024-09-21T06:07:54.017105+0000","last_peered":"2024-09-21T06:07:54.017105+0000","last_clean":"2024-09-21T06:07:54.017105+0000","last_became_active":"2024-09-21T06:07:52.979910+0000","last_became_peered":"2024-09-21T06:07:52.979910+0000","last_unstale":"2024-09-21T06:07:54.017105+0000","last_undegraded":"2024-09-21T06:07:54.017105+0000","last_fullsized":"2024-09-21T06:07:54.017105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:45.830566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.987493+0000","last_change":"2024-09-21T06:07:52.987188+0000","last_active":"2024-09-21T06:07:52.987493+0000","last_peered":"2024-09-21T06:07:52.987493+0000","last_clean":"2024-09-21T06:07:52.987493+0000","last_became_active":"2024-09-21T06:07:52.985865+0000","last_became_peered":"2024-09-21T06:07:52.985865+0000","last_unstale":"2024-09-21T06:07:52.987493+0000","last_undegraded":"2024-09-21T06:07:52.987493+0000","last_fullsized":"2024-09-21T06:07:52.987493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:10.523059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983205+0000","last_change":"2024-09-21T06:07:52.975061+0000","last_active":"2024-09-21T06:07:53.983205+0000","last_peered":"2024-09-21T06:07:53.983205+0000","last_clean":"2024-09-21T06:07:53.983205+0000","last_became_active":"2024-09-21T06:07:52.974564+0000","last_became_peered":"2024-09-21T06:07:52.974564+0000","last_unstale":"2024-09-21T06:07:53.983205+0000","last_undegraded":"2024-09-21T06:07:53.983205+0000","last_fullsized":"2024-09-21T06:07:53.983205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:41.773079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984157+0000","last_change":"2024-09-21T06:07:52.982610+0000","last_active":"2024-09-21T06:07:52.984157+0000","last_peered":"2024-09-21T06:07:52.984157+0000","last_clean":"2024-09-21T06:07:52.984157+0000","last_became_active":"2024-09-21T06:07:52.977404+0000","last_became_peered":"2024-09-21T06:07:52.977404+0000","last_unstale":"2024-09-21T06:07:52.984157+0000","last_undegraded":"2024-09-21T06:07:52.984157+0000","last_fullsized":"2024-09-21T06:07:52.984157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:46.948034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982870+0000","last_change":"2024-09-21T06:07:52.977304+0000","last_active":"2024-09-21T06:07:53.982870+0000","last_peered":"2024-09-21T06:07:53.982870+0000","last_clean":"2024-09-21T06:07:53.982870+0000","last_became_active":"2024-09-21T06:07:52.972867+0000","last_became_peered":"2024-09-21T06:07:52.972867+0000","last_unstale":"2024-09-21T06:07:53.982870+0000","last_undegraded":"2024-09-21T06:07:53.982870+0000","last_fullsized":"2024-09-21T06:07:53.982870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:50.963629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017478+0000","last_change":"2024-09-21T06:07:52.969050+0000","last_active":"2024-09-21T06:07:54.017478+0000","last_peered":"2024-09-21T06:07:54.017478+0000","last_clean":"2024-09-21T06:07:54.017478+0000","last_became_active":"2024-09-21T06:07:52.968746+0000","last_became_peered":"2024-09-21T06:07:52.968746+0000","last_unstale":"2024-09-21T06:07:54.017478+0000","last_undegraded":"2024-09-21T06:07:54.017478+0000","last_fullsized":"2024-09-21T06:07:54.017478+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:49.495738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017130+0000","last_change":"2024-09-21T06:07:52.976083+0000","last_active":"2024-09-21T06:07:54.017130+0000","last_peered":"2024-09-21T06:07:54.017130+0000","last_clean":"2024-09-21T06:07:54.017130+0000","last_became_active":"2024-09-21T06:07:52.975817+0000","last_became_peered":"2024-09-21T06:07:52.975817+0000","last_unstale":"2024-09-21T06:07:54.017130+0000","last_undegraded":"2024-09-21T06:07:54.017130+0000","last_fullsized":"2024-09-21T06:07:54.017130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:09.785287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983381+0000","last_change":"2024-09-21T06:07:52.981250+0000","last_active":"2024-09-21T06:07:52.983381+0000","last_peered":"2024-09-21T06:07:52.983381+0000","last_clean":"2024-09-21T06:07:52.983381+0000","last_became_active":"2024-09-21T06:07:52.978853+0000","last_became_peered":"2024-09-21T06:07:52.978853+0000","last_unstale":"2024-09-21T06:07:52.983381+0000","last_undegraded":"2024-09-21T06:07:52.983381+0000","last_fullsized":"2024-09-21T06:07:52.983381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:15.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984826+0000","last_change":"2024-09-21T06:07:52.984641+0000","last_active":"2024-09-21T06:07:52.984826+0000","last_peered":"2024-09-21T06:07:52.984826+0000","last_clean":"2024-09-21T06:07:52.984826+0000","last_became_active":"2024-09-21T06:07:52.984392+0000","last_became_peered":"2024-09-21T06:07:52.984392+0000","last_unstale":"2024-09-21T06:07:52.984826+0000","last_undegraded":"2024-09-21T06:07:52.984826+0000","last_fullsized":"2024-09-21T06:07:52.984826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:42.933875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017199+0000","last_change":"2024-09-21T06:07:52.982564+0000","last_active":"2024-09-21T06:07:54.017199+0000","last_peered":"2024-09-21T06:07:54.017199+0000","last_clean":"2024-09-21T06:07:54.017199+0000","last_became_active":"2024-09-21T06:07:52.974548+0000","last_became_peered":"2024-09-21T06:07:52.974548+0000","last_unstale":"2024-09-21T06:07:54.017199+0000","last_undegraded":"2024-09-21T06:07:54.017199+0000","last_fullsized":"2024-09-21T06:07:54.017199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:27.134532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.980171+0000","last_change":"2024-09-21T06:07:52.979496+0000","last_active":"2024-09-21T06:07:52.980171+0000","last_peered":"2024-09-21T06:07:52.980171+0000","last_clean":"2024-09-21T06:07:52.980171+0000","last_became_active":"2024-09-21T06:07:52.979234+0000","last_became_peered":"2024-09-21T06:07:52.979234+0000","last_unstale":"2024-09-21T06:07:52.980171+0000","last_undegraded":"2024-09-21T06:07:52.980171+0000","last_fullsized":"2024-09-21T06:07:52.980171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:05.750991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980162+0000","last_change":"2024-09-21T06:07:52.981407+0000","last_active":"2024-09-21T06:07:53.980162+0000","last_peered":"2024-09-21T06:07:53.980162+0000","last_clean":"2024-09-21T06:07:53.980162+0000","last_became_active":"2024-09-21T06:07:52.980592+0000","last_became_peered":"2024-09-21T06:07:52.980592+0000","last_unstale":"2024-09-21T06:07:53.980162+0000","last_undegraded":"2024-09-21T06:07:53.980162+0000","last_fullsized":"2024-09-21T06:07:53.980162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:10.714288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.016909+0000","last_change":"2024-09-21T06:07:52.975227+0000","last_active":"2024-09-21T06:07:54.016909+0000","last_peered":"2024-09-21T06:07:54.016909+0000","last_clean":"2024-09-21T06:07:54.016909+0000","last_became_active":"2024-09-21T06:07:52.974930+0000","last_became_peered":"2024-09-21T06:07:52.974930+0000","last_unstale":"2024-09-21T06:07:54.016909+0000","last_undegraded":"2024-09-21T06:07:54.016909+0000","last_fullsized":"2024-09-21T06:07:54.016909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:25.364476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980149+0000","last_change":"2024-09-21T06:07:52.968694+0000","last_active":"2024-09-21T06:07:53.980149+0000","last_peered":"2024-09-21T06:07:53.980149+0000","last_clean":"2024-09-21T06:07:53.980149+0000","last_became_active":"2024-09-21T06:07:52.968411+0000","last_became_peered":"2024-09-21T06:07:52.968411+0000","last_unstale":"2024-09-21T06:07:53.980149+0000","last_undegraded":"2024-09-21T06:07:53.980149+0000","last_fullsized":"2024-09-21T06:07:53.980149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:26.450665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.972138+0000","last_change":"2024-09-21T06:07:52.971837+0000","last_active":"2024-09-21T06:07:52.972138+0000","last_peered":"2024-09-21T06:07:52.972138+0000","last_clean":"2024-09-21T06:07:52.972138+0000","last_became_active":"2024-09-21T06:07:52.971570+0000","last_became_peered":"2024-09-21T06:07:52.971570+0000","last_unstale":"2024-09-21T06:07:52.972138+0000","last_undegraded":"2024-09-21T06:07:52.972138+0000","last_fullsized":"2024-09-21T06:07:52.972138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:15.487152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.974097+0000","last_change":"2024-09-21T06:07:52.973905+0000","last_active":"2024-09-21T06:07:52.974097+0000","last_peered":"2024-09-21T06:07:52.974097+0000","last_clean":"2024-09-21T06:07:52.974097+0000","last_became_active":"2024-09-21T06:07:52.973534+0000","last_became_peered":"2024-09-21T06:07:52.973534+0000","last_unstale":"2024-09-21T06:07:52.974097+0000","last_undegraded":"2024-09-21T06:07:52.974097+0000","last_fullsized":"2024-09-21T06:07:52.974097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:57.840713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988395+0000","last_change":"2024-09-21T06:07:52.988188+0000","last_active":"2024-09-21T06:07:52.988395+0000","last_peered":"2024-09-21T06:07:52.988395+0000","last_clean":"2024-09-21T06:07:52.988395+0000","last_became_active":"2024-09-21T06:07:52.987602+0000","last_became_peered":"2024-09-21T06:07:52.987602+0000","last_unstale":"2024-09-21T06:07:52.988395+0000","last_undegraded":"2024-09-21T06:07:52.988395+0000","last_fullsized":"2024-09-21T06:07:52.988395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:32.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.990208+0000","last_change":"2024-09-21T06:07:52.989419+0000","last_active":"2024-09-21T06:07:52.990208+0000","last_peered":"2024-09-21T06:07:52.990208+0000","last_clean":"2024-09-21T06:07:52.990208+0000","last_became_active":"2024-09-21T06:07:52.988305+0000","last_became_peered":"2024-09-21T06:07:52.988305+0000","last_unstale":"2024-09-21T06:07:52.990208+0000","last_undegraded":"2024-09-21T06:07:52.990208+0000","last_fullsized":"2024-09-21T06:07:52.990208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:54.551163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986400+0000","last_change":"2024-09-21T06:07:51.955361+0000","last_active":"2024-09-21T06:07:52.986400+0000","last_peered":"2024-09-21T06:07:52.986400+0000","last_clean":"2024-09-21T06:07:52.986400+0000","last_became_active":"2024-09-21T06:07:51.955084+0000","last_became_peered":"2024-09-21T06:07:51.955084+0000","last_unstale":"2024-09-21T06:07:52.986400+0000","last_undegraded":"2024-09-21T06:07:52.986400+0000","last_fullsized":"2024-09-21T06:07:52.986400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:15.029873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984038+0000","last_change":"2024-09-21T06:07:52.983496+0000","last_active":"2024-09-21T06:07:52.984038+0000","last_peered":"2024-09-21T06:07:52.984038+0000","last_clean":"2024-09-21T06:07:52.984038+0000","last_became_active":"2024-09-21T06:07:52.981607+0000","last_became_peered":"2024-09-21T06:07:52.981607+0000","last_unstale":"2024-09-21T06:07:52.984038+0000","last_undegraded":"2024-09-21T06:07:52.984038+0000","last_fullsized":"2024-09-21T06:07:52.984038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:16.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982865+0000","last_change":"2024-09-21T06:07:51.952710+0000","last_active":"2024-09-21T06:07:53.982865+0000","last_peered":"2024-09-21T06:07:53.982865+0000","last_clean":"2024-09-21T06:07:53.982865+0000","last_became_active":"2024-09-21T06:07:51.951543+0000","last_became_peered":"2024-09-21T06:07:51.951543+0000","last_unstale":"2024-09-21T06:07:53.982865+0000","last_undegraded":"2024-09-21T06:07:53.982865+0000","last_fullsized":"2024-09-21T06:07:53.982865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:29.097748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988735+0000","last_change":"2024-09-21T06:07:52.988356+0000","last_active":"2024-09-21T06:07:52.988735+0000","last_peered":"2024-09-21T06:07:52.988735+0000","last_clean":"2024-09-21T06:07:52.988735+0000","last_became_active":"2024-09-21T06:07:52.987367+0000","last_became_peered":"2024-09-21T06:07:52.987367+0000","last_unstale":"2024-09-21T06:07:52.988735+0000","last_undegraded":"2024-09-21T06:07:52.988735+0000","last_fullsized":"2024-09-21T06:07:52.988735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:10.452726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017518+0000","last_change":"2024-09-21T06:07:51.954304+0000","last_active":"2024-09-21T06:07:54.017518+0000","last_peered":"2024-09-21T06:07:54.017518+0000","last_clean":"2024-09-21T06:07:54.017518+0000","last_became_active":"2024-09-21T06:07:51.953675+0000","last_became_peered":"2024-09-21T06:07:51.953675+0000","last_unstale":"2024-09-21T06:07:54.017518+0000","last_undegraded":"2024-09-21T06:07:54.017518+0000","last_fullsized":"2024-09-21T06:07:54.017518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:42.389685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983516+0000","last_change":"2024-09-21T06:07:52.982382+0000","last_active":"2024-09-21T06:07:52.983516+0000","last_peered":"2024-09-21T06:07:52.983516+0000","last_clean":"2024-09-21T06:07:52.983516+0000","last_became_active":"2024-09-21T06:07:52.982005+0000","last_became_peered":"2024-09-21T06:07:52.982005+0000","last_unstale":"2024-09-21T06:07:52.983516+0000","last_undegraded":"2024-09-21T06:07:52.983516+0000","last_fullsized":"2024-09-21T06:07:52.983516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:55.956473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984046+0000","last_change":"2024-09-21T06:07:51.951660+0000","last_active":"2024-09-21T06:07:52.984046+0000","last_peered":"2024-09-21T06:07:52.984046+0000","last_clean":"2024-09-21T06:07:52.984046+0000","last_became_active":"2024-09-21T06:07:51.951377+0000","last_became_peered":"2024-09-21T06:07:51.951377+0000","last_unstale":"2024-09-21T06:07:52.984046+0000","last_undegraded":"2024-09-21T06:07:52.984046+0000","last_fullsized":"2024-09-21T06:07:52.984046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:22.442771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.971095+0000","last_change":"2024-09-21T06:07:52.970844+0000","last_active":"2024-09-21T06:07:52.971095+0000","last_peered":"2024-09-21T06:07:52.971095+0000","last_clean":"2024-09-21T06:07:52.971095+0000","last_became_active":"2024-09-21T06:07:52.970591+0000","last_became_peered":"2024-09-21T06:07:52.970591+0000","last_unstale":"2024-09-21T06:07:52.971095+0000","last_undegraded":"2024-09-21T06:07:52.971095+0000","last_fullsized":"2024-09-21T06:07:52.971095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:02.896843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980543+0000","last_change":"2024-09-21T06:07:51.948610+0000","last_active":"2024-09-21T06:07:53.980543+0000","last_peered":"2024-09-21T06:07:53.980543+0000","last_clean":"2024-09-21T06:07:53.980543+0000","last_became_active":"2024-09-21T06:07:51.948355+0000","last_became_peered":"2024-09-21T06:07:51.948355+0000","last_unstale":"2024-09-21T06:07:53.980543+0000","last_undegraded":"2024-09-21T06:07:53.980543+0000","last_fullsized":"2024-09-21T06:07:53.980543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:29.702792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017401+0000","last_change":"2024-09-21T06:07:52.974100+0000","last_active":"2024-09-21T06:07:54.017401+0000","last_peered":"2024-09-21T06:07:54.017401+0000","last_clean":"2024-09-21T06:07:54.017401+0000","last_became_active":"2024-09-21T06:07:52.973836+0000","last_became_peered":"2024-09-21T06:07:52.973836+0000","last_unstale":"2024-09-21T06:07:54.017401+0000","last_undegraded":"2024-09-21T06:07:54.017401+0000","last_fullsized":"2024-09-21T06:07:54.017401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:26.116036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.981493+0000","last_change":"2024-09-21T06:07:51.949938+0000","last_active":"2024-09-21T06:07:52.981493+0000","last_peered":"2024-09-21T06:07:52.981493+0000","last_clean":"2024-09-21T06:07:52.981493+0000","last_became_active":"2024-09-21T06:07:51.949643+0000","last_became_peered":"2024-09-21T06:07:51.949643+0000","last_unstale":"2024-09-21T06:07:52.981493+0000","last_undegraded":"2024-09-21T06:07:52.981493+0000","last_fullsized":"2024-09-21T06:07:52.981493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:58.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986344+0000","last_change":"2024-09-21T06:07:52.986177+0000","last_active":"2024-09-21T06:07:52.986344+0000","last_peered":"2024-09-21T06:07:52.986344+0000","last_clean":"2024-09-21T06:07:52.986344+0000","last_became_active":"2024-09-21T06:07:52.985785+0000","last_became_peered":"2024-09-21T06:07:52.985785+0000","last_unstale":"2024-09-21T06:07:52.986344+0000","last_undegraded":"2024-09-21T06:07:52.986344+0000","last_fullsized":"2024-09-21T06:07:52.986344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:14.423122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983328+0000","last_change":"2024-09-21T06:07:51.946291+0000","last_active":"2024-09-21T06:07:53.983328+0000","last_peered":"2024-09-21T06:07:53.983328+0000","last_clean":"2024-09-21T06:07:53.983328+0000","last_became_active":"2024-09-21T06:07:51.946035+0000","last_became_peered":"2024-09-21T06:07:51.946035+0000","last_unstale":"2024-09-21T06:07:53.983328+0000","last_undegraded":"2024-09-21T06:07:53.983328+0000","last_fullsized":"2024-09-21T06:07:53.983328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:43.117693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982739+0000","last_change":"2024-09-21T06:07:52.981848+0000","last_active":"2024-09-21T06:07:53.982739+0000","last_peered":"2024-09-21T06:07:53.982739+0000","last_clean":"2024-09-21T06:07:53.982739+0000","last_became_active":"2024-09-21T06:07:52.981527+0000","last_became_peered":"2024-09-21T06:07:52.981527+0000","last_unstale":"2024-09-21T06:07:53.982739+0000","last_undegraded":"2024-09-21T06:07:53.982739+0000","last_fullsized":"2024-09-21T06:07:53.982739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:02.590270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.969767+0000","last_change":"2024-09-21T06:07:51.950620+0000","last_active":"2024-09-21T06:07:52.969767+0000","last_peered":"2024-09-21T06:07:52.969767+0000","last_clean":"2024-09-21T06:07:52.969767+0000","last_became_active":"2024-09-21T06:07:51.949799+0000","last_became_peered":"2024-09-21T06:07:51.949799+0000","last_unstale":"2024-09-21T06:07:52.969767+0000","last_undegraded":"2024-09-21T06:07:52.969767+0000","last_fullsized":"2024-09-21T06:07:52.969767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:13.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.982860+0000","last_change":"2024-09-21T06:07:52.981661+0000","last_active":"2024-09-21T06:07:52.982860+0000","last_peered":"2024-09-21T06:07:52.982860+0000","last_clean":"2024-09-21T06:07:52.982860+0000","last_became_active":"2024-09-21T06:07:52.981303+0000","last_became_peered":"2024-09-21T06:07:52.981303+0000","last_unstale":"2024-09-21T06:07:52.982860+0000","last_undegraded":"2024-09-21T06:07:52.982860+0000","last_fullsized":"2024-09-21T06:07:52.982860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:30.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017588+0000","last_change":"2024-09-21T06:07:51.945975+0000","last_active":"2024-09-21T06:07:54.017588+0000","last_peered":"2024-09-21T06:07:54.017588+0000","last_clean":"2024-09-21T06:07:54.017588+0000","last_became_active":"2024-09-21T06:07:51.945664+0000","last_became_peered":"2024-09-21T06:07:51.945664+0000","last_unstale":"2024-09-21T06:07:54.017588+0000","last_undegraded":"2024-09-21T06:07:54.017588+0000","last_fullsized":"2024-09-21T06:07:54.017588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:22.994891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983410+0000","last_change":"2024-09-21T06:07:52.981225+0000","last_active":"2024-09-21T06:07:52.983410+0000","last_peered":"2024-09-21T06:07:52.983410+0000","last_clean":"2024-09-21T06:07:52.983410+0000","last_became_active":"2024-09-21T06:07:52.980918+0000","last_became_peered":"2024-09-21T06:07:52.980918+0000","last_unstale":"2024-09-21T06:07:52.983410+0000","last_undegraded":"2024-09-21T06:07:52.983410+0000","last_fullsized":"2024-09-21T06:07:52.983410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:24.968498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.965985+0000","last_change":"2024-09-21T06:07:51.958802+0000","last_active":"2024-09-21T06:07:52.965985+0000","last_peered":"2024-09-21T06:07:52.965985+0000","last_clean":"2024-09-21T06:07:52.965985+0000","last_became_active":"2024-09-21T06:07:51.958525+0000","last_became_peered":"2024-09-21T06:07:51.958525+0000","last_unstale":"2024-09-21T06:07:52.965985+0000","last_undegraded":"2024-09-21T06:07:52.965985+0000","last_fullsized":"2024-09-21T06:07:52.965985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:09.149952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.970956+0000","last_change":"2024-09-21T06:07:52.969882+0000","last_active":"2024-09-21T06:07:52.970956+0000","last_peered":"2024-09-21T06:07:52.970956+0000","last_clean":"2024-09-21T06:07:52.970956+0000","last_became_active":"2024-09-21T06:07:52.969610+0000","last_became_peered":"2024-09-21T06:07:52.969610+0000","last_unstale":"2024-09-21T06:07:52.970956+0000","last_undegraded":"2024-09-21T06:07:52.970956+0000","last_fullsized":"2024-09-21T06:07:52.970956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:18.922978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"80'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980262+0000","last_change":"2024-09-21T06:07:51.957729+0000","last_active":"2024-09-21T06:07:53.980262+0000","last_peered":"2024-09-21T06:07:53.980262+0000","last_clean":"2024-09-21T06:07:53.980262+0000","last_became_active":"2024-09-21T06:07:51.957412+0000","last_became_peered":"2024-09-21T06:07:51.957412+0000","last_unstale":"2024-09-21T06:07:53.980262+0000","last_undegraded":"2024-09-21T06:07:53.980262+0000","last_fullsized":"2024-09-21T06:07:53.980262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984060+0000","last_change":"2024-09-21T06:07:52.983833+0000","last_active":"2024-09-21T06:07:52.984060+0000","last_peered":"2024-09-21T06:07:52.984060+0000","last_clean":"2024-09-21T06:07:52.984060+0000","last_became_active":"2024-09-21T06:07:52.982403+0000","last_became_peered":"2024-09-21T06:07:52.982403+0000","last_unstale":"2024-09-21T06:07:52.984060+0000","last_undegraded":"2024-09-21T06:07:52.984060+0000","last_fullsized":"2024-09-21T06:07:52.984060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.850647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"80'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983522+0000","last_change":"2024-09-21T06:07:51.951196+0000","last_active":"2024-09-21T06:07:53.983522+0000","last_peered":"2024-09-21T06:07:53.983522+0000","last_clean":"2024-09-21T06:07:53.983522+0000","last_became_active":"2024-09-21T06:07:51.950880+0000","last_became_peered":"2024-09-21T06:07:51.950880+0000","last_unstale":"2024-09-21T06:07:53.983522+0000","last_undegraded":"2024-09-21T06:07:53.983522+0000","last_fullsized":"2024-09-21T06:07:53.983522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:17.682994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988752+0000","last_change":"2024-09-21T06:07:52.987046+0000","last_active":"2024-09-21T06:07:52.988752+0000","last_peered":"2024-09-21T06:07:52.988752+0000","last_clean":"2024-09-21T06:07:52.988752+0000","last_became_active":"2024-09-21T06:07:52.984178+0000","last_became_peered":"2024-09-21T06:07:52.984178+0000","last_unstale":"2024-09-21T06:07:52.988752+0000","last_undegraded":"2024-09-21T06:07:52.988752+0000","last_fullsized":"2024-09-21T06:07:52.988752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:45.815496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982995+0000","last_change":"2024-09-21T06:07:51.952924+0000","last_active":"2024-09-21T06:07:53.982995+0000","last_peered":"2024-09-21T06:07:53.982995+0000","last_clean":"2024-09-21T06:07:53.982995+0000","last_became_active":"2024-09-21T06:07:51.952683+0000","last_became_peered":"2024-09-21T06:07:51.952683+0000","last_unstale":"2024-09-21T06:07:53.982995+0000","last_undegraded":"2024-09-21T06:07:53.982995+0000","last_fullsized":"2024-09-21T06:07:53.982995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:24.643834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.977201+0000","last_change":"2024-09-21T06:07:52.976762+0000","last_active":"2024-09-21T06:07:52.977201+0000","last_peered":"2024-09-21T06:07:52.977201+0000","last_clean":"2024-09-21T06:07:52.977201+0000","last_became_active":"2024-09-21T06:07:52.976501+0000","last_became_peered":"2024-09-21T06:07:52.976501+0000","last_unstale":"2024-09-21T06:07:52.977201+0000","last_undegraded":"2024-09-21T06:07:52.977201+0000","last_fullsized":"2024-09-21T06:07:52.977201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:36.512844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.970644+0000","last_change":"2024-09-21T06:07:51.953749+0000","last_active":"2024-09-21T06:07:52.970644+0000","last_peered":"2024-09-21T06:07:52.970644+0000","last_clean":"2024-09-21T06:07:52.970644+0000","last_became_active":"2024-09-21T06:07:51.953146+0000","last_became_peered":"2024-09-21T06:07:51.953146+0000","last_unstale":"2024-09-21T06:07:52.970644+0000","last_undegraded":"2024-09-21T06:07:52.970644+0000","last_fullsized":"2024-09-21T06:07:52.970644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.637309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982869+0000","last_change":"2024-09-21T06:07:52.974764+0000","last_active":"2024-09-21T06:07:53.982869+0000","last_peered":"2024-09-21T06:07:53.982869+0000","last_clean":"2024-09-21T06:07:53.982869+0000","last_became_active":"2024-09-21T06:07:52.973915+0000","last_became_peered":"2024-09-21T06:07:52.973915+0000","last_unstale":"2024-09-21T06:07:53.982869+0000","last_undegraded":"2024-09-21T06:07:53.982869+0000","last_fullsized":"2024-09-21T06:07:53.982869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:35.935041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968715+0000","last_change":"2024-09-21T06:07:51.958198+0000","last_active":"2024-09-21T06:07:52.968715+0000","last_peered":"2024-09-21T06:07:52.968715+0000","last_clean":"2024-09-21T06:07:52.968715+0000","last_became_active":"2024-09-21T06:07:51.957578+0000","last_became_peered":"2024-09-21T06:07:51.957578+0000","last_unstale":"2024-09-21T06:07:52.968715+0000","last_undegraded":"2024-09-21T06:07:52.968715+0000","last_fullsized":"2024-09-21T06:07:52.968715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:52.741020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986731+0000","last_change":"2024-09-21T06:07:52.986406+0000","last_active":"2024-09-21T06:07:52.986731+0000","last_peered":"2024-09-21T06:07:52.986731+0000","last_clean":"2024-09-21T06:07:52.986731+0000","last_became_active":"2024-09-21T06:07:52.985362+0000","last_became_peered":"2024-09-21T06:07:52.985362+0000","last_unstale":"2024-09-21T06:07:52.986731+0000","last_undegraded":"2024-09-21T06:07:52.986731+0000","last_fullsized":"2024-09-21T06:07:52.986731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:21.749571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"80'8","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017065+0000","last_change":"2024-09-21T06:07:51.956399+0000","last_active":"2024-09-21T06:07:54.017065+0000","last_peered":"2024-09-21T06:07:54.017065+0000","last_clean":"2024-09-21T06:07:54.017065+0000","last_became_active":"2024-09-21T06:07:51.955705+0000","last_became_peered":"2024-09-21T06:07:51.955705+0000","last_unstale":"2024-09-21T06:07:54.017065+0000","last_undegraded":"2024-09-21T06:07:54.017065+0000","last_fullsized":"2024-09-21T06:07:54.017065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:45.072710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017425+0000","last_change":"2024-09-21T06:07:52.966249+0000","last_active":"2024-09-21T06:07:54.017425+0000","last_peered":"2024-09-21T06:07:54.017425+0000","last_clean":"2024-09-21T06:07:54.017425+0000","last_became_active":"2024-09-21T06:07:52.965969+0000","last_became_peered":"2024-09-21T06:07:52.965969+0000","last_unstale":"2024-09-21T06:07:54.017425+0000","last_undegraded":"2024-09-21T06:07:54.017425+0000","last_fullsized":"2024-09-21T06:07:54.017425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:24.381592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983076+0000","last_change":"2024-09-21T06:07:51.954442+0000","last_active":"2024-09-21T06:07:52.983076+0000","last_peered":"2024-09-21T06:07:52.983076+0000","last_clean":"2024-09-21T06:07:52.983076+0000","last_became_active":"2024-09-21T06:07:51.951514+0000","last_became_peered":"2024-09-21T06:07:51.951514+0000","last_unstale":"2024-09-21T06:07:52.983076+0000","last_undegraded":"2024-09-21T06:07:52.983076+0000","last_fullsized":"2024-09-21T06:07:52.983076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:52.521048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983713+0000","last_change":"2024-09-21T06:07:52.983519+0000","last_active":"2024-09-21T06:07:52.983713+0000","last_peered":"2024-09-21T06:07:52.983713+0000","last_clean":"2024-09-21T06:07:52.983713+0000","last_became_active":"2024-09-21T06:07:52.983172+0000","last_became_peered":"2024-09-21T06:07:52.983172+0000","last_unstale":"2024-09-21T06:07:52.983713+0000","last_undegraded":"2024-09-21T06:07:52.983713+0000","last_fullsized":"2024-09-21T06:07:52.983713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:41.992494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017597+0000","last_change":"2024-09-21T06:07:51.953969+0000","last_active":"2024-09-21T06:07:54.017597+0000","last_peered":"2024-09-21T06:07:54.017597+0000","last_clean":"2024-09-21T06:07:54.017597+0000","last_became_active":"2024-09-21T06:07:51.953310+0000","last_became_peered":"2024-09-21T06:07:51.953310+0000","last_unstale":"2024-09-21T06:07:54.017597+0000","last_undegraded":"2024-09-21T06:07:54.017597+0000","last_fullsized":"2024-09-21T06:07:54.017597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:12.246981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983623+0000","last_change":"2024-09-21T06:07:52.973269+0000","last_active":"2024-09-21T06:07:53.983623+0000","last_peered":"2024-09-21T06:07:53.983623+0000","last_clean":"2024-09-21T06:07:53.983623+0000","last_became_active":"2024-09-21T06:07:52.972744+0000","last_became_peered":"2024-09-21T06:07:52.972744+0000","last_unstale":"2024-09-21T06:07:53.983623+0000","last_undegraded":"2024-09-21T06:07:53.983623+0000","last_fullsized":"2024-09-21T06:07:53.983623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:38.102428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.989625+0000","last_change":"2024-09-21T06:07:51.950054+0000","last_active":"2024-09-21T06:07:52.989625+0000","last_peered":"2024-09-21T06:07:52.989625+0000","last_clean":"2024-09-21T06:07:52.989625+0000","last_became_active":"2024-09-21T06:07:51.949606+0000","last_became_peered":"2024-09-21T06:07:51.949606+0000","last_unstale":"2024-09-21T06:07:52.989625+0000","last_undegraded":"2024-09-21T06:07:52.989625+0000","last_fullsized":"2024-09-21T06:07:52.989625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:07.505421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.976268+0000","last_change":"2024-09-21T06:07:52.975743+0000","last_active":"2024-09-21T06:07:52.976268+0000","last_peered":"2024-09-21T06:07:52.976268+0000","last_clean":"2024-09-21T06:07:52.976268+0000","last_became_active":"2024-09-21T06:07:52.975010+0000","last_became_peered":"2024-09-21T06:07:52.975010+0000","last_unstale":"2024-09-21T06:07:52.976268+0000","last_undegraded":"2024-09-21T06:07:52.976268+0000","last_fullsized":"2024-09-21T06:07:52.976268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:40.510521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968839+0000","last_change":"2024-09-21T06:07:51.956974+0000","last_active":"2024-09-21T06:07:52.968839+0000","last_peered":"2024-09-21T06:07:52.968839+0000","last_clean":"2024-09-21T06:07:52.968839+0000","last_became_active":"2024-09-21T06:07:51.956312+0000","last_became_peered":"2024-09-21T06:07:51.956312+0000","last_unstale":"2024-09-21T06:07:52.968839+0000","last_undegraded":"2024-09-21T06:07:52.968839+0000","last_fullsized":"2024-09-21T06:07:52.968839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:26.549967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980190+0000","last_change":"2024-09-21T06:07:52.968124+0000","last_active":"2024-09-21T06:07:53.980190+0000","last_peered":"2024-09-21T06:07:53.980190+0000","last_clean":"2024-09-21T06:07:53.980190+0000","last_became_active":"2024-09-21T06:07:52.967337+0000","last_became_peered":"2024-09-21T06:07:52.967337+0000","last_unstale":"2024-09-21T06:07:53.980190+0000","last_undegraded":"2024-09-21T06:07:53.980190+0000","last_fullsized":"2024-09-21T06:07:53.980190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:46.827943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.966287+0000","last_change":"2024-09-21T06:07:51.955119+0000","last_active":"2024-09-21T06:07:52.966287+0000","last_peered":"2024-09-21T06:07:52.966287+0000","last_clean":"2024-09-21T06:07:52.966287+0000","last_became_active":"2024-09-21T06:07:51.952748+0000","last_became_peered":"2024-09-21T06:07:51.952748+0000","last_unstale":"2024-09-21T06:07:52.966287+0000","last_undegraded":"2024-09-21T06:07:52.966287+0000","last_fullsized":"2024-09-21T06:07:52.966287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:18.711754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980292+0000","last_change":"2024-09-21T06:07:52.980274+0000","last_active":"2024-09-21T06:07:53.980292+0000","last_peered":"2024-09-21T06:07:53.980292+0000","last_clean":"2024-09-21T06:07:53.980292+0000","last_became_active":"2024-09-21T06:07:52.979875+0000","last_became_peered":"2024-09-21T06:07:52.979875+0000","last_unstale":"2024-09-21T06:07:53.980292+0000","last_undegraded":"2024-09-21T06:07:53.980292+0000","last_fullsized":"2024-09-21T06:07:53.980292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:57.426831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968950+0000","last_change":"2024-09-21T06:07:51.957576+0000","last_active":"2024-09-21T06:07:52.968950+0000","last_peered":"2024-09-21T06:07:52.968950+0000","last_clean":"2024-09-21T06:07:52.968950+0000","last_became_active":"2024-09-21T06:07:51.956909+0000","last_became_peered":"2024-09-21T06:07:51.956909+0000","last_unstale":"2024-09-21T06:07:52.968950+0000","last_undegraded":"2024-09-21T06:07:52.968950+0000","last_fullsized":"2024-09-21T06:07:52.968950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:33.456224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980343+0000","last_change":"2024-09-21T06:07:52.972620+0000","last_active":"2024-09-21T06:07:53.980343+0000","last_peered":"2024-09-21T06:07:53.980343+0000","last_clean":"2024-09-21T06:07:53.980343+0000","last_became_active":"2024-09-21T06:07:52.972342+0000","last_became_peered":"2024-09-21T06:07:52.972342+0000","last_unstale":"2024-09-21T06:07:53.980343+0000","last_undegraded":"2024-09-21T06:07:53.980343+0000","last_fullsized":"2024-09-21T06:07:53.980343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:50.296717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982379+0000","last_change":"2024-09-21T06:07:51.950466+0000","last_active":"2024-09-21T06:07:53.982379+0000","last_peered":"2024-09-21T06:07:53.982379+0000","last_clean":"2024-09-21T06:07:53.982379+0000","last_became_active":"2024-09-21T06:07:51.950177+0000","last_became_peered":"2024-09-21T06:07:51.950177+0000","last_unstale":"2024-09-21T06:07:53.982379+0000","last_undegraded":"2024-09-21T06:07:53.982379+0000","last_fullsized":"2024-09-21T06:07:53.982379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:52.944267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983070+0000","last_change":"2024-09-21T06:07:52.973529+0000","last_active":"2024-09-21T06:07:53.983070+0000","last_peered":"2024-09-21T06:07:53.983070+0000","last_clean":"2024-09-21T06:07:53.983070+0000","last_became_active":"2024-09-21T06:07:52.970226+0000","last_became_peered":"2024-09-21T06:07:52.970226+0000","last_unstale":"2024-09-21T06:07:53.983070+0000","last_undegraded":"2024-09-21T06:07:53.983070+0000","last_fullsized":"2024-09-21T06:07:53.983070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:29.139100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988012+0000","last_change":"2024-09-21T06:07:51.951387+0000","last_active":"2024-09-21T06:07:52.988012+0000","last_peered":"2024-09-21T06:07:52.988012+0000","last_clean":"2024-09-21T06:07:52.988012+0000","last_became_active":"2024-09-21T06:07:51.950908+0000","last_became_peered":"2024-09-21T06:07:51.950908+0000","last_unstale":"2024-09-21T06:07:52.988012+0000","last_undegraded":"2024-09-21T06:07:52.988012+0000","last_fullsized":"2024-09-21T06:07:52.988012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:17.841269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.978936+0000","last_change":"2024-09-21T06:07:52.978507+0000","last_active":"2024-09-21T06:07:52.978936+0000","last_peered":"2024-09-21T06:07:52.978936+0000","last_clean":"2024-09-21T06:07:52.978936+0000","last_became_active":"2024-09-21T06:07:52.978190+0000","last_became_peered":"2024-09-21T06:07:52.978190+0000","last_unstale":"2024-09-21T06:07:52.978936+0000","last_undegraded":"2024-09-21T06:07:52.978936+0000","last_fullsized":"2024-09-21T06:07:52.978936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:49.979534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.967833+0000","last_change":"2024-09-21T06:07:51.957101+0000","last_active":"2024-09-21T06:07:52.967833+0000","last_peered":"2024-09-21T06:07:52.967833+0000","last_clean":"2024-09-21T06:07:52.967833+0000","last_became_active":"2024-09-21T06:07:51.956777+0000","last_became_peered":"2024-09-21T06:07:51.956777+0000","last_unstale":"2024-09-21T06:07:52.967833+0000","last_undegraded":"2024-09-21T06:07:52.967833+0000","last_fullsized":"2024-09-21T06:07:52.967833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:50.668497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.983442+0000","last_change":"2024-09-21T06:07:52.981081+0000","last_active":"2024-09-21T06:07:52.983442+0000","last_peered":"2024-09-21T06:07:52.983442+0000","last_clean":"2024-09-21T06:07:52.983442+0000","last_became_active":"2024-09-21T06:07:52.979397+0000","last_became_peered":"2024-09-21T06:07:52.979397+0000","last_unstale":"2024-09-21T06:07:52.983442+0000","last_undegraded":"2024-09-21T06:07:52.983442+0000","last_fullsized":"2024-09-21T06:07:52.983442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:05.330037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.968657+0000","last_change":"2024-09-21T06:07:51.953659+0000","last_active":"2024-09-21T06:07:52.968657+0000","last_peered":"2024-09-21T06:07:52.968657+0000","last_clean":"2024-09-21T06:07:52.968657+0000","last_became_active":"2024-09-21T06:07:51.953393+0000","last_became_peered":"2024-09-21T06:07:51.953393+0000","last_unstale":"2024-09-21T06:07:52.968657+0000","last_undegraded":"2024-09-21T06:07:52.968657+0000","last_fullsized":"2024-09-21T06:07:52.968657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:05.894429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.990279+0000","last_change":"2024-09-21T06:07:52.989711+0000","last_active":"2024-09-21T06:07:52.990279+0000","last_peered":"2024-09-21T06:07:52.990279+0000","last_clean":"2024-09-21T06:07:52.990279+0000","last_became_active":"2024-09-21T06:07:52.988668+0000","last_became_peered":"2024-09-21T06:07:52.988668+0000","last_unstale":"2024-09-21T06:07:52.990279+0000","last_undegraded":"2024-09-21T06:07:52.990279+0000","last_fullsized":"2024-09-21T06:07:52.990279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:33.878767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.982997+0000","last_change":"2024-09-21T06:07:51.947928+0000","last_active":"2024-09-21T06:07:53.982997+0000","last_peered":"2024-09-21T06:07:53.982997+0000","last_clean":"2024-09-21T06:07:53.982997+0000","last_became_active":"2024-09-21T06:07:51.947659+0000","last_became_peered":"2024-09-21T06:07:51.947659+0000","last_unstale":"2024-09-21T06:07:53.982997+0000","last_undegraded":"2024-09-21T06:07:53.982997+0000","last_fullsized":"2024-09-21T06:07:53.982997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:36.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.986317+0000","last_change":"2024-09-21T06:07:52.986126+0000","last_active":"2024-09-21T06:07:52.986317+0000","last_peered":"2024-09-21T06:07:52.986317+0000","last_clean":"2024-09-21T06:07:52.986317+0000","last_became_active":"2024-09-21T06:07:52.984866+0000","last_became_peered":"2024-09-21T06:07:52.984866+0000","last_unstale":"2024-09-21T06:07:52.986317+0000","last_undegraded":"2024-09-21T06:07:52.986317+0000","last_fullsized":"2024-09-21T06:07:52.986317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:46.302864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.969634+0000","last_change":"2024-09-21T06:07:51.957375+0000","last_active":"2024-09-21T06:07:52.969634+0000","last_peered":"2024-09-21T06:07:52.969634+0000","last_clean":"2024-09-21T06:07:52.969634+0000","last_became_active":"2024-09-21T06:07:51.957091+0000","last_became_peered":"2024-09-21T06:07:51.957091+0000","last_unstale":"2024-09-21T06:07:52.969634+0000","last_undegraded":"2024-09-21T06:07:52.969634+0000","last_fullsized":"2024-09-21T06:07:52.969634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:14.971094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.988292+0000","last_change":"2024-09-21T06:07:52.988022+0000","last_active":"2024-09-21T06:07:52.988292+0000","last_peered":"2024-09-21T06:07:52.988292+0000","last_clean":"2024-09-21T06:07:52.988292+0000","last_became_active":"2024-09-21T06:07:52.985087+0000","last_became_peered":"2024-09-21T06:07:52.985087+0000","last_unstale":"2024-09-21T06:07:52.988292+0000","last_undegraded":"2024-09-21T06:07:52.988292+0000","last_fullsized":"2024-09-21T06:07:52.988292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:43.939431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983687+0000","last_change":"2024-09-21T06:07:51.945686+0000","last_active":"2024-09-21T06:07:53.983687+0000","last_peered":"2024-09-21T06:07:53.983687+0000","last_clean":"2024-09-21T06:07:53.983687+0000","last_became_active":"2024-09-21T06:07:51.945411+0000","last_became_peered":"2024-09-21T06:07:51.945411+0000","last_unstale":"2024-09-21T06:07:53.983687+0000","last_undegraded":"2024-09-21T06:07:53.983687+0000","last_fullsized":"2024-09-21T06:07:53.983687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:56.234917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.983217+0000","last_change":"2024-09-21T06:07:52.976898+0000","last_active":"2024-09-21T06:07:53.983217+0000","last_peered":"2024-09-21T06:07:53.983217+0000","last_clean":"2024-09-21T06:07:53.983217+0000","last_became_active":"2024-09-21T06:07:52.975776+0000","last_became_peered":"2024-09-21T06:07:52.975776+0000","last_unstale":"2024-09-21T06:07:53.983217+0000","last_undegraded":"2024-09-21T06:07:53.983217+0000","last_fullsized":"2024-09-21T06:07:53.983217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:32.631007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:54.017193+0000","last_change":"2024-09-21T06:07:51.956017+0000","last_active":"2024-09-21T06:07:54.017193+0000","last_peered":"2024-09-21T06:07:54.017193+0000","last_clean":"2024-09-21T06:07:54.017193+0000","last_became_active":"2024-09-21T06:07:51.954297+0000","last_became_peered":"2024-09-21T06:07:51.954297+0000","last_unstale":"2024-09-21T06:07:54.017193+0000","last_undegraded":"2024-09-21T06:07:54.017193+0000","last_fullsized":"2024-09-21T06:07:54.017193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:51.266233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.984107+0000","last_change":"2024-09-21T06:07:52.981709+0000","last_active":"2024-09-21T06:07:52.984107+0000","last_peered":"2024-09-21T06:07:52.984107+0000","last_clean":"2024-09-21T06:07:52.984107+0000","last_became_active":"2024-09-21T06:07:52.980673+0000","last_became_peered":"2024-09-21T06:07:52.980673+0000","last_unstale":"2024-09-21T06:07:52.984107+0000","last_undegraded":"2024-09-21T06:07:52.984107+0000","last_fullsized":"2024-09-21T06:07:52.984107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:37.278827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.966804+0000","last_change":"2024-09-21T06:07:51.955577+0000","last_active":"2024-09-21T06:07:52.966804+0000","last_peered":"2024-09-21T06:07:52.966804+0000","last_clean":"2024-09-21T06:07:52.966804+0000","last_became_active":"2024-09-21T06:07:51.953965+0000","last_became_peered":"2024-09-21T06:07:51.953965+0000","last_unstale":"2024-09-21T06:07:52.966804+0000","last_undegraded":"2024-09-21T06:07:52.966804+0000","last_fullsized":"2024-09-21T06:07:52.966804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:15.502095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T06:07:53.980404+0000","last_change":"2024-09-21T06:07:52.973417+0000","last_active":"2024-09-21T06:07:53.980404+0000","last_peered":"2024-09-21T06:07:53.980404+0000","last_clean":"2024-09-21T06:07:53.980404+0000","last_became_active":"2024-09-21T06:07:52.973166+0000","last_became_peered":"2024-09-21T06:07:52.973166+0000","last_unstale":"2024-09-21T06:07:53.980404+0000","last_undegraded":"2024-09-21T06:07:53.980404+0000","last_fullsized":"2024-09-21T06:07:53.980404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:51.933526+0000","last_clean_scrub_stamp":"2024-09-21T06:07:51.933526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:41.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.981013+0000","last_change":"2024-09-21T06:07:51.952754+0000","last_active":"2024-09-21T06:07:52.981013+0000","last_peered":"2024-09-21T06:07:52.981013+0000","last_clean":"2024-09-21T06:07:52.981013+0000","last_became_active":"2024-09-21T06:07:51.952486+0000","last_became_peered":"2024-09-21T06:07:51.952486+0000","last_unstale":"2024-09-21T06:07:52.981013+0000","last_undegraded":"2024-09-21T06:07:52.981013+0000","last_fullsized":"2024-09-21T06:07:52.981013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:07:50.926209+0000","last_clean_scrub_stamp":"2024-09-21T06:07:50.926209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:46.858630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":235,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T06:07:52.979364+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:07:52.979364+0000","last_peered":"2024-09-21T06:07:52.979364+0000","last_clean":"2024-09-21T06:07:52.979364+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:07:52.979364+0000","last_undegraded":"2024-09-21T06:07:52.979364+0000","last_fullsized":"2024-09-21T06:07:52.979364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:25.067726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":420,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194891,"statfs":{"total":200000000,"available":199569269,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198979013,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":991,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194320,"statfs":{"total":200000000,"available":198984697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199575589,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199575591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199575611,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":415,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194896,"statfs":{"total":200000000,"available":199574069,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":416,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194895,"statfs":{"total":200000000,"available":199573453,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:07:57.909 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:07:57.909 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:07:58.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.172+0000 7f5a8bc00640 1 -- 172.21.15.118:0/2258461645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a8413fd80 msgr2=0x7f5a8415dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.172+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/2258461645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a8413fd80 0x7f5a8415dc40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009830 tx=0x7f5a7402a510 comp rx=0 tx=0).stop 2024-09-21T06:07:58.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.173+0000 7f5a8bc00640 1 -- 172.21.15.118:0/2258461645 shutdown_connections 2024-09-21T06:07:58.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.173+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/2258461645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a840cf170 0x7f5a840cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.173+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/2258461645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a8413fd80 0x7f5a8415dc40 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.173+0000 7f5a8bc00640 1 -- 172.21.15.118:0/2258461645 >> 172.21.15.118:0/2258461645 conn(0x7f5a8406d110 msgr2=0x7f5a8406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:58.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.173+0000 7f5a8bc00640 1 -- 172.21.15.118:0/2258461645 shutdown_connections 2024-09-21T06:07:58.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.173+0000 7f5a8bc00640 1 -- 172.21.15.118:0/2258461645 wait complete. 2024-09-21T06:07:58.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.175+0000 7f5a8bc00640 1 Processor -- start 2024-09-21T06:07:58.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.175+0000 7f5a8bc00640 1 -- start start 2024-09-21T06:07:58.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.176+0000 7f5a8bc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a840cf170 0x7f5a84153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.176+0000 7f5a8bc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a840d0ea0 0x7f5a84155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.176+0000 7f5a8bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8413fd80 0x7f5a84155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.176+0000 7f5a8bc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5a840cfac0 con 0x7f5a840d0ea0 2024-09-21T06:07:58.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.176+0000 7f5a8bc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8415d890 con 0x7f5a840cf170 2024-09-21T06:07:58.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.176+0000 7f5a8bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a840cfc40 con 0x7f5a8413fd80 2024-09-21T06:07:58.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a840d0ea0 0x7f5a84155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a840d0ea0 0x7f5a84155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48050/0 (socket says 172.21.15.118:48050) 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 -- 172.21.15.118:0/1387516025 learned_addr learned my addr 172.21.15.118:0/1387516025 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a89200640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a840cf170 0x7f5a84153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a89c00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8413fd80 0x7f5a84155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 -- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8413fd80 msgr2=0x7f5a84155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8413fd80 0x7f5a84155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 -- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a840cf170 msgr2=0x7f5a84153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a840cf170 0x7f5a84153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 -- 172.21.15.118:0/1387516025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a84153740 con 0x7f5a840d0ea0 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a89c00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8413fd80 0x7f5a84155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.177+0000 7f5a7be00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a840d0ea0 0x7f5a84155220 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c430 tx=0x7f5a6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.178+0000 7f5a81600640 1 -- 172.21.15.118:0/1387516025 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011790 con 0x7f5a840d0ea0 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.178+0000 7f5a81600640 1 -- 172.21.15.118:0/1387516025 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a6c017070 con 0x7f5a840d0ea0 2024-09-21T06:07:58.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.178+0000 7f5a81600640 1 -- 172.21.15.118:0/1387516025 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011ce0 con 0x7f5a840d0ea0 2024-09-21T06:07:58.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.178+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a84143160 con 0x7f5a840d0ea0 2024-09-21T06:07:58.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.178+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a84154a20 con 0x7f5a840d0ea0 2024-09-21T06:07:58.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.179+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a840d00f0 con 0x7f5a840d0ea0 2024-09-21T06:07:58.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.180+0000 7f5a81600640 1 -- 172.21.15.118:0/1387516025 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a6c01c460 con 0x7f5a840d0ea0 2024-09-21T06:07:58.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.181+0000 7f5a81600640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a60078b90 0x7f5a6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.181+0000 7f5a81600640 1 -- 172.21.15.118:0/1387516025 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5a6c09aac0 con 0x7f5a840d0ea0 2024-09-21T06:07:58.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.182+0000 7f5a89200640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a60078b90 0x7f5a6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.182+0000 7f5a89200640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a60078b90 0x7f5a6007b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5a74034000 tx=0x7f5a74004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:58.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.186+0000 7f5a81600640 1 -- 172.21.15.118:0/1387516025 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5a84153740 con 0x7f5a840d0ea0 2024-09-21T06:07:58.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.439+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5a840b5b20 con 0x7f5a840d0ea0 2024-09-21T06:07:58.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.442+0000 7f5a81600640 1 -- 172.21.15.118:0/1387516025 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f5a6c062ef0 con 0x7f5a840d0ea0 2024-09-21T06:07:58.445 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:07:58.445 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:07:58.445 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:07:58.445 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:07:58.445 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:07:58.445 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a60078b90 msgr2=0x7f5a6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a60078b90 0x7f5a6007b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5a74034000 tx=0x7f5a74004730 comp rx=0 tx=0).stop 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a840d0ea0 msgr2=0x7f5a84155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a840d0ea0 0x7f5a84155220 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c430 tx=0x7f5a6c00c8f0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 shutdown_connections 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a60078b90 0x7f5a6007b0a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a8413fd80 0x7f5a84155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a840d0ea0 0x7f5a84155220 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 --2- 172.21.15.118:0/1387516025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a840cf170 0x7f5a84153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 >> 172.21.15.118:0/1387516025 conn(0x7f5a8406d110 msgr2=0x7f5a8415cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:58.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 shutdown_connections 2024-09-21T06:07:58.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.446+0000 7f5a8bc00640 1 -- 172.21.15.118:0/1387516025 wait complete. 2024-09-21T06:07:58.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:07:58.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.690+0000 7fd0d9e00640 1 -- 172.21.15.118:0/925421273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d415cfd0 msgr2=0x7fd0d40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.690+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/925421273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d415cfd0 0x7fd0d40b3a60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009830 tx=0x7fd0c402a480 comp rx=0 tx=0).stop 2024-09-21T06:07:58.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.690+0000 7fd0d9e00640 1 -- 172.21.15.118:0/925421273 shutdown_connections 2024-09-21T06:07:58.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.690+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/925421273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d415cfd0 0x7fd0d40b3a60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.690+0000 7fd0d9e00640 1 -- 172.21.15.118:0/925421273 >> 172.21.15.118:0/925421273 conn(0x7fd0d406d110 msgr2=0x7fd0d406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:58.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.690+0000 7fd0d9e00640 1 -- 172.21.15.118:0/925421273 shutdown_connections 2024-09-21T06:07:58.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.690+0000 7fd0d9e00640 1 -- 172.21.15.118:0/925421273 wait complete. 2024-09-21T06:07:58.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.693+0000 7fd0d9e00640 1 Processor -- start 2024-09-21T06:07:58.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.693+0000 7fd0d9e00640 1 -- start start 2024-09-21T06:07:58.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.694+0000 7fd0d9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d40b5040 0x7fd0d4135fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.694+0000 7fd0d9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0d40b5450 0x7fd0d40cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.694+0000 7fd0d9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0d415cfd0 0x7fd0d40c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.694+0000 7fd0d9e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4073e40 con 0x7fd0d40b5040 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.694+0000 7fd0d9e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4073cc0 con 0x7fd0d40b5450 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.694+0000 7fd0d9e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d4073fc0 con 0x7fd0d415cfd0 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d40b5040 0x7fd0d4135fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d40b5040 0x7fd0d4135fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48074/0 (socket says 172.21.15.118:48074) 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 -- 172.21.15.118:0/3473921756 learned_addr learned my addr 172.21.15.118:0/3473921756 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d3400640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0d415cfd0 0x7fd0d40c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2000640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0d40b5450 0x7fd0d40cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 -- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0d415cfd0 msgr2=0x7fd0d40c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0d415cfd0 0x7fd0d40c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 -- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0d40b5450 msgr2=0x7fd0d40cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0d40b5450 0x7fd0d40cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 -- 172.21.15.118:0/3473921756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d40c6ac0 con 0x7fd0d40b5040 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.695+0000 7fd0d2a00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d40b5040 0x7fd0d4135fd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd0c402aa70 tx=0x7fd0c4033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:58.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.696+0000 7fd0cb400640 1 -- 172.21.15.118:0/3473921756 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4031d60 con 0x7fd0d40b5040 2024-09-21T06:07:58.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.696+0000 7fd0cb400640 1 -- 172.21.15.118:0/3473921756 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0c4005020 con 0x7fd0d40b5040 2024-09-21T06:07:58.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.696+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d40c6da0 con 0x7fd0d40b5040 2024-09-21T06:07:58.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.696+0000 7fd0cb400640 1 -- 172.21.15.118:0/3473921756 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4005470 con 0x7fd0d40b5040 2024-09-21T06:07:58.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.696+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d40c7360 con 0x7fd0d40b5040 2024-09-21T06:07:58.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.697+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d40744e0 con 0x7fd0d40b5040 2024-09-21T06:07:58.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.698+0000 7fd0cb400640 1 -- 172.21.15.118:0/3473921756 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0c40047a0 con 0x7fd0d40b5040 2024-09-21T06:07:58.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.699+0000 7fd0cb400640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd0b4078b90 0x7fd0b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:58.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.699+0000 7fd0cb400640 1 -- 172.21.15.118:0/3473921756 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fd0c40bbfe0 con 0x7fd0d40b5040 2024-09-21T06:07:58.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.700+0000 7fd0d2000640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd0b4078b90 0x7fd0b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:58.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.700+0000 7fd0d2000640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd0b4078b90 0x7fd0b407b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40c8730 tx=0x7fd0c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:58.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.703+0000 7fd0cb400640 1 -- 172.21.15.118:0/3473921756 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd0c403f030 con 0x7fd0d40b5040 2024-09-21T06:07:58.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.925+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0d406dd00 con 0x7fd0d40b5040 2024-09-21T06:07:58.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.926+0000 7fd0cb400640 1 -- 172.21.15.118:0/3473921756 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7fd0c4084420 con 0x7fd0d40b5040 2024-09-21T06:07:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:07:58.928 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"btime":"2024-09-21T06:07:55:995571+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:07:52.440795+0000","modified":"2024-09-21T06:07:55.500401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5928},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5928":{"gid":5928,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/186206042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":186206042},{"type":"v1","addr":"172.21.15.118:6835","nonce":186206042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5928,"qdb_cluster":[5928]},"id":5}]} 2024-09-21T06:07:58.929 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 43 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd0b4078b90 msgr2=0x7fd0b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd0b4078b90 0x7fd0b407b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40c8730 tx=0x7fd0c0009040 comp rx=0 tx=0).stop 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d40b5040 msgr2=0x7fd0d4135fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d40b5040 0x7fd0d4135fd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd0c402aa70 tx=0x7fd0c4033ce0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 shutdown_connections 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd0b4078b90 0x7fd0b407b0a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0d415cfd0 0x7fd0d40c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0d40b5450 0x7fd0d40cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 --2- 172.21.15.118:0/3473921756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d40b5040 0x7fd0d4135fd0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:58.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 >> 172.21.15.118:0/3473921756 conn(0x7fd0d406d110 msgr2=0x7fd0d40d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:58.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 shutdown_connections 2024-09-21T06:07:58.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:58.928+0000 7fd0d9e00640 1 -- 172.21.15.118:0/3473921756 wait complete. 2024-09-21T06:07:59.357 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:07:52.440795+0000', 'modified': '2024-09-21T06:07:55.500401+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5928}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5928': {'gid': 5928, 'name': 'c', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/186206042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 186206042}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 186206042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5928, 'qdb_cluster': [5928]} 2024-09-21T06:07:59.358 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:07:59.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:07:59.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.577+0000 7f5317200640 1 -- 172.21.15.118:0/2273456608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5318163900 msgr2=0x7f531815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.577+0000 7f5317200640 1 --2- 172.21.15.118:0/2273456608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5318163900 0x7f531815f660 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5300009830 tx=0x7f530002a5c0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.577+0000 7f5317200640 1 -- 172.21.15.118:0/2273456608 shutdown_connections 2024-09-21T06:07:59.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.577+0000 7f5317200640 1 --2- 172.21.15.118:0/2273456608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5318163900 0x7f531815f660 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.577+0000 7f5317200640 1 -- 172.21.15.118:0/2273456608 >> 172.21.15.118:0/2273456608 conn(0x7f531806d1c0 msgr2=0x7f531806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:59.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.577+0000 7f5317200640 1 -- 172.21.15.118:0/2273456608 shutdown_connections 2024-09-21T06:07:59.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.577+0000 7f5317200640 1 -- 172.21.15.118:0/2273456608 wait complete. 2024-09-21T06:07:59.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.579+0000 7f5317200640 1 Processor -- start 2024-09-21T06:07:59.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.579+0000 7f5317200640 1 -- start start 2024-09-21T06:07:59.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5317200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f531815fba0 0x7f53180ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5317200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181634f0 0x7f531814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5317200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5318163900 0x7f5318161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5317200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f53180d3cb0 con 0x7f53181634f0 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5317200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53180d3b30 con 0x7f5318163900 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5317200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f53180d3e30 con 0x7f531815fba0 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f530d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181634f0 0x7f531814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f530d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181634f0 0x7f531814b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48086/0 (socket says 172.21.15.118:48086) 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f530d400640 1 -- 172.21.15.118:0/3162403343 learned_addr learned my addr 172.21.15.118:0/3162403343 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5316800640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5318163900 0x7f5318161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.581+0000 7f5315e00640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f531815fba0 0x7f53180ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530d400640 1 -- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f531815fba0 msgr2=0x7f53180ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530d400640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f531815fba0 0x7f53180ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530d400640 1 -- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5318163900 msgr2=0x7f5318161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530d400640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5318163900 0x7f5318161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530d400640 1 -- 172.21.15.118:0/3162403343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53181fa810 con 0x7f53181634f0 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f5315e00640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f531815fba0 0x7f53180ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530d400640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181634f0 0x7f531814b190 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5300009950 tx=0x7f5300033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530ea00640 1 -- 172.21.15.118:0/3162403343 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300031b50 con 0x7f53181634f0 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530ea00640 1 -- 172.21.15.118:0/3162403343 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5300031de0 con 0x7f53181634f0 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f530ea00640 1 -- 172.21.15.118:0/3162403343 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300005280 con 0x7f53181634f0 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53180cec00 con 0x7f53181634f0 2024-09-21T06:07:59.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.582+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53181f9ee0 con 0x7f53181634f0 2024-09-21T06:07:59.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.585+0000 7f530ea00640 1 -- 172.21.15.118:0/3162403343 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5300005420 con 0x7f53181634f0 2024-09-21T06:07:59.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.586+0000 7f530ea00640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f52f4078b90 0x7f52f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.586+0000 7f530ea00640 1 -- 172.21.15.118:0/3162403343 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f53000bbee0 con 0x7f53181634f0 2024-09-21T06:07:59.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.586+0000 7f5315e00640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f52f4078b90 0x7f52f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.586+0000 7f53240ac740 1 Processor -- start 2024-09-21T06:07:59.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.586+0000 7f53240ac740 1 -- start start 2024-09-21T06:07:59.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.587+0000 7f5315e00640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f52f4078b90 0x7f52f407b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f53080012e0 tx=0x7f5308009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decdeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8e53b0 0x5616decdf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f53240ac740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8ed590 0x5616decaf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f53240ac740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5616dec38430 con 0x5616de8ed590 2024-09-21T06:07:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5616dec285d0 con 0x5616de8e53b0 2024-09-21T06:07:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5616dec17a00 con 0x5616de90e270 2024-09-21T06:07:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f5316800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8ed590 0x5616decaf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f5316800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8ed590 0x5616decaf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48102/0 (socket says 172.21.15.118:48102) 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f5316800640 1 -- 172.21.15.118:0/3578385200 learned_addr learned my addr 172.21.15.118:0/3578385200 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f5315e00640 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decdeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.588+0000 7f530d400640 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8e53b0 0x5616decdf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5316800640 1 -- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 msgr2=0x5616decdeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5316800640 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decdeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5316800640 1 -- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8e53b0 msgr2=0x5616decdf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5316800640 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8e53b0 0x5616decdf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5316800640 1 -- 172.21.15.118:0/3578385200 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616debe0520 con 0x5616de8ed590 2024-09-21T06:07:59.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5316800640 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8ed590 0x5616decaf150 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5310001810 tx=0x7f5310001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533d1284d022c56d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5306a00640 1 -- 172.21.15.118:0/3578385200 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310018020 con 0x5616de8ed590 2024-09-21T06:07:59.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5306a00640 1 -- 172.21.15.118:0/3578385200 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f531000fb70 con 0x5616de8ed590 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.589+0000 7f5306a00640 1 -- 172.21.15.118:0/3578385200 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310014470 con 0x5616de8ed590 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 -- 172.21.15.118:0/3578385200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8ed590 msgr2=0x5616decaf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8ed590 0x5616decaf150 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5310001810 tx=0x7f5310001cd0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 -- 172.21.15.118:0/3578385200 shutdown_connections 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8ed590 0x5616decaf150 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8e53b0 0x5616decdf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 --2- 172.21.15.118:0/3578385200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decdeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 -- 172.21.15.118:0/3578385200 >> 172.21.15.118:0/3578385200 conn(0x5616de9023c0 msgr2=0x5616decb4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 -- 172.21.15.118:0/3578385200 shutdown_connections 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.590+0000 7f53240ac740 1 -- 172.21.15.118:0/3578385200 wait complete. 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.591+0000 7f53240ac740 1 -- start start 2024-09-21T06:07:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.591+0000 7f53240ac740 1 Processor -- start 2024-09-21T06:07:59.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f53240ac740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8ed590 0x5616decf4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de90e270 0x5616decdba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f53240ac740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5616debbe330 con 0x5616de8e53b0 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5616dec1b810 con 0x5616de90e270 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5616de988620 con 0x5616de8ed590 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f53240ac740 10 client.0 _ll_register_callbacks cb 0x5616debc3420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f5315e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f5315e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48118/0 (socket says 172.21.15.118:48118) 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f5315e00640 1 -- 172.21.15.118:0/4212325961 learned_addr learned my addr 172.21.15.118:0/4212325961 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f530d400640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8ed590 0x5616decf4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.593+0000 7f5316800640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de90e270 0x5616decdba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f5315e00640 1 -- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8ed590 msgr2=0x5616decf4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f5315e00640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8ed590 0x5616decf4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f5315e00640 1 -- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de90e270 msgr2=0x5616decdba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f5315e00640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de90e270 0x5616decdba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f5315e00640 1 -- 172.21.15.118:0/4212325961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616de979850 con 0x5616de8e53b0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f5316800640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de90e270 0x5616decdba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f5315e00640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9520 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f530800ebc0 tx=0x7f5308001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca68281ccea58dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f52fb400640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f52fb400640 1 -- 172.21.15.118:0/4212325961 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308028060 con 0x5616de8e53b0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f52fb400640 1 -- 172.21.15.118:0/4212325961 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5308010040 con 0x5616de8e53b0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f531000fb70 con 0x5616de8e53b0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f52fb400640 1 -- 172.21.15.118:0/4212325961 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f5308022450 con 0x5616de8e53b0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.594+0000 7f53240ac740 10 client.6057 fetch_fsmap learned FSMap version 43 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x5616de9f06b0 con 0x5616de8e53b0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f52fb400640 1 -- 172.21.15.118:0/4212325961 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f531000fb70 con 0x5616de8e53b0 2024-09-21T06:07:59.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f52fb400640 1 -- 172.21.15.118:0/4212325961 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7f530802e520 con 0x5616de8e53b0 2024-09-21T06:07:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f53240ac740 10 client.6057 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:07:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f53240ac740 10 client.6057 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:07:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f53240ac740 20 client.6057 populate_metadata read hostname 'smithi118' 2024-09-21T06:07:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f53240ac740 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616de8cce40 0x5616decc59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f53240ac740 4 client.6057 mds_command: new command op to 5928 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:07:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 --> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616dec2a520 con 0x5616de8cce40 2024-09-21T06:07:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.595+0000 7f530d400640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616de8cce40 0x5616decc59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.596+0000 7f530d400640 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616de8cce40 0x5616decc59e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22817456b7f48b32 server_cookie=56c65c291680fe75 in_seq=0 out_seq=0 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.596+0000 7f52fb400640 10 client.6057 ms_handle_connect on v2:172.21.15.118:6834/186206042 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f52fb400640 1 -- 172.21.15.118:0/4212325961 <== mds.0 v2:172.21.15.118:6834/186206042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616dec2a520 con 0x5616de8cce40 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f52fb400640 10 client.6057 handle_command_reply: tid=0 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 client.6057 shutdown 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 msgr2=0x5616decd9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9520 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f530800ebc0 tx=0x7f5308001250 comp rx=0 tx=0).stop 2024-09-21T06:07:59.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 shutdown_connections 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616de8cce40 0x5616decc59e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de90e270 0x5616decdba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8ed590 0x5616decf4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 --2- 172.21.15.118:0/4212325961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9520 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f52fb400640 0 client.6057 ms_handle_reset on v2:172.21.15.118:6834/186206042 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 >> 172.21.15.118:0/4212325961 conn(0x5616de9023c0 msgr2=0x5616decfc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 shutdown_connections 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 1 -- 172.21.15.118:0/4212325961 wait complete. 2024-09-21T06:07:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.597+0000 7f53240ac740 20 client.6057 trim_cache size 0 max 16384 2024-09-21T06:07:59.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.616+0000 7f53240ac740 1 Processor -- start 2024-09-21T06:07:59.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.616+0000 7f53240ac740 1 -- start start 2024-09-21T06:07:59.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f53240ac740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616decf4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decf5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f53240ac740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f53180ca6f0 con 0x5616de8e53b0 2024-09-21T06:07:59.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53180c9620 con 0x5616de8ed590 2024-09-21T06:07:59.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f53180ca0a0 con 0x5616de90e270 2024-09-21T06:07:59.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48122/0 (socket says 172.21.15.118:48122) 2024-09-21T06:07:59.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 -- 172.21.15.118:0/4047242405 learned_addr learned my addr 172.21.15.118:0/4047242405 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:59.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 -- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 msgr2=0x5616decf5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5316800640 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decf5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f530d400640 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616decf4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decf5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 -- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 msgr2=0x5616decf4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616decf4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5315e00640 1 -- 172.21.15.118:0/4047242405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616decf5e60 con 0x5616de8e53b0 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f5316800640 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decf5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.618+0000 7f530d400640 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616decf4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.619+0000 7f5315e00640 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5308001390 tx=0x7f5308003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed20a7d24154be12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.619+0000 7f5306000640 1 -- 172.21.15.118:0/4047242405 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308017020 con 0x5616de8e53b0 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.619+0000 7f5306000640 1 -- 172.21.15.118:0/4047242405 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5308019070 con 0x5616de8e53b0 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.619+0000 7f5306000640 1 -- 172.21.15.118:0/4047242405 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308028020 con 0x5616de8e53b0 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 -- 172.21.15.118:0/4047242405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 msgr2=0x5616decd9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5308001390 tx=0x7f5308003f50 comp rx=0 tx=0).stop 2024-09-21T06:07:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 -- 172.21.15.118:0/4047242405 shutdown_connections 2024-09-21T06:07:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de90e270 0x5616decf5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616decf4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 --2- 172.21.15.118:0/4047242405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de8e53b0 0x5616decd9910 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 -- 172.21.15.118:0/4047242405 >> 172.21.15.118:0/4047242405 conn(0x5616de9023c0 msgr2=0x5616decb0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 -- 172.21.15.118:0/4047242405 shutdown_connections 2024-09-21T06:07:59.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.620+0000 7f53240ac740 1 -- 172.21.15.118:0/4047242405 wait complete. 2024-09-21T06:07:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.621+0000 7f53240ac740 1 -- start start 2024-09-21T06:07:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.621+0000 7f53240ac740 1 Processor -- start 2024-09-21T06:07:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.622+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8e53b0 0x5616ded7d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.622+0000 7f53240ac740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616ded079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.622+0000 7f53240ac740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de90e270 0x5616decfba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.622+0000 7f53240ac740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5616decda910 con 0x5616de90e270 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.622+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5616decdaf80 con 0x5616de8ed590 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.622+0000 7f53240ac740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5616ded0c250 con 0x5616de8e53b0 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.622+0000 7f53240ac740 10 client.0 _ll_register_callbacks cb 0x7f5308003ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de90e270 0x5616decfba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de90e270 0x5616decfba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48132/0 (socket says 172.21.15.118:48132) 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 -- 172.21.15.118:0/733883228 learned_addr learned my addr 172.21.15.118:0/733883228 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5315e00640 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8e53b0 0x5616ded7d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f530d400640 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616ded079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 -- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8e53b0 msgr2=0x5616ded7d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8e53b0 0x5616ded7d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 -- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 msgr2=0x5616ded079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616ded079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 -- 172.21.15.118:0/733883228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616decfa340 con 0x5616de90e270 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f5316800640 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de90e270 0x5616decfba20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5310016000 tx=0x7f5310005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee140a81132f97a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.623+0000 7f52fb400640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f52fb400640 1 -- 172.21.15.118:0/733883228 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310018040 con 0x5616de90e270 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f52fb400640 1 -- 172.21.15.118:0/733883228 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5310004890 con 0x5616de90e270 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5308019070 con 0x5616de90e270 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f52fb400640 1 -- 172.21.15.118:0/733883228 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f531002f050 con 0x5616de90e270 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 10 client.6063 fetch_fsmap learned FSMap version 43 2024-09-21T06:07:59.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x5616decfc6f0 con 0x5616de90e270 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f52fb400640 1 -- 172.21.15.118:0/733883228 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5308019070 con 0x5616de90e270 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f52fb400640 1 -- 172.21.15.118:0/733883228 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7f5310032020 con 0x5616de90e270 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 10 client.6063 fetch_fsmap finished waiting for FSMap version 43 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 10 client.6063 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 20 client.6063 populate_metadata read hostname 'smithi118' 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616decfc140 0x5616ded0acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 4 client.6063 mds_command: new command op to 5928 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 --> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] -- command(tid 0: {"prefix": "status"}) -- 0x5616dec25fd0 con 0x5616decfc140 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.624+0000 7f5315e00640 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616decfc140 0x5616ded0acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.625+0000 7f5315e00640 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616decfc140 0x5616ded0acf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85697ae50a630996 server_cookie=d85f4e5250a449c8 in_seq=0 out_seq=0 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.625+0000 7f52fb400640 10 client.6063 ms_handle_connect on v2:172.21.15.118:6834/186206042 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.625+0000 7f52fb400640 1 -- 172.21.15.118:0/733883228 <== mds.0 v2:172.21.15.118:6834/186206042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5616dec25fd0 con 0x5616decfc140 2024-09-21T06:07:59.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.625+0000 7f52fb400640 10 client.6063 handle_command_reply: tid=0 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.625+0000 7f53240ac740 1 client.6063 shutdown 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.625+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de90e270 msgr2=0x5616decfba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.625+0000 7f53240ac740 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de90e270 0x5616decfba20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5310016000 tx=0x7f5310005630 comp rx=0 tx=0).stop 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 shutdown_connections 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:6834/186206042,v1:172.21.15.118:6835/186206042] conn(0x5616decfc140 0x5616ded0acf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5616de90e270 0x5616decfba20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5616de8ed590 0x5616ded079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f52fb400640 0 client.6063 ms_handle_reset on v2:172.21.15.118:6834/186206042 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 --2- 172.21.15.118:0/733883228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5616de8e53b0 0x5616ded7d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 >> 172.21.15.118:0/733883228 conn(0x5616de9023c0 msgr2=0x5616decf4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 shutdown_connections 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 1 -- 172.21.15.118:0/733883228 wait complete. 2024-09-21T06:07:59.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f53240ac740 20 client.6063 trim_cache size 0 max 16384 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 5928, 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 6.6691918579999996, 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 43, 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 81, 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 81, 2024-09-21T06:07:59.632 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.581698324 2024-09-21T06:07:59.633 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:07:59.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f52f4078b90 msgr2=0x7f52f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f5317200640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f52f4078b90 0x7f52f407b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f53080012e0 tx=0x7f5308009040 comp rx=0 tx=0).stop 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181634f0 msgr2=0x7f531814b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.626+0000 7f5317200640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181634f0 0x7f531814b190 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5300009950 tx=0x7f5300033ba0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 shutdown_connections 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5318163900 0x7f5318161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53181634f0 0x7f531814b190 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f52f4078b90 0x7f52f407b0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 --2- 172.21.15.118:0/3162403343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f531815fba0 0x7f53180ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 >> 172.21.15.118:0/3162403343 conn(0x7f531806d1c0 msgr2=0x7f531815e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 shutdown_connections 2024-09-21T06:07:59.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.627+0000 7f5317200640 1 -- 172.21.15.118:0/3162403343 wait complete. 2024-09-21T06:07:59.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 -- 172.21.15.118:0/3650922840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0d27e0 msgr2=0x7f2dfc15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 --2- 172.21.15.118:0/3650922840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0d27e0 0x7f2dfc15f250 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0d31d0 tx=0x7f2dec02a4b0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 -- 172.21.15.118:0/3650922840 shutdown_connections 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 --2- 172.21.15.118:0/3650922840 >> v2:172.21.15.149:3300/0 conn(0x7f2dfc0b8a80 0x7f2dfc0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 --2- 172.21.15.118:0/3650922840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dfc06cf00 0x7f2dfc0b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 --2- 172.21.15.118:0/3650922840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0d27e0 0x7f2dfc15f250 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 -- 172.21.15.118:0/3650922840 >> 172.21.15.118:0/3650922840 conn(0x7f2dfc0d4c10 msgr2=0x7f2dfc0d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 -- 172.21.15.118:0/3650922840 shutdown_connections 2024-09-21T06:07:59.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.870+0000 7f2e00c00640 1 -- 172.21.15.118:0/3650922840 wait complete. 2024-09-21T06:07:59.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.872+0000 7f2e00c00640 1 Processor -- start 2024-09-21T06:07:59.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.872+0000 7f2e00c00640 1 -- start start 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2e00c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dfc06cf00 0x7f2dfc1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2e00c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0b8a80 0x7f2dfc0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2e00c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dfc0d27e0 0x7f2dfc0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2e00c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc0d3d80 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2e00c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc0d06f0 con 0x7f2dfc06cf00 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2e00c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2dfc0d3f00 con 0x7f2dfc0d27e0 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2dfaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0b8a80 0x7f2dfc0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2dfb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dfc06cf00 0x7f2dfc1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2dfaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0b8a80 0x7f2dfc0b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48152/0 (socket says 172.21.15.118:48152) 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2dfaa00640 1 -- 172.21.15.118:0/582725106 learned_addr learned my addr 172.21.15.118:0/582725106 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.874+0000 7f2dfbe00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dfc0d27e0 0x7f2dfc0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2dfaa00640 1 -- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dfc0d27e0 msgr2=0x7f2dfc0b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2dfaa00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dfc0d27e0 0x7f2dfc0b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2dfaa00640 1 -- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dfc06cf00 msgr2=0x7f2dfc1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2dfaa00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dfc06cf00 0x7f2dfc1f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2dfaa00640 1 -- 172.21.15.118:0/582725106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc0b6000 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2dfaa00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0b8a80 0x7f2dfc0b52b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2de800d5f0 tx=0x7f2de800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2df3400640 1 -- 172.21.15.118:0/582725106 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8017070 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2df3400640 1 -- 172.21.15.118:0/582725106 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2de8005330 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2df3400640 1 -- 172.21.15.118:0/582725106 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80047a0 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.875+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dfc0cbd60 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.876+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dfc0cd8c0 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.877+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc0cfe10 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.878+0000 7f2df3400640 1 -- 172.21.15.118:0/582725106 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2de8004940 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.879+0000 7f2df3400640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:59.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.879+0000 7f2df3400640 1 -- 172.21.15.118:0/582725106 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f2de809acd0 con 0x7f2dfc0b8a80 2024-09-21T06:07:59.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.879+0000 7f2dfb400640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:59.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.880+0000 7f2dfb400640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2dec033000 tx=0x7f2dec004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:59.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:07:59.883+0000 7f2df3400640 1 -- 172.21.15.118:0/582725106 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2de8062ac0 con 0x7f2dfc0b8a80 2024-09-21T06:08:00.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.106+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2dfc0b5d90 con 0x7f2dfc0b8a80 2024-09-21T06:08:00.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.106+0000 7f2df3400640 1 -- 172.21.15.118:0/582725106 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) ==== 53+0+73 (secure 0 0 0) 0x7f2de80674f0 con 0x7f2dfc0b8a80 2024-09-21T06:08:00.109 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:08:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.108+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ddc078b90 msgr2=0x7f2ddc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.108+0000 7f2e00c00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2dec033000 tx=0x7f2dec004730 comp rx=0 tx=0).stop 2024-09-21T06:08:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.108+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0b8a80 msgr2=0x7f2dfc0b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.108+0000 7f2e00c00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0b8a80 0x7f2dfc0b52b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2de800d5f0 tx=0x7f2de800dab0 comp rx=0 tx=0).stop 2024-09-21T06:08:00.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 shutdown_connections 2024-09-21T06:08:00.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:00.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dfc0d27e0 0x7f2dfc0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:00.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dfc0b8a80 0x7f2dfc0b52b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:00.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 --2- 172.21.15.118:0/582725106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dfc06cf00 0x7f2dfc1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:00.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 >> 172.21.15.118:0/582725106 conn(0x7f2dfc0d4c10 msgr2=0x7f2dfc0b9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:00.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 shutdown_connections 2024-09-21T06:08:00.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00.109+0000 7f2e00c00640 1 -- 172.21.15.118:0/582725106 wait complete. 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:08:00.133 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:08:00.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:00.134 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:08:00.169 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:08:00.169 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:08:00.169 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:08:00.169 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:00.169 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42504sec preferred_lft 42504sec 2024-09-21T06:08:00.170 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:08:00.171 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:08:00.172 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:00.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:00.172 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:08:00.263 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:08:00.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:00.266 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:08:00.304 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:08:00.305 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:08:00.305 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:08:00.305 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:08:00.305 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:08:00.305 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:08:00.305 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:08:00.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:08:00.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:08:00.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:08:00.306 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:08:00.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:08:00.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:08:00.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:00.503 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:08:00.537 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:08:00.537 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:08:00.538 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:08:00.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:00.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:08:00.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:08:00.634 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:08:00.669 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:08:00.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:08:00.670 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:08:00.744 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:08:00.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:00.745 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:08:00.939 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:08:00.939 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:08:00.974 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:08:00.975 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:08:00.975 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:08:00.975 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:08:00.975 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:08:00.977 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:08:00.977 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:08:00.977 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:08:00.977 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:08:00.977 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:08:00.980 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:08:00.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:00.980 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:08:01.037 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:08:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:08:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:08:01.133 INFO:teuthology.orchestra.run.smithi118.stdout:client5438 2024-09-21T06:08:01.133 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:08:01.133 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:01.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 -- 172.21.15.118:0/3739611753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 msgr2=0x7f07b80d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 --2- 172.21.15.118:0/3739611753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 0x7f07b80d0e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009830 tx=0x7f07a802a410 comp rx=0 tx=0).stop 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 -- 172.21.15.118:0/3739611753 shutdown_connections 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 --2- 172.21.15.118:0/3739611753 >> v2:172.21.15.149:3300/0 conn(0x7f07b8142e40 0x7f07b80d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 --2- 172.21.15.118:0/3739611753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 0x7f07b80d0e80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 -- 172.21.15.118:0/3739611753 >> 172.21.15.118:0/3739611753 conn(0x7f07b806d110 msgr2=0x7f07b806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 -- 172.21.15.118:0/3739611753 shutdown_connections 2024-09-21T06:08:01.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.428+0000 7f07bf200640 1 -- 172.21.15.118:0/3739611753 wait complete. 2024-09-21T06:08:01.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.430+0000 7f07bf200640 1 Processor -- start 2024-09-21T06:08:01.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.430+0000 7f07bf200640 1 -- start start 2024-09-21T06:08:01.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 0x7f07b813ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:01.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07b813fef0 0x7f07b8157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:01.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07b8142e40 0x7f07b8158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:01.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80cfa70 con 0x7f07b8142e40 2024-09-21T06:08:01.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f07b80cf8f0 con 0x7f07b813fef0 2024-09-21T06:08:01.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07b80cfbf0 con 0x7f07b813fae0 2024-09-21T06:08:01.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07b8142e40 0x7f07b8158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:01.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07b8142e40 0x7f07b8158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48156/0 (socket says 172.21.15.118:48156) 2024-09-21T06:08:01.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 -- 172.21.15.118:0/522014725 learned_addr learned my addr 172.21.15.118:0/522014725 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07b7e00640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 0x7f07b813ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07af400640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07b813fef0 0x7f07b8157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 -- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 msgr2=0x7f07b813ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 0x7f07b813ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 -- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07b813fef0 msgr2=0x7f07b8157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07b813fef0 0x7f07b8157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.432+0000 7f07bd200640 1 -- 172.21.15.118:0/522014725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b813e650 con 0x7f07b8142e40 2024-09-21T06:08:01.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.433+0000 7f07bd200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07b8142e40 0x7f07b8158020 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f07b000ea40 tx=0x7f07b000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:01.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.433+0000 7f07b4c00640 1 -- 172.21.15.118:0/522014725 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b000ce40 con 0x7f07b8142e40 2024-09-21T06:08:01.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.433+0000 7f07b4c00640 1 -- 172.21.15.118:0/522014725 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07b0004c10 con 0x7f07b8142e40 2024-09-21T06:08:01.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.433+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b80b50c0 con 0x7f07b8142e40 2024-09-21T06:08:01.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.433+0000 7f07b4c00640 1 -- 172.21.15.118:0/522014725 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0005020 con 0x7f07b8142e40 2024-09-21T06:08:01.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.433+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b80b53a0 con 0x7f07b8142e40 2024-09-21T06:08:01.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.434+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b80d00e0 con 0x7f07b8142e40 2024-09-21T06:08:01.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.435+0000 7f07b4c00640 1 -- 172.21.15.118:0/522014725 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07b00051c0 con 0x7f07b8142e40 2024-09-21T06:08:01.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.436+0000 7f07b4c00640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0794078b90 0x7f079407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:01.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.436+0000 7f07b4c00640 1 -- 172.21.15.118:0/522014725 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f07b009bbd0 con 0x7f07b8142e40 2024-09-21T06:08:01.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.437+0000 7f07b7e00640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0794078b90 0x7f079407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:01.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.437+0000 7f07b7e00640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0794078b90 0x7f079407b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f07a8034000 tx=0x7f07a8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:01.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.441+0000 7f07b4c00640 1 -- 172.21.15.118:0/522014725 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f07b0064010 con 0x7f07b8142e40 2024-09-21T06:08:01.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.662+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07b80d11e0 con 0x7f07b8142e40 2024-09-21T06:08:01.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.663+0000 7f07b4c00640 1 -- 172.21.15.118:0/522014725 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) ==== 53+0+73 (secure 0 0 0) 0x7f07b0063910 con 0x7f07b8142e40 2024-09-21T06:08:01.665 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:08:01.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0794078b90 msgr2=0x7f079407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:01.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0794078b90 0x7f079407b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f07a8034000 tx=0x7f07a8004730 comp rx=0 tx=0).stop 2024-09-21T06:08:01.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07b8142e40 msgr2=0x7f07b8158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07b8142e40 0x7f07b8158020 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f07b000ea40 tx=0x7f07b000ef00 comp rx=0 tx=0).stop 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 shutdown_connections 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07b8142e40 0x7f07b8158020 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07b813fef0 0x7f07b8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0794078b90 0x7f079407b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 --2- 172.21.15.118:0/522014725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07b813fae0 0x7f07b813ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 >> 172.21.15.118:0/522014725 conn(0x7f07b806d110 msgr2=0x7f07b8157270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 shutdown_connections 2024-09-21T06:08:01.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:01.665+0000 7f07bf200640 1 -- 172.21.15.118:0/522014725 wait complete. 2024-09-21T06:08:01.689 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:08:01.689 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:08:01.689 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:08:01.690 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:08:01.690 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:08:01.690 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:08:01.690 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:08:01.690 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:08:01.690 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:08:01.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:01.690 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:08:01.730 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:08:01.730 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:01.731 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42478sec preferred_lft 42478sec 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:08:01.732 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:08:01.733 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:01.733 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:08:01.733 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:08:01.733 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:08:01.733 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:08:01.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:01.734 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:08:01.832 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:08:01.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:01.835 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:08:01.872 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:08:01.872 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:08:01.872 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:08:01.873 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:08:01.873 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:08:01.873 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:08:01.873 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:08:01.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:08:01.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:08:01.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:08:01.873 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:08:01.992 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:08:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:08:02.063 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:08:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:08:02.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:02.071 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:08:02.107 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:08:02.107 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:08:02.107 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:08:02.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:02.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:08:02.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:08:02.203 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:08:02.238 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:08:02.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:08:02.238 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:08:02.312 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:08:02.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:02.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:08:02.508 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:08:02.508 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:08:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:08:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:08:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:08:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:08:02.543 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:08:02.544 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:08:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:08:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:08:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:08:02.544 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:08:02.547 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:08:02.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:02.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:08:02.602 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:08:02.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:08:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:08:02.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:08:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:08:02.690 INFO:teuthology.orchestra.run.smithi149.stdout:client5447 2024-09-21T06:08:02.691 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:08:02.691 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:02.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 -- 172.21.15.118:0/2391543694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c163900 msgr2=0x7f593c15f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 --2- 172.21.15.118:0/2391543694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c163900 0x7f593c15f660 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f593c08da80 tx=0x7f592802a530 comp rx=0 tx=0).stop 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 -- 172.21.15.118:0/2391543694 shutdown_connections 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 --2- 172.21.15.118:0/2391543694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c163900 0x7f593c15f660 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 --2- 172.21.15.118:0/2391543694 >> v2:172.21.15.149:3300/0 conn(0x7f593c1634f0 0x7f593c0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 -- 172.21.15.118:0/2391543694 >> 172.21.15.118:0/2391543694 conn(0x7f593c06d1c0 msgr2=0x7f593c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 -- 172.21.15.118:0/2391543694 shutdown_connections 2024-09-21T06:08:02.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.949+0000 7f5941c00640 1 -- 172.21.15.118:0/2391543694 wait complete. 2024-09-21T06:08:02.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.951+0000 7f5941c00640 1 Processor -- start 2024-09-21T06:08:02.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.951+0000 7f5941c00640 1 -- start start 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f5941c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c15fba0 0x7f593c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f5941c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f593c1634f0 0x7f593c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f5941c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f593c163900 0x7f593c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f5941c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f593c0d3aa0 con 0x7f593c15fba0 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f5941c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f593c0d3920 con 0x7f593c1634f0 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f5941c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f593c0d3c20 con 0x7f593c163900 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c15fba0 0x7f593c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c15fba0 0x7f593c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48166/0 (socket says 172.21.15.118:48166) 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 -- 172.21.15.118:0/2392919817 learned_addr learned my addr 172.21.15.118:0/2392919817 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 -- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f593c163900 msgr2=0x7f593c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f593c163900 0x7f593c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 -- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f593c1634f0 msgr2=0x7f593c156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:02.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f593c1634f0 0x7f593c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.953+0000 7f593be00640 1 -- 172.21.15.118:0/2392919817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c156aa0 con 0x7f593c15fba0 2024-09-21T06:08:02.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.954+0000 7f593be00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c15fba0 0x7f593c1536f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f592c00eb30 tx=0x7f592c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:02.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.954+0000 7f5933e00640 1 -- 172.21.15.118:0/2392919817 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c010430 con 0x7f593c15fba0 2024-09-21T06:08:02.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.954+0000 7f5933e00640 1 -- 172.21.15.118:0/2392919817 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f592c0105d0 con 0x7f593c15fba0 2024-09-21T06:08:02.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.954+0000 7f5933e00640 1 -- 172.21.15.118:0/2392919817 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c010a20 con 0x7f593c15fba0 2024-09-21T06:08:02.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.954+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c159f40 con 0x7f593c15fba0 2024-09-21T06:08:02.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.954+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c0c9b80 con 0x7f593c15fba0 2024-09-21T06:08:02.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.955+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c0d02e0 con 0x7f593c15fba0 2024-09-21T06:08:02.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.956+0000 7f5933e00640 1 -- 172.21.15.118:0/2392919817 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f592c010bc0 con 0x7f593c15fba0 2024-09-21T06:08:02.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.957+0000 7f5933e00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f591c078b90 0x7f591c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:02.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.957+0000 7f5933e00640 1 -- 172.21.15.118:0/2392919817 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f592c09bbe0 con 0x7f593c15fba0 2024-09-21T06:08:02.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.958+0000 7f593b400640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f591c078b90 0x7f591c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:02.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.959+0000 7f593b400640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f591c078b90 0x7f591c07b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5928034000 tx=0x7f59280046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:02.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:02.962+0000 7f5933e00640 1 -- 172.21.15.118:0/2392919817 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f592c063f80 con 0x7f593c15fba0 2024-09-21T06:08:03.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.187+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f593c0b7570 con 0x7f593c15fba0 2024-09-21T06:08:03.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.187+0000 7f5933e00640 1 -- 172.21.15.118:0/2392919817 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f592c063880 con 0x7f593c15fba0 2024-09-21T06:08:03.190 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:03.190 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"btime":"2024-09-21T06:07:55:995571+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:07:52.440795+0000","modified":"2024-09-21T06:07:55.500401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5928},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5928":{"gid":5928,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/186206042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":186206042},{"type":"v1","addr":"172.21.15.118:6835","nonce":186206042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5928,"qdb_cluster":[5928]},"id":5}]} 2024-09-21T06:08:03.190 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 43 2024-09-21T06:08:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f591c078b90 msgr2=0x7f591c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f591c078b90 0x7f591c07b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5928034000 tx=0x7f59280046c0 comp rx=0 tx=0).stop 2024-09-21T06:08:03.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c15fba0 msgr2=0x7f593c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c15fba0 0x7f593c1536f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f592c00eb30 tx=0x7f592c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 shutdown_connections 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f591c078b90 0x7f591c07b0a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f593c163900 0x7f593c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f593c1634f0 0x7f593c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 --2- 172.21.15.118:0/2392919817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f593c15fba0 0x7f593c1536f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 >> 172.21.15.118:0/2392919817 conn(0x7f593c06d1c0 msgr2=0x7f593c15e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 shutdown_connections 2024-09-21T06:08:03.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:03.190+0000 7f5941c00640 1 -- 172.21.15.118:0/2392919817 wait complete. 2024-09-21T06:08:03.218 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:08:03.458 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":5928,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.480621770999999,"mdsmap_epoch":43,"osdmap_epoch":81,"osdmap_epoch_barrier":81,"uptime":15.393131088000001} 2024-09-21T06:08:03.458 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 5928, "mdsmap_epoch": 43, "osdmap_epoch": 81, "osdmap_epoch_barrier": 81, "rank_uptime": 10.480621771, "state": "up:active", "uptime": 15.393131088, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:08:03.459 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:08:03.692 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:08:03.692 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:08:03.692 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-21T06:08:03.921 INFO:teuthology.orchestra.run.smithi118.stdout:{"mon_tick_interval":"5"} 2024-09-21T06:08:03.921 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-21T06:08:03.922 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> import time 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> import datetime 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> # Write some buffered data through before going full, all should be well 2024-09-21T06:08:03.922 DEBUG:teuthology.orchestra.run.smithi118:> print("writing some data through which we expect to succeed") 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> bytes = 0 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> # buffered IO, the error should always only appear from fsync and not 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> # from write 2024-09-21T06:08:03.923 DEBUG:teuthology.orchestra.run.smithi118:> full = False 2024-09-21T06:08:03.924 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.924 DEBUG:teuthology.orchestra.run.smithi118:> for n in range(0, int(531 * 1.1)): 2024-09-21T06:08:03.924 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:08:03.924 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-21T06:08:03.924 DEBUG:teuthology.orchestra.run.smithi118:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-21T06:08:03.924 DEBUG:teuthology.orchestra.run.smithi118:> except OSError as e: 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> if False: 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> raise 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> full = True 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> break 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> print("fsync'"'"'ed successfully") 2024-09-21T06:08:03.925 DEBUG:teuthology.orchestra.run.smithi118:> except OSError as e: 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> full = True 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> break 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> if n > 531 * 0.9: 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> # Be cautious in the last region where we expect to hit 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-21T06:08:03.926 DEBUG:teuthology.orchestra.run.smithi118:> time.sleep(15.0) 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> if not full: 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> # close() should not raise an error because we already caught it in 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> # since then because all IOs got cancelled on the full flag. 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> print("calling close") 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> os.close(f) 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> print("close() did not raise error") 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-21T06:08:03.927 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:writing some data through which we expect to succeed 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 1.00 MB 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 2.00 MB 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.659 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 3.00 MB 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 4.00 MB 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 5.00 MB 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 6.00 MB 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 7.00 MB 2024-09-21T06:08:08.660 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 8.00 MB 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 9.00 MB 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 10.00 MB 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 11.00 MB 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.661 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 12.00 MB 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 13.00 MB 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 14.00 MB 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 15.00 MB 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 16.00 MB 2024-09-21T06:08:08.662 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 17.00 MB 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 18.00 MB 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 19.00 MB 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 20.00 MB 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.663 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 21.00 MB 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 22.00 MB 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 23.00 MB 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 24.00 MB 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 25.00 MB 2024-09-21T06:08:08.664 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 26.00 MB 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 27.00 MB 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 28.00 MB 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 29.00 MB 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.665 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 30.00 MB 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 31.00 MB 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 32.00 MB 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 33.00 MB 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 34.00 MB 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.666 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 35.00 MB 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 36.00 MB 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 37.00 MB 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 38.00 MB 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 39.00 MB 2024-09-21T06:08:08.667 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 40.00 MB 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 41.00 MB 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 42.00 MB 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 43.00 MB 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.668 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 44.00 MB 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 45.00 MB 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 46.00 MB 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 47.00 MB 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 48.00 MB 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.669 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 49.00 MB 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 50.00 MB 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 51.00 MB 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 52.00 MB 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 53.00 MB 2024-09-21T06:08:08.670 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 54.00 MB 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 55.00 MB 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 56.00 MB 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 57.00 MB 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.671 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 58.00 MB 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 59.00 MB 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 60.00 MB 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 61.00 MB 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 62.00 MB 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.672 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 63.00 MB 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 64.00 MB 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 65.00 MB 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 66.00 MB 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 67.00 MB 2024-09-21T06:08:08.673 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 68.00 MB 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 69.00 MB 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 70.00 MB 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 71.00 MB 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.674 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 72.00 MB 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 73.00 MB 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 74.00 MB 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 75.00 MB 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 76.00 MB 2024-09-21T06:08:08.675 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 77.00 MB 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 78.00 MB 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 79.00 MB 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:08.676 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 80.00 MB 2024-09-21T06:08:09.220 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 81.00 MB 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 82.00 MB 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 83.00 MB 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 84.00 MB 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.221 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 85.00 MB 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 86.00 MB 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 87.00 MB 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 88.00 MB 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 89.00 MB 2024-09-21T06:08:09.222 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 90.00 MB 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 91.00 MB 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 92.00 MB 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 93.00 MB 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.223 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 94.00 MB 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 95.00 MB 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 96.00 MB 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 97.00 MB 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 98.00 MB 2024-09-21T06:08:09.224 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 99.00 MB 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 100.00 MB 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 101.00 MB 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 102.00 MB 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.225 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 103.00 MB 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 104.00 MB 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 105.00 MB 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 106.00 MB 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 107.00 MB 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.226 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 108.00 MB 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 109.00 MB 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 110.00 MB 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.227 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 111.00 MB 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 112.00 MB 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 113.00 MB 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 114.00 MB 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 115.00 MB 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.228 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 116.00 MB 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 117.00 MB 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 118.00 MB 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 119.00 MB 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 120.00 MB 2024-09-21T06:08:09.229 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 121.00 MB 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 122.00 MB 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 123.00 MB 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 124.00 MB 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.230 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 125.00 MB 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 126.00 MB 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 127.00 MB 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 128.00 MB 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 129.00 MB 2024-09-21T06:08:09.231 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 130.00 MB 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 131.00 MB 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 132.00 MB 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 133.00 MB 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.232 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 134.00 MB 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 135.00 MB 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 136.00 MB 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 137.00 MB 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 138.00 MB 2024-09-21T06:08:09.233 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 139.00 MB 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 140.00 MB 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 141.00 MB 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 142.00 MB 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.234 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 143.00 MB 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 144.00 MB 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 145.00 MB 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 146.00 MB 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 147.00 MB 2024-09-21T06:08:09.235 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 148.00 MB 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 149.00 MB 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 150.00 MB 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 151.00 MB 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.236 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 152.00 MB 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 153.00 MB 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 154.00 MB 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 155.00 MB 2024-09-21T06:08:09.237 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 156.00 MB 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 157.00 MB 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 158.00 MB 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 159.00 MB 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.238 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 160.00 MB 2024-09-21T06:08:09.239 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 161.00 MB 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 162.00 MB 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.789 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 163.00 MB 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 164.00 MB 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 165.00 MB 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 166.00 MB 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 167.00 MB 2024-09-21T06:08:09.790 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 168.00 MB 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 169.00 MB 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 170.00 MB 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 171.00 MB 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.791 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 172.00 MB 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 173.00 MB 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 174.00 MB 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 175.00 MB 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.792 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 176.00 MB 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 177.00 MB 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 178.00 MB 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 179.00 MB 2024-09-21T06:08:09.793 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 180.00 MB 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 181.00 MB 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 182.00 MB 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 183.00 MB 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.794 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 184.00 MB 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 185.00 MB 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 186.00 MB 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 187.00 MB 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 188.00 MB 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.795 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 189.00 MB 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 190.00 MB 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 191.00 MB 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 192.00 MB 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 193.00 MB 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.796 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 194.00 MB 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 195.00 MB 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 196.00 MB 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 197.00 MB 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 198.00 MB 2024-09-21T06:08:09.797 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 199.00 MB 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 200.00 MB 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 201.00 MB 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 202.00 MB 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.798 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 203.00 MB 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 204.00 MB 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 205.00 MB 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 206.00 MB 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 207.00 MB 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.799 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 208.00 MB 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 209.00 MB 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 210.00 MB 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 211.00 MB 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 212.00 MB 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.800 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 213.00 MB 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 214.00 MB 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 215.00 MB 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 216.00 MB 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 217.00 MB 2024-09-21T06:08:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 218.00 MB 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 219.00 MB 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 220.00 MB 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 221.00 MB 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.802 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 222.00 MB 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 223.00 MB 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 224.00 MB 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 225.00 MB 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 226.00 MB 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.803 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 227.00 MB 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 228.00 MB 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 229.00 MB 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 230.00 MB 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 231.00 MB 2024-09-21T06:08:09.804 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 232.00 MB 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 233.00 MB 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 234.00 MB 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 235.00 MB 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 236.00 MB 2024-09-21T06:08:09.805 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 237.00 MB 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 238.00 MB 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 239.00 MB 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 240.00 MB 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:09.806 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.346 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 241.00 MB 2024-09-21T06:08:10.346 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 242.00 MB 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 243.00 MB 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 244.00 MB 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 245.00 MB 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 246.00 MB 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 247.00 MB 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 248.00 MB 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 249.00 MB 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 250.00 MB 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.348 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 251.00 MB 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 252.00 MB 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 253.00 MB 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 254.00 MB 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 255.00 MB 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.349 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 256.00 MB 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 257.00 MB 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 258.00 MB 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 259.00 MB 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.350 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 260.00 MB 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 261.00 MB 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 262.00 MB 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 263.00 MB 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 264.00 MB 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.351 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 265.00 MB 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 266.00 MB 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 267.00 MB 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 268.00 MB 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 269.00 MB 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.352 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 270.00 MB 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 271.00 MB 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 272.00 MB 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 273.00 MB 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 274.00 MB 2024-09-21T06:08:10.353 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 275.00 MB 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 276.00 MB 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 277.00 MB 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 278.00 MB 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.354 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 279.00 MB 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 280.00 MB 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 281.00 MB 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 282.00 MB 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 283.00 MB 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.355 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 284.00 MB 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 285.00 MB 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 286.00 MB 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 287.00 MB 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 288.00 MB 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.356 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 289.00 MB 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 290.00 MB 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 291.00 MB 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 292.00 MB 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 293.00 MB 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 294.00 MB 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 295.00 MB 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 296.00 MB 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 297.00 MB 2024-09-21T06:08:10.358 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 298.00 MB 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 299.00 MB 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 300.00 MB 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 301.00 MB 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.359 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 302.00 MB 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 303.00 MB 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 304.00 MB 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 305.00 MB 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 306.00 MB 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.360 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 307.00 MB 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 308.00 MB 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 309.00 MB 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 310.00 MB 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 311.00 MB 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.361 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 312.00 MB 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 313.00 MB 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 314.00 MB 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 315.00 MB 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 316.00 MB 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.362 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 317.00 MB 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 318.00 MB 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 319.00 MB 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 320.00 MB 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.363 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 321.00 MB 2024-09-21T06:08:10.890 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.890 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.890 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 322.00 MB 2024-09-21T06:08:10.890 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 323.00 MB 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 324.00 MB 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 325.00 MB 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 326.00 MB 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.891 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 327.00 MB 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 328.00 MB 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 329.00 MB 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 330.00 MB 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 331.00 MB 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.892 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 332.00 MB 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 333.00 MB 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 334.00 MB 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 335.00 MB 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 336.00 MB 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.893 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 337.00 MB 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 338.00 MB 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 339.00 MB 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 340.00 MB 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 341.00 MB 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.894 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 342.00 MB 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 343.00 MB 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 344.00 MB 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 345.00 MB 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 346.00 MB 2024-09-21T06:08:10.895 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 347.00 MB 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 348.00 MB 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 349.00 MB 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 350.00 MB 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 351.00 MB 2024-09-21T06:08:10.896 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 352.00 MB 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 353.00 MB 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 354.00 MB 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 355.00 MB 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 356.00 MB 2024-09-21T06:08:10.897 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 357.00 MB 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 358.00 MB 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 359.00 MB 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 360.00 MB 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.898 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 361.00 MB 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 362.00 MB 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 363.00 MB 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 364.00 MB 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 365.00 MB 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.899 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 366.00 MB 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 367.00 MB 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 368.00 MB 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 369.00 MB 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 370.00 MB 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.900 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 371.00 MB 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 372.00 MB 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 373.00 MB 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 374.00 MB 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 375.00 MB 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.901 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 376.00 MB 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 377.00 MB 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 378.00 MB 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 379.00 MB 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 380.00 MB 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.902 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 381.00 MB 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 382.00 MB 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 383.00 MB 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 384.00 MB 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 385.00 MB 2024-09-21T06:08:10.903 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 386.00 MB 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 387.00 MB 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 388.00 MB 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 389.00 MB 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 390.00 MB 2024-09-21T06:08:10.904 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 391.00 MB 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 392.00 MB 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 393.00 MB 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 394.00 MB 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.905 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 395.00 MB 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 396.00 MB 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 397.00 MB 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 398.00 MB 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 399.00 MB 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.906 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 400.00 MB 2024-09-21T06:08:10.907 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:10.907 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:10.907 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 401.00 MB 2024-09-21T06:08:12.581 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:08:12.578+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2024-09-21T06:08:17.647 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:08:17.644+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-21T06:08:19.202 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:19.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:41.494 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 402.00 MB 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 403.00 MB 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 404.00 MB 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.495 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 405.00 MB 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 406.00 MB 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 407.00 MB 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 408.00 MB 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 409.00 MB 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.496 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 410.00 MB 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 411.00 MB 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 412.00 MB 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 413.00 MB 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 414.00 MB 2024-09-21T06:08:41.497 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 415.00 MB 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 416.00 MB 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 417.00 MB 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 418.00 MB 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.498 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 419.00 MB 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 420.00 MB 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 421.00 MB 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 422.00 MB 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 423.00 MB 2024-09-21T06:08:41.499 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 424.00 MB 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 425.00 MB 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 426.00 MB 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 427.00 MB 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 428.00 MB 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.500 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 429.00 MB 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 430.00 MB 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 431.00 MB 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 432.00 MB 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 433.00 MB 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.501 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 434.00 MB 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 435.00 MB 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 436.00 MB 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 437.00 MB 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 438.00 MB 2024-09-21T06:08:41.502 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 439.00 MB 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 440.00 MB 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 441.00 MB 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 442.00 MB 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 443.00 MB 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 444.00 MB 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 445.00 MB 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 446.00 MB 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 447.00 MB 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.504 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 448.00 MB 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 449.00 MB 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 450.00 MB 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 451.00 MB 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 452.00 MB 2024-09-21T06:08:41.505 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 453.00 MB 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 454.00 MB 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 455.00 MB 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 456.00 MB 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 457.00 MB 2024-09-21T06:08:41.506 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 458.00 MB 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 459.00 MB 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 460.00 MB 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 461.00 MB 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.507 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 462.00 MB 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 463.00 MB 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 464.00 MB 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 465.00 MB 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 466.00 MB 2024-09-21T06:08:41.508 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 467.00 MB 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 468.00 MB 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 469.00 MB 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 470.00 MB 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.509 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 471.00 MB 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 472.00 MB 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 473.00 MB 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 474.00 MB 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.510 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 475.00 MB 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 476.00 MB 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 477.00 MB 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 478.00 MB 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 479.00 MB 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:08:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:08:41.512 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:08:41.512 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 480.00 MB 2024-09-21T06:08:41.512 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:08:41.583 INFO:teuthology.orchestra.run.smithi118.stdout:Reached fullness after 480.00 MB 2024-09-21T06:08:41.583 INFO:teuthology.orchestra.run.smithi118.stdout:calling close 2024-09-21T06:08:41.583 INFO:teuthology.orchestra.run.smithi118.stdout:close() did not raise error 2024-09-21T06:08:41.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:08:41.597 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:08:41.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:08:41.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:08:41.792 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:08:41.792 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:08:41.793 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:08:41.793 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:41.828 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:08:41.828 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:41.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:08:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.163+0000 7ff443e00640 1 -- 172.21.15.118:0/1979814366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4440b62c0 msgr2=0x7ff44415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.163+0000 7ff443e00640 1 --2- 172.21.15.118:0/1979814366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4440b62c0 0x7ff44415d150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009830 tx=0x7ff42c02a4b0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.163+0000 7ff443e00640 1 -- 172.21.15.118:0/1979814366 shutdown_connections 2024-09-21T06:08:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.163+0000 7ff443e00640 1 --2- 172.21.15.118:0/1979814366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4440b62c0 0x7ff44415d150 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.163+0000 7ff443e00640 1 -- 172.21.15.118:0/1979814366 >> 172.21.15.118:0/1979814366 conn(0x7ff44406d6e0 msgr2=0x7ff4440b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.163+0000 7ff443e00640 1 -- 172.21.15.118:0/1979814366 shutdown_connections 2024-09-21T06:08:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.163+0000 7ff443e00640 1 -- 172.21.15.118:0/1979814366 wait complete. 2024-09-21T06:08:42.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.165+0000 7ff443e00640 1 Processor -- start 2024-09-21T06:08:42.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.165+0000 7ff443e00640 1 -- start start 2024-09-21T06:08:42.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff443e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4441461d0 0x7ff4441342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff443e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff44415d690 0x7ff444133720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff443e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444133c60 0x7ff4441f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff443e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff44415fc40 con 0x7ff44415d690 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff443e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff44415fac0 con 0x7ff444133c60 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff443e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff44415fdc0 con 0x7ff4441461d0 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff43a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff44415d690 0x7ff444133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff43a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff44415d690 0x7ff444133720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60366/0 (socket says 172.21.15.118:60366) 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff43a000640 1 -- 172.21.15.118:0/1376471466 learned_addr learned my addr 172.21.15.118:0/1376471466 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff443400640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444133c60 0x7ff4441f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.167+0000 7ff442a00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4441461d0 0x7ff4441342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43a000640 1 -- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4441461d0 msgr2=0x7ff4441342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43a000640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4441461d0 0x7ff4441342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43a000640 1 -- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444133c60 msgr2=0x7ff4441f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43a000640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444133c60 0x7ff4441f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43a000640 1 -- 172.21.15.118:0/1376471466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff444156c10 con 0x7ff44415d690 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff443400640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444133c60 0x7ff4441f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43a000640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff44415d690 0x7ff444133720 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009950 tx=0x7ff42c030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c03f070 con 0x7ff44415d690 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff42c030d40 con 0x7ff44415d690 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff444134070 con 0x7ff44415d690 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c005c90 con 0x7ff44415d690 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.168+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff444159a90 con 0x7ff44415d690 2024-09-21T06:08:42.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.169+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44415d150 con 0x7ff44415d690 2024-09-21T06:08:42.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.171+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff42c004280 con 0x7ff44415d690 2024-09-21T06:08:42.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.172+0000 7ff43b400640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff420078bc0 0x7ff42007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.172+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5796+0+0 (secure 0 0 0) 0x7ff42c0bbb70 con 0x7ff44415d690 2024-09-21T06:08:42.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.172+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=86}) -- 0x7ff420080860 con 0x7ff44415d690 2024-09-21T06:08:42.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.173+0000 7ff442a00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff420078bc0 0x7ff42007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.173+0000 7ff442a00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff420078bc0 0x7ff42007b0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff434001850 tx=0x7ff434009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:42.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.177+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff42c083f40 con 0x7ff44415d690 2024-09-21T06:08:42.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.373+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff444074fa0 con 0x7ff44415d690 2024-09-21T06:08:42.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.373+0000 7ff43b400640 1 -- 172.21.15.118:0/1376471466 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v85) ==== 80+0+0 (secure 0 0 0) 0x7ff42c031770 con 0x7ff44415d690 2024-09-21T06:08:42.376 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:08:42.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff420078bc0 msgr2=0x7ff42007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff420078bc0 0x7ff42007b0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff434001850 tx=0x7ff434009040 comp rx=0 tx=0).stop 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff44415d690 msgr2=0x7ff444133720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff44415d690 0x7ff444133720 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009950 tx=0x7ff42c030650 comp rx=0 tx=0).stop 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 shutdown_connections 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff444133c60 0x7ff4441f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff44415d690 0x7ff444133720 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff420078bc0 0x7ff42007b0d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 --2- 172.21.15.118:0/1376471466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4441461d0 0x7ff4441342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 >> 172.21.15.118:0/1376471466 conn(0x7ff44406d6e0 msgr2=0x7ff4440b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 shutdown_connections 2024-09-21T06:08:42.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.376+0000 7ff443e00640 1 -- 172.21.15.118:0/1376471466 wait complete. 2024-09-21T06:08:42.403 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:08:42.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:42.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:08:42.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:08:42.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:42.466 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:08:42.502 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:08:42.502 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:08:42.502 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:42.540 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:08:42.540 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:42.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:08:42.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.842+0000 7f00b2600640 1 -- 172.21.15.118:0/1374506517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5450 msgr2=0x7f00ac0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.842+0000 7f00b2600640 1 --2- 172.21.15.118:0/1374506517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5450 0x7f00ac0cd150 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f00a4005fd0 tx=0x7f00a402a820 comp rx=0 tx=0).stop 2024-09-21T06:08:42.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.842+0000 7f00b2600640 1 -- 172.21.15.118:0/1374506517 shutdown_connections 2024-09-21T06:08:42.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.842+0000 7f00b2600640 1 --2- 172.21.15.118:0/1374506517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5450 0x7f00ac0cd150 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.842+0000 7f00b2600640 1 --2- 172.21.15.118:0/1374506517 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00ac15cfd0 0x7f00ac0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.842+0000 7f00b2600640 1 -- 172.21.15.118:0/1374506517 >> 172.21.15.118:0/1374506517 conn(0x7f00ac06d110 msgr2=0x7f00ac06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:42.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.842+0000 7f00b2600640 1 -- 172.21.15.118:0/1374506517 shutdown_connections 2024-09-21T06:08:42.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.843+0000 7f00b2600640 1 -- 172.21.15.118:0/1374506517 wait complete. 2024-09-21T06:08:42.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.845+0000 7f00b2600640 1 Processor -- start 2024-09-21T06:08:42.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.845+0000 7f00b2600640 1 -- start start 2024-09-21T06:08:42.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00b2600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5040 0x7f00ac0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00b2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00ac0b5450 0x7f00ac0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00b2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00ac15cfd0 0x7f00ac1f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00b2600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac073bc0 con 0x7f00ac0b5040 2024-09-21T06:08:42.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00b2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac073a40 con 0x7f00ac0b5450 2024-09-21T06:08:42.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00b2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00ac073d40 con 0x7f00ac15cfd0 2024-09-21T06:08:42.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00ab400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5040 0x7f00ac0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00ab400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5040 0x7f00ac0b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60376/0 (socket says 172.21.15.118:60376) 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.846+0000 7f00ab400640 1 -- 172.21.15.118:0/650425744 learned_addr learned my addr 172.21.15.118:0/650425744 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00abe00640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00ac15cfd0 0x7f00ac1f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00aaa00640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00ac0b5450 0x7f00ac0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00ab400640 1 -- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00ac15cfd0 msgr2=0x7f00ac1f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00ab400640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00ac15cfd0 0x7f00ac1f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00ab400640 1 -- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00ac0b5450 msgr2=0x7f00ac0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00ab400640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00ac0b5450 0x7f00ac0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00ab400640 1 -- 172.21.15.118:0/650425744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac0ca9f0 con 0x7f00ac0b5040 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00aaa00640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00ac0b5450 0x7f00ac0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00ab400640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5040 0x7f00ac0b2910 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f009c00e790 tx=0x7f009c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c00eea0 con 0x7f00ac0b5040 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f009c00cdb0 con 0x7f00ac0b5040 2024-09-21T06:08:42.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c010690 con 0x7f00ac0b5040 2024-09-21T06:08:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.847+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac1f3710 con 0x7f00ac0b5040 2024-09-21T06:08:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.848+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac0c8b60 con 0x7f00ac0b5040 2024-09-21T06:08:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.848+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ac0b3a60 con 0x7f00ac0b5040 2024-09-21T06:08:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.850+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f009c010830 con 0x7f00ac0b5040 2024-09-21T06:08:42.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.850+0000 7f00a3400640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f008c078b90 0x7f008c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:42.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.851+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5796+0+0 (secure 0 0 0) 0x7f009c09b850 con 0x7f00ac0b5040 2024-09-21T06:08:42.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.851+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7f008c080830 con 0x7f00ac0b5040 2024-09-21T06:08:42.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.851+0000 7f00aaa00640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f008c078b90 0x7f008c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:42.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.852+0000 7f00aaa00640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f008c078b90 0x7f008c07b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f00ac1f6ca0 tx=0x7f0098009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:42.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:42.855+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f009c063c20 con 0x7f00ac0b5040 2024-09-21T06:08:43.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.107+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f00ac074690 con 0x7f00ac0b5040 2024-09-21T06:08:43.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.107+0000 7f00a3400640 1 -- 172.21.15.118:0/650425744 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7f009c063520 con 0x7f00ac0b5040 2024-09-21T06:08:43.110 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:08:43.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f008c078b90 msgr2=0x7f008c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:43.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f008c078b90 0x7f008c07b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f00ac1f6ca0 tx=0x7f0098009040 comp rx=0 tx=0).stop 2024-09-21T06:08:43.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5040 msgr2=0x7f00ac0b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:43.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5040 0x7f00ac0b2910 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f009c00e790 tx=0x7f009c00ec50 comp rx=0 tx=0).stop 2024-09-21T06:08:43.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 shutdown_connections 2024-09-21T06:08:43.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f008c078b90 0x7f008c07b0a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00ac15cfd0 0x7f00ac1f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00ac0b5450 0x7f00ac0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 --2- 172.21.15.118:0/650425744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ac0b5040 0x7f00ac0b2910 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.111+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 >> 172.21.15.118:0/650425744 conn(0x7f00ac06d110 msgr2=0x7f00ac15af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:43.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.112+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 shutdown_connections 2024-09-21T06:08:43.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.112+0000 7f00b2600640 1 -- 172.21.15.118:0/650425744 wait complete. 2024-09-21T06:08:43.155 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:08:43.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:43.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:08:43.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:08:43.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:08:43.228 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:08:43.264 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:08:43.264 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:08:43.264 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:43.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:08:43.300 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:08:43.300 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:08:43.300 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:43.339 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:08:43.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 -- 172.21.15.118:0/3832357189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a8152050 msgr2=0x7f47a806ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 --2- 172.21.15.118:0/3832357189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a8152050 0x7f47a806ecd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4794005fd0 tx=0x7f479402a580 comp rx=0 tx=0).stop 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 -- 172.21.15.118:0/3832357189 shutdown_connections 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 --2- 172.21.15.118:0/3832357189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a8152050 0x7f47a806ecd0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 --2- 172.21.15.118:0/3832357189 >> v2:172.21.15.149:3300/0 conn(0x7f47a806f210 0x7f47a815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 --2- 172.21.15.118:0/3832357189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a80b44c0 0x7f47a815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 -- 172.21.15.118:0/3832357189 >> 172.21.15.118:0/3832357189 conn(0x7f47a806d110 msgr2=0x7f47a806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 -- 172.21.15.118:0/3832357189 shutdown_connections 2024-09-21T06:08:43.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.556+0000 7f47ad000640 1 -- 172.21.15.118:0/3832357189 wait complete. 2024-09-21T06:08:43.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.558+0000 7f47ad000640 1 Processor -- start 2024-09-21T06:08:43.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.558+0000 7f47ad000640 1 -- start start 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47ad000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a806f210 0x7f47a81f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47ad000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a80b44c0 0x7f47a81e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47ad000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a8152050 0x7f47a814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47ad000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f47a815c240 con 0x7f47a806f210 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47ad000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47a8070fd0 con 0x7f47a80b44c0 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47ad000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47a815c3c0 con 0x7f47a8152050 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47a5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a806f210 0x7f47a81f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:43.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47a5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a806f210 0x7f47a81f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60390/0 (socket says 172.21.15.118:60390) 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47a5e00640 1 -- 172.21.15.118:0/3159188314 learned_addr learned my addr 172.21.15.118:0/3159188314 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47a5400640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a80b44c0 0x7f47a81e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.560+0000 7f47a6800640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a8152050 0x7f47a814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47a5e00640 1 -- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a8152050 msgr2=0x7f47a814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47a5e00640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a8152050 0x7f47a814ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47a5e00640 1 -- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a80b44c0 msgr2=0x7f47a81e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47a5e00640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a80b44c0 0x7f47a81e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47a5e00640 1 -- 172.21.15.118:0/3159188314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a81f6c90 con 0x7f47a806f210 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47a6800640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a8152050 0x7f47a814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47a5e00640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a806f210 0x7f47a81f63a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4798009d90 tx=0x7f479800c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:43.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798009e80 con 0x7f47a806f210 2024-09-21T06:08:43.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4798004b20 con 0x7f47a806f210 2024-09-21T06:08:43.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a81f6f70 con 0x7f47a806f210 2024-09-21T06:08:43.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798005020 con 0x7f47a806f210 2024-09-21T06:08:43.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.561+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a8152760 con 0x7f47a806f210 2024-09-21T06:08:43.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.562+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a815f660 con 0x7f47a806f210 2024-09-21T06:08:43.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.564+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f479801b020 con 0x7f47a806f210 2024-09-21T06:08:43.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.565+0000 7f479e000640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4788078b90 0x7f478807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:43.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.565+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5796+0+0 (secure 0 0 0) 0x7f479809b340 con 0x7f47a806f210 2024-09-21T06:08:43.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.566+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7f4788080890 con 0x7f47a806f210 2024-09-21T06:08:43.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.566+0000 7f47a5400640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4788078b90 0x7f478807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:43.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.566+0000 7f47a5400640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4788078b90 0x7f478807b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4794033000 tx=0x7f4794004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.570+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4798011070 con 0x7f47a806f210 2024-09-21T06:08:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.791+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47a80cef60 con 0x7f47a806f210 2024-09-21T06:08:43.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.792+0000 7f479e000640 1 -- 172.21.15.118:0/3159188314 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f4798063680 con 0x7f47a806f210 2024-09-21T06:08:43.794 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:43.795 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"btime":"2024-09-21T06:07:55:995571+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:07:52.440795+0000","modified":"2024-09-21T06:07:55.500401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5928},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5928":{"gid":5928,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/186206042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":186206042},{"type":"v1","addr":"172.21.15.118:6835","nonce":186206042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5928,"qdb_cluster":[5928]},"id":5}]} 2024-09-21T06:08:43.795 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 43 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4788078b90 msgr2=0x7f478807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4788078b90 0x7f478807b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4794033000 tx=0x7f4794004730 comp rx=0 tx=0).stop 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a806f210 msgr2=0x7f47a81f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a806f210 0x7f47a81f63a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4798009d90 tx=0x7f479800c560 comp rx=0 tx=0).stop 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 shutdown_connections 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4788078b90 0x7f478807b0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a8152050 0x7f47a814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a80b44c0 0x7f47a81e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 --2- 172.21.15.118:0/3159188314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47a806f210 0x7f47a81f63a0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:43.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 >> 172.21.15.118:0/3159188314 conn(0x7f47a806d110 msgr2=0x7f47a8151760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:43.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 shutdown_connections 2024-09-21T06:08:43.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:43.794+0000 7f47ad000640 1 -- 172.21.15.118:0/3159188314 wait complete. 2024-09-21T06:08:43.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 -- 172.21.15.118:0/1608877137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 msgr2=0x7f786815d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 --2- 172.21.15.118:0/1608877137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786815d880 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f78680703a0 tx=0x7f786002aa30 comp rx=0 tx=0).stop 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 -- 172.21.15.118:0/1608877137 shutdown_connections 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 --2- 172.21.15.118:0/1608877137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786815d880 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 --2- 172.21.15.118:0/1608877137 >> v2:172.21.15.149:3300/0 conn(0x7f78680cd310 0x7f7868073ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 --2- 172.21.15.118:0/1608877137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7868160840 0x7f78680ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 -- 172.21.15.118:0/1608877137 >> 172.21.15.118:0/1608877137 conn(0x7f786806d6e0 msgr2=0x7f78680b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 -- 172.21.15.118:0/1608877137 shutdown_connections 2024-09-21T06:08:44.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.038+0000 7f786d600640 1 -- 172.21.15.118:0/1608877137 wait complete. 2024-09-21T06:08:44.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.040+0000 7f786d600640 1 Processor -- start 2024-09-21T06:08:44.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.040+0000 7f786d600640 1 -- start start 2024-09-21T06:08:44.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786813c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78680cd310 0x7f7868155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7868160840 0x7f78681563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786d600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f78680b5bb0 con 0x7f7868074220 2024-09-21T06:08:44.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786d600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f786815e0b0 con 0x7f78680cd310 2024-09-21T06:08:44.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786d600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f78680b5d30 con 0x7f7868160840 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786813c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786813c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60404/0 (socket says 172.21.15.118:60404) 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 -- 172.21.15.118:0/1925504934 learned_addr learned my addr 172.21.15.118:0/1925504934 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f785f400640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78680cd310 0x7f7868155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786cc00640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7868160840 0x7f78681563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 -- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7868160840 msgr2=0x7f78681563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7868160840 0x7f78681563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 -- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78680cd310 msgr2=0x7f7868155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78680cd310 0x7f7868155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f7867e00640 1 -- 172.21.15.118:0/1925504934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78680cb7f0 con 0x7f7868074220 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f785f400640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78680cd310 0x7f7868155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.042+0000 7f786cc00640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7868160840 0x7f78681563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.043+0000 7f7867e00640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786813c190 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f785800d740 tx=0x7f785800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:44.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.043+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858017070 con 0x7f7868074220 2024-09-21T06:08:44.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.043+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7858009d20 con 0x7f7868074220 2024-09-21T06:08:44.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.043+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78580106c0 con 0x7f7868074220 2024-09-21T06:08:44.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.043+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78680cbad0 con 0x7f7868074220 2024-09-21T06:08:44.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.043+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78680cc090 con 0x7f7868074220 2024-09-21T06:08:44.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.044+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78680b6250 con 0x7f7868074220 2024-09-21T06:08:44.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.045+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f785801a070 con 0x7f7868074220 2024-09-21T06:08:44.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.046+0000 7f7864c00640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7844078b90 0x7f784407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.046+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5796+0+0 (secure 0 0 0) 0x7f785809b080 con 0x7f7868074220 2024-09-21T06:08:44.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.046+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7f7844080830 con 0x7f7868074220 2024-09-21T06:08:44.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.046+0000 7f785f400640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7844078b90 0x7f784407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.047+0000 7f785f400640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7844078b90 0x7f784407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7868145cb0 tx=0x7f7850005e70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:44.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.051+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7858063340 con 0x7f7868074220 2024-09-21T06:08:44.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.271+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78680b3290 con 0x7f7868074220 2024-09-21T06:08:44.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.271+0000 7f7864c00640 1 -- 172.21.15.118:0/1925504934 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f7858062c40 con 0x7f7868074220 2024-09-21T06:08:44.274 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:44.274 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"btime":"2024-09-21T06:07:55:995571+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:07:52.440795+0000","modified":"2024-09-21T06:07:55.500401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5928},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5928":{"gid":5928,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/186206042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":186206042},{"type":"v1","addr":"172.21.15.118:6835","nonce":186206042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5928,"qdb_cluster":[5928]},"id":5}]} 2024-09-21T06:08:44.274 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 43 2024-09-21T06:08:44.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7844078b90 msgr2=0x7f784407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7844078b90 0x7f784407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7868145cb0 tx=0x7f7850005e70 comp rx=0 tx=0).stop 2024-09-21T06:08:44.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 msgr2=0x7f786813c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786813c190 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f785800d740 tx=0x7f785800dc00 comp rx=0 tx=0).stop 2024-09-21T06:08:44.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 shutdown_connections 2024-09-21T06:08:44.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7844078b90 0x7f784407b0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7868160840 0x7f78681563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78680cd310 0x7f7868155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 --2- 172.21.15.118:0/1925504934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868074220 0x7f786813c190 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 >> 172.21.15.118:0/1925504934 conn(0x7f786806d6e0 msgr2=0x7f7868159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:44.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 shutdown_connections 2024-09-21T06:08:44.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.274+0000 7f786d600640 1 -- 172.21.15.118:0/1925504934 wait complete. 2024-09-21T06:08:44.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:08:44.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.518+0000 7f4df3200640 1 -- 172.21.15.118:0/1941529760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dd4004800 msgr2=0x7f4dd4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.518+0000 7f4df3200640 1 --2- 172.21.15.118:0/1941529760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dd4004800 0x7f4dd4004c10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009b50 tx=0x7f4dd4005830 comp rx=0 tx=0).stop 2024-09-21T06:08:44.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.518+0000 7f4df3200640 1 -- 172.21.15.118:0/1941529760 shutdown_connections 2024-09-21T06:08:44.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.518+0000 7f4df3200640 1 --2- 172.21.15.118:0/1941529760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dd4004800 0x7f4dd4004c10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.518+0000 7f4df3200640 1 -- 172.21.15.118:0/1941529760 >> 172.21.15.118:0/1941529760 conn(0x7f4dec0d0f80 msgr2=0x7f4dec0d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:44.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.518+0000 7f4df3200640 1 -- 172.21.15.118:0/1941529760 shutdown_connections 2024-09-21T06:08:44.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.518+0000 7f4df3200640 1 -- 172.21.15.118:0/1941529760 wait complete. 2024-09-21T06:08:44.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.520+0000 7f4df3200640 1 Processor -- start 2024-09-21T06:08:44.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.520+0000 7f4df3200640 1 -- start start 2024-09-21T06:08:44.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dd4004800 0x7f4dec1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dec14fd40 0x7f4dec1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df3200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec154930 0x7f4dec151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df3200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec15cfd0 con 0x7f4dec154930 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec15ce50 con 0x7f4dd4004800 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec070630 con 0x7f4dec14fd40 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec154930 0x7f4dec151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec154930 0x7f4dec151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60432/0 (socket says 172.21.15.118:60432) 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 -- 172.21.15.118:0/3268396459 learned_addr learned my addr 172.21.15.118:0/3268396459 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df1e00640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dd4004800 0x7f4dec1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df1400640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dec14fd40 0x7f4dec1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 -- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dec14fd40 msgr2=0x7f4dec1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dec14fd40 0x7f4dec1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 -- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dd4004800 msgr2=0x7f4dec1537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dd4004800 0x7f4dec1537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df2800640 1 -- 172.21.15.118:0/3268396459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec154d40 con 0x7f4dec154930 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.522+0000 7f4df1e00640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dd4004800 0x7f4dec1537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.523+0000 7f4df2800640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec154930 0x7f4dec151940 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4dec072a20 tx=0x7f4de80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.523+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8011870 con 0x7f4dec154930 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.523+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4de8017070 con 0x7f4dec154930 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.523+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec151330 con 0x7f4dec154930 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.523+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8011dc0 con 0x7f4dec154930 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.523+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec15f830 con 0x7f4dec154930 2024-09-21T06:08:44.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.524+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec070b90 con 0x7f4dec154930 2024-09-21T06:08:44.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.525+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4de801c460 con 0x7f4dec154930 2024-09-21T06:08:44.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.526+0000 7f4de6000640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4dd0078bc0 0x7f4dd007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.526+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5796+0+0 (secure 0 0 0) 0x7f4de809b570 con 0x7f4dec154930 2024-09-21T06:08:44.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.526+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7f4dd0080860 con 0x7f4dec154930 2024-09-21T06:08:44.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.527+0000 7f4df1e00640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4dd0078bc0 0x7f4dd007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.527+0000 7f4df1e00640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4dd0078bc0 0x7f4dd007b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4de0006cd0 tx=0x7f4de00067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:44.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.531+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4dec154d40 con 0x7f4dec154930 2024-09-21T06:08:44.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.714+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dec1ebae0 con 0x7f4dec154930 2024-09-21T06:08:44.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.715+0000 7f4de6000640 1 -- 172.21.15.118:0/3268396459 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16989 (secure 0 0 0) 0x7f4de8063940 con 0x7f4dec154930 2024-09-21T06:08:44.718 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:44.718 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:08:42.712617+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:07:50.361302+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T06:07:51.405276+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:08:44.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.717+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4dd0078bc0 msgr2=0x7f4dd007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.717+0000 7f4df3200640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4dd0078bc0 0x7f4dd007b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4de0006cd0 tx=0x7f4de00067a0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.717+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec154930 msgr2=0x7f4dec151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.717+0000 7f4df3200640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec154930 0x7f4dec151940 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4dec072a20 tx=0x7f4de80019b0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 shutdown_connections 2024-09-21T06:08:44.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dec154930 0x7f4dec151940 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4dd0078bc0 0x7f4dd007b0d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dec14fd40 0x7f4dec1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 --2- 172.21.15.118:0/3268396459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dd4004800 0x7f4dec1537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 >> 172.21.15.118:0/3268396459 conn(0x7f4dec0d0f80 msgr2=0x7f4dec152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:44.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 shutdown_connections 2024-09-21T06:08:44.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.718+0000 7f4df3200640 1 -- 172.21.15.118:0/3268396459 wait complete. 2024-09-21T06:08:44.722 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:08:44.720+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2024-09-21T06:08:44.743 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:08:44.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:08:44.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.961+0000 7f1d03200640 1 -- 172.21.15.118:0/1051689547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 msgr2=0x7f1d040cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.961+0000 7f1d03200640 1 --2- 172.21.15.118:0/1051689547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d040cf8b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009830 tx=0x7f1cfc02a5c0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.961+0000 7f1d03200640 1 -- 172.21.15.118:0/1051689547 shutdown_connections 2024-09-21T06:08:44.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.961+0000 7f1d03200640 1 --2- 172.21.15.118:0/1051689547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d040cf8b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.961+0000 7f1d03200640 1 -- 172.21.15.118:0/1051689547 >> 172.21.15.118:0/1051689547 conn(0x7f1d0406d6e0 msgr2=0x7f1d040b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:44.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.961+0000 7f1d03200640 1 -- 172.21.15.118:0/1051689547 shutdown_connections 2024-09-21T06:08:44.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.961+0000 7f1d03200640 1 -- 172.21.15.118:0/1051689547 wait complete. 2024-09-21T06:08:44.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.963+0000 7f1d03200640 1 Processor -- start 2024-09-21T06:08:44.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.963+0000 7f1d03200640 1 -- start start 2024-09-21T06:08:44.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d03200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d04141a30 0x7f1d041f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d03200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d0413adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d03200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d04158b50 0x7f1d04149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d03200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d040cff70 con 0x7f1d04141e40 2024-09-21T06:08:44.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d03200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d040cfdf0 con 0x7f1d04158b50 2024-09-21T06:08:44.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d03200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1d040d00f0 con 0x7f1d04141a30 2024-09-21T06:08:44.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d0413adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d0413adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60440/0 (socket says 172.21.15.118:60440) 2024-09-21T06:08:44.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 -- 172.21.15.118:0/3170655692 learned_addr learned my addr 172.21.15.118:0/3170655692 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:44.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d02800640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d04158b50 0x7f1d04149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01e00640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d04141a30 0x7f1d041f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 -- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d04141a30 msgr2=0x7f1d041f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d04141a30 0x7f1d041f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 -- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d04158b50 msgr2=0x7f1d04149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d04158b50 0x7f1d04149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.965+0000 7f1d01400640 1 -- 172.21.15.118:0/3170655692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0414a190 con 0x7f1d04141e40 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.966+0000 7f1d01400640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d0413adb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000c400 tx=0x7f1cf000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.966+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0017070 con 0x7f1d04141e40 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.966+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cf00053c0 con 0x7f1d04141e40 2024-09-21T06:08:44.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.966+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d04138850 con 0x7f1d04141e40 2024-09-21T06:08:44.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.966+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0003850 con 0x7f1d04141e40 2024-09-21T06:08:44.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.966+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d04158350 con 0x7f1d04141e40 2024-09-21T06:08:44.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.967+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d041385c0 con 0x7f1d04141e40 2024-09-21T06:08:44.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.968+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1cf001a070 con 0x7f1d04141e40 2024-09-21T06:08:44.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.970+0000 7f1cfa000640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ce4078b90 0x7f1ce407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:44.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.970+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5796+0+0 (secure 0 0 0) 0x7f1cf009a1a0 con 0x7f1d04141e40 2024-09-21T06:08:44.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.970+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7f1ce4080890 con 0x7f1d04141e40 2024-09-21T06:08:44.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.970+0000 7f1d01e00640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ce4078b90 0x7f1ce407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:44.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.971+0000 7f1d01e00640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ce4078b90 0x7f1ce407b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40012e0 tx=0x7f1cf4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:44.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:44.974+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1d0414a190 con 0x7f1d04141e40 2024-09-21T06:08:45.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.196+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d040d05a0 con 0x7f1d04141e40 2024-09-21T06:08:45.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.197+0000 7f1cfa000640 1 -- 172.21.15.118:0/3170655692 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7f1cf0061ea0 con 0x7f1d04141e40 2024-09-21T06:08:45.199 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:45.199 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"btime":"2024-09-21T06:07:55:995571+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:07:52.440795+0000","modified":"2024-09-21T06:07:55.500401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5928},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5928":{"gid":5928,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/186206042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":186206042},{"type":"v1","addr":"172.21.15.118:6835","nonce":186206042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5928,"qdb_cluster":[5928]},"id":5}]} 2024-09-21T06:08:45.199 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 43 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ce4078b90 msgr2=0x7f1ce407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ce4078b90 0x7f1ce407b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40012e0 tx=0x7f1cf4009040 comp rx=0 tx=0).stop 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 msgr2=0x7f1d0413adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d0413adb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000c400 tx=0x7f1cf000c8c0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 shutdown_connections 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d04158b50 0x7f1d04149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d04141e40 0x7f1d0413adb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ce4078b90 0x7f1ce407b0a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 --2- 172.21.15.118:0/3170655692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d04141a30 0x7f1d041f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 >> 172.21.15.118:0/3170655692 conn(0x7f1d0406d6e0 msgr2=0x7f1d040729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:45.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 shutdown_connections 2024-09-21T06:08:45.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.199+0000 7f1d03200640 1 -- 172.21.15.118:0/3170655692 wait complete. 2024-09-21T06:08:45.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:08:45.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.444+0000 7ff143200640 1 -- 172.21.15.118:0/1284511946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c146650 msgr2=0x7ff13c0d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.444+0000 7ff143200640 1 --2- 172.21.15.118:0/1284511946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c146650 0x7ff13c0d23d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009be0 tx=0x7ff12c02a920 comp rx=0 tx=0).stop 2024-09-21T06:08:45.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.444+0000 7ff143200640 1 -- 172.21.15.118:0/1284511946 shutdown_connections 2024-09-21T06:08:45.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.444+0000 7ff143200640 1 --2- 172.21.15.118:0/1284511946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c146650 0x7ff13c0d23d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.444+0000 7ff143200640 1 -- 172.21.15.118:0/1284511946 >> 172.21.15.118:0/1284511946 conn(0x7ff13c071070 msgr2=0x7ff13c071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:45.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.444+0000 7ff143200640 1 -- 172.21.15.118:0/1284511946 shutdown_connections 2024-09-21T06:08:45.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.444+0000 7ff143200640 1 -- 172.21.15.118:0/1284511946 wait complete. 2024-09-21T06:08:45.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.446+0000 7ff143200640 1 Processor -- start 2024-09-21T06:08:45.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.446+0000 7ff143200640 1 -- start start 2024-09-21T06:08:45.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff143200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c0ceb40 0x7ff13c06f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff143200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c146650 0x7ff13c13d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff143200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c1f9c40 0x7ff13c1f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff143200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c0cf2e0 con 0x7ff13c146650 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff143200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c0cf160 con 0x7ff13c1f9c40 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff143200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff13c0d18f0 con 0x7ff13c0ceb40 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff13b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c146650 0x7ff13c13d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff13be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c0ceb40 0x7ff13c06f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff13b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c146650 0x7ff13c13d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60446/0 (socket says 172.21.15.118:60446) 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff13b400640 1 -- 172.21.15.118:0/139787872 learned_addr learned my addr 172.21.15.118:0/139787872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.448+0000 7ff141200640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c1f9c40 0x7ff13c1f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff13b400640 1 -- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c0ceb40 msgr2=0x7ff13c06f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff13b400640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c0ceb40 0x7ff13c06f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff13b400640 1 -- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c1f9c40 msgr2=0x7ff13c1f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff13b400640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c1f9c40 0x7ff13c1f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff13b400640 1 -- 172.21.15.118:0/139787872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13c1f5a20 con 0x7ff13c146650 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff13b400640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c146650 0x7ff13c13d630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c430 tx=0x7ff12800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128011790 con 0x7ff13c146650 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff128017070 con 0x7ff13c146650 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128011ce0 con 0x7ff13c146650 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13c155340 con 0x7ff13c146650 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.449+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13c0b6e40 con 0x7ff13c146650 2024-09-21T06:08:45.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.451+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13c0d3650 con 0x7ff13c146650 2024-09-21T06:08:45.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.452+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff12801c460 con 0x7ff13c146650 2024-09-21T06:08:45.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.452+0000 7ff133e00640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff11c078bc0 0x7ff11c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.453+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5796+0+0 (secure 0 0 0) 0x7ff12809ab60 con 0x7ff13c146650 2024-09-21T06:08:45.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.453+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=87}) -- 0x7ff11c0808c0 con 0x7ff13c146650 2024-09-21T06:08:45.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.453+0000 7ff13be00640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff11c078bc0 0x7ff11c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.454+0000 7ff13be00640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff11c078bc0 0x7ff11c07b0d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff12c034000 tx=0x7ff12c004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:45.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.457+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff1280627d0 con 0x7ff13c146650 2024-09-21T06:08:45.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.676+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff13c0b6bf0 con 0x7ff13c146650 2024-09-21T06:08:45.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.677+0000 7ff133e00640 1 -- 172.21.15.118:0/139787872 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5222 (secure 0 0 0) 0x7ff128067200 con 0x7ff13c146650 2024-09-21T06:08:45.679 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:45.680 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":43,"btime":"2024-09-21T06:07:55:995571+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:07:52.440795+0000","modified":"2024-09-21T06:07:55.500401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5928},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5928":{"gid":5928,"name":"c","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/186206042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":186206042},{"type":"v1","addr":"172.21.15.118:6835","nonce":186206042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5928,"qdb_cluster":[5928]},"id":5}]} 2024-09-21T06:08:45.680 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 43 2024-09-21T06:08:45.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff11c078bc0 msgr2=0x7ff11c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff11c078bc0 0x7ff11c07b0d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff12c034000 tx=0x7ff12c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c146650 msgr2=0x7ff13c13d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c146650 0x7ff13c13d630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c430 tx=0x7ff12800c8f0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 shutdown_connections 2024-09-21T06:08:45.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c1f9c40 0x7ff13c1f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff13c146650 0x7ff13c13d630 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff11c078bc0 0x7ff11c07b0d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 --2- 172.21.15.118:0/139787872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff13c0ceb40 0x7ff13c06f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.679+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 >> 172.21.15.118:0/139787872 conn(0x7ff13c071070 msgr2=0x7ff13c0b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:45.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.680+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 shutdown_connections 2024-09-21T06:08:45.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.680+0000 7ff143200640 1 -- 172.21.15.118:0/139787872 wait complete. 2024-09-21T06:08:45.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:08:45.731 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:08:45.728+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-21T06:08:45.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.926+0000 7fef54c00640 1 -- 172.21.15.118:0/4182837936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500ce0c0 msgr2=0x7fef501448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.926+0000 7fef54c00640 1 --2- 172.21.15.118:0/4182837936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500ce0c0 0x7fef501448a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fef50072e50 tx=0x7fef4002a510 comp rx=0 tx=0).stop 2024-09-21T06:08:45.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.926+0000 7fef54c00640 1 -- 172.21.15.118:0/4182837936 shutdown_connections 2024-09-21T06:08:45.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.926+0000 7fef54c00640 1 --2- 172.21.15.118:0/4182837936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500ce0c0 0x7fef501448a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.926+0000 7fef54c00640 1 -- 172.21.15.118:0/4182837936 >> 172.21.15.118:0/4182837936 conn(0x7fef5006d110 msgr2=0x7fef5006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:45.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.926+0000 7fef54c00640 1 -- 172.21.15.118:0/4182837936 shutdown_connections 2024-09-21T06:08:45.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.926+0000 7fef54c00640 1 -- 172.21.15.118:0/4182837936 wait complete. 2024-09-21T06:08:45.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.929+0000 7fef54c00640 1 Processor -- start 2024-09-21T06:08:45.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.929+0000 7fef54c00640 1 -- start start 2024-09-21T06:08:45.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef54c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef500ce0c0 0x7fef500cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef54c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500d0ec0 0x7fef501f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef54c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5015fa00 0x7fef500aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef54c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fef5006f3a0 con 0x7fef500d0ec0 2024-09-21T06:08:45.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef54c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef5006f220 con 0x7fef5015fa00 2024-09-21T06:08:45.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef54c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef5006f520 con 0x7fef500ce0c0 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef45400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500d0ec0 0x7fef501f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef45400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500d0ec0 0x7fef501f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58860/0 (socket says 172.21.15.118:58860) 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.930+0000 7fef45400640 1 -- 172.21.15.118:0/2788435544 learned_addr learned my addr 172.21.15.118:0/2788435544 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef4de00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef500ce0c0 0x7fef500cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef4e800640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5015fa00 0x7fef500aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef45400640 1 -- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef500ce0c0 msgr2=0x7fef500cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef45400640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef500ce0c0 0x7fef500cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef45400640 1 -- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5015fa00 msgr2=0x7fef500aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef45400640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5015fa00 0x7fef500aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef45400640 1 -- 172.21.15.118:0/2788435544 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef500cd330 con 0x7fef500d0ec0 2024-09-21T06:08:45.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef45400640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500d0ec0 0x7fef501f5c10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c3d0 tx=0x7fef3800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:45.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38017070 con 0x7fef500d0ec0 2024-09-21T06:08:45.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef380053c0 con 0x7fef500d0ec0 2024-09-21T06:08:45.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38003850 con 0x7fef500d0ec0 2024-09-21T06:08:45.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef500cc570 con 0x7fef500d0ec0 2024-09-21T06:08:45.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.931+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef500ccb30 con 0x7fef500d0ec0 2024-09-21T06:08:45.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.932+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef501f66b0 con 0x7fef500d0ec0 2024-09-21T06:08:45.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.934+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef3801a070 con 0x7fef500d0ec0 2024-09-21T06:08:45.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.935+0000 7fef46a00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef2c078b90 0x7fef2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:45.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.935+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5796+0+0 (secure 0 0 0) 0x7fef3809a120 con 0x7fef500d0ec0 2024-09-21T06:08:45.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.936+0000 7fef4de00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef2c078b90 0x7fef2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:45.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.936+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=88}) -- 0x7fef2c080890 con 0x7fef500d0ec0 2024-09-21T06:08:45.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.936+0000 7fef4de00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef2c078b90 0x7fef2c07b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef40034000 tx=0x7fef40004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:45.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:45.940+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fef380624f0 con 0x7fef500d0ec0 2024-09-21T06:08:46.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.123+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef501f6940 con 0x7fef500d0ec0 2024-09-21T06:08:46.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.124+0000 7fef46a00640 1 -- 172.21.15.118:0/2788435544 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16975 (secure 0 0 0) 0x7fef38061df0 con 0x7fef500d0ec0 2024-09-21T06:08:46.127 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:46.127 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":87,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:08:45.730075+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:07:50.361302+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T06:07:51.405276+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]},{"pgid":"11.33","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:08:46.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef2c078b90 msgr2=0x7fef2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef2c078b90 0x7fef2c07b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef40034000 tx=0x7fef40004730 comp rx=0 tx=0).stop 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500d0ec0 msgr2=0x7fef501f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500d0ec0 0x7fef501f5c10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c3d0 tx=0x7fef3800c890 comp rx=0 tx=0).stop 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 shutdown_connections 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5015fa00 0x7fef500aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef500d0ec0 0x7fef501f5c10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef2c078b90 0x7fef2c07b0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 --2- 172.21.15.118:0/2788435544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef500ce0c0 0x7fef500cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 >> 172.21.15.118:0/2788435544 conn(0x7fef5006d110 msgr2=0x7fef5015fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 shutdown_connections 2024-09-21T06:08:46.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.127+0000 7fef54c00640 1 -- 172.21.15.118:0/2788435544 wait complete. 2024-09-21T06:08:46.151 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:08:46.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.409+0000 7ffa70c00640 1 -- 172.21.15.118:0/1930723730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0cfe10 msgr2=0x7ffa6c0d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.409+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1930723730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0cfe10 0x7ffa6c0d0220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa64005fd0 tx=0x7ffa6402aa90 comp rx=0 tx=0).stop 2024-09-21T06:08:46.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.409+0000 7ffa70c00640 1 -- 172.21.15.118:0/1930723730 shutdown_connections 2024-09-21T06:08:46.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.409+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1930723730 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0cfe10 0x7ffa6c0d0220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.409+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1930723730 >> v2:172.21.15.149:3300/0 conn(0x7ffa6c06cf00 0x7ffa6c15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.409+0000 7ffa70c00640 1 -- 172.21.15.118:0/1930723730 >> 172.21.15.118:0/1930723730 conn(0x7ffa6c0d4c10 msgr2=0x7ffa6c0d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:46.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.410+0000 7ffa70c00640 1 -- 172.21.15.118:0/1930723730 shutdown_connections 2024-09-21T06:08:46.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.410+0000 7ffa70c00640 1 -- 172.21.15.118:0/1930723730 wait complete. 2024-09-21T06:08:46.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.412+0000 7ffa70c00640 1 Processor -- start 2024-09-21T06:08:46.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.412+0000 7ffa70c00640 1 -- start start 2024-09-21T06:08:46.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.413+0000 7ffa70c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa6c06cf00 0x7ffa6c0c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.413+0000 7ffa70c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa6c0cfe10 0x7ffa6c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa70c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0d27e0 0x7ffa6c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa70c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0d3f00 con 0x7ffa6c06cf00 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa70c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0d3d80 con 0x7ffa6c0cfe10 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa70c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c0d4080 con 0x7ffa6c0d27e0 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa6c06cf00 0x7ffa6c0c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa6c06cf00 0x7ffa6c0c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58876/0 (socket says 172.21.15.118:58876) 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 -- 172.21.15.118:0/1068956877 learned_addr learned my addr 172.21.15.118:0/1068956877 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa63e00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa6c0cfe10 0x7ffa6c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6be00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0d27e0 0x7ffa6c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 -- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0d27e0 msgr2=0x7ffa6c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0d27e0 0x7ffa6c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 -- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa6c0cfe10 msgr2=0x7ffa6c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa6c0cfe10 0x7ffa6c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6b400640 1 -- 172.21.15.118:0/1068956877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c1f6800 con 0x7ffa6c06cf00 2024-09-21T06:08:46.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa6be00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0d27e0 0x7ffa6c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:46.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.414+0000 7ffa63e00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa6c0cfe10 0x7ffa6c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:46.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.415+0000 7ffa6b400640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa6c06cf00 0x7ffa6c0c8720 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00c3d0 tx=0x7ffa5c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:46.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.415+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c017070 con 0x7ffa6c06cf00 2024-09-21T06:08:46.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.415+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa5c0053c0 con 0x7ffa6c06cf00 2024-09-21T06:08:46.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.415+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c003850 con 0x7ffa6c06cf00 2024-09-21T06:08:46.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.415+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c1f6ae0 con 0x7ffa6c06cf00 2024-09-21T06:08:46.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.415+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c14d4e0 con 0x7ffa6c06cf00 2024-09-21T06:08:46.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.416+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c0d4530 con 0x7ffa6c06cf00 2024-09-21T06:08:46.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.417+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa5c01a070 con 0x7ffa6c06cf00 2024-09-21T06:08:46.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.418+0000 7ffa63400640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffa48078b90 0x7ffa4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.418+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5796+0+0 (secure 0 0 0) 0x7ffa5c09a530 con 0x7ffa6c06cf00 2024-09-21T06:08:46.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.419+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=88}) -- 0x7ffa48080890 con 0x7ffa6c06cf00 2024-09-21T06:08:46.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.419+0000 7ffa63e00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffa48078b90 0x7ffa4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.420+0000 7ffa63e00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffa48078b90 0x7ffa4807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0cefd0 tx=0x7ffa54005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:46.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.421+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffa5c021020 con 0x7ffa6c06cf00 2024-09-21T06:08:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.642+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ffa6c0c84e0 con 0x7ffa6c06cf00 2024-09-21T06:08:46.645 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:08:46.643+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:08:46.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.645+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) ==== 161+0+0 (secure 0 0 0) 0x7ffa6c0d0760 con 0x7ffa6c06cf00 2024-09-21T06:08:46.648 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:08:46.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.646+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(88..88 src has 1..88) ==== 374+0+0 (secure 0 0 0) 0x7ffa5c098a70 con 0x7ffa6c06cf00 2024-09-21T06:08:46.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.646+0000 7ffa63400640 1 -- 172.21.15.118:0/1068956877 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7ffa48081290 con 0x7ffa6c06cf00 2024-09-21T06:08:46.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.650+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffa48078b90 msgr2=0x7ffa4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.650+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffa48078b90 0x7ffa4807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0cefd0 tx=0x7ffa54005f90 comp rx=0 tx=0).stop 2024-09-21T06:08:46.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.650+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa6c06cf00 msgr2=0x7ffa6c0c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.650+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa6c06cf00 0x7ffa6c0c8720 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00c3d0 tx=0x7ffa5c00c890 comp rx=0 tx=0).stop 2024-09-21T06:08:46.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 shutdown_connections 2024-09-21T06:08:46.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffa48078b90 0x7ffa4807b0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa6c0d27e0 0x7ffa6c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa6c0cfe10 0x7ffa6c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 --2- 172.21.15.118:0/1068956877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa6c06cf00 0x7ffa6c0c8720 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 >> 172.21.15.118:0/1068956877 conn(0x7ffa6c0d4c10 msgr2=0x7ffa6c15d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:46.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 shutdown_connections 2024-09-21T06:08:46.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.651+0000 7ffa70c00640 1 -- 172.21.15.118:0/1068956877 wait complete. 2024-09-21T06:08:46.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:08:46.790 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 -- 172.21.15.118:0/448925365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 msgr2=0x7ff89c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 --2- 172.21.15.118:0/448925365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c0d0e80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0ce7c0 tx=0x7ff88c02a820 comp rx=0 tx=0).stop 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 -- 172.21.15.118:0/448925365 shutdown_connections 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 --2- 172.21.15.118:0/448925365 >> v2:172.21.15.149:3300/0 conn(0x7ff89c142e40 0x7ff89c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 --2- 172.21.15.118:0/448925365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c0d0e80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 -- 172.21.15.118:0/448925365 >> 172.21.15.118:0/448925365 conn(0x7ff89c06d110 msgr2=0x7ff89c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 -- 172.21.15.118:0/448925365 shutdown_connections 2024-09-21T06:08:46.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.905+0000 7ff8a3000640 1 -- 172.21.15.118:0/448925365 wait complete. 2024-09-21T06:08:46.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.907+0000 7ff8a3000640 1 Processor -- start 2024-09-21T06:08:46.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.907+0000 7ff8a3000640 1 -- start start 2024-09-21T06:08:46.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff8a3000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff8a3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c13fef0 0x7ff89c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff8a3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c142e40 0x7ff89c13e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff8a3000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c0cfac0 con 0x7ff89c13fae0 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff8a3000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c0cf940 con 0x7ff89c13fef0 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff8a3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c0cfc40 con 0x7ff89c142e40 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58904/0 (socket says 172.21.15.118:58904) 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 -- 172.21.15.118:0/1135408880 learned_addr learned my addr 172.21.15.118:0/1135408880 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff8a1000640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c142e40 0x7ff89c13e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89b400640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c13fef0 0x7ff89c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 -- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c142e40 msgr2=0x7ff89c13e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c142e40 0x7ff89c13e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 -- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c13fef0 msgr2=0x7ff89c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c13fef0 0x7ff89c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:46.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.909+0000 7ff89be00640 1 -- 172.21.15.118:0/1135408880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c156430 con 0x7ff89c13fae0 2024-09-21T06:08:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.910+0000 7ff89be00640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c153410 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff88c035040 tx=0x7ff88c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.910+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c037040 con 0x7ff89c13fae0 2024-09-21T06:08:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.910+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff88c042070 con 0x7ff89c13fae0 2024-09-21T06:08:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.910+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c156710 con 0x7ff89c13fae0 2024-09-21T06:08:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.910+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c003e60 con 0x7ff89c13fae0 2024-09-21T06:08:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.910+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c156cd0 con 0x7ff89c13fae0 2024-09-21T06:08:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.911+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89c1602a0 con 0x7ff89c13fae0 2024-09-21T06:08:46.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.912+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff88c004280 con 0x7ff89c13fae0 2024-09-21T06:08:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.913+0000 7ff893e00640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff87c078b90 0x7ff87c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.913+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5882+0+0 (secure 0 0 0) 0x7ff88c0bbcd0 con 0x7ff89c13fae0 2024-09-21T06:08:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.914+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7ff87c080930 con 0x7ff89c13fae0 2024-09-21T06:08:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.914+0000 7ff89b400640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff87c078b90 0x7ff87c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:46.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.914+0000 7ff89b400640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff87c078b90 0x7ff87c07b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0b4e70 tx=0x7ff888009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:46.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:46.918+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff89c1602a0 con 0x7ff89c13fae0 2024-09-21T06:08:47.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.142+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff89c0d0160 con 0x7ff89c13fae0 2024-09-21T06:08:47.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.738+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 7 ==== osd_map(89..89 src has 1..89) ==== 296+0+0 (secure 0 0 0) 0x7ff88c0ba1c0 con 0x7ff89c13fae0 2024-09-21T06:08:47.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.739+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7ff87c0811b0 con 0x7ff89c13fae0 2024-09-21T06:08:47.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.745+0000 7ff893e00640 1 -- 172.21.15.118:0/1135408880 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7ff88c083fc0 con 0x7ff89c13fae0 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff87c078b90 msgr2=0x7ff87c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff87c078b90 0x7ff87c07b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0b4e70 tx=0x7ff888009040 comp rx=0 tx=0).stop 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 msgr2=0x7ff89c153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c153410 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff88c035040 tx=0x7ff88c032d10 comp rx=0 tx=0).stop 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 shutdown_connections 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff87c078b90 0x7ff87c07b0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff89c142e40 0x7ff89c13e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff89c13fef0 0x7ff89c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 --2- 172.21.15.118:0/1135408880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff89c13fae0 0x7ff89c153410 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 >> 172.21.15.118:0/1135408880 conn(0x7ff89c06d110 msgr2=0x7ff89c15fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:47.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 shutdown_connections 2024-09-21T06:08:47.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:47.748+0000 7ff8a3000640 1 -- 172.21.15.118:0/1135408880 wait complete. 2024-09-21T06:08:47.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:08:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.000+0000 7fbf78000640 1 -- 172.21.15.118:0/2744752588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf58004800 msgr2=0x7fbf58004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.000+0000 7fbf78000640 1 --2- 172.21.15.118:0/2744752588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf58004800 0x7fbf58004c10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009b20 tx=0x7fbf58005830 comp rx=0 tx=0).stop 2024-09-21T06:08:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.000+0000 7fbf78000640 1 -- 172.21.15.118:0/2744752588 shutdown_connections 2024-09-21T06:08:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.000+0000 7fbf78000640 1 --2- 172.21.15.118:0/2744752588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf58004800 0x7fbf58004c10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.000+0000 7fbf78000640 1 -- 172.21.15.118:0/2744752588 >> 172.21.15.118:0/2744752588 conn(0x7fbf7006cf30 msgr2=0x7fbf7006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.000+0000 7fbf78000640 1 -- 172.21.15.118:0/2744752588 shutdown_connections 2024-09-21T06:08:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.000+0000 7fbf78000640 1 -- 172.21.15.118:0/2744752588 wait complete. 2024-09-21T06:08:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.002+0000 7fbf78000640 1 Processor -- start 2024-09-21T06:08:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.003+0000 7fbf78000640 1 -- start start 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf78000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf58004800 0x7fbf700adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf78000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf70140280 0x7fbf7013f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf78000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf701423a0 0x7fbf700b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf78000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7015c780 con 0x7fbf70140280 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf78000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7015c600 con 0x7fbf701423a0 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf78000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7015cf50 con 0x7fbf58004800 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf74c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf70140280 0x7fbf7013f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf74c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf70140280 0x7fbf7013f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58930/0 (socket says 172.21.15.118:58930) 2024-09-21T06:08:48.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.004+0000 7fbf74c00640 1 -- 172.21.15.118:0/2865978692 learned_addr learned my addr 172.21.15.118:0/2865978692 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf75600640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf58004800 0x7fbf700adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf76000640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf701423a0 0x7fbf700b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf74c00640 1 -- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf58004800 msgr2=0x7fbf700adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf74c00640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf58004800 0x7fbf700adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf74c00640 1 -- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf701423a0 msgr2=0x7fbf700b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf74c00640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf701423a0 0x7fbf700b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf74c00640 1 -- 172.21.15.118:0/2865978692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf700ae100 con 0x7fbf70140280 2024-09-21T06:08:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf75600640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf58004800 0x7fbf700adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:08:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf74c00640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf70140280 0x7fbf7013f530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009a70 tx=0x7fbf5c033650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c040020 con 0x7fbf70140280 2024-09-21T06:08:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf5c033b30 con 0x7fbf70140280 2024-09-21T06:08:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c038040 con 0x7fbf70140280 2024-09-21T06:08:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf70140990 con 0x7fbf70140280 2024-09-21T06:08:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.005+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf70143410 con 0x7fbf70140280 2024-09-21T06:08:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.006+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf700cdbd0 con 0x7fbf70140280 2024-09-21T06:08:48.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.008+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf5c043070 con 0x7fbf70140280 2024-09-21T06:08:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.009+0000 7fbf6d600640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbf50078bc0 0x7fbf5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:48.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.009+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5882+0+0 (secure 0 0 0) 0x7fbf5c0bac40 con 0x7fbf70140280 2024-09-21T06:08:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.010+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7fbf50080970 con 0x7fbf70140280 2024-09-21T06:08:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.010+0000 7fbf75600640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbf50078bc0 0x7fbf5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:48.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.010+0000 7fbf75600640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbf50078bc0 0x7fbf5007b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001220 tx=0x7fbf640067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:48.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.014+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbf5c083050 con 0x7fbf70140280 2024-09-21T06:08:48.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.200+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf7006a260 con 0x7fbf70140280 2024-09-21T06:08:48.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.751+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7fbf5c082950 con 0x7fbf70140280 2024-09-21T06:08:48.754 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:08:48.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.752+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(90..90 src has 1..90) ==== 1065+0+0 (secure 0 0 0) 0x7fbf5c0b9130 con 0x7fbf70140280 2024-09-21T06:08:48.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.752+0000 7fbf6d600640 1 -- 172.21.15.118:0/2865978692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=91}) -- 0x7fbf5007eda0 con 0x7fbf70140280 2024-09-21T06:08:48.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbf50078bc0 msgr2=0x7fbf5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:48.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbf50078bc0 0x7fbf5007b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf64001220 tx=0x7fbf640067a0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf70140280 msgr2=0x7fbf7013f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:48.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf70140280 0x7fbf7013f530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009a70 tx=0x7fbf5c033650 comp rx=0 tx=0).stop 2024-09-21T06:08:48.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 shutdown_connections 2024-09-21T06:08:48.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf701423a0 0x7fbf700b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf70140280 0x7fbf7013f530 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbf50078bc0 0x7fbf5007b0d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 --2- 172.21.15.118:0/2865978692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf58004800 0x7fbf700adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:48.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.759+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 >> 172.21.15.118:0/2865978692 conn(0x7fbf7006cf30 msgr2=0x7fbf7006d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:48.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.760+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 shutdown_connections 2024-09-21T06:08:48.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:48.761+0000 7fbf78000640 1 -- 172.21.15.118:0/2865978692 wait complete. 2024-09-21T06:08:48.789 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:08:49.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.017+0000 7fadd3200640 1 -- 172.21.15.118:0/2843732323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 msgr2=0x7fadb0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:49.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.017+0000 7fadd3200640 1 --2- 172.21.15.118:0/2843732323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 0x7fadb0003f10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009b50 tx=0x7fadb0005830 comp rx=0 tx=0).stop 2024-09-21T06:08:49.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.017+0000 7fadd1200640 1 -- 172.21.15.118:0/2843732323 reap_dead start 2024-09-21T06:08:49.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.017+0000 7fadd3200640 1 -- 172.21.15.118:0/2843732323 shutdown_connections 2024-09-21T06:08:49.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.017+0000 7fadd3200640 1 -- 172.21.15.118:0/2843732323 >> 172.21.15.118:0/2843732323 conn(0x7fadcc06cf30 msgr2=0x7fadcc06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:49.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.017+0000 7fadd3200640 1 -- 172.21.15.118:0/2843732323 shutdown_connections 2024-09-21T06:08:49.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.017+0000 7fadd3200640 1 -- 172.21.15.118:0/2843732323 wait complete. 2024-09-21T06:08:49.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.019+0000 7fadd3200640 1 Processor -- start 2024-09-21T06:08:49.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.019+0000 7fadd3200640 1 -- start start 2024-09-21T06:08:49.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 0x7fadcc0b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:49.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadcc0c6e80 0x7fadcc143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:49.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd3200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadcc0c7290 0x7fadcc144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:49.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd3200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0b45a0 con 0x7fadcc0c7290 2024-09-21T06:08:49.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0b4420 con 0x7fadb0003aa0 2024-09-21T06:08:49.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc0cec90 con 0x7fadcc0c6e80 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd1200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadcc0c7290 0x7fadcc144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 0x7fadcc0b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadcc0c6e80 0x7fadcc143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd1200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadcc0c7290 0x7fadcc144320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58954/0 (socket says 172.21.15.118:58954) 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 0x7fadcc0b12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:53164/0 (socket says 172.21.15.118:53164) 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadd1200640 1 -- 172.21.15.118:0/141946039 learned_addr learned my addr 172.21.15.118:0/141946039 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcbe00640 1 -- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadcc0c6e80 msgr2=0x7fadcc143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcbe00640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadcc0c6e80 0x7fadcc143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcbe00640 1 -- 172.21.15.118:0/141946039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadcc0c7290 msgr2=0x7fadcc144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcbe00640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadcc0c7290 0x7fadcc144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.021+0000 7fadcbe00640 1 -- 172.21.15.118:0/141946039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0b17f0 con 0x7fadb0003aa0 2024-09-21T06:08:49.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.022+0000 7fadcbe00640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 0x7fadcc0b12b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fadb000baf0 tx=0x7fadbc033670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:49.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.022+0000 7fadc3e00640 1 -- 172.21.15.118:0/141946039 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc038040 con 0x7fadb0003aa0 2024-09-21T06:08:49.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.022+0000 7fadc3e00640 1 -- 172.21.15.118:0/141946039 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadbc004020 con 0x7fadb0003aa0 2024-09-21T06:08:49.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.022+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1f9690 con 0x7fadb0003aa0 2024-09-21T06:08:49.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.022+0000 7fadc3e00640 1 -- 172.21.15.118:0/141946039 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc004470 con 0x7fadb0003aa0 2024-09-21T06:08:49.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.022+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1f9c50 con 0x7fadb0003aa0 2024-09-21T06:08:49.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.023+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc06a260 con 0x7fadb0003aa0 2024-09-21T06:08:49.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.025+0000 7fadc3e00640 1 -- 172.21.15.118:0/141946039 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fadbc045020 con 0x7fadb0003aa0 2024-09-21T06:08:49.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.026+0000 7fadc3e00640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadac078b90 0x7fadac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:49.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.026+0000 7fadc3e00640 1 -- 172.21.15.118:0/141946039 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5444+0+0 (secure 0 0 0) 0x7fadbc0bb7e0 con 0x7fadb0003aa0 2024-09-21T06:08:49.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.026+0000 7fadcb400640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadac078b90 0x7fadac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:49.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.027+0000 7fadcb400640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadac078b90 0x7fadac07b0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fadcc144ec0 tx=0x7fadb8001110 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:49.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.030+0000 7fadc3e00640 1 -- 172.21.15.118:0/141946039 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fadbc083800 con 0x7fadb0003aa0 2024-09-21T06:08:49.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.216+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fadcc06d3e0 con 0x7fadb0003aa0 2024-09-21T06:08:49.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:49.329 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:49.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.765+0000 7fadc3e00640 1 -- 172.21.15.118:0/141946039 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7fadbc088230 con 0x7fadb0003aa0 2024-09-21T06:08:49.768 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadac078b90 msgr2=0x7fadac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadac078b90 0x7fadac07b0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fadcc144ec0 tx=0x7fadb8001110 comp rx=0 tx=0).stop 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 msgr2=0x7fadcc0b12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 0x7fadcc0b12b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fadb000baf0 tx=0x7fadbc033670 comp rx=0 tx=0).stop 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 shutdown_connections 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadcc0c7290 0x7fadcc144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadac078b90 0x7fadac07b0a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadcc0c6e80 0x7fadcc143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 --2- 172.21.15.118:0/141946039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadb0003aa0 0x7fadcc0b12b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:49.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.770+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 >> 172.21.15.118:0/141946039 conn(0x7fadcc06cf30 msgr2=0x7fadcc146530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:49.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.771+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 shutdown_connections 2024-09-21T06:08:49.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:49.771+0000 7fadd3200640 1 -- 172.21.15.118:0/141946039 wait complete. 2024-09-21T06:08:49.800 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:08:50.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.021+0000 7fafc7600640 1 -- 172.21.15.118:0/2148603468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc00d1590 msgr2=0x7fafc0142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.021+0000 7fafc7600640 1 --2- 172.21.15.118:0/2148603468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc00d1590 0x7fafc0142730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fafac009830 tx=0x7fafac02a520 comp rx=0 tx=0).stop 2024-09-21T06:08:50.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.021+0000 7fafc7600640 1 -- 172.21.15.118:0/2148603468 shutdown_connections 2024-09-21T06:08:50.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.021+0000 7fafc7600640 1 --2- 172.21.15.118:0/2148603468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc00d1590 0x7fafc0142730 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.021+0000 7fafc7600640 1 -- 172.21.15.118:0/2148603468 >> 172.21.15.118:0/2148603468 conn(0x7fafc006d110 msgr2=0x7fafc006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:50.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.021+0000 7fafc7600640 1 -- 172.21.15.118:0/2148603468 shutdown_connections 2024-09-21T06:08:50.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.021+0000 7fafc7600640 1 -- 172.21.15.118:0/2148603468 wait complete. 2024-09-21T06:08:50.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.023+0000 7fafc7600640 1 Processor -- start 2024-09-21T06:08:50.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.023+0000 7fafc7600640 1 -- start start 2024-09-21T06:08:50.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc7600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc013fae0 0x7fafc0136c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc7600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafc013fef0 0x7fafc01f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc7600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc0153320 0x7fafc01f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc7600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0168280 con 0x7fafc013fae0 2024-09-21T06:08:50.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc7600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0168100 con 0x7fafc0153320 2024-09-21T06:08:50.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc7600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fafc0168400 con 0x7fafc013fef0 2024-09-21T06:08:50.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc013fae0 0x7fafc0136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc013fae0 0x7fafc0136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58966/0 (socket says 172.21.15.118:58966) 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 -- 172.21.15.118:0/2569024213 learned_addr learned my addr 172.21.15.118:0/2569024213 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafbfe00640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafc013fef0 0x7fafc01f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc5600640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc0153320 0x7fafc01f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 -- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafc013fef0 msgr2=0x7fafc01f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafc013fef0 0x7fafc01f78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 -- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc0153320 msgr2=0x7fafc01f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc0153320 0x7fafc01f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.025+0000 7fafc4c00640 1 -- 172.21.15.118:0/2569024213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc01f3a70 con 0x7fafc013fae0 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.026+0000 7fafc4c00640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc013fae0 0x7fafc0136c70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c400 tx=0x7fafb400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.026+0000 7fafbcc00640 1 -- 172.21.15.118:0/2569024213 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011790 con 0x7fafc013fae0 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.026+0000 7fafbcc00640 1 -- 172.21.15.118:0/2569024213 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb4017070 con 0x7fafc013fae0 2024-09-21T06:08:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.026+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc0141590 con 0x7fafc013fae0 2024-09-21T06:08:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.026+0000 7fafbcc00640 1 -- 172.21.15.118:0/2569024213 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011cc0 con 0x7fafc013fae0 2024-09-21T06:08:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.026+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc01f3d30 con 0x7fafc013fae0 2024-09-21T06:08:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.027+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc01399a0 con 0x7fafc013fae0 2024-09-21T06:08:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.028+0000 7fafbcc00640 1 -- 172.21.15.118:0/2569024213 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafb401c460 con 0x7fafc013fae0 2024-09-21T06:08:50.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.029+0000 7fafbcc00640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fafa0078bf0 0x7fafa007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.029+0000 7fafbcc00640 1 -- 172.21.15.118:0/2569024213 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7fafb409a850 con 0x7fafc013fae0 2024-09-21T06:08:50.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.030+0000 7fafbfe00640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fafa0078bf0 0x7fafa007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.030+0000 7fafbfe00640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fafa0078bf0 0x7fafa007b100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fafac034000 tx=0x7fafac004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:50.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.034+0000 7fafbcc00640 1 -- 172.21.15.118:0/2569024213 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fafb4062f90 con 0x7fafc013fae0 2024-09-21T06:08:50.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.219+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fafc00d0e80 con 0x7fafc013fae0 2024-09-21T06:08:50.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.223+0000 7fafbcc00640 1 -- 172.21.15.118:0/2569024213 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7fafb4062890 con 0x7fafc013fae0 2024-09-21T06:08:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.225+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fafa0078bf0 msgr2=0x7fafa007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.225+0000 7fafc7600640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fafa0078bf0 0x7fafa007b100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fafac034000 tx=0x7fafac004730 comp rx=0 tx=0).stop 2024-09-21T06:08:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.225+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc013fae0 msgr2=0x7fafc0136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.225+0000 7fafc7600640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc013fae0 0x7fafc0136c70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c400 tx=0x7fafb400c8c0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 shutdown_connections 2024-09-21T06:08:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafc0153320 0x7fafc01f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fafa0078bf0 0x7fafa007b100 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fafc013fef0 0x7fafc01f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 --2- 172.21.15.118:0/2569024213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc013fae0 0x7fafc0136c70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 >> 172.21.15.118:0/2569024213 conn(0x7fafc006d110 msgr2=0x7fafc0160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 shutdown_connections 2024-09-21T06:08:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.226+0000 7fafc7600640 1 -- 172.21.15.118:0/2569024213 wait complete. 2024-09-21T06:08:50.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-21T06:08:50.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.469+0000 7f4268400640 1 -- 172.21.15.118:0/1860487568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4260142e40 msgr2=0x7f42600d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.469+0000 7f4268400640 1 --2- 172.21.15.118:0/1860487568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4260142e40 0x7f42600d13c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4260071c00 tx=0x7f425802aa30 comp rx=0 tx=0).stop 2024-09-21T06:08:50.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.469+0000 7f4268400640 1 -- 172.21.15.118:0/1860487568 shutdown_connections 2024-09-21T06:08:50.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.469+0000 7f4268400640 1 --2- 172.21.15.118:0/1860487568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4260142e40 0x7f42600d13c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.469+0000 7f4268400640 1 --2- 172.21.15.118:0/1860487568 >> v2:172.21.15.149:3300/0 conn(0x7f426013fae0 0x7f42600d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.469+0000 7f4268400640 1 -- 172.21.15.118:0/1860487568 >> 172.21.15.118:0/1860487568 conn(0x7f426006d110 msgr2=0x7f426006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:50.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.470+0000 7f4268400640 1 -- 172.21.15.118:0/1860487568 shutdown_connections 2024-09-21T06:08:50.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.470+0000 7f4268400640 1 -- 172.21.15.118:0/1860487568 wait complete. 2024-09-21T06:08:50.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.472+0000 7f4268400640 1 Processor -- start 2024-09-21T06:08:50.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.472+0000 7f4268400640 1 -- start start 2024-09-21T06:08:50.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.473+0000 7f4268400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426013fae0 0x7f42601f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.473+0000 7f4268400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f426013fef0 0x7f426013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.473+0000 7f4268400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4260142e40 0x7f426013e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.473+0000 7f4268400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f42600cfa70 con 0x7f426013fef0 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.473+0000 7f4268400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42600cf8f0 con 0x7f426013fae0 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.473+0000 7f4268400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42600cfbf0 con 0x7f4260142e40 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f426013fef0 0x7f426013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f426013fef0 0x7f426013e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58992/0 (socket says 172.21.15.118:58992) 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 -- 172.21.15.118:0/2081462569 learned_addr learned my addr 172.21.15.118:0/2081462569 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265a00640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426013fae0 0x7f42601f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4266400640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4260142e40 0x7f426013e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 -- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4260142e40 msgr2=0x7f426013e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4260142e40 0x7f426013e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 -- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426013fae0 msgr2=0x7f42601f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426013fae0 0x7f42601f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 -- 172.21.15.118:0/2081462569 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42601575d0 con 0x7f426013fef0 2024-09-21T06:08:50.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265a00640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426013fae0 0x7f42601f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:08:50.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.474+0000 7f4265000640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f426013fef0 0x7f426013e1b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c400 tx=0x7f424c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:50.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.475+0000 7f425d600640 1 -- 172.21.15.118:0/2081462569 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c017070 con 0x7f426013fef0 2024-09-21T06:08:50.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.475+0000 7f425d600640 1 -- 172.21.15.118:0/2081462569 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f424c0053c0 con 0x7f426013fef0 2024-09-21T06:08:50.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.475+0000 7f425d600640 1 -- 172.21.15.118:0/2081462569 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c003850 con 0x7f426013fef0 2024-09-21T06:08:50.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.475+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42601415b0 con 0x7f426013fef0 2024-09-21T06:08:50.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.475+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4260157b50 con 0x7f426013fef0 2024-09-21T06:08:50.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.476+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42601f4cc0 con 0x7f426013fef0 2024-09-21T06:08:50.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.477+0000 7f425d600640 1 -- 172.21.15.118:0/2081462569 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f424c01a070 con 0x7f426013fef0 2024-09-21T06:08:50.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.479+0000 7f425d600640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4240078b90 0x7f424007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:50.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.479+0000 7f425d600640 1 -- 172.21.15.118:0/2081462569 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f424c099c60 con 0x7f426013fef0 2024-09-21T06:08:50.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.479+0000 7f4265a00640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4240078b90 0x7f424007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:50.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.480+0000 7f4265a00640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4240078b90 0x7f424007b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4254009f20 tx=0x7f4254005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.483+0000 7f425d600640 1 -- 172.21.15.118:0/2081462569 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f424c061dd0 con 0x7f426013fef0 2024-09-21T06:08:50.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.737+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7f42600d0110 con 0x7f426013fef0 2024-09-21T06:08:50.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.760+0000 7f425d600640 1 -- 172.21.15.118:0/2081462569 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v254) ==== 133+0+0 (secure 0 0 0) 0x7f424c066800 con 0x7f426013fef0 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4240078b90 msgr2=0x7f424007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4240078b90 0x7f424007b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4254009f20 tx=0x7f4254005f90 comp rx=0 tx=0).stop 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f426013fef0 msgr2=0x7f426013e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f426013fef0 0x7f426013e1b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c400 tx=0x7f424c00c8c0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 shutdown_connections 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4240078b90 0x7f424007b0a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4260142e40 0x7f426013e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f426013fef0 0x7f426013e1b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 --2- 172.21.15.118:0/2081462569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f426013fae0 0x7f42601f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 >> 172.21.15.118:0/2081462569 conn(0x7f426006d110 msgr2=0x7f426015f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:50.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 shutdown_connections 2024-09-21T06:08:50.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:50.762+0000 7f4268400640 1 -- 172.21.15.118:0/2081462569 wait complete. 2024-09-21T06:08:50.786 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-21T06:08:50.786 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-21T06:08:50.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:08:51.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 -- 172.21.15.118:0/1223401066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ae10 msgr2=0x7f17140749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 --2- 172.21.15.118:0/1223401066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ae10 0x7f17140749d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1704009830 tx=0x7f170402a480 comp rx=0 tx=0).stop 2024-09-21T06:08:51.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 -- 172.21.15.118:0/1223401066 shutdown_connections 2024-09-21T06:08:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 --2- 172.21.15.118:0/1223401066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f171415ea10 0x7f171415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 --2- 172.21.15.118:0/1223401066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ae10 0x7f17140749d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 -- 172.21.15.118:0/1223401066 >> 172.21.15.118:0/1223401066 conn(0x7f171406d6e0 msgr2=0x7f17140b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 -- 172.21.15.118:0/1223401066 shutdown_connections 2024-09-21T06:08:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.007+0000 7f1718c00640 1 -- 172.21.15.118:0/1223401066 wait complete. 2024-09-21T06:08:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.009+0000 7f1718c00640 1 Processor -- start 2024-09-21T06:08:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.009+0000 7f1718c00640 1 -- start start 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1718c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17140b3bb0 0x7f171415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1718c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171415ae10 0x7f171414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1718c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ea10 0x7f1714153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1718c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1714070d30 con 0x7f171415ae10 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1718c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1714070bb0 con 0x7f171415ea10 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1718c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1714074190 con 0x7f17140b3bb0 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171415ae10 0x7f171414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171415ae10 0x7f171414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59008/0 (socket says 172.21.15.118:59008) 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 -- 172.21.15.118:0/1821558364 learned_addr learned my addr 172.21.15.118:0/1821558364 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1713400640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17140b3bb0 0x7f171415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1713e00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ea10 0x7f1714153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 -- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17140b3bb0 msgr2=0x7f171415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17140b3bb0 0x7f171415deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 -- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ea10 msgr2=0x7f1714153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ea10 0x7f1714153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f170be00640 1 -- 172.21.15.118:0/1821558364 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171415e3f0 con 0x7f171415ae10 2024-09-21T06:08:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.011+0000 7f1713e00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ea10 0x7f1714153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:08:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.012+0000 7f170be00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171415ae10 0x7f171414ff80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e9c0 tx=0x7f16fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.012+0000 7f170b400640 1 -- 172.21.15.118:0/1821558364 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00ccc0 con 0x7f171415ae10 2024-09-21T06:08:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.012+0000 7f170b400640 1 -- 172.21.15.118:0/1821558364 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16fc004020 con 0x7f171415ae10 2024-09-21T06:08:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.012+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17140ccc30 con 0x7f171415ae10 2024-09-21T06:08:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.012+0000 7f170b400640 1 -- 172.21.15.118:0/1821558364 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00ce60 con 0x7f171415ae10 2024-09-21T06:08:51.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.012+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171415d6d0 con 0x7f171415ae10 2024-09-21T06:08:51.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.013+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17141527a0 con 0x7f171415ae10 2024-09-21T06:08:51.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.015+0000 7f170b400640 1 -- 172.21.15.118:0/1821558364 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16fc0035f0 con 0x7f171415ae10 2024-09-21T06:08:51.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.015+0000 7f170b400640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16f0078b90 0x7f16f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.016+0000 7f170b400640 1 -- 172.21.15.118:0/1821558364 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f16fc09b3a0 con 0x7f171415ae10 2024-09-21T06:08:51.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.016+0000 7f1713400640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16f0078b90 0x7f16f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.017+0000 7f1713400640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16f0078b90 0x7f16f007b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1704034000 tx=0x7f1704004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:51.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.020+0000 7f170b400640 1 -- 172.21.15.118:0/1821558364 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f16fc063a40 con 0x7f171415ae10 2024-09-21T06:08:51.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.211+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17140749d0 con 0x7f171415ae10 2024-09-21T06:08:51.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.212+0000 7f170b400640 1 -- 172.21.15.118:0/1821558364 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+13105 (secure 0 0 0) 0x7f16fc063340 con 0x7f171415ae10 2024-09-21T06:08:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:51.214 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":91,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:08:49.753447+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6835/186206042":"2024-09-22T06:08:46.644861+0000","172.21.15.118:6834/186206042":"2024-09-22T06:08:46.644861+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:08:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16f0078b90 msgr2=0x7f16f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16f0078b90 0x7f16f007b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1704034000 tx=0x7f1704004730 comp rx=0 tx=0).stop 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171415ae10 msgr2=0x7f171414ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171415ae10 0x7f171414ff80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e9c0 tx=0x7f16fc00ee80 comp rx=0 tx=0).stop 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 shutdown_connections 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f171415ea10 0x7f1714153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171415ae10 0x7f171414ff80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16f0078b90 0x7f16f007b0a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 --2- 172.21.15.118:0/1821558364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17140b3bb0 0x7f171415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 >> 172.21.15.118:0/1821558364 conn(0x7f171406d6e0 msgr2=0x7f17140ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 shutdown_connections 2024-09-21T06:08:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.214+0000 7f1718c00640 1 -- 172.21.15.118:0/1821558364 wait complete. 2024-09-21T06:08:51.239 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:08:51.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:08:51.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.458+0000 7f91ef800640 1 -- 172.21.15.118:0/3149523073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 msgr2=0x7f91e815fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.458+0000 7f91ef800640 1 --2- 172.21.15.118:0/3149523073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e815fe90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f91d4005fd0 tx=0x7f91d402a540 comp rx=0 tx=0).stop 2024-09-21T06:08:51.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.459+0000 7f91ef800640 1 -- 172.21.15.118:0/3149523073 shutdown_connections 2024-09-21T06:08:51.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.459+0000 7f91ef800640 1 --2- 172.21.15.118:0/3149523073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e815fe90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.459+0000 7f91ef800640 1 --2- 172.21.15.118:0/3149523073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e815bf90 0x7f91e815f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.459+0000 7f91ef800640 1 -- 172.21.15.118:0/3149523073 >> 172.21.15.118:0/3149523073 conn(0x7f91e80cdbd0 msgr2=0x7f91e80cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:51.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.459+0000 7f91ef800640 1 -- 172.21.15.118:0/3149523073 shutdown_connections 2024-09-21T06:08:51.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.459+0000 7f91ef800640 1 -- 172.21.15.118:0/3149523073 wait complete. 2024-09-21T06:08:51.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.461+0000 7f91ef800640 1 Processor -- start 2024-09-21T06:08:51.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.461+0000 7f91ef800640 1 -- start start 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ef800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e80cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ef800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e80b0410 0x7f91e815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ef800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91e815bf90 0x7f91e80ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ef800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f91e80b4830 con 0x7f91e8068f10 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ef800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91e80b46b0 con 0x7f91e815bf90 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ef800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f91e80b49b0 con 0x7f91e80b0410 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e80cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e80cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59032/0 (socket says 172.21.15.118:59032) 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 -- 172.21.15.118:0/2245449491 learned_addr learned my addr 172.21.15.118:0/2245449491 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91e7e00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e80b0410 0x7f91e815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ed800640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91e815bf90 0x7f91e80ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 -- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e80b0410 msgr2=0x7f91e815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e80b0410 0x7f91e815a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 -- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91e815bf90 msgr2=0x7f91e80ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91e815bf90 0x7f91e80ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91ece00640 1 -- 172.21.15.118:0/2245449491 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e80cbd50 con 0x7f91e8068f10 2024-09-21T06:08:51.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.463+0000 7f91e7e00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e80b0410 0x7f91e815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:51.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.464+0000 7f91ece00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e80cb3e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e7c0 tx=0x7f91d800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.464+0000 7f91e4c00640 1 -- 172.21.15.118:0/2245449491 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d800cc60 con 0x7f91e8068f10 2024-09-21T06:08:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.464+0000 7f91e4c00640 1 -- 172.21.15.118:0/2245449491 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91d8010430 con 0x7f91e8068f10 2024-09-21T06:08:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.464+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e80cc030 con 0x7f91e8068f10 2024-09-21T06:08:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.464+0000 7f91e4c00640 1 -- 172.21.15.118:0/2245449491 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8010860 con 0x7f91e8068f10 2024-09-21T06:08:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.464+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e815c5b0 con 0x7f91e8068f10 2024-09-21T06:08:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.465+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e815c3a0 con 0x7f91e8068f10 2024-09-21T06:08:51.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.466+0000 7f91e4c00640 1 -- 172.21.15.118:0/2245449491 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91d8010a00 con 0x7f91e8068f10 2024-09-21T06:08:51.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.468+0000 7f91e4c00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f91c8078bc0 0x7f91c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.468+0000 7f91e4c00640 1 -- 172.21.15.118:0/2245449491 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f91d809b400 con 0x7f91e8068f10 2024-09-21T06:08:51.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.468+0000 7f91e7e00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f91c8078bc0 0x7f91c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.469+0000 7f91e7e00640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f91c8078bc0 0x7f91c807b0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f91d4033000 tx=0x7f91d4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:51.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.473+0000 7f91e4c00640 1 -- 172.21.15.118:0/2245449491 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f91d8063b30 con 0x7f91e8068f10 2024-09-21T06:08:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.654+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91e80b3fa0 con 0x7f91e8068f10 2024-09-21T06:08:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.655+0000 7f91e4c00640 1 -- 172.21.15.118:0/2245449491 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f91d8063430 con 0x7f91e8068f10 2024-09-21T06:08:51.657 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f91c8078bc0 msgr2=0x7f91c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f91c8078bc0 0x7f91c807b0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f91d4033000 tx=0x7f91d4004730 comp rx=0 tx=0).stop 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 msgr2=0x7f91e80cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e80cb3e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e7c0 tx=0x7f91d800ec80 comp rx=0 tx=0).stop 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 shutdown_connections 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91e815bf90 0x7f91e80ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f91c8078bc0 0x7f91c807b0d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e80b0410 0x7f91e815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 --2- 172.21.15.118:0/2245449491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91e8068f10 0x7f91e80cb3e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 >> 172.21.15.118:0/2245449491 conn(0x7f91e80cdbd0 msgr2=0x7f91e815b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:51.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 shutdown_connections 2024-09-21T06:08:51.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.657+0000 7f91ef800640 1 -- 172.21.15.118:0/2245449491 wait complete. 2024-09-21T06:08:51.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-21T06:08:51.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 -- 172.21.15.118:0/3531465637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad80b5e30 msgr2=0x7f8ad815c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 --2- 172.21.15.118:0/3531465637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad80b5e30 0x7f8ad815c5c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8072660 tx=0x7f8ad002aa30 comp rx=0 tx=0).stop 2024-09-21T06:08:51.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 -- 172.21.15.118:0/3531465637 shutdown_connections 2024-09-21T06:08:51.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 --2- 172.21.15.118:0/3531465637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad80b5e30 0x7f8ad815c5c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 --2- 172.21.15.118:0/3531465637 >> v2:172.21.15.149:3300/0 conn(0x7f8ad8152d10 0x7f8ad8072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 -- 172.21.15.118:0/3531465637 >> 172.21.15.118:0/3531465637 conn(0x7f8ad80b2860 msgr2=0x7f8ad80b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:51.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 -- 172.21.15.118:0/3531465637 shutdown_connections 2024-09-21T06:08:51.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.902+0000 7f8adf600640 1 -- 172.21.15.118:0/3531465637 wait complete. 2024-09-21T06:08:51.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.904+0000 7f8adf600640 1 Processor -- start 2024-09-21T06:08:51.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.904+0000 7f8adf600640 1 -- start start 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adf600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad8152d10 0x7f8ad814d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adf600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ad815c1b0 0x7f8ad80b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adf600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ad814dee0 0x7f8ad80b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adf600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80b47d0 con 0x7f8ad8152d10 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adf600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80b4650 con 0x7f8ad815c1b0 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adf600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad80b4950 con 0x7f8ad814dee0 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad8152d10 0x7f8ad814d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad8152d10 0x7f8ad814d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59044/0 (socket says 172.21.15.118:59044) 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 -- 172.21.15.118:0/2671239857 learned_addr learned my addr 172.21.15.118:0/2671239857 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:51.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8ad7e00640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ad815c1b0 0x7f8ad80b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8add600640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ad814dee0 0x7f8ad80b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 -- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ad814dee0 msgr2=0x7f8ad80b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ad814dee0 0x7f8ad80b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 -- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ad815c1b0 msgr2=0x7f8ad80b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:51.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ad815c1b0 0x7f8ad80b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:51.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.906+0000 7f8adcc00640 1 -- 172.21.15.118:0/2671239857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad81f9120 con 0x7f8ad8152d10 2024-09-21T06:08:51.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.907+0000 7f8adcc00640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad8152d10 0x7f8ad814d6e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00d770 tx=0x7f8acc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:51.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.907+0000 7f8ad4c00640 1 -- 172.21.15.118:0/2671239857 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc017070 con 0x7f8ad8152d10 2024-09-21T06:08:51.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.907+0000 7f8ad4c00640 1 -- 172.21.15.118:0/2671239857 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8acc009d20 con 0x7f8ad8152d10 2024-09-21T06:08:51.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.907+0000 7f8ad4c00640 1 -- 172.21.15.118:0/2671239857 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc004280 con 0x7f8ad8152d10 2024-09-21T06:08:51.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.907+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad81f9400 con 0x7f8ad8152d10 2024-09-21T06:08:51.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.907+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad81f99c0 con 0x7f8ad8152d10 2024-09-21T06:08:51.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.908+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad80b4e00 con 0x7f8ad8152d10 2024-09-21T06:08:51.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.909+0000 7f8ad4c00640 1 -- 172.21.15.118:0/2671239857 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8acc005020 con 0x7f8ad8152d10 2024-09-21T06:08:51.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.910+0000 7f8ad4c00640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ab8078b90 0x7f8ab807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:51.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.910+0000 7f8ad4c00640 1 -- 172.21.15.118:0/2671239857 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f8acc09acb0 con 0x7f8ad8152d10 2024-09-21T06:08:51.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.911+0000 7f8ad7e00640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ab8078b90 0x7f8ab807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:51.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.911+0000 7f8ad7e00640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ab8078b90 0x7f8ab807b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8ad81f8d10 tx=0x7f8ac4009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:51.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:51.915+0000 7f8ad4c00640 1 -- 172.21.15.118:0/2671239857 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8acc020020 con 0x7f8ad8152d10 2024-09-21T06:08:52.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.171+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7f8ad80afd50 con 0x7f8ad8152d10 2024-09-21T06:08:52.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.770+0000 7f8ad4c00640 1 -- 172.21.15.118:0/2671239857 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v256) ==== 140+0+0 (secure 0 0 0) 0x7f8acc062e30 con 0x7f8ad8152d10 2024-09-21T06:08:52.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.772+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ab8078b90 msgr2=0x7f8ab807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:52.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.772+0000 7f8adf600640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ab8078b90 0x7f8ab807b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8ad81f8d10 tx=0x7f8ac4009060 comp rx=0 tx=0).stop 2024-09-21T06:08:52.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.772+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad8152d10 msgr2=0x7f8ad814d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:52.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.772+0000 7f8adf600640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad8152d10 0x7f8ad814d6e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00d770 tx=0x7f8acc00dc30 comp rx=0 tx=0).stop 2024-09-21T06:08:52.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 shutdown_connections 2024-09-21T06:08:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ab8078b90 0x7f8ab807b0a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ad814dee0 0x7f8ad80b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ad815c1b0 0x7f8ad80b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 --2- 172.21.15.118:0/2671239857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad8152d10 0x7f8ad814d6e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 >> 172.21.15.118:0/2671239857 conn(0x7f8ad80b2860 msgr2=0x7f8ad815e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 shutdown_connections 2024-09-21T06:08:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:52.773+0000 7f8adf600640 1 -- 172.21.15.118:0/2671239857 wait complete. 2024-09-21T06:08:52.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-21T06:08:53.032 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_objectstore":"memstore"} 2024-09-21T06:08:53.033 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-21T06:08:53.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:08:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.250+0000 7f2e31c00640 1 -- 172.21.15.118:0/2987572884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e10003c10 msgr2=0x7f2e10004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.250+0000 7f2e31c00640 1 --2- 172.21.15.118:0/2987572884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e10003c10 0x7f2e10004060 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009b50 tx=0x7f2e10005830 comp rx=0 tx=0).stop 2024-09-21T06:08:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.250+0000 7f2e2b400640 1 -- 172.21.15.118:0/2987572884 reap_dead start 2024-09-21T06:08:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.250+0000 7f2e31c00640 1 -- 172.21.15.118:0/2987572884 shutdown_connections 2024-09-21T06:08:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.250+0000 7f2e31c00640 1 -- 172.21.15.118:0/2987572884 >> 172.21.15.118:0/2987572884 conn(0x7f2e2c06d110 msgr2=0x7f2e2c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.250+0000 7f2e31c00640 1 -- 172.21.15.118:0/2987572884 shutdown_connections 2024-09-21T06:08:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.250+0000 7f2e31c00640 1 -- 172.21.15.118:0/2987572884 wait complete. 2024-09-21T06:08:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.253+0000 7f2e31c00640 1 Processor -- start 2024-09-21T06:08:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.253+0000 7f2e31c00640 1 -- start start 2024-09-21T06:08:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e31c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e10003c10 0x7f2e2c1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e31c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e2c156ec0 0x7f2e2c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e31c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e2c1f4490 0x7f2e2c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e31c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c0d0020 con 0x7f2e2c156ec0 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e31c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c0cfea0 con 0x7f2e2c1f4490 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e31c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2c0d01a0 con 0x7f2e10003c10 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e22000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e2c156ec0 0x7f2e2c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e22000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e2c156ec0 0x7f2e2c15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59056/0 (socket says 172.21.15.118:59056) 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.254+0000 7f2e22000640 1 -- 172.21.15.118:0/4262064703 learned_addr learned my addr 172.21.15.118:0/4262064703 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e2aa00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e10003c10 0x7f2e2c1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e2b400640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e2c1f4490 0x7f2e2c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e22000640 1 -- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e10003c10 msgr2=0x7f2e2c1f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e22000640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e10003c10 0x7f2e2c1f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e22000640 1 -- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e2c1f4490 msgr2=0x7f2e2c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e22000640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e2c1f4490 0x7f2e2c159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e22000640 1 -- 172.21.15.118:0/4262064703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c154ee0 con 0x7f2e2c156ec0 2024-09-21T06:08:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e22000640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e2c156ec0 0x7f2e2c15c4c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2e14004de0 tx=0x7f2e14001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e23400640 1 -- 172.21.15.118:0/4262064703 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14010950 con 0x7f2e2c156ec0 2024-09-21T06:08:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.255+0000 7f2e23400640 1 -- 172.21.15.118:0/4262064703 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e14016070 con 0x7f2e2c156ec0 2024-09-21T06:08:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.256+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c1551a0 con 0x7f2e2c156ec0 2024-09-21T06:08:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.256+0000 7f2e23400640 1 -- 172.21.15.118:0/4262064703 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14010e40 con 0x7f2e2c156ec0 2024-09-21T06:08:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.256+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c15ca00 con 0x7f2e2c156ec0 2024-09-21T06:08:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.257+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c0cf580 con 0x7f2e2c156ec0 2024-09-21T06:08:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.258+0000 7f2e23400640 1 -- 172.21.15.118:0/4262064703 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e1401b460 con 0x7f2e2c156ec0 2024-09-21T06:08:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.259+0000 7f2e23400640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2e08078b90 0x7f2e0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.259+0000 7f2e23400640 1 -- 172.21.15.118:0/4262064703 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f2e1409b390 con 0x7f2e2c156ec0 2024-09-21T06:08:53.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.259+0000 7f2e2aa00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2e08078b90 0x7f2e0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.260+0000 7f2e2aa00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2e08078b90 0x7f2e0807b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c035000 tx=0x7f2e1c02d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:53.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.264+0000 7f2e23400640 1 -- 172.21.15.118:0/4262064703 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2e14063ac0 con 0x7f2e2c156ec0 2024-09-21T06:08:53.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.452+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f2e2c142ba0 con 0x7f2e2c156ec0 2024-09-21T06:08:53.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.453+0000 7f2e23400640 1 -- 172.21.15.118:0/4262064703 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1472 (secure 0 0 0) 0x7f2e140633c0 con 0x7f2e2c156ec0 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:08:53.456 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:08:53.457 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:08:53.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2e08078b90 msgr2=0x7f2e0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2e08078b90 0x7f2e0807b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c035000 tx=0x7f2e1c02d040 comp rx=0 tx=0).stop 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e2c156ec0 msgr2=0x7f2e2c15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e2c156ec0 0x7f2e2c15c4c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2e14004de0 tx=0x7f2e14001800 comp rx=0 tx=0).stop 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 shutdown_connections 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e2c1f4490 0x7f2e2c159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e2c156ec0 0x7f2e2c15c4c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2e08078b90 0x7f2e0807b0a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 --2- 172.21.15.118:0/4262064703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e10003c10 0x7f2e2c1f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 >> 172.21.15.118:0/4262064703 conn(0x7f2e2c06d110 msgr2=0x7f2e2c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 shutdown_connections 2024-09-21T06:08:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.456+0000 7f2e31c00640 1 -- 172.21.15.118:0/4262064703 wait complete. 2024-09-21T06:08:53.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:08:53.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.699+0000 7f1688200640 1 -- 172.21.15.118:0/1532318287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 msgr2=0x7f16800cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.699+0000 7f1688200640 1 --2- 172.21.15.118:0/1532318287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16800cd8f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f166c009830 tx=0x7f166c02a5c0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.700+0000 7f1688200640 1 -- 172.21.15.118:0/1532318287 shutdown_connections 2024-09-21T06:08:53.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.700+0000 7f1688200640 1 --2- 172.21.15.118:0/1532318287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16800cd8f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.700+0000 7f1688200640 1 -- 172.21.15.118:0/1532318287 >> 172.21.15.118:0/1532318287 conn(0x7f168006ced0 msgr2=0x7f168006d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:53.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.700+0000 7f1688200640 1 -- 172.21.15.118:0/1532318287 shutdown_connections 2024-09-21T06:08:53.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.700+0000 7f1688200640 1 -- 172.21.15.118:0/1532318287 wait complete. 2024-09-21T06:08:53.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.702+0000 7f1688200640 1 Processor -- start 2024-09-21T06:08:53.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.702+0000 7f1688200640 1 -- start start 2024-09-21T06:08:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.703+0000 7f1688200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1680070220 0x7f16801493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.703+0000 7f1688200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16800742d0 0x7f16801571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.703+0000 7f1688200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16801576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.703+0000 7f1688200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16800cc7f0 con 0x7f16800cd4e0 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.703+0000 7f1688200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16800cc670 con 0x7f16800742d0 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.703+0000 7f1688200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16800cc970 con 0x7f1680070220 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16801576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16801576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59076/0 (socket says 172.21.15.118:59076) 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 -- 172.21.15.118:0/902682862 learned_addr learned my addr 172.21.15.118:0/902682862 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1685800640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1680070220 0x7f16801493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1684e00640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16800742d0 0x7f16801571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 -- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1680070220 msgr2=0x7f16801493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1680070220 0x7f16801493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 -- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16800742d0 msgr2=0x7f16801571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16800742d0 0x7f16801571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 -- 172.21.15.118:0/902682862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16800b6380 con 0x7f16800cd4e0 2024-09-21T06:08:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.704+0000 7f1686200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16801576f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f167800c3c0 tx=0x7f167800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.705+0000 7f167d600640 1 -- 172.21.15.118:0/902682862 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678017070 con 0x7f16800cd4e0 2024-09-21T06:08:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.705+0000 7f167d600640 1 -- 172.21.15.118:0/902682862 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1678006d90 con 0x7f16800cd4e0 2024-09-21T06:08:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.705+0000 7f167d600640 1 -- 172.21.15.118:0/902682862 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678007290 con 0x7f16800cd4e0 2024-09-21T06:08:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.705+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16800b6660 con 0x7f16800cd4e0 2024-09-21T06:08:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.705+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1680158230 con 0x7f16800cd4e0 2024-09-21T06:08:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.706+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16800b60f0 con 0x7f16800cd4e0 2024-09-21T06:08:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.707+0000 7f167d600640 1 -- 172.21.15.118:0/902682862 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f167801a070 con 0x7f16800cd4e0 2024-09-21T06:08:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.708+0000 7f167d600640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1660078b90 0x7f166007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.708+0000 7f167d600640 1 -- 172.21.15.118:0/902682862 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f1678099b80 con 0x7f16800cd4e0 2024-09-21T06:08:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.709+0000 7f1685800640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1660078b90 0x7f166007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.709+0000 7f1685800640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1660078b90 0x7f166007b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1674001e20 tx=0x7f1674009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:53.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.712+0000 7f167d600640 1 -- 172.21.15.118:0/902682862 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1680074df0 con 0x7f16800cd4e0 2024-09-21T06:08:53.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.901+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1680076fe0 con 0x7f16800cd4e0 2024-09-21T06:08:53.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.905+0000 7f167d600640 1 -- 172.21.15.118:0/902682862 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f1678061e00 con 0x7f16800cd4e0 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1660078b90 msgr2=0x7f166007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1660078b90 0x7f166007b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1674001e20 tx=0x7f1674009040 comp rx=0 tx=0).stop 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 msgr2=0x7f16801576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16801576f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f167800c3c0 tx=0x7f167800c880 comp rx=0 tx=0).stop 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 shutdown_connections 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16800cd4e0 0x7f16801576f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16800742d0 0x7f16801571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1660078b90 0x7f166007b0a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 --2- 172.21.15.118:0/902682862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1680070220 0x7f16801493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 >> 172.21.15.118:0/902682862 conn(0x7f168006ced0 msgr2=0x7f1680159260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 shutdown_connections 2024-09-21T06:08:53.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:53.908+0000 7f1688200640 1 -- 172.21.15.118:0/902682862 wait complete. 2024-09-21T06:08:53.933 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:08:53.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:08:54.036 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:08:54.117 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:08:54.117 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:08:54.117 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:54.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:08:54.152 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:08:54.152 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:54.189 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:08:54.189 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:08:54.189 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:54.228 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:08:54.228 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:08:54.228 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:08:54.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:08:54.266 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:08:54.266 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:08:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 -- 172.21.15.118:0/784060808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 msgr2=0x7f9ce80b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 --2- 172.21.15.118:0/784060808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce80b3a60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80b46a0 tx=0x7f9cd802a4b0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 -- 172.21.15.118:0/784060808 shutdown_connections 2024-09-21T06:08:54.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 --2- 172.21.15.118:0/784060808 >> v2:172.21.15.149:3300/0 conn(0x7f9ce80b5450 0x7f9ce80ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 --2- 172.21.15.118:0/784060808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ce80b5040 0x7f9ce80cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 --2- 172.21.15.118:0/784060808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce80b3a60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 -- 172.21.15.118:0/784060808 >> 172.21.15.118:0/784060808 conn(0x7f9ce806d110 msgr2=0x7f9ce806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:54.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 -- 172.21.15.118:0/784060808 shutdown_connections 2024-09-21T06:08:54.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.484+0000 7f9cefa00640 1 -- 172.21.15.118:0/784060808 wait complete. 2024-09-21T06:08:54.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.487+0000 7f9cefa00640 1 Processor -- start 2024-09-21T06:08:54.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.487+0000 7f9cefa00640 1 -- start start 2024-09-21T06:08:54.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9cefa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce80b5040 0x7f9ce81f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:54.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9cefa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ce80b5450 0x7f9ce80b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:54.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9cefa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce806ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:54.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9cefa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce81601a0 con 0x7f9ce815cfd0 2024-09-21T06:08:54.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9cefa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce8160020 con 0x7f9ce80b5040 2024-09-21T06:08:54.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9cefa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce8160320 con 0x7f9ce80b5450 2024-09-21T06:08:54.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9ceda00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce806ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9ceda00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce806ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59094/0 (socket says 172.21.15.118:59094) 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9ceda00640 1 -- 172.21.15.118:0/2443148213 learned_addr learned my addr 172.21.15.118:0/2443148213 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.488+0000 7f9ced000640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce80b5040 0x7f9ce81f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ce7e00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ce80b5450 0x7f9ce80b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ceda00640 1 -- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ce80b5450 msgr2=0x7f9ce80b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ceda00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ce80b5450 0x7f9ce80b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ceda00640 1 -- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce80b5040 msgr2=0x7f9ce81f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ceda00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce80b5040 0x7f9ce81f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ceda00640 1 -- 172.21.15.118:0/2443148213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce81f74f0 con 0x7f9ce815cfd0 2024-09-21T06:08:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ceda00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce806ebd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cad0 tx=0x7f9ce000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ce4c00640 1 -- 172.21.15.118:0/2443148213 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000ae20 con 0x7f9ce815cfd0 2024-09-21T06:08:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ce4c00640 1 -- 172.21.15.118:0/2443148213 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ce000f450 con 0x7f9ce815cfd0 2024-09-21T06:08:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9ce4c00640 1 -- 172.21.15.118:0/2443148213 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000f8c0 con 0x7f9ce815cfd0 2024-09-21T06:08:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce81f5030 con 0x7f9ce815cfd0 2024-09-21T06:08:54.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.489+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce81f79f0 con 0x7f9ce815cfd0 2024-09-21T06:08:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.491+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce8160840 con 0x7f9ce815cfd0 2024-09-21T06:08:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.492+0000 7f9ce4c00640 1 -- 172.21.15.118:0/2443148213 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ce000fa60 con 0x7f9ce815cfd0 2024-09-21T06:08:54.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.493+0000 7f9ce4c00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cc8078b90 0x7f9cc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:54.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.493+0000 7f9ce4c00640 1 -- 172.21.15.118:0/2443148213 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f9ce009b440 con 0x7f9ce815cfd0 2024-09-21T06:08:54.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.493+0000 7f9ced000640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cc8078b90 0x7f9cc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:54.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.494+0000 7f9ced000640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cc8078b90 0x7f9cc807b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8033000 tx=0x7f9cd8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:54.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.497+0000 7f9ce4c00640 1 -- 172.21.15.118:0/2443148213 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9ce0014030 con 0x7f9ce815cfd0 2024-09-21T06:08:54.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.716+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ce81f7780 con 0x7f9ce815cfd0 2024-09-21T06:08:54.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.717+0000 7f9ce4c00640 1 -- 172.21.15.118:0/2443148213 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+3911 (secure 0 0 0) 0x7f9ce00635c0 con 0x7f9ce815cfd0 2024-09-21T06:08:54.720 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:54.720 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":45,"btime":"2024-09-21T06:08:47:738638+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/106281747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":106281747},{"type":"v1","addr":"172.21.15.149:6836","nonce":106281747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5345,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/79849637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":79849637},{"type":"v1","addr":"172.21.15.149:6837","nonce":79849637}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/907442730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":907442730},{"type":"v1","addr":"172.21.15.118:6833","nonce":907442730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3571340591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3571340591},{"type":"v1","addr":"172.21.15.118:6835","nonce":3571340591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[]} 2024-09-21T06:08:54.720 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 45 2024-09-21T06:08:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.719+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cc8078b90 msgr2=0x7f9cc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.719+0000 7f9cefa00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cc8078b90 0x7f9cc807b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8033000 tx=0x7f9cd8004730 comp rx=0 tx=0).stop 2024-09-21T06:08:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.719+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 msgr2=0x7f9ce806ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.719+0000 7f9cefa00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce806ebd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cad0 tx=0x7f9ce000cf90 comp rx=0 tx=0).stop 2024-09-21T06:08:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 shutdown_connections 2024-09-21T06:08:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce815cfd0 0x7f9ce806ebd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cc8078b90 0x7f9cc807b0a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ce80b5450 0x7f9ce80b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 --2- 172.21.15.118:0/2443148213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce80b5040 0x7f9ce81f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 >> 172.21.15.118:0/2443148213 conn(0x7f9ce806d110 msgr2=0x7f9ce8156300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 shutdown_connections 2024-09-21T06:08:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:54.720+0000 7f9cefa00640 1 -- 172.21.15.118:0/2443148213 wait complete. 2024-09-21T06:08:54.743 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:08:54.744 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:08:54.744 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:08:54.744 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:08:54.744 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:08:54.744 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:08:54.744 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:08:54.744 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:08:54.745 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:08:54.745 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:08:54.745 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:08:54.745 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:08:54.745 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:08:54.745 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:08:54.746 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:08:54.746 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:08:54.769 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:08:54.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:08:54.771 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:08:54.771 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:08:54.772 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:08:54.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:08:54.773 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:08:54.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:08:54.815 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:08:54.815 DEBUG:teuthology.parallel:result is None 2024-09-21T06:08:54.816 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:08:54.816 DEBUG:teuthology.parallel:result is None 2024-09-21T06:08:54.817 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:08:54.818 DEBUG:teuthology.parallel:result is None 2024-09-21T06:08:54.818 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:08:54.819 DEBUG:teuthology.parallel:result is None 2024-09-21T06:08:54.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:08:55.011 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:08:55.012 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:08:55.013 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:08:55.013 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:08:55.015 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:08:55.013+0000 7fe4efe00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-21T06:08:55.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 -- 172.21.15.118:0/1248724615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a80aede0 msgr2=0x7f62a80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:55.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 --2- 172.21.15.118:0/1248724615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a80aede0 0x7f62a80af1f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f62a80b4970 tx=0x7f62a002aa30 comp rx=0 tx=0).stop 2024-09-21T06:08:55.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 -- 172.21.15.118:0/1248724615 shutdown_connections 2024-09-21T06:08:55.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 --2- 172.21.15.118:0/1248724615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a80aede0 0x7f62a80af1f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 --2- 172.21.15.118:0/1248724615 >> v2:172.21.15.149:3300/0 conn(0x7f62a80b73c0 0x7f62a8162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 -- 172.21.15.118:0/1248724615 >> 172.21.15.118:0/1248724615 conn(0x7f62a80b38e0 msgr2=0x7f62a80b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:55.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 -- 172.21.15.118:0/1248724615 shutdown_connections 2024-09-21T06:08:55.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.048+0000 7f62b0200640 1 -- 172.21.15.118:0/1248724615 wait complete. 2024-09-21T06:08:55.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.051+0000 7f62b0200640 1 Processor -- start 2024-09-21T06:08:55.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.051+0000 7f62b0200640 1 -- start start 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62b0200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a806fe70 0x7f62a8149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62b0200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a80aede0 0x7f62a81f95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62b0200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a80b73c0 0x7f62a81f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62b0200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f62a806ce70 con 0x7f62a806fe70 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62b0200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f62a806ccf0 con 0x7f62a80aede0 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62b0200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62a806cff0 con 0x7f62a80b73c0 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62ad800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a806fe70 0x7f62a8149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62ad800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a806fe70 0x7f62a8149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59146/0 (socket says 172.21.15.118:59146) 2024-09-21T06:08:55.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.052+0000 7f62ad800640 1 -- 172.21.15.118:0/3304404346 learned_addr learned my addr 172.21.15.118:0/3304404346 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ae200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a80b73c0 0x7f62a81f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ace00640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a80aede0 0x7f62a81f95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ad800640 1 -- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a80b73c0 msgr2=0x7f62a81f9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ad800640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a80b73c0 0x7f62a81f9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ad800640 1 -- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a80aede0 msgr2=0x7f62a81f95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ad800640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a80aede0 0x7f62a81f95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ad800640 1 -- 172.21.15.118:0/3304404346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a81fa2c0 con 0x7f62a806fe70 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ae200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a80b73c0 0x7f62a81f9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ace00640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a80aede0 0x7f62a81f95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62ad800640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a806fe70 0x7f62a8149eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f629c00c3d0 tx=0x7f629c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62a5600640 1 -- 172.21.15.118:0/3304404346 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c017070 con 0x7f62a806fe70 2024-09-21T06:08:55.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62a5600640 1 -- 172.21.15.118:0/3304404346 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f629c0053c0 con 0x7f62a806fe70 2024-09-21T06:08:55.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a814c810 con 0x7f62a806fe70 2024-09-21T06:08:55.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.053+0000 7f62a5600640 1 -- 172.21.15.118:0/3304404346 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c003850 con 0x7f62a806fe70 2024-09-21T06:08:55.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.054+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a814d2f0 con 0x7f62a806fe70 2024-09-21T06:08:55.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.054+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a806d450 con 0x7f62a806fe70 2024-09-21T06:08:55.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.056+0000 7f62a5600640 1 -- 172.21.15.118:0/3304404346 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f629c01a070 con 0x7f62a806fe70 2024-09-21T06:08:55.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.057+0000 7f62a5600640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6288078b90 0x7f628807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:55.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.057+0000 7f62a5600640 1 -- 172.21.15.118:0/3304404346 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4943+0+0 (secure 0 0 0) 0x7f629c099e10 con 0x7f62a806fe70 2024-09-21T06:08:55.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.057+0000 7f62ace00640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6288078b90 0x7f628807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:55.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.058+0000 7f62ace00640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6288078b90 0x7f628807b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f62a815de20 tx=0x7f6294005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:55.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.061+0000 7f62a5600640 1 -- 172.21.15.118:0/3304404346 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f629c09d030 con 0x7f62a806fe70 2024-09-21T06:08:55.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.258+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f62a814d580 con 0x7f62a806fe70 2024-09-21T06:08:55.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.921+0000 7f62a5600640 1 -- 172.21.15.118:0/3304404346 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v93) ==== 97+0+0 (secure 0 0 0) 0x7f629c062540 con 0x7f62a806fe70 2024-09-21T06:08:55.923 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:08:55.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.923+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6288078b90 msgr2=0x7f628807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:55.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.923+0000 7f62b0200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6288078b90 0x7f628807b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f62a815de20 tx=0x7f6294005f90 comp rx=0 tx=0).stop 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.923+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a806fe70 msgr2=0x7f62a8149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.923+0000 7f62b0200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a806fe70 0x7f62a8149eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f629c00c3d0 tx=0x7f629c00c890 comp rx=0 tx=0).stop 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 shutdown_connections 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6288078b90 0x7f628807b0a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62a80b73c0 0x7f62a81f9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62a80aede0 0x7f62a81f95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 --2- 172.21.15.118:0/3304404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62a806fe70 0x7f62a8149eb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 >> 172.21.15.118:0/3304404346 conn(0x7f62a80b38e0 msgr2=0x7f62a815e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 shutdown_connections 2024-09-21T06:08:55.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:55.924+0000 7f62b0200640 1 -- 172.21.15.118:0/3304404346 wait complete. 2024-09-21T06:08:55.952 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:08:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.172+0000 7f126da00640 1 -- 172.21.15.118:0/1071256874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 msgr2=0x7f1268142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.172+0000 7f126da00640 1 --2- 172.21.15.118:0/1071256874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268142e40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1260005fd0 tx=0x7f126002aaa0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.172+0000 7f126da00640 1 -- 172.21.15.118:0/1071256874 shutdown_connections 2024-09-21T06:08:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.172+0000 7f126da00640 1 --2- 172.21.15.118:0/1071256874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268142e40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.172+0000 7f126da00640 1 -- 172.21.15.118:0/1071256874 >> 172.21.15.118:0/1071256874 conn(0x7f126806d110 msgr2=0x7f126806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.172+0000 7f126da00640 1 -- 172.21.15.118:0/1071256874 shutdown_connections 2024-09-21T06:08:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.172+0000 7f126da00640 1 -- 172.21.15.118:0/1071256874 wait complete. 2024-09-21T06:08:56.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.174+0000 7f126da00640 1 Processor -- start 2024-09-21T06:08:56.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.175+0000 7f126da00640 1 -- start start 2024-09-21T06:08:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f126da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f126813fae0 0x7f12681f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f126da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f126da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f126813de90 0x7f1268166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f126da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f12681682e0 con 0x7f126813fef0 2024-09-21T06:08:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f126da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1268168160 con 0x7f126813fae0 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f126da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1268168460 con 0x7f126813de90 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f1266000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f1266000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60722/0 (socket says 172.21.15.118:60722) 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f1266000640 1 -- 172.21.15.118:0/307469971 learned_addr learned my addr 172.21.15.118:0/307469971 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.176+0000 7f1266a00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f126813fae0 0x7f12681f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f1267400640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f126813de90 0x7f1268166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f1266000640 1 -- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f126813de90 msgr2=0x7f1268166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f1266000640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f126813de90 0x7f1268166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f1266000640 1 -- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f126813fae0 msgr2=0x7f12681f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f1266000640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f126813fae0 0x7f12681f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f1266000640 1 -- 172.21.15.118:0/307469971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1268140930 con 0x7f126813fef0 2024-09-21T06:08:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f1266000640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268141680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f125400c3d0 tx=0x7f125400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f125ea00640 1 -- 172.21.15.118:0/307469971 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254017070 con 0x7f126813fef0 2024-09-21T06:08:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f125ea00640 1 -- 172.21.15.118:0/307469971 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12540053c0 con 0x7f126813fef0 2024-09-21T06:08:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.177+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1268140ba0 con 0x7f126813fef0 2024-09-21T06:08:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.178+0000 7f125ea00640 1 -- 172.21.15.118:0/307469971 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254003850 con 0x7f126813fef0 2024-09-21T06:08:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.178+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1268141160 con 0x7f126813fef0 2024-09-21T06:08:56.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.179+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12680d0e80 con 0x7f126813fef0 2024-09-21T06:08:56.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.180+0000 7f125ea00640 1 -- 172.21.15.118:0/307469971 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f125401a070 con 0x7f126813fef0 2024-09-21T06:08:56.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.181+0000 7f125ea00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1248078bc0 0x7f124807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.181+0000 7f125ea00640 1 -- 172.21.15.118:0/307469971 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f1254099c70 con 0x7f126813fef0 2024-09-21T06:08:56.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.181+0000 7f1266a00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1248078bc0 0x7f124807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.182+0000 7f1266a00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1248078bc0 0x7f124807b0d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1258000f60 tx=0x7f1258009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:56.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.185+0000 7f125ea00640 1 -- 172.21.15.118:0/307469971 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1254061db0 con 0x7f126813fef0 2024-09-21T06:08:56.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.437+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f12680b5370 con 0x7f126813fef0 2024-09-21T06:08:56.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.438+0000 7f125ea00640 1 -- 172.21.15.118:0/307469971 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f12680b5370 con 0x7f126813fef0 2024-09-21T06:08:56.440 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.441 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:08:56.442 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.443 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.444 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.445 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.446 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.447 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:08:56.448 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.450 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:08:56.452 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.453 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:08:56.454 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:08:56.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1248078bc0 msgr2=0x7f124807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1248078bc0 0x7f124807b0d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1258000f60 tx=0x7f1258009040 comp rx=0 tx=0).stop 2024-09-21T06:08:56.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 msgr2=0x7f1268141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268141680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f125400c3d0 tx=0x7f125400c890 comp rx=0 tx=0).stop 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 shutdown_connections 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1248078bc0 0x7f124807b0d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f126813de90 0x7f1268166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f126813fef0 0x7f1268141680 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 --2- 172.21.15.118:0/307469971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f126813fae0 0x7f12681f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 >> 172.21.15.118:0/307469971 conn(0x7f126806d110 msgr2=0x7f1268142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 shutdown_connections 2024-09-21T06:08:56.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.440+0000 7f126da00640 1 -- 172.21.15.118:0/307469971 wait complete. 2024-09-21T06:08:56.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:08:56.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.684+0000 7f8f09800640 1 -- 172.21.15.118:0/402105506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 msgr2=0x7f8f04142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.684+0000 7f8f09800640 1 --2- 172.21.15.118:0/402105506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f04142c70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005fd0 tx=0x7f8efc02aa10 comp rx=0 tx=0).stop 2024-09-21T06:08:56.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.684+0000 7f8f09800640 1 -- 172.21.15.118:0/402105506 shutdown_connections 2024-09-21T06:08:56.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.684+0000 7f8f09800640 1 --2- 172.21.15.118:0/402105506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f04142c70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.684+0000 7f8f09800640 1 --2- 172.21.15.118:0/402105506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f040d1590 0x7f8f04142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.684+0000 7f8f09800640 1 -- 172.21.15.118:0/402105506 >> 172.21.15.118:0/402105506 conn(0x7f8f0406d110 msgr2=0x7f8f0406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:56.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.684+0000 7f8f09800640 1 -- 172.21.15.118:0/402105506 shutdown_connections 2024-09-21T06:08:56.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.685+0000 7f8f09800640 1 -- 172.21.15.118:0/402105506 wait complete. 2024-09-21T06:08:56.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.687+0000 7f8f09800640 1 Processor -- start 2024-09-21T06:08:56.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.687+0000 7f8f09800640 1 -- start start 2024-09-21T06:08:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.688+0000 7f8f09800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f0413fae0 0x7f8f0413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.688+0000 7f8f09800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f040b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.688+0000 7f8f09800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0415ca90 0x7f8f040b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.688+0000 7f8f09800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8f040cfb10 con 0x7f8f0413fef0 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.688+0000 7f8f09800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f040cf990 con 0x7f8f0415ca90 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.688+0000 7f8f09800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8f040cfc90 con 0x7f8f0413fae0 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f040b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f040b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60734/0 (socket says 172.21.15.118:60734) 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 -- 172.21.15.118:0/3424501297 learned_addr learned my addr 172.21.15.118:0/3424501297 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02a00640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f0413fae0 0x7f8f0413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f03400640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0415ca90 0x7f8f040b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 -- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f0413fae0 msgr2=0x7f8f0413eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f0413fae0 0x7f8f0413eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 -- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0415ca90 msgr2=0x7f8f040b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0415ca90 0x7f8f040b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 -- 172.21.15.118:0/3424501297 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f04074cc0 con 0x7f8f0413fef0 2024-09-21T06:08:56.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.689+0000 7f8f02000640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f040b4be0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000e790 tx=0x7f8ef000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:56.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.690+0000 7f8efaa00640 1 -- 172.21.15.118:0/3424501297 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000eea0 con 0x7f8f0413fef0 2024-09-21T06:08:56.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.690+0000 7f8efaa00640 1 -- 172.21.15.118:0/3424501297 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ef000ccc0 con 0x7f8f0413fef0 2024-09-21T06:08:56.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.690+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f040749e0 con 0x7f8f0413fef0 2024-09-21T06:08:56.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.690+0000 7f8efaa00640 1 -- 172.21.15.118:0/3424501297 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0005280 con 0x7f8f0413fef0 2024-09-21T06:08:56.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.690+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f041f92f0 con 0x7f8f0413fef0 2024-09-21T06:08:56.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.691+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f040d0140 con 0x7f8f0413fef0 2024-09-21T06:08:56.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.692+0000 7f8efaa00640 1 -- 172.21.15.118:0/3424501297 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ef0005420 con 0x7f8f0413fef0 2024-09-21T06:08:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.693+0000 7f8efaa00640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ee4078b90 0x7f8ee407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.694+0000 7f8efaa00640 1 -- 172.21.15.118:0/3424501297 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f8ef009b1a0 con 0x7f8f0413fef0 2024-09-21T06:08:56.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.694+0000 7f8f02a00640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ee4078b90 0x7f8ee407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:56.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.695+0000 7f8f02a00640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ee4078b90 0x7f8ee407b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001720 tx=0x7f8ef4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:56.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.698+0000 7f8efaa00640 1 -- 172.21.15.118:0/3424501297 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ef00632d0 con 0x7f8f0413fef0 2024-09-21T06:08:56.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.883+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8f0415b8c0 con 0x7f8f0413fef0 2024-09-21T06:08:56.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.884+0000 7f8efaa00640 1 -- 172.21.15.118:0/3424501297 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) ==== 84+0+65 (secure 0 0 0) 0x7f8ef0067d00 con 0x7f8f0413fef0 2024-09-21T06:08:56.886 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:08:56.887 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:08:56.887 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:08:56.887 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:08:56.887 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:08:56.887 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:08:56.887 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ee4078b90 msgr2=0x7f8ee407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ee4078b90 0x7f8ee407b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001720 tx=0x7f8ef4009040 comp rx=0 tx=0).stop 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 msgr2=0x7f8f040b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f040b4be0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000e790 tx=0x7f8ef000ec50 comp rx=0 tx=0).stop 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 shutdown_connections 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0415ca90 0x7f8f040b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0413fef0 0x7f8f040b4be0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ee4078b90 0x7f8ee407b0a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 --2- 172.21.15.118:0/3424501297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f0413fae0 0x7f8f0413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 >> 172.21.15.118:0/3424501297 conn(0x7f8f0406d110 msgr2=0x7f8f041427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 shutdown_connections 2024-09-21T06:08:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:56.886+0000 7f8f09800640 1 -- 172.21.15.118:0/3424501297 wait complete. 2024-09-21T06:08:56.911 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:08:56.911 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 -- 172.21.15.118:0/1191534814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000701f0 msgr2=0x7f93000ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 --2- 172.21.15.118:0/1191534814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000701f0 0x7f93000ce1e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f92f0005fd0 tx=0x7f92f002a5c0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 -- 172.21.15.118:0/1191534814 shutdown_connections 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 --2- 172.21.15.118:0/1191534814 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93000b3e00 0x7f93000b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 --2- 172.21.15.118:0/1191534814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000701f0 0x7f93000ce1e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 -- 172.21.15.118:0/1191534814 >> 172.21.15.118:0/1191534814 conn(0x7f930006cf30 msgr2=0x7f930006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 -- 172.21.15.118:0/1191534814 shutdown_connections 2024-09-21T06:08:57.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.135+0000 7f9305200640 1 -- 172.21.15.118:0/1191534814 wait complete. 2024-09-21T06:08:57.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.138+0000 7f9305200640 1 Processor -- start 2024-09-21T06:08:57.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.138+0000 7f9305200640 1 -- start start 2024-09-21T06:08:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f9305200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93000701f0 0x7f930013ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f9305200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000b3e00 0x7f93001f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f9305200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9300160a50 0x7f930015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:57.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f9305200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f93000cf020 con 0x7f93000b3e00 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f9305200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93000ceea0 con 0x7f93000701f0 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f9305200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f93000cf1a0 con 0x7f9300160a50 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f92fd400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000b3e00 0x7f93001f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f92fd400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000b3e00 0x7f93001f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60758/0 (socket says 172.21.15.118:60758) 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.139+0000 7f92fd400640 1 -- 172.21.15.118:0/560584242 learned_addr learned my addr 172.21.15.118:0/560584242 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fde00640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93000701f0 0x7f930013ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fe800640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9300160a50 0x7f930015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fd400640 1 -- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9300160a50 msgr2=0x7f930015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fd400640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9300160a50 0x7f930015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fd400640 1 -- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93000701f0 msgr2=0x7f930013ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fd400640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93000701f0 0x7f930013ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fd400640 1 -- 172.21.15.118:0/560584242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93001416c0 con 0x7f93000b3e00 2024-09-21T06:08:57.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92fd400640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000b3e00 0x7f93001f4020 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00c3a0 tx=0x7f92ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:57.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92f6000640 1 -- 172.21.15.118:0/560584242 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec017070 con 0x7f93000b3e00 2024-09-21T06:08:57.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92f6000640 1 -- 172.21.15.118:0/560584242 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92ec0053c0 con 0x7f93000b3e00 2024-09-21T06:08:57.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.140+0000 7f92f6000640 1 -- 172.21.15.118:0/560584242 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec003850 con 0x7f93000b3e00 2024-09-21T06:08:57.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.141+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93001419a0 con 0x7f93000b3e00 2024-09-21T06:08:57.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.141+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9300141f60 con 0x7f93000b3e00 2024-09-21T06:08:57.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.142+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93000cf6f0 con 0x7f93000b3e00 2024-09-21T06:08:57.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.143+0000 7f92f6000640 1 -- 172.21.15.118:0/560584242 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92ec01a070 con 0x7f93000b3e00 2024-09-21T06:08:57.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.144+0000 7f92f6000640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92e0078bc0 0x7f92e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:57.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.144+0000 7f92f6000640 1 -- 172.21.15.118:0/560584242 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f92ec099d70 con 0x7f93000b3e00 2024-09-21T06:08:57.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.145+0000 7f92fde00640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92e0078bc0 0x7f92e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:57.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.145+0000 7f92fde00640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92e0078bc0 0x7f92e007b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f92f0033000 tx=0x7f92f0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:57.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.149+0000 7f92f6000640 1 -- 172.21.15.118:0/560584242 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92ec061e20 con 0x7f93000b3e00 2024-09-21T06:08:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.337+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f930006a260 con 0x7f93000b3e00 2024-09-21T06:08:57.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.934+0000 7f92f6000640 1 -- 172.21.15.118:0/560584242 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) ==== 138+0+0 (secure 0 0 0) 0x7f92ec066850 con 0x7f93000b3e00 2024-09-21T06:08:57.937 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:08:57.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92e0078bc0 msgr2=0x7f92e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92e0078bc0 0x7f92e007b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f92f0033000 tx=0x7f92f0004730 comp rx=0 tx=0).stop 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000b3e00 msgr2=0x7f93001f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000b3e00 0x7f93001f4020 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00c3a0 tx=0x7f92ec00c860 comp rx=0 tx=0).stop 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 shutdown_connections 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f92e0078bc0 0x7f92e007b0d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9300160a50 0x7f930015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93000b3e00 0x7f93001f4020 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 --2- 172.21.15.118:0/560584242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93000701f0 0x7f930013ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 >> 172.21.15.118:0/560584242 conn(0x7f930006cf30 msgr2=0x7f930015b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 shutdown_connections 2024-09-21T06:08:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:57.937+0000 7f9305200640 1 -- 172.21.15.118:0/560584242 wait complete. 2024-09-21T06:08:57.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:08:58.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.195+0000 7f59d9600640 1 -- 172.21.15.118:0/2954559542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d4070310 msgr2=0x7f59d40b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.195+0000 7f59d9600640 1 --2- 172.21.15.118:0/2954559542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d4070310 0x7f59d40b5010 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc02aa10 comp rx=0 tx=0).stop 2024-09-21T06:08:58.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.195+0000 7f59d9600640 1 -- 172.21.15.118:0/2954559542 shutdown_connections 2024-09-21T06:08:58.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.195+0000 7f59d9600640 1 --2- 172.21.15.118:0/2954559542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d4070310 0x7f59d40b5010 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.195+0000 7f59d9600640 1 --2- 172.21.15.118:0/2954559542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d4159710 0x7f59d4072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.195+0000 7f59d9600640 1 -- 172.21.15.118:0/2954559542 >> 172.21.15.118:0/2954559542 conn(0x7f59d40b2dd0 msgr2=0x7f59d40d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:58.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.196+0000 7f59d9600640 1 -- 172.21.15.118:0/2954559542 shutdown_connections 2024-09-21T06:08:58.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.196+0000 7f59d9600640 1 -- 172.21.15.118:0/2954559542 wait complete. 2024-09-21T06:08:58.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.198+0000 7f59d9600640 1 Processor -- start 2024-09-21T06:08:58.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.198+0000 7f59d9600640 1 -- start start 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.199+0000 7f59d9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59d40b4c00 0x7f59d414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.199+0000 7f59d9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d4159710 0x7f59d4157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.199+0000 7f59d9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d40cfe70 0x7f59d41583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.199+0000 7f59d9600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40b3f70 con 0x7f59d40cfe70 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.199+0000 7f59d9600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40b3df0 con 0x7f59d40b4c00 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.199+0000 7f59d9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59d40b40f0 con 0x7f59d4159710 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d40cfe70 0x7f59d41583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59d40b4c00 0x7f59d414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59d40b4c00 0x7f59d414a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:60866/0 (socket says 172.21.15.118:60866) 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d3e00640 1 -- 172.21.15.118:0/2980884582 learned_addr learned my addr 172.21.15.118:0/2980884582 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:58.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59cb400640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d4159710 0x7f59d4157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d8c00640 1 -- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d4159710 msgr2=0x7f59d4157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d8c00640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d4159710 0x7f59d4157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d8c00640 1 -- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59d40b4c00 msgr2=0x7f59d414a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d8c00640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59d40b4c00 0x7f59d414a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.200+0000 7f59d8c00640 1 -- 172.21.15.118:0/2980884582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d40cf0b0 con 0x7f59d40cfe70 2024-09-21T06:08:58.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.201+0000 7f59d8c00640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d40cfe70 0x7f59d41583d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f59cc032000 tx=0x7f59cc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:58.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.201+0000 7f59d0c00640 1 -- 172.21.15.118:0/2980884582 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc046070 con 0x7f59d40cfe70 2024-09-21T06:08:58.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.201+0000 7f59d0c00640 1 -- 172.21.15.118:0/2980884582 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59cc0045e0 con 0x7f59d40cfe70 2024-09-21T06:08:58.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.201+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d40cf390 con 0x7f59d40cfe70 2024-09-21T06:08:58.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.201+0000 7f59d0c00640 1 -- 172.21.15.118:0/2980884582 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc033070 con 0x7f59d40cfe70 2024-09-21T06:08:58.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.201+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d41e4d70 con 0x7f59d40cfe70 2024-09-21T06:08:58.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.202+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d41589a0 con 0x7f59d40cfe70 2024-09-21T06:08:58.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.204+0000 7f59d0c00640 1 -- 172.21.15.118:0/2980884582 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59cc049070 con 0x7f59d40cfe70 2024-09-21T06:08:58.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.205+0000 7f59d0c00640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59b0078bb0 0x7f59b007b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.206+0000 7f59d0c00640 1 -- 172.21.15.118:0/2980884582 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5227+0+0 (secure 0 0 0) 0x7f59cc0bbc80 con 0x7f59d40cfe70 2024-09-21T06:08:58.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.206+0000 7f59d3e00640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59b0078bb0 0x7f59b007b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.207+0000 7f59d3e00640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59b0078bb0 0x7f59b007b0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f59c400bc00 tx=0x7f59c400b390 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:58.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.209+0000 7f59d0c00640 1 -- 172.21.15.118:0/2980884582 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f59cc03e070 con 0x7f59d40cfe70 2024-09-21T06:08:58.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.394+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f59d40d0550 con 0x7f59d40cfe70 2024-09-21T06:08:58.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.941+0000 7f59d0c00640 1 -- 172.21.15.118:0/2980884582 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) ==== 170+0+0 (secure 0 0 0) 0x7f59d40d0550 con 0x7f59d40cfe70 2024-09-21T06:08:58.944 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59b0078bb0 msgr2=0x7f59b007b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59b0078bb0 0x7f59b007b0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f59c400bc00 tx=0x7f59c400b390 comp rx=0 tx=0).stop 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d40cfe70 msgr2=0x7f59d41583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d40cfe70 0x7f59d41583d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f59cc032000 tx=0x7f59cc003f10 comp rx=0 tx=0).stop 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 shutdown_connections 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d40cfe70 0x7f59d41583d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59b0078bb0 0x7f59b007b0c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d4159710 0x7f59d4157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 --2- 172.21.15.118:0/2980884582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59d40b4c00 0x7f59d414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.944+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 >> 172.21.15.118:0/2980884582 conn(0x7f59d40b2dd0 msgr2=0x7f59d415e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:58.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.946+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 shutdown_connections 2024-09-21T06:08:58.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:58.946+0000 7f59d9600640 1 -- 172.21.15.118:0/2980884582 wait complete. 2024-09-21T06:08:58.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 -- 172.21.15.118:0/2936511207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6944073fa0 msgr2=0x7f69440749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 --2- 172.21.15.118:0/2936511207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6944073fa0 0x7f69440749f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f694415aed0 tx=0x7f693402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 -- 172.21.15.118:0/2936511207 shutdown_connections 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 --2- 172.21.15.118:0/2936511207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440b5bb0 0x7f69440b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 --2- 172.21.15.118:0/2936511207 >> v2:172.21.15.149:3300/0 conn(0x7f69440cfe30 0x7f69440d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 --2- 172.21.15.118:0/2936511207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6944073fa0 0x7f69440749f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 -- 172.21.15.118:0/2936511207 >> 172.21.15.118:0/2936511207 conn(0x7f694406d6e0 msgr2=0x7f69440b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:59.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 -- 172.21.15.118:0/2936511207 shutdown_connections 2024-09-21T06:08:59.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.203+0000 7f6949200640 1 -- 172.21.15.118:0/2936511207 wait complete. 2024-09-21T06:08:59.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.205+0000 7f6949200640 1 Processor -- start 2024-09-21T06:08:59.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.206+0000 7f6949200640 1 -- start start 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f6949200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6944073fa0 0x7f69440cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f6949200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69440b5bb0 0x7f694413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f6949200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cfe30 0x7f69440c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f6949200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f694415d7b0 con 0x7f69440b5bb0 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f6949200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f694415d630 con 0x7f6944073fa0 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f6949200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f694415d930 con 0x7f69440cfe30 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f693aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69440b5bb0 0x7f694413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f693aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69440b5bb0 0x7f694413df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60772/0 (socket says 172.21.15.118:60772) 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.207+0000 7f693aa00640 1 -- 172.21.15.118:0/541586028 learned_addr learned my addr 172.21.15.118:0/541586028 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:08:59.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f6943400640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6944073fa0 0x7f69440cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:59.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f6943e00640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cfe30 0x7f69440c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f693aa00640 1 -- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cfe30 msgr2=0x7f69440c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f693aa00640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cfe30 0x7f69440c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f693aa00640 1 -- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6944073fa0 msgr2=0x7f69440cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f693aa00640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6944073fa0 0x7f69440cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f693aa00640 1 -- 172.21.15.118:0/541586028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69440aada0 con 0x7f69440b5bb0 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f693aa00640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69440b5bb0 0x7f694413df90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f692c00d750 tx=0x7f692c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.208+0000 7f693be00640 1 -- 172.21.15.118:0/541586028 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c017070 con 0x7f69440b5bb0 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.209+0000 7f693be00640 1 -- 172.21.15.118:0/541586028 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f692c004310 con 0x7f69440b5bb0 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.209+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69440ab080 con 0x7f69440b5bb0 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.209+0000 7f693be00640 1 -- 172.21.15.118:0/541586028 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c00de60 con 0x7f69440b5bb0 2024-09-21T06:08:59.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.209+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69440c9600 con 0x7f69440b5bb0 2024-09-21T06:08:59.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.210+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69440b5fc0 con 0x7f69440b5bb0 2024-09-21T06:08:59.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.211+0000 7f693be00640 1 -- 172.21.15.118:0/541586028 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f692c009c30 con 0x7f69440b5bb0 2024-09-21T06:08:59.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.212+0000 7f693be00640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6920078bc0 0x7f692007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:59.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.212+0000 7f693be00640 1 -- 172.21.15.118:0/541586028 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5609+0+0 (secure 0 0 0) 0x7f692c09b540 con 0x7f69440b5bb0 2024-09-21T06:08:59.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.213+0000 7f6943400640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6920078bc0 0x7f692007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:59.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.214+0000 7f6943400640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6920078bc0 0x7f692007b0d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6934033000 tx=0x7f6934004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:59.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.216+0000 7f693be00640 1 -- 172.21.15.118:0/541586028 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f692c020020 con 0x7f69440b5bb0 2024-09-21T06:08:59.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.442+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f694415cc20 con 0x7f69440b5bb0 2024-09-21T06:08:59.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.943+0000 7f693be00640 1 -- 172.21.15.118:0/541586028 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v48) ==== 174+0+0 (secure 0 0 0) 0x7f692c063400 con 0x7f69440b5bb0 2024-09-21T06:08:59.946 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 12 and data pool 13 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.948+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6920078bc0 msgr2=0x7f692007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.948+0000 7f6949200640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6920078bc0 0x7f692007b0d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6934033000 tx=0x7f6934004730 comp rx=0 tx=0).stop 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.948+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69440b5bb0 msgr2=0x7f694413df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.948+0000 7f6949200640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69440b5bb0 0x7f694413df90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f692c00d750 tx=0x7f692c00dc10 comp rx=0 tx=0).stop 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.948+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 shutdown_connections 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.949+0000 7f6949200640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6920078bc0 0x7f692007b0d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.949+0000 7f6949200640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cfe30 0x7f69440c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.949+0000 7f6949200640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69440b5bb0 0x7f694413df90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.949+0000 7f6949200640 1 --2- 172.21.15.118:0/541586028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6944073fa0 0x7f69440cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:59.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.949+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 >> 172.21.15.118:0/541586028 conn(0x7f694406d6e0 msgr2=0x7f69440b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:59.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.951+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 shutdown_connections 2024-09-21T06:08:59.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:08:59.953+0000 7f6949200640 1 -- 172.21.15.118:0/541586028 wait complete. 2024-09-21T06:08:59.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 -- 172.21.15.118:0/1838542651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815cfd0 msgr2=0x7f41580b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 --2- 172.21.15.118:0/1838542651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815cfd0 0x7f41580b3a60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f414c005fd0 tx=0x7f414c02a540 comp rx=0 tx=0).stop 2024-09-21T06:09:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 -- 172.21.15.118:0/1838542651 shutdown_connections 2024-09-21T06:09:00.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 --2- 172.21.15.118:0/1838542651 >> v2:172.21.15.149:3300/0 conn(0x7f41580b5450 0x7f41580cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 --2- 172.21.15.118:0/1838542651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f415815cfd0 0x7f41580b3a60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 -- 172.21.15.118:0/1838542651 >> 172.21.15.118:0/1838542651 conn(0x7f415806d110 msgr2=0x7f415806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:00.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 -- 172.21.15.118:0/1838542651 shutdown_connections 2024-09-21T06:09:00.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.215+0000 7f415f400640 1 -- 172.21.15.118:0/1838542651 wait complete. 2024-09-21T06:09:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.217+0000 7f415f400640 1 Processor -- start 2024-09-21T06:09:00.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.218+0000 7f415f400640 1 -- start start 2024-09-21T06:09:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41580b5040 0x7f41581f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41580b5450 0x7f41581451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f415815cfd0 0x7f41580cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4158073c10 con 0x7f415815cfd0 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4158073a90 con 0x7f41580b5450 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4158073d90 con 0x7f41580b5040 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f415815cfd0 0x7f41580cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f415815cfd0 0x7f41580cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60778/0 (socket says 172.21.15.118:60778) 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.219+0000 7f415d400640 1 -- 172.21.15.118:0/4104591931 learned_addr learned my addr 172.21.15.118:0/4104591931 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f415ca00640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41580b5040 0x7f41581f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f4157e00640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41580b5450 0x7f41581451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f415d400640 1 -- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41580b5040 msgr2=0x7f41581f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f415d400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41580b5040 0x7f41581f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f415d400640 1 -- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41580b5450 msgr2=0x7f41581451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f415d400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41580b5450 0x7f41581451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f415d400640 1 -- 172.21.15.118:0/4104591931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41580ccd20 con 0x7f415815cfd0 2024-09-21T06:09:00.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f415d400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f415815cfd0 0x7f41580cc7e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f415000ea80 tx=0x7f415000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.220+0000 7f4154c00640 1 -- 172.21.15.118:0/4104591931 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150004b20 con 0x7f415815cfd0 2024-09-21T06:09:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.221+0000 7f4154c00640 1 -- 172.21.15.118:0/4104591931 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4150004ce0 con 0x7f415815cfd0 2024-09-21T06:09:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.221+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41581f9ae0 con 0x7f415815cfd0 2024-09-21T06:09:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.221+0000 7f4154c00640 1 -- 172.21.15.118:0/4104591931 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150005280 con 0x7f415815cfd0 2024-09-21T06:09:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.221+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41581fa0a0 con 0x7f415815cfd0 2024-09-21T06:09:00.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.222+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41580b3a60 con 0x7f415815cfd0 2024-09-21T06:09:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.223+0000 7f4154c00640 1 -- 172.21.15.118:0/4104591931 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4150005420 con 0x7f415815cfd0 2024-09-21T06:09:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.224+0000 7f4154c00640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4138078b90 0x7f413807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.224+0000 7f4154c00640 1 -- 172.21.15.118:0/4104591931 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f415009b940 con 0x7f415815cfd0 2024-09-21T06:09:00.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.224+0000 7f415ca00640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4138078b90 0x7f413807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.225+0000 7f415ca00640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4138078b90 0x7f413807b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f414c033000 tx=0x7f414c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:00.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.228+0000 7f4154c00640 1 -- 172.21.15.118:0/4104591931 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f41580ccd20 con 0x7f415815cfd0 2024-09-21T06:09:00.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.417+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4158076200 con 0x7f415815cfd0 2024-09-21T06:09:00.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.418+0000 7f4154c00640 1 -- 172.21.15.118:0/4104591931 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16805 (secure 0 0 0) 0x7f41500636a0 con 0x7f415815cfd0 2024-09-21T06:09:00.422 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:00.422 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":98,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:08:59.444827+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:08:57.351669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T06:08:58.408649+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:00.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4138078b90 msgr2=0x7f413807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4138078b90 0x7f413807b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f414c033000 tx=0x7f414c004730 comp rx=0 tx=0).stop 2024-09-21T06:09:00.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f415815cfd0 msgr2=0x7f41580cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f415815cfd0 0x7f41580cc7e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f415000ea80 tx=0x7f415000ef40 comp rx=0 tx=0).stop 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 shutdown_connections 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f415815cfd0 0x7f41580cc7e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41580b5450 0x7f41581451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4138078b90 0x7f413807b0a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 --2- 172.21.15.118:0/4104591931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41580b5040 0x7f41581f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 >> 172.21.15.118:0/4104591931 conn(0x7f415806d110 msgr2=0x7f41581557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 shutdown_connections 2024-09-21T06:09:00.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.421+0000 7f415f400640 1 -- 172.21.15.118:0/4104591931 wait complete. 2024-09-21T06:09:00.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 -- 172.21.15.118:0/1019475809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed200aff30 msgr2=0x7fed20072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 --2- 172.21.15.118:0/1019475809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed200aff30 0x7fed20072ac0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fed10005fd0 tx=0x7fed1002a540 comp rx=0 tx=0).stop 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 -- 172.21.15.118:0/1019475809 shutdown_connections 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 --2- 172.21.15.118:0/1019475809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed2015f4e0 0x7fed20151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 --2- 172.21.15.118:0/1019475809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed200aff30 0x7fed20072ac0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 -- 172.21.15.118:0/1019475809 >> 172.21.15.118:0/1019475809 conn(0x7fed2006d6e0 msgr2=0x7fed200b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 -- 172.21.15.118:0/1019475809 shutdown_connections 2024-09-21T06:09:00.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.666+0000 7fed26600640 1 -- 172.21.15.118:0/1019475809 wait complete. 2024-09-21T06:09:00.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.668+0000 7fed26600640 1 Processor -- start 2024-09-21T06:09:00.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.668+0000 7fed26600640 1 -- start start 2024-09-21T06:09:00.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed26600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed200aff30 0x7fed2015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed26600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed200b5740 0x7fed20154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed26600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed201549d0 0x7fed200b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed26600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fed200b2e30 con 0x7fed201549d0 2024-09-21T06:09:00.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed26600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed200b2cb0 con 0x7fed200aff30 2024-09-21T06:09:00.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed26600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed200b2fb0 con 0x7fed200b5740 2024-09-21T06:09:00.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed25c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed201549d0 0x7fed200b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed25c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed201549d0 0x7fed200b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60804/0 (socket says 172.21.15.118:60804) 2024-09-21T06:09:00.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed25c00640 1 -- 172.21.15.118:0/658457079 learned_addr learned my addr 172.21.15.118:0/658457079 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:00.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed25c00640 1 -- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed200b5740 msgr2=0x7fed20154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.670+0000 7fed17e00640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed200b5740 0x7fed20154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed25200640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed200aff30 0x7fed2015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed25c00640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed200b5740 0x7fed20154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed25c00640 1 -- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed200aff30 msgr2=0x7fed2015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed25c00640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed200aff30 0x7fed2015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed25c00640 1 -- 172.21.15.118:0/658457079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed201f6000 con 0x7fed201549d0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed17e00640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed200b5740 0x7fed20154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed25200640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed200aff30 0x7fed2015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed25c00640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed201549d0 0x7fed200b1a00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fed1800ddf0 tx=0x7fed1800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed1d600640 1 -- 172.21.15.118:0/658457079 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18004d20 con 0x7fed201549d0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed1d600640 1 -- 172.21.15.118:0/658457079 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed1800be40 con 0x7fed201549d0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed1d600640 1 -- 172.21.15.118:0/658457079 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1800e8c0 con 0x7fed201549d0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed201f62e0 con 0x7fed201549d0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.671+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed201f68a0 con 0x7fed201549d0 2024-09-21T06:09:00.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.672+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2015ce20 con 0x7fed201549d0 2024-09-21T06:09:00.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.675+0000 7fed1d600640 1 -- 172.21.15.118:0/658457079 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed1800ea60 con 0x7fed201549d0 2024-09-21T06:09:00.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.676+0000 7fed1d600640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecfc078bc0 0x7fecfc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:00.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.676+0000 7fed1d600640 1 -- 172.21.15.118:0/658457079 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fed1809bef0 con 0x7fed201549d0 2024-09-21T06:09:00.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.676+0000 7fed25200640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecfc078bc0 0x7fecfc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:00.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.677+0000 7fed25200640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecfc078bc0 0x7fecfc07b0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed10033000 tx=0x7fed10004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:00.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.679+0000 7fed1d600640 1 -- 172.21.15.118:0/658457079 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fed2015ce20 con 0x7fed201549d0 2024-09-21T06:09:00.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.863+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed20072ac0 con 0x7fed201549d0 2024-09-21T06:09:00.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.864+0000 7fed1d600640 1 -- 172.21.15.118:0/658457079 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16805 (secure 0 0 0) 0x7fed18064310 con 0x7fed201549d0 2024-09-21T06:09:00.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:00.867 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":98,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:08:59.444827+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:08:57.351669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T06:08:58.408649+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.866+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecfc078bc0 msgr2=0x7fecfc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecfc078bc0 0x7fecfc07b0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed10033000 tx=0x7fed10004730 comp rx=0 tx=0).stop 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed201549d0 msgr2=0x7fed200b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed201549d0 0x7fed200b1a00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fed1800ddf0 tx=0x7fed1800b730 comp rx=0 tx=0).stop 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 shutdown_connections 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed201549d0 0x7fed200b1a00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecfc078bc0 0x7fecfc07b0d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed200b5740 0x7fed20154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 --2- 172.21.15.118:0/658457079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed200aff30 0x7fed2015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 >> 172.21.15.118:0/658457079 conn(0x7fed2006d6e0 msgr2=0x7fed200b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 shutdown_connections 2024-09-21T06:09:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:00.867+0000 7fed26600640 1 -- 172.21.15.118:0/658457079 wait complete. 2024-09-21T06:09:00.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 -- 172.21.15.118:0/2789049043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 msgr2=0x7fad7c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 --2- 172.21.15.118:0/2789049043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c0d13c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fad7c071c00 tx=0x7fad7402a560 comp rx=0 tx=0).stop 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 -- 172.21.15.118:0/2789049043 shutdown_connections 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 --2- 172.21.15.118:0/2789049043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c0d13c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 --2- 172.21.15.118:0/2789049043 >> v2:172.21.15.149:3300/0 conn(0x7fad7c13fae0 0x7fad7c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 -- 172.21.15.118:0/2789049043 >> 172.21.15.118:0/2789049043 conn(0x7fad7c06d110 msgr2=0x7fad7c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 -- 172.21.15.118:0/2789049043 shutdown_connections 2024-09-21T06:09:01.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.118+0000 7fad81400640 1 -- 172.21.15.118:0/2789049043 wait complete. 2024-09-21T06:09:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.120+0000 7fad81400640 1 Processor -- start 2024-09-21T06:09:01.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.120+0000 7fad81400640 1 -- start start 2024-09-21T06:09:01.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad81400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c13fae0 0x7fad7c138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad81400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c13fef0 0x7fad7c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad81400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad81400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0cfa70 con 0x7fad7c142e40 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad81400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0cf8f0 con 0x7fad7c13fef0 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad81400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c0cfbf0 con 0x7fad7c13fae0 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad7b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad7b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60822/0 (socket says 172.21.15.118:60822) 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad7b200640 1 -- 172.21.15.118:0/901265067 learned_addr learned my addr 172.21.15.118:0/901265067 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:01.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad79e00640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c13fef0 0x7fad7c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad7a800640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c13fae0 0x7fad7c138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad7b200640 1 -- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c13fae0 msgr2=0x7fad7c138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad7b200640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c13fae0 0x7fad7c138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.122+0000 7fad7b200640 1 -- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c13fef0 msgr2=0x7fad7c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad7b200640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c13fef0 0x7fad7c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad7b200640 1 -- 172.21.15.118:0/901265067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c139400 con 0x7fad7c142e40 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad7a800640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c13fae0 0x7fad7c138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad7b200640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c154a80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad74034040 tx=0x7fad74003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad72a00640 1 -- 172.21.15.118:0/901265067 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7403e030 con 0x7fad7c142e40 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad72a00640 1 -- 172.21.15.118:0/901265067 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad74003d10 con 0x7fad7c142e40 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad72a00640 1 -- 172.21.15.118:0/901265067 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74035040 con 0x7fad7c142e40 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c156570 con 0x7fad7c142e40 2024-09-21T06:09:01.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.123+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c156b30 con 0x7fad7c142e40 2024-09-21T06:09:01.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.124+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c1f6d70 con 0x7fad7c142e40 2024-09-21T06:09:01.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.126+0000 7fad72a00640 1 -- 172.21.15.118:0/901265067 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad74041030 con 0x7fad7c142e40 2024-09-21T06:09:01.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.127+0000 7fad72a00640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fad5c078b90 0x7fad5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:01.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.127+0000 7fad72a00640 1 -- 172.21.15.118:0/901265067 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fad740bb7e0 con 0x7fad7c142e40 2024-09-21T06:09:01.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.127+0000 7fad7a800640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fad5c078b90 0x7fad5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:01.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.128+0000 7fad7a800640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fad5c078b90 0x7fad5c07b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fd0 tx=0x7fad6c009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:01.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.131+0000 7fad72a00640 1 -- 172.21.15.118:0/901265067 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fad74083530 con 0x7fad7c142e40 2024-09-21T06:09:01.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:01.357+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fad7c0d0110 con 0x7fad7c142e40 2024-09-21T06:09:01.932 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:09:01.930+0000 7fe4e8600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:09:02.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.338+0000 7fad72a00640 1 -- 172.21.15.118:0/901265067 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) ==== 118+0+0 (secure 0 0 0) 0x7fad74087f60 con 0x7fad7c142e40 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fad5c078b90 msgr2=0x7fad5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fad5c078b90 0x7fad5c07b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fd0 tx=0x7fad6c009500 comp rx=0 tx=0).stop 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 msgr2=0x7fad7c154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c154a80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad74034040 tx=0x7fad74003820 comp rx=0 tx=0).stop 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 shutdown_connections 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad7c142e40 0x7fad7c154a80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c13fef0 0x7fad7c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fad5c078b90 0x7fad5c07b0a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 --2- 172.21.15.118:0/901265067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c13fae0 0x7fad7c138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 >> 172.21.15.118:0/901265067 conn(0x7fad7c06d110 msgr2=0x7fad7c15ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:02.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 shutdown_connections 2024-09-21T06:09:02.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.342+0000 7fad81400640 1 -- 172.21.15.118:0/901265067 wait complete. 2024-09-21T06:09:02.370 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:09:02.371 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:09:02.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 -- 172.21.15.118:0/637828774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00cfe30 msgr2=0x7fb8e00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:02.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/637828774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00cfe30 0x7fb8e00d0240 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0072570 tx=0x7fb8c802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 -- 172.21.15.118:0/637828774 shutdown_connections 2024-09-21T06:09:02.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/637828774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00cfe30 0x7fb8e00d0240 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/637828774 >> v2:172.21.15.149:3300/0 conn(0x7fb8e0073fa0 0x7fb8e00749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 -- 172.21.15.118:0/637828774 >> 172.21.15.118:0/637828774 conn(0x7fb8e006d6e0 msgr2=0x7fb8e00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:02.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 -- 172.21.15.118:0/637828774 shutdown_connections 2024-09-21T06:09:02.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.596+0000 7fb8dfe00640 1 -- 172.21.15.118:0/637828774 wait complete. 2024-09-21T06:09:02.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.598+0000 7fb8dfe00640 1 Processor -- start 2024-09-21T06:09:02.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.598+0000 7fb8dfe00640 1 -- start start 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e0073fa0 0x7fb8e00aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00b5bb0 0x7fb8e01f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8e00cfe30 0x7fb8e01f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e015da00 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e015d880 con 0x7fb8e0073fa0 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e015db80 con 0x7fb8e00cfe30 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8d6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00b5bb0 0x7fb8e01f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8d6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00b5bb0 0x7fb8e01f2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60854/0 (socket says 172.21.15.118:60854) 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8d6000640 1 -- 172.21.15.118:0/35899630 learned_addr learned my addr 172.21.15.118:0/35899630 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8dea00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e0073fa0 0x7fb8e00aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.600+0000 7fb8df400640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8e00cfe30 0x7fb8e01f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d6000640 1 -- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8e00cfe30 msgr2=0x7fb8e01f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d6000640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8e00cfe30 0x7fb8e01f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d6000640 1 -- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e0073fa0 msgr2=0x7fb8e00aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d6000640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e0073fa0 0x7fb8e00aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d6000640 1 -- 172.21.15.118:0/35899630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e00aacf0 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8df400640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8e00cfe30 0x7fb8e01f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d6000640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00b5bb0 0x7fb8e01f2c60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8034040 tx=0x7fb8c80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d7400640 1 -- 172.21.15.118:0/35899630 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c803e030 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d7400640 1 -- 172.21.15.118:0/35899630 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8c80047a0 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8d7400640 1 -- 172.21.15.118:0/35899630 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8035040 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e00aafd0 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.601+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e01f8110 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.603+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e00aaa60 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.604+0000 7fb8d7400640 1 -- 172.21.15.118:0/35899630 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8c8041030 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.605+0000 7fb8d7400640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8bc078b90 0x7fb8bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:02.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.605+0000 7fb8d7400640 1 -- 172.21.15.118:0/35899630 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fb8c80bb530 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.605+0000 7fb8dea00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8bc078b90 0x7fb8bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:02.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.606+0000 7fb8dea00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8bc078b90 0x7fb8bc07b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0005fd0 tx=0x7fb8d000a250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:02.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.610+0000 7fb8d7400640 1 -- 172.21.15.118:0/35899630 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb8c8083310 con 0x7fb8e00b5bb0 2024-09-21T06:09:02.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:02.829+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb8e015e030 con 0x7fb8e00b5bb0 2024-09-21T06:09:03.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.345+0000 7fb8d7400640 1 -- 172.21.15.118:0/35899630 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) ==== 122+0+0 (secure 0 0 0) 0x7fb8c8087d40 con 0x7fb8e00b5bb0 2024-09-21T06:09:03.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8bc078b90 msgr2=0x7fb8bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:03.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8bc078b90 0x7fb8bc07b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0005fd0 tx=0x7fb8d000a250 comp rx=0 tx=0).stop 2024-09-21T06:09:03.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00b5bb0 msgr2=0x7fb8e01f2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:03.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00b5bb0 0x7fb8e01f2c60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8034040 tx=0x7fb8c80039e0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 shutdown_connections 2024-09-21T06:09:03.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8bc078b90 0x7fb8bc07b0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8e00cfe30 0x7fb8e01f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8e00b5bb0 0x7fb8e01f2c60 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 --2- 172.21.15.118:0/35899630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8e0073fa0 0x7fb8e00aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 >> 172.21.15.118:0/35899630 conn(0x7fb8e006d6e0 msgr2=0x7fb8e00b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:03.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 shutdown_connections 2024-09-21T06:09:03.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.348+0000 7fb8dfe00640 1 -- 172.21.15.118:0/35899630 wait complete. 2024-09-21T06:09:03.376 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:09:03.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:03.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.595+0000 7fbc6e600640 1 -- 172.21.15.118:0/1641222785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 msgr2=0x7fbc680749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:03.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.595+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1641222785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680749f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005fd0 tx=0x7fbc5802a5f0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.595+0000 7fbc6e600640 1 -- 172.21.15.118:0/1641222785 shutdown_connections 2024-09-21T06:09:03.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.595+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1641222785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680749f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.595+0000 7fbc6e600640 1 -- 172.21.15.118:0/1641222785 >> 172.21.15.118:0/1641222785 conn(0x7fbc6806d6e0 msgr2=0x7fbc680b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:03.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.595+0000 7fbc6e600640 1 -- 172.21.15.118:0/1641222785 shutdown_connections 2024-09-21T06:09:03.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.595+0000 7fbc6e600640 1 -- 172.21.15.118:0/1641222785 wait complete. 2024-09-21T06:09:03.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.597+0000 7fbc6e600640 1 Processor -- start 2024-09-21T06:09:03.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.597+0000 7fbc6e600640 1 -- start start 2024-09-21T06:09:03.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:03.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc680cfe30 0x7fbc681e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:03.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc681f64e0 0x7fbc681e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc680d0610 con 0x7fbc68073fa0 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc680d0490 con 0x7fbc681f64e0 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6815dd40 con 0x7fbc680cfe30 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60870/0 (socket says 172.21.15.118:60870) 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 -- 172.21.15.118:0/1974986844 learned_addr learned my addr 172.21.15.118:0/1974986844 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6dc00640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc681f64e0 0x7fbc681e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc67e00640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc680cfe30 0x7fbc681e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 -- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc680cfe30 msgr2=0x7fbc681e8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc680cfe30 0x7fbc681e8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 -- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc681f64e0 msgr2=0x7fbc681e9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc681f64e0 0x7fbc681e9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.599+0000 7fbc6d200640 1 -- 172.21.15.118:0/1974986844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc680cbb50 con 0x7fbc68073fa0 2024-09-21T06:09:03.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.600+0000 7fbc6d200640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680c9c20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbc58034040 tx=0x7fbc580039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:03.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.600+0000 7fbc64c00640 1 -- 172.21.15.118:0/1974986844 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5803e030 con 0x7fbc68073fa0 2024-09-21T06:09:03.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.600+0000 7fbc64c00640 1 -- 172.21.15.118:0/1974986844 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc580047a0 con 0x7fbc68073fa0 2024-09-21T06:09:03.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.600+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc680cbe30 con 0x7fbc68073fa0 2024-09-21T06:09:03.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.600+0000 7fbc64c00640 1 -- 172.21.15.118:0/1974986844 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58035040 con 0x7fbc68073fa0 2024-09-21T06:09:03.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.600+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc681e8c50 con 0x7fbc68073fa0 2024-09-21T06:09:03.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.601+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc680cf4b0 con 0x7fbc68073fa0 2024-09-21T06:09:03.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.603+0000 7fbc64c00640 1 -- 172.21.15.118:0/1974986844 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc58041030 con 0x7fbc68073fa0 2024-09-21T06:09:03.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.603+0000 7fbc64c00640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:03.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.604+0000 7fbc64c00640 1 -- 172.21.15.118:0/1974986844 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fbc580bb540 con 0x7fbc68073fa0 2024-09-21T06:09:03.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.604+0000 7fbc67e00640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:03.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.605+0000 7fbc67e00640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbc68145c50 tx=0x7fbc54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:03.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.608+0000 7fbc64c00640 1 -- 172.21.15.118:0/1974986844 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbc680cf4b0 con 0x7fbc68073fa0 2024-09-21T06:09:03.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.829+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc6815e1c0 con 0x7fbc68073fa0 2024-09-21T06:09:03.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.830+0000 7fbc64c00640 1 -- 172.21.15.118:0/1974986844 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7fbc58083aa0 con 0x7fbc68073fa0 2024-09-21T06:09:03.832 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:03.833 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:03.833 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 msgr2=0x7fbc4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbc68145c50 tx=0x7fbc54009040 comp rx=0 tx=0).stop 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 msgr2=0x7fbc680c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680c9c20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbc58034040 tx=0x7fbc580039e0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 shutdown_connections 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc681f64e0 0x7fbc681e9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbc48078b90 0x7fbc4807b0a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc680cfe30 0x7fbc681e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 --2- 172.21.15.118:0/1974986844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc68073fa0 0x7fbc680c9c20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 >> 172.21.15.118:0/1974986844 conn(0x7fbc6806d6e0 msgr2=0x7fbc68145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 shutdown_connections 2024-09-21T06:09:03.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:03.832+0000 7fbc6e600640 1 -- 172.21.15.118:0/1974986844 wait complete. 2024-09-21T06:09:03.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:04.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.074+0000 7f214de00640 1 -- 172.21.15.118:0/117888963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 msgr2=0x7f2148142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.074+0000 7f214de00640 1 --2- 172.21.15.118:0/117888963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 0x7f2148142e40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2140005fd0 tx=0x7f214002a8b0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.074+0000 7f214de00640 1 -- 172.21.15.118:0/117888963 shutdown_connections 2024-09-21T06:09:04.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.074+0000 7f214de00640 1 --2- 172.21.15.118:0/117888963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 0x7f2148142e40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.074+0000 7f214de00640 1 -- 172.21.15.118:0/117888963 >> 172.21.15.118:0/117888963 conn(0x7f214806d110 msgr2=0x7f214806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:04.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.075+0000 7f214de00640 1 -- 172.21.15.118:0/117888963 shutdown_connections 2024-09-21T06:09:04.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.075+0000 7f214de00640 1 -- 172.21.15.118:0/117888963 wait complete. 2024-09-21T06:09:04.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.077+0000 7f214de00640 1 Processor -- start 2024-09-21T06:09:04.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.077+0000 7f214de00640 1 -- start start 2024-09-21T06:09:04.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f214de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f214813fae0 0x7f2148138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f214de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 0x7f2148160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f214de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2148158880 0x7f21481610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f214de00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2148168280 con 0x7f214813fae0 2024-09-21T06:09:04.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f214de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2148168100 con 0x7f214813fef0 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f214de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2148168400 con 0x7f2148158880 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f2146a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f214813fae0 0x7f2148138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f2146a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f214813fae0 0x7f2148138ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60874/0 (socket says 172.21.15.118:60874) 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.078+0000 7f2146a00640 1 -- 172.21.15.118:0/3167665617 learned_addr learned my addr 172.21.15.118:0/3167665617 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2146000640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 0x7f2148160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2147400640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2148158880 0x7f21481610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2146a00640 1 -- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2148158880 msgr2=0x7f21481610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2146a00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2148158880 0x7f21481610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2146a00640 1 -- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 msgr2=0x7f2148160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2146a00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 0x7f2148160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2146a00640 1 -- 172.21.15.118:0/3167665617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2148158ff0 con 0x7f214813fae0 2024-09-21T06:09:04.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f2146a00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f214813fae0 0x7f2148138ec0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f213800c400 tx=0x7f213800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f213f400640 1 -- 172.21.15.118:0/3167665617 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138017070 con 0x7f214813fae0 2024-09-21T06:09:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f213f400640 1 -- 172.21.15.118:0/3167665617 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21380053c0 con 0x7f214813fae0 2024-09-21T06:09:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21481592d0 con 0x7f214813fae0 2024-09-21T06:09:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.079+0000 7f213f400640 1 -- 172.21.15.118:0/3167665617 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138003850 con 0x7f214813fae0 2024-09-21T06:09:04.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.080+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2148159890 con 0x7f214813fae0 2024-09-21T06:09:04.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.081+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21480d0e80 con 0x7f214813fae0 2024-09-21T06:09:04.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.082+0000 7f213f400640 1 -- 172.21.15.118:0/3167665617 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f213801a070 con 0x7f214813fae0 2024-09-21T06:09:04.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.083+0000 7f213f400640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2128078b90 0x7f212807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.083+0000 7f213f400640 1 -- 172.21.15.118:0/3167665617 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f213809a130 con 0x7f214813fae0 2024-09-21T06:09:04.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.083+0000 7f2146000640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2128078b90 0x7f212807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.084+0000 7f2146000640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2128078b90 0x7f212807b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f21480cdc50 tx=0x7f2134009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:04.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.088+0000 7f213f400640 1 -- 172.21.15.118:0/3167665617 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2138062560 con 0x7f214813fae0 2024-09-21T06:09:04.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.273+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f214815ea50 con 0x7f214813fae0 2024-09-21T06:09:04.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.274+0000 7f213f400640 1 -- 172.21.15.118:0/3167665617 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16792 (secure 0 0 0) 0x7f2138061e60 con 0x7f214813fae0 2024-09-21T06:09:04.277 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:04.277 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":99,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:09:00.945016+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:08:57.351669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T06:08:58.408649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:04.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.276+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2128078b90 msgr2=0x7f212807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2128078b90 0x7f212807b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f21480cdc50 tx=0x7f2134009040 comp rx=0 tx=0).stop 2024-09-21T06:09:04.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f214813fae0 msgr2=0x7f2148138ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f214813fae0 0x7f2148138ec0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f213800c400 tx=0x7f213800c8c0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 shutdown_connections 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2128078b90 0x7f212807b0a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2148158880 0x7f21481610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214813fef0 0x7f2148160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 --2- 172.21.15.118:0/3167665617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f214813fae0 0x7f2148138ec0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 >> 172.21.15.118:0/3167665617 conn(0x7f214806d110 msgr2=0x7f214815ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 shutdown_connections 2024-09-21T06:09:04.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.277+0000 7f214de00640 1 -- 172.21.15.118:0/3167665617 wait complete. 2024-09-21T06:09:04.304 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:09:04.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:09:04.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.523+0000 7eff9ca00640 1 -- 172.21.15.118:0/1285196739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144760 msgr2=0x7eff980cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.523+0000 7eff9ca00640 1 --2- 172.21.15.118:0/1285196739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144760 0x7eff980cf4c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7eff80005fd0 tx=0x7eff8002aaa0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.523+0000 7eff9ca00640 1 -- 172.21.15.118:0/1285196739 shutdown_connections 2024-09-21T06:09:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.523+0000 7eff9ca00640 1 --2- 172.21.15.118:0/1285196739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144760 0x7eff980cf4c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.523+0000 7eff9ca00640 1 -- 172.21.15.118:0/1285196739 >> 172.21.15.118:0/1285196739 conn(0x7eff9806d6e0 msgr2=0x7eff980b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.523+0000 7eff9ca00640 1 -- 172.21.15.118:0/1285196739 shutdown_connections 2024-09-21T06:09:04.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.523+0000 7eff9ca00640 1 -- 172.21.15.118:0/1285196739 wait complete. 2024-09-21T06:09:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.525+0000 7eff9ca00640 1 Processor -- start 2024-09-21T06:09:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.525+0000 7eff9ca00640 1 -- start start 2024-09-21T06:09:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff9ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff980cfa00 0x7eff98137d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff9ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff98144760 0x7eff980ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff9ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144ea0 0x7eff980aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff9ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7eff980b4be0 con 0x7eff98144ea0 2024-09-21T06:09:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff9ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff980b4a60 con 0x7eff980cfa00 2024-09-21T06:09:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff9ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff980b4d60 con 0x7eff98144760 2024-09-21T06:09:04.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff97200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144ea0 0x7eff980aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff96800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff980cfa00 0x7eff98137d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff96800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff980cfa00 0x7eff98137d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:60994/0 (socket says 172.21.15.118:60994) 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff96800640 1 -- 172.21.15.118:0/2744643911 learned_addr learned my addr 172.21.15.118:0/2744643911 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.527+0000 7eff8de00640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff98144760 0x7eff980ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff97200640 1 -- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff98144760 msgr2=0x7eff980ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff97200640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff98144760 0x7eff980ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff97200640 1 -- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff980cfa00 msgr2=0x7eff98137d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff97200640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff980cfa00 0x7eff98137d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff97200640 1 -- 172.21.15.118:0/2744643911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9815e3a0 con 0x7eff98144ea0 2024-09-21T06:09:04.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff96800640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff980cfa00 0x7eff98137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:09:04.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff97200640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144ea0 0x7eff980aedf0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c390 tx=0x7eff9000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:04.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff8f400640 1 -- 172.21.15.118:0/2744643911 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90017070 con 0x7eff98144ea0 2024-09-21T06:09:04.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff8f400640 1 -- 172.21.15.118:0/2744643911 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff900053c0 con 0x7eff98144ea0 2024-09-21T06:09:04.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff981fa1f0 con 0x7eff98144ea0 2024-09-21T06:09:04.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.528+0000 7eff8f400640 1 -- 172.21.15.118:0/2744643911 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90003850 con 0x7eff98144ea0 2024-09-21T06:09:04.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.529+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff981f9f00 con 0x7eff98144ea0 2024-09-21T06:09:04.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.530+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff980b5240 con 0x7eff98144ea0 2024-09-21T06:09:04.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.531+0000 7eff8f400640 1 -- 172.21.15.118:0/2744643911 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff9001a070 con 0x7eff98144ea0 2024-09-21T06:09:04.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.532+0000 7eff8f400640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff74078b90 0x7eff7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:04.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.532+0000 7eff8f400640 1 -- 172.21.15.118:0/2744643911 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7eff90099fd0 con 0x7eff98144ea0 2024-09-21T06:09:04.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.532+0000 7eff96800640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff74078b90 0x7eff7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:04.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.533+0000 7eff96800640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff74078b90 0x7eff7407b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7eff88001bd0 tx=0x7eff88009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:04.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.536+0000 7eff8f400640 1 -- 172.21.15.118:0/2744643911 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7eff90061d20 con 0x7eff98144ea0 2024-09-21T06:09:04.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.720+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff981382c0 con 0x7eff74078b90 2024-09-21T06:09:04.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.727+0000 7eff8f400640 1 -- 172.21.15.118:0/2744643911 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247581 (secure 0 0 0) 0x7eff981382c0 con 0x7eff74078b90 2024-09-21T06:09:04.731 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:04.732 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff74078b90 msgr2=0x7eff7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff74078b90 0x7eff7407b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7eff88001bd0 tx=0x7eff88009040 comp rx=0 tx=0).stop 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144ea0 msgr2=0x7eff980aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144ea0 0x7eff980aedf0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c390 tx=0x7eff9000c850 comp rx=0 tx=0).stop 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 shutdown_connections 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff98144ea0 0x7eff980aedf0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff74078b90 0x7eff7407b0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff98144760 0x7eff980ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 --2- 172.21.15.118:0/2744643911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff980cfa00 0x7eff98137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:04.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 >> 172.21.15.118:0/2744643911 conn(0x7eff9806d6e0 msgr2=0x7eff980b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:04.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 shutdown_connections 2024-09-21T06:09:04.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:04.730+0000 7eff9ca00640 1 -- 172.21.15.118:0/2744643911 wait complete. 2024-09-21T06:09:04.759 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-21T06:09:04.537512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557158,"statfs":{"total":1600000000,"available":1594530261,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001554"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271625+0000","last_change":"2024-09-21T06:08:59.967691+0000","last_active":"2024-09-21T06:09:01.271625+0000","last_peered":"2024-09-21T06:09:01.271625+0000","last_clean":"2024-09-21T06:09:01.271625+0000","last_became_active":"2024-09-21T06:08:59.967436+0000","last_became_peered":"2024-09-21T06:08:59.967436+0000","last_unstale":"2024-09-21T06:09:01.271625+0000","last_undegraded":"2024-09-21T06:09:01.271625+0000","last_fullsized":"2024-09-21T06:09:01.271625+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:05.795854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954501+0000","last_change":"2024-09-21T06:08:59.970045+0000","last_active":"2024-09-21T06:09:00.954501+0000","last_peered":"2024-09-21T06:09:00.954501+0000","last_clean":"2024-09-21T06:09:00.954501+0000","last_became_active":"2024-09-21T06:08:59.968763+0000","last_became_peered":"2024-09-21T06:08:59.968763+0000","last_unstale":"2024-09-21T06:09:00.954501+0000","last_undegraded":"2024-09-21T06:09:00.954501+0000","last_fullsized":"2024-09-21T06:09:00.954501+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:50.264752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949081+0000","last_change":"2024-09-21T06:08:59.961532+0000","last_active":"2024-09-21T06:09:00.949081+0000","last_peered":"2024-09-21T06:09:00.949081+0000","last_clean":"2024-09-21T06:09:00.949081+0000","last_became_active":"2024-09-21T06:08:59.961238+0000","last_became_peered":"2024-09-21T06:08:59.961238+0000","last_unstale":"2024-09-21T06:09:00.949081+0000","last_undegraded":"2024-09-21T06:09:00.949081+0000","last_fullsized":"2024-09-21T06:09:00.949081+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:36.329518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.948703+0000","last_change":"2024-09-21T06:08:59.970446+0000","last_active":"2024-09-21T06:09:00.948703+0000","last_peered":"2024-09-21T06:09:00.948703+0000","last_clean":"2024-09-21T06:09:00.948703+0000","last_became_active":"2024-09-21T06:08:59.967782+0000","last_became_peered":"2024-09-21T06:08:59.967782+0000","last_unstale":"2024-09-21T06:09:00.948703+0000","last_undegraded":"2024-09-21T06:09:00.948703+0000","last_fullsized":"2024-09-21T06:09:00.948703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:32.292395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269762+0000","last_change":"2024-09-21T06:08:59.966107+0000","last_active":"2024-09-21T06:09:01.269762+0000","last_peered":"2024-09-21T06:09:01.269762+0000","last_clean":"2024-09-21T06:09:01.269762+0000","last_became_active":"2024-09-21T06:08:59.965870+0000","last_became_peered":"2024-09-21T06:08:59.965870+0000","last_unstale":"2024-09-21T06:09:01.269762+0000","last_undegraded":"2024-09-21T06:09:01.269762+0000","last_fullsized":"2024-09-21T06:09:01.269762+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:11.648891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270924+0000","last_change":"2024-09-21T06:08:59.971535+0000","last_active":"2024-09-21T06:09:01.270924+0000","last_peered":"2024-09-21T06:09:01.270924+0000","last_clean":"2024-09-21T06:09:01.270924+0000","last_became_active":"2024-09-21T06:08:59.967227+0000","last_became_peered":"2024-09-21T06:08:59.967227+0000","last_unstale":"2024-09-21T06:09:01.270924+0000","last_undegraded":"2024-09-21T06:09:01.270924+0000","last_fullsized":"2024-09-21T06:09:01.270924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:14.347566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.948902+0000","last_change":"2024-09-21T06:08:59.957268+0000","last_active":"2024-09-21T06:09:00.948902+0000","last_peered":"2024-09-21T06:09:00.948902+0000","last_clean":"2024-09-21T06:09:00.948902+0000","last_became_active":"2024-09-21T06:08:59.956995+0000","last_became_peered":"2024-09-21T06:08:59.956995+0000","last_unstale":"2024-09-21T06:09:00.948902+0000","last_undegraded":"2024-09-21T06:09:00.948902+0000","last_fullsized":"2024-09-21T06:09:00.948902+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:31.140985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270274+0000","last_change":"2024-09-21T06:08:59.958297+0000","last_active":"2024-09-21T06:09:01.270274+0000","last_peered":"2024-09-21T06:09:01.270274+0000","last_clean":"2024-09-21T06:09:01.270274+0000","last_became_active":"2024-09-21T06:08:59.957944+0000","last_became_peered":"2024-09-21T06:08:59.957944+0000","last_unstale":"2024-09-21T06:09:01.270274+0000","last_undegraded":"2024-09-21T06:09:01.270274+0000","last_fullsized":"2024-09-21T06:09:01.270274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:33.782583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269817+0000","last_change":"2024-09-21T06:08:59.966355+0000","last_active":"2024-09-21T06:09:01.269817+0000","last_peered":"2024-09-21T06:09:01.269817+0000","last_clean":"2024-09-21T06:09:01.269817+0000","last_became_active":"2024-09-21T06:08:59.966096+0000","last_became_peered":"2024-09-21T06:08:59.966096+0000","last_unstale":"2024-09-21T06:09:01.269817+0000","last_undegraded":"2024-09-21T06:09:01.269817+0000","last_fullsized":"2024-09-21T06:09:01.269817+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:08.332492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271878+0000","last_change":"2024-09-21T06:08:59.962081+0000","last_active":"2024-09-21T06:09:01.271878+0000","last_peered":"2024-09-21T06:09:01.271878+0000","last_clean":"2024-09-21T06:09:01.271878+0000","last_became_active":"2024-09-21T06:08:59.961618+0000","last_became_peered":"2024-09-21T06:08:59.961618+0000","last_unstale":"2024-09-21T06:09:01.271878+0000","last_undegraded":"2024-09-21T06:09:01.271878+0000","last_fullsized":"2024-09-21T06:09:01.271878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:48.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954804+0000","last_change":"2024-09-21T06:08:59.966031+0000","last_active":"2024-09-21T06:09:00.954804+0000","last_peered":"2024-09-21T06:09:00.954804+0000","last_clean":"2024-09-21T06:09:00.954804+0000","last_became_active":"2024-09-21T06:08:59.963672+0000","last_became_peered":"2024-09-21T06:08:59.963672+0000","last_unstale":"2024-09-21T06:09:00.954804+0000","last_undegraded":"2024-09-21T06:09:00.954804+0000","last_fullsized":"2024-09-21T06:09:00.954804+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:19.950055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270685+0000","last_change":"2024-09-21T06:08:59.960469+0000","last_active":"2024-09-21T06:09:01.270685+0000","last_peered":"2024-09-21T06:09:01.270685+0000","last_clean":"2024-09-21T06:09:01.270685+0000","last_became_active":"2024-09-21T06:08:59.957778+0000","last_became_peered":"2024-09-21T06:08:59.957778+0000","last_unstale":"2024-09-21T06:09:01.270685+0000","last_undegraded":"2024-09-21T06:09:01.270685+0000","last_fullsized":"2024-09-21T06:09:01.270685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.906763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949437+0000","last_change":"2024-09-21T06:08:59.962991+0000","last_active":"2024-09-21T06:09:00.949437+0000","last_peered":"2024-09-21T06:09:00.949437+0000","last_clean":"2024-09-21T06:09:00.949437+0000","last_became_active":"2024-09-21T06:08:59.962717+0000","last_became_peered":"2024-09-21T06:08:59.962717+0000","last_unstale":"2024-09-21T06:09:00.949437+0000","last_undegraded":"2024-09-21T06:09:00.949437+0000","last_fullsized":"2024-09-21T06:09:00.949437+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.949587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.948924+0000","last_change":"2024-09-21T06:08:59.959880+0000","last_active":"2024-09-21T06:09:00.948924+0000","last_peered":"2024-09-21T06:09:00.948924+0000","last_clean":"2024-09-21T06:09:00.948924+0000","last_became_active":"2024-09-21T06:08:59.959633+0000","last_became_peered":"2024-09-21T06:08:59.959633+0000","last_unstale":"2024-09-21T06:09:00.948924+0000","last_undegraded":"2024-09-21T06:09:00.948924+0000","last_fullsized":"2024-09-21T06:09:00.948924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:48.130294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.956067+0000","last_change":"2024-09-21T06:08:59.954095+0000","last_active":"2024-09-21T06:08:59.956067+0000","last_peered":"2024-09-21T06:08:59.956067+0000","last_clean":"2024-09-21T06:08:59.956067+0000","last_became_active":"2024-09-21T06:08:59.953684+0000","last_became_peered":"2024-09-21T06:08:59.953684+0000","last_unstale":"2024-09-21T06:08:59.956067+0000","last_undegraded":"2024-09-21T06:08:59.956067+0000","last_fullsized":"2024-09-21T06:08:59.956067+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:39.690960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269845+0000","last_change":"2024-09-21T06:08:59.969576+0000","last_active":"2024-09-21T06:09:01.269845+0000","last_peered":"2024-09-21T06:09:01.269845+0000","last_clean":"2024-09-21T06:09:01.269845+0000","last_became_active":"2024-09-21T06:08:59.969014+0000","last_became_peered":"2024-09-21T06:08:59.969014+0000","last_unstale":"2024-09-21T06:09:01.269845+0000","last_undegraded":"2024-09-21T06:09:01.269845+0000","last_fullsized":"2024-09-21T06:09:01.269845+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:45.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270520+0000","last_change":"2024-09-21T06:08:59.965933+0000","last_active":"2024-09-21T06:09:01.270520+0000","last_peered":"2024-09-21T06:09:01.270520+0000","last_clean":"2024-09-21T06:09:01.270520+0000","last_became_active":"2024-09-21T06:08:59.965448+0000","last_became_peered":"2024-09-21T06:08:59.965448+0000","last_unstale":"2024-09-21T06:09:01.270520+0000","last_undegraded":"2024-09-21T06:09:01.270520+0000","last_fullsized":"2024-09-21T06:09:01.270520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:06.647454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949022+0000","last_change":"2024-09-21T06:08:59.965997+0000","last_active":"2024-09-21T06:09:00.949022+0000","last_peered":"2024-09-21T06:09:00.949022+0000","last_clean":"2024-09-21T06:09:00.949022+0000","last_became_active":"2024-09-21T06:08:59.964848+0000","last_became_peered":"2024-09-21T06:08:59.964848+0000","last_unstale":"2024-09-21T06:09:00.949022+0000","last_undegraded":"2024-09-21T06:09:00.949022+0000","last_fullsized":"2024-09-21T06:09:00.949022+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:39.194397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.964128+0000","last_change":"2024-09-21T06:08:59.962588+0000","last_active":"2024-09-21T06:08:59.964128+0000","last_peered":"2024-09-21T06:08:59.964128+0000","last_clean":"2024-09-21T06:08:59.964128+0000","last_became_active":"2024-09-21T06:08:59.961885+0000","last_became_peered":"2024-09-21T06:08:59.961885+0000","last_unstale":"2024-09-21T06:08:59.964128+0000","last_undegraded":"2024-09-21T06:08:59.964128+0000","last_fullsized":"2024-09-21T06:08:59.964128+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:55.044953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949487+0000","last_change":"2024-09-21T06:08:59.975160+0000","last_active":"2024-09-21T06:09:00.949487+0000","last_peered":"2024-09-21T06:09:00.949487+0000","last_clean":"2024-09-21T06:09:00.949487+0000","last_became_active":"2024-09-21T06:08:59.974385+0000","last_became_peered":"2024-09-21T06:08:59.974385+0000","last_unstale":"2024-09-21T06:09:00.949487+0000","last_undegraded":"2024-09-21T06:09:00.949487+0000","last_fullsized":"2024-09-21T06:09:00.949487+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:40.309543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949043+0000","last_change":"2024-09-21T06:08:59.974673+0000","last_active":"2024-09-21T06:09:00.949043+0000","last_peered":"2024-09-21T06:09:00.949043+0000","last_clean":"2024-09-21T06:09:00.949043+0000","last_became_active":"2024-09-21T06:08:59.974108+0000","last_became_peered":"2024-09-21T06:08:59.974108+0000","last_unstale":"2024-09-21T06:09:00.949043+0000","last_undegraded":"2024-09-21T06:09:00.949043+0000","last_fullsized":"2024-09-21T06:09:00.949043+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:20.034684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954761+0000","last_change":"2024-09-21T06:08:59.974551+0000","last_active":"2024-09-21T06:09:00.954761+0000","last_peered":"2024-09-21T06:09:00.954761+0000","last_clean":"2024-09-21T06:09:00.954761+0000","last_became_active":"2024-09-21T06:08:59.969398+0000","last_became_peered":"2024-09-21T06:08:59.969398+0000","last_unstale":"2024-09-21T06:09:00.954761+0000","last_undegraded":"2024-09-21T06:09:00.954761+0000","last_fullsized":"2024-09-21T06:09:00.954761+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:18.254133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270401+0000","last_change":"2024-09-21T06:08:59.961412+0000","last_active":"2024-09-21T06:09:01.270401+0000","last_peered":"2024-09-21T06:09:01.270401+0000","last_clean":"2024-09-21T06:09:01.270401+0000","last_became_active":"2024-09-21T06:08:59.960998+0000","last_became_peered":"2024-09-21T06:08:59.960998+0000","last_unstale":"2024-09-21T06:09:01.270401+0000","last_undegraded":"2024-09-21T06:09:01.270401+0000","last_fullsized":"2024-09-21T06:09:01.270401+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:07.180503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949130+0000","last_change":"2024-09-21T06:08:59.967968+0000","last_active":"2024-09-21T06:09:00.949130+0000","last_peered":"2024-09-21T06:09:00.949130+0000","last_clean":"2024-09-21T06:09:00.949130+0000","last_became_active":"2024-09-21T06:08:59.964811+0000","last_became_peered":"2024-09-21T06:08:59.964811+0000","last_unstale":"2024-09-21T06:09:00.949130+0000","last_undegraded":"2024-09-21T06:09:00.949130+0000","last_fullsized":"2024-09-21T06:09:00.949130+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:44.913733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954599+0000","last_change":"2024-09-21T06:08:59.964296+0000","last_active":"2024-09-21T06:09:00.954599+0000","last_peered":"2024-09-21T06:09:00.954599+0000","last_clean":"2024-09-21T06:09:00.954599+0000","last_became_active":"2024-09-21T06:08:59.963971+0000","last_became_peered":"2024-09-21T06:08:59.963971+0000","last_unstale":"2024-09-21T06:09:00.954599+0000","last_undegraded":"2024-09-21T06:09:00.954599+0000","last_fullsized":"2024-09-21T06:09:00.954599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:36.080592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949191+0000","last_change":"2024-09-21T06:08:59.968322+0000","last_active":"2024-09-21T06:09:00.949191+0000","last_peered":"2024-09-21T06:09:00.949191+0000","last_clean":"2024-09-21T06:09:00.949191+0000","last_became_active":"2024-09-21T06:08:59.968019+0000","last_became_peered":"2024-09-21T06:08:59.968019+0000","last_unstale":"2024-09-21T06:09:00.949191+0000","last_undegraded":"2024-09-21T06:09:00.949191+0000","last_fullsized":"2024-09-21T06:09:00.949191+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:44.754771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271150+0000","last_change":"2024-09-21T06:08:59.966550+0000","last_active":"2024-09-21T06:09:01.271150+0000","last_peered":"2024-09-21T06:09:01.271150+0000","last_clean":"2024-09-21T06:09:01.271150+0000","last_became_active":"2024-09-21T06:08:59.966279+0000","last_became_peered":"2024-09-21T06:08:59.966279+0000","last_unstale":"2024-09-21T06:09:01.271150+0000","last_undegraded":"2024-09-21T06:09:01.271150+0000","last_fullsized":"2024-09-21T06:09:01.271150+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:00.716805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270657+0000","last_change":"2024-09-21T06:08:59.965681+0000","last_active":"2024-09-21T06:09:01.270657+0000","last_peered":"2024-09-21T06:09:01.270657+0000","last_clean":"2024-09-21T06:09:01.270657+0000","last_became_active":"2024-09-21T06:08:59.964750+0000","last_became_peered":"2024-09-21T06:08:59.964750+0000","last_unstale":"2024-09-21T06:09:01.270657+0000","last_undegraded":"2024-09-21T06:09:01.270657+0000","last_fullsized":"2024-09-21T06:09:01.270657+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:05.533560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954753+0000","last_change":"2024-09-21T06:08:59.961566+0000","last_active":"2024-09-21T06:09:00.954753+0000","last_peered":"2024-09-21T06:09:00.954753+0000","last_clean":"2024-09-21T06:09:00.954753+0000","last_became_active":"2024-09-21T06:08:59.961313+0000","last_became_peered":"2024-09-21T06:08:59.961313+0000","last_unstale":"2024-09-21T06:09:00.954753+0000","last_undegraded":"2024-09-21T06:09:00.954753+0000","last_fullsized":"2024-09-21T06:09:00.954753+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954837+0000","last_change":"2024-09-21T06:08:59.968629+0000","last_active":"2024-09-21T06:09:00.954837+0000","last_peered":"2024-09-21T06:09:00.954837+0000","last_clean":"2024-09-21T06:09:00.954837+0000","last_became_active":"2024-09-21T06:08:59.968184+0000","last_became_peered":"2024-09-21T06:08:59.968184+0000","last_unstale":"2024-09-21T06:09:00.954837+0000","last_undegraded":"2024-09-21T06:09:00.954837+0000","last_fullsized":"2024-09-21T06:09:00.954837+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:17.558540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270210+0000","last_change":"2024-09-21T06:08:59.971332+0000","last_active":"2024-09-21T06:09:01.270210+0000","last_peered":"2024-09-21T06:09:01.270210+0000","last_clean":"2024-09-21T06:09:01.270210+0000","last_became_active":"2024-09-21T06:08:59.971092+0000","last_became_peered":"2024-09-21T06:08:59.971092+0000","last_unstale":"2024-09-21T06:09:01.270210+0000","last_undegraded":"2024-09-21T06:09:01.270210+0000","last_fullsized":"2024-09-21T06:09:01.270210+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:23.391114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270933+0000","last_change":"2024-09-21T06:08:59.971876+0000","last_active":"2024-09-21T06:09:01.270933+0000","last_peered":"2024-09-21T06:09:01.270933+0000","last_clean":"2024-09-21T06:09:01.270933+0000","last_became_active":"2024-09-21T06:08:59.971559+0000","last_became_peered":"2024-09-21T06:08:59.971559+0000","last_unstale":"2024-09-21T06:09:01.270933+0000","last_undegraded":"2024-09-21T06:09:01.270933+0000","last_fullsized":"2024-09-21T06:09:01.270933+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:41.956749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269476+0000","last_change":"2024-09-21T06:08:59.963886+0000","last_active":"2024-09-21T06:09:01.269476+0000","last_peered":"2024-09-21T06:09:01.269476+0000","last_clean":"2024-09-21T06:09:01.269476+0000","last_became_active":"2024-09-21T06:08:59.962441+0000","last_became_peered":"2024-09-21T06:08:59.962441+0000","last_unstale":"2024-09-21T06:09:01.269476+0000","last_undegraded":"2024-09-21T06:09:01.269476+0000","last_fullsized":"2024-09-21T06:09:01.269476+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:35.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"98'4","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271109+0000","last_change":"2024-09-21T06:08:58.962858+0000","last_active":"2024-09-21T06:09:01.271109+0000","last_peered":"2024-09-21T06:09:01.271109+0000","last_clean":"2024-09-21T06:09:01.271109+0000","last_became_active":"2024-09-21T06:08:58.962323+0000","last_became_peered":"2024-09-21T06:08:58.962323+0000","last_unstale":"2024-09-21T06:09:01.271109+0000","last_undegraded":"2024-09-21T06:09:01.271109+0000","last_fullsized":"2024-09-21T06:09:01.271109+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:45.732591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270924+0000","last_change":"2024-09-21T06:08:59.959772+0000","last_active":"2024-09-21T06:09:01.270924+0000","last_peered":"2024-09-21T06:09:01.270924+0000","last_clean":"2024-09-21T06:09:01.270924+0000","last_became_active":"2024-09-21T06:08:59.959516+0000","last_became_peered":"2024-09-21T06:08:59.959516+0000","last_unstale":"2024-09-21T06:09:01.270924+0000","last_undegraded":"2024-09-21T06:09:01.270924+0000","last_fullsized":"2024-09-21T06:09:01.270924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:19.048586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269986+0000","last_change":"2024-09-21T06:08:58.950026+0000","last_active":"2024-09-21T06:09:01.269986+0000","last_peered":"2024-09-21T06:09:01.269986+0000","last_clean":"2024-09-21T06:09:01.269986+0000","last_became_active":"2024-09-21T06:08:58.949757+0000","last_became_peered":"2024-09-21T06:08:58.949757+0000","last_unstale":"2024-09-21T06:09:01.269986+0000","last_undegraded":"2024-09-21T06:09:01.269986+0000","last_fullsized":"2024-09-21T06:09:01.269986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.091179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271853+0000","last_change":"2024-09-21T06:08:59.969247+0000","last_active":"2024-09-21T06:09:01.271853+0000","last_peered":"2024-09-21T06:09:01.271853+0000","last_clean":"2024-09-21T06:09:01.271853+0000","last_became_active":"2024-09-21T06:08:59.968056+0000","last_became_peered":"2024-09-21T06:08:59.968056+0000","last_unstale":"2024-09-21T06:09:01.271853+0000","last_undegraded":"2024-09-21T06:09:01.271853+0000","last_fullsized":"2024-09-21T06:09:01.271853+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:56.841829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.974288+0000","last_change":"2024-09-21T06:08:58.961367+0000","last_active":"2024-09-21T06:08:59.974288+0000","last_peered":"2024-09-21T06:08:59.974288+0000","last_clean":"2024-09-21T06:08:59.974288+0000","last_became_active":"2024-09-21T06:08:58.961114+0000","last_became_peered":"2024-09-21T06:08:58.961114+0000","last_unstale":"2024-09-21T06:08:59.974288+0000","last_undegraded":"2024-09-21T06:08:59.974288+0000","last_fullsized":"2024-09-21T06:08:59.974288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:51.689475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949690+0000","last_change":"2024-09-21T06:08:59.966895+0000","last_active":"2024-09-21T06:09:00.949690+0000","last_peered":"2024-09-21T06:09:00.949690+0000","last_clean":"2024-09-21T06:09:00.949690+0000","last_became_active":"2024-09-21T06:08:59.966629+0000","last_became_peered":"2024-09-21T06:08:59.966629+0000","last_unstale":"2024-09-21T06:09:00.949690+0000","last_undegraded":"2024-09-21T06:09:00.949690+0000","last_fullsized":"2024-09-21T06:09:00.949690+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:00.105342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.976917+0000","last_change":"2024-09-21T06:08:58.958668+0000","last_active":"2024-09-21T06:08:59.976917+0000","last_peered":"2024-09-21T06:08:59.976917+0000","last_clean":"2024-09-21T06:08:59.976917+0000","last_became_active":"2024-09-21T06:08:58.958367+0000","last_became_peered":"2024-09-21T06:08:58.958367+0000","last_unstale":"2024-09-21T06:08:59.976917+0000","last_undegraded":"2024-09-21T06:08:59.976917+0000","last_fullsized":"2024-09-21T06:08:59.976917+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:55.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954678+0000","last_change":"2024-09-21T06:08:59.967027+0000","last_active":"2024-09-21T06:09:00.954678+0000","last_peered":"2024-09-21T06:09:00.954678+0000","last_clean":"2024-09-21T06:09:00.954678+0000","last_became_active":"2024-09-21T06:08:59.966325+0000","last_became_peered":"2024-09-21T06:08:59.966325+0000","last_unstale":"2024-09-21T06:09:00.954678+0000","last_undegraded":"2024-09-21T06:09:00.954678+0000","last_fullsized":"2024-09-21T06:09:00.954678+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:25.911397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270962+0000","last_change":"2024-09-21T06:08:58.955274+0000","last_active":"2024-09-21T06:09:01.270962+0000","last_peered":"2024-09-21T06:09:01.270962+0000","last_clean":"2024-09-21T06:09:01.270962+0000","last_became_active":"2024-09-21T06:08:58.954332+0000","last_became_peered":"2024-09-21T06:08:58.954332+0000","last_unstale":"2024-09-21T06:09:01.270962+0000","last_undegraded":"2024-09-21T06:09:01.270962+0000","last_fullsized":"2024-09-21T06:09:01.270962+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:17.978172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270777+0000","last_change":"2024-09-21T06:08:59.965669+0000","last_active":"2024-09-21T06:09:01.270777+0000","last_peered":"2024-09-21T06:09:01.270777+0000","last_clean":"2024-09-21T06:09:01.270777+0000","last_became_active":"2024-09-21T06:08:59.965090+0000","last_became_peered":"2024-09-21T06:08:59.965090+0000","last_unstale":"2024-09-21T06:09:01.270777+0000","last_undegraded":"2024-09-21T06:09:01.270777+0000","last_fullsized":"2024-09-21T06:09:01.270777+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:04.497968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270438+0000","last_change":"2024-09-21T06:08:58.954093+0000","last_active":"2024-09-21T06:09:01.270438+0000","last_peered":"2024-09-21T06:09:01.270438+0000","last_clean":"2024-09-21T06:09:01.270438+0000","last_became_active":"2024-09-21T06:08:58.953788+0000","last_became_peered":"2024-09-21T06:08:58.953788+0000","last_unstale":"2024-09-21T06:09:01.270438+0000","last_undegraded":"2024-09-21T06:09:01.270438+0000","last_fullsized":"2024-09-21T06:09:01.270438+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:24.404320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949170+0000","last_change":"2024-09-21T06:08:59.956334+0000","last_active":"2024-09-21T06:09:00.949170+0000","last_peered":"2024-09-21T06:09:00.949170+0000","last_clean":"2024-09-21T06:09:00.949170+0000","last_became_active":"2024-09-21T06:08:59.955612+0000","last_became_peered":"2024-09-21T06:08:59.955612+0000","last_unstale":"2024-09-21T06:09:00.949170+0000","last_undegraded":"2024-09-21T06:09:00.949170+0000","last_fullsized":"2024-09-21T06:09:00.949170+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:32.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.949293+0000","last_change":"2024-09-21T06:08:58.960636+0000","last_active":"2024-09-21T06:08:59.949293+0000","last_peered":"2024-09-21T06:08:59.949293+0000","last_clean":"2024-09-21T06:08:59.949293+0000","last_became_active":"2024-09-21T06:08:58.960198+0000","last_became_peered":"2024-09-21T06:08:58.960198+0000","last_unstale":"2024-09-21T06:08:59.949293+0000","last_undegraded":"2024-09-21T06:08:59.949293+0000","last_fullsized":"2024-09-21T06:08:59.949293+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:54.940054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.956011+0000","last_change":"2024-09-21T06:08:59.952185+0000","last_active":"2024-09-21T06:08:59.956011+0000","last_peered":"2024-09-21T06:08:59.956011+0000","last_clean":"2024-09-21T06:08:59.956011+0000","last_became_active":"2024-09-21T06:08:59.950084+0000","last_became_peered":"2024-09-21T06:08:59.950084+0000","last_unstale":"2024-09-21T06:08:59.956011+0000","last_undegraded":"2024-09-21T06:08:59.956011+0000","last_fullsized":"2024-09-21T06:08:59.956011+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:56.378322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954995+0000","last_change":"2024-09-21T06:08:58.950239+0000","last_active":"2024-09-21T06:09:00.954995+0000","last_peered":"2024-09-21T06:09:00.954995+0000","last_clean":"2024-09-21T06:09:00.954995+0000","last_became_active":"2024-09-21T06:08:58.949944+0000","last_became_peered":"2024-09-21T06:08:58.949944+0000","last_unstale":"2024-09-21T06:09:00.954995+0000","last_undegraded":"2024-09-21T06:09:00.954995+0000","last_fullsized":"2024-09-21T06:09:00.954995+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:36.559156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.972468+0000","last_change":"2024-09-21T06:08:59.970232+0000","last_active":"2024-09-21T06:08:59.972468+0000","last_peered":"2024-09-21T06:08:59.972468+0000","last_clean":"2024-09-21T06:08:59.972468+0000","last_became_active":"2024-09-21T06:08:59.969957+0000","last_became_peered":"2024-09-21T06:08:59.969957+0000","last_unstale":"2024-09-21T06:08:59.972468+0000","last_undegraded":"2024-09-21T06:08:59.972468+0000","last_fullsized":"2024-09-21T06:08:59.972468+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.232320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271967+0000","last_change":"2024-09-21T06:08:58.964451+0000","last_active":"2024-09-21T06:09:01.271967+0000","last_peered":"2024-09-21T06:09:01.271967+0000","last_clean":"2024-09-21T06:09:01.271967+0000","last_became_active":"2024-09-21T06:08:58.963960+0000","last_became_peered":"2024-09-21T06:08:58.963960+0000","last_unstale":"2024-09-21T06:09:01.271967+0000","last_undegraded":"2024-09-21T06:09:01.271967+0000","last_fullsized":"2024-09-21T06:09:01.271967+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:01.934881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271174+0000","last_change":"2024-09-21T06:08:59.970797+0000","last_active":"2024-09-21T06:09:01.271174+0000","last_peered":"2024-09-21T06:09:01.271174+0000","last_clean":"2024-09-21T06:09:01.271174+0000","last_became_active":"2024-09-21T06:08:59.966869+0000","last_became_peered":"2024-09-21T06:08:59.966869+0000","last_unstale":"2024-09-21T06:09:01.271174+0000","last_undegraded":"2024-09-21T06:09:01.271174+0000","last_fullsized":"2024-09-21T06:09:01.271174+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.027615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271133+0000","last_change":"2024-09-21T06:08:58.961115+0000","last_active":"2024-09-21T06:09:01.271133+0000","last_peered":"2024-09-21T06:09:01.271133+0000","last_clean":"2024-09-21T06:09:01.271133+0000","last_became_active":"2024-09-21T06:08:58.960819+0000","last_became_peered":"2024-09-21T06:08:58.960819+0000","last_unstale":"2024-09-21T06:09:01.271133+0000","last_undegraded":"2024-09-21T06:09:01.271133+0000","last_fullsized":"2024-09-21T06:09:01.271133+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:54.685837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.964155+0000","last_change":"2024-09-21T06:08:59.962868+0000","last_active":"2024-09-21T06:08:59.964155+0000","last_peered":"2024-09-21T06:08:59.964155+0000","last_clean":"2024-09-21T06:08:59.964155+0000","last_became_active":"2024-09-21T06:08:59.962326+0000","last_became_peered":"2024-09-21T06:08:59.962326+0000","last_unstale":"2024-09-21T06:08:59.964155+0000","last_undegraded":"2024-09-21T06:08:59.964155+0000","last_fullsized":"2024-09-21T06:08:59.964155+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:27.371158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"98'3","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271621+0000","last_change":"2024-09-21T06:08:58.959618+0000","last_active":"2024-09-21T06:09:01.271621+0000","last_peered":"2024-09-21T06:09:01.271621+0000","last_clean":"2024-09-21T06:09:01.271621+0000","last_became_active":"2024-09-21T06:08:58.959053+0000","last_became_peered":"2024-09-21T06:08:58.959053+0000","last_unstale":"2024-09-21T06:09:01.271621+0000","last_undegraded":"2024-09-21T06:09:01.271621+0000","last_fullsized":"2024-09-21T06:09:01.271621+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:17.316213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270003+0000","last_change":"2024-09-21T06:08:59.971688+0000","last_active":"2024-09-21T06:09:01.270003+0000","last_peered":"2024-09-21T06:09:01.270003+0000","last_clean":"2024-09-21T06:09:01.270003+0000","last_became_active":"2024-09-21T06:08:59.970408+0000","last_became_peered":"2024-09-21T06:08:59.970408+0000","last_unstale":"2024-09-21T06:09:01.270003+0000","last_undegraded":"2024-09-21T06:09:01.270003+0000","last_fullsized":"2024-09-21T06:09:01.270003+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:30.210909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"98'6","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269984+0000","last_change":"2024-09-21T06:08:58.958357+0000","last_active":"2024-09-21T06:09:01.269984+0000","last_peered":"2024-09-21T06:09:01.269984+0000","last_clean":"2024-09-21T06:09:01.269984+0000","last_became_active":"2024-09-21T06:08:58.957921+0000","last_became_peered":"2024-09-21T06:08:58.957921+0000","last_unstale":"2024-09-21T06:09:01.269984+0000","last_undegraded":"2024-09-21T06:09:01.269984+0000","last_fullsized":"2024-09-21T06:09:01.269984+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:31.499719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.972185+0000","last_change":"2024-09-21T06:08:59.971878+0000","last_active":"2024-09-21T06:08:59.972185+0000","last_peered":"2024-09-21T06:08:59.972185+0000","last_clean":"2024-09-21T06:08:59.972185+0000","last_became_active":"2024-09-21T06:08:59.970790+0000","last_became_peered":"2024-09-21T06:08:59.970790+0000","last_unstale":"2024-09-21T06:08:59.972185+0000","last_undegraded":"2024-09-21T06:08:59.972185+0000","last_fullsized":"2024-09-21T06:08:59.972185+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:32.612011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.955096+0000","last_change":"2024-09-21T06:08:58.962565+0000","last_active":"2024-09-21T06:09:00.955096+0000","last_peered":"2024-09-21T06:09:00.955096+0000","last_clean":"2024-09-21T06:09:00.955096+0000","last_became_active":"2024-09-21T06:08:58.961500+0000","last_became_peered":"2024-09-21T06:08:58.961500+0000","last_unstale":"2024-09-21T06:09:00.955096+0000","last_undegraded":"2024-09-21T06:09:00.955096+0000","last_fullsized":"2024-09-21T06:09:00.955096+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:44.520275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949526+0000","last_change":"2024-09-21T06:08:59.957214+0000","last_active":"2024-09-21T06:09:00.949526+0000","last_peered":"2024-09-21T06:09:00.949526+0000","last_clean":"2024-09-21T06:09:00.949526+0000","last_became_active":"2024-09-21T06:08:59.956039+0000","last_became_peered":"2024-09-21T06:08:59.956039+0000","last_unstale":"2024-09-21T06:09:00.949526+0000","last_undegraded":"2024-09-21T06:09:00.949526+0000","last_fullsized":"2024-09-21T06:09:00.949526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:25.049687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.947217+0000","last_change":"2024-09-21T06:08:58.950575+0000","last_active":"2024-09-21T06:08:59.947217+0000","last_peered":"2024-09-21T06:08:59.947217+0000","last_clean":"2024-09-21T06:08:59.947217+0000","last_became_active":"2024-09-21T06:08:58.950271+0000","last_became_peered":"2024-09-21T06:08:58.950271+0000","last_unstale":"2024-09-21T06:08:59.947217+0000","last_undegraded":"2024-09-21T06:08:59.947217+0000","last_fullsized":"2024-09-21T06:08:59.947217+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:46.922550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954513+0000","last_change":"2024-09-21T06:08:59.967412+0000","last_active":"2024-09-21T06:09:00.954513+0000","last_peered":"2024-09-21T06:09:00.954513+0000","last_clean":"2024-09-21T06:09:00.954513+0000","last_became_active":"2024-09-21T06:08:59.966723+0000","last_became_peered":"2024-09-21T06:08:59.966723+0000","last_unstale":"2024-09-21T06:09:00.954513+0000","last_undegraded":"2024-09-21T06:09:00.954513+0000","last_fullsized":"2024-09-21T06:09:00.954513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:17.052381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271280+0000","last_change":"2024-09-21T06:08:58.962319+0000","last_active":"2024-09-21T06:09:01.271280+0000","last_peered":"2024-09-21T06:09:01.271280+0000","last_clean":"2024-09-21T06:09:01.271280+0000","last_became_active":"2024-09-21T06:08:58.961516+0000","last_became_peered":"2024-09-21T06:08:58.961516+0000","last_unstale":"2024-09-21T06:09:01.271280+0000","last_undegraded":"2024-09-21T06:09:01.271280+0000","last_fullsized":"2024-09-21T06:09:01.271280+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:18.237892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954972+0000","last_change":"2024-09-21T06:08:59.969789+0000","last_active":"2024-09-21T06:09:00.954972+0000","last_peered":"2024-09-21T06:09:00.954972+0000","last_clean":"2024-09-21T06:09:00.954972+0000","last_became_active":"2024-09-21T06:08:59.968389+0000","last_became_peered":"2024-09-21T06:08:59.968389+0000","last_unstale":"2024-09-21T06:09:00.954972+0000","last_undegraded":"2024-09-21T06:09:00.954972+0000","last_fullsized":"2024-09-21T06:09:00.954972+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:50.758099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"98'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.975596+0000","last_change":"2024-09-21T06:08:58.962716+0000","last_active":"2024-09-21T06:08:59.975596+0000","last_peered":"2024-09-21T06:08:59.975596+0000","last_clean":"2024-09-21T06:08:59.975596+0000","last_became_active":"2024-09-21T06:08:58.961600+0000","last_became_peered":"2024-09-21T06:08:58.961600+0000","last_unstale":"2024-09-21T06:08:59.975596+0000","last_undegraded":"2024-09-21T06:08:59.975596+0000","last_fullsized":"2024-09-21T06:08:59.975596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:19.212734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949815+0000","last_change":"2024-09-21T06:08:59.953589+0000","last_active":"2024-09-21T06:09:00.949815+0000","last_peered":"2024-09-21T06:09:00.949815+0000","last_clean":"2024-09-21T06:09:00.949815+0000","last_became_active":"2024-09-21T06:08:59.953315+0000","last_became_peered":"2024-09-21T06:08:59.953315+0000","last_unstale":"2024-09-21T06:09:00.949815+0000","last_undegraded":"2024-09-21T06:09:00.949815+0000","last_fullsized":"2024-09-21T06:09:00.949815+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:14.296586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269975+0000","last_change":"2024-09-21T06:08:58.963659+0000","last_active":"2024-09-21T06:09:01.269975+0000","last_peered":"2024-09-21T06:09:01.269975+0000","last_clean":"2024-09-21T06:09:01.269975+0000","last_became_active":"2024-09-21T06:08:58.962828+0000","last_became_peered":"2024-09-21T06:08:58.962828+0000","last_unstale":"2024-09-21T06:09:01.269975+0000","last_undegraded":"2024-09-21T06:09:01.269975+0000","last_fullsized":"2024-09-21T06:09:01.269975+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.920557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269599+0000","last_change":"2024-09-21T06:08:59.956199+0000","last_active":"2024-09-21T06:09:01.269599+0000","last_peered":"2024-09-21T06:09:01.269599+0000","last_clean":"2024-09-21T06:09:01.269599+0000","last_became_active":"2024-09-21T06:08:59.955933+0000","last_became_peered":"2024-09-21T06:08:59.955933+0000","last_unstale":"2024-09-21T06:09:01.269599+0000","last_undegraded":"2024-09-21T06:09:01.269599+0000","last_fullsized":"2024-09-21T06:09:01.269599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:27.560783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.977455+0000","last_change":"2024-09-21T06:08:58.962100+0000","last_active":"2024-09-21T06:08:59.977455+0000","last_peered":"2024-09-21T06:08:59.977455+0000","last_clean":"2024-09-21T06:08:59.977455+0000","last_became_active":"2024-09-21T06:08:58.961856+0000","last_became_peered":"2024-09-21T06:08:58.961856+0000","last_unstale":"2024-09-21T06:08:59.977455+0000","last_undegraded":"2024-09-21T06:08:59.977455+0000","last_fullsized":"2024-09-21T06:08:59.977455+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.330751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270488+0000","last_change":"2024-09-21T06:08:59.969259+0000","last_active":"2024-09-21T06:09:01.270488+0000","last_peered":"2024-09-21T06:09:01.270488+0000","last_clean":"2024-09-21T06:09:01.270488+0000","last_became_active":"2024-09-21T06:08:59.968661+0000","last_became_peered":"2024-09-21T06:08:59.968661+0000","last_unstale":"2024-09-21T06:09:01.270488+0000","last_undegraded":"2024-09-21T06:09:01.270488+0000","last_fullsized":"2024-09-21T06:09:01.270488+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:32.985628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.948411+0000","last_change":"2024-09-21T06:08:58.957877+0000","last_active":"2024-09-21T06:08:59.948411+0000","last_peered":"2024-09-21T06:08:59.948411+0000","last_clean":"2024-09-21T06:08:59.948411+0000","last_became_active":"2024-09-21T06:08:58.957585+0000","last_became_peered":"2024-09-21T06:08:58.957585+0000","last_unstale":"2024-09-21T06:08:59.948411+0000","last_undegraded":"2024-09-21T06:08:59.948411+0000","last_fullsized":"2024-09-21T06:08:59.948411+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.805845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949337+0000","last_change":"2024-09-21T06:08:59.958322+0000","last_active":"2024-09-21T06:09:00.949337+0000","last_peered":"2024-09-21T06:09:00.949337+0000","last_clean":"2024-09-21T06:09:00.949337+0000","last_became_active":"2024-09-21T06:08:59.958057+0000","last_became_peered":"2024-09-21T06:08:59.958057+0000","last_unstale":"2024-09-21T06:09:00.949337+0000","last_undegraded":"2024-09-21T06:09:00.949337+0000","last_fullsized":"2024-09-21T06:09:00.949337+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:43.951528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.966553+0000","last_change":"2024-09-21T06:08:58.958262+0000","last_active":"2024-09-21T06:08:59.966553+0000","last_peered":"2024-09-21T06:08:59.966553+0000","last_clean":"2024-09-21T06:08:59.966553+0000","last_became_active":"2024-09-21T06:08:58.956315+0000","last_became_peered":"2024-09-21T06:08:58.956315+0000","last_unstale":"2024-09-21T06:08:59.966553+0000","last_undegraded":"2024-09-21T06:08:59.966553+0000","last_fullsized":"2024-09-21T06:08:59.966553+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:31.671327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270539+0000","last_change":"2024-09-21T06:08:59.960114+0000","last_active":"2024-09-21T06:09:01.270539+0000","last_peered":"2024-09-21T06:09:01.270539+0000","last_clean":"2024-09-21T06:09:01.270539+0000","last_became_active":"2024-09-21T06:08:59.959833+0000","last_became_peered":"2024-09-21T06:08:59.959833+0000","last_unstale":"2024-09-21T06:09:01.270539+0000","last_undegraded":"2024-09-21T06:09:01.270539+0000","last_fullsized":"2024-09-21T06:09:01.270539+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:20.079989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949500+0000","last_change":"2024-09-21T06:08:58.963718+0000","last_active":"2024-09-21T06:09:00.949500+0000","last_peered":"2024-09-21T06:09:00.949500+0000","last_clean":"2024-09-21T06:09:00.949500+0000","last_became_active":"2024-09-21T06:08:58.963383+0000","last_became_peered":"2024-09-21T06:08:58.963383+0000","last_unstale":"2024-09-21T06:09:00.949500+0000","last_undegraded":"2024-09-21T06:09:00.949500+0000","last_fullsized":"2024-09-21T06:09:00.949500+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.641253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949258+0000","last_change":"2024-09-21T06:08:59.967611+0000","last_active":"2024-09-21T06:09:00.949258+0000","last_peered":"2024-09-21T06:09:00.949258+0000","last_clean":"2024-09-21T06:09:00.949258+0000","last_became_active":"2024-09-21T06:08:59.963632+0000","last_became_peered":"2024-09-21T06:08:59.963632+0000","last_unstale":"2024-09-21T06:09:00.949258+0000","last_undegraded":"2024-09-21T06:09:00.949258+0000","last_fullsized":"2024-09-21T06:09:00.949258+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:28.333461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949647+0000","last_change":"2024-09-21T06:08:58.958953+0000","last_active":"2024-09-21T06:09:00.949647+0000","last_peered":"2024-09-21T06:09:00.949647+0000","last_clean":"2024-09-21T06:09:00.949647+0000","last_became_active":"2024-09-21T06:08:58.958671+0000","last_became_peered":"2024-09-21T06:08:58.958671+0000","last_unstale":"2024-09-21T06:09:00.949647+0000","last_undegraded":"2024-09-21T06:09:00.949647+0000","last_fullsized":"2024-09-21T06:09:00.949647+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:21.993187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269723+0000","last_change":"2024-09-21T06:08:59.958540+0000","last_active":"2024-09-21T06:09:01.269723+0000","last_peered":"2024-09-21T06:09:01.269723+0000","last_clean":"2024-09-21T06:09:01.269723+0000","last_became_active":"2024-09-21T06:08:59.958247+0000","last_became_peered":"2024-09-21T06:08:59.958247+0000","last_unstale":"2024-09-21T06:09:01.269723+0000","last_undegraded":"2024-09-21T06:09:01.269723+0000","last_fullsized":"2024-09-21T06:09:01.269723+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:57.164455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.947454+0000","last_change":"2024-09-21T06:08:58.955677+0000","last_active":"2024-09-21T06:08:59.947454+0000","last_peered":"2024-09-21T06:08:59.947454+0000","last_clean":"2024-09-21T06:08:59.947454+0000","last_became_active":"2024-09-21T06:08:58.955001+0000","last_became_peered":"2024-09-21T06:08:58.955001+0000","last_unstale":"2024-09-21T06:08:59.947454+0000","last_undegraded":"2024-09-21T06:08:59.947454+0000","last_fullsized":"2024-09-21T06:08:59.947454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:25.782184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270240+0000","last_change":"2024-09-21T06:08:59.961928+0000","last_active":"2024-09-21T06:09:01.270240+0000","last_peered":"2024-09-21T06:09:01.270240+0000","last_clean":"2024-09-21T06:09:01.270240+0000","last_became_active":"2024-09-21T06:08:59.961471+0000","last_became_peered":"2024-09-21T06:08:59.961471+0000","last_unstale":"2024-09-21T06:09:01.270240+0000","last_undegraded":"2024-09-21T06:09:01.270240+0000","last_fullsized":"2024-09-21T06:09:01.270240+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:54.388763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.955295+0000","last_change":"2024-09-21T06:08:58.958194+0000","last_active":"2024-09-21T06:09:00.955295+0000","last_peered":"2024-09-21T06:09:00.955295+0000","last_clean":"2024-09-21T06:09:00.955295+0000","last_became_active":"2024-09-21T06:08:58.957926+0000","last_became_peered":"2024-09-21T06:08:58.957926+0000","last_unstale":"2024-09-21T06:09:00.955295+0000","last_undegraded":"2024-09-21T06:09:00.955295+0000","last_fullsized":"2024-09-21T06:09:00.955295+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:09.376134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949436+0000","last_change":"2024-09-21T06:08:59.956591+0000","last_active":"2024-09-21T06:09:00.949436+0000","last_peered":"2024-09-21T06:09:00.949436+0000","last_clean":"2024-09-21T06:09:00.949436+0000","last_became_active":"2024-09-21T06:08:59.956144+0000","last_became_peered":"2024-09-21T06:08:59.956144+0000","last_unstale":"2024-09-21T06:09:00.949436+0000","last_undegraded":"2024-09-21T06:09:00.949436+0000","last_fullsized":"2024-09-21T06:09:00.949436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.327765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"99'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954811+0000","last_change":"2024-09-21T06:08:58.959784+0000","last_active":"2024-09-21T06:09:00.954811+0000","last_peered":"2024-09-21T06:09:00.954811+0000","last_clean":"2024-09-21T06:09:00.954811+0000","last_became_active":"2024-09-21T06:08:58.959441+0000","last_became_peered":"2024-09-21T06:08:58.959441+0000","last_unstale":"2024-09-21T06:09:00.954811+0000","last_undegraded":"2024-09-21T06:09:00.954811+0000","last_fullsized":"2024-09-21T06:09:00.954811+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:55.204028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.272116+0000","last_change":"2024-09-21T06:08:59.967280+0000","last_active":"2024-09-21T06:09:01.272116+0000","last_peered":"2024-09-21T06:09:01.272116+0000","last_clean":"2024-09-21T06:09:01.272116+0000","last_became_active":"2024-09-21T06:08:59.966981+0000","last_became_peered":"2024-09-21T06:08:59.966981+0000","last_unstale":"2024-09-21T06:09:01.272116+0000","last_undegraded":"2024-09-21T06:09:01.272116+0000","last_fullsized":"2024-09-21T06:09:01.272116+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:00.015905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270098+0000","last_change":"2024-09-21T06:08:58.963356+0000","last_active":"2024-09-21T06:09:01.270098+0000","last_peered":"2024-09-21T06:09:01.270098+0000","last_clean":"2024-09-21T06:09:01.270098+0000","last_became_active":"2024-09-21T06:08:58.962482+0000","last_became_peered":"2024-09-21T06:08:58.962482+0000","last_unstale":"2024-09-21T06:09:01.270098+0000","last_undegraded":"2024-09-21T06:09:01.270098+0000","last_fullsized":"2024-09-21T06:09:01.270098+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:37.425394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269772+0000","last_change":"2024-09-21T06:08:59.964201+0000","last_active":"2024-09-21T06:09:01.269772+0000","last_peered":"2024-09-21T06:09:01.269772+0000","last_clean":"2024-09-21T06:09:01.269772+0000","last_became_active":"2024-09-21T06:08:59.963524+0000","last_became_peered":"2024-09-21T06:08:59.963524+0000","last_unstale":"2024-09-21T06:09:01.269772+0000","last_undegraded":"2024-09-21T06:09:01.269772+0000","last_fullsized":"2024-09-21T06:09:01.269772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:18.736783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.272371+0000","last_change":"2024-09-21T06:08:58.962816+0000","last_active":"2024-09-21T06:09:01.272371+0000","last_peered":"2024-09-21T06:09:01.272371+0000","last_clean":"2024-09-21T06:09:01.272371+0000","last_became_active":"2024-09-21T06:08:58.962530+0000","last_became_peered":"2024-09-21T06:08:58.962530+0000","last_unstale":"2024-09-21T06:09:01.272371+0000","last_undegraded":"2024-09-21T06:09:01.272371+0000","last_fullsized":"2024-09-21T06:09:01.272371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:37.744761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271057+0000","last_change":"2024-09-21T06:08:59.958294+0000","last_active":"2024-09-21T06:09:01.271057+0000","last_peered":"2024-09-21T06:09:01.271057+0000","last_clean":"2024-09-21T06:09:01.271057+0000","last_became_active":"2024-09-21T06:08:59.958027+0000","last_became_peered":"2024-09-21T06:08:59.958027+0000","last_unstale":"2024-09-21T06:09:01.271057+0000","last_undegraded":"2024-09-21T06:09:01.271057+0000","last_fullsized":"2024-09-21T06:09:01.271057+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:34.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.949784+0000","last_change":"2024-09-21T06:08:58.959877+0000","last_active":"2024-09-21T06:08:59.949784+0000","last_peered":"2024-09-21T06:08:59.949784+0000","last_clean":"2024-09-21T06:08:59.949784+0000","last_became_active":"2024-09-21T06:08:58.959620+0000","last_became_peered":"2024-09-21T06:08:58.959620+0000","last_unstale":"2024-09-21T06:08:59.949784+0000","last_undegraded":"2024-09-21T06:08:59.949784+0000","last_fullsized":"2024-09-21T06:08:59.949784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:41.290636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.972703+0000","last_change":"2024-09-21T06:08:59.972253+0000","last_active":"2024-09-21T06:08:59.972703+0000","last_peered":"2024-09-21T06:08:59.972703+0000","last_clean":"2024-09-21T06:08:59.972703+0000","last_became_active":"2024-09-21T06:08:59.971144+0000","last_became_peered":"2024-09-21T06:08:59.971144+0000","last_unstale":"2024-09-21T06:08:59.972703+0000","last_undegraded":"2024-09-21T06:08:59.972703+0000","last_fullsized":"2024-09-21T06:08:59.972703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:44.082835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271318+0000","last_change":"2024-09-21T06:08:58.950865+0000","last_active":"2024-09-21T06:09:01.271318+0000","last_peered":"2024-09-21T06:09:01.271318+0000","last_clean":"2024-09-21T06:09:01.271318+0000","last_became_active":"2024-09-21T06:08:58.950308+0000","last_became_peered":"2024-09-21T06:08:58.950308+0000","last_unstale":"2024-09-21T06:09:01.271318+0000","last_undegraded":"2024-09-21T06:09:01.271318+0000","last_fullsized":"2024-09-21T06:09:01.271318+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:25.172773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949185+0000","last_change":"2024-09-21T06:08:59.958802+0000","last_active":"2024-09-21T06:09:00.949185+0000","last_peered":"2024-09-21T06:09:00.949185+0000","last_clean":"2024-09-21T06:09:00.949185+0000","last_became_active":"2024-09-21T06:08:59.958541+0000","last_became_peered":"2024-09-21T06:08:59.958541+0000","last_unstale":"2024-09-21T06:09:00.949185+0000","last_undegraded":"2024-09-21T06:09:00.949185+0000","last_fullsized":"2024-09-21T06:09:00.949185+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:20.762406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271245+0000","last_change":"2024-09-21T06:08:58.962576+0000","last_active":"2024-09-21T06:09:01.271245+0000","last_peered":"2024-09-21T06:09:01.271245+0000","last_clean":"2024-09-21T06:09:01.271245+0000","last_became_active":"2024-09-21T06:08:58.962000+0000","last_became_peered":"2024-09-21T06:08:58.962000+0000","last_unstale":"2024-09-21T06:09:01.271245+0000","last_undegraded":"2024-09-21T06:09:01.271245+0000","last_fullsized":"2024-09-21T06:09:01.271245+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:14.647288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271442+0000","last_change":"2024-09-21T06:08:59.969575+0000","last_active":"2024-09-21T06:09:01.271442+0000","last_peered":"2024-09-21T06:09:01.271442+0000","last_clean":"2024-09-21T06:09:01.271442+0000","last_became_active":"2024-09-21T06:08:59.969181+0000","last_became_peered":"2024-09-21T06:08:59.969181+0000","last_unstale":"2024-09-21T06:09:01.271442+0000","last_undegraded":"2024-09-21T06:09:01.271442+0000","last_fullsized":"2024-09-21T06:09:01.271442+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:21.409466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270121+0000","last_change":"2024-09-21T06:08:58.964714+0000","last_active":"2024-09-21T06:09:01.270121+0000","last_peered":"2024-09-21T06:09:01.270121+0000","last_clean":"2024-09-21T06:09:01.270121+0000","last_became_active":"2024-09-21T06:08:58.964398+0000","last_became_peered":"2024-09-21T06:08:58.964398+0000","last_unstale":"2024-09-21T06:09:01.270121+0000","last_undegraded":"2024-09-21T06:09:01.270121+0000","last_fullsized":"2024-09-21T06:09:01.270121+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:51.484853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.955213+0000","last_change":"2024-09-21T06:08:59.969028+0000","last_active":"2024-09-21T06:09:00.955213+0000","last_peered":"2024-09-21T06:09:00.955213+0000","last_clean":"2024-09-21T06:09:00.955213+0000","last_became_active":"2024-09-21T06:08:59.965319+0000","last_became_peered":"2024-09-21T06:08:59.965319+0000","last_unstale":"2024-09-21T06:09:00.955213+0000","last_undegraded":"2024-09-21T06:09:00.955213+0000","last_fullsized":"2024-09-21T06:09:00.955213+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:44.640627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949428+0000","last_change":"2024-09-21T06:08:58.962079+0000","last_active":"2024-09-21T06:09:00.949428+0000","last_peered":"2024-09-21T06:09:00.949428+0000","last_clean":"2024-09-21T06:09:00.949428+0000","last_became_active":"2024-09-21T06:08:58.961809+0000","last_became_peered":"2024-09-21T06:08:58.961809+0000","last_unstale":"2024-09-21T06:09:00.949428+0000","last_undegraded":"2024-09-21T06:09:00.949428+0000","last_fullsized":"2024-09-21T06:09:00.949428+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:01.440071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":274,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949414+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:09:00.949414+0000","last_peered":"2024-09-21T06:09:00.949414+0000","last_clean":"2024-09-21T06:09:00.949414+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:09:00.949414+0000","last_undegraded":"2024-09-21T06:09:00.949414+0000","last_fullsized":"2024-09-21T06:09:00.949414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:14.744977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194791,"statfs":{"total":200000000,"available":199466739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1089,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194223,"statfs":{"total":200000000,"available":198884758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1101,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194210,"statfs":{"total":200000000,"available":198871613,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":526,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194786,"statfs":{"total":200000000,"available":199461357,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":526,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194785,"statfs":{"total":200000000,"available":199460417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":525,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194787,"statfs":{"total":200000000,"available":199462051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":525,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194786,"statfs":{"total":200000000,"available":199461469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":525,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194786,"statfs":{"total":200000000,"available":199461857,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:09:04.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:09:05.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.018+0000 7f5e2ba00640 1 -- 172.21.15.118:0/3278024827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e0c004800 msgr2=0x7f5e0c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.018+0000 7f5e2ba00640 1 --2- 172.21.15.118:0/3278024827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e0c004800 0x7f5e0c004c10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009b20 tx=0x7f5e0c005830 comp rx=0 tx=0).stop 2024-09-21T06:09:05.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.018+0000 7f5e29a00640 1 -- 172.21.15.118:0/3278024827 reap_dead start 2024-09-21T06:09:05.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.019+0000 7f5e2ba00640 1 -- 172.21.15.118:0/3278024827 shutdown_connections 2024-09-21T06:09:05.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.019+0000 7f5e2ba00640 1 -- 172.21.15.118:0/3278024827 >> 172.21.15.118:0/3278024827 conn(0x7f5e2406d110 msgr2=0x7f5e2406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:05.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.019+0000 7f5e2ba00640 1 -- 172.21.15.118:0/3278024827 shutdown_connections 2024-09-21T06:09:05.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.019+0000 7f5e2ba00640 1 -- 172.21.15.118:0/3278024827 wait complete. 2024-09-21T06:09:05.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.021+0000 7f5e2ba00640 1 Processor -- start 2024-09-21T06:09:05.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.021+0000 7f5e2ba00640 1 -- start start 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.022+0000 7f5e2ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0c004800 0x7f5e2413d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.022+0000 7f5e2ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e24155eb0 0x7f5e241562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.022+0000 7f5e2ba00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e24156800 0x7f5e24154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.022+0000 7f5e2ba00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24142ac0 con 0x7f5e24156800 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e2ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24142940 con 0x7f5e0c004800 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e2ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e24163b70 con 0x7f5e24155eb0 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0c004800 0x7f5e2413d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e23e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e24155eb0 0x7f5e241562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0c004800 0x7f5e2413d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:32776/0 (socket says 172.21.15.118:32776) 2024-09-21T06:09:05.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 -- 172.21.15.118:0/400276354 learned_addr learned my addr 172.21.15.118:0/400276354 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29a00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e24156800 0x7f5e24154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 -- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e24155eb0 msgr2=0x7f5e241562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e24155eb0 0x7f5e241562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 -- 172.21.15.118:0/400276354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e24156800 msgr2=0x7f5e24154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e24156800 0x7f5e24154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e29000640 1 -- 172.21.15.118:0/400276354 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2413a570 con 0x7f5e0c004800 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.023+0000 7f5e23e00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e24155eb0 0x7f5e241562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:09:05.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.024+0000 7f5e29000640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0c004800 0x7f5e2413d530 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e18003f50 tx=0x7f5e180016f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:05.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.024+0000 7f5e20c00640 1 -- 172.21.15.118:0/400276354 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18011640 con 0x7f5e0c004800 2024-09-21T06:09:05.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.024+0000 7f5e20c00640 1 -- 172.21.15.118:0/400276354 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e18016020 con 0x7f5e0c004800 2024-09-21T06:09:05.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.024+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e24139cd0 con 0x7f5e0c004800 2024-09-21T06:09:05.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.024+0000 7f5e20c00640 1 -- 172.21.15.118:0/400276354 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18011a60 con 0x7f5e0c004800 2024-09-21T06:09:05.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.024+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2413a290 con 0x7f5e0c004800 2024-09-21T06:09:05.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.025+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e240d0e80 con 0x7f5e0c004800 2024-09-21T06:09:05.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.027+0000 7f5e20c00640 1 -- 172.21.15.118:0/400276354 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e18011c00 con 0x7f5e0c004800 2024-09-21T06:09:05.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.028+0000 7f5e20c00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5e04078bc0 0x7f5e0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.028+0000 7f5e20c00640 1 -- 172.21.15.118:0/400276354 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f5e1809b7a0 con 0x7f5e0c004800 2024-09-21T06:09:05.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.028+0000 7f5e23e00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5e04078bc0 0x7f5e0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.029+0000 7f5e23e00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5e04078bc0 0x7f5e0407b0d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e10035000 tx=0x7f5e100046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:05.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.034+0000 7f5e20c00640 1 -- 172.21.15.118:0/400276354 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5e18020020 con 0x7f5e0c004800 2024-09-21T06:09:05.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.216+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e240cfd60 con 0x7f5e04078bc0 2024-09-21T06:09:05.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.221+0000 7f5e20c00640 1 -- 172.21.15.118:0/400276354 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247581 (secure 0 0 0) 0x7f5e240cfd60 con 0x7f5e04078bc0 2024-09-21T06:09:05.225 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:05.226 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:09:05.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5e04078bc0 msgr2=0x7f5e0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5e04078bc0 0x7f5e0407b0d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e10035000 tx=0x7f5e100046c0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0c004800 msgr2=0x7f5e2413d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0c004800 0x7f5e2413d530 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e18003f50 tx=0x7f5e180016f0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 shutdown_connections 2024-09-21T06:09:05.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e24156800 0x7f5e24154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5e04078bc0 0x7f5e0407b0d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e24155eb0 0x7f5e241562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 --2- 172.21.15.118:0/400276354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0c004800 0x7f5e2413d530 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 >> 172.21.15.118:0/400276354 conn(0x7f5e2406d110 msgr2=0x7f5e241406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:05.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 shutdown_connections 2024-09-21T06:09:05.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.224+0000 7f5e2ba00640 1 -- 172.21.15.118:0/400276354 wait complete. 2024-09-21T06:09:05.248 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-21T06:09:04.537512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557158,"statfs":{"total":1600000000,"available":1594530261,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001554"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271625+0000","last_change":"2024-09-21T06:08:59.967691+0000","last_active":"2024-09-21T06:09:01.271625+0000","last_peered":"2024-09-21T06:09:01.271625+0000","last_clean":"2024-09-21T06:09:01.271625+0000","last_became_active":"2024-09-21T06:08:59.967436+0000","last_became_peered":"2024-09-21T06:08:59.967436+0000","last_unstale":"2024-09-21T06:09:01.271625+0000","last_undegraded":"2024-09-21T06:09:01.271625+0000","last_fullsized":"2024-09-21T06:09:01.271625+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:05.795854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954501+0000","last_change":"2024-09-21T06:08:59.970045+0000","last_active":"2024-09-21T06:09:00.954501+0000","last_peered":"2024-09-21T06:09:00.954501+0000","last_clean":"2024-09-21T06:09:00.954501+0000","last_became_active":"2024-09-21T06:08:59.968763+0000","last_became_peered":"2024-09-21T06:08:59.968763+0000","last_unstale":"2024-09-21T06:09:00.954501+0000","last_undegraded":"2024-09-21T06:09:00.954501+0000","last_fullsized":"2024-09-21T06:09:00.954501+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:50.264752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949081+0000","last_change":"2024-09-21T06:08:59.961532+0000","last_active":"2024-09-21T06:09:00.949081+0000","last_peered":"2024-09-21T06:09:00.949081+0000","last_clean":"2024-09-21T06:09:00.949081+0000","last_became_active":"2024-09-21T06:08:59.961238+0000","last_became_peered":"2024-09-21T06:08:59.961238+0000","last_unstale":"2024-09-21T06:09:00.949081+0000","last_undegraded":"2024-09-21T06:09:00.949081+0000","last_fullsized":"2024-09-21T06:09:00.949081+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:36.329518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.948703+0000","last_change":"2024-09-21T06:08:59.970446+0000","last_active":"2024-09-21T06:09:00.948703+0000","last_peered":"2024-09-21T06:09:00.948703+0000","last_clean":"2024-09-21T06:09:00.948703+0000","last_became_active":"2024-09-21T06:08:59.967782+0000","last_became_peered":"2024-09-21T06:08:59.967782+0000","last_unstale":"2024-09-21T06:09:00.948703+0000","last_undegraded":"2024-09-21T06:09:00.948703+0000","last_fullsized":"2024-09-21T06:09:00.948703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:32.292395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269762+0000","last_change":"2024-09-21T06:08:59.966107+0000","last_active":"2024-09-21T06:09:01.269762+0000","last_peered":"2024-09-21T06:09:01.269762+0000","last_clean":"2024-09-21T06:09:01.269762+0000","last_became_active":"2024-09-21T06:08:59.965870+0000","last_became_peered":"2024-09-21T06:08:59.965870+0000","last_unstale":"2024-09-21T06:09:01.269762+0000","last_undegraded":"2024-09-21T06:09:01.269762+0000","last_fullsized":"2024-09-21T06:09:01.269762+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:11.648891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270924+0000","last_change":"2024-09-21T06:08:59.971535+0000","last_active":"2024-09-21T06:09:01.270924+0000","last_peered":"2024-09-21T06:09:01.270924+0000","last_clean":"2024-09-21T06:09:01.270924+0000","last_became_active":"2024-09-21T06:08:59.967227+0000","last_became_peered":"2024-09-21T06:08:59.967227+0000","last_unstale":"2024-09-21T06:09:01.270924+0000","last_undegraded":"2024-09-21T06:09:01.270924+0000","last_fullsized":"2024-09-21T06:09:01.270924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:14.347566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.948902+0000","last_change":"2024-09-21T06:08:59.957268+0000","last_active":"2024-09-21T06:09:00.948902+0000","last_peered":"2024-09-21T06:09:00.948902+0000","last_clean":"2024-09-21T06:09:00.948902+0000","last_became_active":"2024-09-21T06:08:59.956995+0000","last_became_peered":"2024-09-21T06:08:59.956995+0000","last_unstale":"2024-09-21T06:09:00.948902+0000","last_undegraded":"2024-09-21T06:09:00.948902+0000","last_fullsized":"2024-09-21T06:09:00.948902+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:31.140985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270274+0000","last_change":"2024-09-21T06:08:59.958297+0000","last_active":"2024-09-21T06:09:01.270274+0000","last_peered":"2024-09-21T06:09:01.270274+0000","last_clean":"2024-09-21T06:09:01.270274+0000","last_became_active":"2024-09-21T06:08:59.957944+0000","last_became_peered":"2024-09-21T06:08:59.957944+0000","last_unstale":"2024-09-21T06:09:01.270274+0000","last_undegraded":"2024-09-21T06:09:01.270274+0000","last_fullsized":"2024-09-21T06:09:01.270274+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:33.782583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269817+0000","last_change":"2024-09-21T06:08:59.966355+0000","last_active":"2024-09-21T06:09:01.269817+0000","last_peered":"2024-09-21T06:09:01.269817+0000","last_clean":"2024-09-21T06:09:01.269817+0000","last_became_active":"2024-09-21T06:08:59.966096+0000","last_became_peered":"2024-09-21T06:08:59.966096+0000","last_unstale":"2024-09-21T06:09:01.269817+0000","last_undegraded":"2024-09-21T06:09:01.269817+0000","last_fullsized":"2024-09-21T06:09:01.269817+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:08.332492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271878+0000","last_change":"2024-09-21T06:08:59.962081+0000","last_active":"2024-09-21T06:09:01.271878+0000","last_peered":"2024-09-21T06:09:01.271878+0000","last_clean":"2024-09-21T06:09:01.271878+0000","last_became_active":"2024-09-21T06:08:59.961618+0000","last_became_peered":"2024-09-21T06:08:59.961618+0000","last_unstale":"2024-09-21T06:09:01.271878+0000","last_undegraded":"2024-09-21T06:09:01.271878+0000","last_fullsized":"2024-09-21T06:09:01.271878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:48.644013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954804+0000","last_change":"2024-09-21T06:08:59.966031+0000","last_active":"2024-09-21T06:09:00.954804+0000","last_peered":"2024-09-21T06:09:00.954804+0000","last_clean":"2024-09-21T06:09:00.954804+0000","last_became_active":"2024-09-21T06:08:59.963672+0000","last_became_peered":"2024-09-21T06:08:59.963672+0000","last_unstale":"2024-09-21T06:09:00.954804+0000","last_undegraded":"2024-09-21T06:09:00.954804+0000","last_fullsized":"2024-09-21T06:09:00.954804+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:19.950055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270685+0000","last_change":"2024-09-21T06:08:59.960469+0000","last_active":"2024-09-21T06:09:01.270685+0000","last_peered":"2024-09-21T06:09:01.270685+0000","last_clean":"2024-09-21T06:09:01.270685+0000","last_became_active":"2024-09-21T06:08:59.957778+0000","last_became_peered":"2024-09-21T06:08:59.957778+0000","last_unstale":"2024-09-21T06:09:01.270685+0000","last_undegraded":"2024-09-21T06:09:01.270685+0000","last_fullsized":"2024-09-21T06:09:01.270685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.906763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949437+0000","last_change":"2024-09-21T06:08:59.962991+0000","last_active":"2024-09-21T06:09:00.949437+0000","last_peered":"2024-09-21T06:09:00.949437+0000","last_clean":"2024-09-21T06:09:00.949437+0000","last_became_active":"2024-09-21T06:08:59.962717+0000","last_became_peered":"2024-09-21T06:08:59.962717+0000","last_unstale":"2024-09-21T06:09:00.949437+0000","last_undegraded":"2024-09-21T06:09:00.949437+0000","last_fullsized":"2024-09-21T06:09:00.949437+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.949587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.948924+0000","last_change":"2024-09-21T06:08:59.959880+0000","last_active":"2024-09-21T06:09:00.948924+0000","last_peered":"2024-09-21T06:09:00.948924+0000","last_clean":"2024-09-21T06:09:00.948924+0000","last_became_active":"2024-09-21T06:08:59.959633+0000","last_became_peered":"2024-09-21T06:08:59.959633+0000","last_unstale":"2024-09-21T06:09:00.948924+0000","last_undegraded":"2024-09-21T06:09:00.948924+0000","last_fullsized":"2024-09-21T06:09:00.948924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:48.130294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.956067+0000","last_change":"2024-09-21T06:08:59.954095+0000","last_active":"2024-09-21T06:08:59.956067+0000","last_peered":"2024-09-21T06:08:59.956067+0000","last_clean":"2024-09-21T06:08:59.956067+0000","last_became_active":"2024-09-21T06:08:59.953684+0000","last_became_peered":"2024-09-21T06:08:59.953684+0000","last_unstale":"2024-09-21T06:08:59.956067+0000","last_undegraded":"2024-09-21T06:08:59.956067+0000","last_fullsized":"2024-09-21T06:08:59.956067+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:39.690960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269845+0000","last_change":"2024-09-21T06:08:59.969576+0000","last_active":"2024-09-21T06:09:01.269845+0000","last_peered":"2024-09-21T06:09:01.269845+0000","last_clean":"2024-09-21T06:09:01.269845+0000","last_became_active":"2024-09-21T06:08:59.969014+0000","last_became_peered":"2024-09-21T06:08:59.969014+0000","last_unstale":"2024-09-21T06:09:01.269845+0000","last_undegraded":"2024-09-21T06:09:01.269845+0000","last_fullsized":"2024-09-21T06:09:01.269845+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:45.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270520+0000","last_change":"2024-09-21T06:08:59.965933+0000","last_active":"2024-09-21T06:09:01.270520+0000","last_peered":"2024-09-21T06:09:01.270520+0000","last_clean":"2024-09-21T06:09:01.270520+0000","last_became_active":"2024-09-21T06:08:59.965448+0000","last_became_peered":"2024-09-21T06:08:59.965448+0000","last_unstale":"2024-09-21T06:09:01.270520+0000","last_undegraded":"2024-09-21T06:09:01.270520+0000","last_fullsized":"2024-09-21T06:09:01.270520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:06.647454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949022+0000","last_change":"2024-09-21T06:08:59.965997+0000","last_active":"2024-09-21T06:09:00.949022+0000","last_peered":"2024-09-21T06:09:00.949022+0000","last_clean":"2024-09-21T06:09:00.949022+0000","last_became_active":"2024-09-21T06:08:59.964848+0000","last_became_peered":"2024-09-21T06:08:59.964848+0000","last_unstale":"2024-09-21T06:09:00.949022+0000","last_undegraded":"2024-09-21T06:09:00.949022+0000","last_fullsized":"2024-09-21T06:09:00.949022+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:39.194397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.964128+0000","last_change":"2024-09-21T06:08:59.962588+0000","last_active":"2024-09-21T06:08:59.964128+0000","last_peered":"2024-09-21T06:08:59.964128+0000","last_clean":"2024-09-21T06:08:59.964128+0000","last_became_active":"2024-09-21T06:08:59.961885+0000","last_became_peered":"2024-09-21T06:08:59.961885+0000","last_unstale":"2024-09-21T06:08:59.964128+0000","last_undegraded":"2024-09-21T06:08:59.964128+0000","last_fullsized":"2024-09-21T06:08:59.964128+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:55.044953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949487+0000","last_change":"2024-09-21T06:08:59.975160+0000","last_active":"2024-09-21T06:09:00.949487+0000","last_peered":"2024-09-21T06:09:00.949487+0000","last_clean":"2024-09-21T06:09:00.949487+0000","last_became_active":"2024-09-21T06:08:59.974385+0000","last_became_peered":"2024-09-21T06:08:59.974385+0000","last_unstale":"2024-09-21T06:09:00.949487+0000","last_undegraded":"2024-09-21T06:09:00.949487+0000","last_fullsized":"2024-09-21T06:09:00.949487+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:40.309543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949043+0000","last_change":"2024-09-21T06:08:59.974673+0000","last_active":"2024-09-21T06:09:00.949043+0000","last_peered":"2024-09-21T06:09:00.949043+0000","last_clean":"2024-09-21T06:09:00.949043+0000","last_became_active":"2024-09-21T06:08:59.974108+0000","last_became_peered":"2024-09-21T06:08:59.974108+0000","last_unstale":"2024-09-21T06:09:00.949043+0000","last_undegraded":"2024-09-21T06:09:00.949043+0000","last_fullsized":"2024-09-21T06:09:00.949043+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:20.034684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954761+0000","last_change":"2024-09-21T06:08:59.974551+0000","last_active":"2024-09-21T06:09:00.954761+0000","last_peered":"2024-09-21T06:09:00.954761+0000","last_clean":"2024-09-21T06:09:00.954761+0000","last_became_active":"2024-09-21T06:08:59.969398+0000","last_became_peered":"2024-09-21T06:08:59.969398+0000","last_unstale":"2024-09-21T06:09:00.954761+0000","last_undegraded":"2024-09-21T06:09:00.954761+0000","last_fullsized":"2024-09-21T06:09:00.954761+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:18.254133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270401+0000","last_change":"2024-09-21T06:08:59.961412+0000","last_active":"2024-09-21T06:09:01.270401+0000","last_peered":"2024-09-21T06:09:01.270401+0000","last_clean":"2024-09-21T06:09:01.270401+0000","last_became_active":"2024-09-21T06:08:59.960998+0000","last_became_peered":"2024-09-21T06:08:59.960998+0000","last_unstale":"2024-09-21T06:09:01.270401+0000","last_undegraded":"2024-09-21T06:09:01.270401+0000","last_fullsized":"2024-09-21T06:09:01.270401+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:07.180503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949130+0000","last_change":"2024-09-21T06:08:59.967968+0000","last_active":"2024-09-21T06:09:00.949130+0000","last_peered":"2024-09-21T06:09:00.949130+0000","last_clean":"2024-09-21T06:09:00.949130+0000","last_became_active":"2024-09-21T06:08:59.964811+0000","last_became_peered":"2024-09-21T06:08:59.964811+0000","last_unstale":"2024-09-21T06:09:00.949130+0000","last_undegraded":"2024-09-21T06:09:00.949130+0000","last_fullsized":"2024-09-21T06:09:00.949130+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:44.913733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954599+0000","last_change":"2024-09-21T06:08:59.964296+0000","last_active":"2024-09-21T06:09:00.954599+0000","last_peered":"2024-09-21T06:09:00.954599+0000","last_clean":"2024-09-21T06:09:00.954599+0000","last_became_active":"2024-09-21T06:08:59.963971+0000","last_became_peered":"2024-09-21T06:08:59.963971+0000","last_unstale":"2024-09-21T06:09:00.954599+0000","last_undegraded":"2024-09-21T06:09:00.954599+0000","last_fullsized":"2024-09-21T06:09:00.954599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:36.080592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949191+0000","last_change":"2024-09-21T06:08:59.968322+0000","last_active":"2024-09-21T06:09:00.949191+0000","last_peered":"2024-09-21T06:09:00.949191+0000","last_clean":"2024-09-21T06:09:00.949191+0000","last_became_active":"2024-09-21T06:08:59.968019+0000","last_became_peered":"2024-09-21T06:08:59.968019+0000","last_unstale":"2024-09-21T06:09:00.949191+0000","last_undegraded":"2024-09-21T06:09:00.949191+0000","last_fullsized":"2024-09-21T06:09:00.949191+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:44.754771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271150+0000","last_change":"2024-09-21T06:08:59.966550+0000","last_active":"2024-09-21T06:09:01.271150+0000","last_peered":"2024-09-21T06:09:01.271150+0000","last_clean":"2024-09-21T06:09:01.271150+0000","last_became_active":"2024-09-21T06:08:59.966279+0000","last_became_peered":"2024-09-21T06:08:59.966279+0000","last_unstale":"2024-09-21T06:09:01.271150+0000","last_undegraded":"2024-09-21T06:09:01.271150+0000","last_fullsized":"2024-09-21T06:09:01.271150+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:00.716805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270657+0000","last_change":"2024-09-21T06:08:59.965681+0000","last_active":"2024-09-21T06:09:01.270657+0000","last_peered":"2024-09-21T06:09:01.270657+0000","last_clean":"2024-09-21T06:09:01.270657+0000","last_became_active":"2024-09-21T06:08:59.964750+0000","last_became_peered":"2024-09-21T06:08:59.964750+0000","last_unstale":"2024-09-21T06:09:01.270657+0000","last_undegraded":"2024-09-21T06:09:01.270657+0000","last_fullsized":"2024-09-21T06:09:01.270657+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:05.533560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954753+0000","last_change":"2024-09-21T06:08:59.961566+0000","last_active":"2024-09-21T06:09:00.954753+0000","last_peered":"2024-09-21T06:09:00.954753+0000","last_clean":"2024-09-21T06:09:00.954753+0000","last_became_active":"2024-09-21T06:08:59.961313+0000","last_became_peered":"2024-09-21T06:08:59.961313+0000","last_unstale":"2024-09-21T06:09:00.954753+0000","last_undegraded":"2024-09-21T06:09:00.954753+0000","last_fullsized":"2024-09-21T06:09:00.954753+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954837+0000","last_change":"2024-09-21T06:08:59.968629+0000","last_active":"2024-09-21T06:09:00.954837+0000","last_peered":"2024-09-21T06:09:00.954837+0000","last_clean":"2024-09-21T06:09:00.954837+0000","last_became_active":"2024-09-21T06:08:59.968184+0000","last_became_peered":"2024-09-21T06:08:59.968184+0000","last_unstale":"2024-09-21T06:09:00.954837+0000","last_undegraded":"2024-09-21T06:09:00.954837+0000","last_fullsized":"2024-09-21T06:09:00.954837+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:17.558540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270210+0000","last_change":"2024-09-21T06:08:59.971332+0000","last_active":"2024-09-21T06:09:01.270210+0000","last_peered":"2024-09-21T06:09:01.270210+0000","last_clean":"2024-09-21T06:09:01.270210+0000","last_became_active":"2024-09-21T06:08:59.971092+0000","last_became_peered":"2024-09-21T06:08:59.971092+0000","last_unstale":"2024-09-21T06:09:01.270210+0000","last_undegraded":"2024-09-21T06:09:01.270210+0000","last_fullsized":"2024-09-21T06:09:01.270210+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:23.391114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270933+0000","last_change":"2024-09-21T06:08:59.971876+0000","last_active":"2024-09-21T06:09:01.270933+0000","last_peered":"2024-09-21T06:09:01.270933+0000","last_clean":"2024-09-21T06:09:01.270933+0000","last_became_active":"2024-09-21T06:08:59.971559+0000","last_became_peered":"2024-09-21T06:08:59.971559+0000","last_unstale":"2024-09-21T06:09:01.270933+0000","last_undegraded":"2024-09-21T06:09:01.270933+0000","last_fullsized":"2024-09-21T06:09:01.270933+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:41.956749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269476+0000","last_change":"2024-09-21T06:08:59.963886+0000","last_active":"2024-09-21T06:09:01.269476+0000","last_peered":"2024-09-21T06:09:01.269476+0000","last_clean":"2024-09-21T06:09:01.269476+0000","last_became_active":"2024-09-21T06:08:59.962441+0000","last_became_peered":"2024-09-21T06:08:59.962441+0000","last_unstale":"2024-09-21T06:09:01.269476+0000","last_undegraded":"2024-09-21T06:09:01.269476+0000","last_fullsized":"2024-09-21T06:09:01.269476+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:35.463514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"98'4","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271109+0000","last_change":"2024-09-21T06:08:58.962858+0000","last_active":"2024-09-21T06:09:01.271109+0000","last_peered":"2024-09-21T06:09:01.271109+0000","last_clean":"2024-09-21T06:09:01.271109+0000","last_became_active":"2024-09-21T06:08:58.962323+0000","last_became_peered":"2024-09-21T06:08:58.962323+0000","last_unstale":"2024-09-21T06:09:01.271109+0000","last_undegraded":"2024-09-21T06:09:01.271109+0000","last_fullsized":"2024-09-21T06:09:01.271109+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:45.732591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270924+0000","last_change":"2024-09-21T06:08:59.959772+0000","last_active":"2024-09-21T06:09:01.270924+0000","last_peered":"2024-09-21T06:09:01.270924+0000","last_clean":"2024-09-21T06:09:01.270924+0000","last_became_active":"2024-09-21T06:08:59.959516+0000","last_became_peered":"2024-09-21T06:08:59.959516+0000","last_unstale":"2024-09-21T06:09:01.270924+0000","last_undegraded":"2024-09-21T06:09:01.270924+0000","last_fullsized":"2024-09-21T06:09:01.270924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:19.048586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269986+0000","last_change":"2024-09-21T06:08:58.950026+0000","last_active":"2024-09-21T06:09:01.269986+0000","last_peered":"2024-09-21T06:09:01.269986+0000","last_clean":"2024-09-21T06:09:01.269986+0000","last_became_active":"2024-09-21T06:08:58.949757+0000","last_became_peered":"2024-09-21T06:08:58.949757+0000","last_unstale":"2024-09-21T06:09:01.269986+0000","last_undegraded":"2024-09-21T06:09:01.269986+0000","last_fullsized":"2024-09-21T06:09:01.269986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.091179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271853+0000","last_change":"2024-09-21T06:08:59.969247+0000","last_active":"2024-09-21T06:09:01.271853+0000","last_peered":"2024-09-21T06:09:01.271853+0000","last_clean":"2024-09-21T06:09:01.271853+0000","last_became_active":"2024-09-21T06:08:59.968056+0000","last_became_peered":"2024-09-21T06:08:59.968056+0000","last_unstale":"2024-09-21T06:09:01.271853+0000","last_undegraded":"2024-09-21T06:09:01.271853+0000","last_fullsized":"2024-09-21T06:09:01.271853+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:56.841829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.974288+0000","last_change":"2024-09-21T06:08:58.961367+0000","last_active":"2024-09-21T06:08:59.974288+0000","last_peered":"2024-09-21T06:08:59.974288+0000","last_clean":"2024-09-21T06:08:59.974288+0000","last_became_active":"2024-09-21T06:08:58.961114+0000","last_became_peered":"2024-09-21T06:08:58.961114+0000","last_unstale":"2024-09-21T06:08:59.974288+0000","last_undegraded":"2024-09-21T06:08:59.974288+0000","last_fullsized":"2024-09-21T06:08:59.974288+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:51.689475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949690+0000","last_change":"2024-09-21T06:08:59.966895+0000","last_active":"2024-09-21T06:09:00.949690+0000","last_peered":"2024-09-21T06:09:00.949690+0000","last_clean":"2024-09-21T06:09:00.949690+0000","last_became_active":"2024-09-21T06:08:59.966629+0000","last_became_peered":"2024-09-21T06:08:59.966629+0000","last_unstale":"2024-09-21T06:09:00.949690+0000","last_undegraded":"2024-09-21T06:09:00.949690+0000","last_fullsized":"2024-09-21T06:09:00.949690+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:00.105342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.976917+0000","last_change":"2024-09-21T06:08:58.958668+0000","last_active":"2024-09-21T06:08:59.976917+0000","last_peered":"2024-09-21T06:08:59.976917+0000","last_clean":"2024-09-21T06:08:59.976917+0000","last_became_active":"2024-09-21T06:08:58.958367+0000","last_became_peered":"2024-09-21T06:08:58.958367+0000","last_unstale":"2024-09-21T06:08:59.976917+0000","last_undegraded":"2024-09-21T06:08:59.976917+0000","last_fullsized":"2024-09-21T06:08:59.976917+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:55.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954678+0000","last_change":"2024-09-21T06:08:59.967027+0000","last_active":"2024-09-21T06:09:00.954678+0000","last_peered":"2024-09-21T06:09:00.954678+0000","last_clean":"2024-09-21T06:09:00.954678+0000","last_became_active":"2024-09-21T06:08:59.966325+0000","last_became_peered":"2024-09-21T06:08:59.966325+0000","last_unstale":"2024-09-21T06:09:00.954678+0000","last_undegraded":"2024-09-21T06:09:00.954678+0000","last_fullsized":"2024-09-21T06:09:00.954678+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:25.911397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270962+0000","last_change":"2024-09-21T06:08:58.955274+0000","last_active":"2024-09-21T06:09:01.270962+0000","last_peered":"2024-09-21T06:09:01.270962+0000","last_clean":"2024-09-21T06:09:01.270962+0000","last_became_active":"2024-09-21T06:08:58.954332+0000","last_became_peered":"2024-09-21T06:08:58.954332+0000","last_unstale":"2024-09-21T06:09:01.270962+0000","last_undegraded":"2024-09-21T06:09:01.270962+0000","last_fullsized":"2024-09-21T06:09:01.270962+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:17.978172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270777+0000","last_change":"2024-09-21T06:08:59.965669+0000","last_active":"2024-09-21T06:09:01.270777+0000","last_peered":"2024-09-21T06:09:01.270777+0000","last_clean":"2024-09-21T06:09:01.270777+0000","last_became_active":"2024-09-21T06:08:59.965090+0000","last_became_peered":"2024-09-21T06:08:59.965090+0000","last_unstale":"2024-09-21T06:09:01.270777+0000","last_undegraded":"2024-09-21T06:09:01.270777+0000","last_fullsized":"2024-09-21T06:09:01.270777+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:04.497968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270438+0000","last_change":"2024-09-21T06:08:58.954093+0000","last_active":"2024-09-21T06:09:01.270438+0000","last_peered":"2024-09-21T06:09:01.270438+0000","last_clean":"2024-09-21T06:09:01.270438+0000","last_became_active":"2024-09-21T06:08:58.953788+0000","last_became_peered":"2024-09-21T06:08:58.953788+0000","last_unstale":"2024-09-21T06:09:01.270438+0000","last_undegraded":"2024-09-21T06:09:01.270438+0000","last_fullsized":"2024-09-21T06:09:01.270438+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:24.404320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949170+0000","last_change":"2024-09-21T06:08:59.956334+0000","last_active":"2024-09-21T06:09:00.949170+0000","last_peered":"2024-09-21T06:09:00.949170+0000","last_clean":"2024-09-21T06:09:00.949170+0000","last_became_active":"2024-09-21T06:08:59.955612+0000","last_became_peered":"2024-09-21T06:08:59.955612+0000","last_unstale":"2024-09-21T06:09:00.949170+0000","last_undegraded":"2024-09-21T06:09:00.949170+0000","last_fullsized":"2024-09-21T06:09:00.949170+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:32.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.949293+0000","last_change":"2024-09-21T06:08:58.960636+0000","last_active":"2024-09-21T06:08:59.949293+0000","last_peered":"2024-09-21T06:08:59.949293+0000","last_clean":"2024-09-21T06:08:59.949293+0000","last_became_active":"2024-09-21T06:08:58.960198+0000","last_became_peered":"2024-09-21T06:08:58.960198+0000","last_unstale":"2024-09-21T06:08:59.949293+0000","last_undegraded":"2024-09-21T06:08:59.949293+0000","last_fullsized":"2024-09-21T06:08:59.949293+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:54.940054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.956011+0000","last_change":"2024-09-21T06:08:59.952185+0000","last_active":"2024-09-21T06:08:59.956011+0000","last_peered":"2024-09-21T06:08:59.956011+0000","last_clean":"2024-09-21T06:08:59.956011+0000","last_became_active":"2024-09-21T06:08:59.950084+0000","last_became_peered":"2024-09-21T06:08:59.950084+0000","last_unstale":"2024-09-21T06:08:59.956011+0000","last_undegraded":"2024-09-21T06:08:59.956011+0000","last_fullsized":"2024-09-21T06:08:59.956011+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:56.378322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954995+0000","last_change":"2024-09-21T06:08:58.950239+0000","last_active":"2024-09-21T06:09:00.954995+0000","last_peered":"2024-09-21T06:09:00.954995+0000","last_clean":"2024-09-21T06:09:00.954995+0000","last_became_active":"2024-09-21T06:08:58.949944+0000","last_became_peered":"2024-09-21T06:08:58.949944+0000","last_unstale":"2024-09-21T06:09:00.954995+0000","last_undegraded":"2024-09-21T06:09:00.954995+0000","last_fullsized":"2024-09-21T06:09:00.954995+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:36.559156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.972468+0000","last_change":"2024-09-21T06:08:59.970232+0000","last_active":"2024-09-21T06:08:59.972468+0000","last_peered":"2024-09-21T06:08:59.972468+0000","last_clean":"2024-09-21T06:08:59.972468+0000","last_became_active":"2024-09-21T06:08:59.969957+0000","last_became_peered":"2024-09-21T06:08:59.969957+0000","last_unstale":"2024-09-21T06:08:59.972468+0000","last_undegraded":"2024-09-21T06:08:59.972468+0000","last_fullsized":"2024-09-21T06:08:59.972468+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.232320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271967+0000","last_change":"2024-09-21T06:08:58.964451+0000","last_active":"2024-09-21T06:09:01.271967+0000","last_peered":"2024-09-21T06:09:01.271967+0000","last_clean":"2024-09-21T06:09:01.271967+0000","last_became_active":"2024-09-21T06:08:58.963960+0000","last_became_peered":"2024-09-21T06:08:58.963960+0000","last_unstale":"2024-09-21T06:09:01.271967+0000","last_undegraded":"2024-09-21T06:09:01.271967+0000","last_fullsized":"2024-09-21T06:09:01.271967+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:01.934881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271174+0000","last_change":"2024-09-21T06:08:59.970797+0000","last_active":"2024-09-21T06:09:01.271174+0000","last_peered":"2024-09-21T06:09:01.271174+0000","last_clean":"2024-09-21T06:09:01.271174+0000","last_became_active":"2024-09-21T06:08:59.966869+0000","last_became_peered":"2024-09-21T06:08:59.966869+0000","last_unstale":"2024-09-21T06:09:01.271174+0000","last_undegraded":"2024-09-21T06:09:01.271174+0000","last_fullsized":"2024-09-21T06:09:01.271174+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.027615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271133+0000","last_change":"2024-09-21T06:08:58.961115+0000","last_active":"2024-09-21T06:09:01.271133+0000","last_peered":"2024-09-21T06:09:01.271133+0000","last_clean":"2024-09-21T06:09:01.271133+0000","last_became_active":"2024-09-21T06:08:58.960819+0000","last_became_peered":"2024-09-21T06:08:58.960819+0000","last_unstale":"2024-09-21T06:09:01.271133+0000","last_undegraded":"2024-09-21T06:09:01.271133+0000","last_fullsized":"2024-09-21T06:09:01.271133+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:54.685837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.964155+0000","last_change":"2024-09-21T06:08:59.962868+0000","last_active":"2024-09-21T06:08:59.964155+0000","last_peered":"2024-09-21T06:08:59.964155+0000","last_clean":"2024-09-21T06:08:59.964155+0000","last_became_active":"2024-09-21T06:08:59.962326+0000","last_became_peered":"2024-09-21T06:08:59.962326+0000","last_unstale":"2024-09-21T06:08:59.964155+0000","last_undegraded":"2024-09-21T06:08:59.964155+0000","last_fullsized":"2024-09-21T06:08:59.964155+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:27.371158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"98'3","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271621+0000","last_change":"2024-09-21T06:08:58.959618+0000","last_active":"2024-09-21T06:09:01.271621+0000","last_peered":"2024-09-21T06:09:01.271621+0000","last_clean":"2024-09-21T06:09:01.271621+0000","last_became_active":"2024-09-21T06:08:58.959053+0000","last_became_peered":"2024-09-21T06:08:58.959053+0000","last_unstale":"2024-09-21T06:09:01.271621+0000","last_undegraded":"2024-09-21T06:09:01.271621+0000","last_fullsized":"2024-09-21T06:09:01.271621+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:17.316213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270003+0000","last_change":"2024-09-21T06:08:59.971688+0000","last_active":"2024-09-21T06:09:01.270003+0000","last_peered":"2024-09-21T06:09:01.270003+0000","last_clean":"2024-09-21T06:09:01.270003+0000","last_became_active":"2024-09-21T06:08:59.970408+0000","last_became_peered":"2024-09-21T06:08:59.970408+0000","last_unstale":"2024-09-21T06:09:01.270003+0000","last_undegraded":"2024-09-21T06:09:01.270003+0000","last_fullsized":"2024-09-21T06:09:01.270003+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:30.210909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"98'6","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269984+0000","last_change":"2024-09-21T06:08:58.958357+0000","last_active":"2024-09-21T06:09:01.269984+0000","last_peered":"2024-09-21T06:09:01.269984+0000","last_clean":"2024-09-21T06:09:01.269984+0000","last_became_active":"2024-09-21T06:08:58.957921+0000","last_became_peered":"2024-09-21T06:08:58.957921+0000","last_unstale":"2024-09-21T06:09:01.269984+0000","last_undegraded":"2024-09-21T06:09:01.269984+0000","last_fullsized":"2024-09-21T06:09:01.269984+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:31.499719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.972185+0000","last_change":"2024-09-21T06:08:59.971878+0000","last_active":"2024-09-21T06:08:59.972185+0000","last_peered":"2024-09-21T06:08:59.972185+0000","last_clean":"2024-09-21T06:08:59.972185+0000","last_became_active":"2024-09-21T06:08:59.970790+0000","last_became_peered":"2024-09-21T06:08:59.970790+0000","last_unstale":"2024-09-21T06:08:59.972185+0000","last_undegraded":"2024-09-21T06:08:59.972185+0000","last_fullsized":"2024-09-21T06:08:59.972185+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:32.612011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.955096+0000","last_change":"2024-09-21T06:08:58.962565+0000","last_active":"2024-09-21T06:09:00.955096+0000","last_peered":"2024-09-21T06:09:00.955096+0000","last_clean":"2024-09-21T06:09:00.955096+0000","last_became_active":"2024-09-21T06:08:58.961500+0000","last_became_peered":"2024-09-21T06:08:58.961500+0000","last_unstale":"2024-09-21T06:09:00.955096+0000","last_undegraded":"2024-09-21T06:09:00.955096+0000","last_fullsized":"2024-09-21T06:09:00.955096+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:44.520275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949526+0000","last_change":"2024-09-21T06:08:59.957214+0000","last_active":"2024-09-21T06:09:00.949526+0000","last_peered":"2024-09-21T06:09:00.949526+0000","last_clean":"2024-09-21T06:09:00.949526+0000","last_became_active":"2024-09-21T06:08:59.956039+0000","last_became_peered":"2024-09-21T06:08:59.956039+0000","last_unstale":"2024-09-21T06:09:00.949526+0000","last_undegraded":"2024-09-21T06:09:00.949526+0000","last_fullsized":"2024-09-21T06:09:00.949526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:25.049687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.947217+0000","last_change":"2024-09-21T06:08:58.950575+0000","last_active":"2024-09-21T06:08:59.947217+0000","last_peered":"2024-09-21T06:08:59.947217+0000","last_clean":"2024-09-21T06:08:59.947217+0000","last_became_active":"2024-09-21T06:08:58.950271+0000","last_became_peered":"2024-09-21T06:08:58.950271+0000","last_unstale":"2024-09-21T06:08:59.947217+0000","last_undegraded":"2024-09-21T06:08:59.947217+0000","last_fullsized":"2024-09-21T06:08:59.947217+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:46.922550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954513+0000","last_change":"2024-09-21T06:08:59.967412+0000","last_active":"2024-09-21T06:09:00.954513+0000","last_peered":"2024-09-21T06:09:00.954513+0000","last_clean":"2024-09-21T06:09:00.954513+0000","last_became_active":"2024-09-21T06:08:59.966723+0000","last_became_peered":"2024-09-21T06:08:59.966723+0000","last_unstale":"2024-09-21T06:09:00.954513+0000","last_undegraded":"2024-09-21T06:09:00.954513+0000","last_fullsized":"2024-09-21T06:09:00.954513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:17.052381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271280+0000","last_change":"2024-09-21T06:08:58.962319+0000","last_active":"2024-09-21T06:09:01.271280+0000","last_peered":"2024-09-21T06:09:01.271280+0000","last_clean":"2024-09-21T06:09:01.271280+0000","last_became_active":"2024-09-21T06:08:58.961516+0000","last_became_peered":"2024-09-21T06:08:58.961516+0000","last_unstale":"2024-09-21T06:09:01.271280+0000","last_undegraded":"2024-09-21T06:09:01.271280+0000","last_fullsized":"2024-09-21T06:09:01.271280+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:18.237892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954972+0000","last_change":"2024-09-21T06:08:59.969789+0000","last_active":"2024-09-21T06:09:00.954972+0000","last_peered":"2024-09-21T06:09:00.954972+0000","last_clean":"2024-09-21T06:09:00.954972+0000","last_became_active":"2024-09-21T06:08:59.968389+0000","last_became_peered":"2024-09-21T06:08:59.968389+0000","last_unstale":"2024-09-21T06:09:00.954972+0000","last_undegraded":"2024-09-21T06:09:00.954972+0000","last_fullsized":"2024-09-21T06:09:00.954972+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:50.758099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"98'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.975596+0000","last_change":"2024-09-21T06:08:58.962716+0000","last_active":"2024-09-21T06:08:59.975596+0000","last_peered":"2024-09-21T06:08:59.975596+0000","last_clean":"2024-09-21T06:08:59.975596+0000","last_became_active":"2024-09-21T06:08:58.961600+0000","last_became_peered":"2024-09-21T06:08:58.961600+0000","last_unstale":"2024-09-21T06:08:59.975596+0000","last_undegraded":"2024-09-21T06:08:59.975596+0000","last_fullsized":"2024-09-21T06:08:59.975596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:19.212734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949815+0000","last_change":"2024-09-21T06:08:59.953589+0000","last_active":"2024-09-21T06:09:00.949815+0000","last_peered":"2024-09-21T06:09:00.949815+0000","last_clean":"2024-09-21T06:09:00.949815+0000","last_became_active":"2024-09-21T06:08:59.953315+0000","last_became_peered":"2024-09-21T06:08:59.953315+0000","last_unstale":"2024-09-21T06:09:00.949815+0000","last_undegraded":"2024-09-21T06:09:00.949815+0000","last_fullsized":"2024-09-21T06:09:00.949815+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:14.296586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269975+0000","last_change":"2024-09-21T06:08:58.963659+0000","last_active":"2024-09-21T06:09:01.269975+0000","last_peered":"2024-09-21T06:09:01.269975+0000","last_clean":"2024-09-21T06:09:01.269975+0000","last_became_active":"2024-09-21T06:08:58.962828+0000","last_became_peered":"2024-09-21T06:08:58.962828+0000","last_unstale":"2024-09-21T06:09:01.269975+0000","last_undegraded":"2024-09-21T06:09:01.269975+0000","last_fullsized":"2024-09-21T06:09:01.269975+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:10.920557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269599+0000","last_change":"2024-09-21T06:08:59.956199+0000","last_active":"2024-09-21T06:09:01.269599+0000","last_peered":"2024-09-21T06:09:01.269599+0000","last_clean":"2024-09-21T06:09:01.269599+0000","last_became_active":"2024-09-21T06:08:59.955933+0000","last_became_peered":"2024-09-21T06:08:59.955933+0000","last_unstale":"2024-09-21T06:09:01.269599+0000","last_undegraded":"2024-09-21T06:09:01.269599+0000","last_fullsized":"2024-09-21T06:09:01.269599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:27.560783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.977455+0000","last_change":"2024-09-21T06:08:58.962100+0000","last_active":"2024-09-21T06:08:59.977455+0000","last_peered":"2024-09-21T06:08:59.977455+0000","last_clean":"2024-09-21T06:08:59.977455+0000","last_became_active":"2024-09-21T06:08:58.961856+0000","last_became_peered":"2024-09-21T06:08:58.961856+0000","last_unstale":"2024-09-21T06:08:59.977455+0000","last_undegraded":"2024-09-21T06:08:59.977455+0000","last_fullsized":"2024-09-21T06:08:59.977455+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:18.330751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270488+0000","last_change":"2024-09-21T06:08:59.969259+0000","last_active":"2024-09-21T06:09:01.270488+0000","last_peered":"2024-09-21T06:09:01.270488+0000","last_clean":"2024-09-21T06:09:01.270488+0000","last_became_active":"2024-09-21T06:08:59.968661+0000","last_became_peered":"2024-09-21T06:08:59.968661+0000","last_unstale":"2024-09-21T06:09:01.270488+0000","last_undegraded":"2024-09-21T06:09:01.270488+0000","last_fullsized":"2024-09-21T06:09:01.270488+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:32.985628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.948411+0000","last_change":"2024-09-21T06:08:58.957877+0000","last_active":"2024-09-21T06:08:59.948411+0000","last_peered":"2024-09-21T06:08:59.948411+0000","last_clean":"2024-09-21T06:08:59.948411+0000","last_became_active":"2024-09-21T06:08:58.957585+0000","last_became_peered":"2024-09-21T06:08:58.957585+0000","last_unstale":"2024-09-21T06:08:59.948411+0000","last_undegraded":"2024-09-21T06:08:59.948411+0000","last_fullsized":"2024-09-21T06:08:59.948411+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.805845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949337+0000","last_change":"2024-09-21T06:08:59.958322+0000","last_active":"2024-09-21T06:09:00.949337+0000","last_peered":"2024-09-21T06:09:00.949337+0000","last_clean":"2024-09-21T06:09:00.949337+0000","last_became_active":"2024-09-21T06:08:59.958057+0000","last_became_peered":"2024-09-21T06:08:59.958057+0000","last_unstale":"2024-09-21T06:09:00.949337+0000","last_undegraded":"2024-09-21T06:09:00.949337+0000","last_fullsized":"2024-09-21T06:09:00.949337+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:43.951528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"98'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.966553+0000","last_change":"2024-09-21T06:08:58.958262+0000","last_active":"2024-09-21T06:08:59.966553+0000","last_peered":"2024-09-21T06:08:59.966553+0000","last_clean":"2024-09-21T06:08:59.966553+0000","last_became_active":"2024-09-21T06:08:58.956315+0000","last_became_peered":"2024-09-21T06:08:58.956315+0000","last_unstale":"2024-09-21T06:08:59.966553+0000","last_undegraded":"2024-09-21T06:08:59.966553+0000","last_fullsized":"2024-09-21T06:08:59.966553+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:31.671327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270539+0000","last_change":"2024-09-21T06:08:59.960114+0000","last_active":"2024-09-21T06:09:01.270539+0000","last_peered":"2024-09-21T06:09:01.270539+0000","last_clean":"2024-09-21T06:09:01.270539+0000","last_became_active":"2024-09-21T06:08:59.959833+0000","last_became_peered":"2024-09-21T06:08:59.959833+0000","last_unstale":"2024-09-21T06:09:01.270539+0000","last_undegraded":"2024-09-21T06:09:01.270539+0000","last_fullsized":"2024-09-21T06:09:01.270539+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:20.079989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949500+0000","last_change":"2024-09-21T06:08:58.963718+0000","last_active":"2024-09-21T06:09:00.949500+0000","last_peered":"2024-09-21T06:09:00.949500+0000","last_clean":"2024-09-21T06:09:00.949500+0000","last_became_active":"2024-09-21T06:08:58.963383+0000","last_became_peered":"2024-09-21T06:08:58.963383+0000","last_unstale":"2024-09-21T06:09:00.949500+0000","last_undegraded":"2024-09-21T06:09:00.949500+0000","last_fullsized":"2024-09-21T06:09:00.949500+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:07.641253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949258+0000","last_change":"2024-09-21T06:08:59.967611+0000","last_active":"2024-09-21T06:09:00.949258+0000","last_peered":"2024-09-21T06:09:00.949258+0000","last_clean":"2024-09-21T06:09:00.949258+0000","last_became_active":"2024-09-21T06:08:59.963632+0000","last_became_peered":"2024-09-21T06:08:59.963632+0000","last_unstale":"2024-09-21T06:09:00.949258+0000","last_undegraded":"2024-09-21T06:09:00.949258+0000","last_fullsized":"2024-09-21T06:09:00.949258+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:28.333461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949647+0000","last_change":"2024-09-21T06:08:58.958953+0000","last_active":"2024-09-21T06:09:00.949647+0000","last_peered":"2024-09-21T06:09:00.949647+0000","last_clean":"2024-09-21T06:09:00.949647+0000","last_became_active":"2024-09-21T06:08:58.958671+0000","last_became_peered":"2024-09-21T06:08:58.958671+0000","last_unstale":"2024-09-21T06:09:00.949647+0000","last_undegraded":"2024-09-21T06:09:00.949647+0000","last_fullsized":"2024-09-21T06:09:00.949647+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:21.993187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269723+0000","last_change":"2024-09-21T06:08:59.958540+0000","last_active":"2024-09-21T06:09:01.269723+0000","last_peered":"2024-09-21T06:09:01.269723+0000","last_clean":"2024-09-21T06:09:01.269723+0000","last_became_active":"2024-09-21T06:08:59.958247+0000","last_became_peered":"2024-09-21T06:08:59.958247+0000","last_unstale":"2024-09-21T06:09:01.269723+0000","last_undegraded":"2024-09-21T06:09:01.269723+0000","last_fullsized":"2024-09-21T06:09:01.269723+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:57.164455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.947454+0000","last_change":"2024-09-21T06:08:58.955677+0000","last_active":"2024-09-21T06:08:59.947454+0000","last_peered":"2024-09-21T06:08:59.947454+0000","last_clean":"2024-09-21T06:08:59.947454+0000","last_became_active":"2024-09-21T06:08:58.955001+0000","last_became_peered":"2024-09-21T06:08:58.955001+0000","last_unstale":"2024-09-21T06:08:59.947454+0000","last_undegraded":"2024-09-21T06:08:59.947454+0000","last_fullsized":"2024-09-21T06:08:59.947454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:25.782184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270240+0000","last_change":"2024-09-21T06:08:59.961928+0000","last_active":"2024-09-21T06:09:01.270240+0000","last_peered":"2024-09-21T06:09:01.270240+0000","last_clean":"2024-09-21T06:09:01.270240+0000","last_became_active":"2024-09-21T06:08:59.961471+0000","last_became_peered":"2024-09-21T06:08:59.961471+0000","last_unstale":"2024-09-21T06:09:01.270240+0000","last_undegraded":"2024-09-21T06:09:01.270240+0000","last_fullsized":"2024-09-21T06:09:01.270240+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:54.388763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.955295+0000","last_change":"2024-09-21T06:08:58.958194+0000","last_active":"2024-09-21T06:09:00.955295+0000","last_peered":"2024-09-21T06:09:00.955295+0000","last_clean":"2024-09-21T06:09:00.955295+0000","last_became_active":"2024-09-21T06:08:58.957926+0000","last_became_peered":"2024-09-21T06:08:58.957926+0000","last_unstale":"2024-09-21T06:09:00.955295+0000","last_undegraded":"2024-09-21T06:09:00.955295+0000","last_fullsized":"2024-09-21T06:09:00.955295+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:09.376134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949436+0000","last_change":"2024-09-21T06:08:59.956591+0000","last_active":"2024-09-21T06:09:00.949436+0000","last_peered":"2024-09-21T06:09:00.949436+0000","last_clean":"2024-09-21T06:09:00.949436+0000","last_became_active":"2024-09-21T06:08:59.956144+0000","last_became_peered":"2024-09-21T06:08:59.956144+0000","last_unstale":"2024-09-21T06:09:00.949436+0000","last_undegraded":"2024-09-21T06:09:00.949436+0000","last_fullsized":"2024-09-21T06:09:00.949436+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:57.327765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"99'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.954811+0000","last_change":"2024-09-21T06:08:58.959784+0000","last_active":"2024-09-21T06:09:00.954811+0000","last_peered":"2024-09-21T06:09:00.954811+0000","last_clean":"2024-09-21T06:09:00.954811+0000","last_became_active":"2024-09-21T06:08:58.959441+0000","last_became_peered":"2024-09-21T06:08:58.959441+0000","last_unstale":"2024-09-21T06:09:00.954811+0000","last_undegraded":"2024-09-21T06:09:00.954811+0000","last_fullsized":"2024-09-21T06:09:00.954811+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:55.204028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.272116+0000","last_change":"2024-09-21T06:08:59.967280+0000","last_active":"2024-09-21T06:09:01.272116+0000","last_peered":"2024-09-21T06:09:01.272116+0000","last_clean":"2024-09-21T06:09:01.272116+0000","last_became_active":"2024-09-21T06:08:59.966981+0000","last_became_peered":"2024-09-21T06:08:59.966981+0000","last_unstale":"2024-09-21T06:09:01.272116+0000","last_undegraded":"2024-09-21T06:09:01.272116+0000","last_fullsized":"2024-09-21T06:09:01.272116+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:00.015905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270098+0000","last_change":"2024-09-21T06:08:58.963356+0000","last_active":"2024-09-21T06:09:01.270098+0000","last_peered":"2024-09-21T06:09:01.270098+0000","last_clean":"2024-09-21T06:09:01.270098+0000","last_became_active":"2024-09-21T06:08:58.962482+0000","last_became_peered":"2024-09-21T06:08:58.962482+0000","last_unstale":"2024-09-21T06:09:01.270098+0000","last_undegraded":"2024-09-21T06:09:01.270098+0000","last_fullsized":"2024-09-21T06:09:01.270098+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:37.425394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.269772+0000","last_change":"2024-09-21T06:08:59.964201+0000","last_active":"2024-09-21T06:09:01.269772+0000","last_peered":"2024-09-21T06:09:01.269772+0000","last_clean":"2024-09-21T06:09:01.269772+0000","last_became_active":"2024-09-21T06:08:59.963524+0000","last_became_peered":"2024-09-21T06:08:59.963524+0000","last_unstale":"2024-09-21T06:09:01.269772+0000","last_undegraded":"2024-09-21T06:09:01.269772+0000","last_fullsized":"2024-09-21T06:09:01.269772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:18.736783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.272371+0000","last_change":"2024-09-21T06:08:58.962816+0000","last_active":"2024-09-21T06:09:01.272371+0000","last_peered":"2024-09-21T06:09:01.272371+0000","last_clean":"2024-09-21T06:09:01.272371+0000","last_became_active":"2024-09-21T06:08:58.962530+0000","last_became_peered":"2024-09-21T06:08:58.962530+0000","last_unstale":"2024-09-21T06:09:01.272371+0000","last_undegraded":"2024-09-21T06:09:01.272371+0000","last_fullsized":"2024-09-21T06:09:01.272371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:37.744761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271057+0000","last_change":"2024-09-21T06:08:59.958294+0000","last_active":"2024-09-21T06:09:01.271057+0000","last_peered":"2024-09-21T06:09:01.271057+0000","last_clean":"2024-09-21T06:09:01.271057+0000","last_became_active":"2024-09-21T06:08:59.958027+0000","last_became_peered":"2024-09-21T06:08:59.958027+0000","last_unstale":"2024-09-21T06:09:01.271057+0000","last_undegraded":"2024-09-21T06:09:01.271057+0000","last_fullsized":"2024-09-21T06:09:01.271057+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:34.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.949784+0000","last_change":"2024-09-21T06:08:58.959877+0000","last_active":"2024-09-21T06:08:59.949784+0000","last_peered":"2024-09-21T06:08:59.949784+0000","last_clean":"2024-09-21T06:08:59.949784+0000","last_became_active":"2024-09-21T06:08:58.959620+0000","last_became_peered":"2024-09-21T06:08:58.959620+0000","last_unstale":"2024-09-21T06:08:59.949784+0000","last_undegraded":"2024-09-21T06:08:59.949784+0000","last_fullsized":"2024-09-21T06:08:59.949784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:41.290636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-21T06:08:59.972703+0000","last_change":"2024-09-21T06:08:59.972253+0000","last_active":"2024-09-21T06:08:59.972703+0000","last_peered":"2024-09-21T06:08:59.972703+0000","last_clean":"2024-09-21T06:08:59.972703+0000","last_became_active":"2024-09-21T06:08:59.971144+0000","last_became_peered":"2024-09-21T06:08:59.971144+0000","last_unstale":"2024-09-21T06:08:59.972703+0000","last_undegraded":"2024-09-21T06:08:59.972703+0000","last_fullsized":"2024-09-21T06:08:59.972703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:44.082835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271318+0000","last_change":"2024-09-21T06:08:58.950865+0000","last_active":"2024-09-21T06:09:01.271318+0000","last_peered":"2024-09-21T06:09:01.271318+0000","last_clean":"2024-09-21T06:09:01.271318+0000","last_became_active":"2024-09-21T06:08:58.950308+0000","last_became_peered":"2024-09-21T06:08:58.950308+0000","last_unstale":"2024-09-21T06:09:01.271318+0000","last_undegraded":"2024-09-21T06:09:01.271318+0000","last_fullsized":"2024-09-21T06:09:01.271318+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:25.172773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949185+0000","last_change":"2024-09-21T06:08:59.958802+0000","last_active":"2024-09-21T06:09:00.949185+0000","last_peered":"2024-09-21T06:09:00.949185+0000","last_clean":"2024-09-21T06:09:00.949185+0000","last_became_active":"2024-09-21T06:08:59.958541+0000","last_became_peered":"2024-09-21T06:08:59.958541+0000","last_unstale":"2024-09-21T06:09:00.949185+0000","last_undegraded":"2024-09-21T06:09:00.949185+0000","last_fullsized":"2024-09-21T06:09:00.949185+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:20.762406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271245+0000","last_change":"2024-09-21T06:08:58.962576+0000","last_active":"2024-09-21T06:09:01.271245+0000","last_peered":"2024-09-21T06:09:01.271245+0000","last_clean":"2024-09-21T06:09:01.271245+0000","last_became_active":"2024-09-21T06:08:58.962000+0000","last_became_peered":"2024-09-21T06:08:58.962000+0000","last_unstale":"2024-09-21T06:09:01.271245+0000","last_undegraded":"2024-09-21T06:09:01.271245+0000","last_fullsized":"2024-09-21T06:09:01.271245+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:14.647288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.271442+0000","last_change":"2024-09-21T06:08:59.969575+0000","last_active":"2024-09-21T06:09:01.271442+0000","last_peered":"2024-09-21T06:09:01.271442+0000","last_clean":"2024-09-21T06:09:01.271442+0000","last_became_active":"2024-09-21T06:08:59.969181+0000","last_became_peered":"2024-09-21T06:08:59.969181+0000","last_unstale":"2024-09-21T06:09:01.271442+0000","last_undegraded":"2024-09-21T06:09:01.271442+0000","last_fullsized":"2024-09-21T06:09:01.271442+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:21.409466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:01.270121+0000","last_change":"2024-09-21T06:08:58.964714+0000","last_active":"2024-09-21T06:09:01.270121+0000","last_peered":"2024-09-21T06:09:01.270121+0000","last_clean":"2024-09-21T06:09:01.270121+0000","last_became_active":"2024-09-21T06:08:58.964398+0000","last_became_peered":"2024-09-21T06:08:58.964398+0000","last_unstale":"2024-09-21T06:09:01.270121+0000","last_undegraded":"2024-09-21T06:09:01.270121+0000","last_fullsized":"2024-09-21T06:09:01.270121+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:51.484853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.955213+0000","last_change":"2024-09-21T06:08:59.969028+0000","last_active":"2024-09-21T06:09:00.955213+0000","last_peered":"2024-09-21T06:09:00.955213+0000","last_clean":"2024-09-21T06:09:00.955213+0000","last_became_active":"2024-09-21T06:08:59.965319+0000","last_became_peered":"2024-09-21T06:08:59.965319+0000","last_unstale":"2024-09-21T06:09:00.955213+0000","last_undegraded":"2024-09-21T06:09:00.955213+0000","last_fullsized":"2024-09-21T06:09:00.955213+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:58.936349+0000","last_clean_scrub_stamp":"2024-09-21T06:08:58.936349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:44.640627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949428+0000","last_change":"2024-09-21T06:08:58.962079+0000","last_active":"2024-09-21T06:09:00.949428+0000","last_peered":"2024-09-21T06:09:00.949428+0000","last_clean":"2024-09-21T06:09:00.949428+0000","last_became_active":"2024-09-21T06:08:58.961809+0000","last_became_peered":"2024-09-21T06:08:58.961809+0000","last_unstale":"2024-09-21T06:09:00.949428+0000","last_undegraded":"2024-09-21T06:09:00.949428+0000","last_fullsized":"2024-09-21T06:09:00.949428+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:08:57.933427+0000","last_clean_scrub_stamp":"2024-09-21T06:08:57.933427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:01.440071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":274,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-21T06:09:00.949414+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:09:00.949414+0000","last_peered":"2024-09-21T06:09:00.949414+0000","last_clean":"2024-09-21T06:09:00.949414+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:09:00.949414+0000","last_undegraded":"2024-09-21T06:09:00.949414+0000","last_fullsized":"2024-09-21T06:09:00.949414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:14.744977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194791,"statfs":{"total":200000000,"available":199466739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1089,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194223,"statfs":{"total":200000000,"available":198884758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1101,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194210,"statfs":{"total":200000000,"available":198871613,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":526,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194786,"statfs":{"total":200000000,"available":199461357,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":526,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194785,"statfs":{"total":200000000,"available":199460417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":525,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194787,"statfs":{"total":200000000,"available":199462051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":525,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194786,"statfs":{"total":200000000,"available":199461469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":525,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194786,"statfs":{"total":200000000,"available":199461857,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:09:05.251 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:09:05.251 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:09:05.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.516+0000 7f6494200640 1 -- 172.21.15.118:0/3577951294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c142e40 msgr2=0x7f648c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.516+0000 7f6494200640 1 --2- 172.21.15.118:0/3577951294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c142e40 0x7f648c0d13c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6484005fd0 tx=0x7f648402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.517+0000 7f6494200640 1 -- 172.21.15.118:0/3577951294 shutdown_connections 2024-09-21T06:09:05.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.517+0000 7f6494200640 1 --2- 172.21.15.118:0/3577951294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c142e40 0x7f648c0d13c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.517+0000 7f6494200640 1 --2- 172.21.15.118:0/3577951294 >> v2:172.21.15.149:3300/0 conn(0x7f648c13fae0 0x7f648c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.517+0000 7f6494200640 1 -- 172.21.15.118:0/3577951294 >> 172.21.15.118:0/3577951294 conn(0x7f648c06d110 msgr2=0x7f648c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:05.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.517+0000 7f6494200640 1 -- 172.21.15.118:0/3577951294 shutdown_connections 2024-09-21T06:09:05.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.517+0000 7f6494200640 1 -- 172.21.15.118:0/3577951294 wait complete. 2024-09-21T06:09:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.519+0000 7f6494200640 1 Processor -- start 2024-09-21T06:09:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.519+0000 7f6494200640 1 -- start start 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.520+0000 7f6494200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648c13fae0 0x7f648c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6494200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c13fef0 0x7f648c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6494200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f648c142e40 0x7f648c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6494200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0cfa90 con 0x7f648c13fae0 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6494200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0cf910 con 0x7f648c142e40 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6494200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f648c0cfc10 con 0x7f648c13fef0 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648c13fae0 0x7f648c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648c13fae0 0x7f648c13b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60914/0 (socket says 172.21.15.118:60914) 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 -- 172.21.15.118:0/2798327217 learned_addr learned my addr 172.21.15.118:0/2798327217 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6490e00640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c13fef0 0x7f648c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6492200640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f648c142e40 0x7f648c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 -- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c13fef0 msgr2=0x7f648c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c13fef0 0x7f648c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 -- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f648c142e40 msgr2=0x7f648c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f648c142e40 0x7f648c15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.521+0000 7f6491800640 1 -- 172.21.15.118:0/2798327217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c14c3c0 con 0x7f648c13fae0 2024-09-21T06:09:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.522+0000 7f6491800640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648c13fae0 0x7f648c13b950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f648000e7c0 tx=0x7f648000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.522+0000 7f6489600640 1 -- 172.21.15.118:0/2798327217 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648000ccc0 con 0x7f648c13fae0 2024-09-21T06:09:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.522+0000 7f6489600640 1 -- 172.21.15.118:0/2798327217 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6480010430 con 0x7f648c13fae0 2024-09-21T06:09:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.522+0000 7f6489600640 1 -- 172.21.15.118:0/2798327217 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480010860 con 0x7f648c13fae0 2024-09-21T06:09:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.522+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c073040 con 0x7f648c13fae0 2024-09-21T06:09:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.522+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c073600 con 0x7f648c13fae0 2024-09-21T06:09:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.523+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c0d0130 con 0x7f648c13fae0 2024-09-21T06:09:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.524+0000 7f6489600640 1 -- 172.21.15.118:0/2798327217 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6480010a00 con 0x7f648c13fae0 2024-09-21T06:09:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.525+0000 7f6489600640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f646c078bc0 0x7f646c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.525+0000 7f6489600640 1 -- 172.21.15.118:0/2798327217 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f648009b530 con 0x7f648c13fae0 2024-09-21T06:09:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.526+0000 7f6490e00640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f646c078bc0 0x7f646c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:05.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.527+0000 7f6490e00640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f646c078bc0 0x7f646c07b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478001390 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.530+0000 7f6489600640 1 -- 172.21.15.118:0/2798327217 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6480063440 con 0x7f648c13fae0 2024-09-21T06:09:05.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.782+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f648c13c3b0 con 0x7f648c13fae0 2024-09-21T06:09:05.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.785+0000 7f6489600640 1 -- 172.21.15.118:0/2798327217 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f6480067e70 con 0x7f648c13fae0 2024-09-21T06:09:05.786 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:09:05.786 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:09:05.787 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:09:05.787 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:09:05.787 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:09:05.787 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f646c078bc0 msgr2=0x7f646c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f646c078bc0 0x7f646c07b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478001390 comp rx=0 tx=0).stop 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648c13fae0 msgr2=0x7f648c13b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648c13fae0 0x7f648c13b950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f648000e7c0 tx=0x7f648000ec80 comp rx=0 tx=0).stop 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 shutdown_connections 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f648c142e40 0x7f648c15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f646c078bc0 0x7f646c07b0d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f648c13fef0 0x7f648c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 --2- 172.21.15.118:0/2798327217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648c13fae0 0x7f648c13b950 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:05.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 >> 172.21.15.118:0/2798327217 conn(0x7f648c06d110 msgr2=0x7f648c142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:05.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 shutdown_connections 2024-09-21T06:09:05.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:05.787+0000 7f6494200640 1 -- 172.21.15.118:0/2798327217 wait complete. 2024-09-21T06:09:05.814 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:06.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.034+0000 7f8ccfe00640 1 -- 172.21.15.118:0/657381075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 msgr2=0x7f8cd00d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.034+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/657381075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd00d02e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00d3390 tx=0x7f8cc002a560 comp rx=0 tx=0).stop 2024-09-21T06:09:06.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.035+0000 7f8ccfe00640 1 -- 172.21.15.118:0/657381075 shutdown_connections 2024-09-21T06:09:06.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.035+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/657381075 >> v2:172.21.15.149:3300/0 conn(0x7f8cd00d1330 0x7f8cd00d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.035+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/657381075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd00d02e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.035+0000 7f8ccfe00640 1 -- 172.21.15.118:0/657381075 >> 172.21.15.118:0/657381075 conn(0x7f8cd006d1c0 msgr2=0x7f8cd006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.035+0000 7f8ccfe00640 1 -- 172.21.15.118:0/657381075 shutdown_connections 2024-09-21T06:09:06.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.035+0000 7f8ccfe00640 1 -- 172.21.15.118:0/657381075 wait complete. 2024-09-21T06:09:06.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.037+0000 7f8ccfe00640 1 Processor -- start 2024-09-21T06:09:06.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.037+0000 7f8ccfe00640 1 -- start start 2024-09-21T06:09:06.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.038+0000 7f8ccfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00d1330 0x7f8cd00ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.038+0000 7f8ccfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.038+0000 7f8ccfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cd0163900 0x7f8cd015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.038+0000 7f8ccfe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00d3aa0 con 0x7f8cd01634f0 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.038+0000 7f8ccfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00d3920 con 0x7f8cd0163900 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.038+0000 7f8ccfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd00d3c20 con 0x7f8cd00d1330 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd015ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44010/0 (socket says 172.21.15.118:44010) 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 -- 172.21.15.118:0/862897147 learned_addr learned my addr 172.21.15.118:0/862897147 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8ccf400640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cd0163900 0x7f8cd015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8ccea00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00d1330 0x7f8cd00ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 -- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00d1330 msgr2=0x7f8cd00ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00d1330 0x7f8cd00ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 -- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cd0163900 msgr2=0x7f8cd015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cd0163900 0x7f8cd015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 -- 172.21.15.118:0/862897147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd00c96b0 con 0x7f8cd01634f0 2024-09-21T06:09:06.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8ccea00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00d1330 0x7f8cd00ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:06.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.039+0000 7f8cc6000640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd015ca40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009fd0 tx=0x7f8cb800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.040+0000 7f8cc7e00640 1 -- 172.21.15.118:0/862897147 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8015020 con 0x7f8cd01634f0 2024-09-21T06:09:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.040+0000 7f8cc7e00640 1 -- 172.21.15.118:0/862897147 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cb8011920 con 0x7f8cd01634f0 2024-09-21T06:09:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.040+0000 7f8cc7e00640 1 -- 172.21.15.118:0/862897147 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8011d50 con 0x7f8cd01634f0 2024-09-21T06:09:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.040+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd015cf80 con 0x7f8cd01634f0 2024-09-21T06:09:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.040+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd00c9c30 con 0x7f8cd01634f0 2024-09-21T06:09:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.041+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd00d4160 con 0x7f8cd01634f0 2024-09-21T06:09:06.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.042+0000 7f8cc7e00640 1 -- 172.21.15.118:0/862897147 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8cb8018020 con 0x7f8cd01634f0 2024-09-21T06:09:06.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.044+0000 7f8cc7e00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8cac078b90 0x7f8cac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.044+0000 7f8cc7e00640 1 -- 172.21.15.118:0/862897147 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f8cb809ac50 con 0x7f8cd01634f0 2024-09-21T06:09:06.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.044+0000 7f8ccea00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8cac078b90 0x7f8cac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.045+0000 7f8ccea00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8cac078b90 0x7f8cac07b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0033000 tx=0x7f8cc0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.049+0000 7f8cc7e00640 1 -- 172.21.15.118:0/862897147 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8cb801f020 con 0x7f8cd01634f0 2024-09-21T06:09:06.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.266+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cd00cea90 con 0x7f8cd01634f0 2024-09-21T06:09:06.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.266+0000 7f8cc7e00640 1 -- 172.21.15.118:0/862897147 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7f8cb8063080 con 0x7f8cd01634f0 2024-09-21T06:09:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:06.268 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:06.268 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:06.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8cac078b90 msgr2=0x7f8cac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8cac078b90 0x7f8cac07b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0033000 tx=0x7f8cc0004730 comp rx=0 tx=0).stop 2024-09-21T06:09:06.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 msgr2=0x7f8cd015ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd015ca40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009fd0 tx=0x7f8cb800b870 comp rx=0 tx=0).stop 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 shutdown_connections 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cd0163900 0x7f8cd015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8cd01634f0 0x7f8cd015ca40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8cac078b90 0x7f8cac07b0a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 --2- 172.21.15.118:0/862897147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00d1330 0x7f8cd00ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 >> 172.21.15.118:0/862897147 conn(0x7f8cd006d1c0 msgr2=0x7f8cd015e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 shutdown_connections 2024-09-21T06:09:06.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.269+0000 7f8ccfe00640 1 -- 172.21.15.118:0/862897147 wait complete. 2024-09-21T06:09:06.694 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:08:59.444784+0000', 'modified': '2024-09-21T06:09:02.831855+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6249}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6249': {'gid': 6249, 'name': 'c', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6834/1882776841', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 1882776841}, {'type': 'v1', 'addr': '172.21.15.118:6834', 'nonce': 1882776841}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6249, 'qdb_cluster': [6249]} 2024-09-21T06:09:06.694 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:09:06.694 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:09:06.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.920+0000 7fb40fe00640 1 -- 172.21.15.118:0/2348670411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 msgr2=0x7fb3f0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.920+0000 7fb40fe00640 1 --2- 172.21.15.118:0/2348670411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb3f0004c10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009b50 tx=0x7fb3f0005830 comp rx=0 tx=0).stop 2024-09-21T06:09:06.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.920+0000 7fb40fe00640 1 -- 172.21.15.118:0/2348670411 shutdown_connections 2024-09-21T06:09:06.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.920+0000 7fb40fe00640 1 --2- 172.21.15.118:0/2348670411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb3f0004c10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.920+0000 7fb40fe00640 1 -- 172.21.15.118:0/2348670411 >> 172.21.15.118:0/2348670411 conn(0x7fb40806d110 msgr2=0x7fb40806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.920+0000 7fb40fe00640 1 -- 172.21.15.118:0/2348670411 shutdown_connections 2024-09-21T06:09:06.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.920+0000 7fb40fe00640 1 -- 172.21.15.118:0/2348670411 wait complete. 2024-09-21T06:09:06.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.923+0000 7fb40fe00640 1 Processor -- start 2024-09-21T06:09:06.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.923+0000 7fb40fe00640 1 -- start start 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb40813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4080cc310 0x7fb408142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb408158ef0 0x7fb408142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4080d12b0 con 0x7fb3f0004800 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb40815d890 con 0x7fb408158ef0 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4080d1430 con 0x7fb4080cc310 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb40813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb40813f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44024/0 (socket says 172.21.15.118:44024) 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.924+0000 7fb40d400640 1 -- 172.21.15.118:0/1920139567 learned_addr learned my addr 172.21.15.118:0/1920139567 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40de00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb408158ef0 0x7fb408142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40ca00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4080cc310 0x7fb408142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40d400640 1 -- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4080cc310 msgr2=0x7fb408142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40d400640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4080cc310 0x7fb408142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40d400640 1 -- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb408158ef0 msgr2=0x7fb408142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40d400640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb408158ef0 0x7fb408142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40d400640 1 -- 172.21.15.118:0/1920139567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40813f540 con 0x7fb3f0004800 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40ca00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4080cc310 0x7fb408142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40de00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb408158ef0 0x7fb408142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40d400640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb40813f000 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001890 tx=0x7fb3fc001d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb405600640 1 -- 172.21.15.118:0/1920139567 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc015070 con 0x7fb3f0004800 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb405600640 1 -- 172.21.15.118:0/1920139567 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3fc010980 con 0x7fb3f0004800 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4081fa020 con 0x7fb3f0004800 2024-09-21T06:09:06.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.925+0000 7fb405600640 1 -- 172.21.15.118:0/1920139567 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc010dd0 con 0x7fb3f0004800 2024-09-21T06:09:06.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.926+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4080cabc0 con 0x7fb3f0004800 2024-09-21T06:09:06.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.928+0000 7fb405600640 1 -- 172.21.15.118:0/1920139567 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3fc018070 con 0x7fb3f0004800 2024-09-21T06:09:06.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.929+0000 7fb405600640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb3e8078b90 0x7fb3e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.929+0000 7fb405600640 1 -- 172.21.15.118:0/1920139567 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fb3fc09b600 con 0x7fb3f0004800 2024-09-21T06:09:06.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.929+0000 7fb416e9d740 1 Processor -- start 2024-09-21T06:09:06.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.930+0000 7fb40ca00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb3e8078b90 0x7fb3e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.930+0000 7fb416e9d740 1 -- start start 2024-09-21T06:09:06.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.930+0000 7fb40ca00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb3e8078b90 0x7fb3e807b0a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4035000 tx=0x7fb3f40046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae4f270 0x55e42b21f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae263b0 0x55e42b21feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b1eff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb416e9d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55e42b179430 con 0x55e42ae263b0 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e42b1695d0 con 0x55e42ae4f270 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55e42b158a00 con 0x55e42ae2e590 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb40ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae263b0 0x55e42b21feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb40ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae263b0 0x55e42b21feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44034/0 (socket says 172.21.15.118:44034) 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb40ca00640 1 -- 172.21.15.118:0/985998373 learned_addr learned my addr 172.21.15.118:0/985998373 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.931+0000 7fb40d400640 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae4f270 0x55e42b21f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb40de00640 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b1eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb40ca00640 1 -- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 msgr2=0x55e42b1eff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb40ca00640 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b1eff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb40ca00640 1 -- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae4f270 msgr2=0x55e42b21f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb40ca00640 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae4f270 0x55e42b21f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb40ca00640 1 -- 172.21.15.118:0/985998373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42b121520 con 0x55e42ae263b0 2024-09-21T06:09:06.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb40ca00640 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae263b0 0x55e42b21feb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4036040 tx=0x7fb3f403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9553bb2282f92430 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb3f9c00640 1 -- 172.21.15.118:0/985998373 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4044040 con 0x55e42ae263b0 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb3f9c00640 1 -- 172.21.15.118:0/985998373 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3f404d070 con 0x55e42ae263b0 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.932+0000 7fb3f9c00640 1 -- 172.21.15.118:0/985998373 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4038040 con 0x55e42ae263b0 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 -- 172.21.15.118:0/985998373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae263b0 msgr2=0x55e42b21feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae263b0 0x55e42b21feb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4036040 tx=0x7fb3f403a000 comp rx=0 tx=0).stop 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 -- 172.21.15.118:0/985998373 shutdown_connections 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b1eff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae263b0 0x55e42b21feb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 --2- 172.21.15.118:0/985998373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae4f270 0x55e42b21f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 -- 172.21.15.118:0/985998373 >> 172.21.15.118:0/985998373 conn(0x55e42ae433c0 msgr2=0x55e42b1f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 -- 172.21.15.118:0/985998373 shutdown_connections 2024-09-21T06:09:06.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.933+0000 7fb416e9d740 1 -- 172.21.15.118:0/985998373 wait complete. 2024-09-21T06:09:06.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.934+0000 7fb416e9d740 1 -- start start 2024-09-21T06:09:06.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.935+0000 7fb416e9d740 1 Processor -- start 2024-09-21T06:09:06.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b234d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b216410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb416e9d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55e42b0ff330 con 0x55e42ae4f270 2024-09-21T06:09:06.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e42b15c810 con 0x55e42ae263b0 2024-09-21T06:09:06.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55e42aec9620 con 0x55e42ae2e590 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb416e9d740 10 client.0 _ll_register_callbacks cb 0x55e42b104420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb40de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b216410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb40de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b216410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44050/0 (socket says 172.21.15.118:44050) 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.936+0000 7fb40de00640 1 -- 172.21.15.118:0/2036740523 learned_addr learned my addr 172.21.15.118:0/2036740523 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40d400640 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40ca00640 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b234d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40de00640 1 -- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 msgr2=0x55e42b234d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40de00640 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b234d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40de00640 1 -- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 msgr2=0x55e42b21b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40de00640 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40de00640 1 -- 172.21.15.118:0/2036740523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42aeba850 con 0x55e42ae4f270 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb40de00640 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b216410 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb400001050 tx=0x7fb400006410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64388474641f5493 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb3ee000640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:09:06.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb3ee000640 1 -- 172.21.15.118:0/2036740523 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000050d0 con 0x55e42ae4f270 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb3ee000640 1 -- 172.21.15.118:0/2036740523 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fb400005270 con 0x55e42ae4f270 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.937+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f404d070 con 0x55e42ae4f270 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb3ee000640 1 -- 172.21.15.118:0/2036740523 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb400005470 con 0x55e42ae4f270 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 10 client.6360 fetch_fsmap learned FSMap version 51 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55e42af316b0 con 0x55e42ae4f270 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb3ee000640 1 -- 172.21.15.118:0/2036740523 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3f404d070 con 0x55e42ae4f270 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb3ee000640 1 -- 172.21.15.118:0/2036740523 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7fb4000035f0 con 0x55e42ae4f270 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 10 client.6360 fetch_fsmap finished waiting for FSMap version 51 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 10 client.6360 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 20 client.6360 populate_metadata read hostname 'smithi118' 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42ae0de40 0x55e42b249e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 4 client.6360 mds_command: new command op to 6249 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:09:06.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 --> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e42b16b520 con 0x55e42ae0de40 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.938+0000 7fb40d400640 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42ae0de40 0x55e42b249e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.939+0000 7fb40d400640 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42ae0de40 0x55e42b249e90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c2b463dc9756d10 server_cookie=fe7fd4d17ade903f in_seq=0 out_seq=0 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.939+0000 7fb3ee000640 10 client.6360 ms_handle_connect on v2:172.21.15.118:6833/1882776841 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb3ee000640 1 -- 172.21.15.118:0/2036740523 <== mds.0 v2:172.21.15.118:6833/1882776841 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e42b16b520 con 0x55e42ae0de40 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb3ee000640 10 client.6360 handle_command_reply: tid=0 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 client.6360 shutdown 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 msgr2=0x55e42b216410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b216410 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb400001050 tx=0x7fb400006410 comp rx=0 tx=0).stop 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 shutdown_connections 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42ae0de40 0x55e42b249e90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b216410 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b234d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 --2- 172.21.15.118:0/2036740523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb3ee000640 0 client.6360 ms_handle_reset on v2:172.21.15.118:6833/1882776841 2024-09-21T06:09:06.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 >> 172.21.15.118:0/2036740523 conn(0x55e42ae433c0 msgr2=0x55e42b23c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 shutdown_connections 2024-09-21T06:09:06.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 1 -- 172.21.15.118:0/2036740523 wait complete. 2024-09-21T06:09:06.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.940+0000 7fb416e9d740 20 client.6360 trim_cache size 0 max 16384 2024-09-21T06:09:06.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.960+0000 7fb416e9d740 1 Processor -- start 2024-09-21T06:09:06.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.960+0000 7fb416e9d740 1 -- start start 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b21fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b24c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb416e9d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb408201f70 con 0x55e42ae4f270 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb40813ced0 con 0x55e42ae263b0 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb408201900 con 0x55e42ae2e590 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb40de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b24c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb40de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b24c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44060/0 (socket says 172.21.15.118:44060) 2024-09-21T06:09:06.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb40de00640 1 -- 172.21.15.118:0/1139499863 learned_addr learned my addr 172.21.15.118:0/1139499863 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:06.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb40d400640 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.962+0000 7fb40ca00640 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b21fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb40de00640 1 -- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 msgr2=0x55e42b21fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb40de00640 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b21fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb40de00640 1 -- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 msgr2=0x55e42b21f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb40de00640 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb40de00640 1 -- 172.21.15.118:0/1139499863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42b21b180 con 0x55e42ae4f270 2024-09-21T06:09:06.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb40de00640 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b24c0d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb400000c00 tx=0x7fb400006fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ad207e47ad7c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb3f9200640 1 -- 172.21.15.118:0/1139499863 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400005dd0 con 0x55e42ae4f270 2024-09-21T06:09:06.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb3f9200640 1 -- 172.21.15.118:0/1139499863 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4000035f0 con 0x55e42ae4f270 2024-09-21T06:09:06.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.963+0000 7fb3f9200640 1 -- 172.21.15.118:0/1139499863 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400003af0 con 0x55e42ae4f270 2024-09-21T06:09:06.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 -- 172.21.15.118:0/1139499863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 msgr2=0x55e42b24c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b24c0d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb400000c00 tx=0x7fb400006fd0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 -- 172.21.15.118:0/1139499863 shutdown_connections 2024-09-21T06:09:06.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae4f270 0x55e42b24c0d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae2e590 0x55e42b21fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 --2- 172.21.15.118:0/1139499863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b21f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 -- 172.21.15.118:0/1139499863 >> 172.21.15.118:0/1139499863 conn(0x55e42ae433c0 msgr2=0x55e42b21a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 -- 172.21.15.118:0/1139499863 shutdown_connections 2024-09-21T06:09:06.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.964+0000 7fb416e9d740 1 -- 172.21.15.118:0/1139499863 wait complete. 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.965+0000 7fb416e9d740 1 -- start start 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.965+0000 7fb416e9d740 1 Processor -- start 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b2bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae2e590 0x55e42b2b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb416e9d740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae4f270 0x55e42b2bada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb416e9d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55e42b2352d0 con 0x55e42ae2e590 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e42b219250 con 0x55e42ae263b0 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb416e9d740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55e42b24df30 con 0x55e42ae4f270 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb416e9d740 10 client.0 _ll_register_callbacks cb 0x7fb400001600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae2e590 0x55e42b2b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae2e590 0x55e42b2b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44074/0 (socket says 172.21.15.118:44074) 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 -- 172.21.15.118:0/4244546168 learned_addr learned my addr 172.21.15.118:0/4244546168 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 -- 172.21.15.118:0/4244546168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae4f270 msgr2=0x55e42b2bada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae4f270 0x55e42b2bada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 -- 172.21.15.118:0/4244546168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 msgr2=0x55e42b2bece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b2bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.967+0000 7fb40ca00640 1 -- 172.21.15.118:0/4244546168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42ae00970 con 0x55e42ae2e590 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb40ca00640 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae2e590 0x55e42b2b4b30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4036040 tx=0x7fb3f40097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c7eac21aee7a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb3ee000640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb3ee000640 1 -- 172.21.15.118:0/4244546168 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4056020 con 0x55e42ae2e590 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb3ee000640 1 -- 172.21.15.118:0/4244546168 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fb3f4051420 con 0x55e42ae2e590 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4000035f0 con 0x55e42ae2e590 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb3ee000640 1 -- 172.21.15.118:0/4244546168 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb3f4060050 con 0x55e42ae2e590 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb416e9d740 10 client.6366 fetch_fsmap learned FSMap version 51 2024-09-21T06:09:06.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) -- 0x55e42b1f6650 con 0x55e42ae2e590 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.968+0000 7fb3ee000640 1 -- 172.21.15.118:0/4244546168 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4000035f0 con 0x55e42ae2e590 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb3ee000640 1 -- 172.21.15.118:0/4244546168 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) ==== 3502+0+0 (secure 0 0 0) 0x7fb3f4063020 con 0x55e42ae2e590 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb416e9d740 10 client.6366 fetch_fsmap finished waiting for FSMap version 51 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb416e9d740 10 client.6366 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb416e9d740 20 client.6366 populate_metadata read hostname 'smithi118' 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb416e9d740 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42b217930 0x55e42b2352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb416e9d740 4 client.6366 mds_command: new command op to 6249 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 --> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] -- command(tid 0: {"prefix": "status"}) -- 0x55e42b166fd0 con 0x55e42b217930 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb40d400640 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42b217930 0x55e42b2352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb3ee000640 10 client.6366 ms_handle_connect on v2:172.21.15.118:6833/1882776841 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.969+0000 7fb40d400640 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42b217930 0x55e42b2352d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954fc8ea7ce277fc server_cookie=2359f04e3df8081b in_seq=0 out_seq=0 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb3ee000640 1 -- 172.21.15.118:0/4244546168 <== mds.0 v2:172.21.15.118:6833/1882776841 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55e42b166fd0 con 0x55e42b217930 2024-09-21T06:09:06.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb3ee000640 10 client.6366 handle_command_reply: tid=0 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 client.6366 shutdown 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae2e590 msgr2=0x55e42b2b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae2e590 0x55e42b2b4b30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4036040 tx=0x7fb3f40097b0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 shutdown_connections 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e42ae4f270 0x55e42b2bada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:6833/1882776841,v1:172.21.15.118:6834/1882776841] conn(0x55e42b217930 0x55e42b2352d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e42ae2e590 0x55e42b2b4b30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 --2- 172.21.15.118:0/4244546168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e42ae263b0 0x55e42b2bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 >> 172.21.15.118:0/4244546168 conn(0x55e42ae433c0 msgr2=0x55e42b25dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb3ee000640 0 client.6366 ms_handle_reset on v2:172.21.15.118:6833/1882776841 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 shutdown_connections 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 1 -- 172.21.15.118:0/4244546168 wait complete. 2024-09-21T06:09:06.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.970+0000 7fb416e9d740 20 client.6366 trim_cache size 0 max 16384 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 6249, 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 7.0246673939999997, 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 51, 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 99, 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 99, 2024-09-21T06:09:06.977 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.953814381999999 2024-09-21T06:09:06.978 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:06.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb3e8078b90 msgr2=0x7fb3e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb3e8078b90 0x7fb3e807b0a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4035000 tx=0x7fb3f40046c0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 msgr2=0x7fb40813f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:06.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb40813f000 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001890 tx=0x7fb3fc001d50 comp rx=0 tx=0).stop 2024-09-21T06:09:06.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 shutdown_connections 2024-09-21T06:09:06.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb408158ef0 0x7fb408142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb3e8078b90 0x7fb3e807b0a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4080cc310 0x7fb408142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 --2- 172.21.15.118:0/1920139567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3f0004800 0x7fb40813f000 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:06.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 >> 172.21.15.118:0/1920139567 conn(0x7fb40806d110 msgr2=0x7fb408160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:06.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 shutdown_connections 2024-09-21T06:09:06.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:06.971+0000 7fb40fe00640 1 -- 172.21.15.118:0/1920139567 wait complete. 2024-09-21T06:09:06.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:09:07.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 -- 172.21.15.118:0/3152022759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c0d1330 msgr2=0x7f844c0d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:07.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 --2- 172.21.15.118:0/3152022759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c0d1330 0x7f844c0d1740 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8444005fd0 tx=0x7f844402aaa0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 -- 172.21.15.118:0/3152022759 shutdown_connections 2024-09-21T06:09:07.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 --2- 172.21.15.118:0/3152022759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c0d1330 0x7f844c0d1740 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 --2- 172.21.15.118:0/3152022759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f844c1634f0 0x7f844c0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 -- 172.21.15.118:0/3152022759 >> 172.21.15.118:0/3152022759 conn(0x7f844c06d1c0 msgr2=0x7f844c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:07.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 -- 172.21.15.118:0/3152022759 shutdown_connections 2024-09-21T06:09:07.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.216+0000 7f8452a00640 1 -- 172.21.15.118:0/3152022759 wait complete. 2024-09-21T06:09:07.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.218+0000 7f8452a00640 1 Processor -- start 2024-09-21T06:09:07.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.218+0000 7f8452a00640 1 -- start start 2024-09-21T06:09:07.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f844c0d1330 0x7f844c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:07.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f844c1634f0 0x7f844c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c163900 0x7f844c14ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f844c0d3aa0 con 0x7f844c163900 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f844c0d3920 con 0x7f844c0d1330 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f844c0d3c20 con 0x7f844c1634f0 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c163900 0x7f844c14ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c163900 0x7f844c14ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44080/0 (socket says 172.21.15.118:44080) 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 -- 172.21.15.118:0/4013779925 learned_addr learned my addr 172.21.15.118:0/4013779925 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8451600640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f844c0d1330 0x7f844c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:07.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8450c00640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f844c1634f0 0x7f844c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:07.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 -- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f844c1634f0 msgr2=0x7f844c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:07.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f844c1634f0 0x7f844c151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 -- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f844c0d1330 msgr2=0x7f844c15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:07.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f844c0d1330 0x7f844c15a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.220+0000 7f8452000640 1 -- 172.21.15.118:0/4013779925 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c159ec0 con 0x7f844c163900 2024-09-21T06:09:07.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.221+0000 7f8452000640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c163900 0x7f844c14ed10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8444006010 tx=0x7f8444003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:07.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.221+0000 7f8449600640 1 -- 172.21.15.118:0/4013779925 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444044070 con 0x7f844c163900 2024-09-21T06:09:07.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.221+0000 7f8449600640 1 -- 172.21.15.118:0/4013779925 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8444004040 con 0x7f844c163900 2024-09-21T06:09:07.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.221+0000 7f8449600640 1 -- 172.21.15.118:0/4013779925 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444004430 con 0x7f844c163900 2024-09-21T06:09:07.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.221+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844c15a1a0 con 0x7f844c163900 2024-09-21T06:09:07.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.221+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f844c15c770 con 0x7f844c163900 2024-09-21T06:09:07.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.222+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844c15a3e0 con 0x7f844c163900 2024-09-21T06:09:07.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.224+0000 7f8449600640 1 -- 172.21.15.118:0/4013779925 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8444047070 con 0x7f844c163900 2024-09-21T06:09:07.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.225+0000 7f8449600640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f842c078bc0 0x7f842c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:07.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.225+0000 7f8449600640 1 -- 172.21.15.118:0/4013779925 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f84440bbba0 con 0x7f844c163900 2024-09-21T06:09:07.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.225+0000 7f8451600640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f842c078bc0 0x7f842c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:07.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.226+0000 7f8451600640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f842c078bc0 0x7f842c07b0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8440009b30 tx=0x7f8440005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:07.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.229+0000 7f8449600640 1 -- 172.21.15.118:0/4013779925 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f844c15a3e0 con 0x7f844c163900 2024-09-21T06:09:07.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.455+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f844c15ac70 con 0x7f844c163900 2024-09-21T06:09:07.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.455+0000 7f8449600640 1 -- 172.21.15.118:0/4013779925 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) ==== 53+0+73 (secure 0 0 0) 0x7f8444032030 con 0x7f844c163900 2024-09-21T06:09:07.457 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:09:07.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.457+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f842c078bc0 msgr2=0x7f842c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:07.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.457+0000 7f8452a00640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f842c078bc0 0x7f842c07b0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8440009b30 tx=0x7f8440005f90 comp rx=0 tx=0).stop 2024-09-21T06:09:07.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.457+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c163900 msgr2=0x7f844c14ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:07.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.457+0000 7f8452a00640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c163900 0x7f844c14ed10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8444006010 tx=0x7f8444003ce0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 shutdown_connections 2024-09-21T06:09:07.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f844c163900 0x7f844c14ed10 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f842c078bc0 0x7f842c07b0d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f844c1634f0 0x7f844c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 --2- 172.21.15.118:0/4013779925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f844c0d1330 0x7f844c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:07.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 >> 172.21.15.118:0/4013779925 conn(0x7f844c06d1c0 msgr2=0x7f844c15e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:07.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 shutdown_connections 2024-09-21T06:09:07.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07.458+0000 7f8452a00640 1 -- 172.21.15.118:0/4013779925 wait complete. 2024-09-21T06:09:07.481 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:09:07.481 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:09:07.481 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:09:07.481 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:09:07.481 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:09:07.482 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:09:07.482 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:09:07.482 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:09:07.482 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:09:07.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:07.482 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:09:07.518 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:09:07.518 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:09:07.518 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:09:07.519 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42437sec preferred_lft 42437sec 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:09:07.520 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:09:07.521 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:07.521 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:09:07.521 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:09:07.521 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:09:07.521 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:07.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:07.521 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:09:07.612 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:09:07.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:07.615 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:09:07.651 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:09:07.651 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:09:07.651 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:09:07.651 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:09:07.651 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:09:07.652 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:09:07.652 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:09:07.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:09:07.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:09:07.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:09:07.652 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:09:07.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:09:07.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:09:07.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:07.849 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:09:07.887 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:09:07.887 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:09:07.887 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:09:07.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:07.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:09:07.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:09:07.991 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:09:08.027 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:09:08.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:09:08.027 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:09:08.103 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:09:08.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:08.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:09:08.297 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:09:08.297 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:09:08.336 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:09:08.336 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:09:08.336 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:09:08.336 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:09:08.336 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:09:08.338 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:09:08.338 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:09:08.338 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:09:08.338 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:09:08.338 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:09:08.341 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:09:08.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:08.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:09:08.399 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:09:08.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:09:08.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:09:08.499 INFO:teuthology.orchestra.run.smithi118.stdout:client6130 2024-09-21T06:09:08.500 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:08.500 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:08.535 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:09:08.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 -- 172.21.15.118:0/219037824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7400b3a60 msgr2=0x7fc7400cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:08.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 --2- 172.21.15.118:0/219037824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7400b3a60 0x7fc7400cca40 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc728005fd0 tx=0x7fc72802a4a0 comp rx=0 tx=0).stop 2024-09-21T06:09:08.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 -- 172.21.15.118:0/219037824 shutdown_connections 2024-09-21T06:09:08.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 --2- 172.21.15.118:0/219037824 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7400ccf80 0x7fc740073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:08.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 --2- 172.21.15.118:0/219037824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7400b3a60 0x7fc7400cca40 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:08.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 -- 172.21.15.118:0/219037824 >> 172.21.15.118:0/219037824 conn(0x7fc74006d110 msgr2=0x7fc74006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:08.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 -- 172.21.15.118:0/219037824 shutdown_connections 2024-09-21T06:09:08.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.794+0000 7fc747400640 1 -- 172.21.15.118:0/219037824 wait complete. 2024-09-21T06:09:08.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.797+0000 7fc747400640 1 Processor -- start 2024-09-21T06:09:08.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.797+0000 7fc747400640 1 -- start start 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc747400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7400b3a60 0x7fc7401444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc747400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7400ccf80 0x7fc7401e5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc747400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74015cfd0 0x7fc7401e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc747400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc740073cc0 con 0x7fc74015cfd0 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc747400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc740073b40 con 0x7fc7400ccf80 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc747400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc740073e40 con 0x7fc7400b3a60 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc745400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74015cfd0 0x7fc7401e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc745400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74015cfd0 0x7fc7401e5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44098/0 (socket says 172.21.15.118:44098) 2024-09-21T06:09:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.798+0000 7fc745400640 1 -- 172.21.15.118:0/2287517496 learned_addr learned my addr 172.21.15.118:0/2287517496 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:08.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc737e00640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7400ccf80 0x7fc7401e5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc744a00640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7400b3a60 0x7fc7401444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc745400640 1 -- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7400b3a60 msgr2=0x7fc7401444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc745400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7400b3a60 0x7fc7401444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc745400640 1 -- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7400ccf80 msgr2=0x7fc7401e5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc745400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7400ccf80 0x7fc7401e5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc745400640 1 -- 172.21.15.118:0/2287517496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7401e7870 con 0x7fc74015cfd0 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc744a00640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7400b3a60 0x7fc7401444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc745400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74015cfd0 0x7fc7401e5a40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc73800ca80 tx=0x7fc73800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc73d600640 1 -- 172.21.15.118:0/2287517496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738007d30 con 0x7fc74015cfd0 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc73d600640 1 -- 172.21.15.118:0/2287517496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc738004b20 con 0x7fc74015cfd0 2024-09-21T06:09:08.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc73d600640 1 -- 172.21.15.118:0/2287517496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738005020 con 0x7fc74015cfd0 2024-09-21T06:09:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7401e4740 con 0x7fc74015cfd0 2024-09-21T06:09:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.799+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7401e4d00 con 0x7fc74015cfd0 2024-09-21T06:09:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.800+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7400cca40 con 0x7fc74015cfd0 2024-09-21T06:09:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.802+0000 7fc73d600640 1 -- 172.21.15.118:0/2287517496 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7380051c0 con 0x7fc74015cfd0 2024-09-21T06:09:08.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.803+0000 7fc73d600640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc71c078bc0 0x7fc71c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:08.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.803+0000 7fc73d600640 1 -- 172.21.15.118:0/2287517496 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fc73809b710 con 0x7fc74015cfd0 2024-09-21T06:09:08.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.803+0000 7fc744a00640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc71c078bc0 0x7fc71c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:08.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.804+0000 7fc744a00640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc71c078bc0 0x7fc71c07b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a830 tx=0x7fc730008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:08.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:08.807+0000 7fc73d600640 1 -- 172.21.15.118:0/2287517496 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc738014070 con 0x7fc74015cfd0 2024-09-21T06:09:09.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.028+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7401e7600 con 0x7fc74015cfd0 2024-09-21T06:09:09.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.029+0000 7fc73d600640 1 -- 172.21.15.118:0/2287517496 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) ==== 53+0+73 (secure 0 0 0) 0x7fc738063bd0 con 0x7fc74015cfd0 2024-09-21T06:09:09.031 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:09:09.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc71c078bc0 msgr2=0x7fc71c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:09.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc71c078bc0 0x7fc71c07b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a830 tx=0x7fc730008040 comp rx=0 tx=0).stop 2024-09-21T06:09:09.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74015cfd0 msgr2=0x7fc7401e5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:09.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74015cfd0 0x7fc7401e5a40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc73800ca80 tx=0x7fc73800cf40 comp rx=0 tx=0).stop 2024-09-21T06:09:09.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 shutdown_connections 2024-09-21T06:09:09.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74015cfd0 0x7fc7401e5a40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:09.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7400ccf80 0x7fc7401e5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:09.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc71c078bc0 0x7fc71c07b0d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:09.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.031+0000 7fc747400640 1 --2- 172.21.15.118:0/2287517496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7400b3a60 0x7fc7401444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:09.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.032+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 >> 172.21.15.118:0/2287517496 conn(0x7fc74006d110 msgr2=0x7fc740145330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:09.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.032+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 shutdown_connections 2024-09-21T06:09:09.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:09.032+0000 7fc747400640 1 -- 172.21.15.118:0/2287517496 wait complete. 2024-09-21T06:09:09.055 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:09:09.056 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:09:09.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:09.056 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:09:09.096 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:09.097 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:09:09.098 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:09:09.099 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:09:09.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:09.101 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:09:09.200 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:09:09.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:09.203 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:09:09.241 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:09:09.241 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:09:09.241 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:09:09.241 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:09:09.241 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:09:09.241 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:09:09.242 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:09:09.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:09:09.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:09:09.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:09:09.242 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:09:09.361 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:09:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:09:09.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:09:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:09:09.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:09.440 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:09:09.475 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:09:09.475 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:09:09.476 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:09:09.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:09.476 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:09:09.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:09:09.572 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:09:09.607 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:09:09.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:09:09.607 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:09:09.681 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:09:09.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:09.682 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:09:09.875 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:09:09.875 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:09:09.907 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:09:09.908 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:09:09.908 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:09:09.908 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:09:09.908 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:09:09.909 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:09:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:09:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:09:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:09:09.909 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:09:09.912 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:09:09.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:09.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:09:09.967 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:09:10.046 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:09:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:09:10.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:09:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:09:10.057 INFO:teuthology.orchestra.run.smithi149.stdout:client6136 2024-09-21T06:09:10.057 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:09:10.058 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:10.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 -- 172.21.15.118:0/3111574100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc80b62c0 msgr2=0x7f7fc815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 --2- 172.21.15.118:0/3111574100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc80b62c0 0x7f7fc815d150 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0005fd0 tx=0x7f7fb002a540 comp rx=0 tx=0).stop 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 -- 172.21.15.118:0/3111574100 shutdown_connections 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 --2- 172.21.15.118:0/3111574100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc815d690 0x7f7fc815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 --2- 172.21.15.118:0/3111574100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc80b62c0 0x7f7fc815d150 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 -- 172.21.15.118:0/3111574100 >> 172.21.15.118:0/3111574100 conn(0x7f7fc806d6e0 msgr2=0x7f7fc80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 -- 172.21.15.118:0/3111574100 shutdown_connections 2024-09-21T06:09:10.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.315+0000 7f7fcde00640 1 -- 172.21.15.118:0/3111574100 wait complete. 2024-09-21T06:09:10.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.317+0000 7f7fcde00640 1 Processor -- start 2024-09-21T06:09:10.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.317+0000 7f7fcde00640 1 -- start start 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc81461d0 0x7f7fc81441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcde00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc815d690 0x7f7fc80c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc80c5d50 0x7f7fc80c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcde00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc815fa70 con 0x7f7fc815d690 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcde00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc815f8f0 con 0x7f7fc80c5d50 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcde00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc815fbf0 con 0x7f7fc81461d0 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fbfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc815d690 0x7f7fc80c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:10.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fbfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc815d690 0x7f7fc80c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44128/0 (socket says 172.21.15.118:44128) 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fbfe00640 1 -- 172.21.15.118:0/112876032 learned_addr learned my addr 172.21.15.118:0/112876032 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcca00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc81461d0 0x7f7fc81441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fcd400640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc80c5d50 0x7f7fc80c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fbfe00640 1 -- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc81461d0 msgr2=0x7f7fc81441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fbfe00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc81461d0 0x7f7fc81441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fbfe00640 1 -- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc80c5d50 msgr2=0x7f7fc80c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.319+0000 7f7fbfe00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc80c5d50 0x7f7fc80c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fbfe00640 1 -- 172.21.15.118:0/112876032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80c73b0 con 0x7f7fc815d690 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fcd400640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc80c5d50 0x7f7fc80c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:10.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fbfe00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc815d690 0x7f7fc80c5810 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0034040 tx=0x7f7fb00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:10.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fc5600640 1 -- 172.21.15.118:0/112876032 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb003e030 con 0x7f7fc815d690 2024-09-21T06:09:10.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fc5600640 1 -- 172.21.15.118:0/112876032 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fb0003db0 con 0x7f7fc815d690 2024-09-21T06:09:10.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc80c7690 con 0x7f7fc815d690 2024-09-21T06:09:10.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fc5600640 1 -- 172.21.15.118:0/112876032 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0035040 con 0x7f7fc815d690 2024-09-21T06:09:10.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.320+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc81e88e0 con 0x7f7fc815d690 2024-09-21T06:09:10.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.321+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc81600e0 con 0x7f7fc815d690 2024-09-21T06:09:10.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.322+0000 7f7fc5600640 1 -- 172.21.15.118:0/112876032 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fb0041030 con 0x7f7fc815d690 2024-09-21T06:09:10.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.323+0000 7f7fc5600640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7fa4078b90 0x7f7fa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.323+0000 7f7fc5600640 1 -- 172.21.15.118:0/112876032 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f7fb00bb390 con 0x7f7fc815d690 2024-09-21T06:09:10.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.324+0000 7f7fcca00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7fa4078b90 0x7f7fa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:10.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.324+0000 7f7fcca00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7fa4078b90 0x7f7fa407b0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8000f60 tx=0x7f7fb8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:10.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.328+0000 7f7fc5600640 1 -- 172.21.15.118:0/112876032 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7fb0083170 con 0x7f7fc815d690 2024-09-21T06:09:10.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.552+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fc8157250 con 0x7f7fc815d690 2024-09-21T06:09:10.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.553+0000 7f7fc5600640 1 -- 172.21.15.118:0/112876032 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7f7fb008a0c0 con 0x7f7fc815d690 2024-09-21T06:09:10.555 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:10.555 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:10.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.555+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7fa4078b90 msgr2=0x7f7fa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:10.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.555+0000 7f7fcde00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7fa4078b90 0x7f7fa407b0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8000f60 tx=0x7f7fb8009040 comp rx=0 tx=0).stop 2024-09-21T06:09:10.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.555+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc815d690 msgr2=0x7f7fc80c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:10.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.555+0000 7f7fcde00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc815d690 0x7f7fc80c5810 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0034040 tx=0x7f7fb00038a0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 shutdown_connections 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fc80c5d50 0x7f7fc80c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fc815d690 0x7f7fc80c5810 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7fa4078b90 0x7f7fa407b0a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 --2- 172.21.15.118:0/112876032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fc81461d0 0x7f7fc81441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 >> 172.21.15.118:0/112876032 conn(0x7f7fc806d6e0 msgr2=0x7f7fc8074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 shutdown_connections 2024-09-21T06:09:10.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:10.556+0000 7f7fcde00640 1 -- 172.21.15.118:0/112876032 wait complete. 2024-09-21T06:09:10.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:09:10.824 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":6249,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.858812104,"mdsmap_epoch":51,"osdmap_epoch":99,"osdmap_epoch_barrier":99,"uptime":15.787962146} 2024-09-21T06:09:10.825 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 6249, "mdsmap_epoch": 51, "osdmap_epoch": 99, "osdmap_epoch_barrier": 99, "rank_uptime": 10.858812104, "state": "up:active", "uptime": 15.787962146, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:09:10.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:09:11.060 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:09:11.060 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:09:11.060 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-21T06:09:11.061 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:11.061 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:11.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:11.097 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-21T06:09:13.153 INFO:teuthology.orchestra.run.smithi118.stderr:265+0 records in 2024-09-21T06:09:13.154 INFO:teuthology.orchestra.run.smithi118.stderr:265+0 records out 2024-09-21T06:09:13.154 INFO:teuthology.orchestra.run.smithi118.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.97801 s, 140 MB/s 2024-09-21T06:09:13.155 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:13.155 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:13.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:13.190 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-21T06:09:15.329 INFO:teuthology.orchestra.run.smithi118.stderr:292+0 records in 2024-09-21T06:09:15.330 INFO:teuthology.orchestra.run.smithi118.stderr:292+0 records out 2024-09-21T06:09:15.330 INFO:teuthology.orchestra.run.smithi118.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.06268 s, 148 MB/s 2024-09-21T06:09:15.331 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-21T06:09:15.331 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:09:15.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.551+0000 7fa717000640 1 -- 172.21.15.118:0/749731785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 msgr2=0x7fa7101448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:15.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.551+0000 7fa717000640 1 --2- 172.21.15.118:0/749731785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa7101448a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa7100cd690 tx=0x7fa70002a560 comp rx=0 tx=0).stop 2024-09-21T06:09:15.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.551+0000 7fa717000640 1 -- 172.21.15.118:0/749731785 shutdown_connections 2024-09-21T06:09:15.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.551+0000 7fa717000640 1 --2- 172.21.15.118:0/749731785 >> v2:172.21.15.149:3300/0 conn(0x7fa71015fa00 0x7fa71015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.551+0000 7fa717000640 1 --2- 172.21.15.118:0/749731785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa7101448a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.551+0000 7fa717000640 1 -- 172.21.15.118:0/749731785 >> 172.21.15.118:0/749731785 conn(0x7fa71006d110 msgr2=0x7fa71006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:15.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.551+0000 7fa717000640 1 -- 172.21.15.118:0/749731785 shutdown_connections 2024-09-21T06:09:15.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.552+0000 7fa717000640 1 -- 172.21.15.118:0/749731785 wait complete. 2024-09-21T06:09:15.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.554+0000 7fa717000640 1 Processor -- start 2024-09-21T06:09:15.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.554+0000 7fa717000640 1 -- start start 2024-09-21T06:09:15.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.555+0000 7fa717000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa710140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:15.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.555+0000 7fa717000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7100d0ec0 0x7fa7100c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:15.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.555+0000 7fa717000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa71015fa00 0x7fa7100cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:15.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.555+0000 7fa717000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa710073ea0 con 0x7fa7100ce0c0 2024-09-21T06:09:15.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.555+0000 7fa717000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa710073d20 con 0x7fa7100d0ec0 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.555+0000 7fa717000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa710074020 con 0x7fa71015fa00 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa710140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa710140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44150/0 (socket says 172.21.15.118:44150) 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 -- 172.21.15.118:0/3025222840 learned_addr learned my addr 172.21.15.118:0/3025222840 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70f400640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7100d0ec0 0x7fa7100c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa715000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa71015fa00 0x7fa7100cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 -- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa71015fa00 msgr2=0x7fa7100cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa71015fa00 0x7fa7100cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 -- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7100d0ec0 msgr2=0x7fa7100c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7100d0ec0 0x7fa7100c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 -- 172.21.15.118:0/3025222840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7100cb350 con 0x7fa7100ce0c0 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa715000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa71015fa00 0x7fa7100cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.556+0000 7fa70fe00640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa710140380 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa700034040 tx=0x7fa700003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:15.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.557+0000 7fa707e00640 1 -- 172.21.15.118:0/3025222840 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70003e030 con 0x7fa7100ce0c0 2024-09-21T06:09:15.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.557+0000 7fa707e00640 1 -- 172.21.15.118:0/3025222840 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa700003d10 con 0x7fa7100ce0c0 2024-09-21T06:09:15.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.557+0000 7fa707e00640 1 -- 172.21.15.118:0/3025222840 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700035040 con 0x7fa7100ce0c0 2024-09-21T06:09:15.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.557+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7100cb630 con 0x7fa7100ce0c0 2024-09-21T06:09:15.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.557+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7100cbbf0 con 0x7fa7100ce0c0 2024-09-21T06:09:15.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.558+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa710074540 con 0x7fa7100ce0c0 2024-09-21T06:09:15.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.559+0000 7fa707e00640 1 -- 172.21.15.118:0/3025222840 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa700041030 con 0x7fa7100ce0c0 2024-09-21T06:09:15.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.560+0000 7fa707e00640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6f0078b90 0x7fa6f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:15.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.560+0000 7fa707e00640 1 -- 172.21.15.118:0/3025222840 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fa7000bb460 con 0x7fa7100ce0c0 2024-09-21T06:09:15.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.561+0000 7fa70f400640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6f0078b90 0x7fa6f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:15.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.561+0000 7fa70f400640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6f0078b90 0x7fa6f007b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7100cb090 tx=0x7fa6fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:15.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.565+0000 7fa707e00640 1 -- 172.21.15.118:0/3025222840 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa700083240 con 0x7fa7100ce0c0 2024-09-21T06:09:15.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.749+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa7100b35a0 con 0x7fa7100ce0c0 2024-09-21T06:09:15.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.751+0000 7fa707e00640 1 -- 172.21.15.118:0/3025222840 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v99) ==== 81+0+34323 (secure 0 0 0) 0x7fa700087c70 con 0x7fa7100ce0c0 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 99, 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:09:00.945016+0000", 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:09:15.753 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 13, 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:09:15.754 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:15.755 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:15.756 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "90", 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:15.757 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:15.758 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:15.759 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:09:15.760 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 12, 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:09:15.761 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:57.351669+0000", 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:15.762 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "98", 2024-09-21T06:09:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:15.764 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:15.765 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:09:15.766 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:15.767 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 13, 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:58.408649+0000", 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:15.768 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:09:15.769 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "99", 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:15.770 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:15.771 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:15.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:15.774 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.775 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.776 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.777 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.778 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.779 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.780 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:09:15.781 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:09:15.782 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:09:15.783 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:09:15.784 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.785 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.786 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.787 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:09:15.788 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.789 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.791 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.792 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.794 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.795 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.796 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.797 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.798 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.799 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.800 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.802 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.803 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.804 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.806 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.809 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.810 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.811 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:15.814 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.815 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.816 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.817 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:15.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:09:15.820 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.821 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.823 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:09:15.824 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:15.825 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:15.826 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:09:15.827 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:09:15.828 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:09:15.829 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:09:15.829 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:09:15.829 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:09:15.829 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:15.829 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:15.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6f0078b90 msgr2=0x7fa6f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:15.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6f0078b90 0x7fa6f007b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7100cb090 tx=0x7fa6fc009040 comp rx=0 tx=0).stop 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 msgr2=0x7fa710140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa710140380 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa700034040 tx=0x7fa700003820 comp rx=0 tx=0).stop 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 shutdown_connections 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa6f0078b90 0x7fa6f007b0a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa71015fa00 0x7fa7100cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7100d0ec0 0x7fa7100c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 --2- 172.21.15.118:0/3025222840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7100ce0c0 0x7fa710140380 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 >> 172.21.15.118:0/3025222840 conn(0x7fa71006d110 msgr2=0x7fa710143740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 shutdown_connections 2024-09-21T06:09:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:15.753+0000 7fa717000640 1 -- 172.21.15.118:0/3025222840 wait complete. 2024-09-21T06:09:15.832 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:09:17.378 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:09:17.377+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-21T06:09:19.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:19.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:20.833 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 -- 172.21.15.118:0/1682910240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 msgr2=0x7f76840b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 --2- 172.21.15.118:0/1682910240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f76840b1870 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7670005fd0 tx=0x7f767002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 -- 172.21.15.118:0/1682910240 shutdown_connections 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 --2- 172.21.15.118:0/1682910240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f76840b1870 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 --2- 172.21.15.118:0/1682910240 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76840d2b20 0x7f76840d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 -- 172.21.15.118:0/1682910240 >> 172.21.15.118:0/1682910240 conn(0x7f76840d1780 msgr2=0x7f76840d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 -- 172.21.15.118:0/1682910240 shutdown_connections 2024-09-21T06:09:21.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.062+0000 7f7688e00640 1 -- 172.21.15.118:0/1682910240 wait complete. 2024-09-21T06:09:21.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.064+0000 7f7688e00640 1 Processor -- start 2024-09-21T06:09:21.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.064+0000 7f7688e00640 1 -- start start 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7688e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76840b1db0 0x7f768415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7688e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76840d2b20 0x7f7684162900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7688e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f768415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7688e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f76840d2630 con 0x7f76840d3870 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7688e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76840d24b0 con 0x7f76840b1db0 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7688e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76840ba450 con 0x7f76840d2b20 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7682800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f768415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7682800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f768415b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56214/0 (socket says 172.21.15.118:56214) 2024-09-21T06:09:21.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7682800640 1 -- 172.21.15.118:0/1260334032 learned_addr learned my addr 172.21.15.118:0/1260334032 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:21.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7681400640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76840d2b20 0x7f7684162900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.066+0000 7f7681e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76840b1db0 0x7f768415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7682800640 1 -- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76840d2b20 msgr2=0x7f7684162900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7682800640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76840d2b20 0x7f7684162900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7682800640 1 -- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76840b1db0 msgr2=0x7f768415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7682800640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76840b1db0 0x7f768415ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7682800640 1 -- 172.21.15.118:0/1260334032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768414f030 con 0x7f76840d3870 2024-09-21T06:09:21.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7682800640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f768415b340 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c730 tx=0x7f767c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:21.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c003b70 con 0x7f76840d3870 2024-09-21T06:09:21.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f767c003d10 con 0x7f76840d3870 2024-09-21T06:09:21.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7684162e40 con 0x7f76840d3870 2024-09-21T06:09:21.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c005330 con 0x7f76840d3870 2024-09-21T06:09:21.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.067+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7684161e20 con 0x7f76840d3870 2024-09-21T06:09:21.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.068+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76840b2380 con 0x7f76840d3870 2024-09-21T06:09:21.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.070+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f767c0054d0 con 0x7f76840d3870 2024-09-21T06:09:21.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.071+0000 7f767a000640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7664078b90 0x7f766407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.071+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f767c09aab0 con 0x7f76840d3870 2024-09-21T06:09:21.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.071+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=103}) -- 0x7f7664080770 con 0x7f76840d3870 2024-09-21T06:09:21.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.071+0000 7f7681e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7664078b90 0x7f766407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.072+0000 7f7681e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7664078b90 0x7f766407b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7674005fd0 tx=0x7f767400a250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:21.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.075+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f768414f030 con 0x7f76840d3870 2024-09-21T06:09:21.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.260+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f76840b5f10 con 0x7f76840d3870 2024-09-21T06:09:21.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.262+0000 7f767a000640 1 -- 172.21.15.118:0/1260334032 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) ==== 81+0+34494 (secure 0 0 0) 0x7f767c062800 con 0x7f76840d3870 2024-09-21T06:09:21.263 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 102, 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:09:19.438055+0000", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:09:21.264 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 13, 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:09:21.265 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:21.266 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:21.267 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:21.268 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:21.269 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:21.270 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:09:21.271 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 12, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:57.351669+0000", 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:21.272 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:09:21.273 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:21.274 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:21.275 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:21.276 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:09:21.278 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:21.279 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 13, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:58.408649+0000", 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:21.280 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:21.281 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:21.282 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:21.283 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:21.284 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.285 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:09:21.286 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.287 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.288 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.289 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.290 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:09:21.291 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.292 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.293 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.294 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.295 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.296 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.297 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.298 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.299 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:09:21.301 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:09:21.302 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.303 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.304 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.305 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.306 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.308 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:09:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.312 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.313 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.314 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:09:21.315 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:09:21.326 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:09:21.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.329 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:21.330 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.333 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.334 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:09:21.337 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7664078b90 msgr2=0x7f766407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7664078b90 0x7f766407b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7674005fd0 tx=0x7f767400a250 comp rx=0 tx=0).stop 2024-09-21T06:09:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 msgr2=0x7f768415b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f768415b340 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c730 tx=0x7f767c00cb30 comp rx=0 tx=0).stop 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 shutdown_connections 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76840d3870 0x7f768415b340 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7664078b90 0x7f766407b0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76840d2b20 0x7f7684162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 --2- 172.21.15.118:0/1260334032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76840b1db0 0x7f768415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 >> 172.21.15.118:0/1260334032 conn(0x7f76840d1780 msgr2=0x7f768415f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 shutdown_connections 2024-09-21T06:09:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.264+0000 7f7688e00640 1 -- 172.21.15.118:0/1260334032 wait complete. 2024-09-21T06:09:21.342 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T06:09:21.342 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:21.342 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:21.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:21.378 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-21T06:09:21.771 INFO:teuthology.orchestra.run.smithi118.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-21T06:09:21.772 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:09:21.772 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:09:21.772 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.308095 s, 170 MB/s 2024-09-21T06:09:21.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:21.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:09:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 -- 172.21.15.118:0/951813634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fae0 msgr2=0x7f71e40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 --2- 172.21.15.118:0/951813634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fae0 0x7f71e40d0e80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f71e40ce7c0 tx=0x7f71d802a560 comp rx=0 tx=0).stop 2024-09-21T06:09:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 -- 172.21.15.118:0/951813634 shutdown_connections 2024-09-21T06:09:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 --2- 172.21.15.118:0/951813634 >> v2:172.21.15.149:3300/0 conn(0x7f71e4142e40 0x7f71e40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 --2- 172.21.15.118:0/951813634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fae0 0x7f71e40d0e80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 -- 172.21.15.118:0/951813634 >> 172.21.15.118:0/951813634 conn(0x7f71e406d110 msgr2=0x7f71e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:21.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 -- 172.21.15.118:0/951813634 shutdown_connections 2024-09-21T06:09:21.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.992+0000 7f71ec000640 1 -- 172.21.15.118:0/951813634 wait complete. 2024-09-21T06:09:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.995+0000 7f71ec000640 1 Processor -- start 2024-09-21T06:09:21.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.995+0000 7f71ec000640 1 -- start start 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71ec000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71e413fae0 0x7f71e40cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71ec000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fef0 0x7f71e413ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71ec000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71e4142e40 0x7f71e413dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71ec000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40cfa70 con 0x7f71e413fef0 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71ec000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40cf8f0 con 0x7f71e413fae0 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71ec000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71e40cfbf0 con 0x7f71e4142e40 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71e8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fef0 0x7f71e413ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.996+0000 7f71e8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fef0 0x7f71e413ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56228/0 (socket says 172.21.15.118:56228) 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71e413fae0 0x7f71e40cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e8c00640 1 -- 172.21.15.118:0/2216508533 learned_addr learned my addr 172.21.15.118:0/2216508533 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71ea000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71e4142e40 0x7f71e413dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e8c00640 1 -- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71e4142e40 msgr2=0x7f71e413dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e8c00640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71e4142e40 0x7f71e413dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e8c00640 1 -- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71e413fae0 msgr2=0x7f71e40cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e8c00640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71e413fae0 0x7f71e40cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e8c00640 1 -- 172.21.15.118:0/2216508533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e4158790 con 0x7f71e413fef0 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71ea000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71e4142e40 0x7f71e413dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e8c00640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fef0 0x7f71e413ee00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c400 tx=0x7f71d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0017070 con 0x7f71e413fef0 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.997+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71d00053c0 con 0x7f71e413fef0 2024-09-21T06:09:22.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.998+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e413d200 con 0x7f71e413fef0 2024-09-21T06:09:22.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.998+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0003850 con 0x7f71e413fef0 2024-09-21T06:09:22.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.998+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e4157f70 con 0x7f71e413fef0 2024-09-21T06:09:22.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:21.999+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e4157ce0 con 0x7f71e413fef0 2024-09-21T06:09:22.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.000+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71d001a070 con 0x7f71e413fef0 2024-09-21T06:09:22.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.001+0000 7f71e1600640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71c4078b90 0x7f71c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:22.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.001+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f71d009a100 con 0x7f71e413fef0 2024-09-21T06:09:22.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.001+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=103}) -- 0x7f71c4080770 con 0x7f71e413fef0 2024-09-21T06:09:22.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.001+0000 7f71e9600640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71c4078b90 0x7f71c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:22.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.002+0000 7f71e9600640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71c4078b90 0x7f71c407b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71d8033000 tx=0x7f71d8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:22.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.006+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71d0061ee0 con 0x7f71e413fef0 2024-09-21T06:09:22.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.190+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f71e40d0110 con 0x7f71e413fef0 2024-09-21T06:09:22.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.192+0000 7f71e1600640 1 -- 172.21.15.118:0/2216508533 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) ==== 81+0+34494 (secure 0 0 0) 0x7f71d0066910 con 0x7f71e413fef0 2024-09-21T06:09:22.194 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:22.194 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:22.194 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 102, 2024-09-21T06:09:22.194 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:22.194 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:09:22.194 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:09:19.438055+0000", 2024-09-21T06:09:22.194 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:09:22.195 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 13, 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:22.196 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:09:22.197 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:22.198 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:22.199 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:22.200 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:22.201 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:09:22.202 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 12, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:57.351669+0000", 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:22.203 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:09:22.204 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:22.205 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:22.206 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:22.207 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:09:22.208 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:22.209 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 13, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:58.408649+0000", 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:22.210 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:09:22.211 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:22.212 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:22.213 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:22.214 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:22.215 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:22.216 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.217 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.218 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.219 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.220 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.222 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.223 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.224 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.225 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.226 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:09:22.227 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.228 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.229 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:09:22.230 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.231 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.233 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.234 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:09:22.235 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:09:22.236 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.237 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.238 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.239 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.240 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:09:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:09:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:09:22.244 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.245 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.246 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.247 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.249 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.250 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.251 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.252 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.253 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.254 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.255 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:09:22.256 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.257 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:22.258 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.259 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.260 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:22.262 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.263 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.264 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.265 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:22.266 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.267 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:22.268 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:09:22.269 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:09:22.270 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:22.271 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71c4078b90 msgr2=0x7f71c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71c4078b90 0x7f71c407b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71d8033000 tx=0x7f71d8004730 comp rx=0 tx=0).stop 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fef0 msgr2=0x7f71e413ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fef0 0x7f71e413ee00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c400 tx=0x7f71d000c8c0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 shutdown_connections 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f71c4078b90 0x7f71c407b0a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71e4142e40 0x7f71e413dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e413fef0 0x7f71e413ee00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 --2- 172.21.15.118:0/2216508533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71e413fae0 0x7f71e40cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 >> 172.21.15.118:0/2216508533 conn(0x7f71e406d110 msgr2=0x7f71e4153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:22.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 shutdown_connections 2024-09-21T06:09:22.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.194+0000 7f71ec000640 1 -- 172.21.15.118:0/2216508533 wait complete. 2024-09-21T06:09:22.274 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:22.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.495+0000 7f54fd800640 1 -- 172.21.15.118:0/2088635909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 msgr2=0x7f54dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.495+0000 7f54fd800640 1 --2- 172.21.15.118:0/2088635909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 0x7f54dc00b9c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f54f0005fd0 tx=0x7f54dc005830 comp rx=0 tx=0).stop 2024-09-21T06:09:22.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.495+0000 7f54fce00640 1 -- 172.21.15.118:0/2088635909 reap_dead start 2024-09-21T06:09:22.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.495+0000 7f54fd800640 1 -- 172.21.15.118:0/2088635909 shutdown_connections 2024-09-21T06:09:22.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.495+0000 7f54fd800640 1 -- 172.21.15.118:0/2088635909 >> 172.21.15.118:0/2088635909 conn(0x7f54f806d6e0 msgr2=0x7f54f80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:22.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.495+0000 7f54fd800640 1 -- 172.21.15.118:0/2088635909 shutdown_connections 2024-09-21T06:09:22.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.495+0000 7f54fd800640 1 -- 172.21.15.118:0/2088635909 wait complete. 2024-09-21T06:09:22.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.497+0000 7f54fd800640 1 Processor -- start 2024-09-21T06:09:22.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.497+0000 7f54fd800640 1 -- start start 2024-09-21T06:09:22.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fd800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 0x7f54f815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:22.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fd800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f81f3610 0x7f54f81f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f81f3f60 0x7f54f81f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fd800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f54f80d0240 con 0x7f54dc005270 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fd800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54f80b6530 con 0x7f54f81f3f60 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fd800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f54f80d03c0 con 0x7f54f81f3610 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 0x7f54f815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 0x7f54f815a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56236/0 (socket says 172.21.15.118:56236) 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 -- 172.21.15.118:0/456245318 learned_addr learned my addr 172.21.15.118:0/456245318 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54ef400640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f81f3610 0x7f54f81f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fce00640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f81f3f60 0x7f54f81f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 -- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f81f3610 msgr2=0x7f54f81f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f81f3610 0x7f54f81f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 -- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f81f3f60 msgr2=0x7f54f81f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f81f3f60 0x7f54f81f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54f7e00640 1 -- 172.21.15.118:0/456245318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f8141760 con 0x7f54dc005270 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54ef400640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f81f3610 0x7f54f81f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.499+0000 7f54fce00640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f81f3f60 0x7f54f81f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.500+0000 7f54f7e00640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 0x7f54f815a600 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f54e80066b0 tx=0x7f54e80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.500+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8015070 con 0x7f54dc005270 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.500+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54e8011900 con 0x7f54dc005270 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.500+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8011d50 con 0x7f54dc005270 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.500+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f81427a0 con 0x7f54dc005270 2024-09-21T06:09:22.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.500+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f8141cc0 con 0x7f54dc005270 2024-09-21T06:09:22.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.501+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f80749f0 con 0x7f54dc005270 2024-09-21T06:09:22.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.502+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54e8010420 con 0x7f54dc005270 2024-09-21T06:09:22.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.503+0000 7f54f4c00640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54d4078bc0 0x7f54d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:22.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.503+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f54e809bae0 con 0x7f54dc005270 2024-09-21T06:09:22.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.504+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=103}) -- 0x7f54d4080740 con 0x7f54dc005270 2024-09-21T06:09:22.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.504+0000 7f54ef400640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54d4078bc0 0x7f54d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:22.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.505+0000 7f54ef400640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54d4078bc0 0x7f54d407b0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f54f80ccc00 tx=0x7f54e0006b70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:22.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.508+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f54f8141760 con 0x7f54dc005270 2024-09-21T06:09:22.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.731+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54f81e6710 con 0x7f54dc005270 2024-09-21T06:09:22.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.732+0000 7f54f4c00640 1 -- 172.21.15.118:0/456245318 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7f54e8063f20 con 0x7f54dc005270 2024-09-21T06:09:22.733 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:22.734 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:22.734 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:22.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54d4078bc0 msgr2=0x7f54d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54d4078bc0 0x7f54d407b0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f54f80ccc00 tx=0x7f54e0006b70 comp rx=0 tx=0).stop 2024-09-21T06:09:22.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 msgr2=0x7f54f815a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:22.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 0x7f54f815a600 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f54e80066b0 tx=0x7f54e80039c0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 shutdown_connections 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f81f3f60 0x7f54f81f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54d4078bc0 0x7f54d407b0d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f81f3610 0x7f54f81f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 --2- 172.21.15.118:0/456245318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54dc005270 0x7f54f815a600 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.734+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 >> 172.21.15.118:0/456245318 conn(0x7f54f806d6e0 msgr2=0x7f54f81455f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.735+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 shutdown_connections 2024-09-21T06:09:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:22.735+0000 7f54fd800640 1 -- 172.21.15.118:0/456245318 wait complete. 2024-09-21T06:09:22.757 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:09:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":6249,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.034377695,"mdsmap_epoch":51,"osdmap_epoch":102,"osdmap_epoch_barrier":102,"uptime":27.963525964999999} 2024-09-21T06:09:22.999 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 6249, "mdsmap_epoch": 51, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "rank_uptime": 23.034377695, "state": "up:active", "uptime": 27.963525965, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:09:22.999 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:09:22.999 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:22.999 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:23.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:23.035 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-21T06:09:23.111 INFO:teuthology.orchestra.run.smithi118.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-21T06:09:23.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:23.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:23.112 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-21T06:09:23.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:23.191 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-21T06:09:23.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:09:23.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.563+0000 7f07b0a00640 1 -- 172.21.15.118:0/2265996710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 msgr2=0x7f0790003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:23.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.563+0000 7f07b0a00640 1 --2- 172.21.15.118:0/2265996710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 0x7f0790003e70 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f079c009b50 tx=0x7f0790005830 comp rx=0 tx=0).stop 2024-09-21T06:09:23.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.563+0000 7f07ab200640 1 -- 172.21.15.118:0/2265996710 reap_dead start 2024-09-21T06:09:23.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.564+0000 7f07b0a00640 1 -- 172.21.15.118:0/2265996710 shutdown_connections 2024-09-21T06:09:23.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.564+0000 7f07b0a00640 1 -- 172.21.15.118:0/2265996710 >> 172.21.15.118:0/2265996710 conn(0x7f07ac06d6e0 msgr2=0x7f07ac0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:23.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.564+0000 7f07b0a00640 1 -- 172.21.15.118:0/2265996710 shutdown_connections 2024-09-21T06:09:23.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.564+0000 7f07b0a00640 1 -- 172.21.15.118:0/2265996710 wait complete. 2024-09-21T06:09:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.566+0000 7f07b0a00640 1 Processor -- start 2024-09-21T06:09:23.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.566+0000 7f07b0a00640 1 -- start start 2024-09-21T06:09:23.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.567+0000 7f07b0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 0x7f07ac15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:23.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.567+0000 7f07b0a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac15b180 0x7f07ac1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.567+0000 7f07b0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ac0b0bf0 0x7f07ac0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.567+0000 7f07b0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac144760 con 0x7f0790003a00 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.567+0000 7f07b0a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac0b5410 con 0x7f07ac15b180 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.567+0000 7f07b0a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f07ac1448e0 con 0x7f07ac0b0bf0 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 0x7f07ac15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 0x7f07ac15c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56266/0 (socket says 172.21.15.118:56266) 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 -- 172.21.15.118:0/1328870051 learned_addr learned my addr 172.21.15.118:0/1328870051 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07a3e00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac15b180 0x7f07ac1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07ab200640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ac0b0bf0 0x7f07ac0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 -- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ac0b0bf0 msgr2=0x7f07ac0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ac0b0bf0 0x7f07ac0b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:23.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 -- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac15b180 msgr2=0x7f07ac1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:23.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac15b180 0x7f07ac1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:23.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 -- 172.21.15.118:0/1328870051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac0b1540 con 0x7f0790003a00 2024-09-21T06:09:23.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07a3e00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac15b180 0x7f07ac1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:23.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.568+0000 7f07aa800640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 0x7f07ac15c6f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f079c036040 tx=0x7f079c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:23.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.569+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c038050 con 0x7f0790003a00 2024-09-21T06:09:23.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.569+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f079c039040 con 0x7f0790003a00 2024-09-21T06:09:23.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.569+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c033c50 con 0x7f0790003a00 2024-09-21T06:09:23.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.569+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ac13a680 con 0x7f0790003a00 2024-09-21T06:09:23.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.569+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ac1f67e0 con 0x7f0790003a00 2024-09-21T06:09:23.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.570+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ac0cf1c0 con 0x7f0790003a00 2024-09-21T06:09:23.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.571+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f079c046020 con 0x7f0790003a00 2024-09-21T06:09:23.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.572+0000 7f07a2a00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0788078b90 0x7f078807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:23.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.572+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f079c0bb810 con 0x7f0790003a00 2024-09-21T06:09:23.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.572+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=103}) -- 0x7f0788080710 con 0x7f0790003a00 2024-09-21T06:09:23.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.572+0000 7f07a3e00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0788078b90 0x7f078807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:23.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.573+0000 7f07a3e00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0788078b90 0x7f078807b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07ac138940 tx=0x7f0794005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:23.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.577+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f079c08a070 con 0x7f0790003a00 2024-09-21T06:09:23.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.762+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f07ac1f69b0 con 0x7f0790003a00 2024-09-21T06:09:23.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.764+0000 7f07a2a00640 1 -- 172.21.15.118:0/1328870051 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) ==== 81+0+34494 (secure 0 0 0) 0x7f079c04d020 con 0x7f0790003a00 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 102, 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:09:19.438055+0000", 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:09:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 13, 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:09:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:09:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:23.772 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.773 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 12, 2024-09-21T06:09:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:57.351669+0000", 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:23.775 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:23.776 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:23.777 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:23.778 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:23.779 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:09:23.780 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 13, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:58.408649+0000", 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:23.781 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:09:23.782 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:23.783 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:23.784 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:23.785 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:09:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.787 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.788 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.789 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.790 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.791 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.792 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:23.793 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.794 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.796 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.797 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.798 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.799 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.800 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:09:23.802 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.803 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.804 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.805 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.806 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.807 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.808 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.809 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.810 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.811 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.812 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.813 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:09:23.814 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:09:23.815 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.816 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.817 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.818 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:09:23.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:09:23.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:09:23.821 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.822 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.823 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.824 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:09:23.825 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:09:23.826 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:23.827 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.828 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.829 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.830 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:23.832 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.833 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:23.834 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.835 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.836 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.836 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:09:23.836 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.836 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.836 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.836 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:23.837 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.837 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.837 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.837 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.837 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.837 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:09:23.837 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.838 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.839 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.840 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:23.841 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:23.842 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:23.842 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:09:23.842 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:23.842 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.842 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:23.842 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:09:23.842 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:09:23.843 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:09:23.844 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:09:23.845 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:09:23.845 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:23.845 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.766+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0788078b90 msgr2=0x7f078807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.766+0000 7f07b0a00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0788078b90 0x7f078807b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07ac138940 tx=0x7f0794005f90 comp rx=0 tx=0).stop 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.766+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 msgr2=0x7f07ac15c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.766+0000 7f07b0a00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 0x7f07ac15c6f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f079c036040 tx=0x7f079c033670 comp rx=0 tx=0).stop 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 shutdown_connections 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0788078b90 0x7f078807b0a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07ac0b0bf0 0x7f07ac0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:23.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac15b180 0x7f07ac1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:23.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 --2- 172.21.15.118:0/1328870051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0790003a00 0x7f07ac15c6f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:23.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 >> 172.21.15.118:0/1328870051 conn(0x7f07ac06d6e0 msgr2=0x7f07ac0b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:23.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 shutdown_connections 2024-09-21T06:09:23.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:23.767+0000 7f07b0a00640 1 -- 172.21.15.118:0/1328870051 wait complete. 2024-09-21T06:09:23.849 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:09:24.463 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:09:24.462+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-21T06:09:28.850 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:09:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.078+0000 7fae17200640 1 -- 172.21.15.118:0/698061812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4004800 msgr2=0x7fadf4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.078+0000 7fae17200640 1 --2- 172.21.15.118:0/698061812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4004800 0x7fadf4004c10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fadf80016c0 tx=0x7fadf4005830 comp rx=0 tx=0).stop 2024-09-21T06:09:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.078+0000 7fae17200640 1 -- 172.21.15.118:0/698061812 shutdown_connections 2024-09-21T06:09:29.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.078+0000 7fae17200640 1 --2- 172.21.15.118:0/698061812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4004800 0x7fadf4004c10 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.078+0000 7fae17200640 1 -- 172.21.15.118:0/698061812 >> 172.21.15.118:0/698061812 conn(0x7fae1006d110 msgr2=0x7fae1006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.078+0000 7fae17200640 1 -- 172.21.15.118:0/698061812 shutdown_connections 2024-09-21T06:09:29.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.078+0000 7fae17200640 1 -- 172.21.15.118:0/698061812 wait complete. 2024-09-21T06:09:29.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.081+0000 7fae17200640 1 Processor -- start 2024-09-21T06:09:29.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.081+0000 7fae17200640 1 -- start start 2024-09-21T06:09:29.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.082+0000 7fae17200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf4004800 0x7fae100cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:29.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.082+0000 7fae17200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae10158580 0x7fae101f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:29.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.082+0000 7fae17200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae10158990 0x7fae10072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:29.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.082+0000 7fae17200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fae100d16a0 con 0x7fae10158990 2024-09-21T06:09:29.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.082+0000 7fae17200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fae10142730 con 0x7fadf4004800 2024-09-21T06:09:29.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.082+0000 7fae17200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fae100737a0 con 0x7fae10158580 2024-09-21T06:09:29.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.082+0000 7fae15200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae10158990 0x7fae10072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:29.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae10158990 0x7fae10072cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59922/0 (socket says 172.21.15.118:59922) 2024-09-21T06:09:29.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 -- 172.21.15.118:0/3988087738 learned_addr learned my addr 172.21.15.118:0/3988087738 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:29.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae0fe00640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf4004800 0x7fae100cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:29.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae07400640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae10158580 0x7fae101f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:29.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 -- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae10158580 msgr2=0x7fae101f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:29.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae10158580 0x7fae101f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 -- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf4004800 msgr2=0x7fae100cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf4004800 0x7fae100cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 -- 172.21.15.118:0/3988087738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae10157ae0 con 0x7fae10158990 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae07400640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae10158580 0x7fae101f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.083+0000 7fae15200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae10158990 0x7fae10072cd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fae10154510 tx=0x7fae0800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.084+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08003d80 con 0x7fae10158990 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.084+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae08004b20 con 0x7fae10158990 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.084+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08004030 con 0x7fae10158990 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.084+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae101f6370 con 0x7fae10158990 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.084+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae10157d80 con 0x7fae10158990 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.085+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae10142c90 con 0x7fae10158990 2024-09-21T06:09:29.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.086+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae080041d0 con 0x7fae10158990 2024-09-21T06:09:29.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.087+0000 7fae0cc00640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadec078b90 0x7fadec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:29.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.087+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fae0809b9c0 con 0x7fae10158990 2024-09-21T06:09:29.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.087+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=105}) -- 0x7fadec080770 con 0x7fae10158990 2024-09-21T06:09:29.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.088+0000 7fae0fe00640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadec078b90 0x7fadec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:29.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.088+0000 7fae0fe00640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadec078b90 0x7fadec07b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fae1006bd50 tx=0x7fae000067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:29.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.092+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fae08020030 con 0x7fae10158990 2024-09-21T06:09:29.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.276+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fae10158da0 con 0x7fae10158990 2024-09-21T06:09:29.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.277+0000 7fae0cc00640 1 -- 172.21.15.118:0/3988087738 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) ==== 81+0+34478 (secure 0 0 0) 0x7fae08063ce0 con 0x7fae10158990 2024-09-21T06:09:29.280 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:29.280 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:29.280 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 104, 2024-09-21T06:09:29.280 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:29.280 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:09:29.280 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:09:28.488981+0000", 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:09:29.281 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 13, 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:09:29.282 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:29.283 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:29.284 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:29.285 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.286 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:09:29.287 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:29.288 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 12, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:57.351669+0000", 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:29.289 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:29.290 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:29.291 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 13, 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:58.408649+0000", 2024-09-21T06:09:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 3, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full", 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:09:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "100", 2024-09-21T06:09:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:09:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:09:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:09:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:09:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:09:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:09:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:09:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "full", 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:09:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:09:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:09:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:09:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:09:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:29.355 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.279+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadec078b90 msgr2=0x7fadec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.279+0000 7fae17200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadec078b90 0x7fadec07b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fae1006bd50 tx=0x7fae000067a0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.279+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae10158990 msgr2=0x7fae10072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.279+0000 7fae17200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae10158990 0x7fae10072cd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fae10154510 tx=0x7fae0800f790 comp rx=0 tx=0).stop 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.279+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 shutdown_connections 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.279+0000 7fae17200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae10158990 0x7fae10072cd0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.280+0000 7fae17200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadec078b90 0x7fadec07b0a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.280+0000 7fae17200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae10158580 0x7fae101f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.280+0000 7fae17200640 1 --2- 172.21.15.118:0/3988087738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf4004800 0x7fae100cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.280+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 >> 172.21.15.118:0/3988087738 conn(0x7fae1006d110 msgr2=0x7fae100cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.280+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 shutdown_connections 2024-09-21T06:09:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:29.280+0000 7fae17200640 1 -- 172.21.15.118:0/3988087738 wait complete. 2024-09-21T06:09:29.358 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:09:29.492 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:09:29.490+0000 7ff0a8000640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2024-09-21T06:09:34.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:09:34.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 -- 172.21.15.118:0/273295660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc04146230 msgr2=0x7fbc0415d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 --2- 172.21.15.118:0/273295660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc04146230 0x7fbc0415d0d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4005fd0 tx=0x7fbbf402a540 comp rx=0 tx=0).stop 2024-09-21T06:09:34.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 -- 172.21.15.118:0/273295660 shutdown_connections 2024-09-21T06:09:34.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 --2- 172.21.15.118:0/273295660 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc040d00c0 0x7fbc040cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 --2- 172.21.15.118:0/273295660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc04146230 0x7fbc0415d0d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 -- 172.21.15.118:0/273295660 >> 172.21.15.118:0/273295660 conn(0x7fbc0406d6e0 msgr2=0x7fbc040b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:34.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 -- 172.21.15.118:0/273295660 shutdown_connections 2024-09-21T06:09:34.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.587+0000 7fbc0a200640 1 -- 172.21.15.118:0/273295660 wait complete. 2024-09-21T06:09:34.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.589+0000 7fbc0a200640 1 Processor -- start 2024-09-21T06:09:34.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.589+0000 7fbc0a200640 1 -- start start 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc0a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc040ce490 0x7fbc0413aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc0a200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc040d00c0 0x7fbc040cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc0a200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc04146230 0x7fbc0415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc0a200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04160dd0 con 0x7fbc040d00c0 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc0a200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04074330 con 0x7fbc04146230 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc0a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbc04160f50 con 0x7fbc040ce490 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc040d00c0 0x7fbc040cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc040d00c0 0x7fbc040cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59934/0 (socket says 172.21.15.118:59934) 2024-09-21T06:09:34.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbbfbe00640 1 -- 172.21.15.118:0/2481453852 learned_addr learned my addr 172.21.15.118:0/2481453852 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:34.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc08e00640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc040ce490 0x7fbc0413aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.591+0000 7fbc09800640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc04146230 0x7fbc0415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbbfbe00640 1 -- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc040ce490 msgr2=0x7fbc0413aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbbfbe00640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc040ce490 0x7fbc0413aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbbfbe00640 1 -- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc04146230 msgr2=0x7fbc0415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbbfbe00640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc04146230 0x7fbc0415b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbbfbe00640 1 -- 172.21.15.118:0/2481453852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc041f91b0 con 0x7fbc040d00c0 2024-09-21T06:09:34.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbbfbe00640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc040d00c0 0x7fbc040cb9e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00d750 tx=0x7fbbec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:34.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbc01600640 1 -- 172.21.15.118:0/2481453852 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec017070 con 0x7fbc040d00c0 2024-09-21T06:09:34.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbc01600640 1 -- 172.21.15.118:0/2481453852 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbec009d20 con 0x7fbc040d00c0 2024-09-21T06:09:34.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc041f9490 con 0x7fbc040d00c0 2024-09-21T06:09:34.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbc01600640 1 -- 172.21.15.118:0/2481453852 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0106c0 con 0x7fbc040d00c0 2024-09-21T06:09:34.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.592+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc041f9a50 con 0x7fbc040d00c0 2024-09-21T06:09:34.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.594+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc04161470 con 0x7fbc040d00c0 2024-09-21T06:09:34.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.595+0000 7fbc01600640 1 -- 172.21.15.118:0/2481453852 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbbec01a070 con 0x7fbc040d00c0 2024-09-21T06:09:34.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.596+0000 7fbc01600640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbbe0078b90 0x7fbbe007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.596+0000 7fbc01600640 1 -- 172.21.15.118:0/2481453852 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7fbbec09ad90 con 0x7fbc040d00c0 2024-09-21T06:09:34.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.596+0000 7fbc08e00640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbbe0078b90 0x7fbbe007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.597+0000 7fbc08e00640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbbe0078b90 0x7fbbe007b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4033000 tx=0x7fbbf4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:34.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.600+0000 7fbc01600640 1 -- 172.21.15.118:0/2481453852 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbbec00de60 con 0x7fbc040d00c0 2024-09-21T06:09:34.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.792+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fbc0415f8a0 con 0x7fbc040d00c0 2024-09-21T06:09:34.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.793+0000 7fbc01600640 1 -- 172.21.15.118:0/2481453852 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) ==== 81+0+34327 (secure 0 0 0) 0x7fbbec062b70 con 0x7fbc040d00c0 2024-09-21T06:09:34.796 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 106, 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:09:31.499032+0000", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:09:34.797 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 13, 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:09:34.798 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:34.799 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:34.800 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:34.801 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:34.802 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:34.803 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:34.804 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 12, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:57.351669+0000", 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:34.805 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:34.806 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:34.807 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:34.808 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:34.809 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.810 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 13, 2024-09-21T06:09:34.811 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:58.408649+0000", 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:34.812 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.813 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:34.814 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.815 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:09:34.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:34.817 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.818 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:09:34.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:09:34.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:09:34.821 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:09:34.822 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:34.823 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.824 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.828 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.830 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.831 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.832 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:34.833 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:34.834 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.835 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.836 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.837 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.838 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:09:34.839 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.840 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.841 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.842 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.843 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.844 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.845 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.846 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.847 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.848 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.849 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.850 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.851 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.852 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.853 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.854 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.855 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.856 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:34.857 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.858 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.859 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.860 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.861 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.862 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.863 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.864 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.865 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.866 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:34.867 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:09:34.868 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:09:34.869 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:09:34.870 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:09:34.870 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:09:34.870 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:09:34.870 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:34.870 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:34.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbbe0078b90 msgr2=0x7fbbe007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbbe0078b90 0x7fbbe007b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4033000 tx=0x7fbbf4004730 comp rx=0 tx=0).stop 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc040d00c0 msgr2=0x7fbc040cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc040d00c0 0x7fbc040cb9e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00d750 tx=0x7fbbec00dc10 comp rx=0 tx=0).stop 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 shutdown_connections 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc04146230 0x7fbc0415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc040d00c0 0x7fbc040cb9e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbbe0078b90 0x7fbbe007b0a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 --2- 172.21.15.118:0/2481453852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc040ce490 0x7fbc0413aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 >> 172.21.15.118:0/2481453852 conn(0x7fbc0406d6e0 msgr2=0x7fbc0415fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 shutdown_connections 2024-09-21T06:09:34.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:34.796+0000 7fbc0a200640 1 -- 172.21.15.118:0/2481453852 wait complete. 2024-09-21T06:09:34.873 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-21T06:09:34.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:09:35.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.092+0000 7f933de00640 1 -- 172.21.15.118:0/1477301698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 msgr2=0x7f9338073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.092+0000 7f933de00640 1 --2- 172.21.15.118:0/1477301698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338073590 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9338072a70 tx=0x7f933002aa30 comp rx=0 tx=0).stop 2024-09-21T06:09:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.093+0000 7f933de00640 1 -- 172.21.15.118:0/1477301698 shutdown_connections 2024-09-21T06:09:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.093+0000 7f933de00640 1 --2- 172.21.15.118:0/1477301698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338073590 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.093+0000 7f933de00640 1 --2- 172.21.15.118:0/1477301698 >> v2:172.21.15.149:3300/0 conn(0x7f933815ea10 0x7f933815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.093+0000 7f933de00640 1 -- 172.21.15.118:0/1477301698 >> 172.21.15.118:0/1477301698 conn(0x7f933806d6e0 msgr2=0x7f93380b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.093+0000 7f933de00640 1 -- 172.21.15.118:0/1477301698 shutdown_connections 2024-09-21T06:09:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.093+0000 7f933de00640 1 -- 172.21.15.118:0/1477301698 wait complete. 2024-09-21T06:09:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.095+0000 7f933de00640 1 Processor -- start 2024-09-21T06:09:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.095+0000 7f933de00640 1 -- start start 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.096+0000 7f933de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.096+0000 7f933de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f933815ae10 0x7f933814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.096+0000 7f933de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f933815ea10 0x7f933815d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.096+0000 7f933de00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9338070d30 con 0x7f9338073180 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.096+0000 7f933de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9338070bb0 con 0x7f933815ea10 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.096+0000 7f933de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9338073ad0 con 0x7f933815ae10 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59952/0 (socket says 172.21.15.118:59952) 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 -- 172.21.15.118:0/2544555809 learned_addr learned my addr 172.21.15.118:0/2544555809 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933d400640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f933815ea10 0x7f933815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f932fe00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f933815ae10 0x7f933814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 -- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f933815ae10 msgr2=0x7f933814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f933815ae10 0x7f933814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 -- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f933815ea10 msgr2=0x7f933815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f933815ea10 0x7f933815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.097+0000 7f933ca00640 1 -- 172.21.15.118:0/2544555809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93381530f0 con 0x7f9338073180 2024-09-21T06:09:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.098+0000 7f933ca00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338152bb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f932800c3a0 tx=0x7f932800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.098+0000 7f9335600640 1 -- 172.21.15.118:0/2544555809 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328017070 con 0x7f9338073180 2024-09-21T06:09:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.098+0000 7f9335600640 1 -- 172.21.15.118:0/2544555809 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93280053c0 con 0x7f9338073180 2024-09-21T06:09:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.098+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93381f7620 con 0x7f9338073180 2024-09-21T06:09:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.098+0000 7f9335600640 1 -- 172.21.15.118:0/2544555809 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328003850 con 0x7f9338073180 2024-09-21T06:09:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.098+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93381f7be0 con 0x7f9338073180 2024-09-21T06:09:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.099+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9338073590 con 0x7f9338073180 2024-09-21T06:09:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.100+0000 7f9335600640 1 -- 172.21.15.118:0/2544555809 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f932801a070 con 0x7f9338073180 2024-09-21T06:09:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.101+0000 7f9335600640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9314078b90 0x7f931407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.101+0000 7f9335600640 1 -- 172.21.15.118:0/2544555809 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f932809a070 con 0x7f9338073180 2024-09-21T06:09:35.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.102+0000 7f932fe00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9314078b90 0x7f931407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.102+0000 7f932fe00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9314078b90 0x7f931407b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f93380b2c80 tx=0x7f932000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:35.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.106+0000 7f9335600640 1 -- 172.21.15.118:0/2544555809 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f933815f360 con 0x7f9338073180 2024-09-21T06:09:35.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.292+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f9338151750 con 0x7f9338073180 2024-09-21T06:09:35.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.294+0000 7f9335600640 1 -- 172.21.15.118:0/2544555809 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) ==== 81+0+34327 (secure 0 0 0) 0x7f9328061e60 con 0x7f9338073180 2024-09-21T06:09:35.296 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 106, 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:09:31.499032+0000", 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:09:35.297 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 13, 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:09:35.298 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:35.299 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:09:35.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:09:35.301 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:35.302 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:35.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:09:35.304 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:35.305 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 12, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:57.351669+0000", 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:35.306 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:35.307 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:35.308 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:35.309 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:35.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:35.312 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 13, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:08:58.408649+0000", 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:09:35.313 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:09:35.314 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:09:35.315 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:09:35.316 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:09:35.317 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:09:35.318 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:09:35.319 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.320 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.321 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.322 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.323 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.325 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.326 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.328 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.329 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:09:35.331 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.332 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.333 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.334 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.339 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:09:35.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.343 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.344 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:09:35.347 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.348 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:09:35.349 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.350 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:09:35.351 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:09:35.353 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:09:35.354 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.355 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.356 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.357 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.358 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.359 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:09:35.360 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.361 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 97, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:09:35.362 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.363 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.364 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.365 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.366 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:09:35.367 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.368 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.369 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.370 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.371 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.372 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:09:35.373 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:09:35.374 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:09:35.375 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:09:35.376 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:09:35.376 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:09:35.376 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:35.376 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:35.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9314078b90 msgr2=0x7f931407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9314078b90 0x7f931407b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f93380b2c80 tx=0x7f932000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 msgr2=0x7f9338152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338152bb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f932800c3a0 tx=0x7f932800c860 comp rx=0 tx=0).stop 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 shutdown_connections 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f933815ea10 0x7f933815d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9314078b90 0x7f931407b0a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f933815ae10 0x7f933814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 --2- 172.21.15.118:0/2544555809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9338073180 0x7f9338152bb0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 >> 172.21.15.118:0/2544555809 conn(0x7f933806d6e0 msgr2=0x7f93380cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:35.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 shutdown_connections 2024-09-21T06:09:35.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.296+0000 7f933de00640 1 -- 172.21.15.118:0/2544555809 wait complete. 2024-09-21T06:09:35.379 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 -- 172.21.15.118:0/3770709247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9741461d0 msgr2=0x7fa9740b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 --2- 172.21.15.118:0/3770709247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9741461d0 0x7fa9740b5bb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa9740cf100 tx=0x7fa96402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 -- 172.21.15.118:0/3770709247 shutdown_connections 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 --2- 172.21.15.118:0/3770709247 >> v2:172.21.15.149:3300/0 conn(0x7fa97415d690 0x7fa974160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 --2- 172.21.15.118:0/3770709247 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9740b60f0 0x7fa97415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 --2- 172.21.15.118:0/3770709247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9741461d0 0x7fa9740b5bb0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 -- 172.21.15.118:0/3770709247 >> 172.21.15.118:0/3770709247 conn(0x7fa97406d6e0 msgr2=0x7fa9740b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 -- 172.21.15.118:0/3770709247 shutdown_connections 2024-09-21T06:09:35.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.599+0000 7fa979400640 1 -- 172.21.15.118:0/3770709247 wait complete. 2024-09-21T06:09:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.601+0000 7fa979400640 1 Processor -- start 2024-09-21T06:09:35.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.601+0000 7fa979400640 1 -- start start 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa979400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9740b60f0 0x7fa974156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa979400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9741461d0 0x7fa9741f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa979400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa97415d690 0x7fa9741f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa979400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa974161010 con 0x7fa9740b60f0 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa979400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa974160e90 con 0x7fa9741461d0 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa979400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa974161190 con 0x7fa97415d690 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa973e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9740b60f0 0x7fa974156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa973e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9740b60f0 0x7fa974156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59970/0 (socket says 172.21.15.118:59970) 2024-09-21T06:09:35.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa973e00640 1 -- 172.21.15.118:0/1888368637 learned_addr learned my addr 172.21.15.118:0/1888368637 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa978a00640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa97415d690 0x7fa9741f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.603+0000 7fa96b400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9741461d0 0x7fa9741f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.604+0000 7fa973e00640 1 -- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa97415d690 msgr2=0x7fa9741f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.604+0000 7fa973e00640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa97415d690 0x7fa9741f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.604+0000 7fa973e00640 1 -- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9741461d0 msgr2=0x7fa9741f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.604+0000 7fa973e00640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9741461d0 0x7fa9741f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.604+0000 7fa973e00640 1 -- 172.21.15.118:0/1888368637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9741e9bc0 con 0x7fa9740b60f0 2024-09-21T06:09:35.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.604+0000 7fa973e00640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9740b60f0 0x7fa974156df0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa964000c00 tx=0x7fa964003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:35.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.606+0000 7fa970c00640 1 -- 172.21.15.118:0/1888368637 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96403e030 con 0x7fa9740b60f0 2024-09-21T06:09:35.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.606+0000 7fa970c00640 1 -- 172.21.15.118:0/1888368637 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa964003e00 con 0x7fa9740b60f0 2024-09-21T06:09:35.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.606+0000 7fa970c00640 1 -- 172.21.15.118:0/1888368637 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964035040 con 0x7fa9740b60f0 2024-09-21T06:09:35.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.606+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9741e9fe0 con 0x7fa9740b60f0 2024-09-21T06:09:35.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.606+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9741ea5a0 con 0x7fa9740b60f0 2024-09-21T06:09:35.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.607+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9740b5bb0 con 0x7fa9740b60f0 2024-09-21T06:09:35.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.608+0000 7fa970c00640 1 -- 172.21.15.118:0/1888368637 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa964041030 con 0x7fa9740b60f0 2024-09-21T06:09:35.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.609+0000 7fa970c00640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa950078b90 0x7fa95007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:35.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.609+0000 7fa970c00640 1 -- 172.21.15.118:0/1888368637 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7fa9640bb500 con 0x7fa9740b60f0 2024-09-21T06:09:35.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.610+0000 7fa96b400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa950078b90 0x7fa95007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:35.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.610+0000 7fa96b400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa950078b90 0x7fa95007b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa974160380 tx=0x7fa95c00b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:35.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.614+0000 7fa970c00640 1 -- 172.21.15.118:0/1888368637 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa9640832f0 con 0x7fa9740b60f0 2024-09-21T06:09:35.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.831+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa974074fa0 con 0x7fa9740b60f0 2024-09-21T06:09:35.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.831+0000 7fa970c00640 1 -- 172.21.15.118:0/1888368637 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7fa964087d20 con 0x7fa9740b60f0 2024-09-21T06:09:35.835 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:35.835 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:35.835 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:35.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa950078b90 msgr2=0x7fa95007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa950078b90 0x7fa95007b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa974160380 tx=0x7fa95c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9740b60f0 msgr2=0x7fa974156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9740b60f0 0x7fa974156df0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa964000c00 tx=0x7fa964003910 comp rx=0 tx=0).stop 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 shutdown_connections 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa950078b90 0x7fa95007b0a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa97415d690 0x7fa9741f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9741461d0 0x7fa9741f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 --2- 172.21.15.118:0/1888368637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9740b60f0 0x7fa974156df0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 >> 172.21.15.118:0/1888368637 conn(0x7fa97406d6e0 msgr2=0x7fa9740b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 shutdown_connections 2024-09-21T06:09:35.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:35.834+0000 7fa979400640 1 -- 172.21.15.118:0/1888368637 wait complete. 2024-09-21T06:09:35.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:09:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":6249,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":36.133459977000001,"mdsmap_epoch":51,"osdmap_epoch":106,"osdmap_epoch_barrier":102,"uptime":41.062608757} 2024-09-21T06:09:36.098 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 6249, "mdsmap_epoch": 51, "osdmap_epoch": 106, "osdmap_epoch_barrier": 102, "rank_uptime": 36.133459977, "state": "up:active", "uptime": 41.062608757, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:09:36.098 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:09:36.098 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:36.099 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:36.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:36.134 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-21T06:09:36.568 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:09:36.568 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:09:36.568 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.357068 s, 147 MB/s 2024-09-21T06:09:36.569 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:09:36.569 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:09:36.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:09:36.745 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:09:36.745 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:09:36.745 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:36.746 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:36.781 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:36.781 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:36.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 -- 172.21.15.118:0/3336501810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 msgr2=0x7fe4280d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3336501810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280d0240 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe4280cd9f0 tx=0x7fe41402a560 comp rx=0 tx=0).stop 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 -- 172.21.15.118:0/3336501810 shutdown_connections 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3336501810 >> v2:172.21.15.149:3300/0 conn(0x7fe4280b5bb0 0x7fe4280b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3336501810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280d0240 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 -- 172.21.15.118:0/3336501810 >> 172.21.15.118:0/3336501810 conn(0x7fe42806d6e0 msgr2=0x7fe4280b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 -- 172.21.15.118:0/3336501810 shutdown_connections 2024-09-21T06:09:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.115+0000 7fe42ea00640 1 -- 172.21.15.118:0/3336501810 wait complete. 2024-09-21T06:09:37.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.117+0000 7fe42ea00640 1 Processor -- start 2024-09-21T06:09:37.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.117+0000 7fe42ea00640 1 -- start start 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe428073fa0 0x7fe4281390d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4280b5bb0 0x7fe4280cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42ea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe42815d9c0 con 0x7fe4280cfe30 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe42815d840 con 0x7fe4280b5bb0 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe42815db40 con 0x7fe428073fa0 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4280b5bb0 0x7fe4280cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57520/0 (socket says 172.21.15.118:57520) 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 -- 172.21.15.118:0/3994586484 learned_addr learned my addr 172.21.15.118:0/3994586484 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4280b5bb0 0x7fe4280cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:49878/0 (socket says 172.21.15.118:49878) 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42d600640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe428073fa0 0x7fe4281390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 -- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe428073fa0 msgr2=0x7fe4281390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe428073fa0 0x7fe4281390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 -- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4280b5bb0 msgr2=0x7fe4280cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4280b5bb0 0x7fe4280cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.119+0000 7fe42e000640 1 -- 172.21.15.118:0/3994586484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4280ca9c0 con 0x7fe4280cfe30 2024-09-21T06:09:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.120+0000 7fe42e000640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280cbfa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe42000eab0 tx=0x7fe42000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:37.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.120+0000 7fe425600640 1 -- 172.21.15.118:0/3994586484 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42000cea0 con 0x7fe4280cfe30 2024-09-21T06:09:37.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.120+0000 7fe425600640 1 -- 172.21.15.118:0/3994586484 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe420004b20 con 0x7fe4280cfe30 2024-09-21T06:09:37.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.120+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4280caca0 con 0x7fe4280cfe30 2024-09-21T06:09:37.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.120+0000 7fe425600640 1 -- 172.21.15.118:0/3994586484 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420005020 con 0x7fe4280cfe30 2024-09-21T06:09:37.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.120+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4280cb260 con 0x7fe4280cfe30 2024-09-21T06:09:37.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.121+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4280ccf20 con 0x7fe4280cfe30 2024-09-21T06:09:37.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.122+0000 7fe425600640 1 -- 172.21.15.118:0/3994586484 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4200051c0 con 0x7fe4280cfe30 2024-09-21T06:09:37.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.123+0000 7fe425600640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe408078b90 0x7fe40807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.123+0000 7fe425600640 1 -- 172.21.15.118:0/3994586484 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7fe42009b8c0 con 0x7fe4280cfe30 2024-09-21T06:09:37.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.124+0000 7fe42d600640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe408078b90 0x7fe40807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.124+0000 7fe42d600640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe408078b90 0x7fe40807b0a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe41c001720 tx=0x7fe41c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:37.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.128+0000 7fe425600640 1 -- 172.21.15.118:0/3994586484 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe4200636a0 con 0x7fe4280cfe30 2024-09-21T06:09:37.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.323+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe42815e060 con 0x7fe4280cfe30 2024-09-21T06:09:37.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.324+0000 7fe425600640 1 -- 172.21.15.118:0/3994586484 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v106) ==== 80+0+0 (secure 0 0 0) 0x7fe4200680d0 con 0x7fe4280cfe30 2024-09-21T06:09:37.326 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:09:37.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe408078b90 msgr2=0x7fe40807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe408078b90 0x7fe40807b0a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe41c001720 tx=0x7fe41c009040 comp rx=0 tx=0).stop 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 msgr2=0x7fe4280cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280cbfa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe42000eab0 tx=0x7fe42000ef70 comp rx=0 tx=0).stop 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 shutdown_connections 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4280cfe30 0x7fe4280cbfa0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4280b5bb0 0x7fe4280cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe408078b90 0x7fe40807b0a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 --2- 172.21.15.118:0/3994586484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe428073fa0 0x7fe4281390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 >> 172.21.15.118:0/3994586484 conn(0x7fe42806d6e0 msgr2=0x7fe42815e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 shutdown_connections 2024-09-21T06:09:37.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.326+0000 7fe42ea00640 1 -- 172.21.15.118:0/3994586484 wait complete. 2024-09-21T06:09:37.350 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:09:37.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:37.350 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:09:37.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:09:37.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:37.452 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:09:37.496 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:09:37.496 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:09:37.496 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:37.533 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:09:37.533 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:37.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:09:37.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 -- 172.21.15.118:0/2207146642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac144ea0 msgr2=0x7f53ac144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 --2- 172.21.15.118:0/2207146642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac144ea0 0x7f53ac144760 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0afd60 tx=0x7f539c02a560 comp rx=0 tx=0).stop 2024-09-21T06:09:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 -- 172.21.15.118:0/2207146642 shutdown_connections 2024-09-21T06:09:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 --2- 172.21.15.118:0/2207146642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53ac0cf700 0x7f53ac15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 --2- 172.21.15.118:0/2207146642 >> v2:172.21.15.149:3300/0 conn(0x7f53ac0cedb0 0x7f53ac0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 --2- 172.21.15.118:0/2207146642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac144ea0 0x7f53ac144760 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 -- 172.21.15.118:0/2207146642 >> 172.21.15.118:0/2207146642 conn(0x7f53ac06d6e0 msgr2=0x7f53ac0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 -- 172.21.15.118:0/2207146642 shutdown_connections 2024-09-21T06:09:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.827+0000 7f53b0c00640 1 -- 172.21.15.118:0/2207146642 wait complete. 2024-09-21T06:09:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.829+0000 7f53b0c00640 1 Processor -- start 2024-09-21T06:09:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.829+0000 7f53b0c00640 1 -- start start 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53b0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53ac0cedb0 0x7f53ac0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53b0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac0cf700 0x7f53ac1f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53b0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53ac144ea0 0x7f53ac1f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53b0c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac160000 con 0x7f53ac0cf700 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53b0c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac15fe80 con 0x7f53ac0cedb0 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53b0c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac160180 con 0x7f53ac144ea0 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac0cf700 0x7f53ac1f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac0cf700 0x7f53ac1f6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57534/0 (socket says 172.21.15.118:57534) 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 -- 172.21.15.118:0/4255499021 learned_addr learned my addr 172.21.15.118:0/4255499021 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53ab400640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53ac0cedb0 0x7f53ac0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53abe00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53ac144ea0 0x7f53ac1f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 -- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53ac144ea0 msgr2=0x7f53ac1f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53ac144ea0 0x7f53ac1f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 -- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53ac0cedb0 msgr2=0x7f53ac0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53ac0cedb0 0x7f53ac0b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.831+0000 7f53aaa00640 1 -- 172.21.15.118:0/4255499021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac138750 con 0x7f53ac0cf700 2024-09-21T06:09:37.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.832+0000 7f53aaa00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac0cf700 0x7f53ac1f6d70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f539400e790 tx=0x7f539400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.832+0000 7f53a3400640 1 -- 172.21.15.118:0/4255499021 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539400eea0 con 0x7f53ac0cf700 2024-09-21T06:09:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.832+0000 7f53a3400640 1 -- 172.21.15.118:0/4255499021 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f539400cdb0 con 0x7f53ac0cf700 2024-09-21T06:09:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.832+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac138a30 con 0x7f53ac0cf700 2024-09-21T06:09:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.832+0000 7f53a3400640 1 -- 172.21.15.118:0/4255499021 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394010690 con 0x7f53ac0cf700 2024-09-21T06:09:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.832+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac138ff0 con 0x7f53ac0cf700 2024-09-21T06:09:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.833+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac160630 con 0x7f53ac0cf700 2024-09-21T06:09:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.834+0000 7f53a3400640 1 -- 172.21.15.118:0/4255499021 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5394010830 con 0x7f53ac0cf700 2024-09-21T06:09:37.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.835+0000 7f53a3400640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5388078b90 0x7f538807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.835+0000 7f53a3400640 1 -- 172.21.15.118:0/4255499021 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f539409b780 con 0x7f53ac0cf700 2024-09-21T06:09:37.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.835+0000 7f53ab400640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5388078b90 0x7f538807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.836+0000 7f53ab400640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5388078b90 0x7f538807b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f539c033000 tx=0x7f539c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:37.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:37.839+0000 7f53a3400640 1 -- 172.21.15.118:0/4255499021 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f53940634d0 con 0x7f53ac0cf700 2024-09-21T06:09:38.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.034+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f53ac1397d0 con 0x7f53ac0cf700 2024-09-21T06:09:38.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.035+0000 7f53a3400640 1 -- 172.21.15.118:0/4255499021 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v106) ==== 80+0+0 (secure 0 0 0) 0x7f5394067f00 con 0x7f53ac0cf700 2024-09-21T06:09:38.037 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:09:38.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5388078b90 msgr2=0x7f538807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5388078b90 0x7f538807b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f539c033000 tx=0x7f539c004730 comp rx=0 tx=0).stop 2024-09-21T06:09:38.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac0cf700 msgr2=0x7f53ac1f6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac0cf700 0x7f53ac1f6d70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f539400e790 tx=0x7f539400ec50 comp rx=0 tx=0).stop 2024-09-21T06:09:38.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 shutdown_connections 2024-09-21T06:09:38.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5388078b90 0x7f538807b0a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53ac144ea0 0x7f53ac1f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53ac0cf700 0x7f53ac1f6d70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 --2- 172.21.15.118:0/4255499021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53ac0cedb0 0x7f53ac0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 >> 172.21.15.118:0/4255499021 conn(0x7f53ac06d6e0 msgr2=0x7f53ac142910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:38.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 shutdown_connections 2024-09-21T06:09:38.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.037+0000 7f53b0c00640 1 -- 172.21.15.118:0/4255499021 wait complete. 2024-09-21T06:09:38.063 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:09:38.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:38.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:09:38.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:09:38.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:09:38.127 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:09:38.163 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:09:38.163 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:38.163 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:38.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:09:38.198 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:09:38.199 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:09:38.199 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:38.238 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:09:38.238 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:38.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 -- 172.21.15.118:0/3578802497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec80d0e80 msgr2=0x7fbec80d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 --2- 172.21.15.118:0/3578802497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec80d0e80 0x7fbec80d1290 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbec80b0580 tx=0x7fbeb402a560 comp rx=0 tx=0).stop 2024-09-21T06:09:38.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 -- 172.21.15.118:0/3578802497 shutdown_connections 2024-09-21T06:09:38.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 --2- 172.21.15.118:0/3578802497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec80d0e80 0x7fbec80d1290 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 --2- 172.21.15.118:0/3578802497 >> v2:172.21.15.149:3300/0 conn(0x7fbec806ecd0 0x7fbec806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 --2- 172.21.15.118:0/3578802497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbec8073e30 0x7fbec81635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 -- 172.21.15.118:0/3578802497 >> 172.21.15.118:0/3578802497 conn(0x7fbec806d110 msgr2=0x7fbec806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:38.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 -- 172.21.15.118:0/3578802497 shutdown_connections 2024-09-21T06:09:38.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.455+0000 7fbecfa00640 1 -- 172.21.15.118:0/3578802497 wait complete. 2024-09-21T06:09:38.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.458+0000 7fbecfa00640 1 Processor -- start 2024-09-21T06:09:38.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.458+0000 7fbecfa00640 1 -- start start 2024-09-21T06:09:38.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.459+0000 7fbecfa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec806ecd0 0x7fbec814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.459+0000 7fbecfa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbec8073e30 0x7fbec8151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.459+0000 7fbecfa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbec80d0e80 0x7fbec80b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.459+0000 7fbecfa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbec806f620 con 0x7fbec806ecd0 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.459+0000 7fbecfa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbec8156530 con 0x7fbec80d0e80 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.459+0000 7fbecfa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbec806f7a0 con 0x7fbec8073e30 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec806ecd0 0x7fbec814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbec7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbec8073e30 0x7fbec8151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec806ecd0 0x7fbec814f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57552/0 (socket says 172.21.15.118:57552) 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 -- 172.21.15.118:0/2710169927 learned_addr learned my addr 172.21.15.118:0/2710169927 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecda00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbec80d0e80 0x7fbec80b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 -- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbec8073e30 msgr2=0x7fbec8151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbec8073e30 0x7fbec8151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 -- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbec80d0e80 msgr2=0x7fbec80b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbec80d0e80 0x7fbec80b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 -- 172.21.15.118:0/2710169927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec814fee0 con 0x7fbec806ecd0 2024-09-21T06:09:38.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.460+0000 7fbecd000640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec806ecd0 0x7fbec814f8a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00e7f0 tx=0x7fbebc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:38.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.461+0000 7fbec4c00640 1 -- 172.21.15.118:0/2710169927 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00cac0 con 0x7fbec806ecd0 2024-09-21T06:09:38.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.461+0000 7fbec4c00640 1 -- 172.21.15.118:0/2710169927 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbebc00cc80 con 0x7fbec806ecd0 2024-09-21T06:09:38.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.461+0000 7fbec4c00640 1 -- 172.21.15.118:0/2710169927 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc005280 con 0x7fbec806ecd0 2024-09-21T06:09:38.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.461+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec81501c0 con 0x7fbec806ecd0 2024-09-21T06:09:38.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.461+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec8150780 con 0x7fbec806ecd0 2024-09-21T06:09:38.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.462+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec81635c0 con 0x7fbec806ecd0 2024-09-21T06:09:38.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.463+0000 7fbec4c00640 1 -- 172.21.15.118:0/2710169927 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbebc005420 con 0x7fbec806ecd0 2024-09-21T06:09:38.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.464+0000 7fbec4c00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbea8078bc0 0x7fbea807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.464+0000 7fbec4c00640 1 -- 172.21.15.118:0/2710169927 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7fbebc09b540 con 0x7fbec806ecd0 2024-09-21T06:09:38.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.464+0000 7fbec7e00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbea8078bc0 0x7fbea807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.465+0000 7fbec7e00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbea8078bc0 0x7fbea807b0d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4033000 tx=0x7fbeb4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:38.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.469+0000 7fbec4c00640 1 -- 172.21.15.118:0/2710169927 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbebc063a10 con 0x7fbec806ecd0 2024-09-21T06:09:38.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.695+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbec8160fe0 con 0x7fbec806ecd0 2024-09-21T06:09:38.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.696+0000 7fbec4c00640 1 -- 172.21.15.118:0/2710169927 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7fbebc063310 con 0x7fbec806ecd0 2024-09-21T06:09:38.701 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:38.702 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:38.702 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:38.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbea8078bc0 msgr2=0x7fbea807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbea8078bc0 0x7fbea807b0d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4033000 tx=0x7fbeb4004730 comp rx=0 tx=0).stop 2024-09-21T06:09:38.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec806ecd0 msgr2=0x7fbec814f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec806ecd0 0x7fbec814f8a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00e7f0 tx=0x7fbebc00ebf0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 shutdown_connections 2024-09-21T06:09:38.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbec80d0e80 0x7fbec80b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbea8078bc0 0x7fbea807b0d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbec8073e30 0x7fbec8151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 --2- 172.21.15.118:0/2710169927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec806ecd0 0x7fbec814f8a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 >> 172.21.15.118:0/2710169927 conn(0x7fbec806d110 msgr2=0x7fbec8160740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 shutdown_connections 2024-09-21T06:09:38.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.698+0000 7fbecfa00640 1 -- 172.21.15.118:0/2710169927 wait complete. 2024-09-21T06:09:38.723 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.941+0000 7f470be00640 1 -- 172.21.15.118:0/628777174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d35d0 msgr2=0x7f470c06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.941+0000 7f470be00640 1 --2- 172.21.15.118:0/628777174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d35d0 0x7f470c06d6e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4704005fd0 tx=0x7f470402a780 comp rx=0 tx=0).stop 2024-09-21T06:09:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.942+0000 7f470be00640 1 -- 172.21.15.118:0/628777174 shutdown_connections 2024-09-21T06:09:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.942+0000 7f470be00640 1 --2- 172.21.15.118:0/628777174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d35d0 0x7f470c06d6e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.942+0000 7f470be00640 1 --2- 172.21.15.118:0/628777174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f470c0b3be0 0x7f470c0ba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.942+0000 7f470be00640 1 -- 172.21.15.118:0/628777174 >> 172.21.15.118:0/628777174 conn(0x7f470c0d4bd0 msgr2=0x7f470c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.942+0000 7f470be00640 1 -- 172.21.15.118:0/628777174 shutdown_connections 2024-09-21T06:09:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.942+0000 7f470be00640 1 -- 172.21.15.118:0/628777174 wait complete. 2024-09-21T06:09:38.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.944+0000 7f470be00640 1 Processor -- start 2024-09-21T06:09:38.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.944+0000 7f470be00640 1 -- start start 2024-09-21T06:09:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f470c0b3be0 0x7f470c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d2ab0 0x7f470c15aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470c0d35d0 0x7f470c15f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f470c06e0c0 con 0x7f470c0d35d0 2024-09-21T06:09:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f470c06df40 con 0x7f470c0d2ab0 2024-09-21T06:09:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f470c06e240 con 0x7f470c0b3be0 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470c0d35d0 0x7f470c15f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470c0d35d0 0x7f470c15f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57556/0 (socket says 172.21.15.118:57556) 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 -- 172.21.15.118:0/1369969652 learned_addr learned my addr 172.21.15.118:0/1369969652 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470aa00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f470c0b3be0 0x7f470c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f4702000640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d2ab0 0x7f470c15aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 -- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f470c0b3be0 msgr2=0x7f470c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f470c0b3be0 0x7f470c0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 -- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d2ab0 msgr2=0x7f470c15aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d2ab0 0x7f470c15aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:38.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.946+0000 7f470b400640 1 -- 172.21.15.118:0/1369969652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c0cd9e0 con 0x7f470c0d35d0 2024-09-21T06:09:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.947+0000 7f470b400640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470c0d35d0 0x7f470c15f880 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4704009cd0 tx=0x7f4704003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.947+0000 7f4703400640 1 -- 172.21.15.118:0/1369969652 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704040070 con 0x7f470c0d35d0 2024-09-21T06:09:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.947+0000 7f4703400640 1 -- 172.21.15.118:0/1369969652 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4704004540 con 0x7f470c0d35d0 2024-09-21T06:09:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.947+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470c0cdcc0 con 0x7f470c0d35d0 2024-09-21T06:09:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.947+0000 7f4703400640 1 -- 172.21.15.118:0/1369969652 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704003e10 con 0x7f470c0d35d0 2024-09-21T06:09:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.947+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470c0cd490 con 0x7f470c0d35d0 2024-09-21T06:09:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.948+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470c06e6f0 con 0x7f470c0d35d0 2024-09-21T06:09:38.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.950+0000 7f4703400640 1 -- 172.21.15.118:0/1369969652 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4704043070 con 0x7f470c0d35d0 2024-09-21T06:09:38.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.951+0000 7f4703400640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078bc0 0x7f46e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:38.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.951+0000 7f4703400640 1 -- 172.21.15.118:0/1369969652 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f47040bbed0 con 0x7f470c0d35d0 2024-09-21T06:09:38.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.951+0000 7f470aa00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078bc0 0x7f46e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:38.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.952+0000 7f470aa00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078bc0 0x7f46e807b0d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f470c06fae0 tx=0x7f46fc005f30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:38.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:38.956+0000 7f4703400640 1 -- 172.21.15.118:0/1369969652 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4704083cb0 con 0x7f470c0d35d0 2024-09-21T06:09:39.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.177+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f470c1ea6b0 con 0x7f470c0d35d0 2024-09-21T06:09:39.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.178+0000 7f4703400640 1 -- 172.21.15.118:0/1369969652 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7f47040886e0 con 0x7f470c0d35d0 2024-09-21T06:09:39.180 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:39.181 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:39.181 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:39.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078bc0 msgr2=0x7f46e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078bc0 0x7f46e807b0d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f470c06fae0 tx=0x7f46fc005f30 comp rx=0 tx=0).stop 2024-09-21T06:09:39.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470c0d35d0 msgr2=0x7f470c15f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470c0d35d0 0x7f470c15f880 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4704009cd0 tx=0x7f4704003c20 comp rx=0 tx=0).stop 2024-09-21T06:09:39.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 shutdown_connections 2024-09-21T06:09:39.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470c0d35d0 0x7f470c15f880 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470c0d2ab0 0x7f470c15aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078bc0 0x7f46e807b0d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 --2- 172.21.15.118:0/1369969652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f470c0b3be0 0x7f470c0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 >> 172.21.15.118:0/1369969652 conn(0x7f470c0d4bd0 msgr2=0x7f470c1e77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:39.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 shutdown_connections 2024-09-21T06:09:39.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.180+0000 7f470be00640 1 -- 172.21.15.118:0/1369969652 wait complete. 2024-09-21T06:09:39.205 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 -- 172.21.15.118:0/2088797414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800d0e80 msgr2=0x7fef800d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 --2- 172.21.15.118:0/2088797414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800d0e80 0x7fef800d1290 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fef68005fd0 tx=0x7fef6802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 -- 172.21.15.118:0/2088797414 shutdown_connections 2024-09-21T06:09:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 --2- 172.21.15.118:0/2088797414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef800aea60 0x7fef800aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 --2- 172.21.15.118:0/2088797414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800d0e80 0x7fef800d1290 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 -- 172.21.15.118:0/2088797414 >> 172.21.15.118:0/2088797414 conn(0x7fef8006d110 msgr2=0x7fef8006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 -- 172.21.15.118:0/2088797414 shutdown_connections 2024-09-21T06:09:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.427+0000 7fef87600640 1 -- 172.21.15.118:0/2088797414 wait complete. 2024-09-21T06:09:39.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.430+0000 7fef87600640 1 Processor -- start 2024-09-21T06:09:39.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.430+0000 7fef87600640 1 -- start start 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef87600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef80073e30 0x7fef8013ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef87600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800aea60 0x7fef801590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef87600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef800d0e80 0x7fef80157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef87600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fef800af530 con 0x7fef800aea60 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef87600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef800af3b0 con 0x7fef80073e30 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef87600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef800af6b0 con 0x7fef800d0e80 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef77e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800aea60 0x7fef801590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef77e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800aea60 0x7fef801590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57582/0 (socket says 172.21.15.118:57582) 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.431+0000 7fef77e00640 1 -- 172.21.15.118:0/3112925705 learned_addr learned my addr 172.21.15.118:0/3112925705 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef84c00640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef80073e30 0x7fef8013ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef85600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef800d0e80 0x7fef80157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef77e00640 1 -- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef800d0e80 msgr2=0x7fef80157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef77e00640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef800d0e80 0x7fef80157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef77e00640 1 -- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef80073e30 msgr2=0x7fef8013ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef77e00640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef80073e30 0x7fef8013ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef77e00640 1 -- 172.21.15.118:0/3112925705 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef80157640 con 0x7fef800aea60 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef84c00640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef80073e30 0x7fef8013ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef77e00640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800aea60 0x7fef801590f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fef68034040 tx=0x7fef680038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef7d600640 1 -- 172.21.15.118:0/3112925705 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6803e030 con 0x7fef800aea60 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef7d600640 1 -- 172.21.15.118:0/3112925705 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef68003ca0 con 0x7fef800aea60 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.432+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef80158090 con 0x7fef800aea60 2024-09-21T06:09:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.433+0000 7fef7d600640 1 -- 172.21.15.118:0/3112925705 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68035040 con 0x7fef800aea60 2024-09-21T06:09:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.433+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef80158610 con 0x7fef800aea60 2024-09-21T06:09:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.434+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef800afbd0 con 0x7fef800aea60 2024-09-21T06:09:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.435+0000 7fef7d600640 1 -- 172.21.15.118:0/3112925705 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef68041030 con 0x7fef800aea60 2024-09-21T06:09:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.436+0000 7fef7d600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef5c078b90 0x7fef5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.436+0000 7fef7d600640 1 -- 172.21.15.118:0/3112925705 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7fef680bb410 con 0x7fef800aea60 2024-09-21T06:09:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.436+0000 7fef84c00640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef5c078b90 0x7fef5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.437+0000 7fef84c00640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef5c078b90 0x7fef5c07b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fef70007fd0 tx=0x7fef70009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:39.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.440+0000 7fef7d600640 1 -- 172.21.15.118:0/3112925705 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fef80157640 con 0x7fef800aea60 2024-09-21T06:09:39.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.627+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef800af060 con 0x7fef800aea60 2024-09-21T06:09:39.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.628+0000 7fef7d600640 1 -- 172.21.15.118:0/3112925705 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16796 (secure 0 0 0) 0x7fef680837d0 con 0x7fef800aea60 2024-09-21T06:09:39.631 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:39.632 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":106,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:09:31.499032+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:08:57.351669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T06:08:58.408649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:39.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.630+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef5c078b90 msgr2=0x7fef5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.630+0000 7fef87600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef5c078b90 0x7fef5c07b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fef70007fd0 tx=0x7fef70009040 comp rx=0 tx=0).stop 2024-09-21T06:09:39.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.630+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800aea60 msgr2=0x7fef801590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.630+0000 7fef87600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800aea60 0x7fef801590f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fef68034040 tx=0x7fef680038a0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 shutdown_connections 2024-09-21T06:09:39.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef5c078b90 0x7fef5c07b0a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef800d0e80 0x7fef80157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef800aea60 0x7fef801590f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 --2- 172.21.15.118:0/3112925705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef80073e30 0x7fef8013ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 >> 172.21.15.118:0/3112925705 conn(0x7fef8006d110 msgr2=0x7fef8014f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 shutdown_connections 2024-09-21T06:09:39.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.631+0000 7fef87600640 1 -- 172.21.15.118:0/3112925705 wait complete. 2024-09-21T06:09:39.656 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:09:39.657 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:39.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 -- 172.21.15.118:0/3582391644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 msgr2=0x7f4c900ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 --2- 172.21.15.118:0/3582391644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c900ce490 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4c90072570 tx=0x7f4c8802aa30 comp rx=0 tx=0).stop 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 -- 172.21.15.118:0/3582391644 shutdown_connections 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 --2- 172.21.15.118:0/3582391644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c900ce490 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 --2- 172.21.15.118:0/3582391644 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c900cfe70 0x7f4c900cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 --2- 172.21.15.118:0/3582391644 >> v2:172.21.15.149:3300/0 conn(0x7f4c9015d080 0x7f4c90146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 -- 172.21.15.118:0/3582391644 >> 172.21.15.118:0/3582391644 conn(0x7f4c9006d6e0 msgr2=0x7f4c900b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 -- 172.21.15.118:0/3582391644 shutdown_connections 2024-09-21T06:09:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.877+0000 7f4c8f200640 1 -- 172.21.15.118:0/3582391644 wait complete. 2024-09-21T06:09:39.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.879+0000 7f4c8f200640 1 Processor -- start 2024-09-21T06:09:39.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.879+0000 7f4c8f200640 1 -- start start 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c900cfe70 0x7f4c90138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c90134c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c9015d080 0x7f4c90137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90160f60 con 0x7f4c900d0280 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90160de0 con 0x7f4c9015d080 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4c901610e0 con 0x7f4c900cfe70 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c90134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c90134c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57602/0 (socket says 172.21.15.118:57602) 2024-09-21T06:09:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 -- 172.21.15.118:0/127420819 learned_addr learned my addr 172.21.15.118:0/127420819 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8de00640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c900cfe70 0x7f4c90138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8e800640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c9015d080 0x7f4c90137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 -- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c900cfe70 msgr2=0x7f4c90138100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c900cfe70 0x7f4c90138100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 -- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c9015d080 msgr2=0x7f4c90137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c9015d080 0x7f4c90137560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.881+0000 7f4c8d400640 1 -- 172.21.15.118:0/127420819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c900c7870 con 0x7f4c900d0280 2024-09-21T06:09:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.882+0000 7f4c8d400640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c90134c40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00e7f0 tx=0x7f4c7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.882+0000 7f4c86000640 1 -- 172.21.15.118:0/127420819 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00ccc0 con 0x7f4c900d0280 2024-09-21T06:09:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.882+0000 7f4c86000640 1 -- 172.21.15.118:0/127420819 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c7c00ce80 con 0x7f4c900d0280 2024-09-21T06:09:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.882+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c90135650 con 0x7f4c900d0280 2024-09-21T06:09:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.882+0000 7f4c86000640 1 -- 172.21.15.118:0/127420819 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c005280 con 0x7f4c900d0280 2024-09-21T06:09:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.882+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c90135180 con 0x7f4c900d0280 2024-09-21T06:09:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.883+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c900c75e0 con 0x7f4c900d0280 2024-09-21T06:09:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.884+0000 7f4c86000640 1 -- 172.21.15.118:0/127420819 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c7c005420 con 0x7f4c900d0280 2024-09-21T06:09:39.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.885+0000 7f4c86000640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4c70078b90 0x7f4c7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:39.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.885+0000 7f4c86000640 1 -- 172.21.15.118:0/127420819 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f4c7c09b610 con 0x7f4c900d0280 2024-09-21T06:09:39.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.886+0000 7f4c8de00640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4c70078b90 0x7f4c7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:39.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.886+0000 7f4c8de00640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4c70078b90 0x7f4c7007b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c80004510 tx=0x7f4c8000b390 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:39.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:39.890+0000 7f4c86000640 1 -- 172.21.15.118:0/127420819 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4c7c063400 con 0x7f4c900d0280 2024-09-21T06:09:40.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.115+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c90146080 con 0x7f4c900d0280 2024-09-21T06:09:40.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.116+0000 7f4c86000640 1 -- 172.21.15.118:0/127420819 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7f4c7c06c020 con 0x7f4c900d0280 2024-09-21T06:09:40.118 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:40.119 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:40.119 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4c70078b90 msgr2=0x7f4c7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4c70078b90 0x7f4c7007b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c80004510 tx=0x7f4c8000b390 comp rx=0 tx=0).stop 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 msgr2=0x7f4c90134c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c90134c40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00e7f0 tx=0x7f4c7c00ecb0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 shutdown_connections 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c9015d080 0x7f4c90137560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c900d0280 0x7f4c90134c40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4c70078b90 0x7f4c7007b0a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 --2- 172.21.15.118:0/127420819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c900cfe70 0x7f4c90138100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 >> 172.21.15.118:0/127420819 conn(0x7f4c9006d6e0 msgr2=0x7f4c90157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:40.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 shutdown_connections 2024-09-21T06:09:40.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.118+0000 7f4c8f200640 1 -- 172.21.15.118:0/127420819 wait complete. 2024-09-21T06:09:40.142 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:40.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.361+0000 7fecd8600640 1 -- 172.21.15.118:0/2434035686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecb8004800 msgr2=0x7fecb8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.361+0000 7fecd8600640 1 --2- 172.21.15.118:0/2434035686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecb8004800 0x7fecb8004c10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c2e0 tx=0x7fecb8005830 comp rx=0 tx=0).stop 2024-09-21T06:09:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.361+0000 7fecd6600640 1 -- 172.21.15.118:0/2434035686 reap_dead start 2024-09-21T06:09:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.361+0000 7fecd8600640 1 -- 172.21.15.118:0/2434035686 shutdown_connections 2024-09-21T06:09:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.361+0000 7fecd8600640 1 -- 172.21.15.118:0/2434035686 >> 172.21.15.118:0/2434035686 conn(0x7fecd006d110 msgr2=0x7fecd006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.361+0000 7fecd8600640 1 -- 172.21.15.118:0/2434035686 shutdown_connections 2024-09-21T06:09:40.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.361+0000 7fecd8600640 1 -- 172.21.15.118:0/2434035686 wait complete. 2024-09-21T06:09:40.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.364+0000 7fecd8600640 1 Processor -- start 2024-09-21T06:09:40.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.364+0000 7fecd8600640 1 -- start start 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd8600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecb8004800 0x7fecd01f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd8600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd014e010 0x7fecd01e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd8600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd01e7610 0x7fecd00ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd8600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fecd006f550 con 0x7fecd014e010 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd8600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00d07a0 con 0x7fecd01e7610 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd8600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fecd0070dc0 con 0x7fecb8004800 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd5200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd014e010 0x7fecd01e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd5200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd014e010 0x7fecd01e70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57626/0 (socket says 172.21.15.118:57626) 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd5200640 1 -- 172.21.15.118:0/425600132 learned_addr learned my addr 172.21.15.118:0/425600132 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd5c00640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecb8004800 0x7fecd01f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.365+0000 7fecd6600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd01e7610 0x7fecd00ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7fecd5200640 1 -- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecb8004800 msgr2=0x7fecd01f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7fecd5200640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecb8004800 0x7fecd01f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7fecd5200640 1 -- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd01e7610 msgr2=0x7fecd00ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7fecd5200640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd01e7610 0x7fecd00ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7fecd5200640 1 -- 172.21.15.118:0/425600132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd01e7a20 con 0x7fecd014e010 2024-09-21T06:09:40.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7fecd5200640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd014e010 0x7fecd01e70d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fecbc02b070 tx=0x7fecbc001200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:40.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7feccd600640 1 -- 172.21.15.118:0/425600132 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc032030 con 0x7fecd014e010 2024-09-21T06:09:40.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7feccd600640 1 -- 172.21.15.118:0/425600132 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecbc003810 con 0x7fecd014e010 2024-09-21T06:09:40.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd00cd5c0 con 0x7fecd014e010 2024-09-21T06:09:40.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.366+0000 7feccd600640 1 -- 172.21.15.118:0/425600132 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc003c40 con 0x7fecd014e010 2024-09-21T06:09:40.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.367+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd01ebe30 con 0x7fecd014e010 2024-09-21T06:09:40.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.368+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd015f740 con 0x7fecd014e010 2024-09-21T06:09:40.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.369+0000 7feccd600640 1 -- 172.21.15.118:0/425600132 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fecbc035020 con 0x7fecd014e010 2024-09-21T06:09:40.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.370+0000 7feccd600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecb0078b90 0x7fecb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.370+0000 7feccd600640 1 -- 172.21.15.118:0/425600132 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7fecbc0bb030 con 0x7fecd014e010 2024-09-21T06:09:40.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.370+0000 7fecd5c00640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecb0078b90 0x7fecb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.371+0000 7fecd5c00640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecb0078b90 0x7fecb007b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fecc4005eb0 tx=0x7fecc4010040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:40.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.374+0000 7feccd600640 1 -- 172.21.15.118:0/425600132 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fecbc047030 con 0x7fecd014e010 2024-09-21T06:09:40.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.599+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecd0074f10 con 0x7fecd014e010 2024-09-21T06:09:40.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.599+0000 7feccd600640 1 -- 172.21.15.118:0/425600132 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5228 (secure 0 0 0) 0x7fecd01e7a20 con 0x7fecd014e010 2024-09-21T06:09:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:40.602 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":51,"btime":"2024-09-21T06:09:03:340692+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:08:59.444784+0000","modified":"2024-09-21T06:09:02.831855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6249":{"gid":6249,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/1882776841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1882776841},{"type":"v1","addr":"172.21.15.118:6834","nonce":1882776841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6249,"qdb_cluster":[6249]},"id":6}]} 2024-09-21T06:09:40.602 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 51 2024-09-21T06:09:40.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecb0078b90 msgr2=0x7fecb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecb0078b90 0x7fecb007b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fecc4005eb0 tx=0x7fecc4010040 comp rx=0 tx=0).stop 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd014e010 msgr2=0x7fecd01e70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd014e010 0x7fecd01e70d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fecbc02b070 tx=0x7fecbc001200 comp rx=0 tx=0).stop 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 shutdown_connections 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecd01e7610 0x7fecd00ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecd014e010 0x7fecd01e70d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fecb0078b90 0x7fecb007b0a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 --2- 172.21.15.118:0/425600132 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fecb8004800 0x7fecd01f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 >> 172.21.15.118:0/425600132 conn(0x7fecd006d110 msgr2=0x7fecd015a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 shutdown_connections 2024-09-21T06:09:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.602+0000 7fecd8600640 1 -- 172.21.15.118:0/425600132 wait complete. 2024-09-21T06:09:40.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 -- 172.21.15.118:0/2787234911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 msgr2=0x7f2b700b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 --2- 172.21.15.118:0/2787234911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700b3d10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2b700d2760 tx=0x7f2b5c02a560 comp rx=0 tx=0).stop 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 -- 172.21.15.118:0/2787234911 shutdown_connections 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 --2- 172.21.15.118:0/2787234911 >> v2:172.21.15.149:3300/0 conn(0x7f2b700d13c0 0x7f2b700d17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 --2- 172.21.15.118:0/2787234911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700b3d10 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 -- 172.21.15.118:0/2787234911 >> 172.21.15.118:0/2787234911 conn(0x7f2b700d4be0 msgr2=0x7f2b700d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 -- 172.21.15.118:0/2787234911 shutdown_connections 2024-09-21T06:09:40.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.846+0000 7f2b6f200640 1 -- 172.21.15.118:0/2787234911 wait complete. 2024-09-21T06:09:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.849+0000 7f2b6f200640 1 Processor -- start 2024-09-21T06:09:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.849+0000 7f2b6f200640 1 -- start start 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.850+0000 7f2b6f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b700b9f30 0x7f2b7014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.850+0000 7f2b6f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b700d13c0 0x7f2b7015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.850+0000 7f2b6f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.850+0000 7f2b6f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2b700d32b0 con 0x7f2b700d5700 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.850+0000 7f2b6f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2b700d3130 con 0x7f2b700b9f30 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.850+0000 7f2b6f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2b700d3430 con 0x7f2b700d13c0 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57654/0 (socket says 172.21.15.118:57654) 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 -- 172.21.15.118:0/962478806 learned_addr learned my addr 172.21.15.118:0/962478806 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6d400640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b700d13c0 0x7f2b7015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6de00640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b700b9f30 0x7f2b7014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 -- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b700d13c0 msgr2=0x7f2b7015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b700d13c0 0x7f2b7015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 -- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b700b9f30 msgr2=0x7f2b7014d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b700b9f30 0x7f2b7014d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 -- 172.21.15.118:0/962478806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7014dcb0 con 0x7f2b700d5700 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6d400640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b700d13c0 0x7f2b7015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b6e800640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700a22e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800d650 tx=0x7f2b6800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.851+0000 7f2b66000640 1 -- 172.21.15.118:0/962478806 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68017070 con 0x7f2b700d5700 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.852+0000 7f2b66000640 1 -- 172.21.15.118:0/962478806 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b68005310 con 0x7f2b700d5700 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.852+0000 7f2b66000640 1 -- 172.21.15.118:0/962478806 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68009820 con 0x7f2b700d5700 2024-09-21T06:09:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.852+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7015cd20 con 0x7f2b700d5700 2024-09-21T06:09:40.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.852+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b70160070 con 0x7f2b700d5700 2024-09-21T06:09:40.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.853+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b700d17d0 con 0x7f2b700d5700 2024-09-21T06:09:40.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.854+0000 7f2b66000640 1 -- 172.21.15.118:0/962478806 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b680099c0 con 0x7f2b700d5700 2024-09-21T06:09:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.855+0000 7f2b66000640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b50078bc0 0x7f2b5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.855+0000 7f2b66000640 1 -- 172.21.15.118:0/962478806 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f2b6809ada0 con 0x7f2b700d5700 2024-09-21T06:09:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.855+0000 7f2b6de00640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b50078bc0 0x7f2b5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.856+0000 7f2b6de00640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b50078bc0 0x7f2b5007b0d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2b60007fd0 tx=0x7f2b60009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:40.859+0000 7f2b66000640 1 -- 172.21.15.118:0/962478806 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2b7014dcb0 con 0x7f2b700d5700 2024-09-21T06:09:41.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.044+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b700d2510 con 0x7f2b700d5700 2024-09-21T06:09:41.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.045+0000 7f2b66000640 1 -- 172.21.15.118:0/962478806 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16796 (secure 0 0 0) 0x7f2b68062af0 con 0x7f2b700d5700 2024-09-21T06:09:41.047 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:41.048 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":106,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:09:31.499032+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:08:57.351669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T06:08:58.408649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b50078bc0 msgr2=0x7f2b5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b50078bc0 0x7f2b5007b0d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2b60007fd0 tx=0x7f2b60009040 comp rx=0 tx=0).stop 2024-09-21T06:09:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 msgr2=0x7f2b700a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700a22e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800d650 tx=0x7f2b6800db10 comp rx=0 tx=0).stop 2024-09-21T06:09:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 shutdown_connections 2024-09-21T06:09:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b700d5700 0x7f2b700a22e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b50078bc0 0x7f2b5007b0d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b700d13c0 0x7f2b7015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 --2- 172.21.15.118:0/962478806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b700b9f30 0x7f2b7014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.047+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 >> 172.21.15.118:0/962478806 conn(0x7f2b700d4be0 msgr2=0x7f2b700d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:41.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.048+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 shutdown_connections 2024-09-21T06:09:41.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.048+0000 7f2b6f200640 1 -- 172.21.15.118:0/962478806 wait complete. 2024-09-21T06:09:41.074 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:09:41.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.292+0000 7f6fe4200640 1 -- 172.21.15.118:0/686887502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 msgr2=0x7f6fdc15dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.292+0000 7f6fe4200640 1 --2- 172.21.15.118:0/686887502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 0x7f6fdc15dc40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009830 tx=0x7f6fd002a520 comp rx=0 tx=0).stop 2024-09-21T06:09:41.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.292+0000 7f6fe4200640 1 -- 172.21.15.118:0/686887502 shutdown_connections 2024-09-21T06:09:41.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.292+0000 7f6fe4200640 1 --2- 172.21.15.118:0/686887502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 0x7f6fdc15dc40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.292+0000 7f6fe4200640 1 -- 172.21.15.118:0/686887502 >> 172.21.15.118:0/686887502 conn(0x7f6fdc06d110 msgr2=0x7f6fdc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:41.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.292+0000 7f6fe4200640 1 -- 172.21.15.118:0/686887502 shutdown_connections 2024-09-21T06:09:41.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.292+0000 7f6fe4200640 1 -- 172.21.15.118:0/686887502 wait complete. 2024-09-21T06:09:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.294+0000 7f6fe4200640 1 Processor -- start 2024-09-21T06:09:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.294+0000 7f6fe4200640 1 -- start start 2024-09-21T06:09:41.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe4200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc0cf170 0x7f6fdc1f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe4200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fdc0d0ea0 0x7f6fdc1f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe4200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 0x7f6fdc142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe4200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc0cfc90 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe4200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc15d8d0 con 0x7f6fdc13fd80 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe4200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6fdc0cfe10 con 0x7f6fdc0cf170 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe0e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fdc0d0ea0 0x7f6fdc1f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe0e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fdc0d0ea0 0x7f6fdc1f9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57658/0 (socket says 172.21.15.118:57658) 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.296+0000 7f6fe0e00640 1 -- 172.21.15.118:0/3231632639 learned_addr learned my addr 172.21.15.118:0/3231632639 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe1800640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc0cf170 0x7f6fdc1f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe2200640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 0x7f6fdc142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe0e00640 1 -- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc0cf170 msgr2=0x7f6fdc1f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe0e00640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc0cf170 0x7f6fdc1f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe0e00640 1 -- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 msgr2=0x7f6fdc142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe0e00640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 0x7f6fdc142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe0e00640 1 -- 172.21.15.118:0/3231632639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fdc1f6470 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe1800640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc0cf170 0x7f6fdc1f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe0e00640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fdc0d0ea0 0x7f6fdc1f9b70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c460 tx=0x7f6fc800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:41.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fd9600640 1 -- 172.21.15.118:0/3231632639 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8016020 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fd9600640 1 -- 172.21.15.118:0/3231632639 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fc8012940 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fdc1f6750 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.297+0000 7f6fd9600640 1 -- 172.21.15.118:0/3231632639 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8012d90 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.298+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fdc1fa0b0 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.299+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fdc155fa0 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.300+0000 7f6fd9600640 1 -- 172.21.15.118:0/3231632639 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6fc8019020 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.301+0000 7f6fd9600640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6fbc078bc0 0x7f6fbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.302+0000 7f6fd9600640 1 -- 172.21.15.118:0/3231632639 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f6fc809a920 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.302+0000 7f6fe1800640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6fbc078bc0 0x7f6fbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.303+0000 7f6fe1800640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6fbc078bc0 0x7f6fbc07b0d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0034000 tx=0x7f6fd0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.306+0000 7f6fd9600640 1 -- 172.21.15.118:0/3231632639 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6fc8020030 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.532+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6fdc1f6200 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.535 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:09:41.533+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:09:41.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.535+0000 7f6fd9600640 1 -- 172.21.15.118:0/3231632639 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) ==== 161+0+0 (secure 0 0 0) 0x7f6fc8062d70 con 0x7f6fdc0d0ea0 2024-09-21T06:09:41.538 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:09:41.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6fbc078bc0 msgr2=0x7f6fbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6fbc078bc0 0x7f6fbc07b0d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0034000 tx=0x7f6fd0004730 comp rx=0 tx=0).stop 2024-09-21T06:09:41.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fdc0d0ea0 msgr2=0x7f6fdc1f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fdc0d0ea0 0x7f6fdc1f9b70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c460 tx=0x7f6fc800c920 comp rx=0 tx=0).stop 2024-09-21T06:09:41.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 shutdown_connections 2024-09-21T06:09:41.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc13fd80 0x7f6fdc142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fdc0d0ea0 0x7f6fdc1f9b70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6fbc078bc0 0x7f6fbc07b0d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 --2- 172.21.15.118:0/3231632639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc0cf170 0x7f6fdc1f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.540+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 >> 172.21.15.118:0/3231632639 conn(0x7f6fdc06d110 msgr2=0x7f6fdc13f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:41.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.541+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 shutdown_connections 2024-09-21T06:09:41.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.541+0000 7f6fe4200640 1 -- 172.21.15.118:0/3231632639 wait complete. 2024-09-21T06:09:41.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:09:41.680 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:09:41.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.788+0000 7f2528c00640 1 -- 172.21.15.118:0/3839686070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 msgr2=0x7f25240d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.788+0000 7f2528c00640 1 --2- 172.21.15.118:0/3839686070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25240d0ee0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2514005fd0 tx=0x7f251402a540 comp rx=0 tx=0).stop 2024-09-21T06:09:41.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.788+0000 7f2528c00640 1 -- 172.21.15.118:0/3839686070 shutdown_connections 2024-09-21T06:09:41.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.788+0000 7f2528c00640 1 --2- 172.21.15.118:0/3839686070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f25240d1420 0x7f25241426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.788+0000 7f2528c00640 1 --2- 172.21.15.118:0/3839686070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25240d0ee0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.788+0000 7f2528c00640 1 -- 172.21.15.118:0/3839686070 >> 172.21.15.118:0/3839686070 conn(0x7f252406d110 msgr2=0x7f252406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:41.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.789+0000 7f2528c00640 1 -- 172.21.15.118:0/3839686070 shutdown_connections 2024-09-21T06:09:41.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.789+0000 7f2528c00640 1 -- 172.21.15.118:0/3839686070 wait complete. 2024-09-21T06:09:41.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.791+0000 7f2528c00640 1 Processor -- start 2024-09-21T06:09:41.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.791+0000 7f2528c00640 1 -- start start 2024-09-21T06:09:41.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.792+0000 7f2528c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25240d1420 0x7f2524153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.792+0000 7f2528c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25241f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.792+0000 7f2528c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2524142c00 0x7f2524154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.792+0000 7f2528c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f25240d0460 con 0x7f252413fe10 2024-09-21T06:09:41.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.792+0000 7f2528c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f252406f3e0 con 0x7f25240d1420 2024-09-21T06:09:41.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.792+0000 7f2528c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f25241576c0 con 0x7f2524142c00 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25241f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25241f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57670/0 (socket says 172.21.15.118:57670) 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 -- 172.21.15.118:0/3685191631 learned_addr learned my addr 172.21.15.118:0/3685191631 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2521e00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25240d1420 0x7f2524153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2522800640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2524142c00 0x7f2524154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 -- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2524142c00 msgr2=0x7f2524154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2524142c00 0x7f2524154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 -- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25240d1420 msgr2=0x7f2524153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25240d1420 0x7f2524153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 -- 172.21.15.118:0/3685191631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2524153a80 con 0x7f252413fe10 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2522800640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2524142c00 0x7f2524154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:41.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f2519400640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25241f71a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f250c00d7a0 tx=0x7f250c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f251aa00640 1 -- 172.21.15.118:0/3685191631 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c017070 con 0x7f252413fe10 2024-09-21T06:09:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.793+0000 7f251aa00640 1 -- 172.21.15.118:0/3685191631 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f250c009d20 con 0x7f252413fe10 2024-09-21T06:09:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.794+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25241f7f10 con 0x7f252413fe10 2024-09-21T06:09:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.794+0000 7f251aa00640 1 -- 172.21.15.118:0/3685191631 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c004280 con 0x7f252413fe10 2024-09-21T06:09:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.794+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25241f4100 con 0x7f252413fe10 2024-09-21T06:09:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.795+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252406f900 con 0x7f252413fe10 2024-09-21T06:09:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.796+0000 7f251aa00640 1 -- 172.21.15.118:0/3685191631 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f250c005020 con 0x7f252413fe10 2024-09-21T06:09:41.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.797+0000 7f251aa00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2500078bc0 0x7f250007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.797+0000 7f251aa00640 1 -- 172.21.15.118:0/3685191631 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5795+0+0 (secure 0 0 0) 0x7f250c09b0c0 con 0x7f252413fe10 2024-09-21T06:09:41.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.798+0000 7f2521e00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2500078bc0 0x7f250007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.798+0000 7f2521e00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2500078bc0 0x7f250007b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2514033000 tx=0x7f2514004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:41.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:41.802+0000 7f251aa00640 1 -- 172.21.15.118:0/3685191631 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f250c020020 con 0x7f252413fe10 2024-09-21T06:09:42.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.026+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f252406ed70 con 0x7f252413fe10 2024-09-21T06:09:42.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.633+0000 7f251aa00640 1 -- 172.21.15.118:0/3685191631 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) ==== 104+0+0 (secure 0 0 0) 0x7f250c063490 con 0x7f252413fe10 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2500078bc0 msgr2=0x7f250007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2500078bc0 0x7f250007b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2514033000 tx=0x7f2514004730 comp rx=0 tx=0).stop 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 msgr2=0x7f25241f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25241f71a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f250c00d7a0 tx=0x7f250c00dc60 comp rx=0 tx=0).stop 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 shutdown_connections 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2500078bc0 0x7f250007b0d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2524142c00 0x7f2524154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f252413fe10 0x7f25241f71a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 --2- 172.21.15.118:0/3685191631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25240d1420 0x7f2524153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 >> 172.21.15.118:0/3685191631 conn(0x7f252406d110 msgr2=0x7f25240b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 shutdown_connections 2024-09-21T06:09:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.636+0000 7f2528c00640 1 -- 172.21.15.118:0/3685191631 wait complete. 2024-09-21T06:09:42.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:09:42.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 -- 172.21.15.118:0/2032761982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3514074460 msgr2=0x7f351415c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:42.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 --2- 172.21.15.118:0/2032761982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3514074460 0x7f351415c580 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f34fc005fd0 tx=0x7f34fc02a5d0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 -- 172.21.15.118:0/2032761982 shutdown_connections 2024-09-21T06:09:42.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 --2- 172.21.15.118:0/2032761982 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f351415cac0 0x7f3514071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 --2- 172.21.15.118:0/2032761982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3514074460 0x7f351415c580 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 -- 172.21.15.118:0/2032761982 >> 172.21.15.118:0/2032761982 conn(0x7f35140b38e0 msgr2=0x7f35140b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:42.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 -- 172.21.15.118:0/2032761982 shutdown_connections 2024-09-21T06:09:42.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.893+0000 7f3519800640 1 -- 172.21.15.118:0/2032761982 wait complete. 2024-09-21T06:09:42.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.895+0000 7f3519800640 1 Processor -- start 2024-09-21T06:09:42.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.895+0000 7f3519800640 1 -- start start 2024-09-21T06:09:42.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3519800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35140d13d0 0x7f3514143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3519800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f351415cac0 0x7f3514139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3519800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35141f71a0 0x7f35141f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3519800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3514071bf0 con 0x7f351415cac0 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3519800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3514071a70 con 0x7f35140d13d0 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3519800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3514071d70 con 0x7f35141f71a0 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f350a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f351415cac0 0x7f3514139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f350a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f351415cac0 0x7f3514139400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57698/0 (socket says 172.21.15.118:57698) 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f350a000640 1 -- 172.21.15.118:0/16931479 learned_addr learned my addr 172.21.15.118:0/16931479 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3513400640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35141f71a0 0x7f35141f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.897+0000 7f3512a00640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35140d13d0 0x7f3514143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350a000640 1 -- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35141f71a0 msgr2=0x7f35141f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350a000640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35141f71a0 0x7f35141f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350a000640 1 -- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35140d13d0 msgr2=0x7f3514143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350a000640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35140d13d0 0x7f3514143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350a000640 1 -- 172.21.15.118:0/16931479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3514139940 con 0x7f351415cac0 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f3513400640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35141f71a0 0x7f35141f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350a000640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f351415cac0 0x7f3514139400 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f34fc006010 tx=0x7f34fc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350b400640 1 -- 172.21.15.118:0/16931479 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc03e030 con 0x7f351415cac0 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350b400640 1 -- 172.21.15.118:0/16931479 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34fc003ca0 con 0x7f351415cac0 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35141593c0 con 0x7f351415cac0 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f350b400640 1 -- 172.21.15.118:0/16931479 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc035040 con 0x7f351415cac0 2024-09-21T06:09:42.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.898+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35140ac330 con 0x7f351415cac0 2024-09-21T06:09:42.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.900+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3514074610 con 0x7f351415cac0 2024-09-21T06:09:42.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.901+0000 7f350b400640 1 -- 172.21.15.118:0/16931479 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34fc041030 con 0x7f351415cac0 2024-09-21T06:09:42.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.902+0000 7f350b400640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34f0078b90 0x7f34f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:42.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.902+0000 7f350b400640 1 -- 172.21.15.118:0/16931479 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5853+0+0 (secure 0 0 0) 0x7f34fc0bb360 con 0x7f351415cac0 2024-09-21T06:09:42.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.902+0000 7f3512a00640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34f0078b90 0x7f34f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:42.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.903+0000 7f3512a00640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34f0078b90 0x7f34f007b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f35040015e0 tx=0x7f3504009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:42.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:42.906+0000 7f350b400640 1 -- 172.21.15.118:0/16931479 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3514074610 con 0x7f351415cac0 2024-09-21T06:09:43.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.091+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3514072220 con 0x7f351415cac0 2024-09-21T06:09:43.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.635+0000 7f350b400640 1 -- 172.21.15.118:0/16931479 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7f34fc0837a0 con 0x7f351415cac0 2024-09-21T06:09:43.638 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34f0078b90 msgr2=0x7f34f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34f0078b90 0x7f34f007b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f35040015e0 tx=0x7f3504009040 comp rx=0 tx=0).stop 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f351415cac0 msgr2=0x7f3514139400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f351415cac0 0x7f3514139400 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f34fc006010 tx=0x7f34fc0038a0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 shutdown_connections 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34f0078b90 0x7f34f007b0a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f35141f71a0 0x7f35141f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f351415cac0 0x7f3514139400 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 --2- 172.21.15.118:0/16931479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35140d13d0 0x7f3514143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 >> 172.21.15.118:0/16931479 conn(0x7f35140b38e0 msgr2=0x7f35140b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 shutdown_connections 2024-09-21T06:09:43.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.639+0000 7f3519800640 1 -- 172.21.15.118:0/16931479 wait complete. 2024-09-21T06:09:43.670 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:09:43.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 -- 172.21.15.118:0/3407648646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a40cde10 msgr2=0x7f76a40ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:43.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 --2- 172.21.15.118:0/3407648646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a40cde10 0x7f76a40ce940 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f76a40b4830 tx=0x7f769c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:09:43.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 -- 172.21.15.118:0/3407648646 shutdown_connections 2024-09-21T06:09:43.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 --2- 172.21.15.118:0/3407648646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a40cde10 0x7f76a40ce940 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 --2- 172.21.15.118:0/3407648646 >> v2:172.21.15.149:3300/0 conn(0x7f76a41597a0 0x7f76a40cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 -- 172.21.15.118:0/3407648646 >> 172.21.15.118:0/3407648646 conn(0x7f76a406cf30 msgr2=0x7f76a406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:43.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 -- 172.21.15.118:0/3407648646 shutdown_connections 2024-09-21T06:09:43.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.895+0000 7f76aa400640 1 -- 172.21.15.118:0/3407648646 wait complete. 2024-09-21T06:09:43.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.897+0000 7f76aa400640 1 Processor -- start 2024-09-21T06:09:43.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.897+0000 7f76aa400640 1 -- start start 2024-09-21T06:09:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76aa400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a40cde10 0x7f76a41484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76aa400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a41597a0 0x7f76a40b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76aa400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a415cda0 0x7f76a41e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76aa400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40cfde0 con 0x7f76a41597a0 2024-09-21T06:09:43.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76aa400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40cfc60 con 0x7f76a40cde10 2024-09-21T06:09:43.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76aa400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76a40cee80 con 0x7f76a415cda0 2024-09-21T06:09:43.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a41597a0 0x7f76a40b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:43.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a41597a0 0x7f76a40b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57714/0 (socket says 172.21.15.118:57714) 2024-09-21T06:09:43.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 -- 172.21.15.118:0/3441207848 learned_addr learned my addr 172.21.15.118:0/3441207848 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:43.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a3400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a40cde10 0x7f76a41484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:43.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a3e00640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a415cda0 0x7f76a41e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 -- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a415cda0 msgr2=0x7f76a41e7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a415cda0 0x7f76a41e7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 -- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a40cde10 msgr2=0x7f76a41484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a40cde10 0x7f76a41484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a2a00640 1 -- 172.21.15.118:0/3441207848 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a41e6400 con 0x7f76a41597a0 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.899+0000 7f76a3400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a40cde10 0x7f76a41484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.900+0000 7f76a2a00640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a41597a0 0x7f76a40b3080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f769000d770 tx=0x7f769000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:43.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.900+0000 7f769b400640 1 -- 172.21.15.118:0/3441207848 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690017070 con 0x7f76a41597a0 2024-09-21T06:09:43.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.900+0000 7f769b400640 1 -- 172.21.15.118:0/3441207848 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7690009d20 con 0x7f76a41597a0 2024-09-21T06:09:43.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.900+0000 7f769b400640 1 -- 172.21.15.118:0/3441207848 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76900106c0 con 0x7f76a41597a0 2024-09-21T06:09:43.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.900+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a41e66e0 con 0x7f76a41597a0 2024-09-21T06:09:43.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.900+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a41e6ca0 con 0x7f76a41597a0 2024-09-21T06:09:43.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.901+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a41e6170 con 0x7f76a41597a0 2024-09-21T06:09:43.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.902+0000 7f769b400640 1 -- 172.21.15.118:0/3441207848 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f769001a070 con 0x7f76a41597a0 2024-09-21T06:09:43.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.903+0000 7f769b400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7684078b90 0x7f768407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:43.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.903+0000 7f769b400640 1 -- 172.21.15.118:0/3441207848 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5415+0+0 (secure 0 0 0) 0x7f769009acf0 con 0x7f76a41597a0 2024-09-21T06:09:43.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.904+0000 7f76a3400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7684078b90 0x7f768407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:43.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.904+0000 7f76a3400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7684078b90 0x7f768407b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7694000f60 tx=0x7f7694009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:43.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:43.908+0000 7f769b400640 1 -- 172.21.15.118:0/3441207848 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7690062bf0 con 0x7f76a41597a0 2024-09-21T06:09:44.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.093+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f76a40cf3c0 con 0x7f76a41597a0 2024-09-21T06:09:44.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.643+0000 7f769b400640 1 -- 172.21.15.118:0/3441207848 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7f7690067620 con 0x7f76a41597a0 2024-09-21T06:09:44.647 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:09:44.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7684078b90 msgr2=0x7f768407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:44.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7684078b90 0x7f768407b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7694000f60 tx=0x7f7694009040 comp rx=0 tx=0).stop 2024-09-21T06:09:44.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a41597a0 msgr2=0x7f76a40b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:44.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a41597a0 0x7f76a40b3080 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f769000d770 tx=0x7f769000dc30 comp rx=0 tx=0).stop 2024-09-21T06:09:44.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 shutdown_connections 2024-09-21T06:09:44.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7684078b90 0x7f768407b0a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a415cda0 0x7f76a41e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76a41597a0 0x7f76a40b3080 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 --2- 172.21.15.118:0/3441207848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a40cde10 0x7f76a41484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 >> 172.21.15.118:0/3441207848 conn(0x7f76a406cf30 msgr2=0x7f76a406f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:44.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.647+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 shutdown_connections 2024-09-21T06:09:44.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.648+0000 7f76aa400640 1 -- 172.21.15.118:0/3441207848 wait complete. 2024-09-21T06:09:44.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:09:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 -- 172.21.15.118:0/2538189073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 msgr2=0x7fd3c00d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:44.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/2538189073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 0x7fd3c00d0e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009830 tx=0x7fd3b402a480 comp rx=0 tx=0).stop 2024-09-21T06:09:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 -- 172.21.15.118:0/2538189073 shutdown_connections 2024-09-21T06:09:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/2538189073 >> v2:172.21.15.149:3300/0 conn(0x7fd3c013fef0 0x7fd3c00d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/2538189073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 0x7fd3c00d0e80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 -- 172.21.15.118:0/2538189073 >> 172.21.15.118:0/2538189073 conn(0x7fd3c006d110 msgr2=0x7fd3c006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 -- 172.21.15.118:0/2538189073 shutdown_connections 2024-09-21T06:09:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.899+0000 7fd3c7e00640 1 -- 172.21.15.118:0/2538189073 wait complete. 2024-09-21T06:09:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.901+0000 7fd3c7e00640 1 Processor -- start 2024-09-21T06:09:44.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.901+0000 7fd3c7e00640 1 -- start start 2024-09-21T06:09:44.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 0x7fd3c0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:44.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c013fef0 0x7fd3c0157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:44.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0142730 0x7fd3c0158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c7e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00cfac0 con 0x7fd3c0142730 2024-09-21T06:09:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00cf940 con 0x7fd3c013fef0 2024-09-21T06:09:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c00cfc40 con 0x7fd3c013fae0 2024-09-21T06:09:44.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0142730 0x7fd3c0158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0142730 0x7fd3c0158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57716/0 (socket says 172.21.15.118:57716) 2024-09-21T06:09:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c5e00640 1 -- 172.21.15.118:0/1541041146 learned_addr learned my addr 172.21.15.118:0/1541041146 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c4a00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c013fef0 0x7fd3c0157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.903+0000 7fd3c5400640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 0x7fd3c0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:44.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c5e00640 1 -- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 msgr2=0x7fd3c0156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:44.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c5e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 0x7fd3c0156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c5e00640 1 -- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c013fef0 msgr2=0x7fd3c0157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:44.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c5e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c013fef0 0x7fd3c0157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c5e00640 1 -- 172.21.15.118:0/1541041146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c013eab0 con 0x7fd3c0142730 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c5400640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 0x7fd3c0156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c5e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0142730 0x7fd3c0158020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800cb00 tx=0x7fd3b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3bd600640 1 -- 172.21.15.118:0/1541041146 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8016020 con 0x7fd3c0142730 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3bd600640 1 -- 172.21.15.118:0/1541041146 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3b800acd0 con 0x7fd3c0142730 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c015ad90 con 0x7fd3c0142730 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3bd600640 1 -- 172.21.15.118:0/1541041146 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8012680 con 0x7fd3c0142730 2024-09-21T06:09:44.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.904+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c013dfd0 con 0x7fd3c0142730 2024-09-21T06:09:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.905+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c00cd8c0 con 0x7fd3c0142730 2024-09-21T06:09:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.907+0000 7fd3bd600640 1 -- 172.21.15.118:0/1541041146 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3b8019020 con 0x7fd3c0142730 2024-09-21T06:09:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.907+0000 7fd3bd600640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3a0078bc0 0x7fd3a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.908+0000 7fd3bd600640 1 -- 172.21.15.118:0/1541041146 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7fd3b809af70 con 0x7fd3c0142730 2024-09-21T06:09:44.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.908+0000 7fd3c5400640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3a0078bc0 0x7fd3a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:44.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.909+0000 7fd3c5400640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3a0078bc0 0x7fd3a007b0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4034000 tx=0x7fd3b4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:44.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:44.912+0000 7fd3bd600640 1 -- 172.21.15.118:0/1541041146 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd3b8020020 con 0x7fd3c0142730 2024-09-21T06:09:45.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.099+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fd3c00d00f0 con 0x7fd3c0142730 2024-09-21T06:09:45.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.103+0000 7fd3bd600640 1 -- 172.21.15.118:0/1541041146 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7fd3b8063620 con 0x7fd3c0142730 2024-09-21T06:09:45.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3a0078bc0 msgr2=0x7fd3a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3a0078bc0 0x7fd3a007b0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4034000 tx=0x7fd3b4004730 comp rx=0 tx=0).stop 2024-09-21T06:09:45.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0142730 msgr2=0x7fd3c0158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0142730 0x7fd3c0158020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800cb00 tx=0x7fd3b800a060 comp rx=0 tx=0).stop 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 shutdown_connections 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0142730 0x7fd3c0158020 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c013fef0 0x7fd3c0157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3a0078bc0 0x7fd3a007b0d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 --2- 172.21.15.118:0/1541041146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3c013fae0 0x7fd3c0156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.105+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 >> 172.21.15.118:0/1541041146 conn(0x7fd3c006d110 msgr2=0x7fd3c006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.106+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 shutdown_connections 2024-09-21T06:09:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.106+0000 7fd3c7e00640 1 -- 172.21.15.118:0/1541041146 wait complete. 2024-09-21T06:09:45.131 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-21T06:09:45.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.349+0000 7f7238a00640 1 -- 172.21.15.118:0/1998303973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723415f350 msgr2=0x7f7234163350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.349+0000 7f7238a00640 1 --2- 172.21.15.118:0/1998303973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723415f350 0x7f7234163350 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7224009830 tx=0x7f722402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.349+0000 7f7238a00640 1 -- 172.21.15.118:0/1998303973 shutdown_connections 2024-09-21T06:09:45.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.349+0000 7f7238a00640 1 --2- 172.21.15.118:0/1998303973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7234141df0 0x7f72340cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.349+0000 7f7238a00640 1 --2- 172.21.15.118:0/1998303973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723415f350 0x7f7234163350 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.349+0000 7f7238a00640 1 -- 172.21.15.118:0/1998303973 >> 172.21.15.118:0/1998303973 conn(0x7f723406d6e0 msgr2=0x7f72340b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:45.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.350+0000 7f7238a00640 1 -- 172.21.15.118:0/1998303973 shutdown_connections 2024-09-21T06:09:45.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.350+0000 7f7238a00640 1 -- 172.21.15.118:0/1998303973 wait complete. 2024-09-21T06:09:45.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.352+0000 7f7238a00640 1 Processor -- start 2024-09-21T06:09:45.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.352+0000 7f7238a00640 1 -- start start 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.353+0000 7f7238a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72341419e0 0x7f72341401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.353+0000 7f7238a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234141df0 0x7f723415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.353+0000 7f7238a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72341422a0 0x7f723415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.353+0000 7f7238a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f72340d0180 con 0x7f72341419e0 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.353+0000 7f7238a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72340d0000 con 0x7f7234141df0 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.353+0000 7f7238a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72340d0300 con 0x7f72341422a0 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.353+0000 7f7232800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72341419e0 0x7f72341401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72341419e0 0x7f72341401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57732/0 (socket says 172.21.15.118:57732) 2024-09-21T06:09:45.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 -- 172.21.15.118:0/17971371 learned_addr learned my addr 172.21.15.118:0/17971371 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:45.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7233200640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72341422a0 0x7f723415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7229e00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234141df0 0x7f723415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 -- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72341422a0 msgr2=0x7f723415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72341422a0 0x7f723415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 -- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234141df0 msgr2=0x7f723415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234141df0 0x7f723415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 -- 172.21.15.118:0/17971371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723415c830 con 0x7f72341419e0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7229e00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234141df0 0x7f723415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.354+0000 7f7232800640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72341419e0 0x7f72341401b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f722402aa90 tx=0x7f7224003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.355+0000 7f722b400640 1 -- 172.21.15.118:0/17971371 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224005c90 con 0x7f72341419e0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.355+0000 7f722b400640 1 -- 172.21.15.118:0/17971371 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7224005020 con 0x7f72341419e0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.355+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723415cad0 con 0x7f72341419e0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.355+0000 7f722b400640 1 -- 172.21.15.118:0/17971371 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224005450 con 0x7f72341419e0 2024-09-21T06:09:45.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.355+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723415af30 con 0x7f72341419e0 2024-09-21T06:09:45.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.356+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723415cd10 con 0x7f72341419e0 2024-09-21T06:09:45.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.357+0000 7f722b400640 1 -- 172.21.15.118:0/17971371 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72240317c0 con 0x7f72341419e0 2024-09-21T06:09:45.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.358+0000 7f722b400640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7210078bc0 0x7f721007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.358+0000 7f722b400640 1 -- 172.21.15.118:0/17971371 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7f72240bbde0 con 0x7f72341419e0 2024-09-21T06:09:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.359+0000 7f7229e00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7210078bc0 0x7f721007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.359+0000 7f7229e00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7210078bc0 0x7f721007b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f72341444c0 tx=0x7f721c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:45.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.362+0000 7f722b400640 1 -- 172.21.15.118:0/17971371 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f723415cd10 con 0x7f72341419e0 2024-09-21T06:09:45.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.620+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7f7234159760 con 0x7f72341419e0 2024-09-21T06:09:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.645+0000 7f722b400640 1 -- 172.21.15.118:0/17971371 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v302) ==== 137+0+0 (secure 0 0 0) 0x7f7234159760 con 0x7f72341419e0 2024-09-21T06:09:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7210078bc0 msgr2=0x7f721007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7210078bc0 0x7f721007b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f72341444c0 tx=0x7f721c009040 comp rx=0 tx=0).stop 2024-09-21T06:09:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72341419e0 msgr2=0x7f72341401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72341419e0 0x7f72341401b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f722402aa90 tx=0x7f7224003c10 comp rx=0 tx=0).stop 2024-09-21T06:09:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 shutdown_connections 2024-09-21T06:09:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7210078bc0 0x7f721007b0d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72341422a0 0x7f723415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234141df0 0x7f723415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 --2- 172.21.15.118:0/17971371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72341419e0 0x7f72341401b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.647+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 >> 172.21.15.118:0/17971371 conn(0x7f723406d6e0 msgr2=0x7f7234163020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.648+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 shutdown_connections 2024-09-21T06:09:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.648+0000 7f7238a00640 1 -- 172.21.15.118:0/17971371 wait complete. 2024-09-21T06:09:45.676 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-21T06:09:45.676 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-21T06:09:45.677 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2024-09-21T06:09:45.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.897+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1026897396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa884004800 msgr2=0x7fa884004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.897+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1026897396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa884004800 0x7fa884004c10 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0070390 tx=0x7fa884005830 comp rx=0 tx=0).stop 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.898+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1026897396 shutdown_connections 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.898+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1026897396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa884004800 0x7fa884004c10 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.898+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1026897396 >> 172.21.15.118:0/1026897396 conn(0x7fa8a006d110 msgr2=0x7fa8a006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.898+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1026897396 shutdown_connections 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.898+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1026897396 wait complete. 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.900+0000 7fa8a5e00640 1 Processor -- start 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.900+0000 7fa8a5e00640 1 -- start start 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.901+0000 7fa8a5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004800 0x7fa8a0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.901+0000 7fa8a5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a0141620 0x7fa8a00b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.901+0000 7fa8a5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a0153040 0x7fa8a00b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.901+0000 7fa8a5e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0142c10 con 0x7fa8a0153040 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.901+0000 7fa8a5e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0142a90 con 0x7fa8a0141620 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.901+0000 7fa8a5e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a00d0ee0 con 0x7fa884004800 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a0153040 0x7fa8a00b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a0153040 0x7fa8a00b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55804/0 (socket says 172.21.15.118:55804) 2024-09-21T06:09:45.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 -- 172.21.15.118:0/1071604359 learned_addr learned my addr 172.21.15.118:0/1071604359 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:45.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89ea00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004800 0x7fa8a0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89e000640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a0141620 0x7fa8a00b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 -- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004800 msgr2=0x7fa8a0152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004800 0x7fa8a0152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 -- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a0141620 msgr2=0x7fa8a00b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a0141620 0x7fa8a00b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 -- 172.21.15.118:0/1071604359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a01f9220 con 0x7fa8a0153040 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.902+0000 7fa89f400640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a0153040 0x7fa8a00b4ff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa8a01544e0 tx=0x7fa898010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.903+0000 7fa897400640 1 -- 172.21.15.118:0/1071604359 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa898003970 con 0x7fa8a0153040 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.903+0000 7fa897400640 1 -- 172.21.15.118:0/1071604359 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa898015070 con 0x7fa8a0153040 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.903+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a01f9500 con 0x7fa8a0153040 2024-09-21T06:09:45.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.903+0000 7fa897400640 1 -- 172.21.15.118:0/1071604359 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa898004030 con 0x7fa8a0153040 2024-09-21T06:09:45.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.903+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a01f9ac0 con 0x7fa8a0153040 2024-09-21T06:09:45.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.904+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a01f8f80 con 0x7fa8a0153040 2024-09-21T06:09:45.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.905+0000 7fa897400640 1 -- 172.21.15.118:0/1071604359 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8980041d0 con 0x7fa8a0153040 2024-09-21T06:09:45.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.906+0000 7fa897400640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.906+0000 7fa897400640 1 -- 172.21.15.118:0/1071604359 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7fa89809b4c0 con 0x7fa8a0153040 2024-09-21T06:09:45.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.907+0000 7fa89ea00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.907+0000 7fa89ea00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa890001010 tx=0x7fa8900067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:45.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:45.910+0000 7fa897400640 1 -- 172.21.15.118:0/1071604359 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa8a01f8f80 con 0x7fa8a0153040 2024-09-21T06:09:46.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.095+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8a00d0210 con 0x7fa8a0153040 2024-09-21T06:09:46.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.096+0000 7fa897400640 1 -- 172.21.15.118:0/1071604359 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+13111 (secure 0 0 0) 0x7fa898063640 con 0x7fa8a0153040 2024-09-21T06:09:46.098 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:46.098 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":110,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:09:44.637284+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6834/1882776841":"2024-09-22T06:09:41.534284+0000","172.21.15.118:6833/1882776841":"2024-09-22T06:09:41.534284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 msgr2=0x7fa88007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa890001010 tx=0x7fa8900067a0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a0153040 msgr2=0x7fa8a00b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a0153040 0x7fa8a00b4ff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa8a01544e0 tx=0x7fa898010f40 comp rx=0 tx=0).stop 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 shutdown_connections 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8a0153040 0x7fa8a00b4ff0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a0141620 0x7fa8a00b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa880078b90 0x7fa88007b0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 --2- 172.21.15.118:0/1071604359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004800 0x7fa8a0152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 >> 172.21.15.118:0/1071604359 conn(0x7fa8a006d110 msgr2=0x7fa8a015bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:46.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 shutdown_connections 2024-09-21T06:09:46.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.098+0000 7fa8a5e00640 1 -- 172.21.15.118:0/1071604359 wait complete. 2024-09-21T06:09:46.124 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:09:46.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:09:46.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 -- 172.21.15.118:0/23008022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc072f10 msgr2=0x7efecc160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 --2- 172.21.15.118:0/23008022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc072f10 0x7efecc160ca0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efecc06ed70 tx=0x7efeb802a540 comp rx=0 tx=0).stop 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 -- 172.21.15.118:0/23008022 shutdown_connections 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 --2- 172.21.15.118:0/23008022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc072f10 0x7efecc160ca0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 --2- 172.21.15.118:0/23008022 >> v2:172.21.15.149:3300/0 conn(0x7efecc06f920 0x7efecc06fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 --2- 172.21.15.118:0/23008022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efecc072b00 0x7efecc160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 -- 172.21.15.118:0/23008022 >> 172.21.15.118:0/23008022 conn(0x7efecc06d5a0 msgr2=0x7efecc0d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 -- 172.21.15.118:0/23008022 shutdown_connections 2024-09-21T06:09:46.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.345+0000 7efecbe00640 1 -- 172.21.15.118:0/23008022 wait complete. 2024-09-21T06:09:46.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.347+0000 7efecbe00640 1 Processor -- start 2024-09-21T06:09:46.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.347+0000 7efecbe00640 1 -- start start 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc06f920 0x7efecc0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efecc072b00 0x7efecc0ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efecc072f10 0x7efecc15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecbe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efecc15d9f0 con 0x7efecc06f920 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efecc15d870 con 0x7efecc072f10 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efecc15db70 con 0x7efecc072b00 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc06f920 0x7efecc0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc06f920 0x7efecc0b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55828/0 (socket says 172.21.15.118:55828) 2024-09-21T06:09:46.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecaa00640 1 -- 172.21.15.118:0/2883530418 learned_addr learned my addr 172.21.15.118:0/2883530418 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efeca000640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efecc072b00 0x7efecc0ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.349+0000 7efecb400640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efecc072f10 0x7efecc15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecaa00640 1 -- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efecc072b00 msgr2=0x7efecc0ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecaa00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efecc072b00 0x7efecc0ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecaa00640 1 -- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efecc072f10 msgr2=0x7efecc15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecaa00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efecc072f10 0x7efecc15bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecaa00640 1 -- 172.21.15.118:0/2883530418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc1f9480 con 0x7efecc06f920 2024-09-21T06:09:46.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecaa00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc06f920 0x7efecc0b51f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7efebc00d700 tx=0x7efebc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efec2a00640 1 -- 172.21.15.118:0/2883530418 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc017070 con 0x7efecc06f920 2024-09-21T06:09:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efec2a00640 1 -- 172.21.15.118:0/2883530418 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efebc005310 con 0x7efecc06f920 2024-09-21T06:09:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efecc1f9740 con 0x7efecc06f920 2024-09-21T06:09:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efec2a00640 1 -- 172.21.15.118:0/2883530418 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc009820 con 0x7efecc06f920 2024-09-21T06:09:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.350+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efecc1f9d00 con 0x7efecc06f920 2024-09-21T06:09:46.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.351+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efecc06fd30 con 0x7efecc06f920 2024-09-21T06:09:46.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.352+0000 7efec2a00640 1 -- 172.21.15.118:0/2883530418 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efebc0099c0 con 0x7efecc06f920 2024-09-21T06:09:46.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.353+0000 7efec2a00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efeac078b90 0x7efeac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.354+0000 7efec2a00640 1 -- 172.21.15.118:0/2883530418 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7efebc09aa20 con 0x7efecc06f920 2024-09-21T06:09:46.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.354+0000 7efeca000640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efeac078b90 0x7efeac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.355+0000 7efeca000640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efeac078b90 0x7efeac07b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efeb8033000 tx=0x7efeb8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:46.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.358+0000 7efec2a00640 1 -- 172.21.15.118:0/2883530418 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efebc062b90 con 0x7efecc06f920 2024-09-21T06:09:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.543+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efecc0d1380 con 0x7efecc06f920 2024-09-21T06:09:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.543+0000 7efec2a00640 1 -- 172.21.15.118:0/2883530418 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) ==== 93+0+10 (secure 0 0 0) 0x7efebc0675c0 con 0x7efecc06f920 2024-09-21T06:09:46.546 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:09:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.545+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efeac078b90 msgr2=0x7efeac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.545+0000 7efecbe00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efeac078b90 0x7efeac07b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efeb8033000 tx=0x7efeb8004730 comp rx=0 tx=0).stop 2024-09-21T06:09:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.545+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc06f920 msgr2=0x7efecc0b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.545+0000 7efecbe00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc06f920 0x7efecc0b51f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7efebc00d700 tx=0x7efebc00dbc0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 shutdown_connections 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efecc072f10 0x7efecc15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efeac078b90 0x7efeac07b0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efecc072b00 0x7efecc0ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 --2- 172.21.15.118:0/2883530418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efecc06f920 0x7efecc0b51f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 >> 172.21.15.118:0/2883530418 conn(0x7efecc06d5a0 msgr2=0x7efecc15c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 shutdown_connections 2024-09-21T06:09:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.546+0000 7efecbe00640 1 -- 172.21.15.118:0/2883530418 wait complete. 2024-09-21T06:09:46.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-21T06:09:46.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.789+0000 7fb8cca00640 1 -- 172.21.15.118:0/2845041508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8ac005150 msgr2=0x7fb8ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.789+0000 7fb8cca00640 1 --2- 172.21.15.118:0/2845041508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8ac005150 0x7fb8ac00b9c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c590 tx=0x7fb8ac005830 comp rx=0 tx=0).stop 2024-09-21T06:09:46.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.789+0000 7fb8c6800640 1 -- 172.21.15.118:0/2845041508 reap_dead start 2024-09-21T06:09:46.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.789+0000 7fb8cca00640 1 -- 172.21.15.118:0/2845041508 shutdown_connections 2024-09-21T06:09:46.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.789+0000 7fb8cca00640 1 -- 172.21.15.118:0/2845041508 >> 172.21.15.118:0/2845041508 conn(0x7fb8c806d110 msgr2=0x7fb8c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:46.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.790+0000 7fb8cca00640 1 -- 172.21.15.118:0/2845041508 shutdown_connections 2024-09-21T06:09:46.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.790+0000 7fb8cca00640 1 -- 172.21.15.118:0/2845041508 wait complete. 2024-09-21T06:09:46.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.792+0000 7fb8cca00640 1 Processor -- start 2024-09-21T06:09:46.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.792+0000 7fb8cca00640 1 -- start start 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.793+0000 7fb8cca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac005150 0x7fb8c81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.793+0000 7fb8cca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8c8074a10 0x7fb8c81f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.793+0000 7fb8cca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8073ff0 0x7fb8c81f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.793+0000 7fb8cca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c81426c0 con 0x7fb8c8073ff0 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.793+0000 7fb8cca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c80d1800 con 0x7fb8ac005150 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.793+0000 7fb8cca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c8142840 con 0x7fb8c8074a10 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8073ff0 0x7fb8c81f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8073ff0 0x7fb8c81f9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55842/0 (socket says 172.21.15.118:55842) 2024-09-21T06:09:46.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 -- 172.21.15.118:0/2766306656 learned_addr learned my addr 172.21.15.118:0/2766306656 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c5400640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8c8074a10 0x7fb8c81f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c5e00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac005150 0x7fb8c81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 -- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8c8074a10 msgr2=0x7fb8c81f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8c8074a10 0x7fb8c81f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 -- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac005150 msgr2=0x7fb8c81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac005150 0x7fb8c81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 -- 172.21.15.118:0/2766306656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c81f5810 con 0x7fb8c8073ff0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8c6800640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8073ff0 0x7fb8c81f9390 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c590 tx=0x7fb8c000c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.794+0000 7fb8be000640 1 -- 172.21.15.118:0/2766306656 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0003d80 con 0x7fb8c8073ff0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.795+0000 7fb8be000640 1 -- 172.21.15.118:0/2766306656 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8c003a070 con 0x7fb8c8073ff0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.795+0000 7fb8be000640 1 -- 172.21.15.118:0/2766306656 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c002ba90 con 0x7fb8c8073ff0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.795+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c81f98d0 con 0x7fb8c8073ff0 2024-09-21T06:09:46.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.795+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c813d410 con 0x7fb8c8073ff0 2024-09-21T06:09:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.796+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c81f9aa0 con 0x7fb8c8073ff0 2024-09-21T06:09:46.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.797+0000 7fb8be000640 1 -- 172.21.15.118:0/2766306656 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8c003c020 con 0x7fb8c8073ff0 2024-09-21T06:09:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.798+0000 7fb8be000640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8a8078b90 0x7fb8a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:46.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.798+0000 7fb8be000640 1 -- 172.21.15.118:0/2766306656 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7fb8c00ba1b0 con 0x7fb8c8073ff0 2024-09-21T06:09:46.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.798+0000 7fb8c5e00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8a8078b90 0x7fb8a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:46.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.799+0000 7fb8c5e00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8a8078b90 0x7fb8a807b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8006fd0 tx=0x7fb8b8006b10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:46.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:46.804+0000 7fb8be000640 1 -- 172.21.15.118:0/2766306656 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb8c81f9aa0 con 0x7fb8c8073ff0 2024-09-21T06:09:47.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.058+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7fb8c80d0ee0 con 0x7fb8c8073ff0 2024-09-21T06:09:47.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.655+0000 7fb8be000640 1 -- 172.21.15.118:0/2766306656 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v304) ==== 131+0+0 (secure 0 0 0) 0x7fb8c0082310 con 0x7fb8c8073ff0 2024-09-21T06:09:47.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.657+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8a8078b90 msgr2=0x7fb8a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:47.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.657+0000 7fb8cca00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8a8078b90 0x7fb8a807b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8006fd0 tx=0x7fb8b8006b10 comp rx=0 tx=0).stop 2024-09-21T06:09:47.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8073ff0 msgr2=0x7fb8c81f9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:47.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8073ff0 0x7fb8c81f9390 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c590 tx=0x7fb8c000c260 comp rx=0 tx=0).stop 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 shutdown_connections 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c8073ff0 0x7fb8c81f9390 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb8a8078b90 0x7fb8a807b0a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8c8074a10 0x7fb8c81f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 --2- 172.21.15.118:0/2766306656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac005150 0x7fb8c81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 >> 172.21.15.118:0/2766306656 conn(0x7fb8c806d110 msgr2=0x7fb8c80d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 shutdown_connections 2024-09-21T06:09:47.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.658+0000 7fb8cca00640 1 -- 172.21.15.118:0/2766306656 wait complete. 2024-09-21T06:09:47.684 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 -- 172.21.15.118:0/157011131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 msgr2=0x7f1dac0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 --2- 172.21.15.118:0/157011131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac0b3a60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0b5db0 tx=0x7f1d9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 -- 172.21.15.118:0/157011131 shutdown_connections 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 --2- 172.21.15.118:0/157011131 >> v2:172.21.15.149:3300/0 conn(0x7f1dac0b5450 0x7f1dac0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 --2- 172.21.15.118:0/157011131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac0b3a60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 -- 172.21.15.118:0/157011131 >> 172.21.15.118:0/157011131 conn(0x7f1dac06d110 msgr2=0x7f1dac06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 -- 172.21.15.118:0/157011131 shutdown_connections 2024-09-21T06:09:47.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.902+0000 7f1db0c00640 1 -- 172.21.15.118:0/157011131 wait complete. 2024-09-21T06:09:47.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.904+0000 7f1db0c00640 1 Processor -- start 2024-09-21T06:09:47.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.905+0000 7f1db0c00640 1 -- start start 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1db0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1dac0b5040 0x7f1dac1f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1db0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1dac0b5450 0x7f1dac1e9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1db0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac1f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1db0c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac073c60 con 0x7f1dac15cfd0 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1db0c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac073ae0 con 0x7f1dac0b5450 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1db0c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac073de0 con 0x7f1dac0b5040 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1daa800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac1f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1daa800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac1f7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55868/0 (socket says 172.21.15.118:55868) 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.906+0000 7f1daa800640 1 -- 172.21.15.118:0/3112637879 learned_addr learned my addr 172.21.15.118:0/3112637879 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1da9e00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1dac0b5040 0x7f1dac1f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1da3e00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1dac0b5450 0x7f1dac1e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:47.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1daa800640 1 -- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1dac0b5040 msgr2=0x7f1dac1f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1daa800640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1dac0b5040 0x7f1dac1f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1daa800640 1 -- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1dac0b5450 msgr2=0x7f1dac1e9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1daa800640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1dac0b5450 0x7f1dac1e9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1daa800640 1 -- 172.21.15.118:0/3112637879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac1e54f0 con 0x7f1dac15cfd0 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1daa800640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac1f7120 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1da400e9c0 tx=0x7f1da400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1da2000640 1 -- 172.21.15.118:0/3112637879 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4004d20 con 0x7f1dac15cfd0 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1da2000640 1 -- 172.21.15.118:0/3112637879 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1da400cb20 con 0x7f1dac15cfd0 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac1e57d0 con 0x7f1dac15cfd0 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.907+0000 7f1da2000640 1 -- 172.21.15.118:0/3112637879 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4005020 con 0x7f1dac15cfd0 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.908+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac1e5d90 con 0x7f1dac15cfd0 2024-09-21T06:09:47.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.909+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac0b3a60 con 0x7f1dac15cfd0 2024-09-21T06:09:47.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.910+0000 7f1da2000640 1 -- 172.21.15.118:0/3112637879 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1da40051c0 con 0x7f1dac15cfd0 2024-09-21T06:09:47.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.911+0000 7f1da2000640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d88078b90 0x7f1d8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:47.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.911+0000 7f1da2000640 1 -- 172.21.15.118:0/3112637879 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7f1da409b320 con 0x7f1dac15cfd0 2024-09-21T06:09:47.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.911+0000 7f1da9e00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d88078b90 0x7f1d8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:47.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.912+0000 7f1da9e00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d88078b90 0x7f1d8807b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c034000 tx=0x7f1d9c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:47.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:47.916+0000 7f1da2000640 1 -- 172.21.15.118:0/3112637879 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1da4016030 con 0x7f1dac15cfd0 2024-09-21T06:09:48.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.102+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f1dac076750 con 0x7f1dac15cfd0 2024-09-21T06:09:48.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.103+0000 7f1da2000640 1 -- 172.21.15.118:0/3112637879 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+1472 (secure 0 0 0) 0x7f1da4063af0 con 0x7f1dac15cfd0 2024-09-21T06:09:48.105 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:09:48.105 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:09:48.105 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:09:48.106 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:09:48.107 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:09:48.107 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:09:48.107 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:09:48.107 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:09:48.107 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:09:48.107 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:09:48.107 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d88078b90 msgr2=0x7f1d8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d88078b90 0x7f1d8807b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c034000 tx=0x7f1d9c004730 comp rx=0 tx=0).stop 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 msgr2=0x7f1dac1f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac1f7120 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1da400e9c0 tx=0x7f1da400ee80 comp rx=0 tx=0).stop 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 shutdown_connections 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dac15cfd0 0x7f1dac1f7120 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1dac0b5450 0x7f1dac1e9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1d88078b90 0x7f1d8807b0a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 --2- 172.21.15.118:0/3112637879 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1dac0b5040 0x7f1dac1f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 >> 172.21.15.118:0/3112637879 conn(0x7f1dac06d110 msgr2=0x7f1dac06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:48.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 shutdown_connections 2024-09-21T06:09:48.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.105+0000 7f1db0c00640 1 -- 172.21.15.118:0/3112637879 wait complete. 2024-09-21T06:09:48.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:09:48.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.351+0000 7fab61c00640 1 -- 172.21.15.118:0/3072199947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c0d1590 msgr2=0x7fab5c142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:48.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.351+0000 7fab61c00640 1 --2- 172.21.15.118:0/3072199947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c0d1590 0x7fab5c142730 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fab44005fd0 tx=0x7fab4402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.352+0000 7fab61c00640 1 -- 172.21.15.118:0/3072199947 shutdown_connections 2024-09-21T06:09:48.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.352+0000 7fab61c00640 1 --2- 172.21.15.118:0/3072199947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab5c13fef0 0x7fab5c142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.352+0000 7fab61c00640 1 --2- 172.21.15.118:0/3072199947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c0d1590 0x7fab5c142730 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.352+0000 7fab61c00640 1 -- 172.21.15.118:0/3072199947 >> 172.21.15.118:0/3072199947 conn(0x7fab5c06d110 msgr2=0x7fab5c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:48.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.352+0000 7fab61c00640 1 -- 172.21.15.118:0/3072199947 shutdown_connections 2024-09-21T06:09:48.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.352+0000 7fab61c00640 1 -- 172.21.15.118:0/3072199947 wait complete. 2024-09-21T06:09:48.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.354+0000 7fab61c00640 1 Processor -- start 2024-09-21T06:09:48.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.354+0000 7fab61c00640 1 -- start start 2024-09-21T06:09:48.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.355+0000 7fab61c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c13fae0 0x7fab5c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:48.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.355+0000 7fab61c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab5c13fef0 0x7fab5c139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:48.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.355+0000 7fab61c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab5c1f7d70 0x7fab5c139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:48.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.355+0000 7fab61c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c0cfac0 con 0x7fab5c13fae0 2024-09-21T06:09:48.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.355+0000 7fab61c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c0cf940 con 0x7fab5c1f7d70 2024-09-21T06:09:48.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.355+0000 7fab61c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab5c0cfc40 con 0x7fab5c13fef0 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c13fae0 0x7fab5c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c13fae0 0x7fab5c15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55894/0 (socket says 172.21.15.118:55894) 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 -- 172.21.15.118:0/3770243481 learned_addr learned my addr 172.21.15.118:0/3770243481 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab52000640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab5c13fef0 0x7fab5c139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5b400640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab5c1f7d70 0x7fab5c139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 -- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab5c13fef0 msgr2=0x7fab5c139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab5c13fef0 0x7fab5c139490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 -- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab5c1f7d70 msgr2=0x7fab5c139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab5c1f7d70 0x7fab5c139be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 -- 172.21.15.118:0/3770243481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c157ae0 con 0x7fab5c13fae0 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5b400640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab5c1f7d70 0x7fab5c139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.356+0000 7fab5aa00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c13fae0 0x7fab5c15a500 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c7d0 tx=0x7fab4c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.357+0000 7fab53400640 1 -- 172.21.15.118:0/3770243481 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c017070 con 0x7fab5c13fae0 2024-09-21T06:09:48.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.357+0000 7fab53400640 1 -- 172.21.15.118:0/3770243481 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab4c005070 con 0x7fab5c13fae0 2024-09-21T06:09:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.357+0000 7fab53400640 1 -- 172.21.15.118:0/3770243481 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0054a0 con 0x7fab5c13fae0 2024-09-21T06:09:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.357+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c158010 con 0x7fab5c13fae0 2024-09-21T06:09:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.357+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c159a20 con 0x7fab5c13fae0 2024-09-21T06:09:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.358+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5c0d0170 con 0x7fab5c13fae0 2024-09-21T06:09:48.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.359+0000 7fab53400640 1 -- 172.21.15.118:0/3770243481 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab4c01a070 con 0x7fab5c13fae0 2024-09-21T06:09:48.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.360+0000 7fab53400640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab38078b90 0x7fab3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:48.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.360+0000 7fab53400640 1 -- 172.21.15.118:0/3770243481 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7fab4c09a160 con 0x7fab5c13fae0 2024-09-21T06:09:48.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.361+0000 7fab52000640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab38078b90 0x7fab3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:48.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.362+0000 7fab52000640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab38078b90 0x7fab3807b0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fab44033000 tx=0x7fab44004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:48.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.365+0000 7fab53400640 1 -- 172.21.15.118:0/3770243481 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fab4c062800 con 0x7fab5c13fae0 2024-09-21T06:09:48.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.549+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fab5c13f040 con 0x7fab5c13fae0 2024-09-21T06:09:48.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.553+0000 7fab53400640 1 -- 172.21.15.118:0/3770243481 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fab4c062100 con 0x7fab5c13fae0 2024-09-21T06:09:48.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab38078b90 msgr2=0x7fab3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:48.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab38078b90 0x7fab3807b0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fab44033000 tx=0x7fab44004730 comp rx=0 tx=0).stop 2024-09-21T06:09:48.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c13fae0 msgr2=0x7fab5c15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:48.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c13fae0 0x7fab5c15a500 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c7d0 tx=0x7fab4c00cc90 comp rx=0 tx=0).stop 2024-09-21T06:09:48.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 shutdown_connections 2024-09-21T06:09:48.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab5c1f7d70 0x7fab5c139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab38078b90 0x7fab3807b0a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab5c13fef0 0x7fab5c139490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 --2- 172.21.15.118:0/3770243481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab5c13fae0 0x7fab5c15a500 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:48.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.555+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 >> 172.21.15.118:0/3770243481 conn(0x7fab5c06d110 msgr2=0x7fab5c153510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:48.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.556+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 shutdown_connections 2024-09-21T06:09:48.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:48.556+0000 7fab61c00640 1 -- 172.21.15.118:0/3770243481 wait complete. 2024-09-21T06:09:48.583 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:09:48.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:09:48.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:09:48.764 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:09:48.764 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:48.764 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:48.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:09:48.801 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:09:48.801 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:48.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:09:48.838 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:09:48.838 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:48.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:09:48.876 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:09:48.876 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:09:48.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:09:48.913 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:09:48.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:49.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.134+0000 7fa0d6000640 1 -- 172.21.15.118:0/2040319935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d00b5040 msgr2=0x7fa0d00cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.134+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2040319935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d00b5040 0x7fa0d00cca40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00b3800 tx=0x7fa0b802a580 comp rx=0 tx=0).stop 2024-09-21T06:09:49.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.134+0000 7fa0d6000640 1 -- 172.21.15.118:0/2040319935 shutdown_connections 2024-09-21T06:09:49.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.134+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2040319935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d00b5040 0x7fa0d00cca40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.134+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2040319935 >> v2:172.21.15.149:3300/0 conn(0x7fa0d015cfd0 0x7fa0d00b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.134+0000 7fa0d6000640 1 -- 172.21.15.118:0/2040319935 >> 172.21.15.118:0/2040319935 conn(0x7fa0d006d110 msgr2=0x7fa0d006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:49.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.134+0000 7fa0d6000640 1 -- 172.21.15.118:0/2040319935 shutdown_connections 2024-09-21T06:09:49.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.135+0000 7fa0d6000640 1 -- 172.21.15.118:0/2040319935 wait complete. 2024-09-21T06:09:49.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.137+0000 7fa0d6000640 1 Processor -- start 2024-09-21T06:09:49.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.137+0000 7fa0d6000640 1 -- start start 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.138+0000 7fa0d6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0d00b5040 0x7fa0d01445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.138+0000 7fa0d6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0d00b5450 0x7fa0d00cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.138+0000 7fa0d6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d015cfd0 0x7fa0d00cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.138+0000 7fa0d6000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0073c60 con 0x7fa0d015cfd0 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.138+0000 7fa0d6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0073ae0 con 0x7fa0d00b5450 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.138+0000 7fa0d6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d0073de0 con 0x7fa0d00b5040 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.138+0000 7fa0cfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d015cfd0 0x7fa0d00cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d015cfd0 0x7fa0d00cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55902/0 (socket says 172.21.15.118:55902) 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 -- 172.21.15.118:0/2910728558 learned_addr learned my addr 172.21.15.118:0/2910728558 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cf400640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0d00b5040 0x7fa0d01445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0c7e00640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0d00b5450 0x7fa0d00cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 -- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0d00b5040 msgr2=0x7fa0d01445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0d00b5040 0x7fa0d01445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 -- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0d00b5450 msgr2=0x7fa0d00cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0d00b5450 0x7fa0d00cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 -- 172.21.15.118:0/2910728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d00ce2c0 con 0x7fa0d015cfd0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0cfe00640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d015cfd0 0x7fa0d00cf9d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c760 tx=0x7fa0c800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0c7400640 1 -- 172.21.15.118:0/2910728558 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8003b70 con 0x7fa0d015cfd0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.139+0000 7fa0c7400640 1 -- 172.21.15.118:0/2910728558 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0c8003d10 con 0x7fa0d015cfd0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.140+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d00ce5a0 con 0x7fa0d015cfd0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.140+0000 7fa0c7400640 1 -- 172.21.15.118:0/2910728558 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8005330 con 0x7fa0d015cfd0 2024-09-21T06:09:49.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.140+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d00ab3a0 con 0x7fa0d015cfd0 2024-09-21T06:09:49.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.141+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d00b3a60 con 0x7fa0d015cfd0 2024-09-21T06:09:49.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.142+0000 7fa0c7400640 1 -- 172.21.15.118:0/2910728558 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0c80054d0 con 0x7fa0d015cfd0 2024-09-21T06:09:49.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.143+0000 7fa0c7400640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.143+0000 7fa0c7400640 1 -- 172.21.15.118:0/2910728558 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7fa0c809a5c0 con 0x7fa0d015cfd0 2024-09-21T06:09:49.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.143+0000 7fa0cf400640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.144+0000 7fa0cf400640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0004630 tx=0x7fa0c000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:49.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.147+0000 7fa0c7400640 1 -- 172.21.15.118:0/2910728558 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa0c8062740 con 0x7fa0d015cfd0 2024-09-21T06:09:49.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.370+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0d00cff30 con 0x7fa0d015cfd0 2024-09-21T06:09:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.371+0000 7fa0c7400640 1 -- 172.21.15.118:0/2910728558 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+3914 (secure 0 0 0) 0x7fa0c8067170 con 0x7fa0d015cfd0 2024-09-21T06:09:49.373 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:49.373 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":53,"btime":"2024-09-21T06:09:42:627514+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/627261932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":627261932},{"type":"v1","addr":"172.21.15.149:6837","nonce":627261932}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":5552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/976780809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":976780809},{"type":"v1","addr":"172.21.15.118:6835","nonce":976780809}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6013,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/988197431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":988197431},{"type":"v1","addr":"172.21.15.149:6836","nonce":988197431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3132779731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3132779731},{"type":"v1","addr":"172.21.15.118:6834","nonce":3132779731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53}],"filesystems":[]} 2024-09-21T06:09:49.373 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 53 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0ac078b90 msgr2=0x7fa0ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0004630 tx=0x7fa0c000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d015cfd0 msgr2=0x7fa0d00cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d015cfd0 0x7fa0d00cf9d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c760 tx=0x7fa0c800cb60 comp rx=0 tx=0).stop 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 shutdown_connections 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d015cfd0 0x7fa0d00cf9d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0d00b5450 0x7fa0d00cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 --2- 172.21.15.118:0/2910728558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0d00b5040 0x7fa0d01445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 >> 172.21.15.118:0/2910728558 conn(0x7fa0d006d110 msgr2=0x7fa0d006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:49.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 shutdown_connections 2024-09-21T06:09:49.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.373+0000 7fa0d6000640 1 -- 172.21.15.118:0/2910728558 wait complete. 2024-09-21T06:09:49.401 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:09:49.401 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:09:49.401 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:09:49.401 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:09:49.402 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:09:49.402 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:09:49.402 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:09:49.402 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:09:49.402 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:09:49.402 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:09:49.403 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:09:49.403 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:09:49.403 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:09:49.403 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:09:49.403 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:09:49.403 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:09:49.424 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:09:49.424 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:09:49.425 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:09:49.425 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:09:49.427 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:09:49.428 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:09:49.428 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:09:49.428 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:09:49.470 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:09:49.471 DEBUG:teuthology.parallel:result is None 2024-09-21T06:09:49.471 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:09:49.471 DEBUG:teuthology.parallel:result is None 2024-09-21T06:09:49.473 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:09:49.473 DEBUG:teuthology.parallel:result is None 2024-09-21T06:09:49.474 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:09:49.474 DEBUG:teuthology.parallel:result is None 2024-09-21T06:09:49.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:09:49.519 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:49.524 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:49.665 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:09:49.666 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:09:49.667 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:09:49.679 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 -- 172.21.15.118:0/1089388120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb80b44c0 msgr2=0x7fabb815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 --2- 172.21.15.118:0/1089388120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb80b44c0 0x7fabb815f660 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7faba8009860 tx=0x7faba802a540 comp rx=0 tx=0).stop 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 -- 172.21.15.118:0/1089388120 shutdown_connections 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 --2- 172.21.15.118:0/1089388120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabb815bd00 0x7fabb815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 --2- 172.21.15.118:0/1089388120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb80b44c0 0x7fabb815f660 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 -- 172.21.15.118:0/1089388120 >> 172.21.15.118:0/1089388120 conn(0x7fabb806d110 msgr2=0x7fabb806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 -- 172.21.15.118:0/1089388120 shutdown_connections 2024-09-21T06:09:49.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.712+0000 7fabbde00640 1 -- 172.21.15.118:0/1089388120 wait complete. 2024-09-21T06:09:49.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.714+0000 7fabbde00640 1 Processor -- start 2024-09-21T06:09:49.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.715+0000 7fabbde00640 1 -- start start 2024-09-21T06:09:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabbde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb80b44c0 0x7fabb814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabbde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabb8152050 0x7fabb813d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabbde00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb815bd00 0x7fabb815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabbde00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fabb8070f40 con 0x7fabb815bd00 2024-09-21T06:09:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabbde00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fabb8070dc0 con 0x7fabb80b44c0 2024-09-21T06:09:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabbde00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fabb80cfe80 con 0x7fabb8152050 2024-09-21T06:09:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabb7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb815bd00 0x7fabb815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabb7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb815bd00 0x7fabb815a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55944/0 (socket says 172.21.15.118:55944) 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.716+0000 7fabb7400640 1 -- 172.21.15.118:0/1877780304 learned_addr learned my addr 172.21.15.118:0/1877780304 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabb6a00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb80b44c0 0x7fabb814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabafe00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabb8152050 0x7fabb813d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabb7400640 1 -- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabb8152050 msgr2=0x7fabb813d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabb7400640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabb8152050 0x7fabb813d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabb7400640 1 -- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb80b44c0 msgr2=0x7fabb814df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabb7400640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb80b44c0 0x7fabb814df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabb7400640 1 -- 172.21.15.118:0/1877780304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb813d9b0 con 0x7fabb815bd00 2024-09-21T06:09:49.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabafe00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabb8152050 0x7fabb813d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabb7400640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb815bd00 0x7fabb815a110 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fabb000ea80 tx=0x7fabb000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabaf400640 1 -- 172.21.15.118:0/1877780304 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004b20 con 0x7fabb815bd00 2024-09-21T06:09:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabaf400640 1 -- 172.21.15.118:0/1877780304 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabb0004ce0 con 0x7fabb815bd00 2024-09-21T06:09:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabaf400640 1 -- 172.21.15.118:0/1877780304 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0005280 con 0x7fabb815bd00 2024-09-21T06:09:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.717+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb81552b0 con 0x7fabb815bd00 2024-09-21T06:09:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.718+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb814f810 con 0x7fabb815bd00 2024-09-21T06:09:49.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.719+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb815f660 con 0x7fabb815bd00 2024-09-21T06:09:49.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.720+0000 7fabaf400640 1 -- 172.21.15.118:0/1877780304 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabb0005420 con 0x7fabb815bd00 2024-09-21T06:09:49.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.721+0000 7fabaf400640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab94078b90 0x7fab9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.721+0000 7fabaf400640 1 -- 172.21.15.118:0/1877780304 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4943+0+0 (secure 0 0 0) 0x7fabb009b740 con 0x7fabb815bd00 2024-09-21T06:09:49.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.722+0000 7fabb6a00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab94078b90 0x7fab9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.722+0000 7fabb6a00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab94078b90 0x7fab9407b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faba8034000 tx=0x7faba8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:49.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.726+0000 7fabaf400640 1 -- 172.21.15.118:0/1877780304 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabb813d9b0 con 0x7fabb815bd00 2024-09-21T06:09:49.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:49.926+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fabb815c430 con 0x7fabb815bd00 2024-09-21T06:09:50.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.682+0000 7fabaf400640 1 -- 172.21.15.118:0/1877780304 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v112) ==== 97+0+0 (secure 0 0 0) 0x7fabb0063e70 con 0x7fabb815bd00 2024-09-21T06:09:50.683 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab94078b90 msgr2=0x7fab9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab94078b90 0x7fab9407b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faba8034000 tx=0x7faba8004730 comp rx=0 tx=0).stop 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb815bd00 msgr2=0x7fabb815a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb815bd00 0x7fabb815a110 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fabb000ea80 tx=0x7fabb000ef40 comp rx=0 tx=0).stop 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 shutdown_connections 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabb815bd00 0x7fabb815a110 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fab94078b90 0x7fab9407b0a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabb8152050 0x7fabb813d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 --2- 172.21.15.118:0/1877780304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabb80b44c0 0x7fabb814df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 >> 172.21.15.118:0/1877780304 conn(0x7fabb806d110 msgr2=0x7fabb806f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:50.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 shutdown_connections 2024-09-21T06:09:50.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.685+0000 7fabbde00640 1 -- 172.21.15.118:0/1877780304 wait complete. 2024-09-21T06:09:50.713 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 -- 172.21.15.118:0/2905784848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100b62c0 msgr2=0x7f81100d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 --2- 172.21.15.118:0/2905784848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100b62c0 0x7f81100d0240 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8108005fd0 tx=0x7f810802a820 comp rx=0 tx=0).stop 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 -- 172.21.15.118:0/2905784848 shutdown_connections 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 --2- 172.21.15.118:0/2905784848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100b62c0 0x7f81100d0240 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 --2- 172.21.15.118:0/2905784848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8110073fa0 0x7f81100749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 -- 172.21.15.118:0/2905784848 >> 172.21.15.118:0/2905784848 conn(0x7f811006d6e0 msgr2=0x7f81100b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 -- 172.21.15.118:0/2905784848 shutdown_connections 2024-09-21T06:09:50.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.936+0000 7f8115200640 1 -- 172.21.15.118:0/2905784848 wait complete. 2024-09-21T06:09:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.938+0000 7f8115200640 1 Processor -- start 2024-09-21T06:09:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.938+0000 7f8115200640 1 -- start start 2024-09-21T06:09:50.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f8115200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8110073fa0 0x7f8110156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:50.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f8115200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100cfe30 0x7f811015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:50.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f8115200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8110072fa0 0x7f811015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:50.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f8115200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f811015d9c0 con 0x7f81100cfe30 2024-09-21T06:09:50.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f8115200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f811015d840 con 0x7f8110073fa0 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f8115200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f811015db40 con 0x7f8110072fa0 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f810ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100cfe30 0x7f811015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f810ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100cfe30 0x7f811015c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55968/0 (socket says 172.21.15.118:55968) 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f810ea00640 1 -- 172.21.15.118:0/2728076606 learned_addr learned my addr 172.21.15.118:0/2728076606 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f810f400640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8110073fa0 0x7f8110156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.940+0000 7f810fe00640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8110072fa0 0x7f811015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f810ea00640 1 -- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8110072fa0 msgr2=0x7f811015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f810ea00640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8110072fa0 0x7f811015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f810ea00640 1 -- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8110073fa0 msgr2=0x7f8110156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f810ea00640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8110073fa0 0x7f8110156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f810ea00640 1 -- 172.21.15.118:0/2728076606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8110156970 con 0x7f81100cfe30 2024-09-21T06:09:50.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f810ea00640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100cfe30 0x7f811015c490 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c3c0 tx=0x7f80fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:50.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f8107400640 1 -- 172.21.15.118:0/2728076606 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc017070 con 0x7f81100cfe30 2024-09-21T06:09:50.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f8107400640 1 -- 172.21.15.118:0/2728076606 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80fc0035f0 con 0x7f81100cfe30 2024-09-21T06:09:50.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81100ca200 con 0x7f81100cfe30 2024-09-21T06:09:50.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f8107400640 1 -- 172.21.15.118:0/2728076606 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc003a40 con 0x7f81100cfe30 2024-09-21T06:09:50.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.941+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81100cbea0 con 0x7f81100cfe30 2024-09-21T06:09:50.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.942+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81100c9f70 con 0x7f81100cfe30 2024-09-21T06:09:50.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.944+0000 7f8107400640 1 -- 172.21.15.118:0/2728076606 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80fc01a070 con 0x7f81100cfe30 2024-09-21T06:09:50.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.945+0000 7f8107400640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80f0078bc0 0x7f80f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:50.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.945+0000 7f8107400640 1 -- 172.21.15.118:0/2728076606 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4857+0+0 (secure 0 0 0) 0x7f80fc099f90 con 0x7f81100cfe30 2024-09-21T06:09:50.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.946+0000 7f810f400640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80f0078bc0 0x7f80f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:50.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.946+0000 7f810f400640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80f0078bc0 0x7f80f007b0d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f810000bb50 tx=0x7f810000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:50.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:50.948+0000 7f8107400640 1 -- 172.21.15.118:0/2728076606 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f80fc021020 con 0x7f81100cfe30 2024-09-21T06:09:51.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.200+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f81100cb9b0 con 0x7f81100cfe30 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.200+0000 7f8107400640 1 -- 172.21.15.118:0/2728076606 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f80fc0620b0 con 0x7f81100cfe30 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.202 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:09:51.203 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.204 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.205 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.206 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.207 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.208 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.209 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:09:51.210 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:09:51.211 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:09:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:09:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.214 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:09:51.215 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80f0078bc0 msgr2=0x7f80f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80f0078bc0 0x7f80f007b0d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f810000bb50 tx=0x7f810000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100cfe30 msgr2=0x7f811015c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100cfe30 0x7f811015c490 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c3c0 tx=0x7f80fc00c880 comp rx=0 tx=0).stop 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 shutdown_connections 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80f0078bc0 0x7f80f007b0d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8110072fa0 0x7f811015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81100cfe30 0x7f811015c490 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 --2- 172.21.15.118:0/2728076606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8110073fa0 0x7f8110156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 >> 172.21.15.118:0/2728076606 conn(0x7f811006d6e0 msgr2=0x7f8110145910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 shutdown_connections 2024-09-21T06:09:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.203+0000 7f8115200640 1 -- 172.21.15.118:0/2728076606 wait complete. 2024-09-21T06:09:51.226 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:09:51.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 -- 172.21.15.118:0/777231439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce4015ae10 msgr2=0x7fce400749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 --2- 172.21.15.118:0/777231439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce4015ae10 0x7fce400749d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fce34005fd0 tx=0x7fce3402a540 comp rx=0 tx=0).stop 2024-09-21T06:09:51.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 -- 172.21.15.118:0/777231439 shutdown_connections 2024-09-21T06:09:51.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 --2- 172.21.15.118:0/777231439 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce40073180 0x7fce40073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 --2- 172.21.15.118:0/777231439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce4015ae10 0x7fce400749d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 -- 172.21.15.118:0/777231439 >> 172.21.15.118:0/777231439 conn(0x7fce4006d6e0 msgr2=0x7fce400b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:51.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 -- 172.21.15.118:0/777231439 shutdown_connections 2024-09-21T06:09:51.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.445+0000 7fce46800640 1 -- 172.21.15.118:0/777231439 wait complete. 2024-09-21T06:09:51.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.447+0000 7fce46800640 1 Processor -- start 2024-09-21T06:09:51.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.447+0000 7fce46800640 1 -- start start 2024-09-21T06:09:51.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce46800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce40073180 0x7fce4014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce46800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4015ae10 0x7fce400b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce46800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4015ea10 0x7fce400b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce46800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce40070d30 con 0x7fce40073180 2024-09-21T06:09:51.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce46800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce40070bb0 con 0x7fce4015ae10 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce46800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce40073ad0 con 0x7fce4015ea10 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce45400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce40073180 0x7fce4014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce45400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce40073180 0x7fce4014d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55982/0 (socket says 172.21.15.118:55982) 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce45400640 1 -- 172.21.15.118:0/3380237554 learned_addr learned my addr 172.21.15.118:0/3380237554 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce45e00640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4015ea10 0x7fce400b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.449+0000 7fce44a00640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4015ae10 0x7fce400b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce45400640 1 -- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4015ea10 msgr2=0x7fce400b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce45400640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4015ea10 0x7fce400b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce45400640 1 -- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4015ae10 msgr2=0x7fce400b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce45400640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4015ae10 0x7fce400b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce45400640 1 -- 172.21.15.118:0/3380237554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4014fb40 con 0x7fce40073180 2024-09-21T06:09:51.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce45400640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce40073180 0x7fce4014d290 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce34006010 tx=0x7fce340038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:51.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce3d600640 1 -- 172.21.15.118:0/3380237554 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3403e030 con 0x7fce40073180 2024-09-21T06:09:51.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce3d600640 1 -- 172.21.15.118:0/3380237554 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce34003d90 con 0x7fce40073180 2024-09-21T06:09:51.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4014ed80 con 0x7fce40073180 2024-09-21T06:09:51.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce3d600640 1 -- 172.21.15.118:0/3380237554 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34035040 con 0x7fce40073180 2024-09-21T06:09:51.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.450+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4014f340 con 0x7fce40073180 2024-09-21T06:09:51.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.452+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce400b25e0 con 0x7fce40073180 2024-09-21T06:09:51.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.453+0000 7fce3d600640 1 -- 172.21.15.118:0/3380237554 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce34041030 con 0x7fce40073180 2024-09-21T06:09:51.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.454+0000 7fce3d600640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce20078b90 0x7fce2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.454+0000 7fce3d600640 1 -- 172.21.15.118:0/3380237554 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4857+0+0 (secure 0 0 0) 0x7fce340bb090 con 0x7fce40073180 2024-09-21T06:09:51.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.454+0000 7fce44a00640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce20078b90 0x7fce2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.455+0000 7fce44a00640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce20078b90 0x7fce2007b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fce4015e1d0 tx=0x7fce2c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:51.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.458+0000 7fce3d600640 1 -- 172.21.15.118:0/3380237554 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fce400b25e0 con 0x7fce40073180 2024-09-21T06:09:51.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.643+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fce4014a610 con 0x7fce40073180 2024-09-21T06:09:51.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.643+0000 7fce3d600640 1 -- 172.21.15.118:0/3380237554 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v114) ==== 84+0+65 (secure 0 0 0) 0x7fce34088e20 con 0x7fce40073180 2024-09-21T06:09:51.645 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:51.645 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:09:51.645 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:09:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:09:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:09:51.646 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:09:51.646 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:09:51.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce20078b90 msgr2=0x7fce2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce20078b90 0x7fce2007b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fce4015e1d0 tx=0x7fce2c009040 comp rx=0 tx=0).stop 2024-09-21T06:09:51.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce40073180 msgr2=0x7fce4014d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce40073180 0x7fce4014d290 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce34006010 tx=0x7fce340038a0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 shutdown_connections 2024-09-21T06:09:51.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fce20078b90 0x7fce2007b0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce4015ea10 0x7fce400b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce4015ae10 0x7fce400b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 --2- 172.21.15.118:0/3380237554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce40073180 0x7fce4014d290 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 >> 172.21.15.118:0/3380237554 conn(0x7fce4006d6e0 msgr2=0x7fce40151150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:51.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 shutdown_connections 2024-09-21T06:09:51.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.646+0000 7fce46800640 1 -- 172.21.15.118:0/3380237554 wait complete. 2024-09-21T06:09:51.669 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:09:51.670 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:09:51.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 -- 172.21.15.118:0/1844812743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 msgr2=0x7fec84072c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 --2- 172.21.15.118:0/1844812743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec84072c40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fec84145a90 tx=0x7fec7c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:09:51.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 -- 172.21.15.118:0/1844812743 shutdown_connections 2024-09-21T06:09:51.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 --2- 172.21.15.118:0/1844812743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec84072c40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 --2- 172.21.15.118:0/1844812743 >> v2:172.21.15.149:3300/0 conn(0x7fec840cdf00 0x7fec8415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 -- 172.21.15.118:0/1844812743 >> 172.21.15.118:0/1844812743 conn(0x7fec8406cf30 msgr2=0x7fec8406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:51.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 -- 172.21.15.118:0/1844812743 shutdown_connections 2024-09-21T06:09:51.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.894+0000 7fec8c000640 1 -- 172.21.15.118:0/1844812743 wait complete. 2024-09-21T06:09:51.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.896+0000 7fec8c000640 1 Processor -- start 2024-09-21T06:09:51.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.896+0000 7fec8c000640 1 -- start start 2024-09-21T06:09:51.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.897+0000 7fec8c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec841563b0 0x7fec840aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.897+0000 7fec8c000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec840cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.897+0000 7fec8c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840cc670 0x7fec8415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.897+0000 7fec8c000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fec84073390 con 0x7fec8415c930 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.897+0000 7fec8c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec8415cf90 con 0x7fec840cc670 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.897+0000 7fec8c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec84073510 con 0x7fec841563b0 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec840cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec840cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56004/0 (socket says 172.21.15.118:56004) 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 -- 172.21.15.118:0/3859462055 learned_addr learned my addr 172.21.15.118:0/3859462055 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec89600640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec841563b0 0x7fec840aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec8a000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840cc670 0x7fec8415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 -- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec841563b0 msgr2=0x7fec840aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec841563b0 0x7fec840aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 -- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840cc670 msgr2=0x7fec8415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840cc670 0x7fec8415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 -- 172.21.15.118:0/3859462055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec84149860 con 0x7fec8415c930 2024-09-21T06:09:51.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec89600640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec841563b0 0x7fec840aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec8a000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840cc670 0x7fec8415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.898+0000 7fec88c00640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec840cc130 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d6d0 tx=0x7fec7000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.899+0000 7fec81600640 1 -- 172.21.15.118:0/3859462055 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70017070 con 0x7fec8415c930 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.899+0000 7fec81600640 1 -- 172.21.15.118:0/3859462055 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec70004310 con 0x7fec8415c930 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.899+0000 7fec81600640 1 -- 172.21.15.118:0/3859462055 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70009a80 con 0x7fec8415c930 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.899+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec84149b40 con 0x7fec8415c930 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.899+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec8414a100 con 0x7fec8415c930 2024-09-21T06:09:51.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.900+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec8406a260 con 0x7fec8415c930 2024-09-21T06:09:51.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.901+0000 7fec81600640 1 -- 172.21.15.118:0/3859462055 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec700035f0 con 0x7fec8415c930 2024-09-21T06:09:51.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.902+0000 7fec81600640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec64078bc0 0x7fec6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:51.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.902+0000 7fec81600640 1 -- 172.21.15.118:0/3859462055 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4857+0+0 (secure 0 0 0) 0x7fec7009adb0 con 0x7fec8415c930 2024-09-21T06:09:51.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.903+0000 7fec89600640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec64078bc0 0x7fec6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:51.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.903+0000 7fec89600640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec64078bc0 0x7fec6407b0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec78007fd0 tx=0x7fec78009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:51.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:51.906+0000 7fec81600640 1 -- 172.21.15.118:0/3859462055 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fec7009f070 con 0x7fec8415c930 2024-09-21T06:09:52.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.094+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fec841495f0 con 0x7fec8415c930 2024-09-21T06:09:52.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.690+0000 7fec81600640 1 -- 172.21.15.118:0/3859462055 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v115) ==== 138+0+0 (secure 0 0 0) 0x7fec700634a0 con 0x7fec8415c930 2024-09-21T06:09:52.691 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:09:52.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.692+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec64078bc0 msgr2=0x7fec6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:52.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.692+0000 7fec8c000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec64078bc0 0x7fec6407b0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec78007fd0 tx=0x7fec78009040 comp rx=0 tx=0).stop 2024-09-21T06:09:52.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 msgr2=0x7fec840cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:52.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec840cc130 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d6d0 tx=0x7fec7000db90 comp rx=0 tx=0).stop 2024-09-21T06:09:52.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 shutdown_connections 2024-09-21T06:09:52.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840cc670 0x7fec8415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8415c930 0x7fec840cc130 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec64078bc0 0x7fec6407b0d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 --2- 172.21.15.118:0/3859462055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec841563b0 0x7fec840aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 >> 172.21.15.118:0/3859462055 conn(0x7fec8406cf30 msgr2=0x7fec840b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:52.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 shutdown_connections 2024-09-21T06:09:52.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.693+0000 7fec8c000640 1 -- 172.21.15.118:0/3859462055 wait complete. 2024-09-21T06:09:52.720 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:09:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.948+0000 7f1ebe800640 1 -- 172.21.15.118:0/2206319134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb80d1590 msgr2=0x7f1eb8142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.948+0000 7f1ebe800640 1 --2- 172.21.15.118:0/2206319134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb80d1590 0x7f1eb8142730 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009830 tx=0x7f1ea402a4b0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.948+0000 7f1ebe800640 1 -- 172.21.15.118:0/2206319134 shutdown_connections 2024-09-21T06:09:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.948+0000 7f1ebe800640 1 --2- 172.21.15.118:0/2206319134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb80d1590 0x7f1eb8142730 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.948+0000 7f1ebe800640 1 -- 172.21.15.118:0/2206319134 >> 172.21.15.118:0/2206319134 conn(0x7f1eb806d110 msgr2=0x7f1eb806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.948+0000 7f1ebe800640 1 -- 172.21.15.118:0/2206319134 shutdown_connections 2024-09-21T06:09:52.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.948+0000 7f1ebe800640 1 -- 172.21.15.118:0/2206319134 wait complete. 2024-09-21T06:09:52.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.950+0000 7f1ebe800640 1 Processor -- start 2024-09-21T06:09:52.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.951+0000 7f1ebe800640 1 -- start start 2024-09-21T06:09:52.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1ebe800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb813fae0 0x7f1eb8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:52.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1ebe800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1eb813fef0 0x7f1eb80b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:52.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1ebe800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eb81525c0 0x7f1eb80b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:52.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1ebe800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8168280 con 0x7f1eb81525c0 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1ebe800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8168100 con 0x7f1eb813fae0 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1ebe800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb8168400 con 0x7f1eb813fef0 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1eb7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eb81525c0 0x7f1eb80b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1eb7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eb81525c0 0x7f1eb80b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56012/0 (socket says 172.21.15.118:56012) 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.952+0000 7f1eb7e00640 1 -- 172.21.15.118:0/1716866244 learned_addr learned my addr 172.21.15.118:0/1716866244 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb7400640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb813fae0 0x7f1eb8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb6a00640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1eb813fef0 0x7f1eb80b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb7e00640 1 -- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1eb813fef0 msgr2=0x7f1eb80b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb7e00640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1eb813fef0 0x7f1eb80b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb7e00640 1 -- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb813fae0 msgr2=0x7f1eb8150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb7e00640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb813fae0 0x7f1eb8150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb7e00640 1 -- 172.21.15.118:0/1716866244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb8152d30 con 0x7f1eb81525c0 2024-09-21T06:09:52.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eb7e00640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eb81525c0 0x7f1eb80b4ff0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000cb90 tx=0x7f1eb000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:52.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eaf400640 1 -- 172.21.15.118:0/1716866244 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0016020 con 0x7f1eb81525c0 2024-09-21T06:09:52.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eaf400640 1 -- 172.21.15.118:0/1716866244 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eb000ae30 con 0x7f1eb81525c0 2024-09-21T06:09:52.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb8153010 con 0x7f1eb81525c0 2024-09-21T06:09:52.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.953+0000 7f1eaf400640 1 -- 172.21.15.118:0/1716866244 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0012680 con 0x7f1eb81525c0 2024-09-21T06:09:52.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.954+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb813d4e0 con 0x7f1eb81525c0 2024-09-21T06:09:52.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.954+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb80d0e80 con 0x7f1eb81525c0 2024-09-21T06:09:52.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.956+0000 7f1eaf400640 1 -- 172.21.15.118:0/1716866244 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1eb0019020 con 0x7f1eb81525c0 2024-09-21T06:09:52.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.957+0000 7f1eaf400640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1e98078b90 0x7f1e9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:52.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.957+0000 7f1eaf400640 1 -- 172.21.15.118:0/1716866244 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5227+0+0 (secure 0 0 0) 0x7f1eb009b820 con 0x7f1eb81525c0 2024-09-21T06:09:52.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.958+0000 7f1eb7400640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1e98078b90 0x7f1e9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:52.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.958+0000 7f1eb7400640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1e98078b90 0x7f1e9807b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8001120 tx=0x7f1ea8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:52.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:52.961+0000 7f1eaf400640 1 -- 172.21.15.118:0/1716866244 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1eb0020030 con 0x7f1eb81525c0 2024-09-21T06:09:53.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.148+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1eb8152ac0 con 0x7f1eb81525c0 2024-09-21T06:09:53.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.693+0000 7f1eaf400640 1 -- 172.21.15.118:0/1716866244 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v116) ==== 170+0+0 (secure 0 0 0) 0x7f1eb0063e20 con 0x7f1eb81525c0 2024-09-21T06:09:53.695 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1e98078b90 msgr2=0x7f1e9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1e98078b90 0x7f1e9807b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8001120 tx=0x7f1ea8009040 comp rx=0 tx=0).stop 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eb81525c0 msgr2=0x7f1eb80b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eb81525c0 0x7f1eb80b4ff0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000cb90 tx=0x7f1eb000a430 comp rx=0 tx=0).stop 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 shutdown_connections 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eb81525c0 0x7f1eb80b4ff0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1e98078b90 0x7f1e9807b0a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1eb813fef0 0x7f1eb80b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 --2- 172.21.15.118:0/1716866244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1eb813fae0 0x7f1eb8150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 >> 172.21.15.118:0/1716866244 conn(0x7f1eb806d110 msgr2=0x7f1eb815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 shutdown_connections 2024-09-21T06:09:53.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.696+0000 7f1ebe800640 1 -- 172.21.15.118:0/1716866244 wait complete. 2024-09-21T06:09:53.736 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 -- 172.21.15.118:0/1223396373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3980cf170 msgr2=0x7fa3980cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 --2- 172.21.15.118:0/1223396373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3980cf170 0x7fa3980cf580 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa3980708d0 tx=0x7fa39002a830 comp rx=0 tx=0).stop 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 -- 172.21.15.118:0/1223396373 shutdown_connections 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 --2- 172.21.15.118:0/1223396373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3980cf170 0x7fa3980cf580 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 --2- 172.21.15.118:0/1223396373 >> v2:172.21.15.149:3300/0 conn(0x7fa3980d0ea0 0x7fa3980d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 -- 172.21.15.118:0/1223396373 >> 172.21.15.118:0/1223396373 conn(0x7fa39806d110 msgr2=0x7fa39806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 -- 172.21.15.118:0/1223396373 shutdown_connections 2024-09-21T06:09:53.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.960+0000 7fa39f400640 1 -- 172.21.15.118:0/1223396373 wait complete. 2024-09-21T06:09:53.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.962+0000 7fa39f400640 1 Processor -- start 2024-09-21T06:09:53.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.962+0000 7fa39f400640 1 -- start start 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3980cf170 0x7fa3981f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3980d0ea0 0x7fa398160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39813fd80 0x7fa398160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa3981402d0 con 0x7fa39813fd80 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa39815d890 con 0x7fa3980d0ea0 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa3980cfac0 con 0x7fa3980cf170 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39813fd80 0x7fa398160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39813fd80 0x7fa398160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56040/0 (socket says 172.21.15.118:56040) 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.964+0000 7fa39d400640 1 -- 172.21.15.118:0/700260239 learned_addr learned my addr 172.21.15.118:0/700260239 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa38fe00640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3980d0ea0 0x7fa398160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa39ca00640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3980cf170 0x7fa3981f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa39d400640 1 -- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3980cf170 msgr2=0x7fa3981f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa39d400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3980cf170 0x7fa3981f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa39d400640 1 -- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3980d0ea0 msgr2=0x7fa398160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa39d400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3980d0ea0 0x7fa398160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa39d400640 1 -- 172.21.15.118:0/700260239 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa398143230 con 0x7fa39813fd80 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa39d400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39813fd80 0x7fa398160d70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa390009ca0 tx=0x7fa390033ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.965+0000 7fa395600640 1 -- 172.21.15.118:0/700260239 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390042020 con 0x7fa39813fd80 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.966+0000 7fa395600640 1 -- 172.21.15.118:0/700260239 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa390033cc0 con 0x7fa39813fd80 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.966+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa398073810 con 0x7fa39813fd80 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.966+0000 7fa395600640 1 -- 172.21.15.118:0/700260239 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390037040 con 0x7fa39813fd80 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.966+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa398073dd0 con 0x7fa39813fd80 2024-09-21T06:09:53.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.967+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa398076790 con 0x7fa39813fd80 2024-09-21T06:09:53.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.968+0000 7fa395600640 1 -- 172.21.15.118:0/700260239 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa390045020 con 0x7fa39813fd80 2024-09-21T06:09:53.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.970+0000 7fa395600640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa374078bc0 0x7fa37407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.970+0000 7fa395600640 1 -- 172.21.15.118:0/700260239 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5609+0+0 (secure 0 0 0) 0x7fa3900bbff0 con 0x7fa39813fd80 2024-09-21T06:09:53.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.970+0000 7fa39ca00640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa374078bc0 0x7fa37407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.971+0000 7fa39ca00640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa374078bc0 0x7fa37407b0d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa388007d60 tx=0x7fa388007cf0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:53.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:53.974+0000 7fa395600640 1 -- 172.21.15.118:0/700260239 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa398076790 con 0x7fa39813fd80 2024-09-21T06:09:54.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.197+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa398076b90 con 0x7fa39813fd80 2024-09-21T06:09:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.721+0000 7fa395600640 1 -- 172.21.15.118:0/700260239 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v56) ==== 174+0+0 (secure 0 0 0) 0x7fa398076b90 con 0x7fa39813fd80 2024-09-21T06:09:54.725 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 14 and data pool 15 2024-09-21T06:09:54.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.728+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa374078bc0 msgr2=0x7fa37407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.728+0000 7fa39f400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa374078bc0 0x7fa37407b0d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa388007d60 tx=0x7fa388007cf0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.728+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39813fd80 msgr2=0x7fa398160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.728+0000 7fa39f400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39813fd80 0x7fa398160d70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa390009ca0 tx=0x7fa390033ad0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.729+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 shutdown_connections 2024-09-21T06:09:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.729+0000 7fa39f400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39813fd80 0x7fa398160d70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.729+0000 7fa39f400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3980d0ea0 0x7fa398160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.729+0000 7fa39f400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa374078bc0 0x7fa37407b0d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.729+0000 7fa39f400640 1 --2- 172.21.15.118:0/700260239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3980cf170 0x7fa3981f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.729+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 >> 172.21.15.118:0/700260239 conn(0x7fa39806d110 msgr2=0x7fa39813aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:54.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.729+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 shutdown_connections 2024-09-21T06:09:54.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.730+0000 7fa39f400640 1 -- 172.21.15.118:0/700260239 wait complete. 2024-09-21T06:09:54.761 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.984+0000 7f8a36a00640 1 -- 172.21.15.118:0/3839970740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a14004800 msgr2=0x7f8a14004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.984+0000 7f8a36a00640 1 --2- 172.21.15.118:0/3839970740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a14004800 0x7f8a14004c10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800bb20 tx=0x7f8a14005830 comp rx=0 tx=0).stop 2024-09-21T06:09:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.984+0000 7f8a36a00640 1 -- 172.21.15.118:0/3839970740 shutdown_connections 2024-09-21T06:09:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.984+0000 7f8a36a00640 1 --2- 172.21.15.118:0/3839970740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a14004800 0x7f8a14004c10 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.984+0000 7f8a36a00640 1 -- 172.21.15.118:0/3839970740 >> 172.21.15.118:0/3839970740 conn(0x7f8a3006d110 msgr2=0x7f8a3006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.984+0000 7f8a36a00640 1 -- 172.21.15.118:0/3839970740 shutdown_connections 2024-09-21T06:09:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.984+0000 7f8a36a00640 1 -- 172.21.15.118:0/3839970740 wait complete. 2024-09-21T06:09:54.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.986+0000 7f8a36a00640 1 Processor -- start 2024-09-21T06:09:54.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.987+0000 7f8a36a00640 1 -- start start 2024-09-21T06:09:54.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a36a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14004800 0x7f8a301f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:54.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a36a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a3015fd90 0x7f8a30139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:54.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a36a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a301549e0 0x7f8a30154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:54.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a36a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8a300d16a0 con 0x7f8a3015fd90 2024-09-21T06:09:54.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a36a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30142730 con 0x7f8a301549e0 2024-09-21T06:09:54.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a36a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3013da30 con 0x7f8a14004800 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a27400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a3015fd90 0x7f8a30139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a27400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a3015fd90 0x7f8a30139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56056/0 (socket says 172.21.15.118:56056) 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a27400640 1 -- 172.21.15.118:0/1419802265 learned_addr learned my addr 172.21.15.118:0/1419802265 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a2fe00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14004800 0x7f8a301f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.988+0000 7f8a34a00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a301549e0 0x7f8a30154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a27400640 1 -- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14004800 msgr2=0x7f8a301f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a27400640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14004800 0x7f8a301f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a27400640 1 -- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a301549e0 msgr2=0x7f8a30154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a27400640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a301549e0 0x7f8a30154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:54.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a27400640 1 -- 172.21.15.118:0/1419802265 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a30155330 con 0x7f8a3015fd90 2024-09-21T06:09:54.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a27400640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a3015fd90 0x7f8a30139530 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800ba40 tx=0x7f8a1800b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:54.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a2cc00640 1 -- 172.21.15.118:0/1419802265 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18040070 con 0x7f8a3015fd90 2024-09-21T06:09:54.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a2cc00640 1 -- 172.21.15.118:0/1419802265 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a18004340 con 0x7f8a3015fd90 2024-09-21T06:09:54.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.989+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3015ecf0 con 0x7f8a3015fd90 2024-09-21T06:09:54.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.990+0000 7f8a2cc00640 1 -- 172.21.15.118:0/1419802265 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18035040 con 0x7f8a3015fd90 2024-09-21T06:09:54.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.990+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3015f2b0 con 0x7f8a3015fd90 2024-09-21T06:09:54.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.991+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a30142c90 con 0x7f8a3015fd90 2024-09-21T06:09:54.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.992+0000 7f8a2cc00640 1 -- 172.21.15.118:0/1419802265 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a18038020 con 0x7f8a3015fd90 2024-09-21T06:09:54.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.993+0000 7f8a2cc00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:54.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.993+0000 7f8a2cc00640 1 -- 172.21.15.118:0/1419802265 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f8a180bbb40 con 0x7f8a3015fd90 2024-09-21T06:09:54.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.993+0000 7f8a2fe00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:54.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.994+0000 7f8a2fe00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006bd50 tx=0x7f8a20006b70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:54.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:54.997+0000 7f8a2cc00640 1 -- 172.21.15.118:0/1419802265 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8a30155330 con 0x7f8a3015fd90 2024-09-21T06:09:55.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.186+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a30142040 con 0x7f8a3015fd90 2024-09-21T06:09:55.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.187+0000 7f8a2cc00640 1 -- 172.21.15.118:0/1419802265 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16765 (secure 0 0 0) 0x7f8a18083890 con 0x7f8a3015fd90 2024-09-21T06:09:55.189 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:55.189 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":117,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:09:54.198152+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:09:52.106767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T06:09:53.161177+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:55.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8a0c078b90 msgr2=0x7f8a0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006bd50 tx=0x7f8a20006b70 comp rx=0 tx=0).stop 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a3015fd90 msgr2=0x7f8a30139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a3015fd90 0x7f8a30139530 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800ba40 tx=0x7f8a1800b770 comp rx=0 tx=0).stop 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 shutdown_connections 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a301549e0 0x7f8a30154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a3015fd90 0x7f8a30139530 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 --2- 172.21.15.118:0/1419802265 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14004800 0x7f8a301f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 >> 172.21.15.118:0/1419802265 conn(0x7f8a3006d110 msgr2=0x7f8a30140bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 shutdown_connections 2024-09-21T06:09:55.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.190+0000 7f8a36a00640 1 -- 172.21.15.118:0/1419802265 wait complete. 2024-09-21T06:09:55.213 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:55.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 -- 172.21.15.118:0/747626253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 msgr2=0x7fccf40d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 --2- 172.21.15.118:0/747626253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40d0240 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fccf4072570 tx=0x7fcce002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 -- 172.21.15.118:0/747626253 shutdown_connections 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 --2- 172.21.15.118:0/747626253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40d0240 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 --2- 172.21.15.118:0/747626253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fccf40b5bb0 0x7fccf40b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 --2- 172.21.15.118:0/747626253 >> v2:172.21.15.149:3300/0 conn(0x7fccf4073fa0 0x7fccf40749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 -- 172.21.15.118:0/747626253 >> 172.21.15.118:0/747626253 conn(0x7fccf406d6e0 msgr2=0x7fccf40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 -- 172.21.15.118:0/747626253 shutdown_connections 2024-09-21T06:09:55.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.435+0000 7fccf9200640 1 -- 172.21.15.118:0/747626253 wait complete. 2024-09-21T06:09:55.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.437+0000 7fccf9200640 1 Processor -- start 2024-09-21T06:09:55.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.437+0000 7fccf9200640 1 -- start start 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf4073fa0 0x7fccf415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fccf40b5bb0 0x7fccf40aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf9200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fccf415d7b0 con 0x7fccf40cfe30 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fccf415d630 con 0x7fccf4073fa0 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fccf415d930 con 0x7fccf40b5bb0 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56072/0 (socket says 172.21.15.118:56072) 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf3e00640 1 -- 172.21.15.118:0/2579247950 learned_addr learned my addr 172.21.15.118:0/2579247950 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf3400640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf4073fa0 0x7fccf415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.439+0000 7fccf2a00640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fccf40b5bb0 0x7fccf40aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf3e00640 1 -- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fccf40b5bb0 msgr2=0x7fccf40aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf3e00640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fccf40b5bb0 0x7fccf40aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf3e00640 1 -- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf4073fa0 msgr2=0x7fccf415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf3e00640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf4073fa0 0x7fccf415e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf3e00640 1 -- 172.21.15.118:0/2579247950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf41f59c0 con 0x7fccf40cfe30 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf3e00640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40ab490 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fccec00cce0 tx=0x7fccec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fcceb400640 1 -- 172.21.15.118:0/2579247950 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec00f450 con 0x7fccf40cfe30 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fcceb400640 1 -- 172.21.15.118:0/2579247950 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccec00f6e0 con 0x7fccf40cfe30 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf415ea70 con 0x7fccf40cfe30 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fcceb400640 1 -- 172.21.15.118:0/2579247950 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec00fb30 con 0x7fccf40cfe30 2024-09-21T06:09:55.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.440+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf41f5f60 con 0x7fccf40cfe30 2024-09-21T06:09:55.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.442+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf415e7e0 con 0x7fccf40cfe30 2024-09-21T06:09:55.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.443+0000 7fcceb400640 1 -- 172.21.15.118:0/2579247950 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccec00fcd0 con 0x7fccf40cfe30 2024-09-21T06:09:55.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.444+0000 7fcceb400640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccd4078b90 0x7fccd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.444+0000 7fcceb400640 1 -- 172.21.15.118:0/2579247950 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fccec09b7e0 con 0x7fccf40cfe30 2024-09-21T06:09:55.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.444+0000 7fccf3400640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccd4078b90 0x7fccd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.445+0000 7fccf3400640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccd4078b90 0x7fccd407b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005fd0 tx=0x7fcce400b260 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:55.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.448+0000 7fcceb400640 1 -- 172.21.15.118:0/2579247950 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fccec014030 con 0x7fccf40cfe30 2024-09-21T06:09:55.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.633+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccf4146290 con 0x7fccf40cfe30 2024-09-21T06:09:55.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.635+0000 7fcceb400640 1 -- 172.21.15.118:0/2579247950 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16765 (secure 0 0 0) 0x7fccec0635b0 con 0x7fccf40cfe30 2024-09-21T06:09:55.636 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:55.636 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":117,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:09:54.198152+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:09:52.106767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T06:09:53.161177+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccd4078b90 msgr2=0x7fccd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccd4078b90 0x7fccd407b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005fd0 tx=0x7fcce400b260 comp rx=0 tx=0).stop 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 msgr2=0x7fccf40ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40ab490 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fccec00cce0 tx=0x7fccec00a620 comp rx=0 tx=0).stop 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 shutdown_connections 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf40cfe30 0x7fccf40ab490 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccd4078b90 0x7fccd407b0a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fccf40b5bb0 0x7fccf40aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 --2- 172.21.15.118:0/2579247950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccf4073fa0 0x7fccf415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 >> 172.21.15.118:0/2579247950 conn(0x7fccf406d6e0 msgr2=0x7fccf415af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 shutdown_connections 2024-09-21T06:09:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.637+0000 7fccf9200640 1 -- 172.21.15.118:0/2579247950 wait complete. 2024-09-21T06:09:55.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:09:55.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.883+0000 7f294c200640 1 -- 172.21.15.118:0/431021585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29440d1590 msgr2=0x7f2944142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.883+0000 7f294c200640 1 --2- 172.21.15.118:0/431021585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29440d1590 0x7f2944142730 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f294415d420 tx=0x7f293002a4a0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.884+0000 7f294c200640 1 -- 172.21.15.118:0/431021585 shutdown_connections 2024-09-21T06:09:55.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.884+0000 7f294c200640 1 --2- 172.21.15.118:0/431021585 >> v2:172.21.15.149:3300/0 conn(0x7f294413fef0 0x7f2944142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.884+0000 7f294c200640 1 --2- 172.21.15.118:0/431021585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29440d1590 0x7f2944142730 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.884+0000 7f294c200640 1 -- 172.21.15.118:0/431021585 >> 172.21.15.118:0/431021585 conn(0x7f294406d110 msgr2=0x7f294406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:55.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.884+0000 7f294c200640 1 -- 172.21.15.118:0/431021585 shutdown_connections 2024-09-21T06:09:55.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.884+0000 7f294c200640 1 -- 172.21.15.118:0/431021585 wait complete. 2024-09-21T06:09:55.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.886+0000 7f294c200640 1 Processor -- start 2024-09-21T06:09:55.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.886+0000 7f294c200640 1 -- start start 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.887+0000 7f294c200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f294413fae0 0x7f294413a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.887+0000 7f294c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f294413fef0 0x7f29441f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.887+0000 7f294c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29441393f0 0x7f2944072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.887+0000 7f294c200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f29440cfa70 con 0x7f294413fae0 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.887+0000 7f294c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29440cf8f0 con 0x7f29441393f0 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.887+0000 7f294c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29440cfbf0 con 0x7f294413fef0 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f294413fae0 0x7f294413a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f294413fae0 0x7f294413a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53788/0 (socket says 172.21.15.118:53788) 2024-09-21T06:09:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 -- 172.21.15.118:0/3927559237 learned_addr learned my addr 172.21.15.118:0/3927559237 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2948e00640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f294413fef0 0x7f29441f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f294a200640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29441393f0 0x7f2944072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 -- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f294413fef0 msgr2=0x7f29441f9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f294413fef0 0x7f29441f9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 -- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29441393f0 msgr2=0x7f2944072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29441393f0 0x7f2944072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 -- 172.21.15.118:0/3927559237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29441fa0f0 con 0x7f294413fae0 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.888+0000 7f2949800640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f294413fae0 0x7f294413a7f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f293800c3f0 tx=0x7f293800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.889+0000 7f2941600640 1 -- 172.21.15.118:0/3927559237 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938017070 con 0x7f294413fae0 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.889+0000 7f2941600640 1 -- 172.21.15.118:0/3927559237 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29380035f0 con 0x7f294413fae0 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.889+0000 7f2941600640 1 -- 172.21.15.118:0/3927559237 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938003a40 con 0x7f294413fae0 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.889+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2944141400 con 0x7f294413fae0 2024-09-21T06:09:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.889+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2944139ff0 con 0x7f294413fae0 2024-09-21T06:09:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.890+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29440d0110 con 0x7f294413fae0 2024-09-21T06:09:55.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.891+0000 7f2941600640 1 -- 172.21.15.118:0/3927559237 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f293801a070 con 0x7f294413fae0 2024-09-21T06:09:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.892+0000 7f2941600640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2924078b90 0x7f292407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:55.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.892+0000 7f2941600640 1 -- 172.21.15.118:0/3927559237 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f2938099fd0 con 0x7f294413fae0 2024-09-21T06:09:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.893+0000 7f2948e00640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2924078b90 0x7f292407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:55.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.893+0000 7f2948e00640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2924078b90 0x7f292407b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2930034000 tx=0x7f2930004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:55.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:55.897+0000 7f2941600640 1 -- 172.21.15.118:0/3927559237 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f29441fa0f0 con 0x7f294413fae0 2024-09-21T06:09:56.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.117+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f294415ece0 con 0x7f294413fae0 2024-09-21T06:09:56.689 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:09:56.688+0000 7f0b91400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:09:56.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.729+0000 7f2941600640 1 -- 172.21.15.118:0/3927559237 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) ==== 118+0+0 (secure 0 0 0) 0x7f2938061e50 con 0x7f294413fae0 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2924078b90 msgr2=0x7f292407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2924078b90 0x7f292407b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2930034000 tx=0x7f2930004730 comp rx=0 tx=0).stop 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f294413fae0 msgr2=0x7f294413a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f294413fae0 0x7f294413a7f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f293800c3f0 tx=0x7f293800c8b0 comp rx=0 tx=0).stop 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 shutdown_connections 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29441393f0 0x7f2944072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2924078b90 0x7f292407b0a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:56.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f294413fef0 0x7f29441f9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:56.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 --2- 172.21.15.118:0/3927559237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f294413fae0 0x7f294413a7f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:56.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 >> 172.21.15.118:0/3927559237 conn(0x7f294406d110 msgr2=0x7f2944142a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:56.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 shutdown_connections 2024-09-21T06:09:56.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.731+0000 7f294c200640 1 -- 172.21.15.118:0/3927559237 wait complete. 2024-09-21T06:09:56.755 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:09:56.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:09:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.978+0000 7f96ede00640 1 -- 172.21.15.118:0/1206559396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96cc003c10 msgr2=0x7f96cc004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.978+0000 7f96ede00640 1 --2- 172.21.15.118:0/1206559396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96cc003c10 0x7f96cc004060 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f96d8001830 tx=0x7f96cc005830 comp rx=0 tx=0).stop 2024-09-21T06:09:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.978+0000 7f96e7400640 1 -- 172.21.15.118:0/1206559396 reap_dead start 2024-09-21T06:09:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.978+0000 7f96ede00640 1 -- 172.21.15.118:0/1206559396 shutdown_connections 2024-09-21T06:09:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.978+0000 7f96ede00640 1 -- 172.21.15.118:0/1206559396 >> 172.21.15.118:0/1206559396 conn(0x7f96e806d110 msgr2=0x7f96e806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.978+0000 7f96ede00640 1 -- 172.21.15.118:0/1206559396 shutdown_connections 2024-09-21T06:09:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.978+0000 7f96ede00640 1 -- 172.21.15.118:0/1206559396 wait complete. 2024-09-21T06:09:56.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.981+0000 7f96ede00640 1 Processor -- start 2024-09-21T06:09:56.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.981+0000 7f96ede00640 1 -- start start 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.982+0000 7f96ede00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96cc003c10 0x7f96e81f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.982+0000 7f96ede00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e813a7f0 0x7f96e8139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.982+0000 7f96ede00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e80c6dc0 0x7f96e80c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.982+0000 7f96ede00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8165d00 con 0x7f96e80c6dc0 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.982+0000 7f96ede00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8165b80 con 0x7f96e813a7f0 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.982+0000 7f96ede00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f96e8165e80 con 0x7f96cc003c10 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e80c6dc0 0x7f96e80c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e80c6dc0 0x7f96e80c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53808/0 (socket says 172.21.15.118:53808) 2024-09-21T06:09:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 -- 172.21.15.118:0/3020262585 learned_addr learned my addr 172.21.15.118:0/3020262585 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:56.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e6a00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96cc003c10 0x7f96e81f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:56.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96de000640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e813a7f0 0x7f96e8139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 -- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96cc003c10 msgr2=0x7f96e81f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96cc003c10 0x7f96e81f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 -- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e813a7f0 msgr2=0x7f96e8139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e813a7f0 0x7f96e8139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 -- 172.21.15.118:0/3020262585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e813a530 con 0x7f96e80c6dc0 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96e7400640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e80c6dc0 0x7f96e80c71d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f96e8140340 tx=0x7f96e0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.983+0000 7f96dfe00640 1 -- 172.21.15.118:0/3020262585 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0003970 con 0x7f96e80c6dc0 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.984+0000 7f96dfe00640 1 -- 172.21.15.118:0/3020262585 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96e0015070 con 0x7f96e80c6dc0 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.984+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e80c5d20 con 0x7f96e80c6dc0 2024-09-21T06:09:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.984+0000 7f96dfe00640 1 -- 172.21.15.118:0/3020262585 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0004030 con 0x7f96e80c6dc0 2024-09-21T06:09:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.984+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e80c62e0 con 0x7f96e80c6dc0 2024-09-21T06:09:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.985+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e8142730 con 0x7f96e80c6dc0 2024-09-21T06:09:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.986+0000 7f96dfe00640 1 -- 172.21.15.118:0/3020262585 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96e00041d0 con 0x7f96e80c6dc0 2024-09-21T06:09:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.987+0000 7f96dfe00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96c4078b90 0x7f96c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.987+0000 7f96dfe00640 1 -- 172.21.15.118:0/3020262585 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f96e009b780 con 0x7f96e80c6dc0 2024-09-21T06:09:56.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.988+0000 7f96e6a00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96c4078b90 0x7f96c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:56.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.988+0000 7f96e6a00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96c4078b90 0x7f96c407b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f96d8032000 tx=0x7f96d8001360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:56.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:56.992+0000 7f96dfe00640 1 -- 172.21.15.118:0/3020262585 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f96e00635f0 con 0x7f96e80c6dc0 2024-09-21T06:09:57.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.209+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f96e815e810 con 0x7f96e80c6dc0 2024-09-21T06:09:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.735+0000 7f96dfe00640 1 -- 172.21.15.118:0/3020262585 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) ==== 122+0+0 (secure 0 0 0) 0x7f96e006a0c0 con 0x7f96e80c6dc0 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96c4078b90 msgr2=0x7f96c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96c4078b90 0x7f96c407b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f96d8032000 tx=0x7f96d8001360 comp rx=0 tx=0).stop 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e80c6dc0 msgr2=0x7f96e80c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e80c6dc0 0x7f96e80c71d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f96e8140340 tx=0x7f96e0010f40 comp rx=0 tx=0).stop 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 shutdown_connections 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e80c6dc0 0x7f96e80c71d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96e813a7f0 0x7f96e8139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96c4078b90 0x7f96c407b0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 --2- 172.21.15.118:0/3020262585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96cc003c10 0x7f96e81f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 >> 172.21.15.118:0/3020262585 conn(0x7f96e806d110 msgr2=0x7f96e80b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 shutdown_connections 2024-09-21T06:09:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.738+0000 7f96ede00640 1 -- 172.21.15.118:0/3020262585 wait complete. 2024-09-21T06:09:57.762 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:09:57.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:09:57.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.984+0000 7f6a9d400640 1 -- 172.21.15.118:0/2783706293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a7c004800 msgr2=0x7f6a7c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.984+0000 7f6a9d400640 1 --2- 172.21.15.118:0/2783706293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a7c004800 0x7f6a7c004c10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6a980b31a0 tx=0x7f6a7c005830 comp rx=0 tx=0).stop 2024-09-21T06:09:57.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.984+0000 7f6a9d400640 1 -- 172.21.15.118:0/2783706293 shutdown_connections 2024-09-21T06:09:57.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.984+0000 7f6a9d400640 1 --2- 172.21.15.118:0/2783706293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a7c004800 0x7f6a7c004c10 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.984+0000 7f6a9d400640 1 -- 172.21.15.118:0/2783706293 >> 172.21.15.118:0/2783706293 conn(0x7f6a9806d6e0 msgr2=0x7f6a980b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:57.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.984+0000 7f6a9d400640 1 -- 172.21.15.118:0/2783706293 shutdown_connections 2024-09-21T06:09:57.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.984+0000 7f6a9d400640 1 -- 172.21.15.118:0/2783706293 wait complete. 2024-09-21T06:09:57.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.986+0000 7f6a9d400640 1 Processor -- start 2024-09-21T06:09:57.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.986+0000 7f6a9d400640 1 -- start start 2024-09-21T06:09:57.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a7c004800 0x7f6a9813c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a980ae8b0 0x7f6a980c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a980aecc0 0x7f6a980c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9d400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6a980744d0 con 0x7f6a980aecc0 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98074350 con 0x7f6a980ae8b0 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a980748c0 con 0x7f6a7c004800 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a980aecc0 0x7f6a980c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a980aecc0 0x7f6a980c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53832/0 (socket says 172.21.15.118:53832) 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 -- 172.21.15.118:0/626801244 learned_addr learned my addr 172.21.15.118:0/626801244 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a97e00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a7c004800 0x7f6a9813c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a97400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a980ae8b0 0x7f6a980c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 -- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a7c004800 msgr2=0x7f6a9813c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a7c004800 0x7f6a9813c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 -- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a980ae8b0 msgr2=0x7f6a980c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a980ae8b0 0x7f6a980c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a9ca00640 1 -- 172.21.15.118:0/626801244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a981f9640 con 0x7f6a980aecc0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a97e00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a7c004800 0x7f6a9813c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.988+0000 7f6a97400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a980ae8b0 0x7f6a980c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.989+0000 7f6a9ca00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a980aecc0 0x7f6a980c5d50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6a980ce360 tx=0x7f6a9000e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.989+0000 7f6a8fe00640 1 -- 172.21.15.118:0/626801244 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a900107d0 con 0x7f6a980aecc0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.989+0000 7f6a8fe00640 1 -- 172.21.15.118:0/626801244 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a90016070 con 0x7f6a980aecc0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.989+0000 7f6a8fe00640 1 -- 172.21.15.118:0/626801244 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90010ce0 con 0x7f6a980aecc0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.989+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a981f9920 con 0x7f6a980aecc0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.989+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a981f5e00 con 0x7f6a980aecc0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.990+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a980af200 con 0x7f6a980aecc0 2024-09-21T06:09:57.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.991+0000 7f6a8fe00640 1 -- 172.21.15.118:0/626801244 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a9001b460 con 0x7f6a980aecc0 2024-09-21T06:09:57.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.992+0000 7f6a8fe00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a78078bc0 0x7f6a7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.992+0000 7f6a8fe00640 1 -- 172.21.15.118:0/626801244 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f6a9009b0a0 con 0x7f6a980aecc0 2024-09-21T06:09:57.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.993+0000 7f6a97e00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a78078bc0 0x7f6a7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.993+0000 7f6a97e00640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a78078bc0 0x7f6a7807b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005fd0 tx=0x7f6a88009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:57.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:57.997+0000 7f6a8fe00640 1 -- 172.21.15.118:0/626801244 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6a90063600 con 0x7f6a980aecc0 2024-09-21T06:09:58.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.216+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a98144300 con 0x7f6a980aecc0 2024-09-21T06:09:58.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.217+0000 7f6a8fe00640 1 -- 172.21.15.118:0/626801244 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7f6a98144300 con 0x7f6a980aecc0 2024-09-21T06:09:58.218 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:58.218 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:09:58.219 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a78078bc0 msgr2=0x7f6a7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a78078bc0 0x7f6a7807b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005fd0 tx=0x7f6a88009500 comp rx=0 tx=0).stop 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a980aecc0 msgr2=0x7f6a980c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a980aecc0 0x7f6a980c5d50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6a980ce360 tx=0x7f6a9000e770 comp rx=0 tx=0).stop 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 shutdown_connections 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a980aecc0 0x7f6a980c5d50 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a980ae8b0 0x7f6a980c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a78078bc0 0x7f6a7807b0d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 --2- 172.21.15.118:0/626801244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a7c004800 0x7f6a9813c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 >> 172.21.15.118:0/626801244 conn(0x7f6a9806d6e0 msgr2=0x7f6a980b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:58.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 shutdown_connections 2024-09-21T06:09:58.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.219+0000 7f6a9d400640 1 -- 172.21.15.118:0/626801244 wait complete. 2024-09-21T06:09:58.242 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 -- 172.21.15.118:0/67805360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 msgr2=0x7f13f8146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 --2- 172.21.15.118:0/67805360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f8146080 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f13e8005fd0 tx=0x7f13e802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 -- 172.21.15.118:0/67805360 shutdown_connections 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 --2- 172.21.15.118:0/67805360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13f80ce660 0x7f13f8072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 --2- 172.21.15.118:0/67805360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f8146080 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 -- 172.21.15.118:0/67805360 >> 172.21.15.118:0/67805360 conn(0x7f13f806d6e0 msgr2=0x7f13f80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 -- 172.21.15.118:0/67805360 shutdown_connections 2024-09-21T06:09:58.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.461+0000 7f13f7e00640 1 -- 172.21.15.118:0/67805360 wait complete. 2024-09-21T06:09:58.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.463+0000 7f13f7e00640 1 Processor -- start 2024-09-21T06:09:58.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.464+0000 7f13f7e00640 1 -- start start 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f80cfe70 0x7f13f815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f81f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13f81f6d70 0x7f13f81f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f7e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13f80739d0 con 0x7f13f815d080 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13f8073850 con 0x7f13f80cfe70 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f13f8073b50 con 0x7f13f81f6d70 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f81f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f81f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53838/0 (socket says 172.21.15.118:53838) 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.465+0000 7f13f6000640 1 -- 172.21.15.118:0/2434698626 learned_addr learned my addr 172.21.15.118:0/2434698626 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:58.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6a00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f80cfe70 0x7f13f815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f7400640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13f81f6d70 0x7f13f81f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6000640 1 -- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13f81f6d70 msgr2=0x7f13f81f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6000640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13f81f6d70 0x7f13f81f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6000640 1 -- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f80cfe70 msgr2=0x7f13f815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6000640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f80cfe70 0x7f13f815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6000640 1 -- 172.21.15.118:0/2434698626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f81f8f60 con 0x7f13f815d080 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6a00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f80cfe70 0x7f13f815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f6000640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f81f8a20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f13e400c430 tx=0x7f13e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13eea00640 1 -- 172.21.15.118:0/2434698626 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4017070 con 0x7f13f815d080 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13eea00640 1 -- 172.21.15.118:0/2434698626 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13e40053e0 con 0x7f13f815d080 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f80b3b70 con 0x7f13f815d080 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.466+0000 7f13eea00640 1 -- 172.21.15.118:0/2434698626 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4003850 con 0x7f13f815d080 2024-09-21T06:09:58.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.467+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f80b4130 con 0x7f13f815d080 2024-09-21T06:09:58.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.468+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f815c990 con 0x7f13f815d080 2024-09-21T06:09:58.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.469+0000 7f13eea00640 1 -- 172.21.15.118:0/2434698626 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13e401a070 con 0x7f13f815d080 2024-09-21T06:09:58.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.470+0000 7f13eea00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f13d8078b90 0x7f13d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.470+0000 7f13eea00640 1 -- 172.21.15.118:0/2434698626 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f13e409a0c0 con 0x7f13f815d080 2024-09-21T06:09:58.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.470+0000 7f13f6a00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f13d8078b90 0x7f13d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.471+0000 7f13f6a00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f13d8078b90 0x7f13d807b0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f13e8033000 tx=0x7f13e8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:58.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.474+0000 7f13eea00640 1 -- 172.21.15.118:0/2434698626 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f13e4062590 con 0x7f13f815d080 2024-09-21T06:09:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.658+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13f8074000 con 0x7f13f815d080 2024-09-21T06:09:58.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.659+0000 7f13eea00640 1 -- 172.21.15.118:0/2434698626 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16752 (secure 0 0 0) 0x7f13e4061e90 con 0x7f13f815d080 2024-09-21T06:09:58.661 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:58.661 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":118,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:09:55.708722+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:09:52.106767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T06:09:53.161177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:58.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f13d8078b90 msgr2=0x7f13d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f13d8078b90 0x7f13d807b0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f13e8033000 tx=0x7f13e8004730 comp rx=0 tx=0).stop 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 msgr2=0x7f13f81f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f81f8a20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f13e400c430 tx=0x7f13e400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 shutdown_connections 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f13d8078b90 0x7f13d807b0a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13f81f6d70 0x7f13f81f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f815d080 0x7f13f81f8a20 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 --2- 172.21.15.118:0/2434698626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13f80cfe70 0x7f13f815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 >> 172.21.15.118:0/2434698626 conn(0x7f13f806d6e0 msgr2=0x7f13f815fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 shutdown_connections 2024-09-21T06:09:58.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.662+0000 7f13f7e00640 1 -- 172.21.15.118:0/2434698626 wait complete. 2024-09-21T06:09:58.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:09:58.686 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:09:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.905+0000 7fee28200640 1 -- 172.21.15.118:0/357965460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee08003a50 msgr2=0x7fee08003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.905+0000 7fee28200640 1 --2- 172.21.15.118:0/357965460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee08003a50 0x7fee08003ec0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fee140016c0 tx=0x7fee08005830 comp rx=0 tx=0).stop 2024-09-21T06:09:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.905+0000 7fee28200640 1 -- 172.21.15.118:0/357965460 shutdown_connections 2024-09-21T06:09:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.905+0000 7fee28200640 1 --2- 172.21.15.118:0/357965460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee08003a50 0x7fee08003ec0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.905+0000 7fee28200640 1 -- 172.21.15.118:0/357965460 >> 172.21.15.118:0/357965460 conn(0x7fee2006d110 msgr2=0x7fee2006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.905+0000 7fee28200640 1 -- 172.21.15.118:0/357965460 shutdown_connections 2024-09-21T06:09:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.905+0000 7fee28200640 1 -- 172.21.15.118:0/357965460 wait complete. 2024-09-21T06:09:58.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.907+0000 7fee28200640 1 Processor -- start 2024-09-21T06:09:58.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.908+0000 7fee28200640 1 -- start start 2024-09-21T06:09:58.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee28200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee08003a50 0x7fee20152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee28200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee201f5390 0x7fee201f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee28200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee2015bd90 0x7fee2015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee28200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fee200d16a0 con 0x7fee2015bd90 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee28200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee20142730 con 0x7fee201f5390 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee28200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee200746d0 con 0x7fee08003a50 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee26200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee2015bd90 0x7fee2015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee26200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee2015bd90 0x7fee2015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53856/0 (socket says 172.21.15.118:53856) 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.909+0000 7fee26200640 1 -- 172.21.15.118:0/35590120 learned_addr learned my addr 172.21.15.118:0/35590120 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee25800640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee08003a50 0x7fee20152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee24e00640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee201f5390 0x7fee201f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee26200640 1 -- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee08003a50 msgr2=0x7fee20152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee26200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee08003a50 0x7fee20152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee26200640 1 -- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee201f5390 msgr2=0x7fee201f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee26200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee201f5390 0x7fee201f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee26200640 1 -- 172.21.15.118:0/35590120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2015c6e0 con 0x7fee2015bd90 2024-09-21T06:09:58.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee26200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee2015bd90 0x7fee2015c1a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fee20154510 tx=0x7fee18010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee1d600640 1 -- 172.21.15.118:0/35590120 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1800ee70 con 0x7fee2015bd90 2024-09-21T06:09:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee1d600640 1 -- 172.21.15.118:0/35590120 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee18015070 con 0x7fee2015bd90 2024-09-21T06:09:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee1d600640 1 -- 172.21.15.118:0/35590120 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18003d00 con 0x7fee2015bd90 2024-09-21T06:09:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.910+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee201f5e60 con 0x7fee2015bd90 2024-09-21T06:09:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.911+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee20072e50 con 0x7fee2015bd90 2024-09-21T06:09:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.912+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee20142c90 con 0x7fee2015bd90 2024-09-21T06:09:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.913+0000 7fee1d600640 1 -- 172.21.15.118:0/35590120 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee18004030 con 0x7fee2015bd90 2024-09-21T06:09:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.914+0000 7fee1d600640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee00078b90 0x7fee0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.914+0000 7fee1d600640 1 -- 172.21.15.118:0/35590120 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fee1809b4f0 con 0x7fee2015bd90 2024-09-21T06:09:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.914+0000 7fee25800640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee00078b90 0x7fee0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.915+0000 7fee25800640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee00078b90 0x7fee0007b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fee14032000 tx=0x7fee14001190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:58.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:58.918+0000 7fee1d600640 1 -- 172.21.15.118:0/35590120 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee2015c6e0 con 0x7fee2015bd90 2024-09-21T06:09:59.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.101+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee2006fbc0 con 0x7fee00078b90 2024-09-21T06:09:59.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.107+0000 7fee1d600640 1 -- 172.21.15.118:0/35590120 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244078 (secure 0 0 0) 0x7fee2006fbc0 con 0x7fee00078b90 2024-09-21T06:09:59.111 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:59.111 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:09:59.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.110+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee00078b90 msgr2=0x7fee0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.110+0000 7fee28200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee00078b90 0x7fee0007b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fee14032000 tx=0x7fee14001190 comp rx=0 tx=0).stop 2024-09-21T06:09:59.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.110+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee2015bd90 msgr2=0x7fee2015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.110+0000 7fee28200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee2015bd90 0x7fee2015c1a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fee20154510 tx=0x7fee18010f40 comp rx=0 tx=0).stop 2024-09-21T06:09:59.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.110+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 shutdown_connections 2024-09-21T06:09:59.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.111+0000 7fee28200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee2015bd90 0x7fee2015c1a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.111+0000 7fee28200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee201f5390 0x7fee201f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.111+0000 7fee28200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee00078b90 0x7fee0007b0a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.111+0000 7fee28200640 1 --2- 172.21.15.118:0/35590120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee08003a50 0x7fee20152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.111+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 >> 172.21.15.118:0/35590120 conn(0x7fee2006d110 msgr2=0x7fee20140a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:59.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.111+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 shutdown_connections 2024-09-21T06:09:59.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.111+0000 7fee28200640 1 -- 172.21.15.118:0/35590120 wait complete. 2024-09-21T06:09:59.135 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-09-21T06:09:58.551914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6113,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556386,"statfs":{"total":1600000000,"available":1593739532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.854591"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701387+0000","last_change":"2024-09-21T06:09:53.701387+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701387+0000","last_undegraded":"2024-09-21T06:09:53.701387+0000","last_fullsized":"2024-09-21T06:09:53.701387+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736825+0000","last_change":"2024-09-21T06:09:54.736623+0000","last_active":"2024-09-21T06:09:54.736825+0000","last_peered":"2024-09-21T06:09:54.736825+0000","last_clean":"2024-09-21T06:09:54.736825+0000","last_became_active":"2024-09-21T06:09:54.730791+0000","last_became_peered":"2024-09-21T06:09:54.730791+0000","last_unstale":"2024-09-21T06:09:54.736825+0000","last_undegraded":"2024-09-21T06:09:54.736825+0000","last_fullsized":"2024-09-21T06:09:54.736825+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:45.275210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701151+0000","last_change":"2024-09-21T06:09:53.701151+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701151+0000","last_undegraded":"2024-09-21T06:09:53.701151+0000","last_fullsized":"2024-09-21T06:09:53.701151+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.726329+0000","last_change":"2024-09-21T06:09:54.724168+0000","last_active":"2024-09-21T06:09:54.726329+0000","last_peered":"2024-09-21T06:09:54.726329+0000","last_clean":"2024-09-21T06:09:54.726329+0000","last_became_active":"2024-09-21T06:09:54.723648+0000","last_became_peered":"2024-09-21T06:09:54.723648+0000","last_unstale":"2024-09-21T06:09:54.726329+0000","last_undegraded":"2024-09-21T06:09:54.726329+0000","last_fullsized":"2024-09-21T06:09:54.726329+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:00.573035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709985+0000","last_change":"2024-09-21T06:09:53.709985+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709985+0000","last_undegraded":"2024-09-21T06:09:53.709985+0000","last_fullsized":"2024-09-21T06:09:53.709985+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701569+0000","last_change":"2024-09-21T06:09:53.701569+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701569+0000","last_undegraded":"2024-09-21T06:09:53.701569+0000","last_fullsized":"2024-09-21T06:09:53.701569+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699940+0000","last_change":"2024-09-21T06:09:53.699940+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699940+0000","last_undegraded":"2024-09-21T06:09:53.699940+0000","last_fullsized":"2024-09-21T06:09:53.699940+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733366+0000","last_change":"2024-09-21T06:09:54.733110+0000","last_active":"2024-09-21T06:09:54.733366+0000","last_peered":"2024-09-21T06:09:54.733366+0000","last_clean":"2024-09-21T06:09:54.733366+0000","last_became_active":"2024-09-21T06:09:54.732596+0000","last_became_peered":"2024-09-21T06:09:54.732596+0000","last_unstale":"2024-09-21T06:09:54.733366+0000","last_undegraded":"2024-09-21T06:09:54.733366+0000","last_fullsized":"2024-09-21T06:09:54.733366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:40.616708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706962+0000","last_change":"2024-09-21T06:09:53.706962+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706962+0000","last_undegraded":"2024-09-21T06:09:53.706962+0000","last_fullsized":"2024-09-21T06:09:53.706962+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709253+0000","last_change":"2024-09-21T06:09:53.709253+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709253+0000","last_undegraded":"2024-09-21T06:09:53.709253+0000","last_fullsized":"2024-09-21T06:09:53.709253+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.700551+0000","last_change":"2024-09-21T06:09:53.700551+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.700551+0000","last_undegraded":"2024-09-21T06:09:53.700551+0000","last_fullsized":"2024-09-21T06:09:53.700551+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707410+0000","last_change":"2024-09-21T06:09:53.707410+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707410+0000","last_undegraded":"2024-09-21T06:09:53.707410+0000","last_fullsized":"2024-09-21T06:09:53.707410+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728235+0000","last_change":"2024-09-21T06:09:54.727226+0000","last_active":"2024-09-21T06:09:54.728235+0000","last_peered":"2024-09-21T06:09:54.728235+0000","last_clean":"2024-09-21T06:09:54.728235+0000","last_became_active":"2024-09-21T06:09:54.726587+0000","last_became_peered":"2024-09-21T06:09:54.726587+0000","last_unstale":"2024-09-21T06:09:54.728235+0000","last_undegraded":"2024-09-21T06:09:54.728235+0000","last_fullsized":"2024-09-21T06:09:54.728235+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:45.209413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711924+0000","last_change":"2024-09-21T06:09:53.711924+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711924+0000","last_undegraded":"2024-09-21T06:09:53.711924+0000","last_fullsized":"2024-09-21T06:09:53.711924+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.716056+0000","last_change":"2024-09-21T06:09:54.715833+0000","last_active":"2024-09-21T06:09:54.716056+0000","last_peered":"2024-09-21T06:09:54.716056+0000","last_clean":"2024-09-21T06:09:54.716056+0000","last_became_active":"2024-09-21T06:09:54.715403+0000","last_became_peered":"2024-09-21T06:09:54.715403+0000","last_unstale":"2024-09-21T06:09:54.716056+0000","last_undegraded":"2024-09-21T06:09:54.716056+0000","last_fullsized":"2024-09-21T06:09:54.716056+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:22.852188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698833+0000","last_change":"2024-09-21T06:09:53.698833+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698833+0000","last_undegraded":"2024-09-21T06:09:53.698833+0000","last_fullsized":"2024-09-21T06:09:53.698833+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.737093+0000","last_change":"2024-09-21T06:09:54.736891+0000","last_active":"2024-09-21T06:09:54.737093+0000","last_peered":"2024-09-21T06:09:54.737093+0000","last_clean":"2024-09-21T06:09:54.737093+0000","last_became_active":"2024-09-21T06:09:54.731138+0000","last_became_peered":"2024-09-21T06:09:54.731138+0000","last_unstale":"2024-09-21T06:09:54.737093+0000","last_undegraded":"2024-09-21T06:09:54.737093+0000","last_fullsized":"2024-09-21T06:09:54.737093+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:08.199731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.729497+0000","last_change":"2024-09-21T06:09:54.729128+0000","last_active":"2024-09-21T06:09:54.729497+0000","last_peered":"2024-09-21T06:09:54.729497+0000","last_clean":"2024-09-21T06:09:54.729497+0000","last_became_active":"2024-09-21T06:09:54.726952+0000","last_became_peered":"2024-09-21T06:09:54.726952+0000","last_unstale":"2024-09-21T06:09:54.729497+0000","last_undegraded":"2024-09-21T06:09:54.729497+0000","last_fullsized":"2024-09-21T06:09:54.729497+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:22.341479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711530+0000","last_change":"2024-09-21T06:09:53.711530+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711530+0000","last_undegraded":"2024-09-21T06:09:53.711530+0000","last_fullsized":"2024-09-21T06:09:53.711530+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707070+0000","last_change":"2024-09-21T06:09:53.707070+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707070+0000","last_undegraded":"2024-09-21T06:09:53.707070+0000","last_fullsized":"2024-09-21T06:09:53.707070+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709781+0000","last_change":"2024-09-21T06:09:53.709781+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709781+0000","last_undegraded":"2024-09-21T06:09:53.709781+0000","last_fullsized":"2024-09-21T06:09:53.709781+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736165+0000","last_change":"2024-09-21T06:09:54.731406+0000","last_active":"2024-09-21T06:09:54.736165+0000","last_peered":"2024-09-21T06:09:54.736165+0000","last_clean":"2024-09-21T06:09:54.736165+0000","last_became_active":"2024-09-21T06:09:54.729828+0000","last_became_peered":"2024-09-21T06:09:54.729828+0000","last_unstale":"2024-09-21T06:09:54.736165+0000","last_undegraded":"2024-09-21T06:09:54.736165+0000","last_fullsized":"2024-09-21T06:09:54.736165+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:16.225506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733343+0000","last_change":"2024-09-21T06:09:54.732838+0000","last_active":"2024-09-21T06:09:54.733343+0000","last_peered":"2024-09-21T06:09:54.733343+0000","last_clean":"2024-09-21T06:09:54.733343+0000","last_became_active":"2024-09-21T06:09:54.731982+0000","last_became_peered":"2024-09-21T06:09:54.731982+0000","last_unstale":"2024-09-21T06:09:54.733343+0000","last_undegraded":"2024-09-21T06:09:54.733343+0000","last_fullsized":"2024-09-21T06:09:54.733343+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:59.062729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699144+0000","last_change":"2024-09-21T06:09:53.699144+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699144+0000","last_undegraded":"2024-09-21T06:09:53.699144+0000","last_fullsized":"2024-09-21T06:09:53.699144+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708851+0000","last_change":"2024-09-21T06:09:53.708851+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708851+0000","last_undegraded":"2024-09-21T06:09:53.708851+0000","last_fullsized":"2024-09-21T06:09:53.708851+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728688+0000","last_change":"2024-09-21T06:09:54.724653+0000","last_active":"2024-09-21T06:09:54.728688+0000","last_peered":"2024-09-21T06:09:54.728688+0000","last_clean":"2024-09-21T06:09:54.728688+0000","last_became_active":"2024-09-21T06:09:54.724078+0000","last_became_peered":"2024-09-21T06:09:54.724078+0000","last_unstale":"2024-09-21T06:09:54.728688+0000","last_undegraded":"2024-09-21T06:09:54.728688+0000","last_fullsized":"2024-09-21T06:09:54.728688+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:56.899629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699443+0000","last_change":"2024-09-21T06:09:53.699443+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699443+0000","last_undegraded":"2024-09-21T06:09:53.699443+0000","last_fullsized":"2024-09-21T06:09:53.699443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706817+0000","last_change":"2024-09-21T06:09:53.706817+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706817+0000","last_undegraded":"2024-09-21T06:09:53.706817+0000","last_fullsized":"2024-09-21T06:09:53.706817+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728624+0000","last_change":"2024-09-21T06:09:54.722797+0000","last_active":"2024-09-21T06:09:54.728624+0000","last_peered":"2024-09-21T06:09:54.728624+0000","last_clean":"2024-09-21T06:09:54.728624+0000","last_became_active":"2024-09-21T06:09:54.722520+0000","last_became_peered":"2024-09-21T06:09:54.722520+0000","last_unstale":"2024-09-21T06:09:54.728624+0000","last_undegraded":"2024-09-21T06:09:54.728624+0000","last_fullsized":"2024-09-21T06:09:54.728624+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:50.306224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.710014+0000","last_change":"2024-09-21T06:09:53.710014+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.710014+0000","last_undegraded":"2024-09-21T06:09:53.710014+0000","last_fullsized":"2024-09-21T06:09:53.710014+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728514+0000","last_change":"2024-09-21T06:09:54.728270+0000","last_active":"2024-09-21T06:09:54.728514+0000","last_peered":"2024-09-21T06:09:54.728514+0000","last_clean":"2024-09-21T06:09:54.728514+0000","last_became_active":"2024-09-21T06:09:54.727623+0000","last_became_peered":"2024-09-21T06:09:54.727623+0000","last_unstale":"2024-09-21T06:09:54.728514+0000","last_undegraded":"2024-09-21T06:09:54.728514+0000","last_fullsized":"2024-09-21T06:09:54.728514+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:09.350395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.702907+0000","last_change":"2024-09-21T06:09:53.702907+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.702907+0000","last_undegraded":"2024-09-21T06:09:53.702907+0000","last_fullsized":"2024-09-21T06:09:53.702907+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711098+0000","last_change":"2024-09-21T06:09:53.711098+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711098+0000","last_undegraded":"2024-09-21T06:09:53.711098+0000","last_fullsized":"2024-09-21T06:09:53.711098+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"117'4","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.746965+0000","last_change":"2024-09-21T06:09:53.708840+0000","last_active":"2024-09-21T06:09:54.746965+0000","last_peered":"2024-09-21T06:09:54.746965+0000","last_clean":"2024-09-21T06:09:54.746965+0000","last_became_active":"2024-09-21T06:09:53.708196+0000","last_became_peered":"2024-09-21T06:09:53.708196+0000","last_unstale":"2024-09-21T06:09:54.746965+0000","last_undegraded":"2024-09-21T06:09:54.746965+0000","last_fullsized":"2024-09-21T06:09:54.746965+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:30.651982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.722646+0000","last_change":"2024-09-21T06:09:54.721812+0000","last_active":"2024-09-21T06:09:54.722646+0000","last_peered":"2024-09-21T06:09:54.722646+0000","last_clean":"2024-09-21T06:09:54.722646+0000","last_became_active":"2024-09-21T06:09:54.721537+0000","last_became_peered":"2024-09-21T06:09:54.721537+0000","last_unstale":"2024-09-21T06:09:54.722646+0000","last_undegraded":"2024-09-21T06:09:54.722646+0000","last_fullsized":"2024-09-21T06:09:54.722646+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:22.493815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.709369+0000","last_change":"2024-09-21T06:09:53.709117+0000","last_active":"2024-09-21T06:09:53.709369+0000","last_peered":"2024-09-21T06:09:53.709369+0000","last_clean":"2024-09-21T06:09:53.709369+0000","last_became_active":"2024-09-21T06:09:53.708817+0000","last_became_peered":"2024-09-21T06:09:53.708817+0000","last_unstale":"2024-09-21T06:09:53.709369+0000","last_undegraded":"2024-09-21T06:09:53.709369+0000","last_fullsized":"2024-09-21T06:09:53.709369+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:27.644268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.700587+0000","last_change":"2024-09-21T06:09:53.700587+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.700587+0000","last_undegraded":"2024-09-21T06:09:53.700587+0000","last_fullsized":"2024-09-21T06:09:53.700587+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.745282+0000","last_change":"2024-09-21T06:09:53.717421+0000","last_active":"2024-09-21T06:09:54.745282+0000","last_peered":"2024-09-21T06:09:54.745282+0000","last_clean":"2024-09-21T06:09:54.745282+0000","last_became_active":"2024-09-21T06:09:53.716764+0000","last_became_peered":"2024-09-21T06:09:53.716764+0000","last_unstale":"2024-09-21T06:09:54.745282+0000","last_undegraded":"2024-09-21T06:09:54.745282+0000","last_fullsized":"2024-09-21T06:09:54.745282+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.517669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706004+0000","last_change":"2024-09-21T06:09:53.706004+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706004+0000","last_undegraded":"2024-09-21T06:09:53.706004+0000","last_fullsized":"2024-09-21T06:09:53.706004+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.745891+0000","last_change":"2024-09-21T06:09:53.710816+0000","last_active":"2024-09-21T06:09:54.745891+0000","last_peered":"2024-09-21T06:09:54.745891+0000","last_clean":"2024-09-21T06:09:54.745891+0000","last_became_active":"2024-09-21T06:09:53.710001+0000","last_became_peered":"2024-09-21T06:09:53.710001+0000","last_unstale":"2024-09-21T06:09:54.745891+0000","last_undegraded":"2024-09-21T06:09:54.745891+0000","last_fullsized":"2024-09-21T06:09:54.745891+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:26.581020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705856+0000","last_change":"2024-09-21T06:09:53.705856+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705856+0000","last_undegraded":"2024-09-21T06:09:53.705856+0000","last_fullsized":"2024-09-21T06:09:53.705856+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707325+0000","last_change":"2024-09-21T06:09:53.707087+0000","last_active":"2024-09-21T06:09:53.707325+0000","last_peered":"2024-09-21T06:09:53.707325+0000","last_clean":"2024-09-21T06:09:53.707325+0000","last_became_active":"2024-09-21T06:09:53.706816+0000","last_became_peered":"2024-09-21T06:09:53.706816+0000","last_unstale":"2024-09-21T06:09:53.707325+0000","last_undegraded":"2024-09-21T06:09:53.707325+0000","last_fullsized":"2024-09-21T06:09:53.707325+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:31.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699004+0000","last_change":"2024-09-21T06:09:53.699004+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699004+0000","last_undegraded":"2024-09-21T06:09:53.699004+0000","last_fullsized":"2024-09-21T06:09:53.699004+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"117'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.747165+0000","last_change":"2024-09-21T06:09:53.709283+0000","last_active":"2024-09-21T06:09:54.747165+0000","last_peered":"2024-09-21T06:09:54.747165+0000","last_clean":"2024-09-21T06:09:54.747165+0000","last_became_active":"2024-09-21T06:09:53.708580+0000","last_became_peered":"2024-09-21T06:09:53.708580+0000","last_unstale":"2024-09-21T06:09:54.747165+0000","last_undegraded":"2024-09-21T06:09:54.747165+0000","last_fullsized":"2024-09-21T06:09:54.747165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:28.034289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.715772+0000","last_change":"2024-09-21T06:09:54.715641+0000","last_active":"2024-09-21T06:09:54.715772+0000","last_peered":"2024-09-21T06:09:54.715772+0000","last_clean":"2024-09-21T06:09:54.715772+0000","last_became_active":"2024-09-21T06:09:54.715060+0000","last_became_peered":"2024-09-21T06:09:54.715060+0000","last_unstale":"2024-09-21T06:09:54.715772+0000","last_undegraded":"2024-09-21T06:09:54.715772+0000","last_fullsized":"2024-09-21T06:09:54.715772+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:37.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711890+0000","last_change":"2024-09-21T06:09:53.711159+0000","last_active":"2024-09-21T06:09:53.711890+0000","last_peered":"2024-09-21T06:09:53.711890+0000","last_clean":"2024-09-21T06:09:53.711890+0000","last_became_active":"2024-09-21T06:09:53.710652+0000","last_became_peered":"2024-09-21T06:09:53.710652+0000","last_unstale":"2024-09-21T06:09:53.711890+0000","last_undegraded":"2024-09-21T06:09:53.711890+0000","last_fullsized":"2024-09-21T06:09:53.711890+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:28.217669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705912+0000","last_change":"2024-09-21T06:09:53.705912+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705912+0000","last_undegraded":"2024-09-21T06:09:53.705912+0000","last_fullsized":"2024-09-21T06:09:53.705912+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707273+0000","last_change":"2024-09-21T06:09:53.706233+0000","last_active":"2024-09-21T06:09:53.707273+0000","last_peered":"2024-09-21T06:09:53.707273+0000","last_clean":"2024-09-21T06:09:53.707273+0000","last_became_active":"2024-09-21T06:09:53.705963+0000","last_became_peered":"2024-09-21T06:09:53.705963+0000","last_unstale":"2024-09-21T06:09:53.707273+0000","last_undegraded":"2024-09-21T06:09:53.707273+0000","last_fullsized":"2024-09-21T06:09:53.707273+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:10.813076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736798+0000","last_change":"2024-09-21T06:09:54.736294+0000","last_active":"2024-09-21T06:09:54.736798+0000","last_peered":"2024-09-21T06:09:54.736798+0000","last_clean":"2024-09-21T06:09:54.736798+0000","last_became_active":"2024-09-21T06:09:54.730284+0000","last_became_peered":"2024-09-21T06:09:54.730284+0000","last_unstale":"2024-09-21T06:09:54.736798+0000","last_undegraded":"2024-09-21T06:09:54.736798+0000","last_fullsized":"2024-09-21T06:09:54.736798+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:40.171281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.712134+0000","last_change":"2024-09-21T06:09:53.711582+0000","last_active":"2024-09-21T06:09:53.712134+0000","last_peered":"2024-09-21T06:09:53.712134+0000","last_clean":"2024-09-21T06:09:53.712134+0000","last_became_active":"2024-09-21T06:09:53.708856+0000","last_became_peered":"2024-09-21T06:09:53.708856+0000","last_unstale":"2024-09-21T06:09:53.712134+0000","last_undegraded":"2024-09-21T06:09:53.712134+0000","last_fullsized":"2024-09-21T06:09:53.712134+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.187186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706878+0000","last_change":"2024-09-21T06:09:53.706878+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706878+0000","last_undegraded":"2024-09-21T06:09:53.706878+0000","last_fullsized":"2024-09-21T06:09:53.706878+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.710074+0000","last_change":"2024-09-21T06:09:53.709837+0000","last_active":"2024-09-21T06:09:54.710074+0000","last_peered":"2024-09-21T06:09:54.710074+0000","last_clean":"2024-09-21T06:09:54.710074+0000","last_became_active":"2024-09-21T06:09:53.709495+0000","last_became_peered":"2024-09-21T06:09:53.709495+0000","last_unstale":"2024-09-21T06:09:54.710074+0000","last_undegraded":"2024-09-21T06:09:54.710074+0000","last_fullsized":"2024-09-21T06:09:54.710074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:38.922341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707985+0000","last_change":"2024-09-21T06:09:53.707985+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707985+0000","last_undegraded":"2024-09-21T06:09:53.707985+0000","last_fullsized":"2024-09-21T06:09:53.707985+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.703752+0000","last_change":"2024-09-21T06:09:53.703188+0000","last_active":"2024-09-21T06:09:53.703752+0000","last_peered":"2024-09-21T06:09:53.703752+0000","last_clean":"2024-09-21T06:09:53.703752+0000","last_became_active":"2024-09-21T06:09:53.702921+0000","last_became_peered":"2024-09-21T06:09:53.702921+0000","last_unstale":"2024-09-21T06:09:53.703752+0000","last_undegraded":"2024-09-21T06:09:53.703752+0000","last_fullsized":"2024-09-21T06:09:53.703752+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:55.150790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698657+0000","last_change":"2024-09-21T06:09:53.698657+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698657+0000","last_undegraded":"2024-09-21T06:09:53.698657+0000","last_fullsized":"2024-09-21T06:09:53.698657+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.706230+0000","last_change":"2024-09-21T06:09:53.705254+0000","last_active":"2024-09-21T06:09:53.706230+0000","last_peered":"2024-09-21T06:09:53.706230+0000","last_clean":"2024-09-21T06:09:53.706230+0000","last_became_active":"2024-09-21T06:09:53.704428+0000","last_became_peered":"2024-09-21T06:09:53.704428+0000","last_unstale":"2024-09-21T06:09:53.706230+0000","last_undegraded":"2024-09-21T06:09:53.706230+0000","last_fullsized":"2024-09-21T06:09:53.706230+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:16.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.722581+0000","last_change":"2024-09-21T06:09:54.720301+0000","last_active":"2024-09-21T06:09:54.722581+0000","last_peered":"2024-09-21T06:09:54.722581+0000","last_clean":"2024-09-21T06:09:54.722581+0000","last_became_active":"2024-09-21T06:09:54.719957+0000","last_became_peered":"2024-09-21T06:09:54.719957+0000","last_unstale":"2024-09-21T06:09:54.722581+0000","last_undegraded":"2024-09-21T06:09:54.722581+0000","last_fullsized":"2024-09-21T06:09:54.722581+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:42.236903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.713641+0000","last_change":"2024-09-21T06:09:53.712908+0000","last_active":"2024-09-21T06:09:53.713641+0000","last_peered":"2024-09-21T06:09:53.713641+0000","last_clean":"2024-09-21T06:09:53.713641+0000","last_became_active":"2024-09-21T06:09:53.712614+0000","last_became_peered":"2024-09-21T06:09:53.712614+0000","last_unstale":"2024-09-21T06:09:53.713641+0000","last_undegraded":"2024-09-21T06:09:53.713641+0000","last_fullsized":"2024-09-21T06:09:53.713641+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:55.199379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704146+0000","last_change":"2024-09-21T06:09:53.704146+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704146+0000","last_undegraded":"2024-09-21T06:09:53.704146+0000","last_fullsized":"2024-09-21T06:09:53.704146+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.715305+0000","last_change":"2024-09-21T06:09:53.715095+0000","last_active":"2024-09-21T06:09:53.715305+0000","last_peered":"2024-09-21T06:09:53.715305+0000","last_clean":"2024-09-21T06:09:53.715305+0000","last_became_active":"2024-09-21T06:09:53.714836+0000","last_became_peered":"2024-09-21T06:09:53.714836+0000","last_unstale":"2024-09-21T06:09:53.715305+0000","last_undegraded":"2024-09-21T06:09:53.715305+0000","last_fullsized":"2024-09-21T06:09:53.715305+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:30.212166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705289+0000","last_change":"2024-09-21T06:09:53.705289+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705289+0000","last_undegraded":"2024-09-21T06:09:53.705289+0000","last_fullsized":"2024-09-21T06:09:53.705289+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.708994+0000","last_change":"2024-09-21T06:09:53.708722+0000","last_active":"2024-09-21T06:09:53.708994+0000","last_peered":"2024-09-21T06:09:53.708994+0000","last_clean":"2024-09-21T06:09:53.708994+0000","last_became_active":"2024-09-21T06:09:53.707835+0000","last_became_peered":"2024-09-21T06:09:53.707835+0000","last_unstale":"2024-09-21T06:09:53.708994+0000","last_undegraded":"2024-09-21T06:09:53.708994+0000","last_fullsized":"2024-09-21T06:09:53.708994+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:34.855404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709797+0000","last_change":"2024-09-21T06:09:53.709797+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709797+0000","last_undegraded":"2024-09-21T06:09:53.709797+0000","last_fullsized":"2024-09-21T06:09:53.709797+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707302+0000","last_change":"2024-09-21T06:09:53.707015+0000","last_active":"2024-09-21T06:09:53.707302+0000","last_peered":"2024-09-21T06:09:53.707302+0000","last_clean":"2024-09-21T06:09:53.707302+0000","last_became_active":"2024-09-21T06:09:53.706448+0000","last_became_peered":"2024-09-21T06:09:53.706448+0000","last_unstale":"2024-09-21T06:09:53.707302+0000","last_undegraded":"2024-09-21T06:09:53.707302+0000","last_fullsized":"2024-09-21T06:09:53.707302+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:24.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707574+0000","last_change":"2024-09-21T06:09:53.707574+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707574+0000","last_undegraded":"2024-09-21T06:09:53.707574+0000","last_fullsized":"2024-09-21T06:09:53.707574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.714439+0000","last_change":"2024-09-21T06:09:53.714184+0000","last_active":"2024-09-21T06:09:53.714439+0000","last_peered":"2024-09-21T06:09:53.714439+0000","last_clean":"2024-09-21T06:09:53.714439+0000","last_became_active":"2024-09-21T06:09:53.713745+0000","last_became_peered":"2024-09-21T06:09:53.713745+0000","last_unstale":"2024-09-21T06:09:53.714439+0000","last_undegraded":"2024-09-21T06:09:53.714439+0000","last_fullsized":"2024-09-21T06:09:53.714439+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.645814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704756+0000","last_change":"2024-09-21T06:09:53.704756+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704756+0000","last_undegraded":"2024-09-21T06:09:53.704756+0000","last_fullsized":"2024-09-21T06:09:53.704756+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711865+0000","last_change":"2024-09-21T06:09:53.710971+0000","last_active":"2024-09-21T06:09:53.711865+0000","last_peered":"2024-09-21T06:09:53.711865+0000","last_clean":"2024-09-21T06:09:53.711865+0000","last_became_active":"2024-09-21T06:09:53.710679+0000","last_became_peered":"2024-09-21T06:09:53.710679+0000","last_unstale":"2024-09-21T06:09:53.711865+0000","last_undegraded":"2024-09-21T06:09:53.711865+0000","last_fullsized":"2024-09-21T06:09:53.711865+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:29.074269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698312+0000","last_change":"2024-09-21T06:09:53.698312+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698312+0000","last_undegraded":"2024-09-21T06:09:53.698312+0000","last_fullsized":"2024-09-21T06:09:53.698312+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.729462+0000","last_change":"2024-09-21T06:09:53.713604+0000","last_active":"2024-09-21T06:09:54.729462+0000","last_peered":"2024-09-21T06:09:54.729462+0000","last_clean":"2024-09-21T06:09:54.729462+0000","last_became_active":"2024-09-21T06:09:53.712555+0000","last_became_peered":"2024-09-21T06:09:53.712555+0000","last_unstale":"2024-09-21T06:09:54.729462+0000","last_undegraded":"2024-09-21T06:09:54.729462+0000","last_fullsized":"2024-09-21T06:09:54.729462+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:00.616919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705326+0000","last_change":"2024-09-21T06:09:53.705326+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705326+0000","last_undegraded":"2024-09-21T06:09:53.705326+0000","last_fullsized":"2024-09-21T06:09:53.705326+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.746776+0000","last_change":"2024-09-21T06:09:53.718333+0000","last_active":"2024-09-21T06:09:54.746776+0000","last_peered":"2024-09-21T06:09:54.746776+0000","last_clean":"2024-09-21T06:09:54.746776+0000","last_became_active":"2024-09-21T06:09:53.717703+0000","last_became_peered":"2024-09-21T06:09:53.717703+0000","last_unstale":"2024-09-21T06:09:54.746776+0000","last_undegraded":"2024-09-21T06:09:54.746776+0000","last_fullsized":"2024-09-21T06:09:54.746776+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:57.064938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709325+0000","last_change":"2024-09-21T06:09:53.709325+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709325+0000","last_undegraded":"2024-09-21T06:09:53.709325+0000","last_fullsized":"2024-09-21T06:09:53.709325+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.709491+0000","last_change":"2024-09-21T06:09:53.709262+0000","last_active":"2024-09-21T06:09:53.709491+0000","last_peered":"2024-09-21T06:09:53.709491+0000","last_clean":"2024-09-21T06:09:53.709491+0000","last_became_active":"2024-09-21T06:09:53.708917+0000","last_became_peered":"2024-09-21T06:09:53.708917+0000","last_unstale":"2024-09-21T06:09:53.709491+0000","last_undegraded":"2024-09-21T06:09:53.709491+0000","last_fullsized":"2024-09-21T06:09:53.709491+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:57.649690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704258+0000","last_change":"2024-09-21T06:09:53.704258+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704258+0000","last_undegraded":"2024-09-21T06:09:53.704258+0000","last_fullsized":"2024-09-21T06:09:53.704258+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711489+0000","last_change":"2024-09-21T06:09:53.709993+0000","last_active":"2024-09-21T06:09:53.711489+0000","last_peered":"2024-09-21T06:09:53.711489+0000","last_clean":"2024-09-21T06:09:53.711489+0000","last_became_active":"2024-09-21T06:09:53.709716+0000","last_became_peered":"2024-09-21T06:09:53.709716+0000","last_unstale":"2024-09-21T06:09:53.711489+0000","last_undegraded":"2024-09-21T06:09:53.711489+0000","last_fullsized":"2024-09-21T06:09:53.711489+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:02.692503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708346+0000","last_change":"2024-09-21T06:09:53.708346+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708346+0000","last_undegraded":"2024-09-21T06:09:53.708346+0000","last_fullsized":"2024-09-21T06:09:53.708346+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.720498+0000","last_change":"2024-09-21T06:09:53.711144+0000","last_active":"2024-09-21T06:09:54.720498+0000","last_peered":"2024-09-21T06:09:54.720498+0000","last_clean":"2024-09-21T06:09:54.720498+0000","last_became_active":"2024-09-21T06:09:53.710391+0000","last_became_peered":"2024-09-21T06:09:53.710391+0000","last_unstale":"2024-09-21T06:09:54.720498+0000","last_undegraded":"2024-09-21T06:09:54.720498+0000","last_fullsized":"2024-09-21T06:09:54.720498+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.449704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733318+0000","last_change":"2024-09-21T06:09:54.732230+0000","last_active":"2024-09-21T06:09:54.733318+0000","last_peered":"2024-09-21T06:09:54.733318+0000","last_clean":"2024-09-21T06:09:54.733318+0000","last_became_active":"2024-09-21T06:09:54.731646+0000","last_became_peered":"2024-09-21T06:09:54.731646+0000","last_unstale":"2024-09-21T06:09:54.733318+0000","last_undegraded":"2024-09-21T06:09:54.733318+0000","last_fullsized":"2024-09-21T06:09:54.733318+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:17.510453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711460+0000","last_change":"2024-09-21T06:09:53.710718+0000","last_active":"2024-09-21T06:09:53.711460+0000","last_peered":"2024-09-21T06:09:53.711460+0000","last_clean":"2024-09-21T06:09:53.711460+0000","last_became_active":"2024-09-21T06:09:53.710411+0000","last_became_peered":"2024-09-21T06:09:53.710411+0000","last_unstale":"2024-09-21T06:09:53.711460+0000","last_undegraded":"2024-09-21T06:09:53.711460+0000","last_fullsized":"2024-09-21T06:09:53.711460+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.737984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701583+0000","last_change":"2024-09-21T06:09:53.701583+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701583+0000","last_undegraded":"2024-09-21T06:09:53.701583+0000","last_fullsized":"2024-09-21T06:09:53.701583+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.730363+0000","last_change":"2024-09-21T06:09:53.718003+0000","last_active":"2024-09-21T06:09:54.730363+0000","last_peered":"2024-09-21T06:09:54.730363+0000","last_clean":"2024-09-21T06:09:54.730363+0000","last_became_active":"2024-09-21T06:09:53.716916+0000","last_became_peered":"2024-09-21T06:09:53.716916+0000","last_unstale":"2024-09-21T06:09:54.730363+0000","last_undegraded":"2024-09-21T06:09:54.730363+0000","last_fullsized":"2024-09-21T06:09:54.730363+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:51.259599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701277+0000","last_change":"2024-09-21T06:09:53.701277+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701277+0000","last_undegraded":"2024-09-21T06:09:53.701277+0000","last_fullsized":"2024-09-21T06:09:53.701277+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.717503+0000","last_change":"2024-09-21T06:09:53.715330+0000","last_active":"2024-09-21T06:09:54.717503+0000","last_peered":"2024-09-21T06:09:54.717503+0000","last_clean":"2024-09-21T06:09:54.717503+0000","last_became_active":"2024-09-21T06:09:53.710794+0000","last_became_peered":"2024-09-21T06:09:53.710794+0000","last_unstale":"2024-09-21T06:09:54.717503+0000","last_undegraded":"2024-09-21T06:09:54.717503+0000","last_fullsized":"2024-09-21T06:09:54.717503+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:43.129579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707167+0000","last_change":"2024-09-21T06:09:53.707167+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707167+0000","last_undegraded":"2024-09-21T06:09:53.707167+0000","last_fullsized":"2024-09-21T06:09:53.707167+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711912+0000","last_change":"2024-09-21T06:09:53.711730+0000","last_active":"2024-09-21T06:09:53.711912+0000","last_peered":"2024-09-21T06:09:53.711912+0000","last_clean":"2024-09-21T06:09:53.711912+0000","last_became_active":"2024-09-21T06:09:53.711350+0000","last_became_peered":"2024-09-21T06:09:53.711350+0000","last_unstale":"2024-09-21T06:09:53.711912+0000","last_undegraded":"2024-09-21T06:09:53.711912+0000","last_fullsized":"2024-09-21T06:09:53.711912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:34.151664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707870+0000","last_change":"2024-09-21T06:09:53.707870+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707870+0000","last_undegraded":"2024-09-21T06:09:53.707870+0000","last_fullsized":"2024-09-21T06:09:53.707870+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.720758+0000","last_change":"2024-09-21T06:09:53.715215+0000","last_active":"2024-09-21T06:09:54.720758+0000","last_peered":"2024-09-21T06:09:54.720758+0000","last_clean":"2024-09-21T06:09:54.720758+0000","last_became_active":"2024-09-21T06:09:53.714796+0000","last_became_peered":"2024-09-21T06:09:53.714796+0000","last_unstale":"2024-09-21T06:09:54.720758+0000","last_undegraded":"2024-09-21T06:09:54.720758+0000","last_fullsized":"2024-09-21T06:09:54.720758+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:32.161254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706190+0000","last_change":"2024-09-21T06:09:53.706190+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706190+0000","last_undegraded":"2024-09-21T06:09:53.706190+0000","last_fullsized":"2024-09-21T06:09:53.706190+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.712402+0000","last_change":"2024-09-21T06:09:53.712169+0000","last_active":"2024-09-21T06:09:53.712402+0000","last_peered":"2024-09-21T06:09:53.712402+0000","last_clean":"2024-09-21T06:09:53.712402+0000","last_became_active":"2024-09-21T06:09:53.711381+0000","last_became_peered":"2024-09-21T06:09:53.711381+0000","last_unstale":"2024-09-21T06:09:53.712402+0000","last_undegraded":"2024-09-21T06:09:53.712402+0000","last_fullsized":"2024-09-21T06:09:53.712402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.327031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704968+0000","last_change":"2024-09-21T06:09:53.704968+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704968+0000","last_undegraded":"2024-09-21T06:09:53.704968+0000","last_fullsized":"2024-09-21T06:09:53.704968+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.711048+0000","last_change":"2024-09-21T06:09:53.709948+0000","last_active":"2024-09-21T06:09:54.711048+0000","last_peered":"2024-09-21T06:09:54.711048+0000","last_clean":"2024-09-21T06:09:54.711048+0000","last_became_active":"2024-09-21T06:09:53.709689+0000","last_became_peered":"2024-09-21T06:09:53.709689+0000","last_unstale":"2024-09-21T06:09:54.711048+0000","last_undegraded":"2024-09-21T06:09:54.711048+0000","last_fullsized":"2024-09-21T06:09:54.711048+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706402+0000","last_change":"2024-09-21T06:09:53.706402+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706402+0000","last_undegraded":"2024-09-21T06:09:53.706402+0000","last_fullsized":"2024-09-21T06:09:53.706402+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.717095+0000","last_change":"2024-09-21T06:09:53.716899+0000","last_active":"2024-09-21T06:09:53.717095+0000","last_peered":"2024-09-21T06:09:53.717095+0000","last_clean":"2024-09-21T06:09:53.717095+0000","last_became_active":"2024-09-21T06:09:53.716429+0000","last_became_peered":"2024-09-21T06:09:53.716429+0000","last_unstale":"2024-09-21T06:09:53.717095+0000","last_undegraded":"2024-09-21T06:09:53.717095+0000","last_fullsized":"2024-09-21T06:09:53.717095+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.327416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708792+0000","last_change":"2024-09-21T06:09:53.708792+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708792+0000","last_undegraded":"2024-09-21T06:09:53.708792+0000","last_fullsized":"2024-09-21T06:09:53.708792+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.701219+0000","last_change":"2024-09-21T06:09:53.700722+0000","last_active":"2024-09-21T06:09:53.701219+0000","last_peered":"2024-09-21T06:09:53.701219+0000","last_clean":"2024-09-21T06:09:53.701219+0000","last_became_active":"2024-09-21T06:09:53.700465+0000","last_became_peered":"2024-09-21T06:09:53.700465+0000","last_unstale":"2024-09-21T06:09:53.701219+0000","last_undegraded":"2024-09-21T06:09:53.701219+0000","last_fullsized":"2024-09-21T06:09:53.701219+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.698729+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:09:53.698729+0000","last_peered":"2024-09-21T06:09:53.698729+0000","last_clean":"2024-09-21T06:09:53.698729+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:09:53.698729+0000","last_undegraded":"2024-09-21T06:09:53.698729+0000","last_fullsized":"2024-09-21T06:09:53.698729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":623,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199361896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194112,"statfs":{"total":200000000,"available":198771528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194112,"statfs":{"total":200000000,"available":198771528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":623,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199361896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:09:59.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:09:59.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.394+0000 7fef3a000640 1 -- 172.21.15.118:0/3766373725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef340d14f0 msgr2=0x7fef340cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.394+0000 7fef3a000640 1 --2- 172.21.15.118:0/3766373725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef340d14f0 0x7fef340cf1e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fef2c005fd0 tx=0x7fef2c02a8b0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.394+0000 7fef3a000640 1 -- 172.21.15.118:0/3766373725 shutdown_connections 2024-09-21T06:09:59.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.394+0000 7fef3a000640 1 --2- 172.21.15.118:0/3766373725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef340d14f0 0x7fef340cf1e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.394+0000 7fef3a000640 1 --2- 172.21.15.118:0/3766373725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef3413fc50 0x7fef34160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.394+0000 7fef3a000640 1 -- 172.21.15.118:0/3766373725 >> 172.21.15.118:0/3766373725 conn(0x7fef3406d110 msgr2=0x7fef3406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:59.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.395+0000 7fef3a000640 1 -- 172.21.15.118:0/3766373725 shutdown_connections 2024-09-21T06:09:59.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.395+0000 7fef3a000640 1 -- 172.21.15.118:0/3766373725 wait complete. 2024-09-21T06:09:59.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.397+0000 7fef3a000640 1 Processor -- start 2024-09-21T06:09:59.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.397+0000 7fef3a000640 1 -- start start 2024-09-21T06:09:59.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.398+0000 7fef3a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef3413fc50 0x7fef341f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.398+0000 7fef3a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34161530 0x7fef341f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.398+0000 7fef3a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef341444d0 0x7fef340737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.398+0000 7fef3a000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fef340cfcd0 con 0x7fef34161530 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.398+0000 7fef3a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef340cfb50 con 0x7fef3413fc50 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.398+0000 7fef3a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef340cfe50 con 0x7fef341444d0 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.398+0000 7fef32a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34161530 0x7fef341f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34161530 0x7fef341f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53872/0 (socket says 172.21.15.118:53872) 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 -- 172.21.15.118:0/1447133244 learned_addr learned my addr 172.21.15.118:0/1447133244 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef33400640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef3413fc50 0x7fef341f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef33e00640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef341444d0 0x7fef340737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 -- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef341444d0 msgr2=0x7fef340737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef341444d0 0x7fef340737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 -- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef3413fc50 msgr2=0x7fef341f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef3413fc50 0x7fef341f63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 -- 172.21.15.118:0/1447133244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef34074d10 con 0x7fef34161530 2024-09-21T06:09:59.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef33400640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef3413fc50 0x7fef341f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:59.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef32a00640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34161530 0x7fef341f2e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c3c0 tx=0x7fef2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:59.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef2b400640 1 -- 172.21.15.118:0/1447133244 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20017070 con 0x7fef34161530 2024-09-21T06:09:59.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.399+0000 7fef2b400640 1 -- 172.21.15.118:0/1447133244 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef200035f0 con 0x7fef34161530 2024-09-21T06:09:59.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.400+0000 7fef2b400640 1 -- 172.21.15.118:0/1447133244 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20003a20 con 0x7fef34161530 2024-09-21T06:09:59.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.400+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef341f6930 con 0x7fef34161530 2024-09-21T06:09:59.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.400+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef34145c60 con 0x7fef34161530 2024-09-21T06:09:59.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.401+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef340d0370 con 0x7fef34161530 2024-09-21T06:09:59.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.402+0000 7fef2b400640 1 -- 172.21.15.118:0/1447133244 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef2001a070 con 0x7fef34161530 2024-09-21T06:09:59.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.403+0000 7fef2b400640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef14078bc0 0x7fef1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.403+0000 7fef2b400640 1 -- 172.21.15.118:0/1447133244 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fef20099fe0 con 0x7fef34161530 2024-09-21T06:09:59.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.403+0000 7fef33400640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef14078bc0 0x7fef1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.404+0000 7fef33400640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef14078bc0 0x7fef1407b0d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef24009b80 tx=0x7fef24005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:59.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.407+0000 7fef2b400640 1 -- 172.21.15.118:0/1447133244 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fef341f6930 con 0x7fef34161530 2024-09-21T06:09:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.588+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef34145e30 con 0x7fef14078bc0 2024-09-21T06:09:59.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.593+0000 7fef2b400640 1 -- 172.21.15.118:0/1447133244 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244078 (secure 0 0 0) 0x7fef34145e30 con 0x7fef14078bc0 2024-09-21T06:09:59.595 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:09:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:09:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef14078bc0 msgr2=0x7fef1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef14078bc0 0x7fef1407b0d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef24009b80 tx=0x7fef24005f90 comp rx=0 tx=0).stop 2024-09-21T06:09:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34161530 msgr2=0x7fef341f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34161530 0x7fef341f2e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c3c0 tx=0x7fef2000c880 comp rx=0 tx=0).stop 2024-09-21T06:09:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 shutdown_connections 2024-09-21T06:09:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef14078bc0 0x7fef1407b0d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef341444d0 0x7fef340737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef34161530 0x7fef341f2e60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 --2- 172.21.15.118:0/1447133244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef3413fc50 0x7fef341f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 >> 172.21.15.118:0/1447133244 conn(0x7fef3406d110 msgr2=0x7fef34141780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:59.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 shutdown_connections 2024-09-21T06:09:59.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.597+0000 7fef3a000640 1 -- 172.21.15.118:0/1447133244 wait complete. 2024-09-21T06:09:59.620 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-09-21T06:09:58.551914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6113,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556386,"statfs":{"total":1600000000,"available":1593739532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.854591"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701387+0000","last_change":"2024-09-21T06:09:53.701387+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701387+0000","last_undegraded":"2024-09-21T06:09:53.701387+0000","last_fullsized":"2024-09-21T06:09:53.701387+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736825+0000","last_change":"2024-09-21T06:09:54.736623+0000","last_active":"2024-09-21T06:09:54.736825+0000","last_peered":"2024-09-21T06:09:54.736825+0000","last_clean":"2024-09-21T06:09:54.736825+0000","last_became_active":"2024-09-21T06:09:54.730791+0000","last_became_peered":"2024-09-21T06:09:54.730791+0000","last_unstale":"2024-09-21T06:09:54.736825+0000","last_undegraded":"2024-09-21T06:09:54.736825+0000","last_fullsized":"2024-09-21T06:09:54.736825+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:45.275210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701151+0000","last_change":"2024-09-21T06:09:53.701151+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701151+0000","last_undegraded":"2024-09-21T06:09:53.701151+0000","last_fullsized":"2024-09-21T06:09:53.701151+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.726329+0000","last_change":"2024-09-21T06:09:54.724168+0000","last_active":"2024-09-21T06:09:54.726329+0000","last_peered":"2024-09-21T06:09:54.726329+0000","last_clean":"2024-09-21T06:09:54.726329+0000","last_became_active":"2024-09-21T06:09:54.723648+0000","last_became_peered":"2024-09-21T06:09:54.723648+0000","last_unstale":"2024-09-21T06:09:54.726329+0000","last_undegraded":"2024-09-21T06:09:54.726329+0000","last_fullsized":"2024-09-21T06:09:54.726329+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:00.573035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709985+0000","last_change":"2024-09-21T06:09:53.709985+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709985+0000","last_undegraded":"2024-09-21T06:09:53.709985+0000","last_fullsized":"2024-09-21T06:09:53.709985+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701569+0000","last_change":"2024-09-21T06:09:53.701569+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701569+0000","last_undegraded":"2024-09-21T06:09:53.701569+0000","last_fullsized":"2024-09-21T06:09:53.701569+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699940+0000","last_change":"2024-09-21T06:09:53.699940+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699940+0000","last_undegraded":"2024-09-21T06:09:53.699940+0000","last_fullsized":"2024-09-21T06:09:53.699940+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733366+0000","last_change":"2024-09-21T06:09:54.733110+0000","last_active":"2024-09-21T06:09:54.733366+0000","last_peered":"2024-09-21T06:09:54.733366+0000","last_clean":"2024-09-21T06:09:54.733366+0000","last_became_active":"2024-09-21T06:09:54.732596+0000","last_became_peered":"2024-09-21T06:09:54.732596+0000","last_unstale":"2024-09-21T06:09:54.733366+0000","last_undegraded":"2024-09-21T06:09:54.733366+0000","last_fullsized":"2024-09-21T06:09:54.733366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:40.616708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706962+0000","last_change":"2024-09-21T06:09:53.706962+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706962+0000","last_undegraded":"2024-09-21T06:09:53.706962+0000","last_fullsized":"2024-09-21T06:09:53.706962+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709253+0000","last_change":"2024-09-21T06:09:53.709253+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709253+0000","last_undegraded":"2024-09-21T06:09:53.709253+0000","last_fullsized":"2024-09-21T06:09:53.709253+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.700551+0000","last_change":"2024-09-21T06:09:53.700551+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.700551+0000","last_undegraded":"2024-09-21T06:09:53.700551+0000","last_fullsized":"2024-09-21T06:09:53.700551+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707410+0000","last_change":"2024-09-21T06:09:53.707410+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707410+0000","last_undegraded":"2024-09-21T06:09:53.707410+0000","last_fullsized":"2024-09-21T06:09:53.707410+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728235+0000","last_change":"2024-09-21T06:09:54.727226+0000","last_active":"2024-09-21T06:09:54.728235+0000","last_peered":"2024-09-21T06:09:54.728235+0000","last_clean":"2024-09-21T06:09:54.728235+0000","last_became_active":"2024-09-21T06:09:54.726587+0000","last_became_peered":"2024-09-21T06:09:54.726587+0000","last_unstale":"2024-09-21T06:09:54.728235+0000","last_undegraded":"2024-09-21T06:09:54.728235+0000","last_fullsized":"2024-09-21T06:09:54.728235+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:45.209413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711924+0000","last_change":"2024-09-21T06:09:53.711924+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711924+0000","last_undegraded":"2024-09-21T06:09:53.711924+0000","last_fullsized":"2024-09-21T06:09:53.711924+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.716056+0000","last_change":"2024-09-21T06:09:54.715833+0000","last_active":"2024-09-21T06:09:54.716056+0000","last_peered":"2024-09-21T06:09:54.716056+0000","last_clean":"2024-09-21T06:09:54.716056+0000","last_became_active":"2024-09-21T06:09:54.715403+0000","last_became_peered":"2024-09-21T06:09:54.715403+0000","last_unstale":"2024-09-21T06:09:54.716056+0000","last_undegraded":"2024-09-21T06:09:54.716056+0000","last_fullsized":"2024-09-21T06:09:54.716056+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:22.852188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698833+0000","last_change":"2024-09-21T06:09:53.698833+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698833+0000","last_undegraded":"2024-09-21T06:09:53.698833+0000","last_fullsized":"2024-09-21T06:09:53.698833+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.737093+0000","last_change":"2024-09-21T06:09:54.736891+0000","last_active":"2024-09-21T06:09:54.737093+0000","last_peered":"2024-09-21T06:09:54.737093+0000","last_clean":"2024-09-21T06:09:54.737093+0000","last_became_active":"2024-09-21T06:09:54.731138+0000","last_became_peered":"2024-09-21T06:09:54.731138+0000","last_unstale":"2024-09-21T06:09:54.737093+0000","last_undegraded":"2024-09-21T06:09:54.737093+0000","last_fullsized":"2024-09-21T06:09:54.737093+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:08.199731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.729497+0000","last_change":"2024-09-21T06:09:54.729128+0000","last_active":"2024-09-21T06:09:54.729497+0000","last_peered":"2024-09-21T06:09:54.729497+0000","last_clean":"2024-09-21T06:09:54.729497+0000","last_became_active":"2024-09-21T06:09:54.726952+0000","last_became_peered":"2024-09-21T06:09:54.726952+0000","last_unstale":"2024-09-21T06:09:54.729497+0000","last_undegraded":"2024-09-21T06:09:54.729497+0000","last_fullsized":"2024-09-21T06:09:54.729497+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:22.341479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711530+0000","last_change":"2024-09-21T06:09:53.711530+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711530+0000","last_undegraded":"2024-09-21T06:09:53.711530+0000","last_fullsized":"2024-09-21T06:09:53.711530+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707070+0000","last_change":"2024-09-21T06:09:53.707070+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707070+0000","last_undegraded":"2024-09-21T06:09:53.707070+0000","last_fullsized":"2024-09-21T06:09:53.707070+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709781+0000","last_change":"2024-09-21T06:09:53.709781+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709781+0000","last_undegraded":"2024-09-21T06:09:53.709781+0000","last_fullsized":"2024-09-21T06:09:53.709781+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736165+0000","last_change":"2024-09-21T06:09:54.731406+0000","last_active":"2024-09-21T06:09:54.736165+0000","last_peered":"2024-09-21T06:09:54.736165+0000","last_clean":"2024-09-21T06:09:54.736165+0000","last_became_active":"2024-09-21T06:09:54.729828+0000","last_became_peered":"2024-09-21T06:09:54.729828+0000","last_unstale":"2024-09-21T06:09:54.736165+0000","last_undegraded":"2024-09-21T06:09:54.736165+0000","last_fullsized":"2024-09-21T06:09:54.736165+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:16.225506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733343+0000","last_change":"2024-09-21T06:09:54.732838+0000","last_active":"2024-09-21T06:09:54.733343+0000","last_peered":"2024-09-21T06:09:54.733343+0000","last_clean":"2024-09-21T06:09:54.733343+0000","last_became_active":"2024-09-21T06:09:54.731982+0000","last_became_peered":"2024-09-21T06:09:54.731982+0000","last_unstale":"2024-09-21T06:09:54.733343+0000","last_undegraded":"2024-09-21T06:09:54.733343+0000","last_fullsized":"2024-09-21T06:09:54.733343+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:59.062729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699144+0000","last_change":"2024-09-21T06:09:53.699144+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699144+0000","last_undegraded":"2024-09-21T06:09:53.699144+0000","last_fullsized":"2024-09-21T06:09:53.699144+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708851+0000","last_change":"2024-09-21T06:09:53.708851+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708851+0000","last_undegraded":"2024-09-21T06:09:53.708851+0000","last_fullsized":"2024-09-21T06:09:53.708851+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728688+0000","last_change":"2024-09-21T06:09:54.724653+0000","last_active":"2024-09-21T06:09:54.728688+0000","last_peered":"2024-09-21T06:09:54.728688+0000","last_clean":"2024-09-21T06:09:54.728688+0000","last_became_active":"2024-09-21T06:09:54.724078+0000","last_became_peered":"2024-09-21T06:09:54.724078+0000","last_unstale":"2024-09-21T06:09:54.728688+0000","last_undegraded":"2024-09-21T06:09:54.728688+0000","last_fullsized":"2024-09-21T06:09:54.728688+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:56.899629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699443+0000","last_change":"2024-09-21T06:09:53.699443+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699443+0000","last_undegraded":"2024-09-21T06:09:53.699443+0000","last_fullsized":"2024-09-21T06:09:53.699443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706817+0000","last_change":"2024-09-21T06:09:53.706817+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706817+0000","last_undegraded":"2024-09-21T06:09:53.706817+0000","last_fullsized":"2024-09-21T06:09:53.706817+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728624+0000","last_change":"2024-09-21T06:09:54.722797+0000","last_active":"2024-09-21T06:09:54.728624+0000","last_peered":"2024-09-21T06:09:54.728624+0000","last_clean":"2024-09-21T06:09:54.728624+0000","last_became_active":"2024-09-21T06:09:54.722520+0000","last_became_peered":"2024-09-21T06:09:54.722520+0000","last_unstale":"2024-09-21T06:09:54.728624+0000","last_undegraded":"2024-09-21T06:09:54.728624+0000","last_fullsized":"2024-09-21T06:09:54.728624+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:50.306224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.710014+0000","last_change":"2024-09-21T06:09:53.710014+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.710014+0000","last_undegraded":"2024-09-21T06:09:53.710014+0000","last_fullsized":"2024-09-21T06:09:53.710014+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728514+0000","last_change":"2024-09-21T06:09:54.728270+0000","last_active":"2024-09-21T06:09:54.728514+0000","last_peered":"2024-09-21T06:09:54.728514+0000","last_clean":"2024-09-21T06:09:54.728514+0000","last_became_active":"2024-09-21T06:09:54.727623+0000","last_became_peered":"2024-09-21T06:09:54.727623+0000","last_unstale":"2024-09-21T06:09:54.728514+0000","last_undegraded":"2024-09-21T06:09:54.728514+0000","last_fullsized":"2024-09-21T06:09:54.728514+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:09.350395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.702907+0000","last_change":"2024-09-21T06:09:53.702907+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.702907+0000","last_undegraded":"2024-09-21T06:09:53.702907+0000","last_fullsized":"2024-09-21T06:09:53.702907+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711098+0000","last_change":"2024-09-21T06:09:53.711098+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711098+0000","last_undegraded":"2024-09-21T06:09:53.711098+0000","last_fullsized":"2024-09-21T06:09:53.711098+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"117'4","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.746965+0000","last_change":"2024-09-21T06:09:53.708840+0000","last_active":"2024-09-21T06:09:54.746965+0000","last_peered":"2024-09-21T06:09:54.746965+0000","last_clean":"2024-09-21T06:09:54.746965+0000","last_became_active":"2024-09-21T06:09:53.708196+0000","last_became_peered":"2024-09-21T06:09:53.708196+0000","last_unstale":"2024-09-21T06:09:54.746965+0000","last_undegraded":"2024-09-21T06:09:54.746965+0000","last_fullsized":"2024-09-21T06:09:54.746965+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:30.651982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.722646+0000","last_change":"2024-09-21T06:09:54.721812+0000","last_active":"2024-09-21T06:09:54.722646+0000","last_peered":"2024-09-21T06:09:54.722646+0000","last_clean":"2024-09-21T06:09:54.722646+0000","last_became_active":"2024-09-21T06:09:54.721537+0000","last_became_peered":"2024-09-21T06:09:54.721537+0000","last_unstale":"2024-09-21T06:09:54.722646+0000","last_undegraded":"2024-09-21T06:09:54.722646+0000","last_fullsized":"2024-09-21T06:09:54.722646+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:22.493815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.709369+0000","last_change":"2024-09-21T06:09:53.709117+0000","last_active":"2024-09-21T06:09:53.709369+0000","last_peered":"2024-09-21T06:09:53.709369+0000","last_clean":"2024-09-21T06:09:53.709369+0000","last_became_active":"2024-09-21T06:09:53.708817+0000","last_became_peered":"2024-09-21T06:09:53.708817+0000","last_unstale":"2024-09-21T06:09:53.709369+0000","last_undegraded":"2024-09-21T06:09:53.709369+0000","last_fullsized":"2024-09-21T06:09:53.709369+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:27.644268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.700587+0000","last_change":"2024-09-21T06:09:53.700587+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.700587+0000","last_undegraded":"2024-09-21T06:09:53.700587+0000","last_fullsized":"2024-09-21T06:09:53.700587+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.745282+0000","last_change":"2024-09-21T06:09:53.717421+0000","last_active":"2024-09-21T06:09:54.745282+0000","last_peered":"2024-09-21T06:09:54.745282+0000","last_clean":"2024-09-21T06:09:54.745282+0000","last_became_active":"2024-09-21T06:09:53.716764+0000","last_became_peered":"2024-09-21T06:09:53.716764+0000","last_unstale":"2024-09-21T06:09:54.745282+0000","last_undegraded":"2024-09-21T06:09:54.745282+0000","last_fullsized":"2024-09-21T06:09:54.745282+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.517669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706004+0000","last_change":"2024-09-21T06:09:53.706004+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706004+0000","last_undegraded":"2024-09-21T06:09:53.706004+0000","last_fullsized":"2024-09-21T06:09:53.706004+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.745891+0000","last_change":"2024-09-21T06:09:53.710816+0000","last_active":"2024-09-21T06:09:54.745891+0000","last_peered":"2024-09-21T06:09:54.745891+0000","last_clean":"2024-09-21T06:09:54.745891+0000","last_became_active":"2024-09-21T06:09:53.710001+0000","last_became_peered":"2024-09-21T06:09:53.710001+0000","last_unstale":"2024-09-21T06:09:54.745891+0000","last_undegraded":"2024-09-21T06:09:54.745891+0000","last_fullsized":"2024-09-21T06:09:54.745891+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:26.581020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705856+0000","last_change":"2024-09-21T06:09:53.705856+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705856+0000","last_undegraded":"2024-09-21T06:09:53.705856+0000","last_fullsized":"2024-09-21T06:09:53.705856+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707325+0000","last_change":"2024-09-21T06:09:53.707087+0000","last_active":"2024-09-21T06:09:53.707325+0000","last_peered":"2024-09-21T06:09:53.707325+0000","last_clean":"2024-09-21T06:09:53.707325+0000","last_became_active":"2024-09-21T06:09:53.706816+0000","last_became_peered":"2024-09-21T06:09:53.706816+0000","last_unstale":"2024-09-21T06:09:53.707325+0000","last_undegraded":"2024-09-21T06:09:53.707325+0000","last_fullsized":"2024-09-21T06:09:53.707325+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:31.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699004+0000","last_change":"2024-09-21T06:09:53.699004+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699004+0000","last_undegraded":"2024-09-21T06:09:53.699004+0000","last_fullsized":"2024-09-21T06:09:53.699004+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"117'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.747165+0000","last_change":"2024-09-21T06:09:53.709283+0000","last_active":"2024-09-21T06:09:54.747165+0000","last_peered":"2024-09-21T06:09:54.747165+0000","last_clean":"2024-09-21T06:09:54.747165+0000","last_became_active":"2024-09-21T06:09:53.708580+0000","last_became_peered":"2024-09-21T06:09:53.708580+0000","last_unstale":"2024-09-21T06:09:54.747165+0000","last_undegraded":"2024-09-21T06:09:54.747165+0000","last_fullsized":"2024-09-21T06:09:54.747165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:28.034289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.715772+0000","last_change":"2024-09-21T06:09:54.715641+0000","last_active":"2024-09-21T06:09:54.715772+0000","last_peered":"2024-09-21T06:09:54.715772+0000","last_clean":"2024-09-21T06:09:54.715772+0000","last_became_active":"2024-09-21T06:09:54.715060+0000","last_became_peered":"2024-09-21T06:09:54.715060+0000","last_unstale":"2024-09-21T06:09:54.715772+0000","last_undegraded":"2024-09-21T06:09:54.715772+0000","last_fullsized":"2024-09-21T06:09:54.715772+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:37.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711890+0000","last_change":"2024-09-21T06:09:53.711159+0000","last_active":"2024-09-21T06:09:53.711890+0000","last_peered":"2024-09-21T06:09:53.711890+0000","last_clean":"2024-09-21T06:09:53.711890+0000","last_became_active":"2024-09-21T06:09:53.710652+0000","last_became_peered":"2024-09-21T06:09:53.710652+0000","last_unstale":"2024-09-21T06:09:53.711890+0000","last_undegraded":"2024-09-21T06:09:53.711890+0000","last_fullsized":"2024-09-21T06:09:53.711890+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:28.217669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705912+0000","last_change":"2024-09-21T06:09:53.705912+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705912+0000","last_undegraded":"2024-09-21T06:09:53.705912+0000","last_fullsized":"2024-09-21T06:09:53.705912+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707273+0000","last_change":"2024-09-21T06:09:53.706233+0000","last_active":"2024-09-21T06:09:53.707273+0000","last_peered":"2024-09-21T06:09:53.707273+0000","last_clean":"2024-09-21T06:09:53.707273+0000","last_became_active":"2024-09-21T06:09:53.705963+0000","last_became_peered":"2024-09-21T06:09:53.705963+0000","last_unstale":"2024-09-21T06:09:53.707273+0000","last_undegraded":"2024-09-21T06:09:53.707273+0000","last_fullsized":"2024-09-21T06:09:53.707273+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:10.813076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736798+0000","last_change":"2024-09-21T06:09:54.736294+0000","last_active":"2024-09-21T06:09:54.736798+0000","last_peered":"2024-09-21T06:09:54.736798+0000","last_clean":"2024-09-21T06:09:54.736798+0000","last_became_active":"2024-09-21T06:09:54.730284+0000","last_became_peered":"2024-09-21T06:09:54.730284+0000","last_unstale":"2024-09-21T06:09:54.736798+0000","last_undegraded":"2024-09-21T06:09:54.736798+0000","last_fullsized":"2024-09-21T06:09:54.736798+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:40.171281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.712134+0000","last_change":"2024-09-21T06:09:53.711582+0000","last_active":"2024-09-21T06:09:53.712134+0000","last_peered":"2024-09-21T06:09:53.712134+0000","last_clean":"2024-09-21T06:09:53.712134+0000","last_became_active":"2024-09-21T06:09:53.708856+0000","last_became_peered":"2024-09-21T06:09:53.708856+0000","last_unstale":"2024-09-21T06:09:53.712134+0000","last_undegraded":"2024-09-21T06:09:53.712134+0000","last_fullsized":"2024-09-21T06:09:53.712134+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.187186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706878+0000","last_change":"2024-09-21T06:09:53.706878+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706878+0000","last_undegraded":"2024-09-21T06:09:53.706878+0000","last_fullsized":"2024-09-21T06:09:53.706878+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.710074+0000","last_change":"2024-09-21T06:09:53.709837+0000","last_active":"2024-09-21T06:09:54.710074+0000","last_peered":"2024-09-21T06:09:54.710074+0000","last_clean":"2024-09-21T06:09:54.710074+0000","last_became_active":"2024-09-21T06:09:53.709495+0000","last_became_peered":"2024-09-21T06:09:53.709495+0000","last_unstale":"2024-09-21T06:09:54.710074+0000","last_undegraded":"2024-09-21T06:09:54.710074+0000","last_fullsized":"2024-09-21T06:09:54.710074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:38.922341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707985+0000","last_change":"2024-09-21T06:09:53.707985+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707985+0000","last_undegraded":"2024-09-21T06:09:53.707985+0000","last_fullsized":"2024-09-21T06:09:53.707985+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.703752+0000","last_change":"2024-09-21T06:09:53.703188+0000","last_active":"2024-09-21T06:09:53.703752+0000","last_peered":"2024-09-21T06:09:53.703752+0000","last_clean":"2024-09-21T06:09:53.703752+0000","last_became_active":"2024-09-21T06:09:53.702921+0000","last_became_peered":"2024-09-21T06:09:53.702921+0000","last_unstale":"2024-09-21T06:09:53.703752+0000","last_undegraded":"2024-09-21T06:09:53.703752+0000","last_fullsized":"2024-09-21T06:09:53.703752+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:55.150790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698657+0000","last_change":"2024-09-21T06:09:53.698657+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698657+0000","last_undegraded":"2024-09-21T06:09:53.698657+0000","last_fullsized":"2024-09-21T06:09:53.698657+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.706230+0000","last_change":"2024-09-21T06:09:53.705254+0000","last_active":"2024-09-21T06:09:53.706230+0000","last_peered":"2024-09-21T06:09:53.706230+0000","last_clean":"2024-09-21T06:09:53.706230+0000","last_became_active":"2024-09-21T06:09:53.704428+0000","last_became_peered":"2024-09-21T06:09:53.704428+0000","last_unstale":"2024-09-21T06:09:53.706230+0000","last_undegraded":"2024-09-21T06:09:53.706230+0000","last_fullsized":"2024-09-21T06:09:53.706230+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:16.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.722581+0000","last_change":"2024-09-21T06:09:54.720301+0000","last_active":"2024-09-21T06:09:54.722581+0000","last_peered":"2024-09-21T06:09:54.722581+0000","last_clean":"2024-09-21T06:09:54.722581+0000","last_became_active":"2024-09-21T06:09:54.719957+0000","last_became_peered":"2024-09-21T06:09:54.719957+0000","last_unstale":"2024-09-21T06:09:54.722581+0000","last_undegraded":"2024-09-21T06:09:54.722581+0000","last_fullsized":"2024-09-21T06:09:54.722581+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:42.236903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.713641+0000","last_change":"2024-09-21T06:09:53.712908+0000","last_active":"2024-09-21T06:09:53.713641+0000","last_peered":"2024-09-21T06:09:53.713641+0000","last_clean":"2024-09-21T06:09:53.713641+0000","last_became_active":"2024-09-21T06:09:53.712614+0000","last_became_peered":"2024-09-21T06:09:53.712614+0000","last_unstale":"2024-09-21T06:09:53.713641+0000","last_undegraded":"2024-09-21T06:09:53.713641+0000","last_fullsized":"2024-09-21T06:09:53.713641+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:55.199379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704146+0000","last_change":"2024-09-21T06:09:53.704146+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704146+0000","last_undegraded":"2024-09-21T06:09:53.704146+0000","last_fullsized":"2024-09-21T06:09:53.704146+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.715305+0000","last_change":"2024-09-21T06:09:53.715095+0000","last_active":"2024-09-21T06:09:53.715305+0000","last_peered":"2024-09-21T06:09:53.715305+0000","last_clean":"2024-09-21T06:09:53.715305+0000","last_became_active":"2024-09-21T06:09:53.714836+0000","last_became_peered":"2024-09-21T06:09:53.714836+0000","last_unstale":"2024-09-21T06:09:53.715305+0000","last_undegraded":"2024-09-21T06:09:53.715305+0000","last_fullsized":"2024-09-21T06:09:53.715305+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:30.212166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705289+0000","last_change":"2024-09-21T06:09:53.705289+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705289+0000","last_undegraded":"2024-09-21T06:09:53.705289+0000","last_fullsized":"2024-09-21T06:09:53.705289+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.708994+0000","last_change":"2024-09-21T06:09:53.708722+0000","last_active":"2024-09-21T06:09:53.708994+0000","last_peered":"2024-09-21T06:09:53.708994+0000","last_clean":"2024-09-21T06:09:53.708994+0000","last_became_active":"2024-09-21T06:09:53.707835+0000","last_became_peered":"2024-09-21T06:09:53.707835+0000","last_unstale":"2024-09-21T06:09:53.708994+0000","last_undegraded":"2024-09-21T06:09:53.708994+0000","last_fullsized":"2024-09-21T06:09:53.708994+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:34.855404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709797+0000","last_change":"2024-09-21T06:09:53.709797+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709797+0000","last_undegraded":"2024-09-21T06:09:53.709797+0000","last_fullsized":"2024-09-21T06:09:53.709797+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707302+0000","last_change":"2024-09-21T06:09:53.707015+0000","last_active":"2024-09-21T06:09:53.707302+0000","last_peered":"2024-09-21T06:09:53.707302+0000","last_clean":"2024-09-21T06:09:53.707302+0000","last_became_active":"2024-09-21T06:09:53.706448+0000","last_became_peered":"2024-09-21T06:09:53.706448+0000","last_unstale":"2024-09-21T06:09:53.707302+0000","last_undegraded":"2024-09-21T06:09:53.707302+0000","last_fullsized":"2024-09-21T06:09:53.707302+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:24.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707574+0000","last_change":"2024-09-21T06:09:53.707574+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707574+0000","last_undegraded":"2024-09-21T06:09:53.707574+0000","last_fullsized":"2024-09-21T06:09:53.707574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.714439+0000","last_change":"2024-09-21T06:09:53.714184+0000","last_active":"2024-09-21T06:09:53.714439+0000","last_peered":"2024-09-21T06:09:53.714439+0000","last_clean":"2024-09-21T06:09:53.714439+0000","last_became_active":"2024-09-21T06:09:53.713745+0000","last_became_peered":"2024-09-21T06:09:53.713745+0000","last_unstale":"2024-09-21T06:09:53.714439+0000","last_undegraded":"2024-09-21T06:09:53.714439+0000","last_fullsized":"2024-09-21T06:09:53.714439+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.645814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704756+0000","last_change":"2024-09-21T06:09:53.704756+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704756+0000","last_undegraded":"2024-09-21T06:09:53.704756+0000","last_fullsized":"2024-09-21T06:09:53.704756+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711865+0000","last_change":"2024-09-21T06:09:53.710971+0000","last_active":"2024-09-21T06:09:53.711865+0000","last_peered":"2024-09-21T06:09:53.711865+0000","last_clean":"2024-09-21T06:09:53.711865+0000","last_became_active":"2024-09-21T06:09:53.710679+0000","last_became_peered":"2024-09-21T06:09:53.710679+0000","last_unstale":"2024-09-21T06:09:53.711865+0000","last_undegraded":"2024-09-21T06:09:53.711865+0000","last_fullsized":"2024-09-21T06:09:53.711865+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:29.074269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698312+0000","last_change":"2024-09-21T06:09:53.698312+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698312+0000","last_undegraded":"2024-09-21T06:09:53.698312+0000","last_fullsized":"2024-09-21T06:09:53.698312+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.729462+0000","last_change":"2024-09-21T06:09:53.713604+0000","last_active":"2024-09-21T06:09:54.729462+0000","last_peered":"2024-09-21T06:09:54.729462+0000","last_clean":"2024-09-21T06:09:54.729462+0000","last_became_active":"2024-09-21T06:09:53.712555+0000","last_became_peered":"2024-09-21T06:09:53.712555+0000","last_unstale":"2024-09-21T06:09:54.729462+0000","last_undegraded":"2024-09-21T06:09:54.729462+0000","last_fullsized":"2024-09-21T06:09:54.729462+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:00.616919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705326+0000","last_change":"2024-09-21T06:09:53.705326+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705326+0000","last_undegraded":"2024-09-21T06:09:53.705326+0000","last_fullsized":"2024-09-21T06:09:53.705326+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.746776+0000","last_change":"2024-09-21T06:09:53.718333+0000","last_active":"2024-09-21T06:09:54.746776+0000","last_peered":"2024-09-21T06:09:54.746776+0000","last_clean":"2024-09-21T06:09:54.746776+0000","last_became_active":"2024-09-21T06:09:53.717703+0000","last_became_peered":"2024-09-21T06:09:53.717703+0000","last_unstale":"2024-09-21T06:09:54.746776+0000","last_undegraded":"2024-09-21T06:09:54.746776+0000","last_fullsized":"2024-09-21T06:09:54.746776+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:57.064938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709325+0000","last_change":"2024-09-21T06:09:53.709325+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709325+0000","last_undegraded":"2024-09-21T06:09:53.709325+0000","last_fullsized":"2024-09-21T06:09:53.709325+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.709491+0000","last_change":"2024-09-21T06:09:53.709262+0000","last_active":"2024-09-21T06:09:53.709491+0000","last_peered":"2024-09-21T06:09:53.709491+0000","last_clean":"2024-09-21T06:09:53.709491+0000","last_became_active":"2024-09-21T06:09:53.708917+0000","last_became_peered":"2024-09-21T06:09:53.708917+0000","last_unstale":"2024-09-21T06:09:53.709491+0000","last_undegraded":"2024-09-21T06:09:53.709491+0000","last_fullsized":"2024-09-21T06:09:53.709491+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:57.649690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704258+0000","last_change":"2024-09-21T06:09:53.704258+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704258+0000","last_undegraded":"2024-09-21T06:09:53.704258+0000","last_fullsized":"2024-09-21T06:09:53.704258+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711489+0000","last_change":"2024-09-21T06:09:53.709993+0000","last_active":"2024-09-21T06:09:53.711489+0000","last_peered":"2024-09-21T06:09:53.711489+0000","last_clean":"2024-09-21T06:09:53.711489+0000","last_became_active":"2024-09-21T06:09:53.709716+0000","last_became_peered":"2024-09-21T06:09:53.709716+0000","last_unstale":"2024-09-21T06:09:53.711489+0000","last_undegraded":"2024-09-21T06:09:53.711489+0000","last_fullsized":"2024-09-21T06:09:53.711489+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:02.692503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708346+0000","last_change":"2024-09-21T06:09:53.708346+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708346+0000","last_undegraded":"2024-09-21T06:09:53.708346+0000","last_fullsized":"2024-09-21T06:09:53.708346+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.720498+0000","last_change":"2024-09-21T06:09:53.711144+0000","last_active":"2024-09-21T06:09:54.720498+0000","last_peered":"2024-09-21T06:09:54.720498+0000","last_clean":"2024-09-21T06:09:54.720498+0000","last_became_active":"2024-09-21T06:09:53.710391+0000","last_became_peered":"2024-09-21T06:09:53.710391+0000","last_unstale":"2024-09-21T06:09:54.720498+0000","last_undegraded":"2024-09-21T06:09:54.720498+0000","last_fullsized":"2024-09-21T06:09:54.720498+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.449704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733318+0000","last_change":"2024-09-21T06:09:54.732230+0000","last_active":"2024-09-21T06:09:54.733318+0000","last_peered":"2024-09-21T06:09:54.733318+0000","last_clean":"2024-09-21T06:09:54.733318+0000","last_became_active":"2024-09-21T06:09:54.731646+0000","last_became_peered":"2024-09-21T06:09:54.731646+0000","last_unstale":"2024-09-21T06:09:54.733318+0000","last_undegraded":"2024-09-21T06:09:54.733318+0000","last_fullsized":"2024-09-21T06:09:54.733318+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:17.510453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711460+0000","last_change":"2024-09-21T06:09:53.710718+0000","last_active":"2024-09-21T06:09:53.711460+0000","last_peered":"2024-09-21T06:09:53.711460+0000","last_clean":"2024-09-21T06:09:53.711460+0000","last_became_active":"2024-09-21T06:09:53.710411+0000","last_became_peered":"2024-09-21T06:09:53.710411+0000","last_unstale":"2024-09-21T06:09:53.711460+0000","last_undegraded":"2024-09-21T06:09:53.711460+0000","last_fullsized":"2024-09-21T06:09:53.711460+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.737984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701583+0000","last_change":"2024-09-21T06:09:53.701583+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701583+0000","last_undegraded":"2024-09-21T06:09:53.701583+0000","last_fullsized":"2024-09-21T06:09:53.701583+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.730363+0000","last_change":"2024-09-21T06:09:53.718003+0000","last_active":"2024-09-21T06:09:54.730363+0000","last_peered":"2024-09-21T06:09:54.730363+0000","last_clean":"2024-09-21T06:09:54.730363+0000","last_became_active":"2024-09-21T06:09:53.716916+0000","last_became_peered":"2024-09-21T06:09:53.716916+0000","last_unstale":"2024-09-21T06:09:54.730363+0000","last_undegraded":"2024-09-21T06:09:54.730363+0000","last_fullsized":"2024-09-21T06:09:54.730363+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:51.259599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701277+0000","last_change":"2024-09-21T06:09:53.701277+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701277+0000","last_undegraded":"2024-09-21T06:09:53.701277+0000","last_fullsized":"2024-09-21T06:09:53.701277+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.717503+0000","last_change":"2024-09-21T06:09:53.715330+0000","last_active":"2024-09-21T06:09:54.717503+0000","last_peered":"2024-09-21T06:09:54.717503+0000","last_clean":"2024-09-21T06:09:54.717503+0000","last_became_active":"2024-09-21T06:09:53.710794+0000","last_became_peered":"2024-09-21T06:09:53.710794+0000","last_unstale":"2024-09-21T06:09:54.717503+0000","last_undegraded":"2024-09-21T06:09:54.717503+0000","last_fullsized":"2024-09-21T06:09:54.717503+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:43.129579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707167+0000","last_change":"2024-09-21T06:09:53.707167+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707167+0000","last_undegraded":"2024-09-21T06:09:53.707167+0000","last_fullsized":"2024-09-21T06:09:53.707167+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711912+0000","last_change":"2024-09-21T06:09:53.711730+0000","last_active":"2024-09-21T06:09:53.711912+0000","last_peered":"2024-09-21T06:09:53.711912+0000","last_clean":"2024-09-21T06:09:53.711912+0000","last_became_active":"2024-09-21T06:09:53.711350+0000","last_became_peered":"2024-09-21T06:09:53.711350+0000","last_unstale":"2024-09-21T06:09:53.711912+0000","last_undegraded":"2024-09-21T06:09:53.711912+0000","last_fullsized":"2024-09-21T06:09:53.711912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:34.151664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707870+0000","last_change":"2024-09-21T06:09:53.707870+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707870+0000","last_undegraded":"2024-09-21T06:09:53.707870+0000","last_fullsized":"2024-09-21T06:09:53.707870+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.720758+0000","last_change":"2024-09-21T06:09:53.715215+0000","last_active":"2024-09-21T06:09:54.720758+0000","last_peered":"2024-09-21T06:09:54.720758+0000","last_clean":"2024-09-21T06:09:54.720758+0000","last_became_active":"2024-09-21T06:09:53.714796+0000","last_became_peered":"2024-09-21T06:09:53.714796+0000","last_unstale":"2024-09-21T06:09:54.720758+0000","last_undegraded":"2024-09-21T06:09:54.720758+0000","last_fullsized":"2024-09-21T06:09:54.720758+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:32.161254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706190+0000","last_change":"2024-09-21T06:09:53.706190+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706190+0000","last_undegraded":"2024-09-21T06:09:53.706190+0000","last_fullsized":"2024-09-21T06:09:53.706190+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.712402+0000","last_change":"2024-09-21T06:09:53.712169+0000","last_active":"2024-09-21T06:09:53.712402+0000","last_peered":"2024-09-21T06:09:53.712402+0000","last_clean":"2024-09-21T06:09:53.712402+0000","last_became_active":"2024-09-21T06:09:53.711381+0000","last_became_peered":"2024-09-21T06:09:53.711381+0000","last_unstale":"2024-09-21T06:09:53.712402+0000","last_undegraded":"2024-09-21T06:09:53.712402+0000","last_fullsized":"2024-09-21T06:09:53.712402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.327031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704968+0000","last_change":"2024-09-21T06:09:53.704968+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704968+0000","last_undegraded":"2024-09-21T06:09:53.704968+0000","last_fullsized":"2024-09-21T06:09:53.704968+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.711048+0000","last_change":"2024-09-21T06:09:53.709948+0000","last_active":"2024-09-21T06:09:54.711048+0000","last_peered":"2024-09-21T06:09:54.711048+0000","last_clean":"2024-09-21T06:09:54.711048+0000","last_became_active":"2024-09-21T06:09:53.709689+0000","last_became_peered":"2024-09-21T06:09:53.709689+0000","last_unstale":"2024-09-21T06:09:54.711048+0000","last_undegraded":"2024-09-21T06:09:54.711048+0000","last_fullsized":"2024-09-21T06:09:54.711048+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706402+0000","last_change":"2024-09-21T06:09:53.706402+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706402+0000","last_undegraded":"2024-09-21T06:09:53.706402+0000","last_fullsized":"2024-09-21T06:09:53.706402+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.717095+0000","last_change":"2024-09-21T06:09:53.716899+0000","last_active":"2024-09-21T06:09:53.717095+0000","last_peered":"2024-09-21T06:09:53.717095+0000","last_clean":"2024-09-21T06:09:53.717095+0000","last_became_active":"2024-09-21T06:09:53.716429+0000","last_became_peered":"2024-09-21T06:09:53.716429+0000","last_unstale":"2024-09-21T06:09:53.717095+0000","last_undegraded":"2024-09-21T06:09:53.717095+0000","last_fullsized":"2024-09-21T06:09:53.717095+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.327416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708792+0000","last_change":"2024-09-21T06:09:53.708792+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708792+0000","last_undegraded":"2024-09-21T06:09:53.708792+0000","last_fullsized":"2024-09-21T06:09:53.708792+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.701219+0000","last_change":"2024-09-21T06:09:53.700722+0000","last_active":"2024-09-21T06:09:53.701219+0000","last_peered":"2024-09-21T06:09:53.701219+0000","last_clean":"2024-09-21T06:09:53.701219+0000","last_became_active":"2024-09-21T06:09:53.700465+0000","last_became_peered":"2024-09-21T06:09:53.700465+0000","last_unstale":"2024-09-21T06:09:53.701219+0000","last_undegraded":"2024-09-21T06:09:53.701219+0000","last_fullsized":"2024-09-21T06:09:53.701219+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.698729+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:09:53.698729+0000","last_peered":"2024-09-21T06:09:53.698729+0000","last_clean":"2024-09-21T06:09:53.698729+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:09:53.698729+0000","last_undegraded":"2024-09-21T06:09:53.698729+0000","last_fullsized":"2024-09-21T06:09:53.698729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":623,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199361896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194112,"statfs":{"total":200000000,"available":198771528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194112,"statfs":{"total":200000000,"available":198771528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":623,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199361896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:09:59.624 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:09:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.881+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3974380703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 msgr2=0x7fd2e41635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.881+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3974380703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e41635c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009830 tx=0x7fd2d402a4b0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.881+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3974380703 shutdown_connections 2024-09-21T06:09:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.881+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3974380703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e41635c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.881+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3974380703 >> 172.21.15.118:0/3974380703 conn(0x7fd2e406d110 msgr2=0x7fd2e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.881+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3974380703 shutdown_connections 2024-09-21T06:09:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.881+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3974380703 wait complete. 2024-09-21T06:09:59.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.883+0000 7fd2e8e00640 1 Processor -- start 2024-09-21T06:09:59.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.884+0000 7fd2e8e00640 1 -- start start 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e8e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e8e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2e40aea60 0x7fd2e414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2e40d0e80 0x7fd2e41f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e8e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e40af910 con 0x7fd2e4073e30 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e8e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e40af790 con 0x7fd2e40d0e80 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e8e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e40afa90 con 0x7fd2e40aea60 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53898/0 (socket says 172.21.15.118:53898) 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e1e00640 1 -- 172.21.15.118:0/3277817057 learned_addr learned my addr 172.21.15.118:0/3277817057 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2e2800640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2e40d0e80 0x7fd2e41f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.885+0000 7fd2d9400640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2e40aea60 0x7fd2e414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e1e00640 1 -- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2e40aea60 msgr2=0x7fd2e414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e1e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2e40aea60 0x7fd2e414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e1e00640 1 -- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2e40d0e80 msgr2=0x7fd2e41f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e1e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2e40d0e80 0x7fd2e41f6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e1e00640 1 -- 172.21.15.118:0/3277817057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e41597d0 con 0x7fd2e4073e30 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e2800640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2e40d0e80 0x7fd2e41f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2d9400640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2e40aea60 0x7fd2e414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e1e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e415a590 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d4033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2daa00640 1 -- 172.21.15.118:0/3277817057 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4031d60 con 0x7fd2e4073e30 2024-09-21T06:09:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2daa00640 1 -- 172.21.15.118:0/3277817057 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2d4005020 con 0x7fd2e4073e30 2024-09-21T06:09:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2daa00640 1 -- 172.21.15.118:0/3277817057 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4005450 con 0x7fd2e4073e30 2024-09-21T06:09:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e4159ab0 con 0x7fd2e4073e30 2024-09-21T06:09:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.886+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e415a070 con 0x7fd2e4073e30 2024-09-21T06:09:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.887+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e41635c0 con 0x7fd2e4073e30 2024-09-21T06:09:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.889+0000 7fd2daa00640 1 -- 172.21.15.118:0/3277817057 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2d40047a0 con 0x7fd2e4073e30 2024-09-21T06:09:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.889+0000 7fd2daa00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd2c0078b90 0x7fd2c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.890+0000 7fd2daa00640 1 -- 172.21.15.118:0/3277817057 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fd2d40bbfc0 con 0x7fd2e4073e30 2024-09-21T06:09:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.890+0000 7fd2d9400640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd2c0078b90 0x7fd2c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:59.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.891+0000 7fd2d9400640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd2c0078b90 0x7fd2c007b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4154270 tx=0x7fd2cc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:59.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:09:59.894+0000 7fd2daa00640 1 -- 172.21.15.118:0/3277817057 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd2d403f030 con 0x7fd2e4073e30 2024-09-21T06:10:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.077+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2e40b00e0 con 0x7fd2c0078b90 2024-09-21T06:10:00.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.082+0000 7fd2daa00640 1 -- 172.21.15.118:0/3277817057 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244078 (secure 0 0 0) 0x7fd2e40b00e0 con 0x7fd2c0078b90 2024-09-21T06:10:00.086 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:00.087 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.086+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd2c0078b90 msgr2=0x7fd2c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.086+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd2c0078b90 0x7fd2c007b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4154270 tx=0x7fd2cc009040 comp rx=0 tx=0).stop 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.086+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 msgr2=0x7fd2e415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.086+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e415a590 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d4033c90 comp rx=0 tx=0).stop 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 shutdown_connections 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2e40d0e80 0x7fd2e41f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd2c0078b90 0x7fd2c007b0a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2e40aea60 0x7fd2e414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 --2- 172.21.15.118:0/3277817057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e4073e30 0x7fd2e415a590 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 >> 172.21.15.118:0/3277817057 conn(0x7fd2e406d110 msgr2=0x7fd2e4162b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:00.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 shutdown_connections 2024-09-21T06:10:00.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.087+0000 7fd2e8e00640 1 -- 172.21.15.118:0/3277817057 wait complete. 2024-09-21T06:10:00.113 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-09-21T06:09:58.551914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6113,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556386,"statfs":{"total":1600000000,"available":1593739532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.854591"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701387+0000","last_change":"2024-09-21T06:09:53.701387+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701387+0000","last_undegraded":"2024-09-21T06:09:53.701387+0000","last_fullsized":"2024-09-21T06:09:53.701387+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736825+0000","last_change":"2024-09-21T06:09:54.736623+0000","last_active":"2024-09-21T06:09:54.736825+0000","last_peered":"2024-09-21T06:09:54.736825+0000","last_clean":"2024-09-21T06:09:54.736825+0000","last_became_active":"2024-09-21T06:09:54.730791+0000","last_became_peered":"2024-09-21T06:09:54.730791+0000","last_unstale":"2024-09-21T06:09:54.736825+0000","last_undegraded":"2024-09-21T06:09:54.736825+0000","last_fullsized":"2024-09-21T06:09:54.736825+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:45.275210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701151+0000","last_change":"2024-09-21T06:09:53.701151+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701151+0000","last_undegraded":"2024-09-21T06:09:53.701151+0000","last_fullsized":"2024-09-21T06:09:53.701151+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.726329+0000","last_change":"2024-09-21T06:09:54.724168+0000","last_active":"2024-09-21T06:09:54.726329+0000","last_peered":"2024-09-21T06:09:54.726329+0000","last_clean":"2024-09-21T06:09:54.726329+0000","last_became_active":"2024-09-21T06:09:54.723648+0000","last_became_peered":"2024-09-21T06:09:54.723648+0000","last_unstale":"2024-09-21T06:09:54.726329+0000","last_undegraded":"2024-09-21T06:09:54.726329+0000","last_fullsized":"2024-09-21T06:09:54.726329+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:00.573035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709985+0000","last_change":"2024-09-21T06:09:53.709985+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709985+0000","last_undegraded":"2024-09-21T06:09:53.709985+0000","last_fullsized":"2024-09-21T06:09:53.709985+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701569+0000","last_change":"2024-09-21T06:09:53.701569+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701569+0000","last_undegraded":"2024-09-21T06:09:53.701569+0000","last_fullsized":"2024-09-21T06:09:53.701569+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699940+0000","last_change":"2024-09-21T06:09:53.699940+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699940+0000","last_undegraded":"2024-09-21T06:09:53.699940+0000","last_fullsized":"2024-09-21T06:09:53.699940+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733366+0000","last_change":"2024-09-21T06:09:54.733110+0000","last_active":"2024-09-21T06:09:54.733366+0000","last_peered":"2024-09-21T06:09:54.733366+0000","last_clean":"2024-09-21T06:09:54.733366+0000","last_became_active":"2024-09-21T06:09:54.732596+0000","last_became_peered":"2024-09-21T06:09:54.732596+0000","last_unstale":"2024-09-21T06:09:54.733366+0000","last_undegraded":"2024-09-21T06:09:54.733366+0000","last_fullsized":"2024-09-21T06:09:54.733366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:40.616708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706962+0000","last_change":"2024-09-21T06:09:53.706962+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706962+0000","last_undegraded":"2024-09-21T06:09:53.706962+0000","last_fullsized":"2024-09-21T06:09:53.706962+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709253+0000","last_change":"2024-09-21T06:09:53.709253+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709253+0000","last_undegraded":"2024-09-21T06:09:53.709253+0000","last_fullsized":"2024-09-21T06:09:53.709253+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.700551+0000","last_change":"2024-09-21T06:09:53.700551+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.700551+0000","last_undegraded":"2024-09-21T06:09:53.700551+0000","last_fullsized":"2024-09-21T06:09:53.700551+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707410+0000","last_change":"2024-09-21T06:09:53.707410+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707410+0000","last_undegraded":"2024-09-21T06:09:53.707410+0000","last_fullsized":"2024-09-21T06:09:53.707410+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728235+0000","last_change":"2024-09-21T06:09:54.727226+0000","last_active":"2024-09-21T06:09:54.728235+0000","last_peered":"2024-09-21T06:09:54.728235+0000","last_clean":"2024-09-21T06:09:54.728235+0000","last_became_active":"2024-09-21T06:09:54.726587+0000","last_became_peered":"2024-09-21T06:09:54.726587+0000","last_unstale":"2024-09-21T06:09:54.728235+0000","last_undegraded":"2024-09-21T06:09:54.728235+0000","last_fullsized":"2024-09-21T06:09:54.728235+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:45.209413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711924+0000","last_change":"2024-09-21T06:09:53.711924+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711924+0000","last_undegraded":"2024-09-21T06:09:53.711924+0000","last_fullsized":"2024-09-21T06:09:53.711924+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.716056+0000","last_change":"2024-09-21T06:09:54.715833+0000","last_active":"2024-09-21T06:09:54.716056+0000","last_peered":"2024-09-21T06:09:54.716056+0000","last_clean":"2024-09-21T06:09:54.716056+0000","last_became_active":"2024-09-21T06:09:54.715403+0000","last_became_peered":"2024-09-21T06:09:54.715403+0000","last_unstale":"2024-09-21T06:09:54.716056+0000","last_undegraded":"2024-09-21T06:09:54.716056+0000","last_fullsized":"2024-09-21T06:09:54.716056+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:22.852188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698833+0000","last_change":"2024-09-21T06:09:53.698833+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698833+0000","last_undegraded":"2024-09-21T06:09:53.698833+0000","last_fullsized":"2024-09-21T06:09:53.698833+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.737093+0000","last_change":"2024-09-21T06:09:54.736891+0000","last_active":"2024-09-21T06:09:54.737093+0000","last_peered":"2024-09-21T06:09:54.737093+0000","last_clean":"2024-09-21T06:09:54.737093+0000","last_became_active":"2024-09-21T06:09:54.731138+0000","last_became_peered":"2024-09-21T06:09:54.731138+0000","last_unstale":"2024-09-21T06:09:54.737093+0000","last_undegraded":"2024-09-21T06:09:54.737093+0000","last_fullsized":"2024-09-21T06:09:54.737093+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:08.199731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.729497+0000","last_change":"2024-09-21T06:09:54.729128+0000","last_active":"2024-09-21T06:09:54.729497+0000","last_peered":"2024-09-21T06:09:54.729497+0000","last_clean":"2024-09-21T06:09:54.729497+0000","last_became_active":"2024-09-21T06:09:54.726952+0000","last_became_peered":"2024-09-21T06:09:54.726952+0000","last_unstale":"2024-09-21T06:09:54.729497+0000","last_undegraded":"2024-09-21T06:09:54.729497+0000","last_fullsized":"2024-09-21T06:09:54.729497+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:22.341479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711530+0000","last_change":"2024-09-21T06:09:53.711530+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711530+0000","last_undegraded":"2024-09-21T06:09:53.711530+0000","last_fullsized":"2024-09-21T06:09:53.711530+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707070+0000","last_change":"2024-09-21T06:09:53.707070+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707070+0000","last_undegraded":"2024-09-21T06:09:53.707070+0000","last_fullsized":"2024-09-21T06:09:53.707070+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709781+0000","last_change":"2024-09-21T06:09:53.709781+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709781+0000","last_undegraded":"2024-09-21T06:09:53.709781+0000","last_fullsized":"2024-09-21T06:09:53.709781+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736165+0000","last_change":"2024-09-21T06:09:54.731406+0000","last_active":"2024-09-21T06:09:54.736165+0000","last_peered":"2024-09-21T06:09:54.736165+0000","last_clean":"2024-09-21T06:09:54.736165+0000","last_became_active":"2024-09-21T06:09:54.729828+0000","last_became_peered":"2024-09-21T06:09:54.729828+0000","last_unstale":"2024-09-21T06:09:54.736165+0000","last_undegraded":"2024-09-21T06:09:54.736165+0000","last_fullsized":"2024-09-21T06:09:54.736165+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:16.225506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733343+0000","last_change":"2024-09-21T06:09:54.732838+0000","last_active":"2024-09-21T06:09:54.733343+0000","last_peered":"2024-09-21T06:09:54.733343+0000","last_clean":"2024-09-21T06:09:54.733343+0000","last_became_active":"2024-09-21T06:09:54.731982+0000","last_became_peered":"2024-09-21T06:09:54.731982+0000","last_unstale":"2024-09-21T06:09:54.733343+0000","last_undegraded":"2024-09-21T06:09:54.733343+0000","last_fullsized":"2024-09-21T06:09:54.733343+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:59.062729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699144+0000","last_change":"2024-09-21T06:09:53.699144+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699144+0000","last_undegraded":"2024-09-21T06:09:53.699144+0000","last_fullsized":"2024-09-21T06:09:53.699144+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708851+0000","last_change":"2024-09-21T06:09:53.708851+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708851+0000","last_undegraded":"2024-09-21T06:09:53.708851+0000","last_fullsized":"2024-09-21T06:09:53.708851+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728688+0000","last_change":"2024-09-21T06:09:54.724653+0000","last_active":"2024-09-21T06:09:54.728688+0000","last_peered":"2024-09-21T06:09:54.728688+0000","last_clean":"2024-09-21T06:09:54.728688+0000","last_became_active":"2024-09-21T06:09:54.724078+0000","last_became_peered":"2024-09-21T06:09:54.724078+0000","last_unstale":"2024-09-21T06:09:54.728688+0000","last_undegraded":"2024-09-21T06:09:54.728688+0000","last_fullsized":"2024-09-21T06:09:54.728688+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:56.899629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699443+0000","last_change":"2024-09-21T06:09:53.699443+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699443+0000","last_undegraded":"2024-09-21T06:09:53.699443+0000","last_fullsized":"2024-09-21T06:09:53.699443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706817+0000","last_change":"2024-09-21T06:09:53.706817+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706817+0000","last_undegraded":"2024-09-21T06:09:53.706817+0000","last_fullsized":"2024-09-21T06:09:53.706817+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728624+0000","last_change":"2024-09-21T06:09:54.722797+0000","last_active":"2024-09-21T06:09:54.728624+0000","last_peered":"2024-09-21T06:09:54.728624+0000","last_clean":"2024-09-21T06:09:54.728624+0000","last_became_active":"2024-09-21T06:09:54.722520+0000","last_became_peered":"2024-09-21T06:09:54.722520+0000","last_unstale":"2024-09-21T06:09:54.728624+0000","last_undegraded":"2024-09-21T06:09:54.728624+0000","last_fullsized":"2024-09-21T06:09:54.728624+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:50.306224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.710014+0000","last_change":"2024-09-21T06:09:53.710014+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.710014+0000","last_undegraded":"2024-09-21T06:09:53.710014+0000","last_fullsized":"2024-09-21T06:09:53.710014+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.728514+0000","last_change":"2024-09-21T06:09:54.728270+0000","last_active":"2024-09-21T06:09:54.728514+0000","last_peered":"2024-09-21T06:09:54.728514+0000","last_clean":"2024-09-21T06:09:54.728514+0000","last_became_active":"2024-09-21T06:09:54.727623+0000","last_became_peered":"2024-09-21T06:09:54.727623+0000","last_unstale":"2024-09-21T06:09:54.728514+0000","last_undegraded":"2024-09-21T06:09:54.728514+0000","last_fullsized":"2024-09-21T06:09:54.728514+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:09.350395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.702907+0000","last_change":"2024-09-21T06:09:53.702907+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.702907+0000","last_undegraded":"2024-09-21T06:09:53.702907+0000","last_fullsized":"2024-09-21T06:09:53.702907+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.711098+0000","last_change":"2024-09-21T06:09:53.711098+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.711098+0000","last_undegraded":"2024-09-21T06:09:53.711098+0000","last_fullsized":"2024-09-21T06:09:53.711098+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"117'4","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.746965+0000","last_change":"2024-09-21T06:09:53.708840+0000","last_active":"2024-09-21T06:09:54.746965+0000","last_peered":"2024-09-21T06:09:54.746965+0000","last_clean":"2024-09-21T06:09:54.746965+0000","last_became_active":"2024-09-21T06:09:53.708196+0000","last_became_peered":"2024-09-21T06:09:53.708196+0000","last_unstale":"2024-09-21T06:09:54.746965+0000","last_undegraded":"2024-09-21T06:09:54.746965+0000","last_fullsized":"2024-09-21T06:09:54.746965+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:30.651982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.722646+0000","last_change":"2024-09-21T06:09:54.721812+0000","last_active":"2024-09-21T06:09:54.722646+0000","last_peered":"2024-09-21T06:09:54.722646+0000","last_clean":"2024-09-21T06:09:54.722646+0000","last_became_active":"2024-09-21T06:09:54.721537+0000","last_became_peered":"2024-09-21T06:09:54.721537+0000","last_unstale":"2024-09-21T06:09:54.722646+0000","last_undegraded":"2024-09-21T06:09:54.722646+0000","last_fullsized":"2024-09-21T06:09:54.722646+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:22.493815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.709369+0000","last_change":"2024-09-21T06:09:53.709117+0000","last_active":"2024-09-21T06:09:53.709369+0000","last_peered":"2024-09-21T06:09:53.709369+0000","last_clean":"2024-09-21T06:09:53.709369+0000","last_became_active":"2024-09-21T06:09:53.708817+0000","last_became_peered":"2024-09-21T06:09:53.708817+0000","last_unstale":"2024-09-21T06:09:53.709369+0000","last_undegraded":"2024-09-21T06:09:53.709369+0000","last_fullsized":"2024-09-21T06:09:53.709369+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:27.644268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.700587+0000","last_change":"2024-09-21T06:09:53.700587+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.700587+0000","last_undegraded":"2024-09-21T06:09:53.700587+0000","last_fullsized":"2024-09-21T06:09:53.700587+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.745282+0000","last_change":"2024-09-21T06:09:53.717421+0000","last_active":"2024-09-21T06:09:54.745282+0000","last_peered":"2024-09-21T06:09:54.745282+0000","last_clean":"2024-09-21T06:09:54.745282+0000","last_became_active":"2024-09-21T06:09:53.716764+0000","last_became_peered":"2024-09-21T06:09:53.716764+0000","last_unstale":"2024-09-21T06:09:54.745282+0000","last_undegraded":"2024-09-21T06:09:54.745282+0000","last_fullsized":"2024-09-21T06:09:54.745282+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.517669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706004+0000","last_change":"2024-09-21T06:09:53.706004+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706004+0000","last_undegraded":"2024-09-21T06:09:53.706004+0000","last_fullsized":"2024-09-21T06:09:53.706004+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.745891+0000","last_change":"2024-09-21T06:09:53.710816+0000","last_active":"2024-09-21T06:09:54.745891+0000","last_peered":"2024-09-21T06:09:54.745891+0000","last_clean":"2024-09-21T06:09:54.745891+0000","last_became_active":"2024-09-21T06:09:53.710001+0000","last_became_peered":"2024-09-21T06:09:53.710001+0000","last_unstale":"2024-09-21T06:09:54.745891+0000","last_undegraded":"2024-09-21T06:09:54.745891+0000","last_fullsized":"2024-09-21T06:09:54.745891+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:26.581020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705856+0000","last_change":"2024-09-21T06:09:53.705856+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705856+0000","last_undegraded":"2024-09-21T06:09:53.705856+0000","last_fullsized":"2024-09-21T06:09:53.705856+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707325+0000","last_change":"2024-09-21T06:09:53.707087+0000","last_active":"2024-09-21T06:09:53.707325+0000","last_peered":"2024-09-21T06:09:53.707325+0000","last_clean":"2024-09-21T06:09:53.707325+0000","last_became_active":"2024-09-21T06:09:53.706816+0000","last_became_peered":"2024-09-21T06:09:53.706816+0000","last_unstale":"2024-09-21T06:09:53.707325+0000","last_undegraded":"2024-09-21T06:09:53.707325+0000","last_fullsized":"2024-09-21T06:09:53.707325+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:31.779003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.699004+0000","last_change":"2024-09-21T06:09:53.699004+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.699004+0000","last_undegraded":"2024-09-21T06:09:53.699004+0000","last_fullsized":"2024-09-21T06:09:53.699004+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"117'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.747165+0000","last_change":"2024-09-21T06:09:53.709283+0000","last_active":"2024-09-21T06:09:54.747165+0000","last_peered":"2024-09-21T06:09:54.747165+0000","last_clean":"2024-09-21T06:09:54.747165+0000","last_became_active":"2024-09-21T06:09:53.708580+0000","last_became_peered":"2024-09-21T06:09:53.708580+0000","last_unstale":"2024-09-21T06:09:54.747165+0000","last_undegraded":"2024-09-21T06:09:54.747165+0000","last_fullsized":"2024-09-21T06:09:54.747165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:28.034289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.715772+0000","last_change":"2024-09-21T06:09:54.715641+0000","last_active":"2024-09-21T06:09:54.715772+0000","last_peered":"2024-09-21T06:09:54.715772+0000","last_clean":"2024-09-21T06:09:54.715772+0000","last_became_active":"2024-09-21T06:09:54.715060+0000","last_became_peered":"2024-09-21T06:09:54.715060+0000","last_unstale":"2024-09-21T06:09:54.715772+0000","last_undegraded":"2024-09-21T06:09:54.715772+0000","last_fullsized":"2024-09-21T06:09:54.715772+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:37.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711890+0000","last_change":"2024-09-21T06:09:53.711159+0000","last_active":"2024-09-21T06:09:53.711890+0000","last_peered":"2024-09-21T06:09:53.711890+0000","last_clean":"2024-09-21T06:09:53.711890+0000","last_became_active":"2024-09-21T06:09:53.710652+0000","last_became_peered":"2024-09-21T06:09:53.710652+0000","last_unstale":"2024-09-21T06:09:53.711890+0000","last_undegraded":"2024-09-21T06:09:53.711890+0000","last_fullsized":"2024-09-21T06:09:53.711890+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:28.217669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705912+0000","last_change":"2024-09-21T06:09:53.705912+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705912+0000","last_undegraded":"2024-09-21T06:09:53.705912+0000","last_fullsized":"2024-09-21T06:09:53.705912+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707273+0000","last_change":"2024-09-21T06:09:53.706233+0000","last_active":"2024-09-21T06:09:53.707273+0000","last_peered":"2024-09-21T06:09:53.707273+0000","last_clean":"2024-09-21T06:09:53.707273+0000","last_became_active":"2024-09-21T06:09:53.705963+0000","last_became_peered":"2024-09-21T06:09:53.705963+0000","last_unstale":"2024-09-21T06:09:53.707273+0000","last_undegraded":"2024-09-21T06:09:53.707273+0000","last_fullsized":"2024-09-21T06:09:53.707273+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:10.813076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.736798+0000","last_change":"2024-09-21T06:09:54.736294+0000","last_active":"2024-09-21T06:09:54.736798+0000","last_peered":"2024-09-21T06:09:54.736798+0000","last_clean":"2024-09-21T06:09:54.736798+0000","last_became_active":"2024-09-21T06:09:54.730284+0000","last_became_peered":"2024-09-21T06:09:54.730284+0000","last_unstale":"2024-09-21T06:09:54.736798+0000","last_undegraded":"2024-09-21T06:09:54.736798+0000","last_fullsized":"2024-09-21T06:09:54.736798+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:40.171281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.712134+0000","last_change":"2024-09-21T06:09:53.711582+0000","last_active":"2024-09-21T06:09:53.712134+0000","last_peered":"2024-09-21T06:09:53.712134+0000","last_clean":"2024-09-21T06:09:53.712134+0000","last_became_active":"2024-09-21T06:09:53.708856+0000","last_became_peered":"2024-09-21T06:09:53.708856+0000","last_unstale":"2024-09-21T06:09:53.712134+0000","last_undegraded":"2024-09-21T06:09:53.712134+0000","last_fullsized":"2024-09-21T06:09:53.712134+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.187186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706878+0000","last_change":"2024-09-21T06:09:53.706878+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706878+0000","last_undegraded":"2024-09-21T06:09:53.706878+0000","last_fullsized":"2024-09-21T06:09:53.706878+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.710074+0000","last_change":"2024-09-21T06:09:53.709837+0000","last_active":"2024-09-21T06:09:54.710074+0000","last_peered":"2024-09-21T06:09:54.710074+0000","last_clean":"2024-09-21T06:09:54.710074+0000","last_became_active":"2024-09-21T06:09:53.709495+0000","last_became_peered":"2024-09-21T06:09:53.709495+0000","last_unstale":"2024-09-21T06:09:54.710074+0000","last_undegraded":"2024-09-21T06:09:54.710074+0000","last_fullsized":"2024-09-21T06:09:54.710074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:38.922341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707985+0000","last_change":"2024-09-21T06:09:53.707985+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707985+0000","last_undegraded":"2024-09-21T06:09:53.707985+0000","last_fullsized":"2024-09-21T06:09:53.707985+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.703752+0000","last_change":"2024-09-21T06:09:53.703188+0000","last_active":"2024-09-21T06:09:53.703752+0000","last_peered":"2024-09-21T06:09:53.703752+0000","last_clean":"2024-09-21T06:09:53.703752+0000","last_became_active":"2024-09-21T06:09:53.702921+0000","last_became_peered":"2024-09-21T06:09:53.702921+0000","last_unstale":"2024-09-21T06:09:53.703752+0000","last_undegraded":"2024-09-21T06:09:53.703752+0000","last_fullsized":"2024-09-21T06:09:53.703752+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:55.150790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698657+0000","last_change":"2024-09-21T06:09:53.698657+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698657+0000","last_undegraded":"2024-09-21T06:09:53.698657+0000","last_fullsized":"2024-09-21T06:09:53.698657+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.706230+0000","last_change":"2024-09-21T06:09:53.705254+0000","last_active":"2024-09-21T06:09:53.706230+0000","last_peered":"2024-09-21T06:09:53.706230+0000","last_clean":"2024-09-21T06:09:53.706230+0000","last_became_active":"2024-09-21T06:09:53.704428+0000","last_became_peered":"2024-09-21T06:09:53.704428+0000","last_unstale":"2024-09-21T06:09:53.706230+0000","last_undegraded":"2024-09-21T06:09:53.706230+0000","last_fullsized":"2024-09-21T06:09:53.706230+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:16.611359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.722581+0000","last_change":"2024-09-21T06:09:54.720301+0000","last_active":"2024-09-21T06:09:54.722581+0000","last_peered":"2024-09-21T06:09:54.722581+0000","last_clean":"2024-09-21T06:09:54.722581+0000","last_became_active":"2024-09-21T06:09:54.719957+0000","last_became_peered":"2024-09-21T06:09:54.719957+0000","last_unstale":"2024-09-21T06:09:54.722581+0000","last_undegraded":"2024-09-21T06:09:54.722581+0000","last_fullsized":"2024-09-21T06:09:54.722581+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:42.236903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.713641+0000","last_change":"2024-09-21T06:09:53.712908+0000","last_active":"2024-09-21T06:09:53.713641+0000","last_peered":"2024-09-21T06:09:53.713641+0000","last_clean":"2024-09-21T06:09:53.713641+0000","last_became_active":"2024-09-21T06:09:53.712614+0000","last_became_peered":"2024-09-21T06:09:53.712614+0000","last_unstale":"2024-09-21T06:09:53.713641+0000","last_undegraded":"2024-09-21T06:09:53.713641+0000","last_fullsized":"2024-09-21T06:09:53.713641+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:55.199379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704146+0000","last_change":"2024-09-21T06:09:53.704146+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704146+0000","last_undegraded":"2024-09-21T06:09:53.704146+0000","last_fullsized":"2024-09-21T06:09:53.704146+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.715305+0000","last_change":"2024-09-21T06:09:53.715095+0000","last_active":"2024-09-21T06:09:53.715305+0000","last_peered":"2024-09-21T06:09:53.715305+0000","last_clean":"2024-09-21T06:09:53.715305+0000","last_became_active":"2024-09-21T06:09:53.714836+0000","last_became_peered":"2024-09-21T06:09:53.714836+0000","last_unstale":"2024-09-21T06:09:53.715305+0000","last_undegraded":"2024-09-21T06:09:53.715305+0000","last_fullsized":"2024-09-21T06:09:53.715305+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:30.212166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705289+0000","last_change":"2024-09-21T06:09:53.705289+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705289+0000","last_undegraded":"2024-09-21T06:09:53.705289+0000","last_fullsized":"2024-09-21T06:09:53.705289+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.708994+0000","last_change":"2024-09-21T06:09:53.708722+0000","last_active":"2024-09-21T06:09:53.708994+0000","last_peered":"2024-09-21T06:09:53.708994+0000","last_clean":"2024-09-21T06:09:53.708994+0000","last_became_active":"2024-09-21T06:09:53.707835+0000","last_became_peered":"2024-09-21T06:09:53.707835+0000","last_unstale":"2024-09-21T06:09:53.708994+0000","last_undegraded":"2024-09-21T06:09:53.708994+0000","last_fullsized":"2024-09-21T06:09:53.708994+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:34.855404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709797+0000","last_change":"2024-09-21T06:09:53.709797+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709797+0000","last_undegraded":"2024-09-21T06:09:53.709797+0000","last_fullsized":"2024-09-21T06:09:53.709797+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.707302+0000","last_change":"2024-09-21T06:09:53.707015+0000","last_active":"2024-09-21T06:09:53.707302+0000","last_peered":"2024-09-21T06:09:53.707302+0000","last_clean":"2024-09-21T06:09:53.707302+0000","last_became_active":"2024-09-21T06:09:53.706448+0000","last_became_peered":"2024-09-21T06:09:53.706448+0000","last_unstale":"2024-09-21T06:09:53.707302+0000","last_undegraded":"2024-09-21T06:09:53.707302+0000","last_fullsized":"2024-09-21T06:09:53.707302+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:24.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707574+0000","last_change":"2024-09-21T06:09:53.707574+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707574+0000","last_undegraded":"2024-09-21T06:09:53.707574+0000","last_fullsized":"2024-09-21T06:09:53.707574+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.714439+0000","last_change":"2024-09-21T06:09:53.714184+0000","last_active":"2024-09-21T06:09:53.714439+0000","last_peered":"2024-09-21T06:09:53.714439+0000","last_clean":"2024-09-21T06:09:53.714439+0000","last_became_active":"2024-09-21T06:09:53.713745+0000","last_became_peered":"2024-09-21T06:09:53.713745+0000","last_unstale":"2024-09-21T06:09:53.714439+0000","last_undegraded":"2024-09-21T06:09:53.714439+0000","last_fullsized":"2024-09-21T06:09:53.714439+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.645814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704756+0000","last_change":"2024-09-21T06:09:53.704756+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704756+0000","last_undegraded":"2024-09-21T06:09:53.704756+0000","last_fullsized":"2024-09-21T06:09:53.704756+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711865+0000","last_change":"2024-09-21T06:09:53.710971+0000","last_active":"2024-09-21T06:09:53.711865+0000","last_peered":"2024-09-21T06:09:53.711865+0000","last_clean":"2024-09-21T06:09:53.711865+0000","last_became_active":"2024-09-21T06:09:53.710679+0000","last_became_peered":"2024-09-21T06:09:53.710679+0000","last_unstale":"2024-09-21T06:09:53.711865+0000","last_undegraded":"2024-09-21T06:09:53.711865+0000","last_fullsized":"2024-09-21T06:09:53.711865+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:29.074269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.698312+0000","last_change":"2024-09-21T06:09:53.698312+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.698312+0000","last_undegraded":"2024-09-21T06:09:53.698312+0000","last_fullsized":"2024-09-21T06:09:53.698312+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.729462+0000","last_change":"2024-09-21T06:09:53.713604+0000","last_active":"2024-09-21T06:09:54.729462+0000","last_peered":"2024-09-21T06:09:54.729462+0000","last_clean":"2024-09-21T06:09:54.729462+0000","last_became_active":"2024-09-21T06:09:53.712555+0000","last_became_peered":"2024-09-21T06:09:53.712555+0000","last_unstale":"2024-09-21T06:09:54.729462+0000","last_undegraded":"2024-09-21T06:09:54.729462+0000","last_fullsized":"2024-09-21T06:09:54.729462+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:00.616919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.705326+0000","last_change":"2024-09-21T06:09:53.705326+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.705326+0000","last_undegraded":"2024-09-21T06:09:53.705326+0000","last_fullsized":"2024-09-21T06:09:53.705326+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"117'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.746776+0000","last_change":"2024-09-21T06:09:53.718333+0000","last_active":"2024-09-21T06:09:54.746776+0000","last_peered":"2024-09-21T06:09:54.746776+0000","last_clean":"2024-09-21T06:09:54.746776+0000","last_became_active":"2024-09-21T06:09:53.717703+0000","last_became_peered":"2024-09-21T06:09:53.717703+0000","last_unstale":"2024-09-21T06:09:54.746776+0000","last_undegraded":"2024-09-21T06:09:54.746776+0000","last_fullsized":"2024-09-21T06:09:54.746776+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:57.064938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.709325+0000","last_change":"2024-09-21T06:09:53.709325+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.709325+0000","last_undegraded":"2024-09-21T06:09:53.709325+0000","last_fullsized":"2024-09-21T06:09:53.709325+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.709491+0000","last_change":"2024-09-21T06:09:53.709262+0000","last_active":"2024-09-21T06:09:53.709491+0000","last_peered":"2024-09-21T06:09:53.709491+0000","last_clean":"2024-09-21T06:09:53.709491+0000","last_became_active":"2024-09-21T06:09:53.708917+0000","last_became_peered":"2024-09-21T06:09:53.708917+0000","last_unstale":"2024-09-21T06:09:53.709491+0000","last_undegraded":"2024-09-21T06:09:53.709491+0000","last_fullsized":"2024-09-21T06:09:53.709491+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:57.649690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704258+0000","last_change":"2024-09-21T06:09:53.704258+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704258+0000","last_undegraded":"2024-09-21T06:09:53.704258+0000","last_fullsized":"2024-09-21T06:09:53.704258+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711489+0000","last_change":"2024-09-21T06:09:53.709993+0000","last_active":"2024-09-21T06:09:53.711489+0000","last_peered":"2024-09-21T06:09:53.711489+0000","last_clean":"2024-09-21T06:09:53.711489+0000","last_became_active":"2024-09-21T06:09:53.709716+0000","last_became_peered":"2024-09-21T06:09:53.709716+0000","last_unstale":"2024-09-21T06:09:53.711489+0000","last_undegraded":"2024-09-21T06:09:53.711489+0000","last_fullsized":"2024-09-21T06:09:53.711489+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:02.692503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708346+0000","last_change":"2024-09-21T06:09:53.708346+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708346+0000","last_undegraded":"2024-09-21T06:09:53.708346+0000","last_fullsized":"2024-09-21T06:09:53.708346+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.720498+0000","last_change":"2024-09-21T06:09:53.711144+0000","last_active":"2024-09-21T06:09:54.720498+0000","last_peered":"2024-09-21T06:09:54.720498+0000","last_clean":"2024-09-21T06:09:54.720498+0000","last_became_active":"2024-09-21T06:09:53.710391+0000","last_became_peered":"2024-09-21T06:09:53.710391+0000","last_unstale":"2024-09-21T06:09:54.720498+0000","last_undegraded":"2024-09-21T06:09:54.720498+0000","last_fullsized":"2024-09-21T06:09:54.720498+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.449704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.733318+0000","last_change":"2024-09-21T06:09:54.732230+0000","last_active":"2024-09-21T06:09:54.733318+0000","last_peered":"2024-09-21T06:09:54.733318+0000","last_clean":"2024-09-21T06:09:54.733318+0000","last_became_active":"2024-09-21T06:09:54.731646+0000","last_became_peered":"2024-09-21T06:09:54.731646+0000","last_unstale":"2024-09-21T06:09:54.733318+0000","last_undegraded":"2024-09-21T06:09:54.733318+0000","last_fullsized":"2024-09-21T06:09:54.733318+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:17.510453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711460+0000","last_change":"2024-09-21T06:09:53.710718+0000","last_active":"2024-09-21T06:09:53.711460+0000","last_peered":"2024-09-21T06:09:53.711460+0000","last_clean":"2024-09-21T06:09:53.711460+0000","last_became_active":"2024-09-21T06:09:53.710411+0000","last_became_peered":"2024-09-21T06:09:53.710411+0000","last_unstale":"2024-09-21T06:09:53.711460+0000","last_undegraded":"2024-09-21T06:09:53.711460+0000","last_fullsized":"2024-09-21T06:09:53.711460+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:48.737984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701583+0000","last_change":"2024-09-21T06:09:53.701583+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701583+0000","last_undegraded":"2024-09-21T06:09:53.701583+0000","last_fullsized":"2024-09-21T06:09:53.701583+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.730363+0000","last_change":"2024-09-21T06:09:53.718003+0000","last_active":"2024-09-21T06:09:54.730363+0000","last_peered":"2024-09-21T06:09:54.730363+0000","last_clean":"2024-09-21T06:09:54.730363+0000","last_became_active":"2024-09-21T06:09:53.716916+0000","last_became_peered":"2024-09-21T06:09:53.716916+0000","last_unstale":"2024-09-21T06:09:54.730363+0000","last_undegraded":"2024-09-21T06:09:54.730363+0000","last_fullsized":"2024-09-21T06:09:54.730363+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:51.259599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.701277+0000","last_change":"2024-09-21T06:09:53.701277+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.701277+0000","last_undegraded":"2024-09-21T06:09:53.701277+0000","last_fullsized":"2024-09-21T06:09:53.701277+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.717503+0000","last_change":"2024-09-21T06:09:53.715330+0000","last_active":"2024-09-21T06:09:54.717503+0000","last_peered":"2024-09-21T06:09:54.717503+0000","last_clean":"2024-09-21T06:09:54.717503+0000","last_became_active":"2024-09-21T06:09:53.710794+0000","last_became_peered":"2024-09-21T06:09:53.710794+0000","last_unstale":"2024-09-21T06:09:54.717503+0000","last_undegraded":"2024-09-21T06:09:54.717503+0000","last_fullsized":"2024-09-21T06:09:54.717503+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:43.129579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707167+0000","last_change":"2024-09-21T06:09:53.707167+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707167+0000","last_undegraded":"2024-09-21T06:09:53.707167+0000","last_fullsized":"2024-09-21T06:09:53.707167+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.711912+0000","last_change":"2024-09-21T06:09:53.711730+0000","last_active":"2024-09-21T06:09:53.711912+0000","last_peered":"2024-09-21T06:09:53.711912+0000","last_clean":"2024-09-21T06:09:53.711912+0000","last_became_active":"2024-09-21T06:09:53.711350+0000","last_became_peered":"2024-09-21T06:09:53.711350+0000","last_unstale":"2024-09-21T06:09:53.711912+0000","last_undegraded":"2024-09-21T06:09:53.711912+0000","last_fullsized":"2024-09-21T06:09:53.711912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:34.151664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.707870+0000","last_change":"2024-09-21T06:09:53.707870+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.707870+0000","last_undegraded":"2024-09-21T06:09:53.707870+0000","last_fullsized":"2024-09-21T06:09:53.707870+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.720758+0000","last_change":"2024-09-21T06:09:53.715215+0000","last_active":"2024-09-21T06:09:54.720758+0000","last_peered":"2024-09-21T06:09:54.720758+0000","last_clean":"2024-09-21T06:09:54.720758+0000","last_became_active":"2024-09-21T06:09:53.714796+0000","last_became_peered":"2024-09-21T06:09:53.714796+0000","last_unstale":"2024-09-21T06:09:54.720758+0000","last_undegraded":"2024-09-21T06:09:54.720758+0000","last_fullsized":"2024-09-21T06:09:54.720758+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:32.161254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706190+0000","last_change":"2024-09-21T06:09:53.706190+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706190+0000","last_undegraded":"2024-09-21T06:09:53.706190+0000","last_fullsized":"2024-09-21T06:09:53.706190+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.712402+0000","last_change":"2024-09-21T06:09:53.712169+0000","last_active":"2024-09-21T06:09:53.712402+0000","last_peered":"2024-09-21T06:09:53.712402+0000","last_clean":"2024-09-21T06:09:53.712402+0000","last_became_active":"2024-09-21T06:09:53.711381+0000","last_became_peered":"2024-09-21T06:09:53.711381+0000","last_unstale":"2024-09-21T06:09:53.712402+0000","last_undegraded":"2024-09-21T06:09:53.712402+0000","last_fullsized":"2024-09-21T06:09:53.712402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.327031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.704968+0000","last_change":"2024-09-21T06:09:53.704968+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.704968+0000","last_undegraded":"2024-09-21T06:09:53.704968+0000","last_fullsized":"2024-09-21T06:09:53.704968+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-21T06:09:54.711048+0000","last_change":"2024-09-21T06:09:53.709948+0000","last_active":"2024-09-21T06:09:54.711048+0000","last_peered":"2024-09-21T06:09:54.711048+0000","last_clean":"2024-09-21T06:09:54.711048+0000","last_became_active":"2024-09-21T06:09:53.709689+0000","last_became_peered":"2024-09-21T06:09:53.709689+0000","last_unstale":"2024-09-21T06:09:54.711048+0000","last_undegraded":"2024-09-21T06:09:54.711048+0000","last_fullsized":"2024-09-21T06:09:54.711048+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.706402+0000","last_change":"2024-09-21T06:09:53.706402+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.706402+0000","last_undegraded":"2024-09-21T06:09:53.706402+0000","last_fullsized":"2024-09-21T06:09:53.706402+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.717095+0000","last_change":"2024-09-21T06:09:53.716899+0000","last_active":"2024-09-21T06:09:53.717095+0000","last_peered":"2024-09-21T06:09:53.717095+0000","last_clean":"2024-09-21T06:09:53.717095+0000","last_became_active":"2024-09-21T06:09:53.716429+0000","last_became_peered":"2024-09-21T06:09:53.716429+0000","last_unstale":"2024-09-21T06:09:53.717095+0000","last_undegraded":"2024-09-21T06:09:53.717095+0000","last_fullsized":"2024-09-21T06:09:53.717095+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.327416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-09-21T06:09:53.708792+0000","last_change":"2024-09-21T06:09:53.708792+0000","last_active":"2024-09-21T06:09:53.690709+0000","last_peered":"2024-09-21T06:09:53.690709+0000","last_clean":"2024-09-21T06:09:53.690709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:09:53.708792+0000","last_undegraded":"2024-09-21T06:09:53.708792+0000","last_fullsized":"2024-09-21T06:09:53.708792+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.701219+0000","last_change":"2024-09-21T06:09:53.700722+0000","last_active":"2024-09-21T06:09:53.701219+0000","last_peered":"2024-09-21T06:09:53.701219+0000","last_clean":"2024-09-21T06:09:53.701219+0000","last_became_active":"2024-09-21T06:09:53.700465+0000","last_became_peered":"2024-09-21T06:09:53.700465+0000","last_unstale":"2024-09-21T06:09:53.701219+0000","last_undegraded":"2024-09-21T06:09:53.701219+0000","last_fullsized":"2024-09-21T06:09:53.701219+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T06:09:53.698729+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:09:53.698729+0000","last_peered":"2024-09-21T06:09:53.698729+0000","last_clean":"2024-09-21T06:09:53.698729+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:09:53.698729+0000","last_undegraded":"2024-09-21T06:09:53.698729+0000","last_fullsized":"2024-09-21T06:09:53.698729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":623,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199361896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194112,"statfs":{"total":200000000,"available":198771528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194112,"statfs":{"total":200000000,"available":198771528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":617,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194695,"statfs":{"total":200000000,"available":199368171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":623,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194689,"statfs":{"total":200000000,"available":199361896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:10:00.116 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3f is not active+clean 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.701387+0000', 'last_change': '2024-09-21T06:09:53.701387+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.701387+0000', 'last_undegraded': '2024-09-21T06:09:53.701387+0000', 'last_fullsized': '2024-09-21T06:09:53.701387+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3d is not active+clean 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.701151+0000', 'last_change': '2024-09-21T06:09:53.701151+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.701151+0000', 'last_undegraded': '2024-09-21T06:09:53.701151+0000', 'last_fullsized': '2024-09-21T06:09:53.701151+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3b is not active+clean 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.709985+0000', 'last_change': '2024-09-21T06:09:53.709985+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.709985+0000', 'last_undegraded': '2024-09-21T06:09:53.709985+0000', 'last_fullsized': '2024-09-21T06:09:53.709985+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3a is not active+clean 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.701569+0000', 'last_change': '2024-09-21T06:09:53.701569+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.701569+0000', 'last_undegraded': '2024-09-21T06:09:53.701569+0000', 'last_fullsized': '2024-09-21T06:09:53.701569+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:PG 15.39 is not active+clean 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.699940+0000', 'last_change': '2024-09-21T06:09:53.699940+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.699940+0000', 'last_undegraded': '2024-09-21T06:09:53.699940+0000', 'last_fullsized': '2024-09-21T06:09:53.699940+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.117 INFO:tasks.ceph.ceph_manager.ceph:PG 15.37 is not active+clean 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.706962+0000', 'last_change': '2024-09-21T06:09:53.706962+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.706962+0000', 'last_undegraded': '2024-09-21T06:09:53.706962+0000', 'last_fullsized': '2024-09-21T06:09:53.706962+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:PG 15.36 is not active+clean 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.709253+0000', 'last_change': '2024-09-21T06:09:53.709253+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.709253+0000', 'last_undegraded': '2024-09-21T06:09:53.709253+0000', 'last_fullsized': '2024-09-21T06:09:53.709253+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:PG 15.35 is not active+clean 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.700551+0000', 'last_change': '2024-09-21T06:09:53.700551+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.700551+0000', 'last_undegraded': '2024-09-21T06:09:53.700551+0000', 'last_fullsized': '2024-09-21T06:09:53.700551+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:PG 15.34 is not active+clean 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.707410+0000', 'last_change': '2024-09-21T06:09:53.707410+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.707410+0000', 'last_undegraded': '2024-09-21T06:09:53.707410+0000', 'last_fullsized': '2024-09-21T06:09:53.707410+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:PG 15.32 is not active+clean 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.711924+0000', 'last_change': '2024-09-21T06:09:53.711924+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.711924+0000', 'last_undegraded': '2024-09-21T06:09:53.711924+0000', 'last_fullsized': '2024-09-21T06:09:53.711924+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:PG 15.30 is not active+clean 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.698833+0000', 'last_change': '2024-09-21T06:09:53.698833+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.698833+0000', 'last_undegraded': '2024-09-21T06:09:53.698833+0000', 'last_fullsized': '2024-09-21T06:09:53.698833+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.118 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2d is not active+clean 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.711530+0000', 'last_change': '2024-09-21T06:09:53.711530+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.711530+0000', 'last_undegraded': '2024-09-21T06:09:53.711530+0000', 'last_fullsized': '2024-09-21T06:09:53.711530+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2c is not active+clean 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.707070+0000', 'last_change': '2024-09-21T06:09:53.707070+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.707070+0000', 'last_undegraded': '2024-09-21T06:09:53.707070+0000', 'last_fullsized': '2024-09-21T06:09:53.707070+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2b is not active+clean 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.709781+0000', 'last_change': '2024-09-21T06:09:53.709781+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.709781+0000', 'last_undegraded': '2024-09-21T06:09:53.709781+0000', 'last_fullsized': '2024-09-21T06:09:53.709781+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:PG 15.28 is not active+clean 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.699144+0000', 'last_change': '2024-09-21T06:09:53.699144+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.699144+0000', 'last_undegraded': '2024-09-21T06:09:53.699144+0000', 'last_fullsized': '2024-09-21T06:09:53.699144+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:PG 15.27 is not active+clean 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.708851+0000', 'last_change': '2024-09-21T06:09:53.708851+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.708851+0000', 'last_undegraded': '2024-09-21T06:09:53.708851+0000', 'last_fullsized': '2024-09-21T06:09:53.708851+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:PG 15.25 is not active+clean 2024-09-21T06:10:00.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.699443+0000', 'last_change': '2024-09-21T06:09:53.699443+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.699443+0000', 'last_undegraded': '2024-09-21T06:09:53.699443+0000', 'last_fullsized': '2024-09-21T06:09:53.699443+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:PG 15.24 is not active+clean 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.706817+0000', 'last_change': '2024-09-21T06:09:53.706817+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.706817+0000', 'last_undegraded': '2024-09-21T06:09:53.706817+0000', 'last_fullsized': '2024-09-21T06:09:53.706817+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:PG 15.22 is not active+clean 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.710014+0000', 'last_change': '2024-09-21T06:09:53.710014+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.710014+0000', 'last_undegraded': '2024-09-21T06:09:53.710014+0000', 'last_fullsized': '2024-09-21T06:09:53.710014+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:PG 15.20 is not active+clean 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.702907+0000', 'last_change': '2024-09-21T06:09:53.702907+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.702907+0000', 'last_undegraded': '2024-09-21T06:09:53.702907+0000', 'last_fullsized': '2024-09-21T06:09:53.702907+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1e is not active+clean 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.711098+0000', 'last_change': '2024-09-21T06:09:53.711098+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.711098+0000', 'last_undegraded': '2024-09-21T06:09:53.711098+0000', 'last_fullsized': '2024-09-21T06:09:53.711098+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1c is not active+clean 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.700587+0000', 'last_change': '2024-09-21T06:09:53.700587+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.700587+0000', 'last_undegraded': '2024-09-21T06:09:53.700587+0000', 'last_fullsized': '2024-09-21T06:09:53.700587+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:10:00.120 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1d is not active+clean 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.706004+0000', 'last_change': '2024-09-21T06:09:53.706004+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.706004+0000', 'last_undegraded': '2024-09-21T06:09:53.706004+0000', 'last_fullsized': '2024-09-21T06:09:53.706004+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.705856+0000', 'last_change': '2024-09-21T06:09:53.705856+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.705856+0000', 'last_undegraded': '2024-09-21T06:09:53.705856+0000', 'last_fullsized': '2024-09-21T06:09:53.705856+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1b is not active+clean 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.699004+0000', 'last_change': '2024-09-21T06:09:53.699004+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.699004+0000', 'last_undegraded': '2024-09-21T06:09:53.699004+0000', 'last_fullsized': '2024-09-21T06:09:53.699004+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:PG 15.19 is not active+clean 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.705912+0000', 'last_change': '2024-09-21T06:09:53.705912+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.705912+0000', 'last_undegraded': '2024-09-21T06:09:53.705912+0000', 'last_fullsized': '2024-09-21T06:09:53.705912+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:PG 15.17 is not active+clean 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.706878+0000', 'last_change': '2024-09-21T06:09:53.706878+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.706878+0000', 'last_undegraded': '2024-09-21T06:09:53.706878+0000', 'last_fullsized': '2024-09-21T06:09:53.706878+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:PG 15.14 is not active+clean 2024-09-21T06:10:00.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.707985+0000', 'last_change': '2024-09-21T06:09:53.707985+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.707985+0000', 'last_undegraded': '2024-09-21T06:09:53.707985+0000', 'last_fullsized': '2024-09-21T06:09:53.707985+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:PG 15.15 is not active+clean 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.698657+0000', 'last_change': '2024-09-21T06:09:53.698657+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.698657+0000', 'last_undegraded': '2024-09-21T06:09:53.698657+0000', 'last_fullsized': '2024-09-21T06:09:53.698657+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:PG 15.13 is not active+clean 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.704146+0000', 'last_change': '2024-09-21T06:09:53.704146+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.704146+0000', 'last_undegraded': '2024-09-21T06:09:53.704146+0000', 'last_fullsized': '2024-09-21T06:09:53.704146+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:PG 15.10 is not active+clean 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.705289+0000', 'last_change': '2024-09-21T06:09:53.705289+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.705289+0000', 'last_undegraded': '2024-09-21T06:09:53.705289+0000', 'last_fullsized': '2024-09-21T06:09:53.705289+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:PG 15.11 is not active+clean 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.709797+0000', 'last_change': '2024-09-21T06:09:53.709797+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.709797+0000', 'last_undegraded': '2024-09-21T06:09:53.709797+0000', 'last_fullsized': '2024-09-21T06:09:53.709797+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:PG 15.f is not active+clean 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.707574+0000', 'last_change': '2024-09-21T06:09:53.707574+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.707574+0000', 'last_undegraded': '2024-09-21T06:09:53.707574+0000', 'last_fullsized': '2024-09-21T06:09:53.707574+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.122 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.704756+0000', 'last_change': '2024-09-21T06:09:53.704756+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.704756+0000', 'last_undegraded': '2024-09-21T06:09:53.704756+0000', 'last_fullsized': '2024-09-21T06:09:53.704756+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 15.d is not active+clean 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.698312+0000', 'last_change': '2024-09-21T06:09:53.698312+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.698312+0000', 'last_undegraded': '2024-09-21T06:09:53.698312+0000', 'last_fullsized': '2024-09-21T06:09:53.698312+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 15.a is not active+clean 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.705326+0000', 'last_change': '2024-09-21T06:09:53.705326+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.705326+0000', 'last_undegraded': '2024-09-21T06:09:53.705326+0000', 'last_fullsized': '2024-09-21T06:09:53.705326+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 15.b is not active+clean 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.709325+0000', 'last_change': '2024-09-21T06:09:53.709325+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.709325+0000', 'last_undegraded': '2024-09-21T06:09:53.709325+0000', 'last_fullsized': '2024-09-21T06:09:53.709325+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 15.8 is not active+clean 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.704258+0000', 'last_change': '2024-09-21T06:09:53.704258+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.704258+0000', 'last_undegraded': '2024-09-21T06:09:53.704258+0000', 'last_fullsized': '2024-09-21T06:09:53.704258+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 15.9 is not active+clean 2024-09-21T06:10:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.708346+0000', 'last_change': '2024-09-21T06:09:53.708346+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.708346+0000', 'last_undegraded': '2024-09-21T06:09:53.708346+0000', 'last_fullsized': '2024-09-21T06:09:53.708346+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 15.7 is not active+clean 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.701583+0000', 'last_change': '2024-09-21T06:09:53.701583+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.701583+0000', 'last_undegraded': '2024-09-21T06:09:53.701583+0000', 'last_fullsized': '2024-09-21T06:09:53.701583+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 15.4 is not active+clean 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.701277+0000', 'last_change': '2024-09-21T06:09:53.701277+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.701277+0000', 'last_undegraded': '2024-09-21T06:09:53.701277+0000', 'last_fullsized': '2024-09-21T06:09:53.701277+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 15.5 is not active+clean 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.707167+0000', 'last_change': '2024-09-21T06:09:53.707167+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.707167+0000', 'last_undegraded': '2024-09-21T06:09:53.707167+0000', 'last_fullsized': '2024-09-21T06:09:53.707167+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2 is not active+clean 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.707870+0000', 'last_change': '2024-09-21T06:09:53.707870+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.707870+0000', 'last_undegraded': '2024-09-21T06:09:53.707870+0000', 'last_fullsized': '2024-09-21T06:09:53.707870+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3 is not active+clean 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.706190+0000', 'last_change': '2024-09-21T06:09:53.706190+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.706190+0000', 'last_undegraded': '2024-09-21T06:09:53.706190+0000', 'last_fullsized': '2024-09-21T06:09:53.706190+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 15.0 is not active+clean 2024-09-21T06:10:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.704968+0000', 'last_change': '2024-09-21T06:09:53.704968+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.704968+0000', 'last_undegraded': '2024-09-21T06:09:53.704968+0000', 'last_fullsized': '2024-09-21T06:09:53.704968+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.125 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1 is not active+clean 2024-09-21T06:10:00.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.706402+0000', 'last_change': '2024-09-21T06:09:53.706402+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.706402+0000', 'last_undegraded': '2024-09-21T06:09:53.706402+0000', 'last_fullsized': '2024-09-21T06:09:53.706402+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:10:00.125 INFO:tasks.ceph.ceph_manager.ceph:PG 15.e is not active+clean 2024-09-21T06:10:00.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 116, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:09:53.708792+0000', 'last_change': '2024-09-21T06:09:53.708792+0000', 'last_active': '2024-09-21T06:09:53.690709+0000', 'last_peered': '2024-09-21T06:09:53.690709+0000', 'last_clean': '2024-09-21T06:09:53.690709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:09:53.708792+0000', 'last_undegraded': '2024-09-21T06:09:53.708792+0000', 'last_fullsized': '2024-09-21T06:09:53.708792+0000', 'mapping_epoch': 116, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 116, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'last_clean_scrub_stamp': '2024-09-21T06:09:53.690709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:10:00.125 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T06:10:00.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 -- 172.21.15.118:0/1885532620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0b3ae0 msgr2=0x7fbe4c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 --2- 172.21.15.118:0/1885532620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0b3ae0 0x7fbe4c0d0610 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009820 tx=0x7fbe4002a470 comp rx=0 tx=0).stop 2024-09-21T06:10:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 -- 172.21.15.118:0/1885532620 shutdown_connections 2024-09-21T06:10:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 --2- 172.21.15.118:0/1885532620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b42f0 0x7fbe4c0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 --2- 172.21.15.118:0/1885532620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0b3ae0 0x7fbe4c0d0610 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 -- 172.21.15.118:0/1885532620 >> 172.21.15.118:0/1885532620 conn(0x7fbe4c0d4bc0 msgr2=0x7fbe4c0d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 -- 172.21.15.118:0/1885532620 shutdown_connections 2024-09-21T06:10:00.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.373+0000 7fbe52400640 1 -- 172.21.15.118:0/1885532620 wait complete. 2024-09-21T06:10:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.375+0000 7fbe52400640 1 Processor -- start 2024-09-21T06:10:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.375+0000 7fbe52400640 1 -- start start 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe52400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c0b3ae0 0x7fbe4c1e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe52400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b42f0 0x7fbe4c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe52400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0d1240 0x7fbe4c0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe52400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b4c40 con 0x7fbe4c0d1240 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe52400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b58d0 con 0x7fbe4c0b3ae0 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe52400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b4dc0 con 0x7fbe4c0b42f0 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0d1240 0x7fbe4c0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0d1240 0x7fbe4c0b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53910/0 (socket says 172.21.15.118:53910) 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 -- 172.21.15.118:0/1095786438 learned_addr learned my addr 172.21.15.118:0/1095786438 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51000640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c0b3ae0 0x7fbe4c1e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe4be00640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b42f0 0x7fbe4c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 -- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b42f0 msgr2=0x7fbe4c1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b42f0 0x7fbe4c1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 -- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c0b3ae0 msgr2=0x7fbe4c1e2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c0b3ae0 0x7fbe4c1e2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.377+0000 7fbe51a00640 1 -- 172.21.15.118:0/1095786438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c1f6980 con 0x7fbe4c0d1240 2024-09-21T06:10:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.378+0000 7fbe51a00640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0d1240 0x7fbe4c0b79f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400ea10 tx=0x7fbe4400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.378+0000 7fbe48c00640 1 -- 172.21.15.118:0/1095786438 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400cde0 con 0x7fbe4c0d1240 2024-09-21T06:10:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.378+0000 7fbe48c00640 1 -- 172.21.15.118:0/1095786438 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe44004c10 con 0x7fbe4c0d1240 2024-09-21T06:10:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.378+0000 7fbe48c00640 1 -- 172.21.15.118:0/1095786438 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44005020 con 0x7fbe4c0d1240 2024-09-21T06:10:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.378+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4c1e37c0 con 0x7fbe4c0d1240 2024-09-21T06:10:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.378+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4c1e3320 con 0x7fbe4c0d1240 2024-09-21T06:10:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.379+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4c1f66f0 con 0x7fbe4c0d1240 2024-09-21T06:10:00.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.381+0000 7fbe48c00640 1 -- 172.21.15.118:0/1095786438 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe440051c0 con 0x7fbe4c0d1240 2024-09-21T06:10:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.381+0000 7fbe48c00640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe2c078b90 0x7fbe2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.382+0000 7fbe48c00640 1 -- 172.21.15.118:0/1095786438 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fbe4409bab0 con 0x7fbe4c0d1240 2024-09-21T06:10:00.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.382+0000 7fbe51000640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe2c078b90 0x7fbe2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.383+0000 7fbe51000640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe2c078b90 0x7fbe2c07b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbe40034000 tx=0x7fbe40004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:00.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.386+0000 7fbe48c00640 1 -- 172.21.15.118:0/1095786438 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe44063f80 con 0x7fbe4c0d1240 2024-09-21T06:10:00.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.640+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbe4c1e35b0 con 0x7fbe4c0d1240 2024-09-21T06:10:00.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.641+0000 7fbe48c00640 1 -- 172.21.15.118:0/1095786438 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1554 (secure 0 0 0) 0x7fbe44063880 con 0x7fbe4c0d1240 2024-09-21T06:10:00.642 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:00.642 INFO:teuthology.orchestra.run.smithi118.stdout:{"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":385,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":118,"num_osds":8,"num_up_osds":8,"osd_up_since":1726898623,"num_in_osds":8,"osd_in_since":1726898620,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":50},{"state_name":"creating+peering","count":47}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590950,"bytes_used":6260468,"bytes_avail":1593739532,"bytes_total":1600000000,"inactive_pgs_ratio":0.48453608155250549,"write_bytes_sec":174,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":6597}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-21T06:09:42.548031+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T06:10:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe2c078b90 msgr2=0x7fbe2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe2c078b90 0x7fbe2c07b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbe40034000 tx=0x7fbe40004730 comp rx=0 tx=0).stop 2024-09-21T06:10:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0d1240 msgr2=0x7fbe4c0b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0d1240 0x7fbe4c0b79f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400ea10 tx=0x7fbe4400eed0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 shutdown_connections 2024-09-21T06:10:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe4c0d1240 0x7fbe4c0b79f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe2c078b90 0x7fbe2c07b0a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe4c0b42f0 0x7fbe4c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 --2- 172.21.15.118:0/1095786438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe4c0b3ae0 0x7fbe4c1e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.643+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 >> 172.21.15.118:0/1095786438 conn(0x7fbe4c0d4bc0 msgr2=0x7fbe4c0cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.644+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 shutdown_connections 2024-09-21T06:10:00.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.644+0000 7fbe52400640 1 -- 172.21.15.118:0/1095786438 wait complete. 2024-09-21T06:10:00.666 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T06:10:00.666 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 -- 172.21.15.118:0/864530753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e80b5bb0 msgr2=0x7f16e80b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 --2- 172.21.15.118:0/864530753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e80b5bb0 0x7f16e80b5fc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f16e0005fd0 tx=0x7f16e002a820 comp rx=0 tx=0).stop 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 -- 172.21.15.118:0/864530753 shutdown_connections 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 --2- 172.21.15.118:0/864530753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e80b5bb0 0x7f16e80b5fc0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 --2- 172.21.15.118:0/864530753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cfe30 0x7f16e80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 -- 172.21.15.118:0/864530753 >> 172.21.15.118:0/864530753 conn(0x7f16e806d6e0 msgr2=0x7f16e80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 -- 172.21.15.118:0/864530753 shutdown_connections 2024-09-21T06:10:00.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.886+0000 7f16ee800640 1 -- 172.21.15.118:0/864530753 wait complete. 2024-09-21T06:10:00.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.888+0000 7f16ee800640 1 Processor -- start 2024-09-21T06:10:00.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.888+0000 7f16ee800640 1 -- start start 2024-09-21T06:10:00.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ee800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e8073fa0 0x7f16e81f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ee800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e80b5bb0 0x7f16e8154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ee800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cfe30 0x7f16e8156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ee800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16e815d9c0 con 0x7f16e8073fa0 2024-09-21T06:10:00.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ee800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16e815d840 con 0x7f16e80b5bb0 2024-09-21T06:10:00.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ee800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16e815db40 con 0x7f16e80cfe30 2024-09-21T06:10:00.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e8073fa0 0x7f16e81f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e8073fa0 0x7f16e81f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53918/0 (socket says 172.21.15.118:53918) 2024-09-21T06:10:00.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.890+0000 7f16ed400640 1 -- 172.21.15.118:0/3413651140 learned_addr learned my addr 172.21.15.118:0/3413651140 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:00.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ede00640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cfe30 0x7f16e8156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16eca00640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e80b5bb0 0x7f16e8154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ed400640 1 -- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cfe30 msgr2=0x7f16e8156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ed400640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cfe30 0x7f16e8156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ed400640 1 -- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e80b5bb0 msgr2=0x7f16e8154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ed400640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e80b5bb0 0x7f16e8154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ed400640 1 -- 172.21.15.118:0/3413651140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e8154b60 con 0x7f16e8073fa0 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16eca00640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e80b5bb0 0x7f16e8154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ed400640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e8073fa0 0x7f16e81f60a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c3c0 tx=0x7f16dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16e5600640 1 -- 172.21.15.118:0/3413651140 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc017070 con 0x7f16e8073fa0 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16e5600640 1 -- 172.21.15.118:0/3413651140 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16dc0035f0 con 0x7f16e8073fa0 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16e5600640 1 -- 172.21.15.118:0/3413651140 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc003a80 con 0x7f16e8073fa0 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e81574a0 con 0x7f16e8073fa0 2024-09-21T06:10:00.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.891+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e8155350 con 0x7f16e8073fa0 2024-09-21T06:10:00.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.892+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e8076760 con 0x7f16e8073fa0 2024-09-21T06:10:00.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.893+0000 7f16e5600640 1 -- 172.21.15.118:0/3413651140 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16dc01a070 con 0x7f16e8073fa0 2024-09-21T06:10:00.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.894+0000 7f16e5600640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16c8078b90 0x7f16c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:00.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.895+0000 7f16e5600640 1 -- 172.21.15.118:0/3413651140 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f16dc09a0c0 con 0x7f16e8073fa0 2024-09-21T06:10:00.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.895+0000 7f16eca00640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16c8078b90 0x7f16c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:00.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.896+0000 7f16eca00640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16c8078b90 0x7f16c807b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f16e8159cb0 tx=0x7f16d4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:00.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:00.899+0000 7f16e5600640 1 -- 172.21.15.118:0/3413651140 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f16e80b6500 con 0x7f16e8073fa0 2024-09-21T06:10:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.080+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16e80cd740 con 0x7f16c8078b90 2024-09-21T06:10:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.085+0000 7f16e5600640 1 -- 172.21.15.118:0/3413651140 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7f16e80cd740 con 0x7f16c8078b90 2024-09-21T06:10:01.089 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:01.090 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:10:01.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16c8078b90 msgr2=0x7f16c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:01.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16c8078b90 0x7f16c807b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f16e8159cb0 tx=0x7f16d4005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e8073fa0 msgr2=0x7f16e81f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e8073fa0 0x7f16e81f60a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c3c0 tx=0x7f16dc00c880 comp rx=0 tx=0).stop 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 shutdown_connections 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16c8078b90 0x7f16c807b0a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cfe30 0x7f16e8156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e80b5bb0 0x7f16e8154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 --2- 172.21.15.118:0/3413651140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e8073fa0 0x7f16e81f60a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 >> 172.21.15.118:0/3413651140 conn(0x7f16e806d6e0 msgr2=0x7f16e80b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 shutdown_connections 2024-09-21T06:10:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:01.089+0000 7f16ee800640 1 -- 172.21.15.118:0/3413651140 wait complete. 2024-09-21T06:10:01.113 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-09-21T06:10:00.552421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6245,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556254,"statfs":{"total":1600000000,"available":1593605012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.855153"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715980+0000","last_change":"2024-09-21T06:09:54.715201+0000","last_active":"2024-09-21T06:09:55.715980+0000","last_peered":"2024-09-21T06:09:55.715980+0000","last_clean":"2024-09-21T06:09:55.715980+0000","last_became_active":"2024-09-21T06:09:54.714922+0000","last_became_peered":"2024-09-21T06:09:54.714922+0000","last_unstale":"2024-09-21T06:09:55.715980+0000","last_undegraded":"2024-09-21T06:09:55.715980+0000","last_fullsized":"2024-09-21T06:09:55.715980+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:43.006178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715878+0000","last_change":"2024-09-21T06:09:54.736623+0000","last_active":"2024-09-21T06:09:55.715878+0000","last_peered":"2024-09-21T06:09:55.715878+0000","last_clean":"2024-09-21T06:09:55.715878+0000","last_became_active":"2024-09-21T06:09:54.730791+0000","last_became_peered":"2024-09-21T06:09:54.730791+0000","last_unstale":"2024-09-21T06:09:55.715878+0000","last_undegraded":"2024-09-21T06:09:55.715878+0000","last_fullsized":"2024-09-21T06:09:55.715878+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:47.676256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715681+0000","last_change":"2024-09-21T06:09:54.715189+0000","last_active":"2024-09-21T06:09:55.715681+0000","last_peered":"2024-09-21T06:09:55.715681+0000","last_clean":"2024-09-21T06:09:55.715681+0000","last_became_active":"2024-09-21T06:09:54.714882+0000","last_became_peered":"2024-09-21T06:09:54.714882+0000","last_unstale":"2024-09-21T06:09:55.715681+0000","last_undegraded":"2024-09-21T06:09:55.715681+0000","last_fullsized":"2024-09-21T06:09:55.715681+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:24.940809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714420+0000","last_change":"2024-09-21T06:09:54.724168+0000","last_active":"2024-09-21T06:09:55.714420+0000","last_peered":"2024-09-21T06:09:55.714420+0000","last_clean":"2024-09-21T06:09:55.714420+0000","last_became_active":"2024-09-21T06:09:54.723648+0000","last_became_peered":"2024-09-21T06:09:54.723648+0000","last_unstale":"2024-09-21T06:09:55.714420+0000","last_undegraded":"2024-09-21T06:09:55.714420+0000","last_fullsized":"2024-09-21T06:09:55.714420+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:44.068808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730240+0000","last_change":"2024-09-21T06:09:54.732957+0000","last_active":"2024-09-21T06:09:55.730240+0000","last_peered":"2024-09-21T06:09:55.730240+0000","last_clean":"2024-09-21T06:09:55.730240+0000","last_became_active":"2024-09-21T06:09:54.732400+0000","last_became_peered":"2024-09-21T06:09:54.732400+0000","last_unstale":"2024-09-21T06:09:55.730240+0000","last_undegraded":"2024-09-21T06:09:55.730240+0000","last_fullsized":"2024-09-21T06:09:55.730240+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:43.117768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731371+0000","last_change":"2024-09-21T06:09:54.723608+0000","last_active":"2024-09-21T06:09:55.731371+0000","last_peered":"2024-09-21T06:09:55.731371+0000","last_clean":"2024-09-21T06:09:55.731371+0000","last_became_active":"2024-09-21T06:09:54.723354+0000","last_became_peered":"2024-09-21T06:09:54.723354+0000","last_unstale":"2024-09-21T06:09:55.731371+0000","last_undegraded":"2024-09-21T06:09:55.731371+0000","last_fullsized":"2024-09-21T06:09:55.731371+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:39.477347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731144+0000","last_change":"2024-09-21T06:09:54.721811+0000","last_active":"2024-09-21T06:09:55.731144+0000","last_peered":"2024-09-21T06:09:55.731144+0000","last_clean":"2024-09-21T06:09:55.731144+0000","last_became_active":"2024-09-21T06:09:54.721550+0000","last_became_peered":"2024-09-21T06:09:54.721550+0000","last_unstale":"2024-09-21T06:09:55.731144+0000","last_undegraded":"2024-09-21T06:09:55.731144+0000","last_fullsized":"2024-09-21T06:09:55.731144+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:06.539133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716771+0000","last_change":"2024-09-21T06:09:54.733110+0000","last_active":"2024-09-21T06:09:55.716771+0000","last_peered":"2024-09-21T06:09:55.716771+0000","last_clean":"2024-09-21T06:09:55.716771+0000","last_became_active":"2024-09-21T06:09:54.732596+0000","last_became_peered":"2024-09-21T06:09:54.732596+0000","last_unstale":"2024-09-21T06:09:55.716771+0000","last_undegraded":"2024-09-21T06:09:55.716771+0000","last_fullsized":"2024-09-21T06:09:55.716771+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:07.159031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175600+0000","last_change":"2024-09-21T06:09:54.722422+0000","last_active":"2024-09-21T06:09:56.175600+0000","last_peered":"2024-09-21T06:09:56.175600+0000","last_clean":"2024-09-21T06:09:56.175600+0000","last_became_active":"2024-09-21T06:09:54.722033+0000","last_became_peered":"2024-09-21T06:09:54.722033+0000","last_unstale":"2024-09-21T06:09:56.175600+0000","last_undegraded":"2024-09-21T06:09:56.175600+0000","last_fullsized":"2024-09-21T06:09:56.175600+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:34.111391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730506+0000","last_change":"2024-09-21T06:09:54.728015+0000","last_active":"2024-09-21T06:09:55.730506+0000","last_peered":"2024-09-21T06:09:55.730506+0000","last_clean":"2024-09-21T06:09:55.730506+0000","last_became_active":"2024-09-21T06:09:54.727644+0000","last_became_peered":"2024-09-21T06:09:54.727644+0000","last_unstale":"2024-09-21T06:09:55.730506+0000","last_undegraded":"2024-09-21T06:09:55.730506+0000","last_fullsized":"2024-09-21T06:09:55.730506+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:39.631736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731619+0000","last_change":"2024-09-21T06:09:54.731683+0000","last_active":"2024-09-21T06:09:55.731619+0000","last_peered":"2024-09-21T06:09:55.731619+0000","last_clean":"2024-09-21T06:09:55.731619+0000","last_became_active":"2024-09-21T06:09:54.727897+0000","last_became_peered":"2024-09-21T06:09:54.727897+0000","last_unstale":"2024-09-21T06:09:55.731619+0000","last_undegraded":"2024-09-21T06:09:55.731619+0000","last_fullsized":"2024-09-21T06:09:55.731619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:22.078556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176015+0000","last_change":"2024-09-21T06:09:54.723350+0000","last_active":"2024-09-21T06:09:56.176015+0000","last_peered":"2024-09-21T06:09:56.176015+0000","last_clean":"2024-09-21T06:09:56.176015+0000","last_became_active":"2024-09-21T06:09:54.722933+0000","last_became_peered":"2024-09-21T06:09:54.722933+0000","last_unstale":"2024-09-21T06:09:56.176015+0000","last_undegraded":"2024-09-21T06:09:56.176015+0000","last_fullsized":"2024-09-21T06:09:56.176015+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:35.363520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714529+0000","last_change":"2024-09-21T06:09:54.727226+0000","last_active":"2024-09-21T06:09:55.714529+0000","last_peered":"2024-09-21T06:09:55.714529+0000","last_clean":"2024-09-21T06:09:55.714529+0000","last_became_active":"2024-09-21T06:09:54.726587+0000","last_became_peered":"2024-09-21T06:09:54.726587+0000","last_unstale":"2024-09-21T06:09:55.714529+0000","last_undegraded":"2024-09-21T06:09:55.714529+0000","last_fullsized":"2024-09-21T06:09:55.714529+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:22.790060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734202+0000","last_change":"2024-09-21T06:09:54.728182+0000","last_active":"2024-09-21T06:09:55.734202+0000","last_peered":"2024-09-21T06:09:55.734202+0000","last_clean":"2024-09-21T06:09:55.734202+0000","last_became_active":"2024-09-21T06:09:54.727890+0000","last_became_peered":"2024-09-21T06:09:54.727890+0000","last_unstale":"2024-09-21T06:09:55.734202+0000","last_undegraded":"2024-09-21T06:09:55.734202+0000","last_fullsized":"2024-09-21T06:09:55.734202+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:23.427292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714594+0000","last_change":"2024-09-21T06:09:54.715833+0000","last_active":"2024-09-21T06:09:55.714594+0000","last_peered":"2024-09-21T06:09:55.714594+0000","last_clean":"2024-09-21T06:09:55.714594+0000","last_became_active":"2024-09-21T06:09:54.715403+0000","last_became_peered":"2024-09-21T06:09:54.715403+0000","last_unstale":"2024-09-21T06:09:55.714594+0000","last_undegraded":"2024-09-21T06:09:55.714594+0000","last_fullsized":"2024-09-21T06:09:55.714594+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:19.811337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731863+0000","last_change":"2024-09-21T06:09:54.733519+0000","last_active":"2024-09-21T06:09:55.731863+0000","last_peered":"2024-09-21T06:09:55.731863+0000","last_clean":"2024-09-21T06:09:55.731863+0000","last_became_active":"2024-09-21T06:09:54.732828+0000","last_became_peered":"2024-09-21T06:09:54.732828+0000","last_unstale":"2024-09-21T06:09:55.731863+0000","last_undegraded":"2024-09-21T06:09:55.731863+0000","last_fullsized":"2024-09-21T06:09:55.731863+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:03.790986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716116+0000","last_change":"2024-09-21T06:09:54.736891+0000","last_active":"2024-09-21T06:09:55.716116+0000","last_peered":"2024-09-21T06:09:55.716116+0000","last_clean":"2024-09-21T06:09:55.716116+0000","last_became_active":"2024-09-21T06:09:54.731138+0000","last_became_peered":"2024-09-21T06:09:54.731138+0000","last_unstale":"2024-09-21T06:09:55.716116+0000","last_undegraded":"2024-09-21T06:09:55.716116+0000","last_fullsized":"2024-09-21T06:09:55.716116+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.981214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714766+0000","last_change":"2024-09-21T06:09:54.729128+0000","last_active":"2024-09-21T06:09:55.714766+0000","last_peered":"2024-09-21T06:09:55.714766+0000","last_clean":"2024-09-21T06:09:55.714766+0000","last_became_active":"2024-09-21T06:09:54.726952+0000","last_became_peered":"2024-09-21T06:09:54.726952+0000","last_unstale":"2024-09-21T06:09:55.714766+0000","last_undegraded":"2024-09-21T06:09:55.714766+0000","last_fullsized":"2024-09-21T06:09:55.714766+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:41.995126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734423+0000","last_change":"2024-09-21T06:09:54.724894+0000","last_active":"2024-09-21T06:09:55.734423+0000","last_peered":"2024-09-21T06:09:55.734423+0000","last_clean":"2024-09-21T06:09:55.734423+0000","last_became_active":"2024-09-21T06:09:54.724365+0000","last_became_peered":"2024-09-21T06:09:54.724365+0000","last_unstale":"2024-09-21T06:09:55.734423+0000","last_undegraded":"2024-09-21T06:09:55.734423+0000","last_fullsized":"2024-09-21T06:09:55.734423+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:00.725493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175894+0000","last_change":"2024-09-21T06:09:54.722323+0000","last_active":"2024-09-21T06:09:56.175894+0000","last_peered":"2024-09-21T06:09:56.175894+0000","last_clean":"2024-09-21T06:09:56.175894+0000","last_became_active":"2024-09-21T06:09:54.722066+0000","last_became_peered":"2024-09-21T06:09:54.722066+0000","last_unstale":"2024-09-21T06:09:56.175894+0000","last_undegraded":"2024-09-21T06:09:56.175894+0000","last_fullsized":"2024-09-21T06:09:56.175894+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:41.868564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734361+0000","last_change":"2024-09-21T06:09:54.731594+0000","last_active":"2024-09-21T06:09:55.734361+0000","last_peered":"2024-09-21T06:09:55.734361+0000","last_clean":"2024-09-21T06:09:55.734361+0000","last_became_active":"2024-09-21T06:09:54.731075+0000","last_became_peered":"2024-09-21T06:09:54.731075+0000","last_unstale":"2024-09-21T06:09:55.734361+0000","last_undegraded":"2024-09-21T06:09:55.734361+0000","last_fullsized":"2024-09-21T06:09:55.734361+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.973624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716558+0000","last_change":"2024-09-21T06:09:54.731406+0000","last_active":"2024-09-21T06:09:55.716558+0000","last_peered":"2024-09-21T06:09:55.716558+0000","last_clean":"2024-09-21T06:09:55.716558+0000","last_became_active":"2024-09-21T06:09:54.729828+0000","last_became_peered":"2024-09-21T06:09:54.729828+0000","last_unstale":"2024-09-21T06:09:55.716558+0000","last_undegraded":"2024-09-21T06:09:55.716558+0000","last_fullsized":"2024-09-21T06:09:55.716558+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:12:19.205913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717022+0000","last_change":"2024-09-21T06:09:54.732838+0000","last_active":"2024-09-21T06:09:55.717022+0000","last_peered":"2024-09-21T06:09:55.717022+0000","last_clean":"2024-09-21T06:09:55.717022+0000","last_became_active":"2024-09-21T06:09:54.731982+0000","last_became_peered":"2024-09-21T06:09:54.731982+0000","last_unstale":"2024-09-21T06:09:55.717022+0000","last_undegraded":"2024-09-21T06:09:55.717022+0000","last_fullsized":"2024-09-21T06:09:55.717022+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:51.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730411+0000","last_change":"2024-09-21T06:09:54.726673+0000","last_active":"2024-09-21T06:09:55.730411+0000","last_peered":"2024-09-21T06:09:55.730411+0000","last_clean":"2024-09-21T06:09:55.730411+0000","last_became_active":"2024-09-21T06:09:54.725717+0000","last_became_peered":"2024-09-21T06:09:54.725717+0000","last_unstale":"2024-09-21T06:09:55.730411+0000","last_undegraded":"2024-09-21T06:09:55.730411+0000","last_fullsized":"2024-09-21T06:09:55.730411+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:28.774369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730850+0000","last_change":"2024-09-21T06:09:54.732670+0000","last_active":"2024-09-21T06:09:55.730850+0000","last_peered":"2024-09-21T06:09:55.730850+0000","last_clean":"2024-09-21T06:09:55.730850+0000","last_became_active":"2024-09-21T06:09:54.732010+0000","last_became_peered":"2024-09-21T06:09:54.732010+0000","last_unstale":"2024-09-21T06:09:55.730850+0000","last_undegraded":"2024-09-21T06:09:55.730850+0000","last_fullsized":"2024-09-21T06:09:55.730850+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.796356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717067+0000","last_change":"2024-09-21T06:09:54.724653+0000","last_active":"2024-09-21T06:09:55.717067+0000","last_peered":"2024-09-21T06:09:55.717067+0000","last_clean":"2024-09-21T06:09:55.717067+0000","last_became_active":"2024-09-21T06:09:54.724078+0000","last_became_peered":"2024-09-21T06:09:54.724078+0000","last_unstale":"2024-09-21T06:09:55.717067+0000","last_undegraded":"2024-09-21T06:09:55.717067+0000","last_fullsized":"2024-09-21T06:09:55.717067+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:27.464901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731393+0000","last_change":"2024-09-21T06:09:54.727550+0000","last_active":"2024-09-21T06:09:55.731393+0000","last_peered":"2024-09-21T06:09:55.731393+0000","last_clean":"2024-09-21T06:09:55.731393+0000","last_became_active":"2024-09-21T06:09:54.726379+0000","last_became_peered":"2024-09-21T06:09:54.726379+0000","last_unstale":"2024-09-21T06:09:55.731393+0000","last_undegraded":"2024-09-21T06:09:55.731393+0000","last_fullsized":"2024-09-21T06:09:55.731393+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.026478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730863+0000","last_change":"2024-09-21T06:09:54.728670+0000","last_active":"2024-09-21T06:09:55.730863+0000","last_peered":"2024-09-21T06:09:55.730863+0000","last_clean":"2024-09-21T06:09:55.730863+0000","last_became_active":"2024-09-21T06:09:54.728041+0000","last_became_peered":"2024-09-21T06:09:54.728041+0000","last_unstale":"2024-09-21T06:09:55.730863+0000","last_undegraded":"2024-09-21T06:09:55.730863+0000","last_fullsized":"2024-09-21T06:09:55.730863+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:22.315313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716647+0000","last_change":"2024-09-21T06:09:54.722797+0000","last_active":"2024-09-21T06:09:55.716647+0000","last_peered":"2024-09-21T06:09:55.716647+0000","last_clean":"2024-09-21T06:09:55.716647+0000","last_became_active":"2024-09-21T06:09:54.722520+0000","last_became_peered":"2024-09-21T06:09:54.722520+0000","last_unstale":"2024-09-21T06:09:55.716647+0000","last_undegraded":"2024-09-21T06:09:55.716647+0000","last_fullsized":"2024-09-21T06:09:55.716647+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:59.456347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734741+0000","last_change":"2024-09-21T06:09:54.724044+0000","last_active":"2024-09-21T06:09:55.734741+0000","last_peered":"2024-09-21T06:09:55.734741+0000","last_clean":"2024-09-21T06:09:55.734741+0000","last_became_active":"2024-09-21T06:09:54.723721+0000","last_became_peered":"2024-09-21T06:09:54.723721+0000","last_unstale":"2024-09-21T06:09:55.734741+0000","last_undegraded":"2024-09-21T06:09:55.734741+0000","last_fullsized":"2024-09-21T06:09:55.734741+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:59.714119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714355+0000","last_change":"2024-09-21T06:09:54.728270+0000","last_active":"2024-09-21T06:09:55.714355+0000","last_peered":"2024-09-21T06:09:55.714355+0000","last_clean":"2024-09-21T06:09:55.714355+0000","last_became_active":"2024-09-21T06:09:54.727623+0000","last_became_peered":"2024-09-21T06:09:54.727623+0000","last_unstale":"2024-09-21T06:09:55.714355+0000","last_undegraded":"2024-09-21T06:09:55.714355+0000","last_fullsized":"2024-09-21T06:09:55.714355+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.958945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715843+0000","last_change":"2024-09-21T06:09:54.731705+0000","last_active":"2024-09-21T06:09:55.715843+0000","last_peered":"2024-09-21T06:09:55.715843+0000","last_clean":"2024-09-21T06:09:55.715843+0000","last_became_active":"2024-09-21T06:09:54.731362+0000","last_became_peered":"2024-09-21T06:09:54.731362+0000","last_unstale":"2024-09-21T06:09:55.715843+0000","last_undegraded":"2024-09-21T06:09:55.715843+0000","last_fullsized":"2024-09-21T06:09:55.715843+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:54.473387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734695+0000","last_change":"2024-09-21T06:09:54.721916+0000","last_active":"2024-09-21T06:09:55.734695+0000","last_peered":"2024-09-21T06:09:55.734695+0000","last_clean":"2024-09-21T06:09:55.734695+0000","last_became_active":"2024-09-21T06:09:54.721326+0000","last_became_peered":"2024-09-21T06:09:54.721326+0000","last_unstale":"2024-09-21T06:09:55.734695+0000","last_undegraded":"2024-09-21T06:09:55.734695+0000","last_fullsized":"2024-09-21T06:09:55.734695+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:48.523433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"117'4","reported_seq":19,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717468+0000","last_change":"2024-09-21T06:09:53.708840+0000","last_active":"2024-09-21T06:09:55.717468+0000","last_peered":"2024-09-21T06:09:55.717468+0000","last_clean":"2024-09-21T06:09:55.717468+0000","last_became_active":"2024-09-21T06:09:53.708196+0000","last_became_peered":"2024-09-21T06:09:53.708196+0000","last_unstale":"2024-09-21T06:09:55.717468+0000","last_undegraded":"2024-09-21T06:09:55.717468+0000","last_fullsized":"2024-09-21T06:09:55.717468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:30.651982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714991+0000","last_change":"2024-09-21T06:09:54.721812+0000","last_active":"2024-09-21T06:09:55.714991+0000","last_peered":"2024-09-21T06:09:55.714991+0000","last_clean":"2024-09-21T06:09:55.714991+0000","last_became_active":"2024-09-21T06:09:54.721537+0000","last_became_peered":"2024-09-21T06:09:54.721537+0000","last_unstale":"2024-09-21T06:09:55.714991+0000","last_undegraded":"2024-09-21T06:09:55.714991+0000","last_fullsized":"2024-09-21T06:09:55.714991+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:56.349454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730594+0000","last_change":"2024-09-21T06:09:53.709117+0000","last_active":"2024-09-21T06:09:55.730594+0000","last_peered":"2024-09-21T06:09:55.730594+0000","last_clean":"2024-09-21T06:09:55.730594+0000","last_became_active":"2024-09-21T06:09:53.708817+0000","last_became_peered":"2024-09-21T06:09:53.708817+0000","last_unstale":"2024-09-21T06:09:55.730594+0000","last_undegraded":"2024-09-21T06:09:55.730594+0000","last_fullsized":"2024-09-21T06:09:55.730594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:07.728499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716382+0000","last_change":"2024-09-21T06:09:54.727107+0000","last_active":"2024-09-21T06:09:55.716382+0000","last_peered":"2024-09-21T06:09:55.716382+0000","last_clean":"2024-09-21T06:09:55.716382+0000","last_became_active":"2024-09-21T06:09:54.726848+0000","last_became_peered":"2024-09-21T06:09:54.726848+0000","last_unstale":"2024-09-21T06:09:55.716382+0000","last_undegraded":"2024-09-21T06:09:55.716382+0000","last_fullsized":"2024-09-21T06:09:55.716382+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:04.970454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717544+0000","last_change":"2024-09-21T06:09:53.717421+0000","last_active":"2024-09-21T06:09:55.717544+0000","last_peered":"2024-09-21T06:09:55.717544+0000","last_clean":"2024-09-21T06:09:55.717544+0000","last_became_active":"2024-09-21T06:09:53.716764+0000","last_became_peered":"2024-09-21T06:09:53.716764+0000","last_unstale":"2024-09-21T06:09:55.717544+0000","last_undegraded":"2024-09-21T06:09:55.717544+0000","last_fullsized":"2024-09-21T06:09:55.717544+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.517669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176189+0000","last_change":"2024-09-21T06:09:54.725487+0000","last_active":"2024-09-21T06:09:56.176189+0000","last_peered":"2024-09-21T06:09:56.176189+0000","last_clean":"2024-09-21T06:09:56.176189+0000","last_became_active":"2024-09-21T06:09:54.725230+0000","last_became_peered":"2024-09-21T06:09:54.725230+0000","last_unstale":"2024-09-21T06:09:56.176189+0000","last_undegraded":"2024-09-21T06:09:56.176189+0000","last_fullsized":"2024-09-21T06:09:56.176189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:46.234485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717222+0000","last_change":"2024-09-21T06:09:53.710816+0000","last_active":"2024-09-21T06:09:55.717222+0000","last_peered":"2024-09-21T06:09:55.717222+0000","last_clean":"2024-09-21T06:09:55.717222+0000","last_became_active":"2024-09-21T06:09:53.710001+0000","last_became_peered":"2024-09-21T06:09:53.710001+0000","last_unstale":"2024-09-21T06:09:55.717222+0000","last_undegraded":"2024-09-21T06:09:55.717222+0000","last_fullsized":"2024-09-21T06:09:55.717222+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:26.581020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.729924+0000","last_change":"2024-09-21T06:09:54.728541+0000","last_active":"2024-09-21T06:09:55.729924+0000","last_peered":"2024-09-21T06:09:55.729924+0000","last_clean":"2024-09-21T06:09:55.729924+0000","last_became_active":"2024-09-21T06:09:54.728260+0000","last_became_peered":"2024-09-21T06:09:54.728260+0000","last_unstale":"2024-09-21T06:09:55.729924+0000","last_undegraded":"2024-09-21T06:09:55.729924+0000","last_fullsized":"2024-09-21T06:09:55.729924+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:17.847265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716198+0000","last_change":"2024-09-21T06:09:53.707087+0000","last_active":"2024-09-21T06:09:55.716198+0000","last_peered":"2024-09-21T06:09:55.716198+0000","last_clean":"2024-09-21T06:09:55.716198+0000","last_became_active":"2024-09-21T06:09:53.706816+0000","last_became_peered":"2024-09-21T06:09:53.706816+0000","last_unstale":"2024-09-21T06:09:55.716198+0000","last_undegraded":"2024-09-21T06:09:55.716198+0000","last_fullsized":"2024-09-21T06:09:55.716198+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:37.509665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731628+0000","last_change":"2024-09-21T06:09:54.729507+0000","last_active":"2024-09-21T06:09:55.731628+0000","last_peered":"2024-09-21T06:09:55.731628+0000","last_clean":"2024-09-21T06:09:55.731628+0000","last_became_active":"2024-09-21T06:09:54.728916+0000","last_became_peered":"2024-09-21T06:09:54.728916+0000","last_unstale":"2024-09-21T06:09:55.731628+0000","last_undegraded":"2024-09-21T06:09:55.731628+0000","last_fullsized":"2024-09-21T06:09:55.731628+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:36.715451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717560+0000","last_change":"2024-09-21T06:09:53.709283+0000","last_active":"2024-09-21T06:09:55.717560+0000","last_peered":"2024-09-21T06:09:55.717560+0000","last_clean":"2024-09-21T06:09:55.717560+0000","last_became_active":"2024-09-21T06:09:53.708580+0000","last_became_peered":"2024-09-21T06:09:53.708580+0000","last_unstale":"2024-09-21T06:09:55.717560+0000","last_undegraded":"2024-09-21T06:09:55.717560+0000","last_fullsized":"2024-09-21T06:09:55.717560+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:28.034289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714812+0000","last_change":"2024-09-21T06:09:54.715641+0000","last_active":"2024-09-21T06:09:55.714812+0000","last_peered":"2024-09-21T06:09:55.714812+0000","last_clean":"2024-09-21T06:09:55.714812+0000","last_became_active":"2024-09-21T06:09:54.715060+0000","last_became_peered":"2024-09-21T06:09:54.715060+0000","last_unstale":"2024-09-21T06:09:55.714812+0000","last_undegraded":"2024-09-21T06:09:55.714812+0000","last_fullsized":"2024-09-21T06:09:55.714812+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:06.471482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730978+0000","last_change":"2024-09-21T06:09:53.711159+0000","last_active":"2024-09-21T06:09:55.730978+0000","last_peered":"2024-09-21T06:09:55.730978+0000","last_clean":"2024-09-21T06:09:55.730978+0000","last_became_active":"2024-09-21T06:09:53.710652+0000","last_became_peered":"2024-09-21T06:09:53.710652+0000","last_unstale":"2024-09-21T06:09:55.730978+0000","last_undegraded":"2024-09-21T06:09:55.730978+0000","last_fullsized":"2024-09-21T06:09:55.730978+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:42.308269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175900+0000","last_change":"2024-09-21T06:09:54.726655+0000","last_active":"2024-09-21T06:09:56.175900+0000","last_peered":"2024-09-21T06:09:56.175900+0000","last_clean":"2024-09-21T06:09:56.175900+0000","last_became_active":"2024-09-21T06:09:54.725159+0000","last_became_peered":"2024-09-21T06:09:54.725159+0000","last_unstale":"2024-09-21T06:09:56.175900+0000","last_undegraded":"2024-09-21T06:09:56.175900+0000","last_fullsized":"2024-09-21T06:09:56.175900+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:00.816412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716794+0000","last_change":"2024-09-21T06:09:53.706233+0000","last_active":"2024-09-21T06:09:55.716794+0000","last_peered":"2024-09-21T06:09:55.716794+0000","last_clean":"2024-09-21T06:09:55.716794+0000","last_became_active":"2024-09-21T06:09:53.705963+0000","last_became_peered":"2024-09-21T06:09:53.705963+0000","last_unstale":"2024-09-21T06:09:55.716794+0000","last_undegraded":"2024-09-21T06:09:55.716794+0000","last_fullsized":"2024-09-21T06:09:55.716794+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:35.353187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716325+0000","last_change":"2024-09-21T06:09:54.736294+0000","last_active":"2024-09-21T06:09:55.716325+0000","last_peered":"2024-09-21T06:09:55.716325+0000","last_clean":"2024-09-21T06:09:55.716325+0000","last_became_active":"2024-09-21T06:09:54.730284+0000","last_became_peered":"2024-09-21T06:09:54.730284+0000","last_unstale":"2024-09-21T06:09:55.716325+0000","last_undegraded":"2024-09-21T06:09:55.716325+0000","last_fullsized":"2024-09-21T06:09:55.716325+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:31.076145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716151+0000","last_change":"2024-09-21T06:09:53.711582+0000","last_active":"2024-09-21T06:09:55.716151+0000","last_peered":"2024-09-21T06:09:55.716151+0000","last_clean":"2024-09-21T06:09:55.716151+0000","last_became_active":"2024-09-21T06:09:53.708856+0000","last_became_peered":"2024-09-21T06:09:53.708856+0000","last_unstale":"2024-09-21T06:09:55.716151+0000","last_undegraded":"2024-09-21T06:09:55.716151+0000","last_fullsized":"2024-09-21T06:09:55.716151+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.820189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175815+0000","last_change":"2024-09-21T06:09:54.730231+0000","last_active":"2024-09-21T06:09:56.175815+0000","last_peered":"2024-09-21T06:09:56.175815+0000","last_clean":"2024-09-21T06:09:56.175815+0000","last_became_active":"2024-09-21T06:09:54.728824+0000","last_became_peered":"2024-09-21T06:09:54.728824+0000","last_unstale":"2024-09-21T06:09:56.175815+0000","last_undegraded":"2024-09-21T06:09:56.175815+0000","last_fullsized":"2024-09-21T06:09:56.175815+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:11.160184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714164+0000","last_change":"2024-09-21T06:09:53.709837+0000","last_active":"2024-09-21T06:09:55.714164+0000","last_peered":"2024-09-21T06:09:55.714164+0000","last_clean":"2024-09-21T06:09:55.714164+0000","last_became_active":"2024-09-21T06:09:53.709495+0000","last_became_peered":"2024-09-21T06:09:53.709495+0000","last_unstale":"2024-09-21T06:09:55.714164+0000","last_undegraded":"2024-09-21T06:09:55.714164+0000","last_fullsized":"2024-09-21T06:09:55.714164+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:38.922341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730224+0000","last_change":"2024-09-21T06:09:54.730242+0000","last_active":"2024-09-21T06:09:55.730224+0000","last_peered":"2024-09-21T06:09:55.730224+0000","last_clean":"2024-09-21T06:09:55.730224+0000","last_became_active":"2024-09-21T06:09:54.729746+0000","last_became_peered":"2024-09-21T06:09:54.729746+0000","last_unstale":"2024-09-21T06:09:55.730224+0000","last_undegraded":"2024-09-21T06:09:55.730224+0000","last_fullsized":"2024-09-21T06:09:55.730224+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:33.878983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"117'3","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731051+0000","last_change":"2024-09-21T06:09:53.703188+0000","last_active":"2024-09-21T06:09:55.731051+0000","last_peered":"2024-09-21T06:09:55.731051+0000","last_clean":"2024-09-21T06:09:55.731051+0000","last_became_active":"2024-09-21T06:09:53.702921+0000","last_became_peered":"2024-09-21T06:09:53.702921+0000","last_unstale":"2024-09-21T06:09:55.731051+0000","last_undegraded":"2024-09-21T06:09:55.731051+0000","last_fullsized":"2024-09-21T06:09:55.731051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:12.373702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730486+0000","last_change":"2024-09-21T06:09:54.734902+0000","last_active":"2024-09-21T06:09:55.730486+0000","last_peered":"2024-09-21T06:09:55.730486+0000","last_clean":"2024-09-21T06:09:55.730486+0000","last_became_active":"2024-09-21T06:09:54.734717+0000","last_became_peered":"2024-09-21T06:09:54.734717+0000","last_unstale":"2024-09-21T06:09:55.730486+0000","last_undegraded":"2024-09-21T06:09:55.730486+0000","last_fullsized":"2024-09-21T06:09:55.730486+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:41.612679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"117'6","reported_seq":21,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176300+0000","last_change":"2024-09-21T06:09:53.705254+0000","last_active":"2024-09-21T06:09:56.176300+0000","last_peered":"2024-09-21T06:09:56.176300+0000","last_clean":"2024-09-21T06:09:56.176300+0000","last_became_active":"2024-09-21T06:09:53.704428+0000","last_became_peered":"2024-09-21T06:09:53.704428+0000","last_unstale":"2024-09-21T06:09:56.176300+0000","last_undegraded":"2024-09-21T06:09:56.176300+0000","last_fullsized":"2024-09-21T06:09:56.176300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:11.801399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714693+0000","last_change":"2024-09-21T06:09:54.720301+0000","last_active":"2024-09-21T06:09:55.714693+0000","last_peered":"2024-09-21T06:09:55.714693+0000","last_clean":"2024-09-21T06:09:55.714693+0000","last_became_active":"2024-09-21T06:09:54.719957+0000","last_became_peered":"2024-09-21T06:09:54.719957+0000","last_unstale":"2024-09-21T06:09:55.714693+0000","last_undegraded":"2024-09-21T06:09:55.714693+0000","last_fullsized":"2024-09-21T06:09:55.714693+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:31.133304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734916+0000","last_change":"2024-09-21T06:09:53.712908+0000","last_active":"2024-09-21T06:09:55.734916+0000","last_peered":"2024-09-21T06:09:55.734916+0000","last_clean":"2024-09-21T06:09:55.734916+0000","last_became_active":"2024-09-21T06:09:53.712614+0000","last_became_peered":"2024-09-21T06:09:53.712614+0000","last_unstale":"2024-09-21T06:09:55.734916+0000","last_undegraded":"2024-09-21T06:09:55.734916+0000","last_fullsized":"2024-09-21T06:09:55.734916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:38.791443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716404+0000","last_change":"2024-09-21T06:09:54.734698+0000","last_active":"2024-09-21T06:09:55.716404+0000","last_peered":"2024-09-21T06:09:55.716404+0000","last_clean":"2024-09-21T06:09:55.716404+0000","last_became_active":"2024-09-21T06:09:54.733975+0000","last_became_peered":"2024-09-21T06:09:54.733975+0000","last_unstale":"2024-09-21T06:09:55.716404+0000","last_undegraded":"2024-09-21T06:09:55.716404+0000","last_fullsized":"2024-09-21T06:09:55.716404+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:43.545807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734790+0000","last_change":"2024-09-21T06:09:53.715095+0000","last_active":"2024-09-21T06:09:55.734790+0000","last_peered":"2024-09-21T06:09:55.734790+0000","last_clean":"2024-09-21T06:09:55.734790+0000","last_became_active":"2024-09-21T06:09:53.714836+0000","last_became_peered":"2024-09-21T06:09:53.714836+0000","last_unstale":"2024-09-21T06:09:55.734790+0000","last_undegraded":"2024-09-21T06:09:55.734790+0000","last_fullsized":"2024-09-21T06:09:55.734790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:20.909713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175577+0000","last_change":"2024-09-21T06:09:54.731656+0000","last_active":"2024-09-21T06:09:56.175577+0000","last_peered":"2024-09-21T06:09:56.175577+0000","last_clean":"2024-09-21T06:09:56.175577+0000","last_became_active":"2024-09-21T06:09:54.731312+0000","last_became_peered":"2024-09-21T06:09:54.731312+0000","last_unstale":"2024-09-21T06:09:56.175577+0000","last_undegraded":"2024-09-21T06:09:56.175577+0000","last_fullsized":"2024-09-21T06:09:56.175577+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:50.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176254+0000","last_change":"2024-09-21T06:09:53.708722+0000","last_active":"2024-09-21T06:09:56.176254+0000","last_peered":"2024-09-21T06:09:56.176254+0000","last_clean":"2024-09-21T06:09:56.176254+0000","last_became_active":"2024-09-21T06:09:53.707835+0000","last_became_peered":"2024-09-21T06:09:53.707835+0000","last_unstale":"2024-09-21T06:09:56.176254+0000","last_undegraded":"2024-09-21T06:09:56.176254+0000","last_fullsized":"2024-09-21T06:09:56.176254+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:35.218693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734347+0000","last_change":"2024-09-21T06:09:54.727696+0000","last_active":"2024-09-21T06:09:55.734347+0000","last_peered":"2024-09-21T06:09:55.734347+0000","last_clean":"2024-09-21T06:09:55.734347+0000","last_became_active":"2024-09-21T06:09:54.727162+0000","last_became_peered":"2024-09-21T06:09:54.727162+0000","last_unstale":"2024-09-21T06:09:55.734347+0000","last_undegraded":"2024-09-21T06:09:55.734347+0000","last_fullsized":"2024-09-21T06:09:55.734347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:05.088265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"117'8","reported_seq":23,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715907+0000","last_change":"2024-09-21T06:09:53.707015+0000","last_active":"2024-09-21T06:09:55.715907+0000","last_peered":"2024-09-21T06:09:55.715907+0000","last_clean":"2024-09-21T06:09:55.715907+0000","last_became_active":"2024-09-21T06:09:53.706448+0000","last_became_peered":"2024-09-21T06:09:53.706448+0000","last_unstale":"2024-09-21T06:09:55.715907+0000","last_undegraded":"2024-09-21T06:09:55.715907+0000","last_fullsized":"2024-09-21T06:09:55.715907+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:38.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730491+0000","last_change":"2024-09-21T06:09:54.724424+0000","last_active":"2024-09-21T06:09:55.730491+0000","last_peered":"2024-09-21T06:09:55.730491+0000","last_clean":"2024-09-21T06:09:55.730491+0000","last_became_active":"2024-09-21T06:09:54.723860+0000","last_became_peered":"2024-09-21T06:09:54.723860+0000","last_unstale":"2024-09-21T06:09:55.730491+0000","last_undegraded":"2024-09-21T06:09:55.730491+0000","last_fullsized":"2024-09-21T06:09:55.730491+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:44.963028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176380+0000","last_change":"2024-09-21T06:09:53.714184+0000","last_active":"2024-09-21T06:09:56.176380+0000","last_peered":"2024-09-21T06:09:56.176380+0000","last_clean":"2024-09-21T06:09:56.176380+0000","last_became_active":"2024-09-21T06:09:53.713745+0000","last_became_peered":"2024-09-21T06:09:53.713745+0000","last_unstale":"2024-09-21T06:09:56.176380+0000","last_undegraded":"2024-09-21T06:09:56.176380+0000","last_fullsized":"2024-09-21T06:09:56.176380+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:27.231816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.729917+0000","last_change":"2024-09-21T06:09:54.728066+0000","last_active":"2024-09-21T06:09:55.729917+0000","last_peered":"2024-09-21T06:09:55.729917+0000","last_clean":"2024-09-21T06:09:55.729917+0000","last_became_active":"2024-09-21T06:09:54.727684+0000","last_became_peered":"2024-09-21T06:09:54.727684+0000","last_unstale":"2024-09-21T06:09:55.729917+0000","last_undegraded":"2024-09-21T06:09:55.729917+0000","last_fullsized":"2024-09-21T06:09:55.729917+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:07.233797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730877+0000","last_change":"2024-09-21T06:09:53.710971+0000","last_active":"2024-09-21T06:09:55.730877+0000","last_peered":"2024-09-21T06:09:55.730877+0000","last_clean":"2024-09-21T06:09:55.730877+0000","last_became_active":"2024-09-21T06:09:53.710679+0000","last_became_peered":"2024-09-21T06:09:53.710679+0000","last_unstale":"2024-09-21T06:09:55.730877+0000","last_undegraded":"2024-09-21T06:09:55.730877+0000","last_fullsized":"2024-09-21T06:09:55.730877+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:12.489290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.732013+0000","last_change":"2024-09-21T06:09:54.733166+0000","last_active":"2024-09-21T06:09:55.732013+0000","last_peered":"2024-09-21T06:09:55.732013+0000","last_clean":"2024-09-21T06:09:55.732013+0000","last_became_active":"2024-09-21T06:09:54.730779+0000","last_became_peered":"2024-09-21T06:09:54.730779+0000","last_unstale":"2024-09-21T06:09:55.732013+0000","last_undegraded":"2024-09-21T06:09:55.732013+0000","last_fullsized":"2024-09-21T06:09:55.732013+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:39.039184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716785+0000","last_change":"2024-09-21T06:09:53.713604+0000","last_active":"2024-09-21T06:09:55.716785+0000","last_peered":"2024-09-21T06:09:55.716785+0000","last_clean":"2024-09-21T06:09:55.716785+0000","last_became_active":"2024-09-21T06:09:53.712555+0000","last_became_peered":"2024-09-21T06:09:53.712555+0000","last_unstale":"2024-09-21T06:09:55.716785+0000","last_undegraded":"2024-09-21T06:09:55.716785+0000","last_fullsized":"2024-09-21T06:09:55.716785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:00.616919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734884+0000","last_change":"2024-09-21T06:09:54.724631+0000","last_active":"2024-09-21T06:09:55.734884+0000","last_peered":"2024-09-21T06:09:55.734884+0000","last_clean":"2024-09-21T06:09:55.734884+0000","last_became_active":"2024-09-21T06:09:54.724018+0000","last_became_peered":"2024-09-21T06:09:54.724018+0000","last_unstale":"2024-09-21T06:09:55.734884+0000","last_undegraded":"2024-09-21T06:09:55.734884+0000","last_fullsized":"2024-09-21T06:09:55.734884+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:48.871033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717616+0000","last_change":"2024-09-21T06:09:53.718333+0000","last_active":"2024-09-21T06:09:55.717616+0000","last_peered":"2024-09-21T06:09:55.717616+0000","last_clean":"2024-09-21T06:09:55.717616+0000","last_became_active":"2024-09-21T06:09:53.717703+0000","last_became_peered":"2024-09-21T06:09:53.717703+0000","last_unstale":"2024-09-21T06:09:55.717616+0000","last_undegraded":"2024-09-21T06:09:55.717616+0000","last_fullsized":"2024-09-21T06:09:55.717616+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:57.064938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734316+0000","last_change":"2024-09-21T06:09:54.735645+0000","last_active":"2024-09-21T06:09:55.734316+0000","last_peered":"2024-09-21T06:09:55.734316+0000","last_clean":"2024-09-21T06:09:55.734316+0000","last_became_active":"2024-09-21T06:09:54.735360+0000","last_became_peered":"2024-09-21T06:09:54.735360+0000","last_unstale":"2024-09-21T06:09:55.734316+0000","last_undegraded":"2024-09-21T06:09:55.734316+0000","last_fullsized":"2024-09-21T06:09:55.734316+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:29.866909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.729570+0000","last_change":"2024-09-21T06:09:53.709262+0000","last_active":"2024-09-21T06:09:55.729570+0000","last_peered":"2024-09-21T06:09:55.729570+0000","last_clean":"2024-09-21T06:09:55.729570+0000","last_became_active":"2024-09-21T06:09:53.708917+0000","last_became_peered":"2024-09-21T06:09:53.708917+0000","last_unstale":"2024-09-21T06:09:55.729570+0000","last_undegraded":"2024-09-21T06:09:55.729570+0000","last_fullsized":"2024-09-21T06:09:55.729570+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:08.122167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734626+0000","last_change":"2024-09-21T06:09:54.731320+0000","last_active":"2024-09-21T06:09:55.734626+0000","last_peered":"2024-09-21T06:09:55.734626+0000","last_clean":"2024-09-21T06:09:55.734626+0000","last_became_active":"2024-09-21T06:09:54.730669+0000","last_became_peered":"2024-09-21T06:09:54.730669+0000","last_unstale":"2024-09-21T06:09:55.734626+0000","last_undegraded":"2024-09-21T06:09:55.734626+0000","last_fullsized":"2024-09-21T06:09:55.734626+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:41.549757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730418+0000","last_change":"2024-09-21T06:09:53.709993+0000","last_active":"2024-09-21T06:09:55.730418+0000","last_peered":"2024-09-21T06:09:55.730418+0000","last_clean":"2024-09-21T06:09:55.730418+0000","last_became_active":"2024-09-21T06:09:53.709716+0000","last_became_peered":"2024-09-21T06:09:53.709716+0000","last_unstale":"2024-09-21T06:09:55.730418+0000","last_undegraded":"2024-09-21T06:09:55.730418+0000","last_fullsized":"2024-09-21T06:09:55.730418+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:53.342806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731122+0000","last_change":"2024-09-21T06:09:54.724590+0000","last_active":"2024-09-21T06:09:55.731122+0000","last_peered":"2024-09-21T06:09:55.731122+0000","last_clean":"2024-09-21T06:09:55.731122+0000","last_became_active":"2024-09-21T06:09:54.724226+0000","last_became_peered":"2024-09-21T06:09:54.724226+0000","last_unstale":"2024-09-21T06:09:55.731122+0000","last_undegraded":"2024-09-21T06:09:55.731122+0000","last_fullsized":"2024-09-21T06:09:55.731122+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:03.459913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717327+0000","last_change":"2024-09-21T06:09:53.711144+0000","last_active":"2024-09-21T06:09:55.717327+0000","last_peered":"2024-09-21T06:09:55.717327+0000","last_clean":"2024-09-21T06:09:55.717327+0000","last_became_active":"2024-09-21T06:09:53.710391+0000","last_became_peered":"2024-09-21T06:09:53.710391+0000","last_unstale":"2024-09-21T06:09:55.717327+0000","last_undegraded":"2024-09-21T06:09:55.717327+0000","last_fullsized":"2024-09-21T06:09:55.717327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.449704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717252+0000","last_change":"2024-09-21T06:09:54.732230+0000","last_active":"2024-09-21T06:09:55.717252+0000","last_peered":"2024-09-21T06:09:55.717252+0000","last_clean":"2024-09-21T06:09:55.717252+0000","last_became_active":"2024-09-21T06:09:54.731646+0000","last_became_peered":"2024-09-21T06:09:54.731646+0000","last_unstale":"2024-09-21T06:09:55.717252+0000","last_undegraded":"2024-09-21T06:09:55.717252+0000","last_fullsized":"2024-09-21T06:09:55.717252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:04.337768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730249+0000","last_change":"2024-09-21T06:09:53.710718+0000","last_active":"2024-09-21T06:09:55.730249+0000","last_peered":"2024-09-21T06:09:55.730249+0000","last_clean":"2024-09-21T06:09:55.730249+0000","last_became_active":"2024-09-21T06:09:53.710411+0000","last_became_peered":"2024-09-21T06:09:53.710411+0000","last_unstale":"2024-09-21T06:09:55.730249+0000","last_undegraded":"2024-09-21T06:09:55.730249+0000","last_fullsized":"2024-09-21T06:09:55.730249+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:37.043415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716046+0000","last_change":"2024-09-21T06:09:54.724139+0000","last_active":"2024-09-21T06:09:55.716046+0000","last_peered":"2024-09-21T06:09:55.716046+0000","last_clean":"2024-09-21T06:09:55.716046+0000","last_became_active":"2024-09-21T06:09:54.723873+0000","last_became_peered":"2024-09-21T06:09:54.723873+0000","last_unstale":"2024-09-21T06:09:55.716046+0000","last_undegraded":"2024-09-21T06:09:55.716046+0000","last_fullsized":"2024-09-21T06:09:55.716046+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:22.942833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"118'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717693+0000","last_change":"2024-09-21T06:09:53.718003+0000","last_active":"2024-09-21T06:09:55.717693+0000","last_peered":"2024-09-21T06:09:55.717693+0000","last_clean":"2024-09-21T06:09:55.717693+0000","last_became_active":"2024-09-21T06:09:53.716916+0000","last_became_peered":"2024-09-21T06:09:53.716916+0000","last_unstale":"2024-09-21T06:09:55.717693+0000","last_undegraded":"2024-09-21T06:09:55.717693+0000","last_fullsized":"2024-09-21T06:09:55.717693+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:51.259599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716632+0000","last_change":"2024-09-21T06:09:54.725206+0000","last_active":"2024-09-21T06:09:55.716632+0000","last_peered":"2024-09-21T06:09:55.716632+0000","last_clean":"2024-09-21T06:09:55.716632+0000","last_became_active":"2024-09-21T06:09:54.724924+0000","last_became_peered":"2024-09-21T06:09:54.724924+0000","last_unstale":"2024-09-21T06:09:55.716632+0000","last_undegraded":"2024-09-21T06:09:55.716632+0000","last_fullsized":"2024-09-21T06:09:55.716632+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:00.561857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716895+0000","last_change":"2024-09-21T06:09:53.715330+0000","last_active":"2024-09-21T06:09:55.716895+0000","last_peered":"2024-09-21T06:09:55.716895+0000","last_clean":"2024-09-21T06:09:55.716895+0000","last_became_active":"2024-09-21T06:09:53.710794+0000","last_became_peered":"2024-09-21T06:09:53.710794+0000","last_unstale":"2024-09-21T06:09:55.716895+0000","last_undegraded":"2024-09-21T06:09:55.716895+0000","last_fullsized":"2024-09-21T06:09:55.716895+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:43.129579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730784+0000","last_change":"2024-09-21T06:09:54.724133+0000","last_active":"2024-09-21T06:09:55.730784+0000","last_peered":"2024-09-21T06:09:55.730784+0000","last_clean":"2024-09-21T06:09:55.730784+0000","last_became_active":"2024-09-21T06:09:54.723209+0000","last_became_peered":"2024-09-21T06:09:54.723209+0000","last_unstale":"2024-09-21T06:09:55.730784+0000","last_undegraded":"2024-09-21T06:09:55.730784+0000","last_fullsized":"2024-09-21T06:09:55.730784+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:20.324375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731300+0000","last_change":"2024-09-21T06:09:53.711730+0000","last_active":"2024-09-21T06:09:55.731300+0000","last_peered":"2024-09-21T06:09:55.731300+0000","last_clean":"2024-09-21T06:09:55.731300+0000","last_became_active":"2024-09-21T06:09:53.711350+0000","last_became_peered":"2024-09-21T06:09:53.711350+0000","last_unstale":"2024-09-21T06:09:55.731300+0000","last_undegraded":"2024-09-21T06:09:55.731300+0000","last_fullsized":"2024-09-21T06:09:55.731300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:11.953398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734517+0000","last_change":"2024-09-21T06:09:54.727417+0000","last_active":"2024-09-21T06:09:55.734517+0000","last_peered":"2024-09-21T06:09:55.734517+0000","last_clean":"2024-09-21T06:09:55.734517+0000","last_became_active":"2024-09-21T06:09:54.725996+0000","last_became_peered":"2024-09-21T06:09:54.725996+0000","last_unstale":"2024-09-21T06:09:55.734517+0000","last_undegraded":"2024-09-21T06:09:55.734517+0000","last_fullsized":"2024-09-21T06:09:55.734517+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:57.497933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717417+0000","last_change":"2024-09-21T06:09:53.715215+0000","last_active":"2024-09-21T06:09:55.717417+0000","last_peered":"2024-09-21T06:09:55.717417+0000","last_clean":"2024-09-21T06:09:55.717417+0000","last_became_active":"2024-09-21T06:09:53.714796+0000","last_became_peered":"2024-09-21T06:09:53.714796+0000","last_unstale":"2024-09-21T06:09:55.717417+0000","last_undegraded":"2024-09-21T06:09:55.717417+0000","last_fullsized":"2024-09-21T06:09:55.717417+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:32.161254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176115+0000","last_change":"2024-09-21T06:09:54.726997+0000","last_active":"2024-09-21T06:09:56.176115+0000","last_peered":"2024-09-21T06:09:56.176115+0000","last_clean":"2024-09-21T06:09:56.176115+0000","last_became_active":"2024-09-21T06:09:54.726712+0000","last_became_peered":"2024-09-21T06:09:54.726712+0000","last_unstale":"2024-09-21T06:09:56.176115+0000","last_undegraded":"2024-09-21T06:09:56.176115+0000","last_fullsized":"2024-09-21T06:09:56.176115+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:31.958813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731025+0000","last_change":"2024-09-21T06:09:53.712169+0000","last_active":"2024-09-21T06:09:55.731025+0000","last_peered":"2024-09-21T06:09:55.731025+0000","last_clean":"2024-09-21T06:09:55.731025+0000","last_became_active":"2024-09-21T06:09:53.711381+0000","last_became_peered":"2024-09-21T06:09:53.711381+0000","last_unstale":"2024-09-21T06:09:55.731025+0000","last_undegraded":"2024-09-21T06:09:55.731025+0000","last_fullsized":"2024-09-21T06:09:55.731025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:19.752960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.735002+0000","last_change":"2024-09-21T06:09:54.726056+0000","last_active":"2024-09-21T06:09:55.735002+0000","last_peered":"2024-09-21T06:09:55.735002+0000","last_clean":"2024-09-21T06:09:55.735002+0000","last_became_active":"2024-09-21T06:09:54.725375+0000","last_became_peered":"2024-09-21T06:09:54.725375+0000","last_unstale":"2024-09-21T06:09:55.735002+0000","last_undegraded":"2024-09-21T06:09:55.735002+0000","last_fullsized":"2024-09-21T06:09:55.735002+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:24.258408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715137+0000","last_change":"2024-09-21T06:09:53.709948+0000","last_active":"2024-09-21T06:09:55.715137+0000","last_peered":"2024-09-21T06:09:55.715137+0000","last_clean":"2024-09-21T06:09:55.715137+0000","last_became_active":"2024-09-21T06:09:53.709689+0000","last_became_peered":"2024-09-21T06:09:53.709689+0000","last_unstale":"2024-09-21T06:09:55.715137+0000","last_undegraded":"2024-09-21T06:09:55.715137+0000","last_fullsized":"2024-09-21T06:09:55.715137+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730521+0000","last_change":"2024-09-21T06:09:54.728965+0000","last_active":"2024-09-21T06:09:55.730521+0000","last_peered":"2024-09-21T06:09:55.730521+0000","last_clean":"2024-09-21T06:09:55.730521+0000","last_became_active":"2024-09-21T06:09:54.728427+0000","last_became_peered":"2024-09-21T06:09:54.728427+0000","last_unstale":"2024-09-21T06:09:55.730521+0000","last_undegraded":"2024-09-21T06:09:55.730521+0000","last_fullsized":"2024-09-21T06:09:55.730521+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:12.894096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.735121+0000","last_change":"2024-09-21T06:09:53.716899+0000","last_active":"2024-09-21T06:09:55.735121+0000","last_peered":"2024-09-21T06:09:55.735121+0000","last_clean":"2024-09-21T06:09:55.735121+0000","last_became_active":"2024-09-21T06:09:53.716429+0000","last_became_peered":"2024-09-21T06:09:53.716429+0000","last_unstale":"2024-09-21T06:09:55.735121+0000","last_undegraded":"2024-09-21T06:09:55.735121+0000","last_fullsized":"2024-09-21T06:09:55.735121+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:27.876459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734558+0000","last_change":"2024-09-21T06:09:54.730432+0000","last_active":"2024-09-21T06:09:55.734558+0000","last_peered":"2024-09-21T06:09:55.734558+0000","last_clean":"2024-09-21T06:09:55.734558+0000","last_became_active":"2024-09-21T06:09:54.730160+0000","last_became_peered":"2024-09-21T06:09:54.730160+0000","last_unstale":"2024-09-21T06:09:55.734558+0000","last_undegraded":"2024-09-21T06:09:55.734558+0000","last_fullsized":"2024-09-21T06:09:55.734558+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:23.482999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730717+0000","last_change":"2024-09-21T06:09:53.700722+0000","last_active":"2024-09-21T06:09:55.730717+0000","last_peered":"2024-09-21T06:09:55.730717+0000","last_clean":"2024-09-21T06:09:55.730717+0000","last_became_active":"2024-09-21T06:09:53.700465+0000","last_became_peered":"2024-09-21T06:09:53.700465+0000","last_unstale":"2024-09-21T06:09:55.730717+0000","last_undegraded":"2024-09-21T06:09:55.730717+0000","last_fullsized":"2024-09-21T06:09:55.730717+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:51.509547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":315,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730838+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:09:55.730838+0000","last_peered":"2024-09-21T06:09:55.730838+0000","last_clean":"2024-09-21T06:09:55.730838+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:09:55.730838+0000","last_undegraded":"2024-09-21T06:09:55.730838+0000","last_fullsized":"2024-09-21T06:09:55.730838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347187,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194099,"statfs":{"total":200000000,"available":198757871,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194099,"statfs":{"total":200000000,"available":198758341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":636,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194675,"statfs":{"total":200000000,"available":199348169,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":635,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194676,"statfs":{"total":200000000,"available":199348751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347085,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":635,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194676,"statfs":{"total":200000000,"available":199348787,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":635,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194676,"statfs":{"total":200000000,"available":199348821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:10:04.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 -- 172.21.15.118:0/2594371498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7640ce130 msgr2=0x7fe7641449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 --2- 172.21.15.118:0/2594371498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7640ce130 0x7fe7641449a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe758009830 tx=0x7fe75802a410 comp rx=0 tx=0).stop 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 -- 172.21.15.118:0/2594371498 shutdown_connections 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 --2- 172.21.15.118:0/2594371498 >> v2:172.21.15.149:3300/0 conn(0x7fe7640736e0 0x7fe764073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 --2- 172.21.15.118:0/2594371498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7640ce130 0x7fe7641449a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 -- 172.21.15.118:0/2594371498 >> 172.21.15.118:0/2594371498 conn(0x7fe76406d110 msgr2=0x7fe76406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 -- 172.21.15.118:0/2594371498 shutdown_connections 2024-09-21T06:10:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.396+0000 7fe76c000640 1 -- 172.21.15.118:0/2594371498 wait complete. 2024-09-21T06:10:04.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.398+0000 7fe76c000640 1 Processor -- start 2024-09-21T06:10:04.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.398+0000 7fe76c000640 1 -- start start 2024-09-21T06:10:04.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe76c000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7640736e0 0x7fe76415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe76c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7640ce130 0x7fe7640ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe76c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7640d0de0 0x7fe7640ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe76c000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe7640b5000 con 0x7fe7640736e0 2024-09-21T06:10:04.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe76c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe7640b4e80 con 0x7fe7640d0de0 2024-09-21T06:10:04.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe76c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7640b5180 con 0x7fe7640ce130 2024-09-21T06:10:04.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7640736e0 0x7fe76415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7640736e0 0x7fe76415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53930/0 (socket says 172.21.15.118:53930) 2024-09-21T06:10:04.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 -- 172.21.15.118:0/1181579548 learned_addr learned my addr 172.21.15.118:0/1181579548 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 -- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7640ce130 msgr2=0x7fe7640ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7640ce130 0x7fe7640ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 -- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7640d0de0 msgr2=0x7fe7640ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7640d0de0 0x7fe7640ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.400+0000 7fe769600640 1 -- 172.21.15.118:0/1181579548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7640acda0 con 0x7fe7640736e0 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.401+0000 7fe769600640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7640736e0 0x7fe76415f300 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe758009950 tx=0x7fe758003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.401+0000 7fe761600640 1 -- 172.21.15.118:0/1181579548 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75803f030 con 0x7fe7640736e0 2024-09-21T06:10:04.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.401+0000 7fe761600640 1 -- 172.21.15.118:0/1181579548 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe758004510 con 0x7fe7640736e0 2024-09-21T06:10:04.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.401+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7640aa6f0 con 0x7fe7640736e0 2024-09-21T06:10:04.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.401+0000 7fe761600640 1 -- 172.21.15.118:0/1181579548 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758037040 con 0x7fe7640736e0 2024-09-21T06:10:04.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.401+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7640aacb0 con 0x7fe7640736e0 2024-09-21T06:10:04.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.402+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7640cda30 con 0x7fe7640736e0 2024-09-21T06:10:04.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.403+0000 7fe761600640 1 -- 172.21.15.118:0/1181579548 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe758042070 con 0x7fe7640736e0 2024-09-21T06:10:04.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.404+0000 7fe761600640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe744078b90 0x7fe74407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.404+0000 7fe761600640 1 -- 172.21.15.118:0/1181579548 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fe7580baa70 con 0x7fe7640736e0 2024-09-21T06:10:04.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.405+0000 7fe768c00640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe744078b90 0x7fe74407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.405+0000 7fe768c00640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe744078b90 0x7fe74407b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe7500058c0 tx=0x7fe750005850 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:04.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.409+0000 7fe761600640 1 -- 172.21.15.118:0/1181579548 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe7640cda30 con 0x7fe7640736e0 2024-09-21T06:10:04.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.589+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7640aa500 con 0x7fe744078b90 2024-09-21T06:10:04.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.594+0000 7fe761600640 1 -- 172.21.15.118:0/1181579548 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7fe7640aa500 con 0x7fe744078b90 2024-09-21T06:10:04.598 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe744078b90 msgr2=0x7fe74407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe744078b90 0x7fe74407b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe7500058c0 tx=0x7fe750005850 comp rx=0 tx=0).stop 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7640736e0 msgr2=0x7fe76415f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7640736e0 0x7fe76415f300 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe758009950 tx=0x7fe758003b60 comp rx=0 tx=0).stop 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 shutdown_connections 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7640d0de0 0x7fe7640ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe744078b90 0x7fe74407b0a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7640ce130 0x7fe7640ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 --2- 172.21.15.118:0/1181579548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7640736e0 0x7fe76415f300 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 >> 172.21.15.118:0/1181579548 conn(0x7fe76406d110 msgr2=0x7fe764145000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 shutdown_connections 2024-09-21T06:10:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.598+0000 7fe76c000640 1 -- 172.21.15.118:0/1181579548 wait complete. 2024-09-21T06:10:04.621 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-21T06:10:04.553587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6245,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556254,"statfs":{"total":1600000000,"available":1593605012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.841143"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715980+0000","last_change":"2024-09-21T06:09:54.715201+0000","last_active":"2024-09-21T06:09:55.715980+0000","last_peered":"2024-09-21T06:09:55.715980+0000","last_clean":"2024-09-21T06:09:55.715980+0000","last_became_active":"2024-09-21T06:09:54.714922+0000","last_became_peered":"2024-09-21T06:09:54.714922+0000","last_unstale":"2024-09-21T06:09:55.715980+0000","last_undegraded":"2024-09-21T06:09:55.715980+0000","last_fullsized":"2024-09-21T06:09:55.715980+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:43.006178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715878+0000","last_change":"2024-09-21T06:09:54.736623+0000","last_active":"2024-09-21T06:09:55.715878+0000","last_peered":"2024-09-21T06:09:55.715878+0000","last_clean":"2024-09-21T06:09:55.715878+0000","last_became_active":"2024-09-21T06:09:54.730791+0000","last_became_peered":"2024-09-21T06:09:54.730791+0000","last_unstale":"2024-09-21T06:09:55.715878+0000","last_undegraded":"2024-09-21T06:09:55.715878+0000","last_fullsized":"2024-09-21T06:09:55.715878+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:47.676256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715681+0000","last_change":"2024-09-21T06:09:54.715189+0000","last_active":"2024-09-21T06:09:55.715681+0000","last_peered":"2024-09-21T06:09:55.715681+0000","last_clean":"2024-09-21T06:09:55.715681+0000","last_became_active":"2024-09-21T06:09:54.714882+0000","last_became_peered":"2024-09-21T06:09:54.714882+0000","last_unstale":"2024-09-21T06:09:55.715681+0000","last_undegraded":"2024-09-21T06:09:55.715681+0000","last_fullsized":"2024-09-21T06:09:55.715681+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:24.940809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714420+0000","last_change":"2024-09-21T06:09:54.724168+0000","last_active":"2024-09-21T06:09:55.714420+0000","last_peered":"2024-09-21T06:09:55.714420+0000","last_clean":"2024-09-21T06:09:55.714420+0000","last_became_active":"2024-09-21T06:09:54.723648+0000","last_became_peered":"2024-09-21T06:09:54.723648+0000","last_unstale":"2024-09-21T06:09:55.714420+0000","last_undegraded":"2024-09-21T06:09:55.714420+0000","last_fullsized":"2024-09-21T06:09:55.714420+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:44.068808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730240+0000","last_change":"2024-09-21T06:09:54.732957+0000","last_active":"2024-09-21T06:09:55.730240+0000","last_peered":"2024-09-21T06:09:55.730240+0000","last_clean":"2024-09-21T06:09:55.730240+0000","last_became_active":"2024-09-21T06:09:54.732400+0000","last_became_peered":"2024-09-21T06:09:54.732400+0000","last_unstale":"2024-09-21T06:09:55.730240+0000","last_undegraded":"2024-09-21T06:09:55.730240+0000","last_fullsized":"2024-09-21T06:09:55.730240+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:43.117768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731371+0000","last_change":"2024-09-21T06:09:54.723608+0000","last_active":"2024-09-21T06:09:55.731371+0000","last_peered":"2024-09-21T06:09:55.731371+0000","last_clean":"2024-09-21T06:09:55.731371+0000","last_became_active":"2024-09-21T06:09:54.723354+0000","last_became_peered":"2024-09-21T06:09:54.723354+0000","last_unstale":"2024-09-21T06:09:55.731371+0000","last_undegraded":"2024-09-21T06:09:55.731371+0000","last_fullsized":"2024-09-21T06:09:55.731371+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:39.477347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731144+0000","last_change":"2024-09-21T06:09:54.721811+0000","last_active":"2024-09-21T06:09:55.731144+0000","last_peered":"2024-09-21T06:09:55.731144+0000","last_clean":"2024-09-21T06:09:55.731144+0000","last_became_active":"2024-09-21T06:09:54.721550+0000","last_became_peered":"2024-09-21T06:09:54.721550+0000","last_unstale":"2024-09-21T06:09:55.731144+0000","last_undegraded":"2024-09-21T06:09:55.731144+0000","last_fullsized":"2024-09-21T06:09:55.731144+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:06.539133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716771+0000","last_change":"2024-09-21T06:09:54.733110+0000","last_active":"2024-09-21T06:09:55.716771+0000","last_peered":"2024-09-21T06:09:55.716771+0000","last_clean":"2024-09-21T06:09:55.716771+0000","last_became_active":"2024-09-21T06:09:54.732596+0000","last_became_peered":"2024-09-21T06:09:54.732596+0000","last_unstale":"2024-09-21T06:09:55.716771+0000","last_undegraded":"2024-09-21T06:09:55.716771+0000","last_fullsized":"2024-09-21T06:09:55.716771+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:07.159031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175600+0000","last_change":"2024-09-21T06:09:54.722422+0000","last_active":"2024-09-21T06:09:56.175600+0000","last_peered":"2024-09-21T06:09:56.175600+0000","last_clean":"2024-09-21T06:09:56.175600+0000","last_became_active":"2024-09-21T06:09:54.722033+0000","last_became_peered":"2024-09-21T06:09:54.722033+0000","last_unstale":"2024-09-21T06:09:56.175600+0000","last_undegraded":"2024-09-21T06:09:56.175600+0000","last_fullsized":"2024-09-21T06:09:56.175600+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:34.111391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730506+0000","last_change":"2024-09-21T06:09:54.728015+0000","last_active":"2024-09-21T06:09:55.730506+0000","last_peered":"2024-09-21T06:09:55.730506+0000","last_clean":"2024-09-21T06:09:55.730506+0000","last_became_active":"2024-09-21T06:09:54.727644+0000","last_became_peered":"2024-09-21T06:09:54.727644+0000","last_unstale":"2024-09-21T06:09:55.730506+0000","last_undegraded":"2024-09-21T06:09:55.730506+0000","last_fullsized":"2024-09-21T06:09:55.730506+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:39.631736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731619+0000","last_change":"2024-09-21T06:09:54.731683+0000","last_active":"2024-09-21T06:09:55.731619+0000","last_peered":"2024-09-21T06:09:55.731619+0000","last_clean":"2024-09-21T06:09:55.731619+0000","last_became_active":"2024-09-21T06:09:54.727897+0000","last_became_peered":"2024-09-21T06:09:54.727897+0000","last_unstale":"2024-09-21T06:09:55.731619+0000","last_undegraded":"2024-09-21T06:09:55.731619+0000","last_fullsized":"2024-09-21T06:09:55.731619+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:22.078556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176015+0000","last_change":"2024-09-21T06:09:54.723350+0000","last_active":"2024-09-21T06:09:56.176015+0000","last_peered":"2024-09-21T06:09:56.176015+0000","last_clean":"2024-09-21T06:09:56.176015+0000","last_became_active":"2024-09-21T06:09:54.722933+0000","last_became_peered":"2024-09-21T06:09:54.722933+0000","last_unstale":"2024-09-21T06:09:56.176015+0000","last_undegraded":"2024-09-21T06:09:56.176015+0000","last_fullsized":"2024-09-21T06:09:56.176015+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:35.363520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714529+0000","last_change":"2024-09-21T06:09:54.727226+0000","last_active":"2024-09-21T06:09:55.714529+0000","last_peered":"2024-09-21T06:09:55.714529+0000","last_clean":"2024-09-21T06:09:55.714529+0000","last_became_active":"2024-09-21T06:09:54.726587+0000","last_became_peered":"2024-09-21T06:09:54.726587+0000","last_unstale":"2024-09-21T06:09:55.714529+0000","last_undegraded":"2024-09-21T06:09:55.714529+0000","last_fullsized":"2024-09-21T06:09:55.714529+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:22.790060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734202+0000","last_change":"2024-09-21T06:09:54.728182+0000","last_active":"2024-09-21T06:09:55.734202+0000","last_peered":"2024-09-21T06:09:55.734202+0000","last_clean":"2024-09-21T06:09:55.734202+0000","last_became_active":"2024-09-21T06:09:54.727890+0000","last_became_peered":"2024-09-21T06:09:54.727890+0000","last_unstale":"2024-09-21T06:09:55.734202+0000","last_undegraded":"2024-09-21T06:09:55.734202+0000","last_fullsized":"2024-09-21T06:09:55.734202+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:23.427292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714594+0000","last_change":"2024-09-21T06:09:54.715833+0000","last_active":"2024-09-21T06:09:55.714594+0000","last_peered":"2024-09-21T06:09:55.714594+0000","last_clean":"2024-09-21T06:09:55.714594+0000","last_became_active":"2024-09-21T06:09:54.715403+0000","last_became_peered":"2024-09-21T06:09:54.715403+0000","last_unstale":"2024-09-21T06:09:55.714594+0000","last_undegraded":"2024-09-21T06:09:55.714594+0000","last_fullsized":"2024-09-21T06:09:55.714594+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:19.811337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731863+0000","last_change":"2024-09-21T06:09:54.733519+0000","last_active":"2024-09-21T06:09:55.731863+0000","last_peered":"2024-09-21T06:09:55.731863+0000","last_clean":"2024-09-21T06:09:55.731863+0000","last_became_active":"2024-09-21T06:09:54.732828+0000","last_became_peered":"2024-09-21T06:09:54.732828+0000","last_unstale":"2024-09-21T06:09:55.731863+0000","last_undegraded":"2024-09-21T06:09:55.731863+0000","last_fullsized":"2024-09-21T06:09:55.731863+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:31:03.790986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716116+0000","last_change":"2024-09-21T06:09:54.736891+0000","last_active":"2024-09-21T06:09:55.716116+0000","last_peered":"2024-09-21T06:09:55.716116+0000","last_clean":"2024-09-21T06:09:55.716116+0000","last_became_active":"2024-09-21T06:09:54.731138+0000","last_became_peered":"2024-09-21T06:09:54.731138+0000","last_unstale":"2024-09-21T06:09:55.716116+0000","last_undegraded":"2024-09-21T06:09:55.716116+0000","last_fullsized":"2024-09-21T06:09:55.716116+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.981214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714766+0000","last_change":"2024-09-21T06:09:54.729128+0000","last_active":"2024-09-21T06:09:55.714766+0000","last_peered":"2024-09-21T06:09:55.714766+0000","last_clean":"2024-09-21T06:09:55.714766+0000","last_became_active":"2024-09-21T06:09:54.726952+0000","last_became_peered":"2024-09-21T06:09:54.726952+0000","last_unstale":"2024-09-21T06:09:55.714766+0000","last_undegraded":"2024-09-21T06:09:55.714766+0000","last_fullsized":"2024-09-21T06:09:55.714766+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:41.995126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734423+0000","last_change":"2024-09-21T06:09:54.724894+0000","last_active":"2024-09-21T06:09:55.734423+0000","last_peered":"2024-09-21T06:09:55.734423+0000","last_clean":"2024-09-21T06:09:55.734423+0000","last_became_active":"2024-09-21T06:09:54.724365+0000","last_became_peered":"2024-09-21T06:09:54.724365+0000","last_unstale":"2024-09-21T06:09:55.734423+0000","last_undegraded":"2024-09-21T06:09:55.734423+0000","last_fullsized":"2024-09-21T06:09:55.734423+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:00.725493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175894+0000","last_change":"2024-09-21T06:09:54.722323+0000","last_active":"2024-09-21T06:09:56.175894+0000","last_peered":"2024-09-21T06:09:56.175894+0000","last_clean":"2024-09-21T06:09:56.175894+0000","last_became_active":"2024-09-21T06:09:54.722066+0000","last_became_peered":"2024-09-21T06:09:54.722066+0000","last_unstale":"2024-09-21T06:09:56.175894+0000","last_undegraded":"2024-09-21T06:09:56.175894+0000","last_fullsized":"2024-09-21T06:09:56.175894+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:41.868564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734361+0000","last_change":"2024-09-21T06:09:54.731594+0000","last_active":"2024-09-21T06:09:55.734361+0000","last_peered":"2024-09-21T06:09:55.734361+0000","last_clean":"2024-09-21T06:09:55.734361+0000","last_became_active":"2024-09-21T06:09:54.731075+0000","last_became_peered":"2024-09-21T06:09:54.731075+0000","last_unstale":"2024-09-21T06:09:55.734361+0000","last_undegraded":"2024-09-21T06:09:55.734361+0000","last_fullsized":"2024-09-21T06:09:55.734361+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.973624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716558+0000","last_change":"2024-09-21T06:09:54.731406+0000","last_active":"2024-09-21T06:09:55.716558+0000","last_peered":"2024-09-21T06:09:55.716558+0000","last_clean":"2024-09-21T06:09:55.716558+0000","last_became_active":"2024-09-21T06:09:54.729828+0000","last_became_peered":"2024-09-21T06:09:54.729828+0000","last_unstale":"2024-09-21T06:09:55.716558+0000","last_undegraded":"2024-09-21T06:09:55.716558+0000","last_fullsized":"2024-09-21T06:09:55.716558+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:12:19.205913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717022+0000","last_change":"2024-09-21T06:09:54.732838+0000","last_active":"2024-09-21T06:09:55.717022+0000","last_peered":"2024-09-21T06:09:55.717022+0000","last_clean":"2024-09-21T06:09:55.717022+0000","last_became_active":"2024-09-21T06:09:54.731982+0000","last_became_peered":"2024-09-21T06:09:54.731982+0000","last_unstale":"2024-09-21T06:09:55.717022+0000","last_undegraded":"2024-09-21T06:09:55.717022+0000","last_fullsized":"2024-09-21T06:09:55.717022+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:51.344343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730411+0000","last_change":"2024-09-21T06:09:54.726673+0000","last_active":"2024-09-21T06:09:55.730411+0000","last_peered":"2024-09-21T06:09:55.730411+0000","last_clean":"2024-09-21T06:09:55.730411+0000","last_became_active":"2024-09-21T06:09:54.725717+0000","last_became_peered":"2024-09-21T06:09:54.725717+0000","last_unstale":"2024-09-21T06:09:55.730411+0000","last_undegraded":"2024-09-21T06:09:55.730411+0000","last_fullsized":"2024-09-21T06:09:55.730411+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:18:28.774369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730850+0000","last_change":"2024-09-21T06:09:54.732670+0000","last_active":"2024-09-21T06:09:55.730850+0000","last_peered":"2024-09-21T06:09:55.730850+0000","last_clean":"2024-09-21T06:09:55.730850+0000","last_became_active":"2024-09-21T06:09:54.732010+0000","last_became_peered":"2024-09-21T06:09:54.732010+0000","last_unstale":"2024-09-21T06:09:55.730850+0000","last_undegraded":"2024-09-21T06:09:55.730850+0000","last_fullsized":"2024-09-21T06:09:55.730850+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.796356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717067+0000","last_change":"2024-09-21T06:09:54.724653+0000","last_active":"2024-09-21T06:09:55.717067+0000","last_peered":"2024-09-21T06:09:55.717067+0000","last_clean":"2024-09-21T06:09:55.717067+0000","last_became_active":"2024-09-21T06:09:54.724078+0000","last_became_peered":"2024-09-21T06:09:54.724078+0000","last_unstale":"2024-09-21T06:09:55.717067+0000","last_undegraded":"2024-09-21T06:09:55.717067+0000","last_fullsized":"2024-09-21T06:09:55.717067+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:27.464901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731393+0000","last_change":"2024-09-21T06:09:54.727550+0000","last_active":"2024-09-21T06:09:55.731393+0000","last_peered":"2024-09-21T06:09:55.731393+0000","last_clean":"2024-09-21T06:09:55.731393+0000","last_became_active":"2024-09-21T06:09:54.726379+0000","last_became_peered":"2024-09-21T06:09:54.726379+0000","last_unstale":"2024-09-21T06:09:55.731393+0000","last_undegraded":"2024-09-21T06:09:55.731393+0000","last_fullsized":"2024-09-21T06:09:55.731393+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.026478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730863+0000","last_change":"2024-09-21T06:09:54.728670+0000","last_active":"2024-09-21T06:09:55.730863+0000","last_peered":"2024-09-21T06:09:55.730863+0000","last_clean":"2024-09-21T06:09:55.730863+0000","last_became_active":"2024-09-21T06:09:54.728041+0000","last_became_peered":"2024-09-21T06:09:54.728041+0000","last_unstale":"2024-09-21T06:09:55.730863+0000","last_undegraded":"2024-09-21T06:09:55.730863+0000","last_fullsized":"2024-09-21T06:09:55.730863+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:22.315313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716647+0000","last_change":"2024-09-21T06:09:54.722797+0000","last_active":"2024-09-21T06:09:55.716647+0000","last_peered":"2024-09-21T06:09:55.716647+0000","last_clean":"2024-09-21T06:09:55.716647+0000","last_became_active":"2024-09-21T06:09:54.722520+0000","last_became_peered":"2024-09-21T06:09:54.722520+0000","last_unstale":"2024-09-21T06:09:55.716647+0000","last_undegraded":"2024-09-21T06:09:55.716647+0000","last_fullsized":"2024-09-21T06:09:55.716647+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:59.456347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734741+0000","last_change":"2024-09-21T06:09:54.724044+0000","last_active":"2024-09-21T06:09:55.734741+0000","last_peered":"2024-09-21T06:09:55.734741+0000","last_clean":"2024-09-21T06:09:55.734741+0000","last_became_active":"2024-09-21T06:09:54.723721+0000","last_became_peered":"2024-09-21T06:09:54.723721+0000","last_unstale":"2024-09-21T06:09:55.734741+0000","last_undegraded":"2024-09-21T06:09:55.734741+0000","last_fullsized":"2024-09-21T06:09:55.734741+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:59.714119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714355+0000","last_change":"2024-09-21T06:09:54.728270+0000","last_active":"2024-09-21T06:09:55.714355+0000","last_peered":"2024-09-21T06:09:55.714355+0000","last_clean":"2024-09-21T06:09:55.714355+0000","last_became_active":"2024-09-21T06:09:54.727623+0000","last_became_peered":"2024-09-21T06:09:54.727623+0000","last_unstale":"2024-09-21T06:09:55.714355+0000","last_undegraded":"2024-09-21T06:09:55.714355+0000","last_fullsized":"2024-09-21T06:09:55.714355+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:38.958945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715843+0000","last_change":"2024-09-21T06:09:54.731705+0000","last_active":"2024-09-21T06:09:55.715843+0000","last_peered":"2024-09-21T06:09:55.715843+0000","last_clean":"2024-09-21T06:09:55.715843+0000","last_became_active":"2024-09-21T06:09:54.731362+0000","last_became_peered":"2024-09-21T06:09:54.731362+0000","last_unstale":"2024-09-21T06:09:55.715843+0000","last_undegraded":"2024-09-21T06:09:55.715843+0000","last_fullsized":"2024-09-21T06:09:55.715843+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:54.473387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734695+0000","last_change":"2024-09-21T06:09:54.721916+0000","last_active":"2024-09-21T06:09:55.734695+0000","last_peered":"2024-09-21T06:09:55.734695+0000","last_clean":"2024-09-21T06:09:55.734695+0000","last_became_active":"2024-09-21T06:09:54.721326+0000","last_became_peered":"2024-09-21T06:09:54.721326+0000","last_unstale":"2024-09-21T06:09:55.734695+0000","last_undegraded":"2024-09-21T06:09:55.734695+0000","last_fullsized":"2024-09-21T06:09:55.734695+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:48.523433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"117'4","reported_seq":19,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717468+0000","last_change":"2024-09-21T06:09:53.708840+0000","last_active":"2024-09-21T06:09:55.717468+0000","last_peered":"2024-09-21T06:09:55.717468+0000","last_clean":"2024-09-21T06:09:55.717468+0000","last_became_active":"2024-09-21T06:09:53.708196+0000","last_became_peered":"2024-09-21T06:09:53.708196+0000","last_unstale":"2024-09-21T06:09:55.717468+0000","last_undegraded":"2024-09-21T06:09:55.717468+0000","last_fullsized":"2024-09-21T06:09:55.717468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:30.651982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714991+0000","last_change":"2024-09-21T06:09:54.721812+0000","last_active":"2024-09-21T06:09:55.714991+0000","last_peered":"2024-09-21T06:09:55.714991+0000","last_clean":"2024-09-21T06:09:55.714991+0000","last_became_active":"2024-09-21T06:09:54.721537+0000","last_became_peered":"2024-09-21T06:09:54.721537+0000","last_unstale":"2024-09-21T06:09:55.714991+0000","last_undegraded":"2024-09-21T06:09:55.714991+0000","last_fullsized":"2024-09-21T06:09:55.714991+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:56.349454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730594+0000","last_change":"2024-09-21T06:09:53.709117+0000","last_active":"2024-09-21T06:09:55.730594+0000","last_peered":"2024-09-21T06:09:55.730594+0000","last_clean":"2024-09-21T06:09:55.730594+0000","last_became_active":"2024-09-21T06:09:53.708817+0000","last_became_peered":"2024-09-21T06:09:53.708817+0000","last_unstale":"2024-09-21T06:09:55.730594+0000","last_undegraded":"2024-09-21T06:09:55.730594+0000","last_fullsized":"2024-09-21T06:09:55.730594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:07.728499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716382+0000","last_change":"2024-09-21T06:09:54.727107+0000","last_active":"2024-09-21T06:09:55.716382+0000","last_peered":"2024-09-21T06:09:55.716382+0000","last_clean":"2024-09-21T06:09:55.716382+0000","last_became_active":"2024-09-21T06:09:54.726848+0000","last_became_peered":"2024-09-21T06:09:54.726848+0000","last_unstale":"2024-09-21T06:09:55.716382+0000","last_undegraded":"2024-09-21T06:09:55.716382+0000","last_fullsized":"2024-09-21T06:09:55.716382+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:04.970454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717544+0000","last_change":"2024-09-21T06:09:53.717421+0000","last_active":"2024-09-21T06:09:55.717544+0000","last_peered":"2024-09-21T06:09:55.717544+0000","last_clean":"2024-09-21T06:09:55.717544+0000","last_became_active":"2024-09-21T06:09:53.716764+0000","last_became_peered":"2024-09-21T06:09:53.716764+0000","last_unstale":"2024-09-21T06:09:55.717544+0000","last_undegraded":"2024-09-21T06:09:55.717544+0000","last_fullsized":"2024-09-21T06:09:55.717544+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.517669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176189+0000","last_change":"2024-09-21T06:09:54.725487+0000","last_active":"2024-09-21T06:09:56.176189+0000","last_peered":"2024-09-21T06:09:56.176189+0000","last_clean":"2024-09-21T06:09:56.176189+0000","last_became_active":"2024-09-21T06:09:54.725230+0000","last_became_peered":"2024-09-21T06:09:54.725230+0000","last_unstale":"2024-09-21T06:09:56.176189+0000","last_undegraded":"2024-09-21T06:09:56.176189+0000","last_fullsized":"2024-09-21T06:09:56.176189+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:46.234485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717222+0000","last_change":"2024-09-21T06:09:53.710816+0000","last_active":"2024-09-21T06:09:55.717222+0000","last_peered":"2024-09-21T06:09:55.717222+0000","last_clean":"2024-09-21T06:09:55.717222+0000","last_became_active":"2024-09-21T06:09:53.710001+0000","last_became_peered":"2024-09-21T06:09:53.710001+0000","last_unstale":"2024-09-21T06:09:55.717222+0000","last_undegraded":"2024-09-21T06:09:55.717222+0000","last_fullsized":"2024-09-21T06:09:55.717222+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:26.581020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.729924+0000","last_change":"2024-09-21T06:09:54.728541+0000","last_active":"2024-09-21T06:09:55.729924+0000","last_peered":"2024-09-21T06:09:55.729924+0000","last_clean":"2024-09-21T06:09:55.729924+0000","last_became_active":"2024-09-21T06:09:54.728260+0000","last_became_peered":"2024-09-21T06:09:54.728260+0000","last_unstale":"2024-09-21T06:09:55.729924+0000","last_undegraded":"2024-09-21T06:09:55.729924+0000","last_fullsized":"2024-09-21T06:09:55.729924+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:17.847265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716198+0000","last_change":"2024-09-21T06:09:53.707087+0000","last_active":"2024-09-21T06:09:55.716198+0000","last_peered":"2024-09-21T06:09:55.716198+0000","last_clean":"2024-09-21T06:09:55.716198+0000","last_became_active":"2024-09-21T06:09:53.706816+0000","last_became_peered":"2024-09-21T06:09:53.706816+0000","last_unstale":"2024-09-21T06:09:55.716198+0000","last_undegraded":"2024-09-21T06:09:55.716198+0000","last_fullsized":"2024-09-21T06:09:55.716198+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:37.509665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731628+0000","last_change":"2024-09-21T06:09:54.729507+0000","last_active":"2024-09-21T06:09:55.731628+0000","last_peered":"2024-09-21T06:09:55.731628+0000","last_clean":"2024-09-21T06:09:55.731628+0000","last_became_active":"2024-09-21T06:09:54.728916+0000","last_became_peered":"2024-09-21T06:09:54.728916+0000","last_unstale":"2024-09-21T06:09:55.731628+0000","last_undegraded":"2024-09-21T06:09:55.731628+0000","last_fullsized":"2024-09-21T06:09:55.731628+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:36.715451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717560+0000","last_change":"2024-09-21T06:09:53.709283+0000","last_active":"2024-09-21T06:09:55.717560+0000","last_peered":"2024-09-21T06:09:55.717560+0000","last_clean":"2024-09-21T06:09:55.717560+0000","last_became_active":"2024-09-21T06:09:53.708580+0000","last_became_peered":"2024-09-21T06:09:53.708580+0000","last_unstale":"2024-09-21T06:09:55.717560+0000","last_undegraded":"2024-09-21T06:09:55.717560+0000","last_fullsized":"2024-09-21T06:09:55.717560+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:28.034289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714812+0000","last_change":"2024-09-21T06:09:54.715641+0000","last_active":"2024-09-21T06:09:55.714812+0000","last_peered":"2024-09-21T06:09:55.714812+0000","last_clean":"2024-09-21T06:09:55.714812+0000","last_became_active":"2024-09-21T06:09:54.715060+0000","last_became_peered":"2024-09-21T06:09:54.715060+0000","last_unstale":"2024-09-21T06:09:55.714812+0000","last_undegraded":"2024-09-21T06:09:55.714812+0000","last_fullsized":"2024-09-21T06:09:55.714812+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:06.471482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730978+0000","last_change":"2024-09-21T06:09:53.711159+0000","last_active":"2024-09-21T06:09:55.730978+0000","last_peered":"2024-09-21T06:09:55.730978+0000","last_clean":"2024-09-21T06:09:55.730978+0000","last_became_active":"2024-09-21T06:09:53.710652+0000","last_became_peered":"2024-09-21T06:09:53.710652+0000","last_unstale":"2024-09-21T06:09:55.730978+0000","last_undegraded":"2024-09-21T06:09:55.730978+0000","last_fullsized":"2024-09-21T06:09:55.730978+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:42.308269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175900+0000","last_change":"2024-09-21T06:09:54.726655+0000","last_active":"2024-09-21T06:09:56.175900+0000","last_peered":"2024-09-21T06:09:56.175900+0000","last_clean":"2024-09-21T06:09:56.175900+0000","last_became_active":"2024-09-21T06:09:54.725159+0000","last_became_peered":"2024-09-21T06:09:54.725159+0000","last_unstale":"2024-09-21T06:09:56.175900+0000","last_undegraded":"2024-09-21T06:09:56.175900+0000","last_fullsized":"2024-09-21T06:09:56.175900+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:00.816412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716794+0000","last_change":"2024-09-21T06:09:53.706233+0000","last_active":"2024-09-21T06:09:55.716794+0000","last_peered":"2024-09-21T06:09:55.716794+0000","last_clean":"2024-09-21T06:09:55.716794+0000","last_became_active":"2024-09-21T06:09:53.705963+0000","last_became_peered":"2024-09-21T06:09:53.705963+0000","last_unstale":"2024-09-21T06:09:55.716794+0000","last_undegraded":"2024-09-21T06:09:55.716794+0000","last_fullsized":"2024-09-21T06:09:55.716794+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:35.353187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716325+0000","last_change":"2024-09-21T06:09:54.736294+0000","last_active":"2024-09-21T06:09:55.716325+0000","last_peered":"2024-09-21T06:09:55.716325+0000","last_clean":"2024-09-21T06:09:55.716325+0000","last_became_active":"2024-09-21T06:09:54.730284+0000","last_became_peered":"2024-09-21T06:09:54.730284+0000","last_unstale":"2024-09-21T06:09:55.716325+0000","last_undegraded":"2024-09-21T06:09:55.716325+0000","last_fullsized":"2024-09-21T06:09:55.716325+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:31.076145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716151+0000","last_change":"2024-09-21T06:09:53.711582+0000","last_active":"2024-09-21T06:09:55.716151+0000","last_peered":"2024-09-21T06:09:55.716151+0000","last_clean":"2024-09-21T06:09:55.716151+0000","last_became_active":"2024-09-21T06:09:53.708856+0000","last_became_peered":"2024-09-21T06:09:53.708856+0000","last_unstale":"2024-09-21T06:09:55.716151+0000","last_undegraded":"2024-09-21T06:09:55.716151+0000","last_fullsized":"2024-09-21T06:09:55.716151+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:47.820189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175815+0000","last_change":"2024-09-21T06:09:54.730231+0000","last_active":"2024-09-21T06:09:56.175815+0000","last_peered":"2024-09-21T06:09:56.175815+0000","last_clean":"2024-09-21T06:09:56.175815+0000","last_became_active":"2024-09-21T06:09:54.728824+0000","last_became_peered":"2024-09-21T06:09:54.728824+0000","last_unstale":"2024-09-21T06:09:56.175815+0000","last_undegraded":"2024-09-21T06:09:56.175815+0000","last_fullsized":"2024-09-21T06:09:56.175815+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:11.160184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714164+0000","last_change":"2024-09-21T06:09:53.709837+0000","last_active":"2024-09-21T06:09:55.714164+0000","last_peered":"2024-09-21T06:09:55.714164+0000","last_clean":"2024-09-21T06:09:55.714164+0000","last_became_active":"2024-09-21T06:09:53.709495+0000","last_became_peered":"2024-09-21T06:09:53.709495+0000","last_unstale":"2024-09-21T06:09:55.714164+0000","last_undegraded":"2024-09-21T06:09:55.714164+0000","last_fullsized":"2024-09-21T06:09:55.714164+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:38.922341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730224+0000","last_change":"2024-09-21T06:09:54.730242+0000","last_active":"2024-09-21T06:09:55.730224+0000","last_peered":"2024-09-21T06:09:55.730224+0000","last_clean":"2024-09-21T06:09:55.730224+0000","last_became_active":"2024-09-21T06:09:54.729746+0000","last_became_peered":"2024-09-21T06:09:54.729746+0000","last_unstale":"2024-09-21T06:09:55.730224+0000","last_undegraded":"2024-09-21T06:09:55.730224+0000","last_fullsized":"2024-09-21T06:09:55.730224+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:33.878983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"117'3","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731051+0000","last_change":"2024-09-21T06:09:53.703188+0000","last_active":"2024-09-21T06:09:55.731051+0000","last_peered":"2024-09-21T06:09:55.731051+0000","last_clean":"2024-09-21T06:09:55.731051+0000","last_became_active":"2024-09-21T06:09:53.702921+0000","last_became_peered":"2024-09-21T06:09:53.702921+0000","last_unstale":"2024-09-21T06:09:55.731051+0000","last_undegraded":"2024-09-21T06:09:55.731051+0000","last_fullsized":"2024-09-21T06:09:55.731051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:12.373702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730486+0000","last_change":"2024-09-21T06:09:54.734902+0000","last_active":"2024-09-21T06:09:55.730486+0000","last_peered":"2024-09-21T06:09:55.730486+0000","last_clean":"2024-09-21T06:09:55.730486+0000","last_became_active":"2024-09-21T06:09:54.734717+0000","last_became_peered":"2024-09-21T06:09:54.734717+0000","last_unstale":"2024-09-21T06:09:55.730486+0000","last_undegraded":"2024-09-21T06:09:55.730486+0000","last_fullsized":"2024-09-21T06:09:55.730486+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:41.612679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"117'6","reported_seq":21,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176300+0000","last_change":"2024-09-21T06:09:53.705254+0000","last_active":"2024-09-21T06:09:56.176300+0000","last_peered":"2024-09-21T06:09:56.176300+0000","last_clean":"2024-09-21T06:09:56.176300+0000","last_became_active":"2024-09-21T06:09:53.704428+0000","last_became_peered":"2024-09-21T06:09:53.704428+0000","last_unstale":"2024-09-21T06:09:56.176300+0000","last_undegraded":"2024-09-21T06:09:56.176300+0000","last_fullsized":"2024-09-21T06:09:56.176300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:11.801399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.714693+0000","last_change":"2024-09-21T06:09:54.720301+0000","last_active":"2024-09-21T06:09:55.714693+0000","last_peered":"2024-09-21T06:09:55.714693+0000","last_clean":"2024-09-21T06:09:55.714693+0000","last_became_active":"2024-09-21T06:09:54.719957+0000","last_became_peered":"2024-09-21T06:09:54.719957+0000","last_unstale":"2024-09-21T06:09:55.714693+0000","last_undegraded":"2024-09-21T06:09:55.714693+0000","last_fullsized":"2024-09-21T06:09:55.714693+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:31.133304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734916+0000","last_change":"2024-09-21T06:09:53.712908+0000","last_active":"2024-09-21T06:09:55.734916+0000","last_peered":"2024-09-21T06:09:55.734916+0000","last_clean":"2024-09-21T06:09:55.734916+0000","last_became_active":"2024-09-21T06:09:53.712614+0000","last_became_peered":"2024-09-21T06:09:53.712614+0000","last_unstale":"2024-09-21T06:09:55.734916+0000","last_undegraded":"2024-09-21T06:09:55.734916+0000","last_fullsized":"2024-09-21T06:09:55.734916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:38.791443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716404+0000","last_change":"2024-09-21T06:09:54.734698+0000","last_active":"2024-09-21T06:09:55.716404+0000","last_peered":"2024-09-21T06:09:55.716404+0000","last_clean":"2024-09-21T06:09:55.716404+0000","last_became_active":"2024-09-21T06:09:54.733975+0000","last_became_peered":"2024-09-21T06:09:54.733975+0000","last_unstale":"2024-09-21T06:09:55.716404+0000","last_undegraded":"2024-09-21T06:09:55.716404+0000","last_fullsized":"2024-09-21T06:09:55.716404+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:43.545807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734790+0000","last_change":"2024-09-21T06:09:53.715095+0000","last_active":"2024-09-21T06:09:55.734790+0000","last_peered":"2024-09-21T06:09:55.734790+0000","last_clean":"2024-09-21T06:09:55.734790+0000","last_became_active":"2024-09-21T06:09:53.714836+0000","last_became_peered":"2024-09-21T06:09:53.714836+0000","last_unstale":"2024-09-21T06:09:55.734790+0000","last_undegraded":"2024-09-21T06:09:55.734790+0000","last_fullsized":"2024-09-21T06:09:55.734790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:20.909713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.175577+0000","last_change":"2024-09-21T06:09:54.731656+0000","last_active":"2024-09-21T06:09:56.175577+0000","last_peered":"2024-09-21T06:09:56.175577+0000","last_clean":"2024-09-21T06:09:56.175577+0000","last_became_active":"2024-09-21T06:09:54.731312+0000","last_became_peered":"2024-09-21T06:09:54.731312+0000","last_unstale":"2024-09-21T06:09:56.175577+0000","last_undegraded":"2024-09-21T06:09:56.175577+0000","last_fullsized":"2024-09-21T06:09:56.175577+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:50.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176254+0000","last_change":"2024-09-21T06:09:53.708722+0000","last_active":"2024-09-21T06:09:56.176254+0000","last_peered":"2024-09-21T06:09:56.176254+0000","last_clean":"2024-09-21T06:09:56.176254+0000","last_became_active":"2024-09-21T06:09:53.707835+0000","last_became_peered":"2024-09-21T06:09:53.707835+0000","last_unstale":"2024-09-21T06:09:56.176254+0000","last_undegraded":"2024-09-21T06:09:56.176254+0000","last_fullsized":"2024-09-21T06:09:56.176254+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:35.218693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734347+0000","last_change":"2024-09-21T06:09:54.727696+0000","last_active":"2024-09-21T06:09:55.734347+0000","last_peered":"2024-09-21T06:09:55.734347+0000","last_clean":"2024-09-21T06:09:55.734347+0000","last_became_active":"2024-09-21T06:09:54.727162+0000","last_became_peered":"2024-09-21T06:09:54.727162+0000","last_unstale":"2024-09-21T06:09:55.734347+0000","last_undegraded":"2024-09-21T06:09:55.734347+0000","last_fullsized":"2024-09-21T06:09:55.734347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:05.088265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"117'8","reported_seq":23,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715907+0000","last_change":"2024-09-21T06:09:53.707015+0000","last_active":"2024-09-21T06:09:55.715907+0000","last_peered":"2024-09-21T06:09:55.715907+0000","last_clean":"2024-09-21T06:09:55.715907+0000","last_became_active":"2024-09-21T06:09:53.706448+0000","last_became_peered":"2024-09-21T06:09:53.706448+0000","last_unstale":"2024-09-21T06:09:55.715907+0000","last_undegraded":"2024-09-21T06:09:55.715907+0000","last_fullsized":"2024-09-21T06:09:55.715907+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:38.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730491+0000","last_change":"2024-09-21T06:09:54.724424+0000","last_active":"2024-09-21T06:09:55.730491+0000","last_peered":"2024-09-21T06:09:55.730491+0000","last_clean":"2024-09-21T06:09:55.730491+0000","last_became_active":"2024-09-21T06:09:54.723860+0000","last_became_peered":"2024-09-21T06:09:54.723860+0000","last_unstale":"2024-09-21T06:09:55.730491+0000","last_undegraded":"2024-09-21T06:09:55.730491+0000","last_fullsized":"2024-09-21T06:09:55.730491+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:44.963028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176380+0000","last_change":"2024-09-21T06:09:53.714184+0000","last_active":"2024-09-21T06:09:56.176380+0000","last_peered":"2024-09-21T06:09:56.176380+0000","last_clean":"2024-09-21T06:09:56.176380+0000","last_became_active":"2024-09-21T06:09:53.713745+0000","last_became_peered":"2024-09-21T06:09:53.713745+0000","last_unstale":"2024-09-21T06:09:56.176380+0000","last_undegraded":"2024-09-21T06:09:56.176380+0000","last_fullsized":"2024-09-21T06:09:56.176380+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:27.231816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.729917+0000","last_change":"2024-09-21T06:09:54.728066+0000","last_active":"2024-09-21T06:09:55.729917+0000","last_peered":"2024-09-21T06:09:55.729917+0000","last_clean":"2024-09-21T06:09:55.729917+0000","last_became_active":"2024-09-21T06:09:54.727684+0000","last_became_peered":"2024-09-21T06:09:54.727684+0000","last_unstale":"2024-09-21T06:09:55.729917+0000","last_undegraded":"2024-09-21T06:09:55.729917+0000","last_fullsized":"2024-09-21T06:09:55.729917+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:07.233797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730877+0000","last_change":"2024-09-21T06:09:53.710971+0000","last_active":"2024-09-21T06:09:55.730877+0000","last_peered":"2024-09-21T06:09:55.730877+0000","last_clean":"2024-09-21T06:09:55.730877+0000","last_became_active":"2024-09-21T06:09:53.710679+0000","last_became_peered":"2024-09-21T06:09:53.710679+0000","last_unstale":"2024-09-21T06:09:55.730877+0000","last_undegraded":"2024-09-21T06:09:55.730877+0000","last_fullsized":"2024-09-21T06:09:55.730877+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:12.489290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.732013+0000","last_change":"2024-09-21T06:09:54.733166+0000","last_active":"2024-09-21T06:09:55.732013+0000","last_peered":"2024-09-21T06:09:55.732013+0000","last_clean":"2024-09-21T06:09:55.732013+0000","last_became_active":"2024-09-21T06:09:54.730779+0000","last_became_peered":"2024-09-21T06:09:54.730779+0000","last_unstale":"2024-09-21T06:09:55.732013+0000","last_undegraded":"2024-09-21T06:09:55.732013+0000","last_fullsized":"2024-09-21T06:09:55.732013+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:39.039184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716785+0000","last_change":"2024-09-21T06:09:53.713604+0000","last_active":"2024-09-21T06:09:55.716785+0000","last_peered":"2024-09-21T06:09:55.716785+0000","last_clean":"2024-09-21T06:09:55.716785+0000","last_became_active":"2024-09-21T06:09:53.712555+0000","last_became_peered":"2024-09-21T06:09:53.712555+0000","last_unstale":"2024-09-21T06:09:55.716785+0000","last_undegraded":"2024-09-21T06:09:55.716785+0000","last_fullsized":"2024-09-21T06:09:55.716785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:00.616919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734884+0000","last_change":"2024-09-21T06:09:54.724631+0000","last_active":"2024-09-21T06:09:55.734884+0000","last_peered":"2024-09-21T06:09:55.734884+0000","last_clean":"2024-09-21T06:09:55.734884+0000","last_became_active":"2024-09-21T06:09:54.724018+0000","last_became_peered":"2024-09-21T06:09:54.724018+0000","last_unstale":"2024-09-21T06:09:55.734884+0000","last_undegraded":"2024-09-21T06:09:55.734884+0000","last_fullsized":"2024-09-21T06:09:55.734884+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:48.871033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717616+0000","last_change":"2024-09-21T06:09:53.718333+0000","last_active":"2024-09-21T06:09:55.717616+0000","last_peered":"2024-09-21T06:09:55.717616+0000","last_clean":"2024-09-21T06:09:55.717616+0000","last_became_active":"2024-09-21T06:09:53.717703+0000","last_became_peered":"2024-09-21T06:09:53.717703+0000","last_unstale":"2024-09-21T06:09:55.717616+0000","last_undegraded":"2024-09-21T06:09:55.717616+0000","last_fullsized":"2024-09-21T06:09:55.717616+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:57.064938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734316+0000","last_change":"2024-09-21T06:09:54.735645+0000","last_active":"2024-09-21T06:09:55.734316+0000","last_peered":"2024-09-21T06:09:55.734316+0000","last_clean":"2024-09-21T06:09:55.734316+0000","last_became_active":"2024-09-21T06:09:54.735360+0000","last_became_peered":"2024-09-21T06:09:54.735360+0000","last_unstale":"2024-09-21T06:09:55.734316+0000","last_undegraded":"2024-09-21T06:09:55.734316+0000","last_fullsized":"2024-09-21T06:09:55.734316+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:29.866909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.729570+0000","last_change":"2024-09-21T06:09:53.709262+0000","last_active":"2024-09-21T06:09:55.729570+0000","last_peered":"2024-09-21T06:09:55.729570+0000","last_clean":"2024-09-21T06:09:55.729570+0000","last_became_active":"2024-09-21T06:09:53.708917+0000","last_became_peered":"2024-09-21T06:09:53.708917+0000","last_unstale":"2024-09-21T06:09:55.729570+0000","last_undegraded":"2024-09-21T06:09:55.729570+0000","last_fullsized":"2024-09-21T06:09:55.729570+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:08.122167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734626+0000","last_change":"2024-09-21T06:09:54.731320+0000","last_active":"2024-09-21T06:09:55.734626+0000","last_peered":"2024-09-21T06:09:55.734626+0000","last_clean":"2024-09-21T06:09:55.734626+0000","last_became_active":"2024-09-21T06:09:54.730669+0000","last_became_peered":"2024-09-21T06:09:54.730669+0000","last_unstale":"2024-09-21T06:09:55.734626+0000","last_undegraded":"2024-09-21T06:09:55.734626+0000","last_fullsized":"2024-09-21T06:09:55.734626+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:41.549757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730418+0000","last_change":"2024-09-21T06:09:53.709993+0000","last_active":"2024-09-21T06:09:55.730418+0000","last_peered":"2024-09-21T06:09:55.730418+0000","last_clean":"2024-09-21T06:09:55.730418+0000","last_became_active":"2024-09-21T06:09:53.709716+0000","last_became_peered":"2024-09-21T06:09:53.709716+0000","last_unstale":"2024-09-21T06:09:55.730418+0000","last_undegraded":"2024-09-21T06:09:55.730418+0000","last_fullsized":"2024-09-21T06:09:55.730418+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:53.342806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731122+0000","last_change":"2024-09-21T06:09:54.724590+0000","last_active":"2024-09-21T06:09:55.731122+0000","last_peered":"2024-09-21T06:09:55.731122+0000","last_clean":"2024-09-21T06:09:55.731122+0000","last_became_active":"2024-09-21T06:09:54.724226+0000","last_became_peered":"2024-09-21T06:09:54.724226+0000","last_unstale":"2024-09-21T06:09:55.731122+0000","last_undegraded":"2024-09-21T06:09:55.731122+0000","last_fullsized":"2024-09-21T06:09:55.731122+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:03.459913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717327+0000","last_change":"2024-09-21T06:09:53.711144+0000","last_active":"2024-09-21T06:09:55.717327+0000","last_peered":"2024-09-21T06:09:55.717327+0000","last_clean":"2024-09-21T06:09:55.717327+0000","last_became_active":"2024-09-21T06:09:53.710391+0000","last_became_peered":"2024-09-21T06:09:53.710391+0000","last_unstale":"2024-09-21T06:09:55.717327+0000","last_undegraded":"2024-09-21T06:09:55.717327+0000","last_fullsized":"2024-09-21T06:09:55.717327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.449704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717252+0000","last_change":"2024-09-21T06:09:54.732230+0000","last_active":"2024-09-21T06:09:55.717252+0000","last_peered":"2024-09-21T06:09:55.717252+0000","last_clean":"2024-09-21T06:09:55.717252+0000","last_became_active":"2024-09-21T06:09:54.731646+0000","last_became_peered":"2024-09-21T06:09:54.731646+0000","last_unstale":"2024-09-21T06:09:55.717252+0000","last_undegraded":"2024-09-21T06:09:55.717252+0000","last_fullsized":"2024-09-21T06:09:55.717252+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:04.337768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730249+0000","last_change":"2024-09-21T06:09:53.710718+0000","last_active":"2024-09-21T06:09:55.730249+0000","last_peered":"2024-09-21T06:09:55.730249+0000","last_clean":"2024-09-21T06:09:55.730249+0000","last_became_active":"2024-09-21T06:09:53.710411+0000","last_became_peered":"2024-09-21T06:09:53.710411+0000","last_unstale":"2024-09-21T06:09:55.730249+0000","last_undegraded":"2024-09-21T06:09:55.730249+0000","last_fullsized":"2024-09-21T06:09:55.730249+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:37.043415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716046+0000","last_change":"2024-09-21T06:09:54.724139+0000","last_active":"2024-09-21T06:09:55.716046+0000","last_peered":"2024-09-21T06:09:55.716046+0000","last_clean":"2024-09-21T06:09:55.716046+0000","last_became_active":"2024-09-21T06:09:54.723873+0000","last_became_peered":"2024-09-21T06:09:54.723873+0000","last_unstale":"2024-09-21T06:09:55.716046+0000","last_undegraded":"2024-09-21T06:09:55.716046+0000","last_fullsized":"2024-09-21T06:09:55.716046+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:22.942833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"118'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717693+0000","last_change":"2024-09-21T06:09:53.718003+0000","last_active":"2024-09-21T06:09:55.717693+0000","last_peered":"2024-09-21T06:09:55.717693+0000","last_clean":"2024-09-21T06:09:55.717693+0000","last_became_active":"2024-09-21T06:09:53.716916+0000","last_became_peered":"2024-09-21T06:09:53.716916+0000","last_unstale":"2024-09-21T06:09:55.717693+0000","last_undegraded":"2024-09-21T06:09:55.717693+0000","last_fullsized":"2024-09-21T06:09:55.717693+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:51.259599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716632+0000","last_change":"2024-09-21T06:09:54.725206+0000","last_active":"2024-09-21T06:09:55.716632+0000","last_peered":"2024-09-21T06:09:55.716632+0000","last_clean":"2024-09-21T06:09:55.716632+0000","last_became_active":"2024-09-21T06:09:54.724924+0000","last_became_peered":"2024-09-21T06:09:54.724924+0000","last_unstale":"2024-09-21T06:09:55.716632+0000","last_undegraded":"2024-09-21T06:09:55.716632+0000","last_fullsized":"2024-09-21T06:09:55.716632+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:00.561857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.716895+0000","last_change":"2024-09-21T06:09:53.715330+0000","last_active":"2024-09-21T06:09:55.716895+0000","last_peered":"2024-09-21T06:09:55.716895+0000","last_clean":"2024-09-21T06:09:55.716895+0000","last_became_active":"2024-09-21T06:09:53.710794+0000","last_became_peered":"2024-09-21T06:09:53.710794+0000","last_unstale":"2024-09-21T06:09:55.716895+0000","last_undegraded":"2024-09-21T06:09:55.716895+0000","last_fullsized":"2024-09-21T06:09:55.716895+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:43.129579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730784+0000","last_change":"2024-09-21T06:09:54.724133+0000","last_active":"2024-09-21T06:09:55.730784+0000","last_peered":"2024-09-21T06:09:55.730784+0000","last_clean":"2024-09-21T06:09:55.730784+0000","last_became_active":"2024-09-21T06:09:54.723209+0000","last_became_peered":"2024-09-21T06:09:54.723209+0000","last_unstale":"2024-09-21T06:09:55.730784+0000","last_undegraded":"2024-09-21T06:09:55.730784+0000","last_fullsized":"2024-09-21T06:09:55.730784+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:20.324375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731300+0000","last_change":"2024-09-21T06:09:53.711730+0000","last_active":"2024-09-21T06:09:55.731300+0000","last_peered":"2024-09-21T06:09:55.731300+0000","last_clean":"2024-09-21T06:09:55.731300+0000","last_became_active":"2024-09-21T06:09:53.711350+0000","last_became_peered":"2024-09-21T06:09:53.711350+0000","last_unstale":"2024-09-21T06:09:55.731300+0000","last_undegraded":"2024-09-21T06:09:55.731300+0000","last_fullsized":"2024-09-21T06:09:55.731300+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:11.953398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734517+0000","last_change":"2024-09-21T06:09:54.727417+0000","last_active":"2024-09-21T06:09:55.734517+0000","last_peered":"2024-09-21T06:09:55.734517+0000","last_clean":"2024-09-21T06:09:55.734517+0000","last_became_active":"2024-09-21T06:09:54.725996+0000","last_became_peered":"2024-09-21T06:09:54.725996+0000","last_unstale":"2024-09-21T06:09:55.734517+0000","last_undegraded":"2024-09-21T06:09:55.734517+0000","last_fullsized":"2024-09-21T06:09:55.734517+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:57.497933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.717417+0000","last_change":"2024-09-21T06:09:53.715215+0000","last_active":"2024-09-21T06:09:55.717417+0000","last_peered":"2024-09-21T06:09:55.717417+0000","last_clean":"2024-09-21T06:09:55.717417+0000","last_became_active":"2024-09-21T06:09:53.714796+0000","last_became_peered":"2024-09-21T06:09:53.714796+0000","last_unstale":"2024-09-21T06:09:55.717417+0000","last_undegraded":"2024-09-21T06:09:55.717417+0000","last_fullsized":"2024-09-21T06:09:55.717417+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:32.161254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:56.176115+0000","last_change":"2024-09-21T06:09:54.726997+0000","last_active":"2024-09-21T06:09:56.176115+0000","last_peered":"2024-09-21T06:09:56.176115+0000","last_clean":"2024-09-21T06:09:56.176115+0000","last_became_active":"2024-09-21T06:09:54.726712+0000","last_became_peered":"2024-09-21T06:09:54.726712+0000","last_unstale":"2024-09-21T06:09:56.176115+0000","last_undegraded":"2024-09-21T06:09:56.176115+0000","last_fullsized":"2024-09-21T06:09:56.176115+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:31.958813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.731025+0000","last_change":"2024-09-21T06:09:53.712169+0000","last_active":"2024-09-21T06:09:55.731025+0000","last_peered":"2024-09-21T06:09:55.731025+0000","last_clean":"2024-09-21T06:09:55.731025+0000","last_became_active":"2024-09-21T06:09:53.711381+0000","last_became_peered":"2024-09-21T06:09:53.711381+0000","last_unstale":"2024-09-21T06:09:55.731025+0000","last_undegraded":"2024-09-21T06:09:55.731025+0000","last_fullsized":"2024-09-21T06:09:55.731025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:19.752960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.735002+0000","last_change":"2024-09-21T06:09:54.726056+0000","last_active":"2024-09-21T06:09:55.735002+0000","last_peered":"2024-09-21T06:09:55.735002+0000","last_clean":"2024-09-21T06:09:55.735002+0000","last_became_active":"2024-09-21T06:09:54.725375+0000","last_became_peered":"2024-09-21T06:09:54.725375+0000","last_unstale":"2024-09-21T06:09:55.735002+0000","last_undegraded":"2024-09-21T06:09:55.735002+0000","last_fullsized":"2024-09-21T06:09:55.735002+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:24.258408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.715137+0000","last_change":"2024-09-21T06:09:53.709948+0000","last_active":"2024-09-21T06:09:55.715137+0000","last_peered":"2024-09-21T06:09:55.715137+0000","last_clean":"2024-09-21T06:09:55.715137+0000","last_became_active":"2024-09-21T06:09:53.709689+0000","last_became_peered":"2024-09-21T06:09:53.709689+0000","last_unstale":"2024-09-21T06:09:55.715137+0000","last_undegraded":"2024-09-21T06:09:55.715137+0000","last_fullsized":"2024-09-21T06:09:55.715137+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730521+0000","last_change":"2024-09-21T06:09:54.728965+0000","last_active":"2024-09-21T06:09:55.730521+0000","last_peered":"2024-09-21T06:09:55.730521+0000","last_clean":"2024-09-21T06:09:55.730521+0000","last_became_active":"2024-09-21T06:09:54.728427+0000","last_became_peered":"2024-09-21T06:09:54.728427+0000","last_unstale":"2024-09-21T06:09:55.730521+0000","last_undegraded":"2024-09-21T06:09:55.730521+0000","last_fullsized":"2024-09-21T06:09:55.730521+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:12.894096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.735121+0000","last_change":"2024-09-21T06:09:53.716899+0000","last_active":"2024-09-21T06:09:55.735121+0000","last_peered":"2024-09-21T06:09:55.735121+0000","last_clean":"2024-09-21T06:09:55.735121+0000","last_became_active":"2024-09-21T06:09:53.716429+0000","last_became_peered":"2024-09-21T06:09:53.716429+0000","last_unstale":"2024-09-21T06:09:55.735121+0000","last_undegraded":"2024-09-21T06:09:55.735121+0000","last_fullsized":"2024-09-21T06:09:55.735121+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:27.876459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.734558+0000","last_change":"2024-09-21T06:09:54.730432+0000","last_active":"2024-09-21T06:09:55.734558+0000","last_peered":"2024-09-21T06:09:55.734558+0000","last_clean":"2024-09-21T06:09:55.734558+0000","last_became_active":"2024-09-21T06:09:54.730160+0000","last_became_peered":"2024-09-21T06:09:54.730160+0000","last_unstale":"2024-09-21T06:09:55.734558+0000","last_undegraded":"2024-09-21T06:09:55.734558+0000","last_fullsized":"2024-09-21T06:09:55.734558+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:53.690709+0000","last_clean_scrub_stamp":"2024-09-21T06:09:53.690709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:23.482999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730717+0000","last_change":"2024-09-21T06:09:53.700722+0000","last_active":"2024-09-21T06:09:55.730717+0000","last_peered":"2024-09-21T06:09:55.730717+0000","last_clean":"2024-09-21T06:09:55.730717+0000","last_became_active":"2024-09-21T06:09:53.700465+0000","last_became_peered":"2024-09-21T06:09:53.700465+0000","last_unstale":"2024-09-21T06:09:55.730717+0000","last_undegraded":"2024-09-21T06:09:55.730717+0000","last_fullsized":"2024-09-21T06:09:55.730717+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:09:52.684729+0000","last_clean_scrub_stamp":"2024-09-21T06:09:52.684729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:51.509547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":315,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-21T06:09:55.730838+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:09:55.730838+0000","last_peered":"2024-09-21T06:09:55.730838+0000","last_clean":"2024-09-21T06:09:55.730838+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:09:55.730838+0000","last_undegraded":"2024-09-21T06:09:55.730838+0000","last_fullsized":"2024-09-21T06:09:55.730838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347187,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194099,"statfs":{"total":200000000,"available":198757871,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194099,"statfs":{"total":200000000,"available":198758341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":636,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194675,"statfs":{"total":200000000,"available":199348169,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":635,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194676,"statfs":{"total":200000000,"available":199348751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347085,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":635,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194676,"statfs":{"total":200000000,"available":199348787,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":635,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194676,"statfs":{"total":200000000,"available":199348821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:10:04.624 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:10:04.625 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:10:04.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.888+0000 7f4307800640 1 -- 172.21.15.118:0/2081362966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42e4003c10 msgr2=0x7f42e4004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.888+0000 7f4307800640 1 --2- 172.21.15.118:0/2081362966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42e4003c10 0x7f42e4004060 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f42f0006fb0 tx=0x7f42e4005830 comp rx=0 tx=0).stop 2024-09-21T06:10:04.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.888+0000 7f4305800640 1 -- 172.21.15.118:0/2081362966 reap_dead start 2024-09-21T06:10:04.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.888+0000 7f4307800640 1 -- 172.21.15.118:0/2081362966 shutdown_connections 2024-09-21T06:10:04.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.888+0000 7f4307800640 1 -- 172.21.15.118:0/2081362966 >> 172.21.15.118:0/2081362966 conn(0x7f430006d110 msgr2=0x7f430006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:04.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.888+0000 7f4307800640 1 -- 172.21.15.118:0/2081362966 shutdown_connections 2024-09-21T06:10:04.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.888+0000 7f4307800640 1 -- 172.21.15.118:0/2081362966 wait complete. 2024-09-21T06:10:04.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.890+0000 7f4307800640 1 Processor -- start 2024-09-21T06:10:04.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.891+0000 7f4307800640 1 -- start start 2024-09-21T06:10:04.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f4307800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42e4003c10 0x7f430013a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f4307800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4300153ad0 0x7f430015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f4307800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4300153ee0 0x7f430015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f4307800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4300165d90 con 0x7f4300153ad0 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f4307800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f43001431a0 con 0x7f4300153ee0 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f4307800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4300165f10 con 0x7f42e4003c10 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4300153ad0 0x7f430015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4300153ad0 0x7f430015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53950/0 (socket says 172.21.15.118:53950) 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.892+0000 7f42f7e00640 1 -- 172.21.15.118:0/419103248 learned_addr learned my addr 172.21.15.118:0/419103248 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f4304e00640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42e4003c10 0x7f430013a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f4305800640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4300153ee0 0x7f430015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42f7e00640 1 -- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42e4003c10 msgr2=0x7f430013a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42f7e00640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42e4003c10 0x7f430013a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42f7e00640 1 -- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4300153ee0 msgr2=0x7f430015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42f7e00640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4300153ee0 0x7f430015c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42f7e00640 1 -- 172.21.15.118:0/419103248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43001f5940 con 0x7f4300153ad0 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42f7e00640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4300153ad0 0x7f430015bef0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f42e8004d90 tx=0x7f42e8001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42fd600640 1 -- 172.21.15.118:0/419103248 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80107d0 con 0x7f4300153ad0 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f42fd600640 1 -- 172.21.15.118:0/419103248 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e8010a60 con 0x7f4300153ad0 2024-09-21T06:10:04.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.893+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430013a730 con 0x7f4300153ad0 2024-09-21T06:10:04.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.894+0000 7f42fd600640 1 -- 172.21.15.118:0/419103248 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8011460 con 0x7f4300153ad0 2024-09-21T06:10:04.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.894+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430013c6f0 con 0x7f4300153ad0 2024-09-21T06:10:04.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.895+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4300142730 con 0x7f4300153ad0 2024-09-21T06:10:04.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.896+0000 7f42fd600640 1 -- 172.21.15.118:0/419103248 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42e8011600 con 0x7f4300153ad0 2024-09-21T06:10:04.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.897+0000 7f42fd600640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f42dc078b90 0x7f42dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.897+0000 7f42fd600640 1 -- 172.21.15.118:0/419103248 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f42e809b8a0 con 0x7f4300153ad0 2024-09-21T06:10:04.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.898+0000 7f4304e00640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f42dc078b90 0x7f42dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.898+0000 7f4304e00640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f42dc078b90 0x7f42dc07b0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42f0033000 tx=0x7f42f002d000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:04.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:04.902+0000 7f42fd600640 1 -- 172.21.15.118:0/419103248 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f43001f5940 con 0x7f4300153ad0 2024-09-21T06:10:05.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.153+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f430013c1a0 con 0x7f4300153ad0 2024-09-21T06:10:05.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.157+0000 7f42fd600640 1 -- 172.21.15.118:0/419103248 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f42e8063d00 con 0x7f4300153ad0 2024-09-21T06:10:05.158 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:10:05.158 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:10:05.158 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:10:05.158 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:10:05.159 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:10:05.159 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f42dc078b90 msgr2=0x7f42dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f42dc078b90 0x7f42dc07b0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42f0033000 tx=0x7f42f002d000 comp rx=0 tx=0).stop 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4300153ad0 msgr2=0x7f430015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4300153ad0 0x7f430015bef0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f42e8004d90 tx=0x7f42e8001800 comp rx=0 tx=0).stop 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 shutdown_connections 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4300153ee0 0x7f430015c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4300153ad0 0x7f430015bef0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f42dc078b90 0x7f42dc07b0a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 --2- 172.21.15.118:0/419103248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42e4003c10 0x7f430013a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 >> 172.21.15.118:0/419103248 conn(0x7f430006d110 msgr2=0x7f430015ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:05.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 shutdown_connections 2024-09-21T06:10:05.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.159+0000 7f4307800640 1 -- 172.21.15.118:0/419103248 wait complete. 2024-09-21T06:10:05.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:05.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 -- 172.21.15.118:0/3971298490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fae0 msgr2=0x7f4d7c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:05.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 --2- 172.21.15.118:0/3971298490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fae0 0x7f4d7c0d0e80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0cedb0 tx=0x7f4d7002a560 comp rx=0 tx=0).stop 2024-09-21T06:10:05.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 -- 172.21.15.118:0/3971298490 shutdown_connections 2024-09-21T06:10:05.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 --2- 172.21.15.118:0/3971298490 >> v2:172.21.15.149:3300/0 conn(0x7f4d7c13fef0 0x7f4d7c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 --2- 172.21.15.118:0/3971298490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fae0 0x7f4d7c0d0e80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 -- 172.21.15.118:0/3971298490 >> 172.21.15.118:0/3971298490 conn(0x7f4d7c06d110 msgr2=0x7f4d7c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:05.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 -- 172.21.15.118:0/3971298490 shutdown_connections 2024-09-21T06:10:05.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.402+0000 7f4d84200640 1 -- 172.21.15.118:0/3971298490 wait complete. 2024-09-21T06:10:05.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.405+0000 7f4d84200640 1 Processor -- start 2024-09-21T06:10:05.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.405+0000 7f4d84200640 1 -- start start 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d84200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c13fae0 0x7f4d7c13eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d84200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fef0 0x7f4d7c1edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d84200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c142730 0x7f4d7c1f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d84200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0cfa70 con 0x7f4d7c13fef0 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d84200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0cf8f0 con 0x7f4d7c142730 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d84200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c0cfbf0 con 0x7f4d7c13fae0 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d80e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fef0 0x7f4d7c1edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d80e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fef0 0x7f4d7c1edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53974/0 (socket says 172.21.15.118:53974) 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.406+0000 7f4d80e00640 1 -- 172.21.15.118:0/3297390303 learned_addr learned my addr 172.21.15.118:0/3297390303 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:05.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d81800640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c13fae0 0x7f4d7c13eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d82200640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c142730 0x7f4d7c1f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d80e00640 1 -- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c13fae0 msgr2=0x7f4d7c13eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d80e00640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c13fae0 0x7f4d7c13eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d80e00640 1 -- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c142730 msgr2=0x7f4d7c1f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d80e00640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c142730 0x7f4d7c1f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d80e00640 1 -- 172.21.15.118:0/3297390303 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c1ee1c0 con 0x7f4d7c13fef0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d80e00640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fef0 0x7f4d7c1edc80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800d700 tx=0x7f4d6800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.407+0000 7f4d79600640 1 -- 172.21.15.118:0/3297390303 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68017070 con 0x7f4d7c13fef0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.408+0000 7f4d79600640 1 -- 172.21.15.118:0/3297390303 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d68005310 con 0x7f4d7c13fef0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.408+0000 7f4d79600640 1 -- 172.21.15.118:0/3297390303 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68009820 con 0x7f4d7c13fef0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.408+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c1f80d0 con 0x7f4d7c13fef0 2024-09-21T06:10:05.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.408+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c1557a0 con 0x7f4d7c13fef0 2024-09-21T06:10:05.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.409+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c0d0110 con 0x7f4d7c13fef0 2024-09-21T06:10:05.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.410+0000 7f4d79600640 1 -- 172.21.15.118:0/3297390303 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d680099c0 con 0x7f4d7c13fef0 2024-09-21T06:10:05.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.411+0000 7f4d79600640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4d5c078b90 0x7f4d5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:05.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.412+0000 7f4d79600640 1 -- 172.21.15.118:0/3297390303 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f4d6809ae40 con 0x7f4d7c13fef0 2024-09-21T06:10:05.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.412+0000 7f4d81800640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4d5c078b90 0x7f4d5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:05.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.413+0000 7f4d81800640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4d5c078b90 0x7f4d5c07b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4d70033000 tx=0x7f4d70004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.416+0000 7f4d79600640 1 -- 172.21.15.118:0/3297390303 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4d68062b90 con 0x7f4d7c13fef0 2024-09-21T06:10:05.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.642+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d7c155210 con 0x7f4d7c13fef0 2024-09-21T06:10:05.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.642+0000 7f4d79600640 1 -- 172.21.15.118:0/3297390303 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7f4d680675c0 con 0x7f4d7c13fef0 2024-09-21T06:10:05.644 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:05.644 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:10:05.644 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:10:05.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4d5c078b90 msgr2=0x7f4d5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:05.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4d5c078b90 0x7f4d5c07b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4d70033000 tx=0x7f4d70004730 comp rx=0 tx=0).stop 2024-09-21T06:10:05.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fef0 msgr2=0x7f4d7c1edc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:05.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fef0 0x7f4d7c1edc80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800d700 tx=0x7f4d6800dbc0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 shutdown_connections 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c142730 0x7f4d7c1f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c13fef0 0x7f4d7c1edc80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4d5c078b90 0x7f4d5c07b0a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 --2- 172.21.15.118:0/3297390303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c13fae0 0x7f4d7c13eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 >> 172.21.15.118:0/3297390303 conn(0x7f4d7c06d110 msgr2=0x7f4d7c15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 shutdown_connections 2024-09-21T06:10:05.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:05.645+0000 7f4d84200640 1 -- 172.21.15.118:0/3297390303 wait complete. 2024-09-21T06:10:06.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:09:54.198104+0000', 'modified': '2024-09-21T06:09:57.210901+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6597': {'gid': 6597, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/3458774046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 3458774046}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 3458774046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6597, 'qdb_cluster': [6597]} 2024-09-21T06:10:06.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:10:06.071 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:10:06.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.290+0000 7fd6cb200640 1 -- 172.21.15.118:0/1085461601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 msgr2=0x7fd6c40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.290+0000 7fd6cb200640 1 --2- 172.21.15.118:0/1085461601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c40d0e80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd6c415d7d0 tx=0x7fd6b402a540 comp rx=0 tx=0).stop 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.290+0000 7fd6cb200640 1 -- 172.21.15.118:0/1085461601 shutdown_connections 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.290+0000 7fd6cb200640 1 --2- 172.21.15.118:0/1085461601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6c4142730 0x7fd6c4142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.290+0000 7fd6cb200640 1 --2- 172.21.15.118:0/1085461601 >> v2:172.21.15.149:3300/0 conn(0x7fd6c413fef0 0x7fd6c40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.290+0000 7fd6cb200640 1 --2- 172.21.15.118:0/1085461601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c40d0e80 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.290+0000 7fd6cb200640 1 -- 172.21.15.118:0/1085461601 >> 172.21.15.118:0/1085461601 conn(0x7fd6c406d110 msgr2=0x7fd6c406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.291+0000 7fd6cb200640 1 -- 172.21.15.118:0/1085461601 shutdown_connections 2024-09-21T06:10:06.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.291+0000 7fd6cb200640 1 -- 172.21.15.118:0/1085461601 wait complete. 2024-09-21T06:10:06.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.293+0000 7fd6cb200640 1 Processor -- start 2024-09-21T06:10:06.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.293+0000 7fd6cb200640 1 -- start start 2024-09-21T06:10:06.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.294+0000 7fd6cb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c4074870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.294+0000 7fd6cb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6c413fef0 0x7fd6c415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.294+0000 7fd6cb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6c4142730 0x7fd6c41531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.294+0000 7fd6cb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c406f300 con 0x7fd6c413fae0 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.294+0000 7fd6cb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c406f180 con 0x7fd6c4142730 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.294+0000 7fd6cb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c406f480 con 0x7fd6c413fef0 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c4074870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c4074870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42912/0 (socket says 172.21.15.118:42912) 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3049129939 learned_addr learned my addr 172.21.15.118:0/3049129939 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6bb400640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6c413fef0 0x7fd6c415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c9200640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6c4142730 0x7fd6c41531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6c413fef0 msgr2=0x7fd6c415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6c413fef0 0x7fd6c415c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6c4142730 msgr2=0x7fd6c41531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6c4142730 0x7fd6c41531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.295+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3049129939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c4073810 con 0x7fd6c413fae0 2024-09-21T06:10:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.296+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c4074870 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4005fd0 tx=0x7fd6b40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.296+0000 7fd6c0c00640 1 -- 172.21.15.118:0/3049129939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b403e030 con 0x7fd6c413fae0 2024-09-21T06:10:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.296+0000 7fd6c0c00640 1 -- 172.21.15.118:0/3049129939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6b4003db0 con 0x7fd6c413fae0 2024-09-21T06:10:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.296+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c4073ab0 con 0x7fd6c413fae0 2024-09-21T06:10:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.296+0000 7fd6c0c00640 1 -- 172.21.15.118:0/3049129939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4035040 con 0x7fd6c413fae0 2024-09-21T06:10:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.296+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c4074070 con 0x7fd6c413fae0 2024-09-21T06:10:06.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.299+0000 7fd6c0c00640 1 -- 172.21.15.118:0/3049129939 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd6b4041030 con 0x7fd6c413fae0 2024-09-21T06:10:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.300+0000 7fd6c0c00640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd6a0078b90 0x7fd6a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.300+0000 7fd6c0c00640 1 -- 172.21.15.118:0/3049129939 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fd6b40bb690 con 0x7fd6c413fae0 2024-09-21T06:10:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.301+0000 7fd6d2260740 1 Processor -- start 2024-09-21T06:10:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.301+0000 7fd6d2260740 1 -- start start 2024-09-21T06:10:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.301+0000 7fd6bb400640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd6a0078b90 0x7fd6a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6bb400640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd6a0078b90 0x7fd6a007b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd6c413b8f0 tx=0x7fd6ac005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdb3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdb3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176cd83f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6d2260740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x56176cd0d430 con 0x56176c9c2590 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56176ccfd5d0 con 0x56176c9e3270 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56176cceca00 con 0x56176c9ba3b0 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6c9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176cd83f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.302+0000 7fd6c9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176cd83f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42926/0 (socket says 172.21.15.118:42926) 2024-09-21T06:10:06.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6bb400640 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdb3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c9200640 1 -- 172.21.15.118:0/1354925482 learned_addr learned my addr 172.21.15.118:0/1354925482 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:06.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdb3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c9200640 1 -- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 msgr2=0x56176cdb3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c9200640 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdb3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c9200640 1 -- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 msgr2=0x56176cdb3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c9200640 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdb3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c9200640 1 -- 172.21.15.118:0/1354925482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176ccb5520 con 0x56176c9c2590 2024-09-21T06:10:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6c9200640 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176cd83f60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009e70 tx=0x7fd6bc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0b09a61f236c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.303+0000 7fd6b8c00640 1 -- 172.21.15.118:0/1354925482 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc016070 con 0x56176c9c2590 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6b8c00640 1 -- 172.21.15.118:0/1354925482 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6bc01b750 con 0x56176c9c2590 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6b8c00640 1 -- 172.21.15.118:0/1354925482 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc01bb80 con 0x56176c9c2590 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 -- 172.21.15.118:0/1354925482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 msgr2=0x56176cd83f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176cd83f60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009e70 tx=0x7fd6bc010740 comp rx=0 tx=0).stop 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 -- 172.21.15.118:0/1354925482 shutdown_connections 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176cd83f60 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdb3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1354925482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdb3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 -- 172.21.15.118:0/1354925482 >> 172.21.15.118:0/1354925482 conn(0x56176c9d73c0 msgr2=0x56176cd89970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 -- 172.21.15.118:0/1354925482 shutdown_connections 2024-09-21T06:10:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.304+0000 7fd6d2260740 1 -- 172.21.15.118:0/1354925482 wait complete. 2024-09-21T06:10:06.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.305+0000 7fd6d2260740 1 -- start start 2024-09-21T06:10:06.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.306+0000 7fd6d2260740 1 Processor -- start 2024-09-21T06:10:06.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176cdb1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176cde1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6d2260740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x56176cc93330 con 0x56176c9ba3b0 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56176ccf0810 con 0x56176c9c2590 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56176ca5d620 con 0x56176c9e3270 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6d2260740 10 client.0 _ll_register_callbacks cb 0x56176cc98420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176cdb1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176cdb1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42936/0 (socket says 172.21.15.118:42936) 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.307+0000 7fd6c3e00640 1 -- 172.21.15.118:0/1043141249 learned_addr learned my addr 172.21.15.118:0/1043141249 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6bb400640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c9200640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176cde1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c3e00640 1 -- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 msgr2=0x56176cde1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176cde1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c3e00640 1 -- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 msgr2=0x56176cdc8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c3e00640 1 -- 172.21.15.118:0/1043141249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176ca4e850 con 0x56176c9ba3b0 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6bb400640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c9200640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176cde1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176cdb1040 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40834a0 tx=0x7fd6b4083350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71632be90624a8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6b1600640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6b1600640 1 -- 172.21.15.118:0/1043141249 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4048040 con 0x56176c9ba3b0 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6b1600640 1 -- 172.21.15.118:0/1043141249 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fd6b40a5bd0 con 0x56176c9ba3b0 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6bc01b750 con 0x56176c9ba3b0 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6b1600640 1 -- 172.21.15.118:0/1043141249 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fd6b4083510 con 0x56176c9ba3b0 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6d2260740 10 client.6753 fetch_fsmap learned FSMap version 59 2024-09-21T06:10:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.308+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x56176cac56b0 con 0x56176c9ba3b0 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6b1600640 1 -- 172.21.15.118:0/1043141249 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6bc01b750 con 0x56176c9ba3b0 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6b1600640 1 -- 172.21.15.118:0/1043141249 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7fd6b408c960 con 0x56176c9ba3b0 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6d2260740 10 client.6753 fetch_fsmap finished waiting for FSMap version 59 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6d2260740 10 client.6753 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6d2260740 20 client.6753 populate_metadata read hostname 'smithi118' 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176c9a1e40 0x56176cddda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6d2260740 4 client.6753 mds_command: new command op to 6597 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 --> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56176ccff520 con 0x56176c9a1e40 2024-09-21T06:10:06.313 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.309+0000 7fd6bb400640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176c9a1e40 0x56176cddda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.310+0000 7fd6bb400640 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176c9a1e40 0x56176cddda10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e74b89d08375d84 server_cookie=9525eb3484543f35 in_seq=0 out_seq=0 2024-09-21T06:10:06.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.310+0000 7fd6b1600640 10 client.6753 ms_handle_connect on v2:172.21.15.118:6834/3458774046 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.310+0000 7fd6b1600640 1 -- 172.21.15.118:0/1043141249 <== mds.0 v2:172.21.15.118:6834/3458774046 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56176ccff520 con 0x56176c9a1e40 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6b1600640 10 client.6753 handle_command_reply: tid=0 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 client.6753 shutdown 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 msgr2=0x56176cdb1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176cdb1040 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40834a0 tx=0x7fd6b4083350 comp rx=0 tx=0).stop 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 shutdown_connections 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176cde1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176c9a1e40 0x56176cddda10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 --2- 172.21.15.118:0/1043141249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176cdb1040 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6b1600640 0 client.6753 ms_handle_reset on v2:172.21.15.118:6834/3458774046 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 >> 172.21.15.118:0/1043141249 conn(0x56176c9d73c0 msgr2=0x56176cdd1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 shutdown_connections 2024-09-21T06:10:06.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 1 -- 172.21.15.118:0/1043141249 wait complete. 2024-09-21T06:10:06.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.311+0000 7fd6d2260740 20 client.6753 trim_cache size 0 max 16384 2024-09-21T06:10:06.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.330+0000 7fd6d2260740 1 Processor -- start 2024-09-21T06:10:06.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.330+0000 7fd6d2260740 1 -- start start 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdf1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176ce48110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdc8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6d2260740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4201880 con 0x56176c9c2590 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c413e0e0 con 0x56176c9e3270 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c4158d70 con 0x56176c9ba3b0 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176ce48110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176ce48110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42946/0 (socket says 172.21.15.118:42946) 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 -- 172.21.15.118:0/2601664747 learned_addr learned my addr 172.21.15.118:0/2601664747 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:06.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6c9200640 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdc8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdf1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 -- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 msgr2=0x56176cdf1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdf1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 -- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 msgr2=0x56176cdc8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdc8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.332+0000 7fd6bb400640 1 -- 172.21.15.118:0/2601664747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176cd883b0 con 0x56176c9c2590 2024-09-21T06:10:06.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.333+0000 7fd6bb400640 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176ce48110 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac011e10 tx=0x7fd6ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e19b9fc3d9d0d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.333+0000 7fd6b3e00640 1 -- 172.21.15.118:0/2601664747 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac005020 con 0x56176c9c2590 2024-09-21T06:10:06.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.333+0000 7fd6b3e00640 1 -- 172.21.15.118:0/2601664747 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6ac0051c0 con 0x56176c9c2590 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.333+0000 7fd6b3e00640 1 -- 172.21.15.118:0/2601664747 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0055b0 con 0x56176c9c2590 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 -- 172.21.15.118:0/2601664747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 msgr2=0x56176ce48110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176ce48110 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac011e10 tx=0x7fd6ac014000 comp rx=0 tx=0).stop 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 -- 172.21.15.118:0/2601664747 shutdown_connections 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9e3270 0x56176cdc8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9c2590 0x56176ce48110 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 --2- 172.21.15.118:0/2601664747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9ba3b0 0x56176cdf1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 -- 172.21.15.118:0/2601664747 >> 172.21.15.118:0/2601664747 conn(0x56176c9d73c0 msgr2=0x56176cddcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 -- 172.21.15.118:0/2601664747 shutdown_connections 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.334+0000 7fd6d2260740 1 -- 172.21.15.118:0/2601664747 wait complete. 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.335+0000 7fd6d2260740 1 -- start start 2024-09-21T06:10:06.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.335+0000 7fd6d2260740 1 Processor -- start 2024-09-21T06:10:06.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.336+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176ce524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.336+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.336+0000 7fd6d2260740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176ce36bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.336+0000 7fd6d2260740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x56176cde00e0 con 0x56176c9ba3b0 2024-09-21T06:10:06.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.336+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56176cc93330 con 0x56176c9c2590 2024-09-21T06:10:06.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.336+0000 7fd6d2260740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x56176cddf3c0 con 0x56176c9e3270 2024-09-21T06:10:06.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6d2260740 10 client.0 _ll_register_callbacks cb 0x7fd6b40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176ce524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176ce524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42956/0 (socket says 172.21.15.118:42956) 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3912543626 learned_addr learned my addr 172.21.15.118:0/3912543626 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6bb400640 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c9200640 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176ce36bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 msgr2=0x56176ce36bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176ce36bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 msgr2=0x56176cdc8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 -- 172.21.15.118:0/3912543626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176cdddc30 con 0x56176c9ba3b0 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6c3e00640 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176ce524e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4080780 tx=0x7fd6b4005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2ee2d4cfa46355 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.337+0000 7fd6b1600640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:10:06.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6b1600640 1 -- 172.21.15.118:0/3912543626 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40a3060 con 0x56176c9ba3b0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6b1600640 1 -- 172.21.15.118:0/3912543626 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fd6b4082770 con 0x56176c9ba3b0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6ac0051c0 con 0x56176c9ba3b0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6b1600640 1 -- 172.21.15.118:0/3912543626 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fd6b4048070 con 0x56176c9ba3b0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 10 client.6759 fetch_fsmap learned FSMap version 59 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x56176ce47900 con 0x56176c9ba3b0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6b1600640 1 -- 172.21.15.118:0/3912543626 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6ac0051c0 con 0x56176c9ba3b0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6b1600640 1 -- 172.21.15.118:0/3912543626 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7fd6b408a140 con 0x56176c9ba3b0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 10 client.6759 fetch_fsmap finished waiting for FSMap version 59 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 10 client.6759 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 20 client.6759 populate_metadata read hostname 'smithi118' 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176cdf0ef0 0x56176cdcf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 4 client.6759 mds_command: new command op to 6597 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.338+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 --> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] -- command(tid 0: {"prefix": "status"}) -- 0x56176ccfafd0 con 0x56176cdf0ef0 2024-09-21T06:10:06.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.339+0000 7fd6bb400640 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176cdf0ef0 0x56176cdcf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.339+0000 7fd6b1600640 10 client.6759 ms_handle_connect on v2:172.21.15.118:6834/3458774046 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.339+0000 7fd6bb400640 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176cdf0ef0 0x56176cdcf720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1bb5af3bfb5ea08 server_cookie=d948dbd717940dc in_seq=0 out_seq=0 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.339+0000 7fd6b1600640 1 -- 172.21.15.118:0/3912543626 <== mds.0 v2:172.21.15.118:6834/3458774046 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56176ccfafd0 con 0x56176cdf0ef0 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.339+0000 7fd6b1600640 10 client.6759 handle_command_reply: tid=0 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.339+0000 7fd6d2260740 1 client.6759 shutdown 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 msgr2=0x56176ce524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176ce524e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4080780 tx=0x7fd6b4005a60 comp rx=0 tx=0).stop 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 shutdown_connections 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56176c9e3270 0x56176ce36bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:6834/3458774046,v1:172.21.15.118:6835/3458774046] conn(0x56176cdf0ef0 0x56176cdcf720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56176c9c2590 0x56176cdc8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 --2- 172.21.15.118:0/3912543626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56176c9ba3b0 0x56176ce524e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 >> 172.21.15.118:0/3912543626 conn(0x56176c9d73c0 msgr2=0x56176cdb3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6b1600640 0 client.6759 ms_handle_reset on v2:172.21.15.118:6834/3458774046 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 shutdown_connections 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 1 -- 172.21.15.118:0/3912543626 wait complete. 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.340+0000 7fd6d2260740 20 client.6759 trim_cache size 0 max 16384 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:10:06.345 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 6597, 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 11.615448394, 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 59, 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 118, 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 118, 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 16.656492447000002 2024-09-21T06:10:06.346 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd6a0078b90 msgr2=0x7fd6a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd6a0078b90 0x7fd6a007b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd6c413b8f0 tx=0x7fd6ac005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 msgr2=0x7fd6c4074870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c4074870 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4005fd0 tx=0x7fd6b40038a0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 shutdown_connections 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6c4142730 0x7fd6c41531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd6a0078b90 0x7fd6a007b0a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6c413fef0 0x7fd6c415c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 --2- 172.21.15.118:0/3049129939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6c413fae0 0x7fd6c4074870 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 >> 172.21.15.118:0/3049129939 conn(0x7fd6c406d110 msgr2=0x7fd6c415ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 shutdown_connections 2024-09-21T06:10:06.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.341+0000 7fd6cb200640 1 -- 172.21.15.118:0/3049129939 wait complete. 2024-09-21T06:10:06.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:10:06.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 -- 172.21.15.118:0/983695098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff70015fa00 msgr2=0x7ff70015fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 --2- 172.21.15.118:0/983695098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff70015fa00 0x7ff70015fe10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8005fd0 tx=0x7ff6f802aa00 comp rx=0 tx=0).stop 2024-09-21T06:10:06.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 -- 172.21.15.118:0/983695098 shutdown_connections 2024-09-21T06:10:06.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 --2- 172.21.15.118:0/983695098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff70015fa00 0x7ff70015fe10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 --2- 172.21.15.118:0/983695098 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7000d0ec0 0x7ff7000d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 -- 172.21.15.118:0/983695098 >> 172.21.15.118:0/983695098 conn(0x7ff70006d110 msgr2=0x7ff70006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 -- 172.21.15.118:0/983695098 shutdown_connections 2024-09-21T06:10:06.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.584+0000 7ff707200640 1 -- 172.21.15.118:0/983695098 wait complete. 2024-09-21T06:10:06.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.587+0000 7ff707200640 1 Processor -- start 2024-09-21T06:10:06.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.587+0000 7ff707200640 1 -- start start 2024-09-21T06:10:06.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.588+0000 7ff707200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7000ce0c0 0x7ff70015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.588+0000 7ff707200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7000d0ec0 0x7ff7000cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.588+0000 7ff707200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70015fa00 0x7ff7000af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.588+0000 7ff707200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff700073f20 con 0x7ff70015fa00 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.588+0000 7ff707200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff700073da0 con 0x7ff7000ce0c0 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.588+0000 7ff707200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff7000740a0 con 0x7ff7000d0ec0 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.588+0000 7ff705200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70015fa00 0x7ff7000af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70015fa00 0x7ff7000af160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42970/0 (socket says 172.21.15.118:42970) 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 -- 172.21.15.118:0/2050318912 learned_addr learned my addr 172.21.15.118:0/2050318912 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff6ffe00640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7000ce0c0 0x7ff70015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff6f7e00640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7000d0ec0 0x7ff7000cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 -- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7000d0ec0 msgr2=0x7ff7000cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7000d0ec0 0x7ff7000cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 -- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7000ce0c0 msgr2=0x7ff70015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7000ce0c0 0x7ff70015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 -- 172.21.15.118:0/2050318912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70015af40 con 0x7ff70015fa00 2024-09-21T06:10:06.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.589+0000 7ff705200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70015fa00 0x7ff7000af160 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009d90 tx=0x7ff6f8003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.590+0000 7ff6fcc00640 1 -- 172.21.15.118:0/2050318912 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8046070 con 0x7ff70015fa00 2024-09-21T06:10:06.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.590+0000 7ff6fcc00640 1 -- 172.21.15.118:0/2050318912 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6f8004540 con 0x7ff70015fa00 2024-09-21T06:10:06.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.590+0000 7ff6fcc00640 1 -- 172.21.15.118:0/2050318912 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8033070 con 0x7ff70015fa00 2024-09-21T06:10:06.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.590+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7000ce610 con 0x7ff70015fa00 2024-09-21T06:10:06.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.590+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7001f68a0 con 0x7ff70015fa00 2024-09-21T06:10:06.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.591+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7001f6330 con 0x7ff70015fa00 2024-09-21T06:10:06.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.592+0000 7ff6fcc00640 1 -- 172.21.15.118:0/2050318912 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6f8036070 con 0x7ff70015fa00 2024-09-21T06:10:06.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.593+0000 7ff6fcc00640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff6dc078b90 0x7ff6dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:06.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.593+0000 7ff6fcc00640 1 -- 172.21.15.118:0/2050318912 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7ff6f80bb8f0 con 0x7ff70015fa00 2024-09-21T06:10:06.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.593+0000 7ff6ffe00640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff6dc078b90 0x7ff6dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:06.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.594+0000 7ff6ffe00640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff6dc078b90 0x7ff6dc07b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001720 tx=0x7ff6f0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:06.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.597+0000 7ff6fcc00640 1 -- 172.21.15.118:0/2050318912 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff6f803e070 con 0x7ff70015fa00 2024-09-21T06:10:06.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.818+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff7000b0f50 con 0x7ff70015fa00 2024-09-21T06:10:06.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.819+0000 7ff6fcc00640 1 -- 172.21.15.118:0/2050318912 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) ==== 53+0+73 (secure 0 0 0) 0x7ff6f80836d0 con 0x7ff70015fa00 2024-09-21T06:10:06.820 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff6dc078b90 msgr2=0x7ff6dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff6dc078b90 0x7ff6dc07b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001720 tx=0x7ff6f0009040 comp rx=0 tx=0).stop 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70015fa00 msgr2=0x7ff7000af160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70015fa00 0x7ff7000af160 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009d90 tx=0x7ff6f8003ef0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 shutdown_connections 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff70015fa00 0x7ff7000af160 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff6dc078b90 0x7ff6dc07b0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff7000d0ec0 0x7ff7000cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 --2- 172.21.15.118:0/2050318912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7000ce0c0 0x7ff70015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 >> 172.21.15.118:0/2050318912 conn(0x7ff70006d110 msgr2=0x7ff70015c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:06.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 shutdown_connections 2024-09-21T06:10:06.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:06.821+0000 7ff707200640 1 -- 172.21.15.118:0/2050318912 wait complete. 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:10:06.845 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:10:06.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:06.846 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:10:06.881 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:10:06.881 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:06.882 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42378sec preferred_lft 42378sec 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:06.883 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:10:06.884 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:10:06.884 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:06.884 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:06.884 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:10:06.884 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:10:06.884 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:06.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:06.884 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:10:06.976 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:10:06.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:06.979 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:10:07.015 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:10:07.015 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:10:07.015 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:10:07.015 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:10:07.015 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:10:07.016 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:07.016 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:10:07.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:10:07.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:10:07.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:10:07.016 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:10:07.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:07.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:07.212 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:10:07.246 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:10:07.246 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:10:07.247 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:10:07.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:07.248 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:10:07.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:07.343 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:07.378 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:10:07.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:07.379 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:07.454 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:10:07.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:07.454 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:07.648 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:07.648 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:07.682 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:07.683 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:07.683 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:10:07.683 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:10:07.683 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:10:07.684 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:10:07.685 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:10:07.685 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:10:07.685 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:10:07.685 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:10:07.688 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:10:07.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:07.688 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:07.744 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:07.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:07.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:07.840 INFO:teuthology.orchestra.run.smithi118.stdout:client5906 2024-09-21T06:10:07.841 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:07.841 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:07.876 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:10:08.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.135+0000 7fb99a800640 1 -- 172.21.15.118:0/1621475128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb978004800 msgr2=0x7fb978004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.135+0000 7fb99a800640 1 --2- 172.21.15.118:0/1621475128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb978004800 0x7fb978004c10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0016c0 tx=0x7fb978005830 comp rx=0 tx=0).stop 2024-09-21T06:10:08.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.135+0000 7fb99a800640 1 -- 172.21.15.118:0/1621475128 shutdown_connections 2024-09-21T06:10:08.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.135+0000 7fb99a800640 1 --2- 172.21.15.118:0/1621475128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb978004800 0x7fb978004c10 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.135+0000 7fb99a800640 1 -- 172.21.15.118:0/1621475128 >> 172.21.15.118:0/1621475128 conn(0x7fb99406d110 msgr2=0x7fb99406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:08.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.135+0000 7fb99a800640 1 -- 172.21.15.118:0/1621475128 shutdown_connections 2024-09-21T06:10:08.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.135+0000 7fb99a800640 1 -- 172.21.15.118:0/1621475128 wait complete. 2024-09-21T06:10:08.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.137+0000 7fb99a800640 1 Processor -- start 2024-09-21T06:10:08.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.138+0000 7fb99a800640 1 -- start start 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb99a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978004800 0x7fb9940cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb99a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994158580 0x7fb9941f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb99a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994158990 0x7fb994072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb99a800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940d16a0 con 0x7fb994158580 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb99a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb994142730 con 0x7fb994158990 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb99a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb9940737a0 con 0x7fb978004800 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb98aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994158580 0x7fb9941f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb98aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994158580 0x7fb9941f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42994/0 (socket says 172.21.15.118:42994) 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.139+0000 7fb98aa00640 1 -- 172.21.15.118:0/2650930025 learned_addr learned my addr 172.21.15.118:0/2650930025 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb993400640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978004800 0x7fb9940cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb993e00640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994158990 0x7fb994072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb98aa00640 1 -- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978004800 msgr2=0x7fb9940cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb98aa00640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978004800 0x7fb9940cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb98aa00640 1 -- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994158990 msgr2=0x7fb994072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb98aa00640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994158990 0x7fb994072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb98aa00640 1 -- 172.21.15.118:0/2650930025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb994157ae0 con 0x7fb994158580 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb993e00640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994158990 0x7fb994072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb98aa00640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994158580 0x7fb9941f5820 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0017e0 tx=0x7fb97c0063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.140+0000 7fb98be00640 1 -- 172.21.15.118:0/2650930025 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c042070 con 0x7fb994158580 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.141+0000 7fb98be00640 1 -- 172.21.15.118:0/2650930025 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb97c039070 con 0x7fb994158580 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.141+0000 7fb98be00640 1 -- 172.21.15.118:0/2650930025 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c003d70 con 0x7fb994158580 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.141+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9941f6370 con 0x7fb994158580 2024-09-21T06:10:08.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.141+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb994157d80 con 0x7fb994158580 2024-09-21T06:10:08.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.142+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb994142c90 con 0x7fb994158580 2024-09-21T06:10:08.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.143+0000 7fb98be00640 1 -- 172.21.15.118:0/2650930025 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb97c03b070 con 0x7fb994158580 2024-09-21T06:10:08.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.144+0000 7fb98be00640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb970078b90 0x7fb97007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.144+0000 7fb98be00640 1 -- 172.21.15.118:0/2650930025 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fb97c0ba3a0 con 0x7fb994158580 2024-09-21T06:10:08.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.145+0000 7fb993400640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb970078b90 0x7fb97007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.145+0000 7fb993400640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb970078b90 0x7fb97007b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb99406bd50 tx=0x7fb9840067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.148+0000 7fb98be00640 1 -- 172.21.15.118:0/2650930025 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb97c082190 con 0x7fb994158580 2024-09-21T06:10:08.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.370+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb994158da0 con 0x7fb994158580 2024-09-21T06:10:08.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.370+0000 7fb98be00640 1 -- 172.21.15.118:0/2650930025 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) ==== 53+0+73 (secure 0 0 0) 0x7fb97c086bc0 con 0x7fb994158580 2024-09-21T06:10:08.372 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb970078b90 msgr2=0x7fb97007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb970078b90 0x7fb97007b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb99406bd50 tx=0x7fb9840067a0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994158580 msgr2=0x7fb9941f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994158580 0x7fb9941f5820 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0017e0 tx=0x7fb97c0063a0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 shutdown_connections 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb994158990 0x7fb994072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb994158580 0x7fb9941f5820 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb970078b90 0x7fb97007b0a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 --2- 172.21.15.118:0/2650930025 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb978004800 0x7fb9940cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 >> 172.21.15.118:0/2650930025 conn(0x7fb99406d110 msgr2=0x7fb9940cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 shutdown_connections 2024-09-21T06:10:08.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:08.373+0000 7fb99a800640 1 -- 172.21.15.118:0/2650930025 wait complete. 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:10:08.397 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:10:08.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:08.397 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:10:08.438 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:10:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:10:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:10:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:10:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:08.438 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42351sec preferred_lft 42351sec 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:10:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:10:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:08.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:08.441 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:10:08.539 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:10:08.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:08.543 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:10:08.580 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:10:08.580 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:10:08.580 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:10:08.580 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:10:08.580 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:10:08.581 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:08.581 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:10:08.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:10:08.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:10:08.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:10:08.581 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:10:08.699 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:08.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:08.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:08.778 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:10:08.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:10:08.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:10:08.814 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:10:08.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:08.814 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:10:08.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:08.910 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:08.944 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:10:08.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:08.945 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:09.019 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:10:09.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:09.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:09.213 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:09.213 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:09.248 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:09.248 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:09.248 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:10:09.248 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:10:09.248 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:10:09.250 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:10:09.250 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:10:09.250 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:10:09.250 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:10:09.250 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:10:09.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:10:09.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:09.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:09.309 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:09.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:09.389 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:09.396 INFO:teuthology.orchestra.run.smithi149.stdout:client6771 2024-09-21T06:10:09.397 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:10:09.397 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:09.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.659+0000 7fc94bc00640 1 -- 172.21.15.118:0/1346967705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 msgr2=0x7fc9440d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.659+0000 7fc94bc00640 1 --2- 172.21.15.118:0/1346967705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 0x7fc9440d0e80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc934005fd0 tx=0x7fc93402a540 comp rx=0 tx=0).stop 2024-09-21T06:10:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.659+0000 7fc94bc00640 1 -- 172.21.15.118:0/1346967705 shutdown_connections 2024-09-21T06:10:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.659+0000 7fc94bc00640 1 --2- 172.21.15.118:0/1346967705 >> v2:172.21.15.149:3300/0 conn(0x7fc94413fef0 0x7fc9440d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.659+0000 7fc94bc00640 1 --2- 172.21.15.118:0/1346967705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 0x7fc9440d0e80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.659+0000 7fc94bc00640 1 -- 172.21.15.118:0/1346967705 >> 172.21.15.118:0/1346967705 conn(0x7fc94406d110 msgr2=0x7fc94406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:09.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.660+0000 7fc94bc00640 1 -- 172.21.15.118:0/1346967705 shutdown_connections 2024-09-21T06:10:09.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.660+0000 7fc94bc00640 1 -- 172.21.15.118:0/1346967705 wait complete. 2024-09-21T06:10:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.662+0000 7fc94bc00640 1 Processor -- start 2024-09-21T06:10:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.662+0000 7fc94bc00640 1 -- start start 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.663+0000 7fc94bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 0x7fc9440cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.663+0000 7fc94bc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94413fef0 0x7fc9441f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.663+0000 7fc94bc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc944142730 0x7fc9441f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.663+0000 7fc94bc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc9440cfac0 con 0x7fc94413fef0 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.663+0000 7fc94bc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9440cf940 con 0x7fc944142730 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.663+0000 7fc94bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9440cfc40 con 0x7fc94413fae0 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94413fef0 0x7fc9441f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:09.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94413fef0 0x7fc9441f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43010/0 (socket says 172.21.15.118:43010) 2024-09-21T06:10:09.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 -- 172.21.15.118:0/882982850 learned_addr learned my addr 172.21.15.118:0/882982850 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:09.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc949200640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 0x7fc9440cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:09.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc949c00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc944142730 0x7fc9441f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 -- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 msgr2=0x7fc9440cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 0x7fc9440cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 -- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc944142730 msgr2=0x7fc9441f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc944142730 0x7fc9441f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 -- 172.21.15.118:0/882982850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94413e000 con 0x7fc94413fef0 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.664+0000 7fc943e00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94413fef0 0x7fc9441f5f10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc93000ea20 tx=0x7fc93000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.665+0000 7fc940c00640 1 -- 172.21.15.118:0/882982850 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93000ce40 con 0x7fc94413fef0 2024-09-21T06:10:09.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.665+0000 7fc940c00640 1 -- 172.21.15.118:0/882982850 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc930004020 con 0x7fc94413fef0 2024-09-21T06:10:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.665+0000 7fc940c00640 1 -- 172.21.15.118:0/882982850 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930004470 con 0x7fc94413fef0 2024-09-21T06:10:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.665+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94413e2e0 con 0x7fc94413fef0 2024-09-21T06:10:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.665+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94413e8a0 con 0x7fc94413fef0 2024-09-21T06:10:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.666+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94406a710 con 0x7fc94413fef0 2024-09-21T06:10:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.667+0000 7fc940c00640 1 -- 172.21.15.118:0/882982850 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9300035f0 con 0x7fc94413fef0 2024-09-21T06:10:09.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.668+0000 7fc940c00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc924078b90 0x7fc92407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:09.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.668+0000 7fc940c00640 1 -- 172.21.15.118:0/882982850 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7fc93009b6c0 con 0x7fc94413fef0 2024-09-21T06:10:09.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.668+0000 7fc949200640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc924078b90 0x7fc92407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:09.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.669+0000 7fc949200640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc924078b90 0x7fc92407b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc934033000 tx=0x7fc934004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:09.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.673+0000 7fc940c00640 1 -- 172.21.15.118:0/882982850 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc94406a710 con 0x7fc94413fef0 2024-09-21T06:10:09.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.897+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9440d00f0 con 0x7fc94413fef0 2024-09-21T06:10:09.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.898+0000 7fc940c00640 1 -- 172.21.15.118:0/882982850 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7fc930063530 con 0x7fc94413fef0 2024-09-21T06:10:09.899 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:09.899 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:10:09.900 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:10:09.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc924078b90 msgr2=0x7fc92407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:09.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc924078b90 0x7fc92407b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc934033000 tx=0x7fc934004730 comp rx=0 tx=0).stop 2024-09-21T06:10:09.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94413fef0 msgr2=0x7fc9441f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94413fef0 0x7fc9441f5f10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc93000ea20 tx=0x7fc93000eee0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 shutdown_connections 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc944142730 0x7fc9441f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94413fef0 0x7fc9441f5f10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc924078b90 0x7fc92407b0a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 --2- 172.21.15.118:0/882982850 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc94413fae0 0x7fc9440cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 >> 172.21.15.118:0/882982850 conn(0x7fc94406d110 msgr2=0x7fc94406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 shutdown_connections 2024-09-21T06:10:09.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:09.900+0000 7fc94bc00640 1 -- 172.21.15.118:0/882982850 wait complete. 2024-09-21T06:10:09.928 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:10:10.168 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":6597,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.424622662000001,"mdsmap_epoch":59,"osdmap_epoch":118,"osdmap_epoch_barrier":118,"uptime":20.465669005999999} 2024-09-21T06:10:10.169 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 6597, "mdsmap_epoch": 59, "osdmap_epoch": 118, "osdmap_epoch_barrier": 118, "rank_uptime": 15.424622662, "state": "up:active", "uptime": 20.465669006, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:10:10.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-21T06:10:10.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 -- 172.21.15.118:0/3368882233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 msgr2=0x7f456815e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 --2- 172.21.15.118:0/3368882233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456815e090 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4558005fd0 tx=0x7f455802a4f0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 -- 172.21.15.118:0/3368882233 shutdown_connections 2024-09-21T06:10:10.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 --2- 172.21.15.118:0/3368882233 >> v2:172.21.15.149:3300/0 conn(0x7f45680cdfa0 0x7f45680cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 --2- 172.21.15.118:0/3368882233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456815e090 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 -- 172.21.15.118:0/3368882233 >> 172.21.15.118:0/3368882233 conn(0x7f456806cf30 msgr2=0x7f456806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:10.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 -- 172.21.15.118:0/3368882233 shutdown_connections 2024-09-21T06:10:10.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.393+0000 7f456ee00640 1 -- 172.21.15.118:0/3368882233 wait complete. 2024-09-21T06:10:10.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.395+0000 7f456ee00640 1 Processor -- start 2024-09-21T06:10:10.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.395+0000 7f456ee00640 1 -- start start 2024-09-21T06:10:10.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4568161510 0x7f4568152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f456814c360 0x7f4568141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f45680cf6e0 con 0x7f45680b3e90 2024-09-21T06:10:10.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45680cf560 con 0x7f456814c360 2024-09-21T06:10:10.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45680cf860 con 0x7f4568161510 2024-09-21T06:10:10.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456813ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43020/0 (socket says 172.21.15.118:43020) 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 -- 172.21.15.118:0/1795880523 learned_addr learned my addr 172.21.15.118:0/1795880523 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567400640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4568161510 0x7f4568152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ce00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f456814c360 0x7f4568141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 -- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4568161510 msgr2=0x7f4568152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4568161510 0x7f4568152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 -- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f456814c360 msgr2=0x7f4568141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f456814c360 0x7f4568141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f4567e00640 1 -- 172.21.15.118:0/1795880523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45681f99e0 con 0x7f45680b3e90 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.397+0000 7f456ce00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f456814c360 0x7f4568141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.398+0000 7f4567e00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456813ec00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4558034040 tx=0x7f4558003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.398+0000 7f455fe00640 1 -- 172.21.15.118:0/1795880523 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455803e030 con 0x7f45680b3e90 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.398+0000 7f455fe00640 1 -- 172.21.15.118:0/1795880523 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4558003e00 con 0x7f45680b3e90 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.398+0000 7f455fe00640 1 -- 172.21.15.118:0/1795880523 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558035040 con 0x7f45680b3e90 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.398+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45681f9cc0 con 0x7f45680b3e90 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.398+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45681414f0 con 0x7f45680b3e90 2024-09-21T06:10:10.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.399+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45681fa1e0 con 0x7f45680b3e90 2024-09-21T06:10:10.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.401+0000 7f455fe00640 1 -- 172.21.15.118:0/1795880523 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4558041030 con 0x7f45680b3e90 2024-09-21T06:10:10.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.401+0000 7f455fe00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4548078b90 0x7f454807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.402+0000 7f455fe00640 1 -- 172.21.15.118:0/1795880523 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5709+0+0 (secure 0 0 0) 0x7f45580bb880 con 0x7f45680b3e90 2024-09-21T06:10:10.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.402+0000 7f4567400640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4548078b90 0x7f454807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.403+0000 7f4567400640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4548078b90 0x7f454807b0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45681f9240 tx=0x7f4554009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:10.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.405+0000 7f455fe00640 1 -- 172.21.15.118:0/1795880523 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f45580836d0 con 0x7f45680b3e90 2024-09-21T06:10:10.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.590+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f456815e090 con 0x7f45680b3e90 2024-09-21T06:10:10.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.778+0000 7f455fe00640 1 -- 172.21.15.118:0/1795880523 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v119) ==== 181+0+0 (secure 0 0 0) 0x7f4558088100 con 0x7f45680b3e90 2024-09-21T06:10:10.780 INFO:teuthology.orchestra.run.smithi118.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-21T06:10:10.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4548078b90 msgr2=0x7f454807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4548078b90 0x7f454807b0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45681f9240 tx=0x7f4554009060 comp rx=0 tx=0).stop 2024-09-21T06:10:10.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 msgr2=0x7f456813ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456813ec00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4558034040 tx=0x7f4558003910 comp rx=0 tx=0).stop 2024-09-21T06:10:10.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 shutdown_connections 2024-09-21T06:10:10.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f456814c360 0x7f4568141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4548078b90 0x7f454807b0a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4568161510 0x7f4568152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 --2- 172.21.15.118:0/1795880523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45680b3e90 0x7f456813ec00 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 >> 172.21.15.118:0/1795880523 conn(0x7f456806cf30 msgr2=0x7f45680b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:10.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 shutdown_connections 2024-09-21T06:10:10.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10.781+0000 7f456ee00640 1 -- 172.21.15.118:0/1795880523 wait complete. 2024-09-21T06:10:10.805 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:10:10.805 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:10:10.805 DEBUG:teuthology.orchestra.run.smithi118:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-21T06:10:10.805 DEBUG:teuthology.orchestra.run.smithi118:> os.fchmod(fd, 0O666) 2024-09-21T06:10:10.805 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(fd) 2024-09-21T06:10:10.805 DEBUG:teuthology.orchestra.run.smithi118:> os.close(fd) 2024-09-21T06:10:10.805 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:10:10.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:10.922 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:11.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:11.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:11.052 INFO:teuthology.orchestra.run.smithi118.stdout:client5906 2024-09-21T06:10:11.052 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client5906/osdmap') 2024-09-21T06:10:11.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:11.150 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 118 barrier 118 flags 0x588000 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:10:11.151 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:10:11.152 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:10:11.152 INFO:teuthology.orchestra.run.smithi118.stderr:803 bytes copied, 8.0697e-05 s, 10.0 MB/s 2024-09-21T06:10:11.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:11.162 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-21T06:10:11.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 -- 172.21.15.118:0/4054907385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02040b60f0 msgr2=0x7f020415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:11.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 --2- 172.21.15.118:0/4054907385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02040b60f0 0x7f020415d150 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f01ec005fd0 tx=0x7f01ec02a540 comp rx=0 tx=0).stop 2024-09-21T06:10:11.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 -- 172.21.15.118:0/4054907385 shutdown_connections 2024-09-21T06:10:11.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 --2- 172.21.15.118:0/4054907385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02040b60f0 0x7f020415d150 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 --2- 172.21.15.118:0/4054907385 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02041461d0 0x7f02040b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 -- 172.21.15.118:0/4054907385 >> 172.21.15.118:0/4054907385 conn(0x7f020406d6e0 msgr2=0x7f02040b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:11.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 -- 172.21.15.118:0/4054907385 shutdown_connections 2024-09-21T06:10:11.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.381+0000 7f0203200640 1 -- 172.21.15.118:0/4054907385 wait complete. 2024-09-21T06:10:11.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.383+0000 7f0203200640 1 Processor -- start 2024-09-21T06:10:11.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.383+0000 7f0203200640 1 -- start start 2024-09-21T06:10:11.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0203200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02040b60f0 0x7f0204137be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:11.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0203200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02041461d0 0x7f02041f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:11.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0203200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020415d690 0x7f02041f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:11.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0203200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0204160e50 con 0x7f02041461d0 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0203200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02041601d0 con 0x7f020415d690 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0203200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0204160fd0 con 0x7f02040b60f0 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02041461d0 0x7f02041f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02041461d0 0x7f02041f99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43036/0 (socket says 172.21.15.118:43036) 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 -- 172.21.15.118:0/3822230581 learned_addr learned my addr 172.21.15.118:0/3822230581 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0201e00640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02040b60f0 0x7f0204137be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0202800640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020415d690 0x7f02041f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 -- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02040b60f0 msgr2=0x7f0204137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02040b60f0 0x7f0204137be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 -- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020415d690 msgr2=0x7f02041f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020415d690 0x7f02041f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f01f9400640 1 -- 172.21.15.118:0/3822230581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02040c5c50 con 0x7f02041461d0 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.385+0000 7f0202800640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020415d690 0x7f02041f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:11.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.386+0000 7f01f9400640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02041461d0 0x7f02041f99a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f01ec034040 tx=0x7f01ec003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.386+0000 7f01faa00640 1 -- 172.21.15.118:0/3822230581 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec03e030 con 0x7f02041461d0 2024-09-21T06:10:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.386+0000 7f01faa00640 1 -- 172.21.15.118:0/3822230581 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01ec003e00 con 0x7f02041461d0 2024-09-21T06:10:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.386+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02040c5f30 con 0x7f02041461d0 2024-09-21T06:10:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.386+0000 7f01faa00640 1 -- 172.21.15.118:0/3822230581 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec035040 con 0x7f02041461d0 2024-09-21T06:10:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.386+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02040c64f0 con 0x7f02041461d0 2024-09-21T06:10:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.387+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02041ebf70 con 0x7f02041461d0 2024-09-21T06:10:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.388+0000 7f01faa00640 1 -- 172.21.15.118:0/3822230581 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01ec041030 con 0x7f02041461d0 2024-09-21T06:10:11.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.389+0000 7f01faa00640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01e0078b90 0x7f01e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:11.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.389+0000 7f01faa00640 1 -- 172.21.15.118:0/3822230581 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5709+0+0 (secure 0 0 0) 0x7f01ec0bb480 con 0x7f02041461d0 2024-09-21T06:10:11.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.390+0000 7f0201e00640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01e0078b90 0x7f01e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:11.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.390+0000 7f0201e00640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01e0078b90 0x7f01e007b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f01f4004630 tx=0x7f01f400b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:11.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.394+0000 7f01faa00640 1 -- 172.21.15.118:0/3822230581 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f01ec083260 con 0x7f02041461d0 2024-09-21T06:10:11.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.590+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7f02041614f0 con 0x7f02041461d0 2024-09-21T06:10:11.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.780+0000 7f01faa00640 1 -- 172.21.15.118:0/3822230581 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v120) ==== 93+0+0 (secure 0 0 0) 0x7f01ec088e20 con 0x7f02041461d0 2024-09-21T06:10:11.782 INFO:teuthology.orchestra.run.smithi118.stderr:pauserd,pausewr is set 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01e0078b90 msgr2=0x7f01e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01e0078b90 0x7f01e007b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f01f4004630 tx=0x7f01f400b2e0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02041461d0 msgr2=0x7f02041f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02041461d0 0x7f02041f99a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f01ec034040 tx=0x7f01ec003910 comp rx=0 tx=0).stop 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 shutdown_connections 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f020415d690 0x7f02041f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02041461d0 0x7f02041f99a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f01e0078b90 0x7f01e007b0a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 --2- 172.21.15.118:0/3822230581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02040b60f0 0x7f0204137be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 >> 172.21.15.118:0/3822230581 conn(0x7f020406d6e0 msgr2=0x7f02040b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:11.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 shutdown_connections 2024-09-21T06:10:11.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:11.784+0000 7f0203200640 1 -- 172.21.15.118:0/3822230581 wait complete. 2024-09-21T06:10:11.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-21T06:10:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.029+0000 7f7d35200640 1 -- 172.21.15.118:0/1257575505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d14003c10 msgr2=0x7f7d14004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.029+0000 7f7d35200640 1 --2- 172.21.15.118:0/1257575505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d14003c10 0x7f7d14004060 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009b50 tx=0x7f7d14005830 comp rx=0 tx=0).stop 2024-09-21T06:10:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.029+0000 7f7d2e800640 1 -- 172.21.15.118:0/1257575505 reap_dead start 2024-09-21T06:10:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.030+0000 7f7d35200640 1 -- 172.21.15.118:0/1257575505 shutdown_connections 2024-09-21T06:10:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.030+0000 7f7d35200640 1 -- 172.21.15.118:0/1257575505 >> 172.21.15.118:0/1257575505 conn(0x7f7d3006d110 msgr2=0x7f7d3006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.030+0000 7f7d35200640 1 -- 172.21.15.118:0/1257575505 shutdown_connections 2024-09-21T06:10:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.030+0000 7f7d35200640 1 -- 172.21.15.118:0/1257575505 wait complete. 2024-09-21T06:10:12.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.032+0000 7f7d35200640 1 Processor -- start 2024-09-21T06:10:12.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.032+0000 7f7d35200640 1 -- start start 2024-09-21T06:10:12.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d35200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14003c10 0x7f7d3013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d35200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d3015bc70 0x7f7d301f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d35200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301f9650 0x7f7d30141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d35200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d30160e70 con 0x7f7d301f9650 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d35200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d30160cf0 con 0x7f7d14003c10 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d35200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d30160ff0 con 0x7f7d3015bc70 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301f9650 0x7f7d30141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301f9650 0x7f7d30141820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43040/0 (socket says 172.21.15.118:43040) 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 -- 172.21.15.118:0/1803153379 learned_addr learned my addr 172.21.15.118:0/1803153379 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2de00640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14003c10 0x7f7d3013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2d400640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d3015bc70 0x7f7d301f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 -- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d3015bc70 msgr2=0x7f7d301f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d3015bc70 0x7f7d301f9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 -- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14003c10 msgr2=0x7f7d3013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14003c10 0x7f7d3013fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2e800640 1 -- 172.21.15.118:0/1803153379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d301443a0 con 0x7f7d301f9650 2024-09-21T06:10:12.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.034+0000 7f7d2de00640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14003c10 0x7f7d3013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.035+0000 7f7d2e800640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301f9650 0x7f7d30141820 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7d30160a50 tx=0x7f7d28006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.035+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d280107d0 con 0x7f7d301f9650 2024-09-21T06:10:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.035+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d28016070 con 0x7f7d301f9650 2024-09-21T06:10:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.035+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28010d00 con 0x7f7d301f9650 2024-09-21T06:10:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.035+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d301f9dc0 con 0x7f7d301f9650 2024-09-21T06:10:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.035+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d301e7680 con 0x7f7d301f9650 2024-09-21T06:10:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.036+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3015fe10 con 0x7f7d301f9650 2024-09-21T06:10:12.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.038+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d2801b460 con 0x7f7d301f9650 2024-09-21T06:10:12.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.039+0000 7f7d26000640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d10078bc0 0x7f7d1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.039+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5709+0+0 (secure 0 0 0) 0x7f7d2809b4c0 con 0x7f7d301f9650 2024-09-21T06:10:12.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.039+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=121+}) -- 0x7f7d100807a0 con 0x7f7d301f9650 2024-09-21T06:10:12.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.040+0000 7f7d2de00640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d10078bc0 0x7f7d1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.040+0000 7f7d2de00640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d10078bc0 0x7f7d1007b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7d20035000 tx=0x7f7d2002d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:12.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.044+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d28063980 con 0x7f7d301f9650 2024-09-21T06:10:12.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.238+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f7d3015d230 con 0x7f7d301f9650 2024-09-21T06:10:12.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.796+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v121) ==== 97+0+0 (secure 0 0 0) 0x7f7d28063280 con 0x7f7d301f9650 2024-09-21T06:10:12.799 INFO:teuthology.orchestra.run.smithi118.stderr:pauserd,pausewr is unset 2024-09-21T06:10:12.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.796+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(121..121 src has 1..121) ==== 288+0+0 (secure 0 0 0) 0x7f7d280d22b0 con 0x7f7d301f9650 2024-09-21T06:10:12.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.796+0000 7f7d26000640 1 -- 172.21.15.118:0/1803153379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=122}) -- 0x7f7d10081170 con 0x7f7d301f9650 2024-09-21T06:10:12.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d10078bc0 msgr2=0x7f7d1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d10078bc0 0x7f7d1007b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7d20035000 tx=0x7f7d2002d040 comp rx=0 tx=0).stop 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301f9650 msgr2=0x7f7d30141820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301f9650 0x7f7d30141820 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7d30160a50 tx=0x7f7d28006420 comp rx=0 tx=0).stop 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 shutdown_connections 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301f9650 0x7f7d30141820 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d10078bc0 0x7f7d1007b0d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d3015bc70 0x7f7d301f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 --2- 172.21.15.118:0/1803153379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d14003c10 0x7f7d3013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 >> 172.21.15.118:0/1803153379 conn(0x7f7d3006d110 msgr2=0x7f7d300ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 shutdown_connections 2024-09-21T06:10:12.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:12.801+0000 7f7d35200640 1 -- 172.21.15.118:0/1803153379 wait complete. 2024-09-21T06:10:12.830 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:10:13.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.050+0000 7f0fe6000640 1 -- 172.21.15.118:0/3423371178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fae0 msgr2=0x7f0fe00d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.050+0000 7f0fe6000640 1 --2- 172.21.15.118:0/3423371178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fae0 0x7f0fe00d0e80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009830 tx=0x7f0fd002a510 comp rx=0 tx=0).stop 2024-09-21T06:10:13.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.051+0000 7f0fe6000640 1 -- 172.21.15.118:0/3423371178 shutdown_connections 2024-09-21T06:10:13.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.051+0000 7f0fe6000640 1 --2- 172.21.15.118:0/3423371178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fe013fef0 0x7f0fe00d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.051+0000 7f0fe6000640 1 --2- 172.21.15.118:0/3423371178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fae0 0x7f0fe00d0e80 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.051+0000 7f0fe6000640 1 -- 172.21.15.118:0/3423371178 >> 172.21.15.118:0/3423371178 conn(0x7f0fe006d110 msgr2=0x7f0fe006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:13.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.051+0000 7f0fe6000640 1 -- 172.21.15.118:0/3423371178 shutdown_connections 2024-09-21T06:10:13.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.051+0000 7f0fe6000640 1 -- 172.21.15.118:0/3423371178 wait complete. 2024-09-21T06:10:13.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.053+0000 7f0fe6000640 1 Processor -- start 2024-09-21T06:10:13.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.053+0000 7f0fe6000640 1 -- start start 2024-09-21T06:10:13.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.054+0000 7f0fe6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fe013fae0 0x7f0fe01f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.054+0000 7f0fe6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fef0 0x7f0fe01f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.054+0000 7f0fe6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fe0142730 0x7f0fe0139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.054+0000 7f0fe6000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe00cfab0 con 0x7f0fe013fef0 2024-09-21T06:10:13.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.054+0000 7f0fe6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe00cf930 con 0x7f0fe013fae0 2024-09-21T06:10:13.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.054+0000 7f0fe6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe00cfc30 con 0x7f0fe0142730 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fef0 0x7f0fe01f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fef0 0x7f0fe01f9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43058/0 (socket says 172.21.15.118:43058) 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 -- 172.21.15.118:0/2024862319 learned_addr learned my addr 172.21.15.118:0/2024862319 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fdf400640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fe013fae0 0x7f0fe01f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fdfe00640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fe0142730 0x7f0fe0139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 -- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fe0142730 msgr2=0x7f0fe0139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fe0142730 0x7f0fe0139fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 -- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fe013fae0 msgr2=0x7f0fe01f9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fe013fae0 0x7f0fe01f9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 -- 172.21.15.118:0/2024862319 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe0153840 con 0x7f0fe013fef0 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fdfe00640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fe0142730 0x7f0fe0139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.055+0000 7f0fd6a00640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fef0 0x7f0fe01f9fc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009fd0 tx=0x7f0fc800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:13.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.056+0000 7f0fd7e00640 1 -- 172.21.15.118:0/2024862319 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800ccc0 con 0x7f0fe013fef0 2024-09-21T06:10:13.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.056+0000 7f0fd7e00640 1 -- 172.21.15.118:0/2024862319 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fc800ee70 con 0x7f0fe013fef0 2024-09-21T06:10:13.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.056+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe0141610 con 0x7f0fe013fef0 2024-09-21T06:10:13.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.056+0000 7f0fd7e00640 1 -- 172.21.15.118:0/2024862319 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800ce60 con 0x7f0fe013fef0 2024-09-21T06:10:13.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.056+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe0141bd0 con 0x7f0fe013fef0 2024-09-21T06:10:13.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.057+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe0141380 con 0x7f0fe013fef0 2024-09-21T06:10:13.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.058+0000 7f0fd7e00640 1 -- 172.21.15.118:0/2024862319 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fc803bd10 con 0x7f0fe013fef0 2024-09-21T06:10:13.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.059+0000 7f0fd7e00640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.059+0000 7f0fd7e00640 1 -- 172.21.15.118:0/2024862319 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7f0fc809b890 con 0x7f0fe013fef0 2024-09-21T06:10:13.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.060+0000 7f0fdf400640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.060+0000 7f0fdf400640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0034000 tx=0x7f0fd0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:13.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.062+0000 7f0fd7e00640 1 -- 172.21.15.118:0/2024862319 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0fc8063d40 con 0x7f0fe013fef0 2024-09-21T06:10:13.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.248+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fe0160280 con 0x7f0fe013fef0 2024-09-21T06:10:13.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.250+0000 7f0fd7e00640 1 -- 172.21.15.118:0/2024862319 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+16759 (secure 0 0 0) 0x7f0fc8063640 con 0x7f0fe013fef0 2024-09-21T06:10:13.252 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:13.252 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":121,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:10:12.790034+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:09:52.106767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T06:09:53.161177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0fbc078b90 msgr2=0x7f0fbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0034000 tx=0x7f0fd0004730 comp rx=0 tx=0).stop 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fef0 msgr2=0x7f0fe01f9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fef0 0x7f0fe01f9fc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009fd0 tx=0x7f0fc800ec20 comp rx=0 tx=0).stop 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 shutdown_connections 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fe0142730 0x7f0fe0139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fe013fef0 0x7f0fe01f9fc0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 --2- 172.21.15.118:0/2024862319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fe013fae0 0x7f0fe01f9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 >> 172.21.15.118:0/2024862319 conn(0x7f0fe006d110 msgr2=0x7f0fe0153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 shutdown_connections 2024-09-21T06:10:13.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.252+0000 7f0fe6000640 1 -- 172.21.15.118:0/2024862319 wait complete. 2024-09-21T06:10:13.277 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:10:13.277 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:10:13.277 DEBUG:teuthology.orchestra.run.smithi118:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-21T06:10:13.278 DEBUG:teuthology.orchestra.run.smithi118:> os.fchmod(fd, 0O666) 2024-09-21T06:10:13.278 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(fd) 2024-09-21T06:10:13.278 DEBUG:teuthology.orchestra.run.smithi118:> os.close(fd) 2024-09-21T06:10:13.278 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:10:13.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:13.391 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:13.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:13.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:13.519 INFO:teuthology.orchestra.run.smithi118.stdout:client5906 2024-09-21T06:10:13.519 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client5906/osdmap') 2024-09-21T06:10:13.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 118 barrier 118 flags 0x588000 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:10:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:10:13.619 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:10:13.619 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:10:13.619 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:10:13.619 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:10:13.619 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:10:13.619 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:10:13.619 INFO:teuthology.orchestra.run.smithi118.stderr:803 bytes copied, 6.9421e-05 s, 11.6 MB/s 2024-09-21T06:10:13.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:13.628 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 -- 172.21.15.118:0/3048111817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc142e40 msgr2=0x7fabfc0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 --2- 172.21.15.118:0/3048111817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc142e40 0x7fabfc0d13c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fabfc071c00 tx=0x7fabf402aa30 comp rx=0 tx=0).stop 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 -- 172.21.15.118:0/3048111817 shutdown_connections 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 --2- 172.21.15.118:0/3048111817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc142e40 0x7fabfc0d13c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 --2- 172.21.15.118:0/3048111817 >> v2:172.21.15.149:3300/0 conn(0x7fabfc13fae0 0x7fabfc0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 -- 172.21.15.118:0/3048111817 >> 172.21.15.118:0/3048111817 conn(0x7fabfc06d110 msgr2=0x7fabfc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 -- 172.21.15.118:0/3048111817 shutdown_connections 2024-09-21T06:10:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.846+0000 7fac00a00640 1 -- 172.21.15.118:0/3048111817 wait complete. 2024-09-21T06:10:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.849+0000 7fac00a00640 1 Processor -- start 2024-09-21T06:10:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.849+0000 7fac00a00640 1 -- start start 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.850+0000 7fac00a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabfc13fae0 0x7fabfc157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.850+0000 7fac00a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc13fef0 0x7fabfc074640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.850+0000 7fac00a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabfc142e40 0x7fabfc15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.850+0000 7fac00a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0cfa70 con 0x7fabfc13fef0 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.850+0000 7fac00a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0cf8f0 con 0x7fabfc142e40 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.850+0000 7fac00a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fabfc0cfbf0 con 0x7fabfc13fae0 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.850+0000 7fabf9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc13fef0 0x7fabfc074640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc13fef0 0x7fabfc074640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43070/0 (socket says 172.21.15.118:43070) 2024-09-21T06:10:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 -- 172.21.15.118:0/1081277977 learned_addr learned my addr 172.21.15.118:0/1081277977 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:13.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9e00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabfc13fae0 0x7fabfc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabfa800640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabfc142e40 0x7fabfc15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 -- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabfc13fae0 msgr2=0x7fabfc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabfc13fae0 0x7fabfc157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 -- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabfc142e40 msgr2=0x7fabfc15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabfc142e40 0x7fabfc15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 -- 172.21.15.118:0/1081277977 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc1552e0 con 0x7fabfc13fef0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabfa800640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabfc142e40 0x7fabfc15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9e00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabfc13fae0 0x7fabfc157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf9400640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc13fef0 0x7fabfc074640 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c3d0 tx=0x7fabe800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.851+0000 7fabf2000640 1 -- 172.21.15.118:0/1081277977 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8017070 con 0x7fabfc13fef0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.852+0000 7fabf2000640 1 -- 172.21.15.118:0/1081277977 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabe80053c0 con 0x7fabfc13fef0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.852+0000 7fabf2000640 1 -- 172.21.15.118:0/1081277977 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8003850 con 0x7fabfc13fef0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.852+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc1f9cb0 con 0x7fabfc13fef0 2024-09-21T06:10:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.852+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabfc073a90 con 0x7fabfc13fef0 2024-09-21T06:10:13.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.853+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc155050 con 0x7fabfc13fef0 2024-09-21T06:10:13.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.854+0000 7fabf2000640 1 -- 172.21.15.118:0/1081277977 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabe801a070 con 0x7fabfc13fef0 2024-09-21T06:10:13.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.855+0000 7fabf2000640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabdc078bc0 0x7fabdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:13.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.855+0000 7fabf2000640 1 -- 172.21.15.118:0/1081277977 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7fabe809a130 con 0x7fabfc13fef0 2024-09-21T06:10:13.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.855+0000 7fabf9e00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabdc078bc0 0x7fabdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:13.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.856+0000 7fabf9e00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabdc078bc0 0x7fabdc07b0d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fabec009ab0 tx=0x7fabec005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:13.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:13.859+0000 7fabf2000640 1 -- 172.21.15.118:0/1081277977 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabe80624d0 con 0x7fabfc13fef0 2024-09-21T06:10:14.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.078+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabfc161360 con 0x7fabfc13fef0 2024-09-21T06:10:14.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.078+0000 7fabf2000640 1 -- 172.21.15.118:0/1081277977 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7fabfc161360 con 0x7fabfc13fef0 2024-09-21T06:10:14.081 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:14.081 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:10:14.081 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:10:14.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabdc078bc0 msgr2=0x7fabdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:14.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabdc078bc0 0x7fabdc07b0d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fabec009ab0 tx=0x7fabec005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:14.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc13fef0 msgr2=0x7fabfc074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc13fef0 0x7fabfc074640 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c3d0 tx=0x7fabe800c890 comp rx=0 tx=0).stop 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 shutdown_connections 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabfc142e40 0x7fabfc15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc13fef0 0x7fabfc074640 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabdc078bc0 0x7fabdc07b0d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 --2- 172.21.15.118:0/1081277977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabfc13fae0 0x7fabfc157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 >> 172.21.15.118:0/1081277977 conn(0x7fabfc06d110 msgr2=0x7fabfc141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 shutdown_connections 2024-09-21T06:10:14.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14.081+0000 7fac00a00640 1 -- 172.21.15.118:0/1081277977 wait complete. 2024-09-21T06:10:14.109 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 121 2024-09-21T06:10:14.350 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-21T06:10:14.350 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:10:14.350 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:10:14.351 DEBUG:teuthology.orchestra.run.smithi118:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-21T06:10:14.351 DEBUG:teuthology.orchestra.run.smithi118:> os.fchmod(fd, 0O666) 2024-09-21T06:10:14.351 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(fd) 2024-09-21T06:10:14.351 DEBUG:teuthology.orchestra.run.smithi118:> os.close(fd) 2024-09-21T06:10:14.351 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:10:14.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:14.466 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:14.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:14.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:14.596 INFO:teuthology.orchestra.run.smithi118.stdout:client5906 2024-09-21T06:10:14.596 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client5906/osdmap') 2024-09-21T06:10:14.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 121 barrier 121 flags 0x588000 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:10:14.694 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:10:14.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:10:14.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:10:14.695 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:10:14.695 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:10:14.695 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:10:14.695 INFO:teuthology.orchestra.run.smithi118.stderr:803 bytes copied, 9.6969e-05 s, 8.3 MB/s 2024-09-21T06:10:14.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:14.705 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:14.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:14.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:14.792 INFO:teuthology.orchestra.run.smithi118.stdout:client5906 2024-09-21T06:10:14.793 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.client5906/osdmap') 2024-09-21T06:10:14.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 121 barrier 121 flags 0x588000 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:osd0 (2)172.21.15.118:6811 100% (exists, up) 100% -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:osd1 (2)172.21.15.118:6808 100% (exists, up) 100% -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:osd2 (2)172.21.15.118:6824 100% (exists, up) 100% -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:osd3 (2)172.21.15.118:6800 100% (exists, up) 100% -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:osd4 (2)172.21.15.149:6805 100% (exists, up) 100% -1 2024-09-21T06:10:14.892 INFO:teuthology.orchestra.run.smithi118.stdout:osd5 (2)172.21.15.149:6802 100% (exists, up) 100% -1 2024-09-21T06:10:14.893 INFO:teuthology.orchestra.run.smithi118.stdout:osd6 (2)172.21.15.149:6811 100% (exists, up) 100% -1 2024-09-21T06:10:14.893 INFO:teuthology.orchestra.run.smithi118.stdout:osd7 (2)172.21.15.149:6826 100% (exists, up) 100% -1 2024-09-21T06:10:14.893 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records in 2024-09-21T06:10:14.893 INFO:teuthology.orchestra.run.smithi118.stderr:1+1 records out 2024-09-21T06:10:14.893 INFO:teuthology.orchestra.run.smithi118.stderr:803 bytes copied, 9.1957e-05 s, 8.7 MB/s 2024-09-21T06:10:14.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:14.902 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:10:14.903 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:10:14.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:10:14.985 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:10:15.079 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:10:15.079 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:10:15.080 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:15.080 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:15.115 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:15.115 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:15.190 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:10:15.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.726+0000 7f3d5cc00640 1 -- 172.21.15.118:0/2051290047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5813fae0 msgr2=0x7f3d580d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:15.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.726+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/2051290047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5813fae0 0x7f3d580d0e80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009830 tx=0x7f3d4802a530 comp rx=0 tx=0).stop 2024-09-21T06:10:15.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.726+0000 7f3d5cc00640 1 -- 172.21.15.118:0/2051290047 shutdown_connections 2024-09-21T06:10:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.726+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/2051290047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d5813fae0 0x7f3d580d0e80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.726+0000 7f3d5cc00640 1 -- 172.21.15.118:0/2051290047 >> 172.21.15.118:0/2051290047 conn(0x7f3d5806d110 msgr2=0x7f3d5806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.726+0000 7f3d5cc00640 1 -- 172.21.15.118:0/2051290047 shutdown_connections 2024-09-21T06:10:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.726+0000 7f3d5cc00640 1 -- 172.21.15.118:0/2051290047 wait complete. 2024-09-21T06:10:15.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.728+0000 7f3d5cc00640 1 Processor -- start 2024-09-21T06:10:15.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.728+0000 7f3d5cc00640 1 -- start start 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.729+0000 7f3d5cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5813fae0 0x7f3d5813dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.729+0000 7f3d5cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d5813fef0 0x7f3d581343e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.729+0000 7f3d5cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d58142e40 0x7f3d58157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.729+0000 7f3d5cc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3d580cfce0 con 0x7f3d5813fae0 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.729+0000 7f3d5cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3d580cfb60 con 0x7f3d58142e40 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.729+0000 7f3d5cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d580cfe60 con 0x7f3d5813fef0 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5813fae0 0x7f3d5813dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5813fae0 0x7f3d5813dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43080/0 (socket says 172.21.15.118:43080) 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 -- 172.21.15.118:0/1314440141 learned_addr learned my addr 172.21.15.118:0/1314440141 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d56800640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d58142e40 0x7f3d58157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55400640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d5813fef0 0x7f3d581343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 -- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d5813fef0 msgr2=0x7f3d581343e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d5813fef0 0x7f3d581343e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 -- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d58142e40 msgr2=0x7f3d58157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d58142e40 0x7f3d58157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 -- 172.21.15.118:0/1314440141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5813e290 con 0x7f3d5813fae0 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d56800640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d58142e40 0x7f3d58157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.730+0000 7f3d55e00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5813fae0 0x7f3d5813dad0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3d4802ab20 tx=0x7f3d48033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:15.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.731+0000 7f3d4e000640 1 -- 172.21.15.118:0/1314440141 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48031b50 con 0x7f3d5813fae0 2024-09-21T06:10:15.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.731+0000 7f3d4e000640 1 -- 172.21.15.118:0/1314440141 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d48031de0 con 0x7f3d5813fae0 2024-09-21T06:10:15.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.731+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5813e570 con 0x7f3d5813fae0 2024-09-21T06:10:15.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.731+0000 7f3d4e000640 1 -- 172.21.15.118:0/1314440141 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48005280 con 0x7f3d5813fae0 2024-09-21T06:10:15.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.731+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d581f92a0 con 0x7f3d5813fae0 2024-09-21T06:10:15.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.732+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d580d0310 con 0x7f3d5813fae0 2024-09-21T06:10:15.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.733+0000 7f3d4e000640 1 -- 172.21.15.118:0/1314440141 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d48005420 con 0x7f3d5813fae0 2024-09-21T06:10:15.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.734+0000 7f3d4e000640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d38078b90 0x7f3d3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:15.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.734+0000 7f3d4e000640 1 -- 172.21.15.118:0/1314440141 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7f3d480bbf10 con 0x7f3d5813fae0 2024-09-21T06:10:15.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.735+0000 7f3d55400640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d38078b90 0x7f3d3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:15.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.735+0000 7f3d55400640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d38078b90 0x7f3d3807b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3d581541f0 tx=0x7f3d44009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:15.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.739+0000 7f3d4e000640 1 -- 172.21.15.118:0/1314440141 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3d4803f030 con 0x7f3d5813fae0 2024-09-21T06:10:15.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.936+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3d58153c60 con 0x7f3d5813fae0 2024-09-21T06:10:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.936+0000 7f3d4e000640 1 -- 172.21.15.118:0/1314440141 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v121) ==== 80+0+0 (secure 0 0 0) 0x7f3d480842b0 con 0x7f3d5813fae0 2024-09-21T06:10:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:10:15.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d38078b90 msgr2=0x7f3d3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:15.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d38078b90 0x7f3d3807b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3d581541f0 tx=0x7f3d44009040 comp rx=0 tx=0).stop 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5813fae0 msgr2=0x7f3d5813dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5813fae0 0x7f3d5813dad0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3d4802ab20 tx=0x7f3d48033ba0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 shutdown_connections 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d58142e40 0x7f3d58157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3d38078b90 0x7f3d3807b0a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d5813fef0 0x7f3d581343e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.938+0000 7f3d5cc00640 1 --2- 172.21.15.118:0/1314440141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5813fae0 0x7f3d5813dad0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.939+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 >> 172.21.15.118:0/1314440141 conn(0x7f3d5806d110 msgr2=0x7f3d5806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.939+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 shutdown_connections 2024-09-21T06:10:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:15.939+0000 7f3d5cc00640 1 -- 172.21.15.118:0/1314440141 wait complete. 2024-09-21T06:10:15.965 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:10:15.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:15.965 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:16.070 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:10:16.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:16.070 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:10:16.113 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:10:16.113 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:10:16.113 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:16.152 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:10:16.152 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:16.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:10:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.450+0000 7fa07ac00640 1 -- 172.21.15.118:0/1723190729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa058005350 msgr2=0x7fa05800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.450+0000 7fa07ac00640 1 --2- 172.21.15.118:0/1723190729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa058005350 0x7fa05800b9c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa06c001d90 tx=0x7fa058005830 comp rx=0 tx=0).stop 2024-09-21T06:10:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.450+0000 7fa07ac00640 1 -- 172.21.15.118:0/1723190729 shutdown_connections 2024-09-21T06:10:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.450+0000 7fa07ac00640 1 --2- 172.21.15.118:0/1723190729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa058005350 0x7fa05800b9c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.450+0000 7fa07ac00640 1 -- 172.21.15.118:0/1723190729 >> 172.21.15.118:0/1723190729 conn(0x7fa07406d110 msgr2=0x7fa07406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.450+0000 7fa07ac00640 1 -- 172.21.15.118:0/1723190729 shutdown_connections 2024-09-21T06:10:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.450+0000 7fa07ac00640 1 -- 172.21.15.118:0/1723190729 wait complete. 2024-09-21T06:10:16.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.452+0000 7fa07ac00640 1 Processor -- start 2024-09-21T06:10:16.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.453+0000 7fa07ac00640 1 -- start start 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa07ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa058005350 0x7fa07415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa07ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa074136cf0 0x7fa074137100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa07ac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0741f4e50 0x7fa0741f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa07ac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa074144c30 con 0x7fa0741f4e50 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa07ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa074144ab0 con 0x7fa058005350 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa07ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa074144db0 con 0x7fa074136cf0 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa078c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0741f4e50 0x7fa0741f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa078c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0741f4e50 0x7fa0741f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51752/0 (socket says 172.21.15.118:51752) 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa078c00640 1 -- 172.21.15.118:0/3555071901 learned_addr learned my addr 172.21.15.118:0/3555071901 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa073400640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa074136cf0 0x7fa074137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.454+0000 7fa073e00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa058005350 0x7fa07415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa078c00640 1 -- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa074136cf0 msgr2=0x7fa074137100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa078c00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa074136cf0 0x7fa074137100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa078c00640 1 -- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa058005350 msgr2=0x7fa07415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa078c00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa058005350 0x7fa07415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa078c00640 1 -- 172.21.15.118:0/3555071901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074135f70 con 0x7fa0741f4e50 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa078c00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0741f4e50 0x7fa0741f5260 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa06c001eb0 tx=0x7fa06c006d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa06be00640 1 -- 172.21.15.118:0/3555071901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0019e0 con 0x7fa0741f4e50 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa06be00640 1 -- 172.21.15.118:0/3555071901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa06c005a90 con 0x7fa0741f4e50 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa074136210 con 0x7fa0741f4e50 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.455+0000 7fa06be00640 1 -- 172.21.15.118:0/3555071901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c005ec0 con 0x7fa0741f4e50 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.456+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa074141fd0 con 0x7fa0741f4e50 2024-09-21T06:10:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.457+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07413a780 con 0x7fa0741f4e50 2024-09-21T06:10:16.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.458+0000 7fa06be00640 1 -- 172.21.15.118:0/3555071901 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa06c006060 con 0x7fa0741f4e50 2024-09-21T06:10:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.459+0000 7fa06be00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa054078b90 0x7fa05407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.459+0000 7fa06be00640 1 -- 172.21.15.118:0/3555071901 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7fa06c0babf0 con 0x7fa0741f4e50 2024-09-21T06:10:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.459+0000 7fa073e00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa054078b90 0x7fa05407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.460+0000 7fa073e00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa054078b90 0x7fa05407b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa064001410 tx=0x7fa0640068d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:16.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.463+0000 7fa06be00640 1 -- 172.21.15.118:0/3555071901 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa06c083030 con 0x7fa0741f4e50 2024-09-21T06:10:16.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.658+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa074138c20 con 0x7fa0741f4e50 2024-09-21T06:10:16.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.659+0000 7fa06be00640 1 -- 172.21.15.118:0/3555071901 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v121) ==== 80+0+0 (secure 0 0 0) 0x7fa06c082930 con 0x7fa0741f4e50 2024-09-21T06:10:16.662 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:10:16.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa054078b90 msgr2=0x7fa05407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa054078b90 0x7fa05407b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa064001410 tx=0x7fa0640068d0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0741f4e50 msgr2=0x7fa0741f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0741f4e50 0x7fa0741f5260 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa06c001eb0 tx=0x7fa06c006d20 comp rx=0 tx=0).stop 2024-09-21T06:10:16.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 shutdown_connections 2024-09-21T06:10:16.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0741f4e50 0x7fa0741f5260 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa054078b90 0x7fa05407b0a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa074136cf0 0x7fa074137100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 --2- 172.21.15.118:0/3555071901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa058005350 0x7fa07415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 >> 172.21.15.118:0/3555071901 conn(0x7fa07406d110 msgr2=0x7fa0740d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:16.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 shutdown_connections 2024-09-21T06:10:16.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:16.661+0000 7fa07ac00640 1 -- 172.21.15.118:0/3555071901 wait complete. 2024-09-21T06:10:16.685 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:10:16.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:16.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:16.748 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:10:16.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:16.749 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:10:16.785 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:10:16.786 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:16.786 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:16.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:10:16.822 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:10:16.822 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:10:16.822 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:16.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:10:16.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:17.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 -- 172.21.15.118:0/2589147301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b6260 msgr2=0x7f56400b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 --2- 172.21.15.118:0/2589147301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b6260 0x7f56400b6670 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5640070700 tx=0x7f562802a530 comp rx=0 tx=0).stop 2024-09-21T06:10:17.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 -- 172.21.15.118:0/2589147301 shutdown_connections 2024-09-21T06:10:17.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 --2- 172.21.15.118:0/2589147301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b6260 0x7f56400b6670 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 --2- 172.21.15.118:0/2589147301 >> v2:172.21.15.149:3300/0 conn(0x7f56400b7bd0 0x7f56400d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 -- 172.21.15.118:0/2589147301 >> 172.21.15.118:0/2589147301 conn(0x7f56400d2900 msgr2=0x7f56400d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:17.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 -- 172.21.15.118:0/2589147301 shutdown_connections 2024-09-21T06:10:17.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.079+0000 7f5645c00640 1 -- 172.21.15.118:0/2589147301 wait complete. 2024-09-21T06:10:17.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.081+0000 7f5645c00640 1 Processor -- start 2024-09-21T06:10:17.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.081+0000 7f5645c00640 1 -- start start 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56400b6260 0x7f56401e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56400b6bb0 0x7f56400cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b7bd0 0x7f56400cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f56400b3260 con 0x7f56400b7bd0 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f56400b30e0 con 0x7f56400b6260 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f56400b33e0 con 0x7f56400b6bb0 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b7bd0 0x7f56400cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b7bd0 0x7f56400cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51778/0 (socket says 172.21.15.118:51778) 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5645200640 1 -- 172.21.15.118:0/629789143 learned_addr learned my addr 172.21.15.118:0/629789143 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:17.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f563fe00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56400b6260 0x7f56401e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.083+0000 7f5637400640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56400b6bb0 0x7f56400cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645200640 1 -- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56400b6bb0 msgr2=0x7f56400cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645200640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56400b6bb0 0x7f56400cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645200640 1 -- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56400b6260 msgr2=0x7f56401e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645200640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56400b6260 0x7f56401e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645200640 1 -- 172.21.15.118:0/629789143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56401f6160 con 0x7f56400b7bd0 2024-09-21T06:10:17.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f563fe00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56400b6260 0x7f56401e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645200640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b7bd0 0x7f56400cdfe0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f563800c730 tx=0x7f563800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f563cc00640 1 -- 172.21.15.118:0/629789143 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638003b70 con 0x7f56400b7bd0 2024-09-21T06:10:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f563cc00640 1 -- 172.21.15.118:0/629789143 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5638003d10 con 0x7f56400b7bd0 2024-09-21T06:10:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56401f6440 con 0x7f56400b7bd0 2024-09-21T06:10:17.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f563cc00640 1 -- 172.21.15.118:0/629789143 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380052d0 con 0x7f56400b7bd0 2024-09-21T06:10:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.084+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56400cd580 con 0x7f56400b7bd0 2024-09-21T06:10:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.085+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56400d3420 con 0x7f56400b7bd0 2024-09-21T06:10:17.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.087+0000 7f563cc00640 1 -- 172.21.15.118:0/629789143 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5638005470 con 0x7f56400b7bd0 2024-09-21T06:10:17.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.088+0000 7f563cc00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f561c078bc0 0x7f561c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.088+0000 7f563cc00640 1 -- 172.21.15.118:0/629789143 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7f563809a930 con 0x7f56400b7bd0 2024-09-21T06:10:17.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.089+0000 7f563fe00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f561c078bc0 0x7f561c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.089+0000 7f563fe00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f561c078bc0 0x7f561c07b0d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5630009f20 tx=0x7f5630005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:17.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.093+0000 7f563cc00640 1 -- 172.21.15.118:0/629789143 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5638062720 con 0x7f56400b7bd0 2024-09-21T06:10:17.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.315+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56401f5ef0 con 0x7f56400b7bd0 2024-09-21T06:10:17.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.316+0000 7f563cc00640 1 -- 172.21.15.118:0/629789143 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7f5638067150 con 0x7f56400b7bd0 2024-09-21T06:10:17.318 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:17.318 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:10:17.319 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f561c078bc0 msgr2=0x7f561c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f561c078bc0 0x7f561c07b0d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5630009f20 tx=0x7f5630005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b7bd0 msgr2=0x7f56400cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b7bd0 0x7f56400cdfe0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f563800c730 tx=0x7f563800cb30 comp rx=0 tx=0).stop 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 shutdown_connections 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56400b7bd0 0x7f56400cdfe0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f561c078bc0 0x7f561c07b0d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56400b6bb0 0x7f56400cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 --2- 172.21.15.118:0/629789143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56400b6260 0x7f56401e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 >> 172.21.15.118:0/629789143 conn(0x7f56400d2900 msgr2=0x7f56400cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 shutdown_connections 2024-09-21T06:10:17.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.318+0000 7f5645c00640 1 -- 172.21.15.118:0/629789143 wait complete. 2024-09-21T06:10:17.342 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 -- 172.21.15.118:0/3001414963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb3015bd00 msgr2=0x7fdb3015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 --2- 172.21.15.118:0/3001414963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb3015bd00 0x7fdb3015c110 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fdb30072780 tx=0x7fdb2802aa30 comp rx=0 tx=0).stop 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 -- 172.21.15.118:0/3001414963 shutdown_connections 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 --2- 172.21.15.118:0/3001414963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb3015bd00 0x7fdb3015c110 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 --2- 172.21.15.118:0/3001414963 >> v2:172.21.15.149:3300/0 conn(0x7fdb300b44c0 0x7fdb3015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 -- 172.21.15.118:0/3001414963 >> 172.21.15.118:0/3001414963 conn(0x7fdb3006d110 msgr2=0x7fdb3006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 -- 172.21.15.118:0/3001414963 shutdown_connections 2024-09-21T06:10:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.558+0000 7fdb37e00640 1 -- 172.21.15.118:0/3001414963 wait complete. 2024-09-21T06:10:17.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.560+0000 7fdb37e00640 1 Processor -- start 2024-09-21T06:10:17.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.561+0000 7fdb37e00640 1 -- start start 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb37e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb300b44c0 0x7fdb3015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb37e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb30152050 0x7fdb30146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb37e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb3015bd00 0x7fdb30146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb37e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30070f40 con 0x7fdb30152050 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb37e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30070dc0 con 0x7fdb3015bd00 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb37e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdb300cfe80 con 0x7fdb300b44c0 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb34a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb30152050 0x7fdb30146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb34a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb30152050 0x7fdb30146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51788/0 (socket says 172.21.15.118:51788) 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb34a00640 1 -- 172.21.15.118:0/1818811685 learned_addr learned my addr 172.21.15.118:0/1818811685 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb35400640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb300b44c0 0x7fdb3015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.562+0000 7fdb35e00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb3015bd00 0x7fdb30146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb34a00640 1 -- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb300b44c0 msgr2=0x7fdb3015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb34a00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb300b44c0 0x7fdb3015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb34a00640 1 -- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb3015bd00 msgr2=0x7fdb30146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb34a00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb3015bd00 0x7fdb30146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb34a00640 1 -- 172.21.15.118:0/1818811685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb30149360 con 0x7fdb30152050 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb34a00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb30152050 0x7fdb30146c30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c001eb0 tx=0x7fdb1c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb2d600640 1 -- 172.21.15.118:0/1818811685 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c017070 con 0x7fdb30152050 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb2d600640 1 -- 172.21.15.118:0/1818811685 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb1c0053c0 con 0x7fdb30152050 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb2d600640 1 -- 172.21.15.118:0/1818811685 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c003830 con 0x7fdb30152050 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.563+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb30149640 con 0x7fdb30152050 2024-09-21T06:10:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.564+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb30147270 con 0x7fdb30152050 2024-09-21T06:10:17.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.565+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3015f660 con 0x7fdb30152050 2024-09-21T06:10:17.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.566+0000 7fdb2d600640 1 -- 172.21.15.118:0/1818811685 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb1c01a070 con 0x7fdb30152050 2024-09-21T06:10:17.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.567+0000 7fdb2d600640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb10078b90 0x7fdb1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:17.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.567+0000 7fdb2d600640 1 -- 172.21.15.118:0/1818811685 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7fdb1c099fe0 con 0x7fdb30152050 2024-09-21T06:10:17.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.567+0000 7fdb35400640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb10078b90 0x7fdb1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:17.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.568+0000 7fdb35400640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb10078b90 0x7fdb1007b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdb24005fd0 tx=0x7fdb2400a250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:17.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.571+0000 7fdb2d600640 1 -- 172.21.15.118:0/1818811685 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdb1c061e20 con 0x7fdb30152050 2024-09-21T06:10:17.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.797+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb301490b0 con 0x7fdb30152050 2024-09-21T06:10:17.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.798+0000 7fdb2d600640 1 -- 172.21.15.118:0/1818811685 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7fdb1c066850 con 0x7fdb30152050 2024-09-21T06:10:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:17.801 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:10:17.801 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:10:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb10078b90 msgr2=0x7fdb1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb10078b90 0x7fdb1007b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdb24005fd0 tx=0x7fdb2400a250 comp rx=0 tx=0).stop 2024-09-21T06:10:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb30152050 msgr2=0x7fdb30146c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb30152050 0x7fdb30146c30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c001eb0 tx=0x7fdb1c00c890 comp rx=0 tx=0).stop 2024-09-21T06:10:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 shutdown_connections 2024-09-21T06:10:17.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb3015bd00 0x7fdb30146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb30152050 0x7fdb30146c30 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdb10078b90 0x7fdb1007b0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 --2- 172.21.15.118:0/1818811685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb300b44c0 0x7fdb3015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.800+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 >> 172.21.15.118:0/1818811685 conn(0x7fdb3006d110 msgr2=0x7fdb3006ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.801+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 shutdown_connections 2024-09-21T06:10:17.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:17.801+0000 7fdb37e00640 1 -- 172.21.15.118:0/1818811685 wait complete. 2024-09-21T06:10:17.828 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:10:18.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.047+0000 7fe745200640 1 -- 172.21.15.118:0/1952578844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe724005280 msgr2=0x7fe72400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.047+0000 7fe745200640 1 --2- 172.21.15.118:0/1952578844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe724005280 0x7fe72400b9c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe73800c560 tx=0x7fe724005830 comp rx=0 tx=0).stop 2024-09-21T06:10:18.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.047+0000 7fe745200640 1 -- 172.21.15.118:0/1952578844 shutdown_connections 2024-09-21T06:10:18.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.047+0000 7fe745200640 1 --2- 172.21.15.118:0/1952578844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe724005280 0x7fe72400b9c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.047+0000 7fe745200640 1 -- 172.21.15.118:0/1952578844 >> 172.21.15.118:0/1952578844 conn(0x7fe74006d110 msgr2=0x7fe74006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:18.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.047+0000 7fe745200640 1 -- 172.21.15.118:0/1952578844 shutdown_connections 2024-09-21T06:10:18.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.047+0000 7fe745200640 1 -- 172.21.15.118:0/1952578844 wait complete. 2024-09-21T06:10:18.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.049+0000 7fe745200640 1 Processor -- start 2024-09-21T06:10:18.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.050+0000 7fe745200640 1 -- start start 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe745200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe724005280 0x7fe740152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe745200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe740153940 0x7fe740153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe745200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74014e280 0x7fe74014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe745200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe74006f060 con 0x7fe740153940 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe745200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe74006eee0 con 0x7fe724005280 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe745200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe740071030 con 0x7fe74014e280 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe735400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe740153940 0x7fe740153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe735400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe740153940 0x7fe740153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51810/0 (socket says 172.21.15.118:51810) 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe735400640 1 -- 172.21.15.118:0/4194789359 learned_addr learned my addr 172.21.15.118:0/4194789359 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe73de00640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe724005280 0x7fe740152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.051+0000 7fe73e800640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74014e280 0x7fe74014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe735400640 1 -- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74014e280 msgr2=0x7fe74014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe735400640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74014e280 0x7fe74014e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe735400640 1 -- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe724005280 msgr2=0x7fe740152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe735400640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe724005280 0x7fe740152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe735400640 1 -- 172.21.15.118:0/4194789359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7400cb180 con 0x7fe740153940 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe73e800640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74014e280 0x7fe74014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe735400640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe740153940 0x7fe740153d50 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe72800ea40 tx=0x7fe72800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe736a00640 1 -- 172.21.15.118:0/4194789359 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72801c070 con 0x7fe740153940 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe736a00640 1 -- 172.21.15.118:0/4194789359 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe72800ddb0 con 0x7fe740153940 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe740153530 con 0x7fe740153940 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe736a00640 1 -- 172.21.15.118:0/4194789359 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728017670 con 0x7fe740153940 2024-09-21T06:10:18.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.052+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7400c8e50 con 0x7fe740153940 2024-09-21T06:10:18.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.053+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7401523d0 con 0x7fe740153940 2024-09-21T06:10:18.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.055+0000 7fe736a00640 1 -- 172.21.15.118:0/4194789359 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe72801f070 con 0x7fe740153940 2024-09-21T06:10:18.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.056+0000 7fe736a00640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe71c078b90 0x7fe71c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.056+0000 7fe736a00640 1 -- 172.21.15.118:0/4194789359 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7fe72809b250 con 0x7fe740153940 2024-09-21T06:10:18.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.056+0000 7fe73de00640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe71c078b90 0x7fe71c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.057+0000 7fe73de00640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe71c078b90 0x7fe71c07b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe730000c00 tx=0x7fe730006230 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:18.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.060+0000 7fe736a00640 1 -- 172.21.15.118:0/4194789359 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe728062fb0 con 0x7fe740153940 2024-09-21T06:10:18.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.245+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe740074f10 con 0x7fe740153940 2024-09-21T06:10:18.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.246+0000 7fe736a00640 1 -- 172.21.15.118:0/4194789359 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+16759 (secure 0 0 0) 0x7fe7280679e0 con 0x7fe740153940 2024-09-21T06:10:18.248 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:18.249 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":121,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:10:12.790034+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:09:52.106767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T06:09:53.161177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe71c078b90 msgr2=0x7fe71c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe71c078b90 0x7fe71c07b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe730000c00 tx=0x7fe730006230 comp rx=0 tx=0).stop 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe740153940 msgr2=0x7fe740153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe740153940 0x7fe740153d50 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe72800ea40 tx=0x7fe72800ef00 comp rx=0 tx=0).stop 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 shutdown_connections 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe71c078b90 0x7fe71c07b0a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74014e280 0x7fe74014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe740153940 0x7fe740153d50 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 --2- 172.21.15.118:0/4194789359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe724005280 0x7fe740152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 >> 172.21.15.118:0/4194789359 conn(0x7fe74006d110 msgr2=0x7fe74006f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:18.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 shutdown_connections 2024-09-21T06:10:18.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.248+0000 7fe745200640 1 -- 172.21.15.118:0/4194789359 wait complete. 2024-09-21T06:10:18.277 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:10:18.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:18.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 -- 172.21.15.118:0/3048540286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c13fae0 msgr2=0x7f559c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 --2- 172.21.15.118:0/3048540286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c13fae0 0x7f559c0d0e80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f559c0ce7c0 tx=0x7f559002a560 comp rx=0 tx=0).stop 2024-09-21T06:10:18.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 -- 172.21.15.118:0/3048540286 shutdown_connections 2024-09-21T06:10:18.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 --2- 172.21.15.118:0/3048540286 >> v2:172.21.15.149:3300/0 conn(0x7f559c142e40 0x7f559c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 --2- 172.21.15.118:0/3048540286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c13fae0 0x7f559c0d0e80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 -- 172.21.15.118:0/3048540286 >> 172.21.15.118:0/3048540286 conn(0x7f559c06d110 msgr2=0x7f559c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:18.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 -- 172.21.15.118:0/3048540286 shutdown_connections 2024-09-21T06:10:18.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.494+0000 7f55a3400640 1 -- 172.21.15.118:0/3048540286 wait complete. 2024-09-21T06:10:18.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.497+0000 7f55a3400640 1 Processor -- start 2024-09-21T06:10:18.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.497+0000 7f55a3400640 1 -- start start 2024-09-21T06:10:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c13fae0 0x7f559c157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c13fef0 0x7f559c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c142e40 0x7f559c073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a3400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0cfa70 con 0x7f559c142e40 2024-09-21T06:10:18.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a3400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0cf8f0 con 0x7f559c13fae0 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a3400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f559c0cfbf0 con 0x7f559c13fef0 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c142e40 0x7f559c073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c142e40 0x7f559c073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51838/0 (socket says 172.21.15.118:51838) 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.498+0000 7f55a1400640 1 -- 172.21.15.118:0/2110388375 learned_addr learned my addr 172.21.15.118:0/2110388375 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a0a00640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c13fae0 0x7f559c157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f559be00640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c13fef0 0x7f559c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a1400640 1 -- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c13fef0 msgr2=0x7f559c153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a1400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c13fef0 0x7f559c153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a1400640 1 -- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c13fae0 msgr2=0x7f559c157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a1400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c13fae0 0x7f559c157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a1400640 1 -- 172.21.15.118:0/2110388375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c13dd40 con 0x7f559c142e40 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a0a00640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c13fae0 0x7f559c157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:18.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a1400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c142e40 0x7f559c073f90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f559400eab0 tx=0x7f559400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:18.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f5598c00640 1 -- 172.21.15.118:0/2110388375 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559400cea0 con 0x7f559c142e40 2024-09-21T06:10:18.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f5598c00640 1 -- 172.21.15.118:0/2110388375 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5594004b20 con 0x7f559c142e40 2024-09-21T06:10:18.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f5598c00640 1 -- 172.21.15.118:0/2110388375 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594005020 con 0x7f559c142e40 2024-09-21T06:10:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.499+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c158020 con 0x7f559c142e40 2024-09-21T06:10:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.500+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c1f6480 con 0x7f559c142e40 2024-09-21T06:10:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.501+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c1581f0 con 0x7f559c142e40 2024-09-21T06:10:18.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.502+0000 7f5598c00640 1 -- 172.21.15.118:0/2110388375 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55940051c0 con 0x7f559c142e40 2024-09-21T06:10:18.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.503+0000 7f5598c00640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f557c078b90 0x7f557c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.503+0000 7f5598c00640 1 -- 172.21.15.118:0/2110388375 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7f559409b990 con 0x7f559c142e40 2024-09-21T06:10:18.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.503+0000 7f55a0a00640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f557c078b90 0x7f557c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.504+0000 7f55a0a00640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f557c078b90 0x7f557c07b0a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5590033000 tx=0x7f5590004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:18.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.507+0000 7f5598c00640 1 -- 172.21.15.118:0/2110388375 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5594063ef0 con 0x7f559c142e40 2024-09-21T06:10:18.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.733+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f559c0d0110 con 0x7f559c142e40 2024-09-21T06:10:18.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.733+0000 7f5598c00640 1 -- 172.21.15.118:0/2110388375 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7f55940637f0 con 0x7f559c142e40 2024-09-21T06:10:18.736 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:18.736 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:10:18.736 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f557c078b90 msgr2=0x7f557c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f557c078b90 0x7f557c07b0a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5590033000 tx=0x7f5590004730 comp rx=0 tx=0).stop 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c142e40 msgr2=0x7f559c073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c142e40 0x7f559c073f90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f559400eab0 tx=0x7f559400ef70 comp rx=0 tx=0).stop 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 shutdown_connections 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f559c142e40 0x7f559c073f90 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f557c078b90 0x7f557c07b0a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f559c13fef0 0x7f559c153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 --2- 172.21.15.118:0/2110388375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f559c13fae0 0x7f559c157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 >> 172.21.15.118:0/2110388375 conn(0x7f559c06d110 msgr2=0x7f559c15f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:18.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 shutdown_connections 2024-09-21T06:10:18.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.736+0000 7f55a3400640 1 -- 172.21.15.118:0/2110388375 wait complete. 2024-09-21T06:10:18.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:18.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 -- 172.21.15.118:0/218647500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f267013fae0 msgr2=0x7f26700d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 --2- 172.21.15.118:0/218647500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f267013fae0 0x7f26700d0e80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f26700cedb0 tx=0x7f266002a4a0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 -- 172.21.15.118:0/218647500 shutdown_connections 2024-09-21T06:10:18.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 --2- 172.21.15.118:0/218647500 >> v2:172.21.15.149:3300/0 conn(0x7f267013fef0 0x7f26700d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 --2- 172.21.15.118:0/218647500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f267013fae0 0x7f26700d0e80 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 -- 172.21.15.118:0/218647500 >> 172.21.15.118:0/218647500 conn(0x7f267006d110 msgr2=0x7f267006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:18.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 -- 172.21.15.118:0/218647500 shutdown_connections 2024-09-21T06:10:18.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.980+0000 7f2676600640 1 -- 172.21.15.118:0/218647500 wait complete. 2024-09-21T06:10:18.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.983+0000 7f2676600640 1 Processor -- start 2024-09-21T06:10:18.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.983+0000 7f2676600640 1 -- start start 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f2676600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f267013fae0 0x7f26700cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f2676600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f267013fef0 0x7f2670157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f2676600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2670142730 0x7f2670141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f2676600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f26700cfa70 con 0x7f2670142730 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f2676600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f26700cf8f0 con 0x7f267013fef0 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f2676600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f26700cfbf0 con 0x7f267013fae0 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f266fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2670142730 0x7f2670141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f266fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2670142730 0x7f2670141350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51866/0 (socket says 172.21.15.118:51866) 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.984+0000 7f266fe00640 1 -- 172.21.15.118:0/4033492017 learned_addr learned my addr 172.21.15.118:0/4033492017 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f2667e00640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f267013fef0 0x7f2670157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f266f400640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f267013fae0 0x7f26700cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f266fe00640 1 -- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f267013fae0 msgr2=0x7f26700cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f266fe00640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f267013fae0 0x7f26700cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f266fe00640 1 -- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f267013fef0 msgr2=0x7f2670157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f266fe00640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f267013fef0 0x7f2670157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f266fe00640 1 -- 172.21.15.118:0/4033492017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26701f6100 con 0x7f2670142730 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f266fe00640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2670142730 0x7f2670141350 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f266800cb40 tx=0x7f266800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f2667400640 1 -- 172.21.15.118:0/4033492017 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668016020 con 0x7f2670142730 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f2667400640 1 -- 172.21.15.118:0/4033492017 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f266800adb0 con 0x7f2670142730 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f2667400640 1 -- 172.21.15.118:0/4033492017 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668012680 con 0x7f2670142730 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.985+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26701f63e0 con 0x7f2670142730 2024-09-21T06:10:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.986+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26701f69a0 con 0x7f2670142730 2024-09-21T06:10:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.987+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2670158430 con 0x7f2670142730 2024-09-21T06:10:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.988+0000 7f2667400640 1 -- 172.21.15.118:0/4033492017 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2668019020 con 0x7f2670142730 2024-09-21T06:10:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.989+0000 7f2667400640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f264c078b90 0x7f264c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.989+0000 7f2667400640 1 -- 172.21.15.118:0/4033492017 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7f266809b200 con 0x7f2670142730 2024-09-21T06:10:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.989+0000 7f266f400640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f264c078b90 0x7f264c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:18.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.990+0000 7f266f400640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f264c078b90 0x7f264c07b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2660034000 tx=0x7f2660004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:18.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:18.993+0000 7f2667400640 1 -- 172.21.15.118:0/4033492017 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2668020020 con 0x7f2670142730 2024-09-21T06:10:19.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.214+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26700d0110 con 0x7f2670142730 2024-09-21T06:10:19.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.215+0000 7f2667400640 1 -- 172.21.15.118:0/4033492017 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5237 (secure 0 0 0) 0x7f2668062ff0 con 0x7f2670142730 2024-09-21T06:10:19.217 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:19.217 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":59,"btime":"2024-09-21T06:09:57:729749+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:09:54.198104+0000","modified":"2024-09-21T06:09:57.210901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6597":{"gid":6597,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/3458774046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3458774046},{"type":"v1","addr":"172.21.15.118:6835","nonce":3458774046}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6597,"qdb_cluster":[6597]},"id":7}]} 2024-09-21T06:10:19.217 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 59 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f264c078b90 msgr2=0x7f264c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f264c078b90 0x7f264c07b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2660034000 tx=0x7f2660004730 comp rx=0 tx=0).stop 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2670142730 msgr2=0x7f2670141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2670142730 0x7f2670141350 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f266800cb40 tx=0x7f266800a060 comp rx=0 tx=0).stop 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 shutdown_connections 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2670142730 0x7f2670141350 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f267013fef0 0x7f2670157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f264c078b90 0x7f264c07b0a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 --2- 172.21.15.118:0/4033492017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f267013fae0 0x7f26700cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 >> 172.21.15.118:0/4033492017 conn(0x7f267006d110 msgr2=0x7f26700d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 shutdown_connections 2024-09-21T06:10:19.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.217+0000 7f2676600640 1 -- 172.21.15.118:0/4033492017 wait complete. 2024-09-21T06:10:19.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:10:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.464+0000 7fc176a00640 1 -- 172.21.15.118:0/3217599289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 msgr2=0x7fc158003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.464+0000 7fc176a00640 1 --2- 172.21.15.118:0/3217599289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc158003ef0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc164001710 tx=0x7fc158005830 comp rx=0 tx=0).stop 2024-09-21T06:10:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.464+0000 7fc176a00640 1 -- 172.21.15.118:0/3217599289 shutdown_connections 2024-09-21T06:10:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.464+0000 7fc176a00640 1 --2- 172.21.15.118:0/3217599289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc158003ef0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.464+0000 7fc176a00640 1 -- 172.21.15.118:0/3217599289 >> 172.21.15.118:0/3217599289 conn(0x7fc1700d4c00 msgr2=0x7fc1700d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.464+0000 7fc176a00640 1 -- 172.21.15.118:0/3217599289 shutdown_connections 2024-09-21T06:10:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.464+0000 7fc176a00640 1 -- 172.21.15.118:0/3217599289 wait complete. 2024-09-21T06:10:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.466+0000 7fc176a00640 1 Processor -- start 2024-09-21T06:10:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.466+0000 7fc176a00640 1 -- start start 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc176a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc1700cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc176a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc170157f50 0x7fc170148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc176a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1700caa30 0x7fc1700cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc176a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc1700d0990 con 0x7fc158003a80 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc176a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1700d2020 con 0x7fc170157f50 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc176a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc1700d0b10 con 0x7fc1700caa30 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc1700cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc1700cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51874/0 (socket says 172.21.15.118:51874) 2024-09-21T06:10:19.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 -- 172.21.15.118:0/2416509663 learned_addr learned my addr 172.21.15.118:0/2416509663 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc174c00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc170157f50 0x7fc170148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc176000640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1700caa30 0x7fc1700cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 -- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1700caa30 msgr2=0x7fc1700cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1700caa30 0x7fc1700cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 -- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc170157f50 msgr2=0x7fc170148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc170157f50 0x7fc170148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.468+0000 7fc175600640 1 -- 172.21.15.118:0/2416509663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1700cc910 con 0x7fc158003a80 2024-09-21T06:10:19.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.469+0000 7fc175600640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc1700cc3d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc16402a8e0 tx=0x7fc1640062f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:19.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.469+0000 7fc16d600640 1 -- 172.21.15.118:0/2416509663 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164003840 con 0x7fc158003a80 2024-09-21T06:10:19.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.469+0000 7fc16d600640 1 -- 172.21.15.118:0/2416509663 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc164039070 con 0x7fc158003a80 2024-09-21T06:10:19.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.469+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1700c9990 con 0x7fc158003a80 2024-09-21T06:10:19.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.469+0000 7fc16d600640 1 -- 172.21.15.118:0/2416509663 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164003d70 con 0x7fc158003a80 2024-09-21T06:10:19.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.469+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1700c9f50 con 0x7fc158003a80 2024-09-21T06:10:19.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.470+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1700d13c0 con 0x7fc158003a80 2024-09-21T06:10:19.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.472+0000 7fc16d600640 1 -- 172.21.15.118:0/2416509663 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc164044020 con 0x7fc158003a80 2024-09-21T06:10:19.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.472+0000 7fc16d600640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc150078bc0 0x7fc15007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.473+0000 7fc16d600640 1 -- 172.21.15.118:0/2416509663 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7fc1640ba5a0 con 0x7fc158003a80 2024-09-21T06:10:19.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.473+0000 7fc174c00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc150078bc0 0x7fc15007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.474+0000 7fc174c00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc150078bc0 0x7fc15007b0d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc1700b2ef0 tx=0x7fc15c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:19.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.477+0000 7fc16d600640 1 -- 172.21.15.118:0/2416509663 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc1700cc910 con 0x7fc158003a80 2024-09-21T06:10:19.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:19.615 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:19.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.666+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1700c82b0 con 0x7fc158003a80 2024-09-21T06:10:19.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.667+0000 7fc16d600640 1 -- 172.21.15.118:0/2416509663 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+16759 (secure 0 0 0) 0x7fc1640829e0 con 0x7fc158003a80 2024-09-21T06:10:19.670 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:19.670 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":121,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:10:12.790034+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:09:52.106767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T06:09:53.161177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc150078bc0 msgr2=0x7fc15007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc150078bc0 0x7fc15007b0d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc1700b2ef0 tx=0x7fc15c005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 msgr2=0x7fc1700cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc1700cc3d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc16402a8e0 tx=0x7fc1640062f0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 shutdown_connections 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc150078bc0 0x7fc15007b0d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1700caa30 0x7fc1700cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc170157f50 0x7fc170148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 --2- 172.21.15.118:0/2416509663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc158003a80 0x7fc1700cc3d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 >> 172.21.15.118:0/2416509663 conn(0x7fc1700d4c00 msgr2=0x7fc1700d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:19.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.669+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 shutdown_connections 2024-09-21T06:10:19.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.670+0000 7fc176a00640 1 -- 172.21.15.118:0/2416509663 wait complete. 2024-09-21T06:10:19.694 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:10:19.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.912+0000 7f3900a00640 1 -- 172.21.15.118:0/3509277004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 msgr2=0x7f38fc0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.912+0000 7f3900a00640 1 --2- 172.21.15.118:0/3509277004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc0b4140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38f4005fd0 tx=0x7f38f402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.912+0000 7f3900a00640 1 -- 172.21.15.118:0/3509277004 shutdown_connections 2024-09-21T06:10:19.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.912+0000 7f3900a00640 1 --2- 172.21.15.118:0/3509277004 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc0b4140 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.912+0000 7f3900a00640 1 --2- 172.21.15.118:0/3509277004 >> v2:172.21.15.149:3300/0 conn(0x7f38fc144ea0 0x7f38fc144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.912+0000 7f3900a00640 1 -- 172.21.15.118:0/3509277004 >> 172.21.15.118:0/3509277004 conn(0x7f38fc06d6e0 msgr2=0x7f38fc0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:19.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.913+0000 7f3900a00640 1 -- 172.21.15.118:0/3509277004 shutdown_connections 2024-09-21T06:10:19.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.913+0000 7f3900a00640 1 -- 172.21.15.118:0/3509277004 wait complete. 2024-09-21T06:10:19.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.915+0000 7f3900a00640 1 Processor -- start 2024-09-21T06:10:19.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.915+0000 7f3900a00640 1 -- start start 2024-09-21T06:10:19.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f3900a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc0cedb0 0x7f38fc0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f3900a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc1eb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f3900a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38fc144ea0 0x7f38fc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f3900a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc0b4a90 con 0x7f38fc144ea0 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f3900a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc0b4910 con 0x7f38fc0cedb0 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f3900a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc0b4c10 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f38fb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38fc144ea0 0x7f38fc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f38f1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc1eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f38f1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc1eb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:35120/0 (socket says 172.21.15.118:35120) 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f38f1e00640 1 -- 172.21.15.118:0/293844933 learned_addr learned my addr 172.21.15.118:0/293844933 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:19.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.917+0000 7f38fa800640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc0cedb0 0x7f38fc0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f1e00640 1 -- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc0cedb0 msgr2=0x7f38fc0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f1e00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc0cedb0 0x7f38fc0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f1e00640 1 -- 172.21.15.118:0/293844933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38fc144ea0 msgr2=0x7f38fc15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f1e00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38fc144ea0 0x7f38fc15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f1e00640 1 -- 172.21.15.118:0/293844933 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc1f9750 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38fb200640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38fc144ea0 0x7f38fc15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f1e00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc1eb720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c730 tx=0x7f38e400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f3400640 1 -- 172.21.15.118:0/293844933 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4003b70 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f3400640 1 -- 172.21.15.118:0/293844933 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e4003d30 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc1f9a30 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.918+0000 7f38f3400640 1 -- 172.21.15.118:0/293844933 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e400aab0 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.919+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc1f5d00 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.919+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38fc1f5af0 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.921+0000 7f38f3400640 1 -- 172.21.15.118:0/293844933 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38e400ac50 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.922+0000 7f38f3400640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38d8078b90 0x7f38d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.922+0000 7f38f3400640 1 -- 172.21.15.118:0/293844933 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(121..121 src has 1..121) ==== 5709+0+0 (secure 0 0 0) 0x7f38e409ab50 con 0x7f38fc0cf8d0 2024-09-21T06:10:19.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.922+0000 7f38fa800640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38d8078b90 0x7f38d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.923+0000 7f38fa800640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38d8078b90 0x7f38d807b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009b30 tx=0x7f38ec005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:19.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:19.926+0000 7f38f3400640 1 -- 172.21.15.118:0/293844933 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f38fc0cfce0 con 0x7f38fc0cf8d0 2024-09-21T06:10:20.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.147+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f38fc0b4140 con 0x7f38fc0cf8d0 2024-09-21T06:10:20.151 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:10:20.149+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:10:20.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.157+0000 7f38f3400640 1 -- 172.21.15.118:0/293844933 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) ==== 161+0+0 (secure 0 0 0) 0x7f38e4062a70 con 0x7f38fc0cf8d0 2024-09-21T06:10:20.159 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38d8078b90 msgr2=0x7f38d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38d8078b90 0x7f38d807b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009b30 tx=0x7f38ec005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 msgr2=0x7f38fc1eb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc1eb720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c730 tx=0x7f38e400cbf0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 shutdown_connections 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38fc144ea0 0x7f38fc15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f38d8078b90 0x7f38d807b0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc0cf8d0 0x7f38fc1eb720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.159+0000 7f3900a00640 1 --2- 172.21.15.118:0/293844933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc0cedb0 0x7f38fc0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.160+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 >> 172.21.15.118:0/293844933 conn(0x7f38fc06d6e0 msgr2=0x7f38fc0af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:20.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.160+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 shutdown_connections 2024-09-21T06:10:20.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.160+0000 7f3900a00640 1 -- 172.21.15.118:0/293844933 wait complete. 2024-09-21T06:10:20.167 INFO:tasks.ceph.mds.c.smithi118.stderr: -5988> 2024-09-21T06:09:56.688+0000 7f0b91400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:10:20.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:10:20.295 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:10:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.428+0000 7f267f200640 1 -- 172.21.15.118:0/1820665163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26800b62c0 msgr2=0x7f268015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.428+0000 7f267f200640 1 --2- 172.21.15.118:0/1820665163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26800b62c0 0x7f268015d150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f266c009860 tx=0x7f266c02a510 comp rx=0 tx=0).stop 2024-09-21T06:10:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.428+0000 7f267f200640 1 -- 172.21.15.118:0/1820665163 shutdown_connections 2024-09-21T06:10:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.428+0000 7f267f200640 1 --2- 172.21.15.118:0/1820665163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26800b62c0 0x7f268015d150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.428+0000 7f267f200640 1 -- 172.21.15.118:0/1820665163 >> 172.21.15.118:0/1820665163 conn(0x7f268006d6e0 msgr2=0x7f26800b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:20.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.428+0000 7f267f200640 1 -- 172.21.15.118:0/1820665163 shutdown_connections 2024-09-21T06:10:20.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.428+0000 7f267f200640 1 -- 172.21.15.118:0/1820665163 wait complete. 2024-09-21T06:10:20.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.431+0000 7f267f200640 1 Processor -- start 2024-09-21T06:10:20.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.431+0000 7f267f200640 1 -- start start 2024-09-21T06:10:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26801461d0 0x7f26800b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f268015d690 0x7f26801f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26801f7630 0x7f268013dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f268015fc90 con 0x7f26801f7630 2024-09-21T06:10:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f268015fb10 con 0x7f268015d690 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f268015fe10 con 0x7f26801461d0 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26801f7630 0x7f268013dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26801f7630 0x7f268013dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51920/0 (socket says 172.21.15.118:51920) 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.432+0000 7f267e800640 1 -- 172.21.15.118:0/3619251794 learned_addr learned my addr 172.21.15.118:0/3619251794 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267d400640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f268015d690 0x7f26801f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267de00640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26801461d0 0x7f26800b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267e800640 1 -- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26801461d0 msgr2=0x7f26800b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267e800640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26801461d0 0x7f26800b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267e800640 1 -- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f268015d690 msgr2=0x7f26801f70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267e800640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f268015d690 0x7f26801f70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:20.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267e800640 1 -- 172.21.15.118:0/3619251794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26801f7a40 con 0x7f26801f7630 2024-09-21T06:10:20.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.433+0000 7f267e800640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26801f7630 0x7f268013dcf0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f267800c760 tx=0x7f267800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:20.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.434+0000 7f2676000640 1 -- 172.21.15.118:0/3619251794 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678003b70 con 0x7f26801f7630 2024-09-21T06:10:20.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.434+0000 7f2676000640 1 -- 172.21.15.118:0/3619251794 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2678003d10 con 0x7f26801f7630 2024-09-21T06:10:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.434+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26800b2390 con 0x7f26801f7630 2024-09-21T06:10:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.434+0000 7f2676000640 1 -- 172.21.15.118:0/3619251794 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267800aa50 con 0x7f26801f7630 2024-09-21T06:10:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.434+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268013cf30 con 0x7f26801f7630 2024-09-21T06:10:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.435+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2680142bc0 con 0x7f26801f7630 2024-09-21T06:10:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.436+0000 7f2676000640 1 -- 172.21.15.118:0/3619251794 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f267800abf0 con 0x7f26801f7630 2024-09-21T06:10:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.437+0000 7f2676000640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2660078b90 0x7f266007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.437+0000 7f2676000640 1 -- 172.21.15.118:0/3619251794 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5795+0+0 (secure 0 0 0) 0x7f267809ab60 con 0x7f26801f7630 2024-09-21T06:10:20.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.438+0000 7f267de00640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2660078b90 0x7f266007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:20.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.438+0000 7f267de00640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2660078b90 0x7f266007b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2670007fd0 tx=0x7f2670007eb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:20.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.442+0000 7f2676000640 1 -- 172.21.15.118:0/3619251794 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f26801f7a40 con 0x7f26801f7630 2024-09-21T06:10:20.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:20.662+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2680074fa0 con 0x7f26801f7630 2024-09-21T06:10:21.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.153+0000 7f2676000640 1 -- 172.21.15.118:0/3619251794 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) ==== 104+0+0 (secure 0 0 0) 0x7f26780627d0 con 0x7f26801f7630 2024-09-21T06:10:21.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2660078b90 msgr2=0x7f266007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2660078b90 0x7f266007b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2670007fd0 tx=0x7f2670007eb0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26801f7630 msgr2=0x7f268013dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26801f7630 0x7f268013dcf0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f267800c760 tx=0x7f267800cc20 comp rx=0 tx=0).stop 2024-09-21T06:10:21.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 shutdown_connections 2024-09-21T06:10:21.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26801f7630 0x7f268013dcf0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f268015d690 0x7f26801f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2660078b90 0x7f266007b0a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 --2- 172.21.15.118:0/3619251794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26801461d0 0x7f26800b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.155+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 >> 172.21.15.118:0/3619251794 conn(0x7f268006d6e0 msgr2=0x7f26801589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:21.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.156+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 shutdown_connections 2024-09-21T06:10:21.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.156+0000 7f267f200640 1 -- 172.21.15.118:0/3619251794 wait complete. 2024-09-21T06:10:21.186 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:10:21.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.408+0000 7fe077a00640 1 -- 172.21.15.118:0/3947791592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0700b3e90 msgr2=0x7fe07015e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.408+0000 7fe077a00640 1 --2- 172.21.15.118:0/3947791592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0700b3e90 0x7fe07015e090 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe07015dd80 tx=0x7fe06402a540 comp rx=0 tx=0).stop 2024-09-21T06:10:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.409+0000 7fe077a00640 1 -- 172.21.15.118:0/3947791592 shutdown_connections 2024-09-21T06:10:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.409+0000 7fe077a00640 1 --2- 172.21.15.118:0/3947791592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0700cdfa0 0x7fe0700cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.409+0000 7fe077a00640 1 --2- 172.21.15.118:0/3947791592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0700b3e90 0x7fe07015e090 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.409+0000 7fe077a00640 1 -- 172.21.15.118:0/3947791592 >> 172.21.15.118:0/3947791592 conn(0x7fe07006cf30 msgr2=0x7fe07006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.409+0000 7fe077a00640 1 -- 172.21.15.118:0/3947791592 shutdown_connections 2024-09-21T06:10:21.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.409+0000 7fe077a00640 1 -- 172.21.15.118:0/3947791592 wait complete. 2024-09-21T06:10:21.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.411+0000 7fe077a00640 1 Processor -- start 2024-09-21T06:10:21.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.411+0000 7fe077a00640 1 -- start start 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe077a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0700b3e90 0x7fe07014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe077a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe070161510 0x7fe0701e7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe077a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07014e7f0 0x7fe0701e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe077a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700cf6e0 con 0x7fe070161510 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe077a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700cf560 con 0x7fe07014e7f0 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe077a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0700cf860 con 0x7fe0700b3e90 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe070161510 0x7fe0701e7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe070161510 0x7fe0701e7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51934/0 (socket says 172.21.15.118:51934) 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 -- 172.21.15.118:0/3611617762 learned_addr learned my addr 172.21.15.118:0/3611617762 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:21.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe075000640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0700b3e90 0x7fe07014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe075a00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07014e7f0 0x7fe0701e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 -- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0700b3e90 msgr2=0x7fe07014cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0700b3e90 0x7fe07014cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 -- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07014e7f0 msgr2=0x7fe0701e8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07014e7f0 0x7fe0701e8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.413+0000 7fe06fe00640 1 -- 172.21.15.118:0/3611617762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe070151aa0 con 0x7fe070161510 2024-09-21T06:10:21.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.414+0000 7fe06fe00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe070161510 0x7fe0701e7e30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c340 tx=0x7fe05c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:21.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.414+0000 7fe06cc00640 1 -- 172.21.15.118:0/3611617762 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c017070 con 0x7fe070161510 2024-09-21T06:10:21.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.414+0000 7fe06cc00640 1 -- 172.21.15.118:0/3611617762 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe05c0053c0 con 0x7fe070161510 2024-09-21T06:10:21.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.414+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701514e0 con 0x7fe070161510 2024-09-21T06:10:21.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.414+0000 7fe06cc00640 1 -- 172.21.15.118:0/3611617762 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c003850 con 0x7fe070161510 2024-09-21T06:10:21.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.414+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe070150280 con 0x7fe070161510 2024-09-21T06:10:21.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.415+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07015e090 con 0x7fe070161510 2024-09-21T06:10:21.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.416+0000 7fe06cc00640 1 -- 172.21.15.118:0/3611617762 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe05c01a070 con 0x7fe070161510 2024-09-21T06:10:21.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.417+0000 7fe06cc00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe050078b90 0x7fe05007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.417+0000 7fe06cc00640 1 -- 172.21.15.118:0/3611617762 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5795+0+0 (secure 0 0 0) 0x7fe05c09a0d0 con 0x7fe070161510 2024-09-21T06:10:21.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.418+0000 7fe075000640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe050078b90 0x7fe05007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.418+0000 7fe075000640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe050078b90 0x7fe05007b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe064033000 tx=0x7fe064004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:21.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.422+0000 7fe06cc00640 1 -- 172.21.15.118:0/3611617762 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe05c061dc0 con 0x7fe070161510 2024-09-21T06:10:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:21.607+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe07006a260 con 0x7fe070161510 2024-09-21T06:10:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.160+0000 7fe06cc00640 1 -- 172.21.15.118:0/3611617762 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v123) ==== 181+0+0 (secure 0 0 0) 0x7fe05c0667f0 con 0x7fe070161510 2024-09-21T06:10:22.162 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe050078b90 msgr2=0x7fe05007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe050078b90 0x7fe05007b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe064033000 tx=0x7fe064004730 comp rx=0 tx=0).stop 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe070161510 msgr2=0x7fe0701e7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe070161510 0x7fe0701e7e30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c340 tx=0x7fe05c00c800 comp rx=0 tx=0).stop 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 shutdown_connections 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe07014e7f0 0x7fe0701e8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe070161510 0x7fe0701e7e30 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe050078b90 0x7fe05007b0a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 --2- 172.21.15.118:0/3611617762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0700b3e90 0x7fe07014cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 >> 172.21.15.118:0/3611617762 conn(0x7fe07006cf30 msgr2=0x7fe0700b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:22.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.164+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 shutdown_connections 2024-09-21T06:10:22.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.165+0000 7fe077a00640 1 -- 172.21.15.118:0/3611617762 wait complete. 2024-09-21T06:10:22.192 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:10:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 -- 172.21.15.118:0/2074193475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300b5670 msgr2=0x7f883006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 --2- 172.21.15.118:0/2074193475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300b5670 0x7f883006efd0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f8820005fd0 tx=0x7f882002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 -- 172.21.15.118:0/2074193475 shutdown_connections 2024-09-21T06:10:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 --2- 172.21.15.118:0/2074193475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88300b5a80 0x7f883006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 --2- 172.21.15.118:0/2074193475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300b5670 0x7f883006efd0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 -- 172.21.15.118:0/2074193475 >> 172.21.15.118:0/2074193475 conn(0x7f883006d420 msgr2=0x7f88300b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:22.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 -- 172.21.15.118:0/2074193475 shutdown_connections 2024-09-21T06:10:22.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.413+0000 7f8835c00640 1 -- 172.21.15.118:0/2074193475 wait complete. 2024-09-21T06:10:22.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.415+0000 7f8835c00640 1 Processor -- start 2024-09-21T06:10:22.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.416+0000 7f8835c00640 1 -- start start 2024-09-21T06:10:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f8835c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300ae8b0 0x7f883014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f8835c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88300b5670 0x7f88301f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f8835c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88300b5a80 0x7f88301f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f8835c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f88300afe30 con 0x7f88300ae8b0 2024-09-21T06:10:22.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f8835c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f88300affb0 con 0x7f88300b5a80 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f8835c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f88300af3d0 con 0x7f88300b5670 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f882fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300ae8b0 0x7f883014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f882fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300ae8b0 0x7f883014cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51942/0 (socket says 172.21.15.118:51942) 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.417+0000 7f882fe00640 1 -- 172.21.15.118:0/55576266 learned_addr learned my addr 172.21.15.118:0/55576266 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882f400640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88300b5670 0x7f88301f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f8835200640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88300b5a80 0x7f88301f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882fe00640 1 -- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88300b5670 msgr2=0x7f88301f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882fe00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88300b5670 0x7f88301f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882fe00640 1 -- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88300b5a80 msgr2=0x7f88301f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882fe00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88300b5a80 0x7f88301f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882fe00640 1 -- 172.21.15.118:0/55576266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88300b1140 con 0x7f88300ae8b0 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882f400640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88300b5670 0x7f88301f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:22.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f882fe00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300ae8b0 0x7f883014cd10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8820006010 tx=0x7f88200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:22.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f8827e00640 1 -- 172.21.15.118:0/55576266 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882003e030 con 0x7f88300ae8b0 2024-09-21T06:10:22.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f8827e00640 1 -- 172.21.15.118:0/55576266 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8820003ca0 con 0x7f88300ae8b0 2024-09-21T06:10:22.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f8827e00640 1 -- 172.21.15.118:0/55576266 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820035040 con 0x7f88300ae8b0 2024-09-21T06:10:22.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.418+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88300b1400 con 0x7f88300ae8b0 2024-09-21T06:10:22.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.419+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88300b19c0 con 0x7f88300ae8b0 2024-09-21T06:10:22.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.420+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88300aecc0 con 0x7f88300ae8b0 2024-09-21T06:10:22.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.421+0000 7f8827e00640 1 -- 172.21.15.118:0/55576266 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8820041030 con 0x7f88300ae8b0 2024-09-21T06:10:22.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.422+0000 7f8827e00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8810078b90 0x7f881007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:22.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.422+0000 7f8827e00640 1 -- 172.21.15.118:0/55576266 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5357+0+0 (secure 0 0 0) 0x7f88200bb2d0 con 0x7f88300ae8b0 2024-09-21T06:10:22.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.422+0000 7f882f400640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8810078b90 0x7f881007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:22.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.423+0000 7f882f400640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8810078b90 0x7f881007b0a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f881c005fd0 tx=0x7f881c00f360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:22.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.426+0000 7f8827e00640 1 -- 172.21.15.118:0/55576266 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f88200837d0 con 0x7f88300ae8b0 2024-09-21T06:10:22.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:22.613+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8830160ad0 con 0x7f88300ae8b0 2024-09-21T06:10:23.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.167+0000 7f8827e00640 1 -- 172.21.15.118:0/55576266 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v124) ==== 169+0+0 (secure 0 0 0) 0x7f88200830d0 con 0x7f88300ae8b0 2024-09-21T06:10:23.169 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8810078b90 msgr2=0x7f881007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8810078b90 0x7f881007b0a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f881c005fd0 tx=0x7f881c00f360 comp rx=0 tx=0).stop 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300ae8b0 msgr2=0x7f883014cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300ae8b0 0x7f883014cd10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8820006010 tx=0x7f88200038a0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 shutdown_connections 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88300b5a80 0x7f88301f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8810078b90 0x7f881007b0a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88300b5670 0x7f88301f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 --2- 172.21.15.118:0/55576266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88300ae8b0 0x7f883014cd10 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.170+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 >> 172.21.15.118:0/55576266 conn(0x7f883006d420 msgr2=0x7f8830153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:23.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.171+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 shutdown_connections 2024-09-21T06:10:23.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.171+0000 7f8835c00640 1 -- 172.21.15.118:0/55576266 wait complete. 2024-09-21T06:10:23.198 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 -- 172.21.15.118:0/2162246362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2800d1590 msgr2=0x7fa280142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 --2- 172.21.15.118:0/2162246362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2800d1590 0x7fa280142730 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa268005fd0 tx=0x7fa26802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 -- 172.21.15.118:0/2162246362 shutdown_connections 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 --2- 172.21.15.118:0/2162246362 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa28013fef0 0x7fa280142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 --2- 172.21.15.118:0/2162246362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2800d1590 0x7fa280142730 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 -- 172.21.15.118:0/2162246362 >> 172.21.15.118:0/2162246362 conn(0x7fa28006d110 msgr2=0x7fa28006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 -- 172.21.15.118:0/2162246362 shutdown_connections 2024-09-21T06:10:23.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.418+0000 7fa286c00640 1 -- 172.21.15.118:0/2162246362 wait complete. 2024-09-21T06:10:23.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.420+0000 7fa286c00640 1 Processor -- start 2024-09-21T06:10:23.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.421+0000 7fa286c00640 1 -- start start 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa286c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28013fae0 0x7fa2801f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa286c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28013fef0 0x7fa280138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa286c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2801414f0 0x7fa280141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa286c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800cfac0 con 0x7fa28013fae0 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa286c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800cf940 con 0x7fa28013fef0 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa286c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa2800cfc40 con 0x7fa2801414f0 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28013fae0 0x7fa2801f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa27fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28013fae0 0x7fa2801f80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51956/0 (socket says 172.21.15.118:51956) 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa27fe00640 1 -- 172.21.15.118:0/1053161464 learned_addr learned my addr 172.21.15.118:0/1053161464 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa277400640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28013fef0 0x7fa280138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.422+0000 7fa284c00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2801414f0 0x7fa280141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27fe00640 1 -- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2801414f0 msgr2=0x7fa280141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27fe00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2801414f0 0x7fa280141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27fe00640 1 -- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28013fef0 msgr2=0x7fa280138be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27fe00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28013fef0 0x7fa280138be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27fe00640 1 -- 172.21.15.118:0/1053161464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa280141e40 con 0x7fa28013fae0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa277400640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28013fef0 0x7fa280138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27fe00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28013fae0 0x7fa2801f80d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c3d0 tx=0x7fa27000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27cc00640 1 -- 172.21.15.118:0/1053161464 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270017070 con 0x7fa28013fae0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27cc00640 1 -- 172.21.15.118:0/1053161464 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2700053c0 con 0x7fa28013fae0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa27cc00640 1 -- 172.21.15.118:0/1053161464 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270003850 con 0x7fa28013fae0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.423+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa280151a20 con 0x7fa28013fae0 2024-09-21T06:10:23.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.424+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28013a060 con 0x7fa28013fae0 2024-09-21T06:10:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.425+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2800d00f0 con 0x7fa28013fae0 2024-09-21T06:10:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.426+0000 7fa27cc00640 1 -- 172.21.15.118:0/1053161464 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa27001a070 con 0x7fa28013fae0 2024-09-21T06:10:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.427+0000 7fa27cc00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa25c078bc0 0x7fa25c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.427+0000 7fa27cc00640 1 -- 172.21.15.118:0/1053161464 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7fa270099db0 con 0x7fa28013fae0 2024-09-21T06:10:23.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.428+0000 7fa277400640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa25c078bc0 0x7fa25c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.428+0000 7fa277400640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa25c078bc0 0x7fa25c07b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa268033000 tx=0x7fa268004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.432+0000 7fa27cc00640 1 -- 172.21.15.118:0/1053161464 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa27009e070 con 0x7fa28013fae0 2024-09-21T06:10:23.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.618+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fa28015d020 con 0x7fa28013fae0 2024-09-21T06:10:23.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.622+0000 7fa27cc00640 1 -- 172.21.15.118:0/1053161464 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7fa280141e40 con 0x7fa28013fae0 2024-09-21T06:10:23.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa25c078bc0 msgr2=0x7fa25c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa25c078bc0 0x7fa25c07b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa268033000 tx=0x7fa268004730 comp rx=0 tx=0).stop 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28013fae0 msgr2=0x7fa2801f80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28013fae0 0x7fa2801f80d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c3d0 tx=0x7fa27000c890 comp rx=0 tx=0).stop 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 shutdown_connections 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa25c078bc0 0x7fa25c07b0d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa2801414f0 0x7fa280141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28013fef0 0x7fa280138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 --2- 172.21.15.118:0/1053161464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28013fae0 0x7fa2801f80d0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 >> 172.21.15.118:0/1053161464 conn(0x7fa28006d110 msgr2=0x7fa280153250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 shutdown_connections 2024-09-21T06:10:23.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.625+0000 7fa286c00640 1 -- 172.21.15.118:0/1053161464 wait complete. 2024-09-21T06:10:23.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-21T06:10:23.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 -- 172.21.15.118:0/4111193175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800b60a0 msgr2=0x7f8680074470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 --2- 172.21.15.118:0/4111193175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800b60a0 0x7f8680074470 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f86800ce1f0 tx=0x7f867002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 -- 172.21.15.118:0/4111193175 shutdown_connections 2024-09-21T06:10:23.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 --2- 172.21.15.118:0/4111193175 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f868015ffd0 0x7f86801521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 --2- 172.21.15.118:0/4111193175 >> v2:172.21.15.149:3300/0 conn(0x7f86800749b0 0x7f868015fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 --2- 172.21.15.118:0/4111193175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800b60a0 0x7f8680074470 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 -- 172.21.15.118:0/4111193175 >> 172.21.15.118:0/4111193175 conn(0x7f86800d0f80 msgr2=0x7f86800d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:23.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 -- 172.21.15.118:0/4111193175 shutdown_connections 2024-09-21T06:10:23.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.873+0000 7f8685000640 1 -- 172.21.15.118:0/4111193175 wait complete. 2024-09-21T06:10:23.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.876+0000 7f8685000640 1 Processor -- start 2024-09-21T06:10:23.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.876+0000 7f8685000640 1 -- start start 2024-09-21T06:10:23.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f8685000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800749b0 0x7f86800cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f8685000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86800b60a0 0x7f86801f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f8685000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868015ffd0 0x7f86801f9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f8685000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8680152aa0 con 0x7f86800749b0 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f8685000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8680152920 con 0x7f868015ffd0 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f8685000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8680152c20 con 0x7f86800b60a0 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f867f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800749b0 0x7f86800cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.877+0000 7f867f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800749b0 0x7f86800cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51962/0 (socket says 172.21.15.118:51962) 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867f400640 1 -- 172.21.15.118:0/2770765177 learned_addr learned my addr 172.21.15.118:0/2770765177 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f8676a00640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86800b60a0 0x7f86801f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867fe00640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868015ffd0 0x7f86801f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867f400640 1 -- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86800b60a0 msgr2=0x7f86801f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867f400640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86800b60a0 0x7f86801f9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867f400640 1 -- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868015ffd0 msgr2=0x7f86801f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867f400640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868015ffd0 0x7f86801f9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867f400640 1 -- 172.21.15.118:0/2770765177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868014f2e0 con 0x7f86800749b0 2024-09-21T06:10:23.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f8676a00640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86800b60a0 0x7f86801f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:23.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f867f400640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800749b0 0x7f86800cca90 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8670034040 tx=0x7f8670003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:23.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.878+0000 7f8677e00640 1 -- 172.21.15.118:0/2770765177 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867003e030 con 0x7f86800749b0 2024-09-21T06:10:23.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.879+0000 7f8677e00640 1 -- 172.21.15.118:0/2770765177 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8670003d10 con 0x7f86800749b0 2024-09-21T06:10:23.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.879+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868014f580 con 0x7f86800749b0 2024-09-21T06:10:23.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.879+0000 7f8677e00640 1 -- 172.21.15.118:0/2770765177 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670035040 con 0x7f86800749b0 2024-09-21T06:10:23.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.879+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868014fb40 con 0x7f86800749b0 2024-09-21T06:10:23.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.880+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8680074470 con 0x7f86800749b0 2024-09-21T06:10:23.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.881+0000 7f8677e00640 1 -- 172.21.15.118:0/2770765177 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8670041030 con 0x7f86800749b0 2024-09-21T06:10:23.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.882+0000 7f8677e00640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f865c078b90 0x7f865c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:23.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.882+0000 7f8677e00640 1 -- 172.21.15.118:0/2770765177 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7f86700bb260 con 0x7f86800749b0 2024-09-21T06:10:23.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.882+0000 7f8676a00640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f865c078b90 0x7f865c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:23.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.883+0000 7f8676a00640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f865c078b90 0x7f865c07b0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f868015b380 tx=0x7f8668005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:23.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:23.886+0000 7f8677e00640 1 -- 172.21.15.118:0/2770765177 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8670083900 con 0x7f86800749b0 2024-09-21T06:10:24.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.140+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7f868015d780 con 0x7f86800749b0 2024-09-21T06:10:24.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.168+0000 7f8677e00640 1 -- 172.21.15.118:0/2770765177 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v337) ==== 128+0+0 (secure 0 0 0) 0x7f8670083200 con 0x7f86800749b0 2024-09-21T06:10:24.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f865c078b90 msgr2=0x7f865c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f865c078b90 0x7f865c07b0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f868015b380 tx=0x7f8668005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800749b0 msgr2=0x7f86800cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800749b0 0x7f86800cca90 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f8670034040 tx=0x7f8670003820 comp rx=0 tx=0).stop 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 shutdown_connections 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868015ffd0 0x7f86801f9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f865c078b90 0x7f865c07b0a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86800b60a0 0x7f86801f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 --2- 172.21.15.118:0/2770765177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86800749b0 0x7f86800cca90 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 >> 172.21.15.118:0/2770765177 conn(0x7f86800d0f80 msgr2=0x7f8680150570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 shutdown_connections 2024-09-21T06:10:24.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.171+0000 7f8685000640 1 -- 172.21.15.118:0/2770765177 wait complete. 2024-09-21T06:10:24.195 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-21T06:10:24.195 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-21T06:10:24.196 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:10:24.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.412+0000 7fd4b3200640 1 -- 172.21.15.118:0/1958245532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40d13c0 msgr2=0x7fd4b40d17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.413+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1958245532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40d13c0 0x7fd4b40d17d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40d2b40 tx=0x7fd4ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.413+0000 7fd4b3200640 1 -- 172.21.15.118:0/1958245532 shutdown_connections 2024-09-21T06:10:24.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.413+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1958245532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40d13c0 0x7fd4b40d17d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.413+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1958245532 >> v2:172.21.15.149:3300/0 conn(0x7fd4b40b9f30 0x7fd4b40d5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.413+0000 7fd4b3200640 1 -- 172.21.15.118:0/1958245532 >> 172.21.15.118:0/1958245532 conn(0x7fd4b40d4be0 msgr2=0x7fd4b40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:24.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.413+0000 7fd4b3200640 1 -- 172.21.15.118:0/1958245532 shutdown_connections 2024-09-21T06:10:24.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.413+0000 7fd4b3200640 1 -- 172.21.15.118:0/1958245532 wait complete. 2024-09-21T06:10:24.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.415+0000 7fd4b3200640 1 Processor -- start 2024-09-21T06:10:24.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.415+0000 7fd4b3200640 1 -- start start 2024-09-21T06:10:24.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40b3d10 0x7fd4b40b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b3200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40b9f30 0x7fd4b4155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4b40d13c0 0x7fd4b41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b3200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40d32b0 con 0x7fd4b40b9f30 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40d3130 con 0x7fd4b40b3d10 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b40d3430 con 0x7fd4b40d13c0 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40b9f30 0x7fd4b4155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40b9f30 0x7fd4b4155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51992/0 (socket says 172.21.15.118:51992) 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 -- 172.21.15.118:0/1214122278 learned_addr learned my addr 172.21.15.118:0/1214122278 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1e00640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40b3d10 0x7fd4b40b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b2800640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4b40d13c0 0x7fd4b41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 -- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4b40d13c0 msgr2=0x7fd4b41562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4b40d13c0 0x7fd4b41562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 -- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40b3d10 msgr2=0x7fd4b40b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40b3d10 0x7fd4b40b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1400640 1 -- 172.21.15.118:0/1214122278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b4154440 con 0x7fd4b40b9f30 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b1e00640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40b3d10 0x7fd4b40b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.417+0000 7fd4b2800640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4b40d13c0 0x7fd4b41562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.418+0000 7fd4b1400640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40b9f30 0x7fd4b4155d70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c3c0 tx=0x7fd4a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.418+0000 7fd4aa000640 1 -- 172.21.15.118:0/1214122278 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0017070 con 0x7fd4b40b9f30 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.418+0000 7fd4aa000640 1 -- 172.21.15.118:0/1214122278 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4a00035f0 con 0x7fd4b40b9f30 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.418+0000 7fd4aa000640 1 -- 172.21.15.118:0/1214122278 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0003a80 con 0x7fd4b40b9f30 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.418+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b4157660 con 0x7fd4b40b9f30 2024-09-21T06:10:24.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.418+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b4160880 con 0x7fd4b40b9f30 2024-09-21T06:10:24.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.419+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b40d5700 con 0x7fd4b40b9f30 2024-09-21T06:10:24.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.420+0000 7fd4aa000640 1 -- 172.21.15.118:0/1214122278 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4a001a070 con 0x7fd4b40b9f30 2024-09-21T06:10:24.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.421+0000 7fd4aa000640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd494078b90 0x7fd49407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.421+0000 7fd4aa000640 1 -- 172.21.15.118:0/1214122278 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7fd4a0099df0 con 0x7fd4b40b9f30 2024-09-21T06:10:24.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.422+0000 7fd4b1e00640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd494078b90 0x7fd49407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.423+0000 7fd4b1e00640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd494078b90 0x7fd49407b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4005fd0 tx=0x7fd4a4004c70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:24.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.426+0000 7fd4aa000640 1 -- 172.21.15.118:0/1214122278 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd4b40d1d10 con 0x7fd4b40b9f30 2024-09-21T06:10:24.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.610+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4b40d0220 con 0x7fd4b40b9f30 2024-09-21T06:10:24.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.611+0000 7fd4aa000640 1 -- 172.21.15.118:0/1214122278 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+13117 (secure 0 0 0) 0x7fd4a0062490 con 0x7fd4b40b9f30 2024-09-21T06:10:24.613 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:24.614 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":124,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:10:23.162040+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6835/3458774046":"2024-09-22T06:10:20.150237+0000","172.21.15.118:6834/3458774046":"2024-09-22T06:10:20.150237+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:24.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd494078b90 msgr2=0x7fd49407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd494078b90 0x7fd49407b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4005fd0 tx=0x7fd4a4004c70 comp rx=0 tx=0).stop 2024-09-21T06:10:24.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40b9f30 msgr2=0x7fd4b4155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40b9f30 0x7fd4b4155d70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c3c0 tx=0x7fd4a000c880 comp rx=0 tx=0).stop 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 shutdown_connections 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd494078b90 0x7fd49407b0a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4b40d13c0 0x7fd4b41562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4b40b9f30 0x7fd4b4155d70 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 --2- 172.21.15.118:0/1214122278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40b3d10 0x7fd4b40b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 >> 172.21.15.118:0/1214122278 conn(0x7fd4b40d4be0 msgr2=0x7fd4b4159020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.613+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 shutdown_connections 2024-09-21T06:10:24.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.614+0000 7fd4b3200640 1 -- 172.21.15.118:0/1214122278 wait complete. 2024-09-21T06:10:24.641 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:10:24.642 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:10:24.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.864+0000 7fa376200640 1 -- 172.21.15.118:0/2605128654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa354003a30 msgr2=0x7fa354003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.864+0000 7fa376200640 1 --2- 172.21.15.118:0/2605128654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa354003a30 0x7fa354003ea0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa360009b50 tx=0x7fa354005830 comp rx=0 tx=0).stop 2024-09-21T06:10:24.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.864+0000 7fa36fe00640 1 -- 172.21.15.118:0/2605128654 reap_dead start 2024-09-21T06:10:24.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.864+0000 7fa376200640 1 -- 172.21.15.118:0/2605128654 shutdown_connections 2024-09-21T06:10:24.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.864+0000 7fa376200640 1 -- 172.21.15.118:0/2605128654 >> 172.21.15.118:0/2605128654 conn(0x7fa3700b2860 msgr2=0x7fa3700b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:24.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.864+0000 7fa376200640 1 -- 172.21.15.118:0/2605128654 shutdown_connections 2024-09-21T06:10:24.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.864+0000 7fa376200640 1 -- 172.21.15.118:0/2605128654 wait complete. 2024-09-21T06:10:24.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.867+0000 7fa376200640 1 Processor -- start 2024-09-21T06:10:24.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.867+0000 7fa376200640 1 -- start start 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.868+0000 7fa376200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa354003a30 0x7fa3700af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.868+0000 7fa376200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3701f61c0 0x7fa3701f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.868+0000 7fa376200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701f6ef0 0x7fa3700ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.868+0000 7fa376200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa37006fd90 con 0x7fa3701f6ef0 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.868+0000 7fa376200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa37006fc10 con 0x7fa3701f61c0 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.868+0000 7fa376200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa37006ff10 con 0x7fa354003a30 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701f6ef0 0x7fa3700ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701f6ef0 0x7fa3700ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52024/0 (socket says 172.21.15.118:52024) 2024-09-21T06:10:24.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 -- 172.21.15.118:0/1499732295 learned_addr learned my addr 172.21.15.118:0/1499732295 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:24.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36f400640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa354003a30 0x7fa3700af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa367e00640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3701f61c0 0x7fa3701f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 -- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa354003a30 msgr2=0x7fa3700af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa354003a30 0x7fa3700af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 -- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3701f61c0 msgr2=0x7fa3701f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3701f61c0 0x7fa3701f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 -- 172.21.15.118:0/1499732295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3701f7300 con 0x7fa3701f6ef0 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.869+0000 7fa36fe00640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701f6ef0 0x7fa3700ab190 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa37015afe0 tx=0x7fa36800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.870+0000 7fa367400640 1 -- 172.21.15.118:0/1499732295 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36800ca10 con 0x7fa3701f6ef0 2024-09-21T06:10:24.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.870+0000 7fa367400640 1 -- 172.21.15.118:0/1499732295 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa368018070 con 0x7fa3701f6ef0 2024-09-21T06:10:24.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.870+0000 7fa367400640 1 -- 172.21.15.118:0/1499732295 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368011460 con 0x7fa3701f6ef0 2024-09-21T06:10:24.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.870+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3701f41b0 con 0x7fa3701f6ef0 2024-09-21T06:10:24.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.870+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3700aa990 con 0x7fa3701f6ef0 2024-09-21T06:10:24.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.871+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3701f3f20 con 0x7fa3701f6ef0 2024-09-21T06:10:24.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.872+0000 7fa367400640 1 -- 172.21.15.118:0/1499732295 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa368011600 con 0x7fa3701f6ef0 2024-09-21T06:10:24.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.873+0000 7fa367400640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa34c078bc0 0x7fa34c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.873+0000 7fa367400640 1 -- 172.21.15.118:0/1499732295 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7fa36809ac60 con 0x7fa3701f6ef0 2024-09-21T06:10:24.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.874+0000 7fa36f400640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa34c078bc0 0x7fa34c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.874+0000 7fa36f400640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa34c078bc0 0x7fa34c07b0d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa360035000 tx=0x7fa36002d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:24.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:24.877+0000 7fa367400640 1 -- 172.21.15.118:0/1499732295 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa3701f7300 con 0x7fa3701f6ef0 2024-09-21T06:10:25.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.061+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3700b4050 con 0x7fa3701f6ef0 2024-09-21T06:10:25.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.062+0000 7fa367400640 1 -- 172.21.15.118:0/1499732295 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) ==== 93+0+10 (secure 0 0 0) 0x7fa3700b4050 con 0x7fa3701f6ef0 2024-09-21T06:10:25.064 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:10:25.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa34c078bc0 msgr2=0x7fa34c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:25.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa34c078bc0 0x7fa34c07b0d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa360035000 tx=0x7fa36002d040 comp rx=0 tx=0).stop 2024-09-21T06:10:25.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701f6ef0 msgr2=0x7fa3700ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:25.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701f6ef0 0x7fa3700ab190 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa37015afe0 tx=0x7fa36800eb60 comp rx=0 tx=0).stop 2024-09-21T06:10:25.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 shutdown_connections 2024-09-21T06:10:25.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701f6ef0 0x7fa3700ab190 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:25.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3701f61c0 0x7fa3701f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:25.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa34c078bc0 0x7fa34c07b0d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:25.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 --2- 172.21.15.118:0/1499732295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa354003a30 0x7fa3700af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:25.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 >> 172.21.15.118:0/1499732295 conn(0x7fa3700b2860 msgr2=0x7fa37015fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:25.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 shutdown_connections 2024-09-21T06:10:25.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.065+0000 7fa376200640 1 -- 172.21.15.118:0/1499732295 wait complete. 2024-09-21T06:10:25.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-21T06:10:25.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.309+0000 7ff216a00640 1 -- 172.21.15.118:0/2551904024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 msgr2=0x7ff1f8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:25.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.309+0000 7ff216a00640 1 --2- 172.21.15.118:0/2551904024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff1f8004c10 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c310 tx=0x7ff1f8005830 comp rx=0 tx=0).stop 2024-09-21T06:10:25.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.309+0000 7ff216a00640 1 -- 172.21.15.118:0/2551904024 shutdown_connections 2024-09-21T06:10:25.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.309+0000 7ff216a00640 1 --2- 172.21.15.118:0/2551904024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff1f8004c10 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:25.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.309+0000 7ff216a00640 1 -- 172.21.15.118:0/2551904024 >> 172.21.15.118:0/2551904024 conn(0x7ff21006d6e0 msgr2=0x7ff2100b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:25.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.309+0000 7ff216a00640 1 -- 172.21.15.118:0/2551904024 shutdown_connections 2024-09-21T06:10:25.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.309+0000 7ff216a00640 1 -- 172.21.15.118:0/2551904024 wait complete. 2024-09-21T06:10:25.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.312+0000 7ff216a00640 1 Processor -- start 2024-09-21T06:10:25.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.312+0000 7ff216a00640 1 -- start start 2024-09-21T06:10:25.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff216a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff2100c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff216a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2101ef970 0x7ff2101f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff216a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2101f6f00 0x7ff2101e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff216a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff2100d05d0 con 0x7ff1f8004800 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff216a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff2100d0450 con 0x7ff2101f6f00 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff216a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff2100749f0 con 0x7ff2101ef970 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff215600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff2100c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff215600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff2100c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52044/0 (socket says 172.21.15.118:52044) 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.313+0000 7ff215600640 1 -- 172.21.15.118:0/377176835 learned_addr learned my addr 172.21.15.118:0/377176835 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff214c00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2101ef970 0x7ff2101f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff216000640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2101f6f00 0x7ff2101e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff215600640 1 -- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2101ef970 msgr2=0x7ff2101f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:25.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff215600640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2101ef970 0x7ff2101f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff215600640 1 -- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2101f6f00 msgr2=0x7ff2101e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff215600640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2101f6f00 0x7ff2101e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff215600640 1 -- 172.21.15.118:0/377176835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2101e96d0 con 0x7ff1f8004800 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff215600640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff2100c6ab0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff204003da0 tx=0x7ff204001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff20d600640 1 -- 172.21.15.118:0/377176835 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204015070 con 0x7ff1f8004800 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff20d600640 1 -- 172.21.15.118:0/377176835 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff204011840 con 0x7ff1f8004800 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2100c5fd0 con 0x7ff1f8004800 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff20d600640 1 -- 172.21.15.118:0/377176835 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204001d40 con 0x7ff1f8004800 2024-09-21T06:10:25.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.314+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2101f7420 con 0x7ff1f8004800 2024-09-21T06:10:25.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.316+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2100b5bb0 con 0x7ff1f8004800 2024-09-21T06:10:25.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.317+0000 7ff20d600640 1 -- 172.21.15.118:0/377176835 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff204018070 con 0x7ff1f8004800 2024-09-21T06:10:25.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.318+0000 7ff20d600640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff1f0078bc0 0x7ff1f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:25.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.318+0000 7ff20d600640 1 -- 172.21.15.118:0/377176835 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7ff20409b4f0 con 0x7ff1f8004800 2024-09-21T06:10:25.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.318+0000 7ff214c00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff1f0078bc0 0x7ff1f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:25.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.319+0000 7ff214c00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff1f0078bc0 0x7ff1f007b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc033000 tx=0x7ff2100b34d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:25.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.323+0000 7ff20d600640 1 -- 172.21.15.118:0/377176835 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff204063cf0 con 0x7ff1f8004800 2024-09-21T06:10:25.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:25.582+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7ff2101541b0 con 0x7ff1f8004800 2024-09-21T06:10:26.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.179+0000 7ff20d600640 1 -- 172.21.15.118:0/377176835 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v339) ==== 143+0+0 (secure 0 0 0) 0x7ff2040635f0 con 0x7ff1f8004800 2024-09-21T06:10:26.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff1f0078bc0 msgr2=0x7ff1f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff1f0078bc0 0x7ff1f007b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc033000 tx=0x7ff2100b34d0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 msgr2=0x7ff2100c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff2100c6ab0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff204003da0 tx=0x7ff204001630 comp rx=0 tx=0).stop 2024-09-21T06:10:26.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 shutdown_connections 2024-09-21T06:10:26.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2101f6f00 0x7ff2101e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff1f0078bc0 0x7ff1f007b0d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2101ef970 0x7ff2101f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 --2- 172.21.15.118:0/377176835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1f8004800 0x7ff2100c6ab0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.181+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 >> 172.21.15.118:0/377176835 conn(0x7ff21006d6e0 msgr2=0x7ff21015f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:26.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.182+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 shutdown_connections 2024-09-21T06:10:26.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.182+0000 7ff216a00640 1 -- 172.21.15.118:0/377176835 wait complete. 2024-09-21T06:10:26.207 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:10:26.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.426+0000 7fbabb000640 1 -- 172.21.15.118:0/1623474034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 msgr2=0x7fbab40d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.426+0000 7fbabb000640 1 --2- 172.21.15.118:0/1623474034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 0x7fbab40d1740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbaac005fd0 tx=0x7fbaac02a8b0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.426+0000 7fbabb000640 1 -- 172.21.15.118:0/1623474034 shutdown_connections 2024-09-21T06:10:26.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.426+0000 7fbabb000640 1 --2- 172.21.15.118:0/1623474034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 0x7fbab40d1740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.426+0000 7fbabb000640 1 --2- 172.21.15.118:0/1623474034 >> v2:172.21.15.149:3300/0 conn(0x7fbab41634f0 0x7fbab40d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.426+0000 7fbabb000640 1 -- 172.21.15.118:0/1623474034 >> 172.21.15.118:0/1623474034 conn(0x7fbab406d1c0 msgr2=0x7fbab406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:26.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.426+0000 7fbabb000640 1 -- 172.21.15.118:0/1623474034 shutdown_connections 2024-09-21T06:10:26.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.427+0000 7fbabb000640 1 -- 172.21.15.118:0/1623474034 wait complete. 2024-09-21T06:10:26.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.429+0000 7fbabb000640 1 Processor -- start 2024-09-21T06:10:26.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.429+0000 7fbabb000640 1 -- start start 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.430+0000 7fbabb000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 0x7fbab41598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.430+0000 7fbabb000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbab41634f0 0x7fbab414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.430+0000 7fbabb000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbab4163900 0x7fbab41f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.430+0000 7fbabb000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbab40d3aa0 con 0x7fbab41634f0 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.430+0000 7fbabb000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbab40d3920 con 0x7fbab4163900 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.430+0000 7fbabb000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbab40d3c20 con 0x7fbab40d1330 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbab41634f0 0x7fbab414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbaba600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbab4163900 0x7fbab41f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbab41634f0 0x7fbab414b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48724/0 (socket says 172.21.15.118:48724) 2024-09-21T06:10:26.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 -- 172.21.15.118:0/433277366 learned_addr learned my addr 172.21.15.118:0/433277366 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:26.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9c00640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 0x7fbab41598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 -- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 msgr2=0x7fbab41598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 0x7fbab41598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 -- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbab4163900 msgr2=0x7fbab41f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbab4163900 0x7fbab41f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 -- 172.21.15.118:0/433277366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab41542a0 con 0x7fbab41634f0 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbaba600640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbab4163900 0x7fbab41f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.431+0000 7fbab9200640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbab41634f0 0x7fbab414b100 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c3a0 tx=0x7fbaa000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.432+0000 7fbab1600640 1 -- 172.21.15.118:0/433277366 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0011790 con 0x7fbab41634f0 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.432+0000 7fbab1600640 1 -- 172.21.15.118:0/433277366 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaa0017070 con 0x7fbab41634f0 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.432+0000 7fbab1600640 1 -- 172.21.15.118:0/433277366 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0011ce0 con 0x7fbab41634f0 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.432+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab41fa160 con 0x7fbab41634f0 2024-09-21T06:10:26.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.432+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab40ca0e0 con 0x7fbab41634f0 2024-09-21T06:10:26.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.433+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab40d4140 con 0x7fbab41634f0 2024-09-21T06:10:26.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.434+0000 7fbab1600640 1 -- 172.21.15.118:0/433277366 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbaa001c460 con 0x7fbab41634f0 2024-09-21T06:10:26.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.435+0000 7fbab1600640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fba94078b90 0x7fba9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.435+0000 7fbab1600640 1 -- 172.21.15.118:0/433277366 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7fbaa009a760 con 0x7fbab41634f0 2024-09-21T06:10:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.435+0000 7fbab9c00640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fba94078b90 0x7fba9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.436+0000 7fbab9c00640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fba94078b90 0x7fba9407b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80095f0 tx=0x7fbaa8005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:26.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.440+0000 7fbab1600640 1 -- 172.21.15.118:0/433277366 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbaa0011e80 con 0x7fbab41634f0 2024-09-21T06:10:26.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.625+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbab4069830 con 0x7fbab41634f0 2024-09-21T06:10:26.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.625+0000 7fbab1600640 1 -- 172.21.15.118:0/433277366 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+1472 (secure 0 0 0) 0x7fbaa00627b0 con 0x7fbab41634f0 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:10:26.628 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:10:26.629 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:10:26.630 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fba94078b90 msgr2=0x7fba9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fba94078b90 0x7fba9407b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80095f0 tx=0x7fbaa8005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbab41634f0 msgr2=0x7fbab414b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbab41634f0 0x7fbab414b100 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c3a0 tx=0x7fbaa000c860 comp rx=0 tx=0).stop 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 shutdown_connections 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbab4163900 0x7fbab41f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbab41634f0 0x7fbab414b100 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fba94078b90 0x7fba9407b0a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 --2- 172.21.15.118:0/433277366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbab40d1330 0x7fbab41598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 >> 172.21.15.118:0/433277366 conn(0x7fbab406d1c0 msgr2=0x7fbab4076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.627+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 shutdown_connections 2024-09-21T06:10:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.628+0000 7fbabb000640 1 -- 172.21.15.118:0/433277366 wait complete. 2024-09-21T06:10:26.651 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:10:26.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 -- 172.21.15.118:0/3902959134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b040b4830 msgr2=0x7f3b040b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3902959134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b040b4830 0x7f3b040b4c40 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f3afc005fd0 tx=0x7f3afc02aa90 comp rx=0 tx=0).stop 2024-09-21T06:10:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 -- 172.21.15.118:0/3902959134 shutdown_connections 2024-09-21T06:10:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3902959134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b040b4830 0x7f3b040b4c40 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3902959134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b040ceb40 0x7f3b040cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 -- 172.21.15.118:0/3902959134 >> 172.21.15.118:0/3902959134 conn(0x7f3b04071070 msgr2=0x7f3b04071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 -- 172.21.15.118:0/3902959134 shutdown_connections 2024-09-21T06:10:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.873+0000 7f3b0a600640 1 -- 172.21.15.118:0/3902959134 wait complete. 2024-09-21T06:10:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.875+0000 7f3b0a600640 1 Processor -- start 2024-09-21T06:10:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.875+0000 7f3b0a600640 1 -- start start 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.876+0000 7f3b0a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040b4830 0x7f3b041570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.876+0000 7f3b0a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b040ceb40 0x7f3b04159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.876+0000 7f3b0a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04146650 0x7f3b0415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b0a600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040d1570 con 0x7f3b04146650 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b0a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040d13f0 con 0x7f3b040b4830 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b0a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3b040d16f0 con 0x7f3b040ceb40 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04146650 0x7f3b0415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04146650 0x7f3b0415b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48740/0 (socket says 172.21.15.118:48740) 2024-09-21T06:10:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 -- 172.21.15.118:0/3046676459 learned_addr learned my addr 172.21.15.118:0/3046676459 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03400640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040b4830 0x7f3b041570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b02a00640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b040ceb40 0x7f3b04159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 -- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b040ceb40 msgr2=0x7f3b04159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b040ceb40 0x7f3b04159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 -- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040b4830 msgr2=0x7f3b041570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040b4830 0x7f3b041570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03e00640 1 -- 172.21.15.118:0/3046676459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b04157b80 con 0x7f3b04146650 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.877+0000 7f3b03400640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040b4830 0x7f3b041570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.878+0000 7f3b03e00640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04146650 0x7f3b0415b680 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f3afc006010 tx=0x7f3afc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.878+0000 7f3afb400640 1 -- 172.21.15.118:0/3046676459 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc044070 con 0x7f3b04146650 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.878+0000 7f3afb400640 1 -- 172.21.15.118:0/3046676459 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3afc02e7f0 con 0x7f3b04146650 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.878+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b04157e60 con 0x7f3b04146650 2024-09-21T06:10:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.878+0000 7f3afb400640 1 -- 172.21.15.118:0/3046676459 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0044b0 con 0x7f3b04146650 2024-09-21T06:10:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.878+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b04158420 con 0x7f3b04146650 2024-09-21T06:10:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.879+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b040d1ba0 con 0x7f3b04146650 2024-09-21T06:10:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.880+0000 7f3afb400640 1 -- 172.21.15.118:0/3046676459 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3afc047070 con 0x7f3b04146650 2024-09-21T06:10:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.881+0000 7f3afb400640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ae4078b90 0x7f3ae407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.881+0000 7f3afb400640 1 -- 172.21.15.118:0/3046676459 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7f3afc0bb8a0 con 0x7f3b04146650 2024-09-21T06:10:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.882+0000 7f3b03400640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ae4078b90 0x7f3ae407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.883+0000 7f3b03400640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ae4078b90 0x7f3ae407b0a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3af4007fd0 tx=0x7f3af4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:26.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:26.886+0000 7f3afb400640 1 -- 172.21.15.118:0/3046676459 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3afc032030 con 0x7f3b04146650 2024-09-21T06:10:27.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.074+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3b04070010 con 0x7f3b04146650 2024-09-21T06:10:27.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.078+0000 7f3afb400640 1 -- 172.21.15.118:0/3046676459 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f3afc083a20 con 0x7f3b04146650 2024-09-21T06:10:27.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ae4078b90 msgr2=0x7f3ae407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ae4078b90 0x7f3ae407b0a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3af4007fd0 tx=0x7f3af4009040 comp rx=0 tx=0).stop 2024-09-21T06:10:27.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04146650 msgr2=0x7f3b0415b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04146650 0x7f3b0415b680 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f3afc006010 tx=0x7f3afc003f10 comp rx=0 tx=0).stop 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 shutdown_connections 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04146650 0x7f3b0415b680 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3ae4078b90 0x7f3ae407b0a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b040ceb40 0x7f3b04159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 --2- 172.21.15.118:0/3046676459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040b4830 0x7f3b041570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 >> 172.21.15.118:0/3046676459 conn(0x7f3b04071070 msgr2=0x7f3b040d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 shutdown_connections 2024-09-21T06:10:27.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.081+0000 7f3b0a600640 1 -- 172.21.15.118:0/3046676459 wait complete. 2024-09-21T06:10:27.105 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:10:27.106 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:10:27.201 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:10:27.304 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:10:27.304 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:27.304 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:27.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:10:27.340 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:10:27.340 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:27.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:10:27.378 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:27.378 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:27.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:10:27.416 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:10:27.416 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:27.453 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:10:27.454 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:10:27.454 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:27.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.674+0000 7f738ee00640 1 -- 172.21.15.118:0/2668081065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f736c003c30 msgr2=0x7f736c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.674+0000 7f738ee00640 1 --2- 172.21.15.118:0/2668081065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f736c003c30 0x7f736c004080 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7378009b50 tx=0x7f736c005830 comp rx=0 tx=0).stop 2024-09-21T06:10:27.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.674+0000 7f738ee00640 1 -- 172.21.15.118:0/2668081065 shutdown_connections 2024-09-21T06:10:27.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.674+0000 7f738ee00640 1 --2- 172.21.15.118:0/2668081065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f736c003c30 0x7f736c004080 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.674+0000 7f738ee00640 1 -- 172.21.15.118:0/2668081065 >> 172.21.15.118:0/2668081065 conn(0x7f738806d110 msgr2=0x7f738806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:27.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.675+0000 7f738ee00640 1 -- 172.21.15.118:0/2668081065 shutdown_connections 2024-09-21T06:10:27.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.675+0000 7f738ee00640 1 -- 172.21.15.118:0/2668081065 wait complete. 2024-09-21T06:10:27.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.677+0000 7f738ee00640 1 Processor -- start 2024-09-21T06:10:27.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.677+0000 7f738ee00640 1 -- start start 2024-09-21T06:10:27.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f738ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f736c003c30 0x7f738813c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f738ee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f738813f1f0 0x7f73881f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f738ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73881f1410 0x7f738813d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f738ee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f73880ccdd0 con 0x7f738813f1f0 2024-09-21T06:10:27.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f738ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f73880ccc50 con 0x7f73881f1410 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f738ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f73880ccf50 con 0x7f736c003c30 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f7387400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f738813f1f0 0x7f73881f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f7387400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f738813f1f0 0x7f73881f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48768/0 (socket says 172.21.15.118:48768) 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.678+0000 7f7387400640 1 -- 172.21.15.118:0/1539638009 learned_addr learned my addr 172.21.15.118:0/1539638009 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f7387e00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f736c003c30 0x7f738813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f738ce00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73881f1410 0x7f738813d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f7387400640 1 -- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f736c003c30 msgr2=0x7f738813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f7387400640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f736c003c30 0x7f738813c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f7387400640 1 -- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73881f1410 msgr2=0x7f738813d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f7387400640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73881f1410 0x7f738813d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f7387400640 1 -- 172.21.15.118:0/1539638009 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7388141ec0 con 0x7f738813f1f0 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f738ce00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73881f1410 0x7f738813d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:27.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f7387400640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f738813f1f0 0x7f73881f0ed0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7374006fd0 tx=0x7f7374001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:27.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f737fe00640 1 -- 172.21.15.118:0/1539638009 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374011640 con 0x7f738813f1f0 2024-09-21T06:10:27.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f737fe00640 1 -- 172.21.15.118:0/1539638009 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7374016020 con 0x7f738813f1f0 2024-09-21T06:10:27.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f737fe00640 1 -- 172.21.15.118:0/1539638009 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374011aa0 con 0x7f738813f1f0 2024-09-21T06:10:27.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.679+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73881421a0 con 0x7f738813f1f0 2024-09-21T06:10:27.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.680+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738813bff0 con 0x7f738813f1f0 2024-09-21T06:10:27.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.681+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73880cd4b0 con 0x7f738813f1f0 2024-09-21T06:10:27.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.682+0000 7f737fe00640 1 -- 172.21.15.118:0/1539638009 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7374011c40 con 0x7f738813f1f0 2024-09-21T06:10:27.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.683+0000 7f737fe00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7368078b90 0x7f736807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.683+0000 7f737fe00640 1 -- 172.21.15.118:0/1539638009 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7f737409b680 con 0x7f738813f1f0 2024-09-21T06:10:27.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.683+0000 7f7387e00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7368078b90 0x7f736807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.684+0000 7f7387e00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7368078b90 0x7f736807b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7378035000 tx=0x7f73780046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:27.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.687+0000 7f737fe00640 1 -- 172.21.15.118:0/1539638009 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7374020020 con 0x7f738813f1f0 2024-09-21T06:10:27.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.911+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7388073830 con 0x7f738813f1f0 2024-09-21T06:10:27.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.912+0000 7f737fe00640 1 -- 172.21.15.118:0/1539638009 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+3923 (secure 0 0 0) 0x7f7374063d20 con 0x7f738813f1f0 2024-09-21T06:10:27.914 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:27.914 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":61,"btime":"2024-09-21T06:10:21:152804+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1109455544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1109455544},{"type":"v1","addr":"172.21.15.149:6837","nonce":1109455544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":5969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3124044625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":3124044625},{"type":"v1","addr":"172.21.15.118:6835","nonce":3124044625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/4294098320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4294098320},{"type":"v1","addr":"172.21.15.149:6836","nonce":4294098320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6591,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1422306329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1422306329},{"type":"v1","addr":"172.21.15.118:6833","nonce":1422306329}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[]} 2024-09-21T06:10:27.915 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 61 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7368078b90 msgr2=0x7f736807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7368078b90 0x7f736807b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7378035000 tx=0x7f73780046c0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f738813f1f0 msgr2=0x7f73881f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f738813f1f0 0x7f73881f0ed0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7374006fd0 tx=0x7f7374001800 comp rx=0 tx=0).stop 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 shutdown_connections 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73881f1410 0x7f738813d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f738813f1f0 0x7f73881f0ed0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7368078b90 0x7f736807b0a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 --2- 172.21.15.118:0/1539638009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f736c003c30 0x7f738813c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 >> 172.21.15.118:0/1539638009 conn(0x7f738806d110 msgr2=0x7f7388075fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 shutdown_connections 2024-09-21T06:10:27.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:27.914+0000 7f738ee00640 1 -- 172.21.15.118:0/1539638009 wait complete. 2024-09-21T06:10:27.941 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:10:27.941 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:10:27.941 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:10:27.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:10:27.942 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:10:27.942 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:10:27.942 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:10:27.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:10:27.942 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:10:27.942 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:10:27.943 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:10:27.943 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:10:27.943 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:10:27.943 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:10:27.943 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:10:27.943 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:10:27.965 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:10:27.965 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:10:27.967 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:10:27.967 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:10:27.969 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:10:27.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:10:27.970 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:10:27.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:10:28.012 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:10:28.013 DEBUG:teuthology.parallel:result is None 2024-09-21T06:10:28.013 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:10:28.013 DEBUG:teuthology.parallel:result is None 2024-09-21T06:10:28.015 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:10:28.015 DEBUG:teuthology.parallel:result is None 2024-09-21T06:10:28.016 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:10:28.016 DEBUG:teuthology.parallel:result is None 2024-09-21T06:10:28.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:10:28.209 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:10:28.209 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:10:28.211 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:10:28.214 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 -- 172.21.15.118:0/4003201218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8684070dc0 msgr2=0x7f86840b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 --2- 172.21.15.118:0/4003201218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8684070dc0 0x7f86840b44c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8678009860 tx=0x7f867802a540 comp rx=0 tx=0).stop 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 -- 172.21.15.118:0/4003201218 shutdown_connections 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 --2- 172.21.15.118:0/4003201218 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f868415bd00 0x7f868415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 --2- 172.21.15.118:0/4003201218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8684070dc0 0x7f86840b44c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 -- 172.21.15.118:0/4003201218 >> 172.21.15.118:0/4003201218 conn(0x7f868406d110 msgr2=0x7f868406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 -- 172.21.15.118:0/4003201218 shutdown_connections 2024-09-21T06:10:28.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.246+0000 7f868c400640 1 -- 172.21.15.118:0/4003201218 wait complete. 2024-09-21T06:10:28.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.248+0000 7f868c400640 1 Processor -- start 2024-09-21T06:10:28.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.249+0000 7f868c400640 1 -- start start 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f868c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8684070dc0 0x7f8684152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f868c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868415bd00 0x7f86841496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f868c400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868415f660 0x7f868414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f868c400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f868406f170 con 0x7f868415f660 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f868c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f868406eff0 con 0x7f868415bd00 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f868c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f868406f2f0 con 0x7f8684070dc0 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f868a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868415f660 0x7f868414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f8689a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8684070dc0 0x7f8684152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f8689a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8684070dc0 0x7f8684152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:38492/0 (socket says 172.21.15.118:38492) 2024-09-21T06:10:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f8689a00640 1 -- 172.21.15.118:0/2348481408 learned_addr learned my addr 172.21.15.118:0/2348481408 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:28.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.250+0000 7f8689000640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868415bd00 0x7f86841496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8689a00640 1 -- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868415bd00 msgr2=0x7f86841496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8689a00640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868415bd00 0x7f86841496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8689a00640 1 -- 172.21.15.118:0/2348481408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868415f660 msgr2=0x7f868414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8689a00640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868415f660 0x7f868414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8689a00640 1 -- 172.21.15.118:0/2348481408 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8684152810 con 0x7f8684070dc0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8689a00640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8684070dc0 0x7f8684152050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8678009980 tx=0x7f8678033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8681600640 1 -- 172.21.15.118:0/2348481408 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8678031d60 con 0x7f8684070dc0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8681600640 1 -- 172.21.15.118:0/2348481408 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8678033e10 con 0x7f8684070dc0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f8681600640 1 -- 172.21.15.118:0/2348481408 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86780332b0 con 0x7f8684070dc0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8684152af0 con 0x7f8684070dc0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.251+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8684150040 con 0x7f8684070dc0 2024-09-21T06:10:28.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.252+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86840b44c0 con 0x7f8684070dc0 2024-09-21T06:10:28.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.254+0000 7f8681600640 1 -- 172.21.15.118:0/2348481408 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8678033450 con 0x7f8684070dc0 2024-09-21T06:10:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.255+0000 7f8681600640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8664078b90 0x7f866407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.255+0000 7f8681600640 1 -- 172.21.15.118:0/2348481408 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7f86780bbd30 con 0x7f8684070dc0 2024-09-21T06:10:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.255+0000 7f8689000640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8664078b90 0x7f866407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:28.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.256+0000 7f8689000640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8664078b90 0x7f866407b0a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f868414d2b0 tx=0x7f8670007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:28.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.260+0000 7f8681600640 1 -- 172.21.15.118:0/2348481408 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f867803f030 con 0x7f8684070dc0 2024-09-21T06:10:28.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:28.469+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8684149c30 con 0x7f8684070dc0 2024-09-21T06:10:29.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.201+0000 7f8681600640 1 -- 172.21.15.118:0/2348481408 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v126) ==== 97+0+0 (secure 0 0 0) 0x7f8678083e10 con 0x7f8684070dc0 2024-09-21T06:10:29.203 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:10:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8664078b90 msgr2=0x7f866407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8664078b90 0x7f866407b0a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f868414d2b0 tx=0x7f8670007e90 comp rx=0 tx=0).stop 2024-09-21T06:10:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8684070dc0 msgr2=0x7f8684152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8684070dc0 0x7f8684152050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8678009980 tx=0x7f8678033c20 comp rx=0 tx=0).stop 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 shutdown_connections 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868415f660 0x7f868414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f868415bd00 0x7f86841496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8664078b90 0x7f866407b0a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.203+0000 7f868c400640 1 --2- 172.21.15.118:0/2348481408 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8684070dc0 0x7f8684152050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.204+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 >> 172.21.15.118:0/2348481408 conn(0x7f868406d110 msgr2=0x7f86840b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.204+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 shutdown_connections 2024-09-21T06:10:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.204+0000 7f868c400640 1 -- 172.21.15.118:0/2348481408 wait complete. 2024-09-21T06:10:29.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 -- 172.21.15.118:0/2926657061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 msgr2=0x7f8b700b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/2926657061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700b4010 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8b68005fd0 tx=0x7f8b6802a5c0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 -- 172.21.15.118:0/2926657061 shutdown_connections 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/2926657061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700b4010 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/2926657061 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b70144dc0 0x7f8b70144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 -- 172.21.15.118:0/2926657061 >> 172.21.15.118:0/2926657061 conn(0x7f8b7006d6e0 msgr2=0x7f8b700b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 -- 172.21.15.118:0/2926657061 shutdown_connections 2024-09-21T06:10:29.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.452+0000 7f8b6fe00640 1 -- 172.21.15.118:0/2926657061 wait complete. 2024-09-21T06:10:29.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.454+0000 7f8b6fe00640 1 Processor -- start 2024-09-21T06:10:29.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.455+0000 7f8b6fe00640 1 -- start start 2024-09-21T06:10:29.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b700cedb0 0x7f8b7013dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b70144dc0 0x7f8b7013f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8b700b4a20 con 0x7f8b700cf8d0 2024-09-21T06:10:29.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8b700b48a0 con 0x7f8b700cedb0 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8b700b4ba0 con 0x7f8b70144dc0 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b66000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b66000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48850/0 (socket says 172.21.15.118:48850) 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b66000640 1 -- 172.21.15.118:0/4193605013 learned_addr learned my addr 172.21.15.118:0/4193605013 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6ea00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b700cedb0 0x7f8b7013dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.456+0000 7f8b6f400640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b70144dc0 0x7f8b7013f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b66000640 1 -- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b70144dc0 msgr2=0x7f8b7013f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b66000640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b70144dc0 0x7f8b7013f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b66000640 1 -- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b700cedb0 msgr2=0x7f8b7013dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b66000640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b700cedb0 0x7f8b7013dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b66000640 1 -- 172.21.15.118:0/4193605013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b700aee10 con 0x7f8b700cf8d0 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b66000640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700affb0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800c3c0 tx=0x7f8b5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:29.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b67400640 1 -- 172.21.15.118:0/4193605013 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58017070 con 0x7f8b700cf8d0 2024-09-21T06:10:29.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b67400640 1 -- 172.21.15.118:0/4193605013 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b580035f0 con 0x7f8b700cf8d0 2024-09-21T06:10:29.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b700af0f0 con 0x7f8b700cf8d0 2024-09-21T06:10:29.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b67400640 1 -- 172.21.15.118:0/4193605013 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58003a20 con 0x7f8b700cf8d0 2024-09-21T06:10:29.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.457+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b700b11f0 con 0x7f8b700cf8d0 2024-09-21T06:10:29.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.459+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b700b61a0 con 0x7f8b700cf8d0 2024-09-21T06:10:29.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.460+0000 7f8b67400640 1 -- 172.21.15.118:0/4193605013 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b5801a070 con 0x7f8b700cf8d0 2024-09-21T06:10:29.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.461+0000 7f8b67400640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.461+0000 7f8b67400640 1 -- 172.21.15.118:0/4193605013 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4857+0+0 (secure 0 0 0) 0x7f8b58099bf0 con 0x7f8b700cf8d0 2024-09-21T06:10:29.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.461+0000 7f8b6ea00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.462+0000 7f8b6ea00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005fd0 tx=0x7f8b60009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:29.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.465+0000 7f8b67400640 1 -- 172.21.15.118:0/4193605013 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b700cfce0 con 0x7f8b700cf8d0 2024-09-21T06:10:29.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.718+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8b700af2c0 con 0x7f8b700cf8d0 2024-09-21T06:10:29.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.719+0000 7f8b67400640 1 -- 172.21.15.118:0/4193605013 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f8b58061d30 con 0x7f8b700cf8d0 2024-09-21T06:10:29.721 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.722 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:10:29.723 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.724 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.726 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.727 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:10:29.728 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.729 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.730 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:10:29.731 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:10:29.732 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.733 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:29.734 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:29.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8b4c078b90 msgr2=0x7f8b4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005fd0 tx=0x7f8b60009500 comp rx=0 tx=0).stop 2024-09-21T06:10:29.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 msgr2=0x7f8b700affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700affb0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800c3c0 tx=0x7f8b5800c880 comp rx=0 tx=0).stop 2024-09-21T06:10:29.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 shutdown_connections 2024-09-21T06:10:29.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8b70144dc0 0x7f8b7013f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b700cf8d0 0x7f8b700affb0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 --2- 172.21.15.118:0/4193605013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b700cedb0 0x7f8b7013dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 >> 172.21.15.118:0/4193605013 conn(0x7f8b7006d6e0 msgr2=0x7f8b7006f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:29.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 shutdown_connections 2024-09-21T06:10:29.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.722+0000 7f8b6fe00640 1 -- 172.21.15.118:0/4193605013 wait complete. 2024-09-21T06:10:29.745 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:10:29.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.964+0000 7fda3fe00640 1 -- 172.21.15.118:0/788568791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda24004db0 msgr2=0x7fda24005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.964+0000 7fda3fe00640 1 --2- 172.21.15.118:0/788568791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda24004db0 0x7fda24005280 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fda38001f30 tx=0x7fda24005830 comp rx=0 tx=0).stop 2024-09-21T06:10:29.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.964+0000 7fda3f400640 1 -- 172.21.15.118:0/788568791 reap_dead start 2024-09-21T06:10:29.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.964+0000 7fda3fe00640 1 -- 172.21.15.118:0/788568791 shutdown_connections 2024-09-21T06:10:29.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.964+0000 7fda3fe00640 1 -- 172.21.15.118:0/788568791 >> 172.21.15.118:0/788568791 conn(0x7fda4006d1c0 msgr2=0x7fda4006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:29.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.964+0000 7fda3fe00640 1 -- 172.21.15.118:0/788568791 shutdown_connections 2024-09-21T06:10:29.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.964+0000 7fda3fe00640 1 -- 172.21.15.118:0/788568791 wait complete. 2024-09-21T06:10:29.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.966+0000 7fda3fe00640 1 Processor -- start 2024-09-21T06:10:29.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.966+0000 7fda3fe00640 1 -- start start 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda24004db0 0x7fda40153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda400b9400 0x7fda4015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda4015c430 0x7fda401f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fda4015f9f0 con 0x7fda400b9400 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda4015f870 con 0x7fda4015c430 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fda400d1d10 con 0x7fda24004db0 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda36000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda400b9400 0x7fda4015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda36000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda400b9400 0x7fda4015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48876/0 (socket says 172.21.15.118:48876) 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda36000640 1 -- 172.21.15.118:0/1756702419 learned_addr learned my addr 172.21.15.118:0/1756702419 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:29.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3ea00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda24004db0 0x7fda40153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.968+0000 7fda3f400640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda4015c430 0x7fda401f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda36000640 1 -- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda24004db0 msgr2=0x7fda40153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda36000640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda24004db0 0x7fda40153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda36000640 1 -- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda4015c430 msgr2=0x7fda401f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda36000640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda4015c430 0x7fda401f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda36000640 1 -- 172.21.15.118:0/1756702419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4015c840 con 0x7fda400b9400 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda3f400640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda4015c430 0x7fda401f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda3ea00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda24004db0 0x7fda40153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda36000640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda400b9400 0x7fda4015bef0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fda28011ae0 tx=0x7fda28009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda37e00640 1 -- 172.21.15.118:0/1756702419 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2801e070 con 0x7fda400b9400 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda37e00640 1 -- 172.21.15.118:0/1756702419 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda2800fe70 con 0x7fda400b9400 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda40155a00 con 0x7fda400b9400 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda37e00640 1 -- 172.21.15.118:0/1756702419 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28004290 con 0x7fda400b9400 2024-09-21T06:10:29.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.969+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda40155fc0 con 0x7fda400b9400 2024-09-21T06:10:29.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.970+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda400d5460 con 0x7fda400b9400 2024-09-21T06:10:29.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.972+0000 7fda37e00640 1 -- 172.21.15.118:0/1756702419 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda28021070 con 0x7fda400b9400 2024-09-21T06:10:29.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.972+0000 7fda37e00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda1c078bc0 0x7fda1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.973+0000 7fda37e00640 1 -- 172.21.15.118:0/1756702419 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4857+0+0 (secure 0 0 0) 0x7fda2809b490 con 0x7fda400b9400 2024-09-21T06:10:29.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.973+0000 7fda3ea00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda1c078bc0 0x7fda1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.974+0000 7fda3ea00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda1c078bc0 0x7fda1c07b0d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fda30001eb0 tx=0x7fda30001d80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:29.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:29.977+0000 7fda37e00640 1 -- 172.21.15.118:0/1756702419 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fda4015c840 con 0x7fda400b9400 2024-09-21T06:10:30.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.162+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fda400b9870 con 0x7fda400b9400 2024-09-21T06:10:30.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.163+0000 7fda37e00640 1 -- 172.21.15.118:0/1756702419 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v128) ==== 84+0+65 (secure 0 0 0) 0x7fda280635f0 con 0x7fda400b9400 2024-09-21T06:10:30.166 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:30.166 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:10:30.166 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:30.166 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:10:30.166 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:10:30.166 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:30.166 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:10:30.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda1c078bc0 msgr2=0x7fda1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:30.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda1c078bc0 0x7fda1c07b0d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fda30001eb0 tx=0x7fda30001d80 comp rx=0 tx=0).stop 2024-09-21T06:10:30.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda400b9400 msgr2=0x7fda4015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:30.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda400b9400 0x7fda4015bef0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fda28011ae0 tx=0x7fda28009e90 comp rx=0 tx=0).stop 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 shutdown_connections 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda4015c430 0x7fda401f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda400b9400 0x7fda4015bef0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fda1c078bc0 0x7fda1c07b0d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 --2- 172.21.15.118:0/1756702419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda24004db0 0x7fda40153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.165+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 >> 172.21.15.118:0/1756702419 conn(0x7fda4006d1c0 msgr2=0x7fda4015d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.166+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 shutdown_connections 2024-09-21T06:10:30.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.166+0000 7fda3fe00640 1 -- 172.21.15.118:0/1756702419 wait complete. 2024-09-21T06:10:30.189 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:10:30.189 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:10:30.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.411+0000 7fa953e00640 1 -- 172.21.15.118:0/1545616745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 msgr2=0x7fa9541606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:30.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.411+0000 7fa953e00640 1 --2- 172.21.15.118:0/1545616745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 0x7fa9541606e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009890 tx=0x7fa93c02a540 comp rx=0 tx=0).stop 2024-09-21T06:10:30.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.411+0000 7fa953e00640 1 -- 172.21.15.118:0/1545616745 shutdown_connections 2024-09-21T06:10:30.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.411+0000 7fa953e00640 1 --2- 172.21.15.118:0/1545616745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 0x7fa9541606e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:30.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.412+0000 7fa953e00640 1 -- 172.21.15.118:0/1545616745 >> 172.21.15.118:0/1545616745 conn(0x7fa95406d420 msgr2=0x7fa9540b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:30.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.412+0000 7fa953e00640 1 -- 172.21.15.118:0/1545616745 shutdown_connections 2024-09-21T06:10:30.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.412+0000 7fa953e00640 1 -- 172.21.15.118:0/1545616745 wait complete. 2024-09-21T06:10:30.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.414+0000 7fa953e00640 1 Processor -- start 2024-09-21T06:10:30.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.414+0000 7fa953e00640 1 -- start start 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.415+0000 7fa953e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 0x7fa95414c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.415+0000 7fa953e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9540cf790 0x7fa95415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.415+0000 7fa953e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa954160c20 0x7fa95415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.415+0000 7fa953e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa95406fb90 con 0x7fa954160c20 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.415+0000 7fa953e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa95406fa10 con 0x7fa9540cf790 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.415+0000 7fa953e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa95406fd10 con 0x7fa9540cd380 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa954160c20 0x7fa95415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa954160c20 0x7fa95415bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48880/0 (socket says 172.21.15.118:48880) 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 -- 172.21.15.118:0/133426551 learned_addr learned my addr 172.21.15.118:0/133426551 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:30.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa94a000640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9540cf790 0x7fa95415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa952a00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 0x7fa95414c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 -- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 msgr2=0x7fa95414c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:30.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 0x7fa95414c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 -- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9540cf790 msgr2=0x7fa95415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9540cf790 0x7fa95415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 -- 172.21.15.118:0/133426551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9541588a0 con 0x7fa954160c20 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.416+0000 7fa953400640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa954160c20 0x7fa95415bf10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00cfd0 tx=0x7fa94c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.417+0000 7fa94b400640 1 -- 172.21.15.118:0/133426551 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c016020 con 0x7fa954160c20 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.417+0000 7fa94b400640 1 -- 172.21.15.118:0/133426551 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa94c012420 con 0x7fa954160c20 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.417+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa954158b80 con 0x7fa954160c20 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.417+0000 7fa94b400640 1 -- 172.21.15.118:0/133426551 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c012870 con 0x7fa954160c20 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.417+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa954154ae0 con 0x7fa954160c20 2024-09-21T06:10:30.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.418+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa954158610 con 0x7fa954160c20 2024-09-21T06:10:30.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.419+0000 7fa94b400640 1 -- 172.21.15.118:0/133426551 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa94c019020 con 0x7fa954160c20 2024-09-21T06:10:30.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.420+0000 7fa94b400640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa930078b90 0x7fa93007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:30.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.420+0000 7fa94b400640 1 -- 172.21.15.118:0/133426551 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4857+0+0 (secure 0 0 0) 0x7fa94c09b110 con 0x7fa954160c20 2024-09-21T06:10:30.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.420+0000 7fa952a00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa930078b90 0x7fa93007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:30.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.421+0000 7fa952a00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa930078b90 0x7fa93007b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa944001120 tx=0x7fa944009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:30.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.424+0000 7fa94b400640 1 -- 172.21.15.118:0/133426551 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa94c020020 con 0x7fa954160c20 2024-09-21T06:10:30.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:30.612+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa954161210 con 0x7fa954160c20 2024-09-21T06:10:31.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.206+0000 7fa94b400640 1 -- 172.21.15.118:0/133426551 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v129) ==== 138+0+0 (secure 0 0 0) 0x7fa954161210 con 0x7fa954160c20 2024-09-21T06:10:31.209 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:10:31.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa930078b90 msgr2=0x7fa93007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa930078b90 0x7fa93007b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa944001120 tx=0x7fa944009040 comp rx=0 tx=0).stop 2024-09-21T06:10:31.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa954160c20 msgr2=0x7fa95415bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa954160c20 0x7fa95415bf10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00cfd0 tx=0x7fa94c00a430 comp rx=0 tx=0).stop 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 shutdown_connections 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa954160c20 0x7fa95415bf10 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9540cf790 0x7fa95415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa930078b90 0x7fa93007b0a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 --2- 172.21.15.118:0/133426551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9540cd380 0x7fa95414c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 >> 172.21.15.118:0/133426551 conn(0x7fa95406d420 msgr2=0x7fa9540b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.212+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 shutdown_connections 2024-09-21T06:10:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.213+0000 7fa953e00640 1 -- 172.21.15.118:0/133426551 wait complete. 2024-09-21T06:10:31.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:10:31.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 -- 172.21.15.118:0/3506123092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6840cd790 msgr2=0x7fb684160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3506123092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6840cd790 0x7fb684160880 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb670009830 tx=0x7fb67002a480 comp rx=0 tx=0).stop 2024-09-21T06:10:31.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 -- 172.21.15.118:0/3506123092 shutdown_connections 2024-09-21T06:10:31.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3506123092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6840cd790 0x7fb684160880 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3506123092 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6841571e0 0x7fb6840cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 -- 172.21.15.118:0/3506123092 >> 172.21.15.118:0/3506123092 conn(0x7fb6840b2dd0 msgr2=0x7fb6840d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:31.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 -- 172.21.15.118:0/3506123092 shutdown_connections 2024-09-21T06:10:31.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.466+0000 7fb68ac00640 1 -- 172.21.15.118:0/3506123092 wait complete. 2024-09-21T06:10:31.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.468+0000 7fb68ac00640 1 Processor -- start 2024-09-21T06:10:31.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.468+0000 7fb68ac00640 1 -- start start 2024-09-21T06:10:31.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb68ac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6840cd790 0x7fb6840cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb68ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6841571e0 0x7fb68415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb68ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb684160dc0 0x7fb68415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb68ac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb68415d9a0 con 0x7fb6840cd790 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb68ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840cfab0 con 0x7fb6841571e0 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb68ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb68415db20 con 0x7fb684160dc0 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb689800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6840cd790 0x7fb6840cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb689800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6840cd790 0x7fb6840cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48892/0 (socket says 172.21.15.118:48892) 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb689800640 1 -- 172.21.15.118:0/3780310537 learned_addr learned my addr 172.21.15.118:0/3780310537 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb688e00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6841571e0 0x7fb68415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.470+0000 7fb68a200640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb684160dc0 0x7fb68415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb689800640 1 -- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb684160dc0 msgr2=0x7fb68415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb689800640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb684160dc0 0x7fb68415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb689800640 1 -- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6841571e0 msgr2=0x7fb68415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb689800640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6841571e0 0x7fb68415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb689800640 1 -- 172.21.15.118:0/3780310537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68414b900 con 0x7fb6840cd790 2024-09-21T06:10:31.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb689800640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6840cd790 0x7fb6840cc110 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb67800ece0 tx=0x7fb67800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:31.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb681600640 1 -- 172.21.15.118:0/3780310537 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678003b70 con 0x7fb6840cd790 2024-09-21T06:10:31.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb681600640 1 -- 172.21.15.118:0/3780310537 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb678003d10 con 0x7fb6840cd790 2024-09-21T06:10:31.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68414bbe0 con 0x7fb6840cd790 2024-09-21T06:10:31.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb681600640 1 -- 172.21.15.118:0/3780310537 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678004280 con 0x7fb6840cd790 2024-09-21T06:10:31.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.471+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68414c1a0 con 0x7fb6840cd790 2024-09-21T06:10:31.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.473+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68415dfd0 con 0x7fb6840cd790 2024-09-21T06:10:31.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.474+0000 7fb681600640 1 -- 172.21.15.118:0/3780310537 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb678004420 con 0x7fb6840cd790 2024-09-21T06:10:31.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.475+0000 7fb681600640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb664078b90 0x7fb66407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.475+0000 7fb681600640 1 -- 172.21.15.118:0/3780310537 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5227+0+0 (secure 0 0 0) 0x7fb67809b960 con 0x7fb6840cd790 2024-09-21T06:10:31.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.475+0000 7fb688e00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb664078b90 0x7fb66407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.476+0000 7fb688e00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb664078b90 0x7fb66407b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb670034000 tx=0x7fb670004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:31.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.480+0000 7fb681600640 1 -- 172.21.15.118:0/3780310537 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb678063810 con 0x7fb6840cd790 2024-09-21T06:10:31.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:31.665+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb6840d1560 con 0x7fb6840cd790 2024-09-21T06:10:32.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.209+0000 7fb681600640 1 -- 172.21.15.118:0/3780310537 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v130) ==== 170+0+0 (secure 0 0 0) 0x7fb678068240 con 0x7fb6840cd790 2024-09-21T06:10:32.212 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:10:32.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb664078b90 msgr2=0x7fb66407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:32.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb664078b90 0x7fb66407b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb670034000 tx=0x7fb670004730 comp rx=0 tx=0).stop 2024-09-21T06:10:32.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6840cd790 msgr2=0x7fb6840cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:32.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6840cd790 0x7fb6840cc110 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb67800ece0 tx=0x7fb67800c6a0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 shutdown_connections 2024-09-21T06:10:32.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb664078b90 0x7fb66407b0a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb684160dc0 0x7fb68415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6841571e0 0x7fb68415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 --2- 172.21.15.118:0/3780310537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6840cd790 0x7fb6840cc110 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 >> 172.21.15.118:0/3780310537 conn(0x7fb6840b2dd0 msgr2=0x7fb6840ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:32.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 shutdown_connections 2024-09-21T06:10:32.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.213+0000 7fb68ac00640 1 -- 172.21.15.118:0/3780310537 wait complete. 2024-09-21T06:10:32.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:10:32.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.472+0000 7f9cfd200640 1 -- 172.21.15.118:0/1571072132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf80b62c0 msgr2=0x7f9cf80d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:32.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.472+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1571072132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf80b62c0 0x7f9cf80d0240 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009830 tx=0x7f9cf002a520 comp rx=0 tx=0).stop 2024-09-21T06:10:32.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.472+0000 7f9cfd200640 1 -- 172.21.15.118:0/1571072132 shutdown_connections 2024-09-21T06:10:32.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.472+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1571072132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf80b62c0 0x7f9cf80d0240 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.472+0000 7f9cfd200640 1 -- 172.21.15.118:0/1571072132 >> 172.21.15.118:0/1571072132 conn(0x7f9cf806d6e0 msgr2=0x7f9cf80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:32.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.472+0000 7f9cfd200640 1 -- 172.21.15.118:0/1571072132 shutdown_connections 2024-09-21T06:10:32.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.472+0000 7f9cfd200640 1 -- 172.21.15.118:0/1571072132 wait complete. 2024-09-21T06:10:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.475+0000 7f9cfd200640 1 Processor -- start 2024-09-21T06:10:32.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.475+0000 7f9cfd200640 1 -- start start 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.476+0000 7f9cfd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf8073fa0 0x7f9cf8159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.476+0000 7f9cfd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80cfe30 0x7f9cf8158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.476+0000 7f9cfd200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8158ed0 0x7f9cf81592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.476+0000 7f9cfd200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf815dad0 con 0x7f9cf8158ed0 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.476+0000 7f9cfd200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf815d950 con 0x7f9cf80cfe30 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.476+0000 7f9cfd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf815dc50 con 0x7f9cf8073fa0 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8158ed0 0x7f9cf81592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8158ed0 0x7f9cf81592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48908/0 (socket says 172.21.15.118:48908) 2024-09-21T06:10:32.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 -- 172.21.15.118:0/1742717775 learned_addr learned my addr 172.21.15.118:0/1742717775 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9ceea00640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80cfe30 0x7f9cf8158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7400640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf8073fa0 0x7f9cf8159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 -- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf8073fa0 msgr2=0x7f9cf8159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf8073fa0 0x7f9cf8159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 -- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80cfe30 msgr2=0x7f9cf8158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80cfe30 0x7f9cf8158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 -- 172.21.15.118:0/1742717775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf8132dd0 con 0x7f9cf8158ed0 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9ceea00640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80cfe30 0x7f9cf8158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7400640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf8073fa0 0x7f9cf8159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.477+0000 7f9cf7e00640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8158ed0 0x7f9cf81592e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009950 tx=0x7f9cf0033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.478+0000 7f9cefe00640 1 -- 172.21.15.118:0/1742717775 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0031d60 con 0x7f9cf8158ed0 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.478+0000 7f9cefe00640 1 -- 172.21.15.118:0/1742717775 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cf0005020 con 0x7f9cf8158ed0 2024-09-21T06:10:32.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.478+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf81e6af0 con 0x7f9cf8158ed0 2024-09-21T06:10:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.478+0000 7f9cefe00640 1 -- 172.21.15.118:0/1742717775 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0005450 con 0x7f9cf8158ed0 2024-09-21T06:10:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.478+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf8133350 con 0x7f9cf8158ed0 2024-09-21T06:10:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.479+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf81e6860 con 0x7f9cf8158ed0 2024-09-21T06:10:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.480+0000 7f9cefe00640 1 -- 172.21.15.118:0/1742717775 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9cf00047a0 con 0x7f9cf8158ed0 2024-09-21T06:10:32.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.482+0000 7f9cefe00640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cd4078bc0 0x7f9cd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:32.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.482+0000 7f9cefe00640 1 -- 172.21.15.118:0/1742717775 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5609+0+0 (secure 0 0 0) 0x7f9cf00bbf60 con 0x7f9cf8158ed0 2024-09-21T06:10:32.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.483+0000 7f9cf7400640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cd4078bc0 0x7f9cd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:32.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.483+0000 7f9cf7400640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cd4078bc0 0x7f9cd407b0d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8001d10 tx=0x7f9ce8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:32.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.487+0000 7f9cefe00640 1 -- 172.21.15.118:0/1742717775 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9cf003f030 con 0x7f9cf8158ed0 2024-09-21T06:10:32.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:32.713+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9cf815c730 con 0x7f9cf8158ed0 2024-09-21T06:10:33.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.227+0000 7f9cefe00640 1 -- 172.21.15.118:0/1742717775 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v64) ==== 174+0+0 (secure 0 0 0) 0x7f9cf0084400 con 0x7f9cf8158ed0 2024-09-21T06:10:33.229 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 16 and data pool 17 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.230+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cd4078bc0 msgr2=0x7f9cd407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.230+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cd4078bc0 0x7f9cd407b0d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8001d10 tx=0x7f9ce8009040 comp rx=0 tx=0).stop 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8158ed0 msgr2=0x7f9cf81592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8158ed0 0x7f9cf81592e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009950 tx=0x7f9cf0033ce0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 shutdown_connections 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8158ed0 0x7f9cf81592e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80cfe30 0x7f9cf8158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cd4078bc0 0x7f9cd407b0d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 --2- 172.21.15.118:0/1742717775 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cf8073fa0 0x7f9cf8159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 >> 172.21.15.118:0/1742717775 conn(0x7f9cf806d6e0 msgr2=0x7f9cf8146170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:33.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 shutdown_connections 2024-09-21T06:10:33.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.231+0000 7f9cfd200640 1 -- 172.21.15.118:0/1742717775 wait complete. 2024-09-21T06:10:33.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 -- 172.21.15.118:0/3187262031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae806f210 msgr2=0x7fdae815bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 --2- 172.21.15.118:0/3187262031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae806f210 0x7fdae815bd00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fdae0005fd0 tx=0x7fdae002a580 comp rx=0 tx=0).stop 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 -- 172.21.15.118:0/3187262031 shutdown_connections 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 --2- 172.21.15.118:0/3187262031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae806f210 0x7fdae815bd00 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 --2- 172.21.15.118:0/3187262031 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdae8152050 0x7fdae806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 --2- 172.21.15.118:0/3187262031 >> v2:172.21.15.149:3300/0 conn(0x7fdae80b44c0 0x7fdae815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 -- 172.21.15.118:0/3187262031 >> 172.21.15.118:0/3187262031 conn(0x7fdae806d110 msgr2=0x7fdae806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:33.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 -- 172.21.15.118:0/3187262031 shutdown_connections 2024-09-21T06:10:33.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.499+0000 7fdaefe00640 1 -- 172.21.15.118:0/3187262031 wait complete. 2024-09-21T06:10:33.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.501+0000 7fdaefe00640 1 Processor -- start 2024-09-21T06:10:33.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.502+0000 7fdaefe00640 1 -- start start 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaefe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdae806f210 0x7fdae8152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaefe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae80b44c0 0x7fdae81f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaefe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdae8152050 0x7fdae8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaefe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdae815c240 con 0x7fdae80b44c0 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaefe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdae8070fd0 con 0x7fdae806f210 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaefe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdae815c3c0 con 0x7fdae8152050 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaeca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae80b44c0 0x7fdae81f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaeca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae80b44c0 0x7fdae81f9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48914/0 (socket says 172.21.15.118:48914) 2024-09-21T06:10:33.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.503+0000 7fdaeca00640 1 -- 172.21.15.118:0/1115985307 learned_addr learned my addr 172.21.15.118:0/1115985307 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:33.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaed400640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdae806f210 0x7fdae8152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaede00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdae8152050 0x7fdae8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaeca00640 1 -- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdae8152050 msgr2=0x7fdae8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaeca00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdae8152050 0x7fdae8151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaeca00640 1 -- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdae806f210 msgr2=0x7fdae8152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaeca00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdae806f210 0x7fdae8152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaeca00640 1 -- 172.21.15.118:0/1115985307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae80c63f0 con 0x7fdae80b44c0 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaede00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdae8152050 0x7fdae8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaed400640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdae806f210 0x7fdae8152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaeca00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae80b44c0 0x7fdae81f9f90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fdad400e790 tx=0x7fdad400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdae5600640 1 -- 172.21.15.118:0/1115985307 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad400eea0 con 0x7fdae80b44c0 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdae5600640 1 -- 172.21.15.118:0/1115985307 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdad400cd50 con 0x7fdae80b44c0 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae80c66d0 con 0x7fdae80b44c0 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.504+0000 7fdae5600640 1 -- 172.21.15.118:0/1115985307 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4010690 con 0x7fdae80b44c0 2024-09-21T06:10:33.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.505+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae8152e10 con 0x7fdae80b44c0 2024-09-21T06:10:33.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.506+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae81f5fb0 con 0x7fdae80b44c0 2024-09-21T06:10:33.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.507+0000 7fdae5600640 1 -- 172.21.15.118:0/1115985307 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdad4010830 con 0x7fdae80b44c0 2024-09-21T06:10:33.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.508+0000 7fdae5600640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdac8078bc0 0x7fdac807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.509+0000 7fdae5600640 1 -- 172.21.15.118:0/1115985307 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fdad409b710 con 0x7fdae80b44c0 2024-09-21T06:10:33.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.509+0000 7fdaed400640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdac8078bc0 0x7fdac807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.510+0000 7fdaed400640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdac8078bc0 0x7fdac807b0d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00afd0 tx=0x7fdadc00e040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:33.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.513+0000 7fdae5600640 1 -- 172.21.15.118:0/1115985307 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdad4063b40 con 0x7fdae80b44c0 2024-09-21T06:10:33.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.698+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdae815f660 con 0x7fdae80b44c0 2024-09-21T06:10:33.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.699+0000 7fdae5600640 1 -- 172.21.15.118:0/1115985307 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16773 (secure 0 0 0) 0x7fdad4063440 con 0x7fdae80b44c0 2024-09-21T06:10:33.702 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:33.702 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":131,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:10:32.715861+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:30.625521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:31.678886+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:33.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.701+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdac8078bc0 msgr2=0x7fdac807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.701+0000 7fdaefe00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdac8078bc0 0x7fdac807b0d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00afd0 tx=0x7fdadc00e040 comp rx=0 tx=0).stop 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.701+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae80b44c0 msgr2=0x7fdae81f9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.701+0000 7fdaefe00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae80b44c0 0x7fdae81f9f90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fdad400e790 tx=0x7fdad400ec50 comp rx=0 tx=0).stop 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 shutdown_connections 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdac8078bc0 0x7fdac807b0d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdae8152050 0x7fdae8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdae80b44c0 0x7fdae81f9f90 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 --2- 172.21.15.118:0/1115985307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdae806f210 0x7fdae8152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 >> 172.21.15.118:0/1115985307 conn(0x7fdae806d110 msgr2=0x7fdae80cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:33.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 shutdown_connections 2024-09-21T06:10:33.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.702+0000 7fdaefe00640 1 -- 172.21.15.118:0/1115985307 wait complete. 2024-09-21T06:10:33.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:10:33.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.943+0000 7fbd25800640 1 -- 172.21.15.118:0/2490582031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd20144760 msgr2=0x7fbd200cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.943+0000 7fbd25800640 1 --2- 172.21.15.118:0/2490582031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd20144760 0x7fbd200cf4c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009830 tx=0x7fbd0802a530 comp rx=0 tx=0).stop 2024-09-21T06:10:33.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.943+0000 7fbd25800640 1 -- 172.21.15.118:0/2490582031 shutdown_connections 2024-09-21T06:10:33.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.943+0000 7fbd25800640 1 --2- 172.21.15.118:0/2490582031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd20144760 0x7fbd200cf4c0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.943+0000 7fbd25800640 1 -- 172.21.15.118:0/2490582031 >> 172.21.15.118:0/2490582031 conn(0x7fbd2006d6e0 msgr2=0x7fbd200b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:33.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.943+0000 7fbd25800640 1 -- 172.21.15.118:0/2490582031 shutdown_connections 2024-09-21T06:10:33.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.943+0000 7fbd25800640 1 -- 172.21.15.118:0/2490582031 wait complete. 2024-09-21T06:10:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.946+0000 7fbd25800640 1 Processor -- start 2024-09-21T06:10:33.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.946+0000 7fbd25800640 1 -- start start 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd25800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd200cfa00 0x7fbd201553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd25800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd20144760 0x7fbd200ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd25800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd20144ea0 0x7fbd200aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd25800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200b4c10 con 0x7fbd200cfa00 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd25800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200b4a90 con 0x7fbd20144ea0 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd25800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbd200b4d90 con 0x7fbd20144760 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd1fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd200cfa00 0x7fbd201553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd1fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd200cfa00 0x7fbd201553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48930/0 (socket says 172.21.15.118:48930) 2024-09-21T06:10:33.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.947+0000 7fbd1fe00640 1 -- 172.21.15.118:0/1513978466 learned_addr learned my addr 172.21.15.118:0/1513978466 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:33.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd17400640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd20144760 0x7fbd200ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd24e00640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd20144ea0 0x7fbd200aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd1fe00640 1 -- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd20144760 msgr2=0x7fbd200ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd1fe00640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd20144760 0x7fbd200ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd1fe00640 1 -- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd20144ea0 msgr2=0x7fbd200aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd1fe00640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd20144ea0 0x7fbd200aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd1fe00640 1 -- 172.21.15.118:0/1513978466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd201f9260 con 0x7fbd200cfa00 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd1fe00640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd200cfa00 0x7fbd201553b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c730 tx=0x7fbd1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.948+0000 7fbd1cc00640 1 -- 172.21.15.118:0/1513978466 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10003da0 con 0x7fbd200cfa00 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.949+0000 7fbd1cc00640 1 -- 172.21.15.118:0/1513978466 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd1000ce40 con 0x7fbd200cfa00 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.949+0000 7fbd1cc00640 1 -- 172.21.15.118:0/1513978466 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100052d0 con 0x7fbd200cfa00 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.949+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd201f9700 con 0x7fbd200cfa00 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.949+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd201f9cc0 con 0x7fbd200cfa00 2024-09-21T06:10:33.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.950+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd200b5270 con 0x7fbd200cfa00 2024-09-21T06:10:33.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.951+0000 7fbd1cc00640 1 -- 172.21.15.118:0/1513978466 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd10005470 con 0x7fbd200cfa00 2024-09-21T06:10:33.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.952+0000 7fbd1cc00640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.952+0000 7fbd1cc00640 1 -- 172.21.15.118:0/1513978466 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fbd1009aa40 con 0x7fbd200cfa00 2024-09-21T06:10:33.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.953+0000 7fbd17400640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.954+0000 7fbd17400640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd08034000 tx=0x7fbd08004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:33.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:33.957+0000 7fbd1cc00640 1 -- 172.21.15.118:0/1513978466 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbd10062820 con 0x7fbd200cfa00 2024-09-21T06:10:34.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.141+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd200af700 con 0x7fbd200cfa00 2024-09-21T06:10:34.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.142+0000 7fbd1cc00640 1 -- 172.21.15.118:0/1513978466 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16773 (secure 0 0 0) 0x7fbd10067250 con 0x7fbd200cfa00 2024-09-21T06:10:34.145 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:34.145 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":131,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:10:32.715861+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:30.625521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:31.678886+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:34.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.144+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcfc078b90 msgr2=0x7fbcfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.144+0000 7fbd25800640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd08034000 tx=0x7fbd08004730 comp rx=0 tx=0).stop 2024-09-21T06:10:34.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.144+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd200cfa00 msgr2=0x7fbd201553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.144+0000 7fbd25800640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd200cfa00 0x7fbd201553b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c730 tx=0x7fbd1000cbf0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 shutdown_connections 2024-09-21T06:10:34.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd20144ea0 0x7fbd200aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd20144760 0x7fbd200ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 --2- 172.21.15.118:0/1513978466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd200cfa00 0x7fbd201553b0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 >> 172.21.15.118:0/1513978466 conn(0x7fbd2006d6e0 msgr2=0x7fbd200b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:34.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 shutdown_connections 2024-09-21T06:10:34.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.145+0000 7fbd25800640 1 -- 172.21.15.118:0/1513978466 wait complete. 2024-09-21T06:10:34.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:10:34.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 -- 172.21.15.118:0/3673590591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb65813fd80 msgr2=0x7fb65815dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 --2- 172.21.15.118:0/3673590591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb65813fd80 0x7fb65815dc40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb648005fd0 tx=0x7fb64802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 -- 172.21.15.118:0/3673590591 shutdown_connections 2024-09-21T06:10:34.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 --2- 172.21.15.118:0/3673590591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6580cf170 0x7fb6580cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 --2- 172.21.15.118:0/3673590591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb65813fd80 0x7fb65815dc40 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 -- 172.21.15.118:0/3673590591 >> 172.21.15.118:0/3673590591 conn(0x7fb65806d110 msgr2=0x7fb65806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:34.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 -- 172.21.15.118:0/3673590591 shutdown_connections 2024-09-21T06:10:34.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.391+0000 7fb65d200640 1 -- 172.21.15.118:0/3673590591 wait complete. 2024-09-21T06:10:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.394+0000 7fb65d200640 1 Processor -- start 2024-09-21T06:10:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.394+0000 7fb65d200640 1 -- start start 2024-09-21T06:10:34.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.395+0000 7fb65d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6580cf170 0x7fb65813a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.395+0000 7fb65d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6580d0ea0 0x7fb6580cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.395+0000 7fb65d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb65813fd80 0x7fb65813e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.395+0000 7fb65d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb6580cfac0 con 0x7fb6580d0ea0 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.395+0000 7fb65d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb65815d890 con 0x7fb65813fd80 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.395+0000 7fb65d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6580cfc40 con 0x7fb6580cf170 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.395+0000 7fb655400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6580d0ea0 0x7fb6580cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6580d0ea0 0x7fb6580cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48954/0 (socket says 172.21.15.118:48954) 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 -- 172.21.15.118:0/1174078753 learned_addr learned my addr 172.21.15.118:0/1174078753 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655e00640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6580cf170 0x7fb65813a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb656800640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb65813fd80 0x7fb65813e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 -- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6580cf170 msgr2=0x7fb65813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6580cf170 0x7fb65813a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 -- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb65813fd80 msgr2=0x7fb65813e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb65813fd80 0x7fb65813e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 -- 172.21.15.118:0/1174078753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65813ad90 con 0x7fb6580d0ea0 2024-09-21T06:10:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.396+0000 7fb655400640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6580d0ea0 0x7fb6580cd5e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c3d0 tx=0x7fb64400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.397+0000 7fb64e000640 1 -- 172.21.15.118:0/1174078753 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644017070 con 0x7fb6580d0ea0 2024-09-21T06:10:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.397+0000 7fb64e000640 1 -- 172.21.15.118:0/1174078753 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6440053c0 con 0x7fb6580d0ea0 2024-09-21T06:10:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.397+0000 7fb64e000640 1 -- 172.21.15.118:0/1174078753 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644003850 con 0x7fb6580d0ea0 2024-09-21T06:10:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.397+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb658160ff0 con 0x7fb6580d0ea0 2024-09-21T06:10:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.397+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6581f9c10 con 0x7fb6580d0ea0 2024-09-21T06:10:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.398+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6580cdef0 con 0x7fb6580d0ea0 2024-09-21T06:10:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.399+0000 7fb64e000640 1 -- 172.21.15.118:0/1174078753 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb64401a070 con 0x7fb6580d0ea0 2024-09-21T06:10:34.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.400+0000 7fb64e000640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb638078b90 0x7fb63807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.400+0000 7fb64e000640 1 -- 172.21.15.118:0/1174078753 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fb644099fa0 con 0x7fb6580d0ea0 2024-09-21T06:10:34.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.400+0000 7fb655e00640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb638078b90 0x7fb63807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.401+0000 7fb655e00640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb638078b90 0x7fb63807b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb648033000 tx=0x7fb648004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:34.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.404+0000 7fb64e000640 1 -- 172.21.15.118:0/1174078753 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb6580cdef0 con 0x7fb6580d0ea0 2024-09-21T06:10:34.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:34.627+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb6580d00f0 con 0x7fb6580d0ea0 2024-09-21T06:10:35.205 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:10:35.203+0000 7f7f11800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:10:35.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.254+0000 7fb64e000640 1 -- 172.21.15.118:0/1174078753 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7fb65813ad90 con 0x7fb6580d0ea0 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb638078b90 msgr2=0x7fb63807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb638078b90 0x7fb63807b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb648033000 tx=0x7fb648004730 comp rx=0 tx=0).stop 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6580d0ea0 msgr2=0x7fb6580cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6580d0ea0 0x7fb6580cd5e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c3d0 tx=0x7fb64400c890 comp rx=0 tx=0).stop 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 shutdown_connections 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb65813fd80 0x7fb65813e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6580d0ea0 0x7fb6580cd5e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb638078b90 0x7fb63807b0a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 --2- 172.21.15.118:0/1174078753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6580cf170 0x7fb65813a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.257+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 >> 172.21.15.118:0/1174078753 conn(0x7fb65806d110 msgr2=0x7fb65813f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.258+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 shutdown_connections 2024-09-21T06:10:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.258+0000 7fb65d200640 1 -- 172.21.15.118:0/1174078753 wait complete. 2024-09-21T06:10:35.287 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:10:35.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:10:35.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 -- 172.21.15.118:0/2492260256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 msgr2=0x7f16fc142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:35.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 --2- 172.21.15.118:0/2492260256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc142c70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0ceaa0 tx=0x7f16f802aa30 comp rx=0 tx=0).stop 2024-09-21T06:10:35.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 -- 172.21.15.118:0/2492260256 shutdown_connections 2024-09-21T06:10:35.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 --2- 172.21.15.118:0/2492260256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc142c70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 --2- 172.21.15.118:0/2492260256 >> v2:172.21.15.149:3300/0 conn(0x7f16fc0d1590 0x7f16fc142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 -- 172.21.15.118:0/2492260256 >> 172.21.15.118:0/2492260256 conn(0x7f16fc06d110 msgr2=0x7f16fc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:35.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 -- 172.21.15.118:0/2492260256 shutdown_connections 2024-09-21T06:10:35.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.510+0000 7f1704800640 1 -- 172.21.15.118:0/2492260256 wait complete. 2024-09-21T06:10:35.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.513+0000 7f1704800640 1 Processor -- start 2024-09-21T06:10:35.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.513+0000 7f1704800640 1 -- start start 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1704800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16fc13fae0 0x7f16fc073790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1704800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1704800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc139be0 0x7f16fc13e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1704800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc0cfa70 con 0x7f16fc13fef0 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1704800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc0cf8f0 con 0x7f16fc139be0 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1704800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16fc0cfbf0 con 0x7f16fc13fae0 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1701400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1701400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48968/0 (socket says 172.21.15.118:48968) 2024-09-21T06:10:35.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.514+0000 7f1701400640 1 -- 172.21.15.118:0/467175085 learned_addr learned my addr 172.21.15.118:0/467175085 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1702800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc139be0 0x7f16fc13e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1701e00640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16fc13fae0 0x7f16fc073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1701400640 1 -- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16fc13fae0 msgr2=0x7f16fc073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1701400640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16fc13fae0 0x7f16fc073790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1701400640 1 -- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc139be0 msgr2=0x7f16fc13e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1701400640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc139be0 0x7f16fc13e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1701400640 1 -- 172.21.15.118:0/467175085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16fc074c10 con 0x7f16fc13fef0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1702800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc139be0 0x7f16fc13e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1701400640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc152ec0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e790 tx=0x7f16ec00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f16f6000640 1 -- 172.21.15.118:0/467175085 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00eea0 con 0x7f16fc13fef0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f16f6000640 1 -- 172.21.15.118:0/467175085 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16ec00cdb0 con 0x7f16fc13fef0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f16f6000640 1 -- 172.21.15.118:0/467175085 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec010690 con 0x7f16fc13fef0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.515+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16fc074650 con 0x7f16fc13fef0 2024-09-21T06:10:35.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.516+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16fc138880 con 0x7f16fc13fef0 2024-09-21T06:10:35.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.517+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16fc0d0110 con 0x7f16fc13fef0 2024-09-21T06:10:35.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.519+0000 7f16f6000640 1 -- 172.21.15.118:0/467175085 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16ec010830 con 0x7f16fc13fef0 2024-09-21T06:10:35.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.520+0000 7f16f6000640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16e0078b90 0x7f16e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:35.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.520+0000 7f16f6000640 1 -- 172.21.15.118:0/467175085 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f16ec09b970 con 0x7f16fc13fef0 2024-09-21T06:10:35.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.521+0000 7f1701e00640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16e0078b90 0x7f16e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:35.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.521+0000 7f1701e00640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16e0078b90 0x7f16e007b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f16f00015e0 tx=0x7f16f0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:35.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.523+0000 7f16f6000640 1 -- 172.21.15.118:0/467175085 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f16ec063e20 con 0x7f16fc13fef0 2024-09-21T06:10:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:35.746+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f16fc13a050 con 0x7f16fc13fef0 2024-09-21T06:10:36.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.256+0000 7f16f6000640 1 -- 172.21.15.118:0/467175085 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7f16ec063720 con 0x7f16fc13fef0 2024-09-21T06:10:36.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.258+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16e0078b90 msgr2=0x7f16e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.258+0000 7f1704800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16e0078b90 0x7f16e007b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f16f00015e0 tx=0x7f16f0009040 comp rx=0 tx=0).stop 2024-09-21T06:10:36.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.258+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 msgr2=0x7f16fc152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.258+0000 7f1704800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc152ec0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e790 tx=0x7f16ec00ec50 comp rx=0 tx=0).stop 2024-09-21T06:10:36.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 shutdown_connections 2024-09-21T06:10:36.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16fc139be0 0x7f16fc13e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16fc13fef0 0x7f16fc152ec0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16e0078b90 0x7f16e007b0a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 --2- 172.21.15.118:0/467175085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16fc13fae0 0x7f16fc073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 >> 172.21.15.118:0/467175085 conn(0x7f16fc06d110 msgr2=0x7f16fc1538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 shutdown_connections 2024-09-21T06:10:36.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.259+0000 7f1704800640 1 -- 172.21.15.118:0/467175085 wait complete. 2024-09-21T06:10:36.285 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:10:36.285 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:36.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 -- 172.21.15.118:0/1211468285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc415fa00 msgr2=0x7f1bc415fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1211468285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc415fa00 0x7f1bc415fe10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40b4b20 tx=0x7f1bbc02aa30 comp rx=0 tx=0).stop 2024-09-21T06:10:36.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 -- 172.21.15.118:0/1211468285 shutdown_connections 2024-09-21T06:10:36.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1211468285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc415fa00 0x7f1bc415fe10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1211468285 >> v2:172.21.15.149:3300/0 conn(0x7f1bc40d0ec0 0x7f1bc40d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 -- 172.21.15.118:0/1211468285 >> 172.21.15.118:0/1211468285 conn(0x7f1bc406d110 msgr2=0x7f1bc406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 -- 172.21.15.118:0/1211468285 shutdown_connections 2024-09-21T06:10:36.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.504+0000 7f1bcc600640 1 -- 172.21.15.118:0/1211468285 wait complete. 2024-09-21T06:10:36.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.506+0000 7f1bcc600640 1 Processor -- start 2024-09-21T06:10:36.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.507+0000 7f1bcc600640 1 -- start start 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bcc600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bc40ce0c0 0x7f1bc41f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bcc600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc40d0ec0 0x7f1bc41f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bcc600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bc415fa00 0x7f1bc40cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bcc600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc4073e50 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bcc600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc4073cd0 con 0x7f1bc415fa00 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bcc600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc4073fd0 con 0x7f1bc40ce0c0 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bc9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc40d0ec0 0x7f1bc41f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bc9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc40d0ec0 0x7f1bc41f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40080/0 (socket says 172.21.15.118:40080) 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.508+0000 7f1bc9200640 1 -- 172.21.15.118:0/1180414581 learned_addr learned my addr 172.21.15.118:0/1180414581 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bc9c00640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bc40ce0c0 0x7f1bc41f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bca600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bc415fa00 0x7f1bc40cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bc9200640 1 -- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bc40ce0c0 msgr2=0x7f1bc41f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bc9200640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bc40ce0c0 0x7f1bc41f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bc9200640 1 -- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bc415fa00 msgr2=0x7f1bc40cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bc9200640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bc415fa00 0x7f1bc40cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bc9200640 1 -- 172.21.15.118:0/1180414581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc41f7510 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.509+0000 7f1bc9200640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc40d0ec0 0x7f1bc41f9cf0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000d700 tx=0x7f1bb000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.510+0000 7f1bc1600640 1 -- 172.21.15.118:0/1180414581 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0017070 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.510+0000 7f1bc1600640 1 -- 172.21.15.118:0/1180414581 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb0005310 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.510+0000 7f1bc1600640 1 -- 172.21.15.118:0/1180414581 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0009820 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.510+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc40cfa00 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.510+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc40cffc0 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.511+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc40cf770 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.512+0000 7f1bc1600640 1 -- 172.21.15.118:0/1180414581 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bb00099c0 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.513+0000 7f1bc1600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ba4078b90 0x7f1ba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.513+0000 7f1bc1600640 1 -- 172.21.15.118:0/1180414581 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb009add0 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.514+0000 7f1bc9c00640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ba4078b90 0x7f1ba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.514+0000 7f1bc9c00640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ba4078b90 0x7f1ba407b0a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8001720 tx=0x7f1bb8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.518+0000 7f1bc1600640 1 -- 172.21.15.118:0/1180414581 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1bc41f7510 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.742+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bc4076790 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.743+0000 7f1bc1600640 1 -- 172.21.15.118:0/1180414581 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f1bc4076790 con 0x7f1bc40d0ec0 2024-09-21T06:10:36.744 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:36.744 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:10:36.744 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ba4078b90 msgr2=0x7f1ba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ba4078b90 0x7f1ba407b0a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8001720 tx=0x7f1bb8009040 comp rx=0 tx=0).stop 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc40d0ec0 msgr2=0x7f1bc41f9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc40d0ec0 0x7f1bc41f9cf0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000d700 tx=0x7f1bb000dbc0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 shutdown_connections 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bc415fa00 0x7f1bc40cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bc40d0ec0 0x7f1bc41f9cf0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1ba4078b90 0x7f1ba407b0a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 --2- 172.21.15.118:0/1180414581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bc40ce0c0 0x7f1bc41f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 >> 172.21.15.118:0/1180414581 conn(0x7f1bc406d110 msgr2=0x7f1bc4143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 shutdown_connections 2024-09-21T06:10:36.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.745+0000 7f1bcc600640 1 -- 172.21.15.118:0/1180414581 wait complete. 2024-09-21T06:10:36.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:10:36.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.991+0000 7f68d9600640 1 -- 172.21.15.118:0/1306266615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 msgr2=0x7f68d40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.991+0000 7f68d9600640 1 --2- 172.21.15.118:0/1306266615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d40d0e80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009830 tx=0x7f68c402a530 comp rx=0 tx=0).stop 2024-09-21T06:10:36.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.991+0000 7f68d9600640 1 -- 172.21.15.118:0/1306266615 shutdown_connections 2024-09-21T06:10:36.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.991+0000 7f68d9600640 1 --2- 172.21.15.118:0/1306266615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d40d0e80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.991+0000 7f68d9600640 1 -- 172.21.15.118:0/1306266615 >> 172.21.15.118:0/1306266615 conn(0x7f68d406d110 msgr2=0x7f68d406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.991+0000 7f68d9600640 1 -- 172.21.15.118:0/1306266615 shutdown_connections 2024-09-21T06:10:36.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.991+0000 7f68d9600640 1 -- 172.21.15.118:0/1306266615 wait complete. 2024-09-21T06:10:36.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.994+0000 7f68d9600640 1 Processor -- start 2024-09-21T06:10:36.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.994+0000 7f68d9600640 1 -- start start 2024-09-21T06:10:36.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d41f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68d413fef0 0x7f68d4158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f68d4142e40 0x7f68d4158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d9600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f68d40cfce0 con 0x7f68d413fae0 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d9600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f68d40cfb60 con 0x7f68d413fef0 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f68d40cfe60 con 0x7f68d4142e40 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d41f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d41f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40092/0 (socket says 172.21.15.118:40092) 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.995+0000 7f68d2a00640 1 -- 172.21.15.118:0/2599428392 learned_addr learned my addr 172.21.15.118:0/2599428392 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68ca000640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68d413fef0 0x7f68d4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68d3400640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f68d4142e40 0x7f68d4158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68d2a00640 1 -- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f68d4142e40 msgr2=0x7f68d4158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68d2a00640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f68d4142e40 0x7f68d4158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68d2a00640 1 -- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68d413fef0 msgr2=0x7f68d4158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68d2a00640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68d413fef0 0x7f68d4158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68d2a00640 1 -- 172.21.15.118:0/2599428392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d415a320 con 0x7f68d413fae0 2024-09-21T06:10:36.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68ca000640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68d413fef0 0x7f68d4158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:36.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68d2a00640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d41f8aa0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f68c402ab20 tx=0x7f68c4033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.996+0000 7f68cb400640 1 -- 172.21.15.118:0/2599428392 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4031b60 con 0x7f68d413fae0 2024-09-21T06:10:36.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.997+0000 7f68cb400640 1 -- 172.21.15.118:0/2599428392 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68c4031df0 con 0x7f68d413fae0 2024-09-21T06:10:36.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.997+0000 7f68cb400640 1 -- 172.21.15.118:0/2599428392 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4005280 con 0x7f68d413fae0 2024-09-21T06:10:37.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.997+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d415a5e0 con 0x7f68d413fae0 2024-09-21T06:10:37.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.997+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d4072cd0 con 0x7f68d413fae0 2024-09-21T06:10:37.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.998+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d40d0310 con 0x7f68d413fae0 2024-09-21T06:10:37.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:36.999+0000 7f68cb400640 1 -- 172.21.15.118:0/2599428392 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68c4005420 con 0x7f68d413fae0 2024-09-21T06:10:37.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.000+0000 7f68cb400640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68b0078b90 0x7f68b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.000+0000 7f68cb400640 1 -- 172.21.15.118:0/2599428392 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f68c40bc010 con 0x7f68d413fae0 2024-09-21T06:10:37.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.000+0000 7f68ca000640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68b0078b90 0x7f68b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.001+0000 7f68ca000640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68b0078b90 0x7f68b007b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68bc007fd0 tx=0x7f68bc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:37.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.004+0000 7f68cb400640 1 -- 172.21.15.118:0/2599428392 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f68c403f030 con 0x7f68d413fae0 2024-09-21T06:10:37.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.191+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68d4142860 con 0x7f68d413fae0 2024-09-21T06:10:37.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.192+0000 7f68cb400640 1 -- 172.21.15.118:0/2599428392 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16760 (secure 0 0 0) 0x7f68c4031770 con 0x7f68d413fae0 2024-09-21T06:10:37.194 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:37.194 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":132,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:10:34.228434+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:30.625521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:31.678886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:37.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68b0078b90 msgr2=0x7f68b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68b0078b90 0x7f68b007b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68bc007fd0 tx=0x7f68bc009040 comp rx=0 tx=0).stop 2024-09-21T06:10:37.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 msgr2=0x7f68d41f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d41f8aa0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f68c402ab20 tx=0x7f68c4033c10 comp rx=0 tx=0).stop 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 shutdown_connections 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68b0078b90 0x7f68b007b0a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f68d4142e40 0x7f68d4158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68d413fef0 0x7f68d4158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 --2- 172.21.15.118:0/2599428392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68d413fae0 0x7f68d41f8aa0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 >> 172.21.15.118:0/2599428392 conn(0x7f68d406d110 msgr2=0x7f68d415efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 shutdown_connections 2024-09-21T06:10:37.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.195+0000 7f68d9600640 1 -- 172.21.15.118:0/2599428392 wait complete. 2024-09-21T06:10:37.219 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:10:37.219 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:10:37.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.439+0000 7f3acbe00640 1 -- 172.21.15.118:0/628691155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc070d40 msgr2=0x7f3acc15cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.439+0000 7f3acbe00640 1 --2- 172.21.15.118:0/628691155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc070d40 0x7f3acc15cc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8005fd0 tx=0x7f3ab802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.440+0000 7f3acbe00640 1 -- 172.21.15.118:0/628691155 shutdown_connections 2024-09-21T06:10:37.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.440+0000 7f3acbe00640 1 --2- 172.21.15.118:0/628691155 >> v2:172.21.15.149:3300/0 conn(0x7f3acc073350 0x7f3acc073760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.440+0000 7f3acbe00640 1 --2- 172.21.15.118:0/628691155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc070d40 0x7f3acc15cc40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.440+0000 7f3acbe00640 1 -- 172.21.15.118:0/628691155 >> 172.21.15.118:0/628691155 conn(0x7f3acc0d0f80 msgr2=0x7f3acc0d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:37.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.440+0000 7f3acbe00640 1 -- 172.21.15.118:0/628691155 shutdown_connections 2024-09-21T06:10:37.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.440+0000 7f3acbe00640 1 -- 172.21.15.118:0/628691155 wait complete. 2024-09-21T06:10:37.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.442+0000 7f3acbe00640 1 Processor -- start 2024-09-21T06:10:37.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.442+0000 7f3acbe00640 1 -- start start 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc068f10 0x7f3acc153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc073350 0x7f3acc151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3acc151fd0 0x7f3acc154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acbe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc074030 con 0x7f3acc151fd0 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc073eb0 con 0x7f3acc068f10 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3acc0741b0 con 0x7f3acc073350 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3acc151fd0 0x7f3acc154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3acc151fd0 0x7f3acc154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40108/0 (socket says 172.21.15.118:40108) 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acb400640 1 -- 172.21.15.118:0/1958662684 learned_addr learned my addr 172.21.15.118:0/1958662684 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3acaa00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc068f10 0x7f3acc153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.444+0000 7f3aca000640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc073350 0x7f3acc151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acb400640 1 -- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc073350 msgr2=0x7f3acc151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acb400640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc073350 0x7f3acc151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acb400640 1 -- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc068f10 msgr2=0x7f3acc153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acb400640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc068f10 0x7f3acc153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acb400640 1 -- 172.21.15.118:0/1958662684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc1566f0 con 0x7f3acc151fd0 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3aca000640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc073350 0x7f3acc151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acb400640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3acc151fd0 0x7f3acc154380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400ea40 tx=0x7f3ac400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3ac3400640 1 -- 172.21.15.118:0/1958662684 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400ce40 con 0x7f3acc151fd0 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3ac3400640 1 -- 172.21.15.118:0/1958662684 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ac4004c10 con 0x7f3acc151fd0 2024-09-21T06:10:37.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3ac3400640 1 -- 172.21.15.118:0/1958662684 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4005020 con 0x7f3acc151fd0 2024-09-21T06:10:37.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3acc1569d0 con 0x7f3acc151fd0 2024-09-21T06:10:37.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.445+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3acc152760 con 0x7f3acc151fd0 2024-09-21T06:10:37.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.447+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3acc156440 con 0x7f3acc151fd0 2024-09-21T06:10:37.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.448+0000 7f3ac3400640 1 -- 172.21.15.118:0/1958662684 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ac40051c0 con 0x7f3acc151fd0 2024-09-21T06:10:37.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.449+0000 7f3ac3400640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3aac078b90 0x7f3aac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.449+0000 7f3ac3400640 1 -- 172.21.15.118:0/1958662684 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f3ac409bbd0 con 0x7f3acc151fd0 2024-09-21T06:10:37.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.449+0000 7f3acaa00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3aac078b90 0x7f3aac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.450+0000 7f3acaa00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3aac078b90 0x7f3aac07b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000f60 tx=0x7f3abc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:37.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.453+0000 7f3ac3400640 1 -- 172.21.15.118:0/1958662684 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ac4063f70 con 0x7f3acc151fd0 2024-09-21T06:10:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.633+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3acc15cc40 con 0x7f3aac078b90 2024-09-21T06:10:37.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.638+0000 7f3ac3400640 1 -- 172.21.15.118:0/1958662684 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247977 (secure 0 0 0) 0x7f3acc15cc40 con 0x7f3aac078b90 2024-09-21T06:10:37.642 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:37.643 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3aac078b90 msgr2=0x7f3aac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3aac078b90 0x7f3aac07b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000f60 tx=0x7f3abc009040 comp rx=0 tx=0).stop 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3acc151fd0 msgr2=0x7f3acc154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3acc151fd0 0x7f3acc154380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400ea40 tx=0x7f3ac400ef00 comp rx=0 tx=0).stop 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 shutdown_connections 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3acc151fd0 0x7f3acc154380 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3aac078b90 0x7f3aac07b0a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc073350 0x7f3acc151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 --2- 172.21.15.118:0/1958662684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc068f10 0x7f3acc153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 >> 172.21.15.118:0/1958662684 conn(0x7f3acc0d0f80 msgr2=0x7f3acc159190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 shutdown_connections 2024-09-21T06:10:37.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.642+0000 7f3acbe00640 1 -- 172.21.15.118:0/1958662684 wait complete. 2024-09-21T06:10:37.665 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-21T06:10:36.562042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6837,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555662,"statfs":{"total":1600000000,"available":1592998568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.352676"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538169+0000","last_change":"2024-09-21T06:10:33.246928+0000","last_active":"2024-09-21T06:10:34.538169+0000","last_peered":"2024-09-21T06:10:34.538169+0000","last_clean":"2024-09-21T06:10:34.538169+0000","last_became_active":"2024-09-21T06:10:33.244299+0000","last_became_peered":"2024-09-21T06:10:33.244299+0000","last_unstale":"2024-09-21T06:10:34.538169+0000","last_undegraded":"2024-09-21T06:10:34.538169+0000","last_fullsized":"2024-09-21T06:10:34.538169+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.236328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252978+0000","last_change":"2024-09-21T06:10:33.252782+0000","last_active":"2024-09-21T06:10:33.252978+0000","last_peered":"2024-09-21T06:10:33.252978+0000","last_clean":"2024-09-21T06:10:33.252978+0000","last_became_active":"2024-09-21T06:10:33.250312+0000","last_became_peered":"2024-09-21T06:10:33.250312+0000","last_unstale":"2024-09-21T06:10:33.252978+0000","last_undegraded":"2024-09-21T06:10:33.252978+0000","last_fullsized":"2024-09-21T06:10:33.252978+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:01.193133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246374+0000","last_change":"2024-09-21T06:10:33.246094+0000","last_active":"2024-09-21T06:10:33.246374+0000","last_peered":"2024-09-21T06:10:33.246374+0000","last_clean":"2024-09-21T06:10:33.246374+0000","last_became_active":"2024-09-21T06:10:33.245601+0000","last_became_peered":"2024-09-21T06:10:33.245601+0000","last_unstale":"2024-09-21T06:10:33.246374+0000","last_undegraded":"2024-09-21T06:10:33.246374+0000","last_fullsized":"2024-09-21T06:10:33.246374+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:45.113325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.537989+0000","last_change":"2024-09-21T06:10:33.251708+0000","last_active":"2024-09-21T06:10:34.537989+0000","last_peered":"2024-09-21T06:10:34.537989+0000","last_clean":"2024-09-21T06:10:34.537989+0000","last_became_active":"2024-09-21T06:10:33.251419+0000","last_became_peered":"2024-09-21T06:10:33.251419+0000","last_unstale":"2024-09-21T06:10:34.537989+0000","last_undegraded":"2024-09-21T06:10:34.537989+0000","last_fullsized":"2024-09-21T06:10:34.537989+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:57.396017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248452+0000","last_change":"2024-09-21T06:10:33.248235+0000","last_active":"2024-09-21T06:10:33.248452+0000","last_peered":"2024-09-21T06:10:33.248452+0000","last_clean":"2024-09-21T06:10:33.248452+0000","last_became_active":"2024-09-21T06:10:33.247466+0000","last_became_peered":"2024-09-21T06:10:33.247466+0000","last_unstale":"2024-09-21T06:10:33.248452+0000","last_undegraded":"2024-09-21T06:10:33.248452+0000","last_fullsized":"2024-09-21T06:10:33.248452+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:33.970381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248524+0000","last_change":"2024-09-21T06:10:33.248233+0000","last_active":"2024-09-21T06:10:33.248524+0000","last_peered":"2024-09-21T06:10:33.248524+0000","last_clean":"2024-09-21T06:10:33.248524+0000","last_became_active":"2024-09-21T06:10:33.247942+0000","last_became_peered":"2024-09-21T06:10:33.247942+0000","last_unstale":"2024-09-21T06:10:33.248524+0000","last_undegraded":"2024-09-21T06:10:33.248524+0000","last_fullsized":"2024-09-21T06:10:33.248524+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:44.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251369+0000","last_change":"2024-09-21T06:10:33.250479+0000","last_active":"2024-09-21T06:10:33.251369+0000","last_peered":"2024-09-21T06:10:33.251369+0000","last_clean":"2024-09-21T06:10:33.251369+0000","last_became_active":"2024-09-21T06:10:33.250130+0000","last_became_peered":"2024-09-21T06:10:33.250130+0000","last_unstale":"2024-09-21T06:10:33.251369+0000","last_undegraded":"2024-09-21T06:10:33.251369+0000","last_fullsized":"2024-09-21T06:10:33.251369+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:45.112186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244789+0000","last_change":"2024-09-21T06:10:33.243279+0000","last_active":"2024-09-21T06:10:33.244789+0000","last_peered":"2024-09-21T06:10:33.244789+0000","last_clean":"2024-09-21T06:10:33.244789+0000","last_became_active":"2024-09-21T06:10:33.242894+0000","last_became_peered":"2024-09-21T06:10:33.242894+0000","last_unstale":"2024-09-21T06:10:33.244789+0000","last_undegraded":"2024-09-21T06:10:33.244789+0000","last_fullsized":"2024-09-21T06:10:33.244789+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:33.051211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538220+0000","last_change":"2024-09-21T06:10:33.248077+0000","last_active":"2024-09-21T06:10:34.538220+0000","last_peered":"2024-09-21T06:10:34.538220+0000","last_clean":"2024-09-21T06:10:34.538220+0000","last_became_active":"2024-09-21T06:10:33.245768+0000","last_became_peered":"2024-09-21T06:10:33.245768+0000","last_unstale":"2024-09-21T06:10:34.538220+0000","last_undegraded":"2024-09-21T06:10:34.538220+0000","last_fullsized":"2024-09-21T06:10:34.538220+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:08.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538574+0000","last_change":"2024-09-21T06:10:33.245826+0000","last_active":"2024-09-21T06:10:34.538574+0000","last_peered":"2024-09-21T06:10:34.538574+0000","last_clean":"2024-09-21T06:10:34.538574+0000","last_became_active":"2024-09-21T06:10:33.245487+0000","last_became_peered":"2024-09-21T06:10:33.245487+0000","last_unstale":"2024-09-21T06:10:34.538574+0000","last_undegraded":"2024-09-21T06:10:34.538574+0000","last_fullsized":"2024-09-21T06:10:34.538574+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:38.756606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.247219+0000","last_change":"2024-09-21T06:10:33.245602+0000","last_active":"2024-09-21T06:10:33.247219+0000","last_peered":"2024-09-21T06:10:33.247219+0000","last_clean":"2024-09-21T06:10:33.247219+0000","last_became_active":"2024-09-21T06:10:33.245288+0000","last_became_peered":"2024-09-21T06:10:33.245288+0000","last_unstale":"2024-09-21T06:10:33.247219+0000","last_undegraded":"2024-09-21T06:10:33.247219+0000","last_fullsized":"2024-09-21T06:10:33.247219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:31.197116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538312+0000","last_change":"2024-09-21T06:10:33.249186+0000","last_active":"2024-09-21T06:10:34.538312+0000","last_peered":"2024-09-21T06:10:34.538312+0000","last_clean":"2024-09-21T06:10:34.538312+0000","last_became_active":"2024-09-21T06:10:33.248946+0000","last_became_peered":"2024-09-21T06:10:33.248946+0000","last_unstale":"2024-09-21T06:10:34.538312+0000","last_undegraded":"2024-09-21T06:10:34.538312+0000","last_fullsized":"2024-09-21T06:10:34.538312+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:56.114678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.243681+0000","last_change":"2024-09-21T06:10:33.241406+0000","last_active":"2024-09-21T06:10:33.243681+0000","last_peered":"2024-09-21T06:10:33.243681+0000","last_clean":"2024-09-21T06:10:33.243681+0000","last_became_active":"2024-09-21T06:10:33.238511+0000","last_became_peered":"2024-09-21T06:10:33.238511+0000","last_unstale":"2024-09-21T06:10:33.243681+0000","last_undegraded":"2024-09-21T06:10:33.243681+0000","last_fullsized":"2024-09-21T06:10:33.243681+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:14.629592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241055+0000","last_change":"2024-09-21T06:10:33.239918+0000","last_active":"2024-09-21T06:10:33.241055+0000","last_peered":"2024-09-21T06:10:33.241055+0000","last_clean":"2024-09-21T06:10:33.241055+0000","last_became_active":"2024-09-21T06:10:33.239166+0000","last_became_peered":"2024-09-21T06:10:33.239166+0000","last_unstale":"2024-09-21T06:10:33.241055+0000","last_undegraded":"2024-09-21T06:10:33.241055+0000","last_fullsized":"2024-09-21T06:10:33.241055+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:13.902900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251820+0000","last_change":"2024-09-21T06:10:33.251574+0000","last_active":"2024-09-21T06:10:33.251820+0000","last_peered":"2024-09-21T06:10:33.251820+0000","last_clean":"2024-09-21T06:10:33.251820+0000","last_became_active":"2024-09-21T06:10:33.250994+0000","last_became_peered":"2024-09-21T06:10:33.250994+0000","last_unstale":"2024-09-21T06:10:33.251820+0000","last_undegraded":"2024-09-21T06:10:33.251820+0000","last_fullsized":"2024-09-21T06:10:33.251820+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.954474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538444+0000","last_change":"2024-09-21T06:10:33.252287+0000","last_active":"2024-09-21T06:10:34.538444+0000","last_peered":"2024-09-21T06:10:34.538444+0000","last_clean":"2024-09-21T06:10:34.538444+0000","last_became_active":"2024-09-21T06:10:33.249394+0000","last_became_peered":"2024-09-21T06:10:33.249394+0000","last_unstale":"2024-09-21T06:10:34.538444+0000","last_undegraded":"2024-09-21T06:10:34.538444+0000","last_fullsized":"2024-09-21T06:10:34.538444+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252857+0000","last_change":"2024-09-21T06:10:33.251833+0000","last_active":"2024-09-21T06:10:33.252857+0000","last_peered":"2024-09-21T06:10:33.252857+0000","last_clean":"2024-09-21T06:10:33.252857+0000","last_became_active":"2024-09-21T06:10:33.248940+0000","last_became_peered":"2024-09-21T06:10:33.248940+0000","last_unstale":"2024-09-21T06:10:33.252857+0000","last_undegraded":"2024-09-21T06:10:33.252857+0000","last_fullsized":"2024-09-21T06:10:33.252857+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:43.023716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246441+0000","last_change":"2024-09-21T06:10:33.246197+0000","last_active":"2024-09-21T06:10:33.246441+0000","last_peered":"2024-09-21T06:10:33.246441+0000","last_clean":"2024-09-21T06:10:33.246441+0000","last_became_active":"2024-09-21T06:10:33.245964+0000","last_became_peered":"2024-09-21T06:10:33.245964+0000","last_unstale":"2024-09-21T06:10:33.246441+0000","last_undegraded":"2024-09-21T06:10:33.246441+0000","last_fullsized":"2024-09-21T06:10:33.246441+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:34.057054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.234990+0000","last_change":"2024-09-21T06:10:33.234713+0000","last_active":"2024-09-21T06:10:33.234990+0000","last_peered":"2024-09-21T06:10:33.234990+0000","last_clean":"2024-09-21T06:10:33.234990+0000","last_became_active":"2024-09-21T06:10:33.234490+0000","last_became_peered":"2024-09-21T06:10:33.234490+0000","last_unstale":"2024-09-21T06:10:33.234990+0000","last_undegraded":"2024-09-21T06:10:33.234990+0000","last_fullsized":"2024-09-21T06:10:33.234990+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:01.922400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248063+0000","last_change":"2024-09-21T06:10:33.247853+0000","last_active":"2024-09-21T06:10:33.248063+0000","last_peered":"2024-09-21T06:10:33.248063+0000","last_clean":"2024-09-21T06:10:33.248063+0000","last_became_active":"2024-09-21T06:10:33.247530+0000","last_became_peered":"2024-09-21T06:10:33.247530+0000","last_unstale":"2024-09-21T06:10:33.248063+0000","last_undegraded":"2024-09-21T06:10:33.248063+0000","last_fullsized":"2024-09-21T06:10:33.248063+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:25.883812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241947+0000","last_change":"2024-09-21T06:10:33.241773+0000","last_active":"2024-09-21T06:10:33.241947+0000","last_peered":"2024-09-21T06:10:33.241947+0000","last_clean":"2024-09-21T06:10:33.241947+0000","last_became_active":"2024-09-21T06:10:33.241525+0000","last_became_peered":"2024-09-21T06:10:33.241525+0000","last_unstale":"2024-09-21T06:10:33.241947+0000","last_undegraded":"2024-09-21T06:10:33.241947+0000","last_fullsized":"2024-09-21T06:10:33.241947+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:24.309227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.231946+0000","last_change":"2024-09-21T06:10:33.239527+0000","last_active":"2024-09-21T06:10:34.231946+0000","last_peered":"2024-09-21T06:10:34.231946+0000","last_clean":"2024-09-21T06:10:34.231946+0000","last_became_active":"2024-09-21T06:10:33.239134+0000","last_became_peered":"2024-09-21T06:10:33.239134+0000","last_unstale":"2024-09-21T06:10:34.231946+0000","last_undegraded":"2024-09-21T06:10:34.231946+0000","last_fullsized":"2024-09-21T06:10:34.231946+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:37.721459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.247247+0000","last_change":"2024-09-21T06:10:33.245941+0000","last_active":"2024-09-21T06:10:33.247247+0000","last_peered":"2024-09-21T06:10:33.247247+0000","last_clean":"2024-09-21T06:10:33.247247+0000","last_became_active":"2024-09-21T06:10:33.245604+0000","last_became_peered":"2024-09-21T06:10:33.245604+0000","last_unstale":"2024-09-21T06:10:33.247247+0000","last_undegraded":"2024-09-21T06:10:33.247247+0000","last_fullsized":"2024-09-21T06:10:33.247247+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:27.554800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.231990+0000","last_change":"2024-09-21T06:10:33.235010+0000","last_active":"2024-09-21T06:10:34.231990+0000","last_peered":"2024-09-21T06:10:34.231990+0000","last_clean":"2024-09-21T06:10:34.231990+0000","last_became_active":"2024-09-21T06:10:33.234740+0000","last_became_peered":"2024-09-21T06:10:33.234740+0000","last_unstale":"2024-09-21T06:10:34.231990+0000","last_undegraded":"2024-09-21T06:10:34.231990+0000","last_fullsized":"2024-09-21T06:10:34.231990+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:35.481842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.250390+0000","last_change":"2024-09-21T06:10:33.250158+0000","last_active":"2024-09-21T06:10:33.250390+0000","last_peered":"2024-09-21T06:10:33.250390+0000","last_clean":"2024-09-21T06:10:33.250390+0000","last_became_active":"2024-09-21T06:10:33.249869+0000","last_became_peered":"2024-09-21T06:10:33.249869+0000","last_unstale":"2024-09-21T06:10:33.250390+0000","last_undegraded":"2024-09-21T06:10:33.250390+0000","last_fullsized":"2024-09-21T06:10:33.250390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:07.470266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539106+0000","last_change":"2024-09-21T06:10:33.253122+0000","last_active":"2024-09-21T06:10:34.539106+0000","last_peered":"2024-09-21T06:10:34.539106+0000","last_clean":"2024-09-21T06:10:34.539106+0000","last_became_active":"2024-09-21T06:10:33.252088+0000","last_became_peered":"2024-09-21T06:10:33.252088+0000","last_unstale":"2024-09-21T06:10:34.539106+0000","last_undegraded":"2024-09-21T06:10:34.539106+0000","last_fullsized":"2024-09-21T06:10:34.539106+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:37.993310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251885+0000","last_change":"2024-09-21T06:10:33.251588+0000","last_active":"2024-09-21T06:10:33.251885+0000","last_peered":"2024-09-21T06:10:33.251885+0000","last_clean":"2024-09-21T06:10:33.251885+0000","last_became_active":"2024-09-21T06:10:33.251319+0000","last_became_peered":"2024-09-21T06:10:33.251319+0000","last_unstale":"2024-09-21T06:10:33.251885+0000","last_undegraded":"2024-09-21T06:10:33.251885+0000","last_fullsized":"2024-09-21T06:10:33.251885+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:39.734880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.231933+0000","last_change":"2024-09-21T06:10:33.255055+0000","last_active":"2024-09-21T06:10:34.231933+0000","last_peered":"2024-09-21T06:10:34.231933+0000","last_clean":"2024-09-21T06:10:34.231933+0000","last_became_active":"2024-09-21T06:10:33.254425+0000","last_became_peered":"2024-09-21T06:10:33.254425+0000","last_unstale":"2024-09-21T06:10:34.231933+0000","last_undegraded":"2024-09-21T06:10:34.231933+0000","last_fullsized":"2024-09-21T06:10:34.231933+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:52:34.660067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241890+0000","last_change":"2024-09-21T06:10:33.241674+0000","last_active":"2024-09-21T06:10:33.241890+0000","last_peered":"2024-09-21T06:10:33.241890+0000","last_clean":"2024-09-21T06:10:33.241890+0000","last_became_active":"2024-09-21T06:10:33.241382+0000","last_became_peered":"2024-09-21T06:10:33.241382+0000","last_unstale":"2024-09-21T06:10:33.241890+0000","last_undegraded":"2024-09-21T06:10:33.241890+0000","last_fullsized":"2024-09-21T06:10:33.241890+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.352303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241113+0000","last_change":"2024-09-21T06:10:33.240896+0000","last_active":"2024-09-21T06:10:33.241113+0000","last_peered":"2024-09-21T06:10:33.241113+0000","last_clean":"2024-09-21T06:10:33.241113+0000","last_became_active":"2024-09-21T06:10:33.239308+0000","last_became_peered":"2024-09-21T06:10:33.239308+0000","last_unstale":"2024-09-21T06:10:33.241113+0000","last_undegraded":"2024-09-21T06:10:33.241113+0000","last_fullsized":"2024-09-21T06:10:33.241113+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:30.698372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539334+0000","last_change":"2024-09-21T06:10:33.252661+0000","last_active":"2024-09-21T06:10:34.539334+0000","last_peered":"2024-09-21T06:10:34.539334+0000","last_clean":"2024-09-21T06:10:34.539334+0000","last_became_active":"2024-09-21T06:10:33.249805+0000","last_became_peered":"2024-09-21T06:10:33.249805+0000","last_unstale":"2024-09-21T06:10:34.539334+0000","last_undegraded":"2024-09-21T06:10:34.539334+0000","last_fullsized":"2024-09-21T06:10:34.539334+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:40.909833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.242428+0000","last_change":"2024-09-21T06:10:33.241977+0000","last_active":"2024-09-21T06:10:33.242428+0000","last_peered":"2024-09-21T06:10:33.242428+0000","last_clean":"2024-09-21T06:10:33.242428+0000","last_became_active":"2024-09-21T06:10:33.241511+0000","last_became_peered":"2024-09-21T06:10:33.241511+0000","last_unstale":"2024-09-21T06:10:33.242428+0000","last_undegraded":"2024-09-21T06:10:33.242428+0000","last_fullsized":"2024-09-21T06:10:33.242428+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:35.813837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.250327+0000","last_change":"2024-09-21T06:10:33.249891+0000","last_active":"2024-09-21T06:10:33.250327+0000","last_peered":"2024-09-21T06:10:33.250327+0000","last_clean":"2024-09-21T06:10:33.250327+0000","last_became_active":"2024-09-21T06:10:33.249620+0000","last_became_peered":"2024-09-21T06:10:33.249620+0000","last_unstale":"2024-09-21T06:10:33.250327+0000","last_undegraded":"2024-09-21T06:10:33.250327+0000","last_fullsized":"2024-09-21T06:10:33.250327+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:16.192701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"131'4","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.259645+0000","last_change":"2024-09-21T06:10:32.226894+0000","last_active":"2024-09-21T06:10:33.259645+0000","last_peered":"2024-09-21T06:10:33.259645+0000","last_clean":"2024-09-21T06:10:33.259645+0000","last_became_active":"2024-09-21T06:10:32.225456+0000","last_became_peered":"2024-09-21T06:10:32.225456+0000","last_unstale":"2024-09-21T06:10:33.259645+0000","last_undegraded":"2024-09-21T06:10:33.259645+0000","last_fullsized":"2024-09-21T06:10:33.259645+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:55.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248201+0000","last_change":"2024-09-21T06:10:33.247893+0000","last_active":"2024-09-21T06:10:33.248201+0000","last_peered":"2024-09-21T06:10:33.248201+0000","last_clean":"2024-09-21T06:10:33.248201+0000","last_became_active":"2024-09-21T06:10:33.247618+0000","last_became_peered":"2024-09-21T06:10:33.247618+0000","last_unstale":"2024-09-21T06:10:33.248201+0000","last_undegraded":"2024-09-21T06:10:33.248201+0000","last_fullsized":"2024-09-21T06:10:33.248201+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.642140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"131'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.260871+0000","last_change":"2024-09-21T06:10:32.220593+0000","last_active":"2024-09-21T06:10:33.260871+0000","last_peered":"2024-09-21T06:10:33.260871+0000","last_clean":"2024-09-21T06:10:33.260871+0000","last_became_active":"2024-09-21T06:10:32.220266+0000","last_became_peered":"2024-09-21T06:10:32.220266+0000","last_unstale":"2024-09-21T06:10:33.260871+0000","last_undegraded":"2024-09-21T06:10:33.260871+0000","last_fullsized":"2024-09-21T06:10:33.260871+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:43.385933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.247735+0000","last_change":"2024-09-21T06:10:33.246593+0000","last_active":"2024-09-21T06:10:33.247735+0000","last_peered":"2024-09-21T06:10:33.247735+0000","last_clean":"2024-09-21T06:10:33.247735+0000","last_became_active":"2024-09-21T06:10:33.246296+0000","last_became_peered":"2024-09-21T06:10:33.246296+0000","last_unstale":"2024-09-21T06:10:33.247735+0000","last_undegraded":"2024-09-21T06:10:33.247735+0000","last_fullsized":"2024-09-21T06:10:33.247735+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:17.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.263995+0000","last_change":"2024-09-21T06:10:32.224728+0000","last_active":"2024-09-21T06:10:33.263995+0000","last_peered":"2024-09-21T06:10:33.263995+0000","last_clean":"2024-09-21T06:10:33.263995+0000","last_became_active":"2024-09-21T06:10:32.223178+0000","last_became_peered":"2024-09-21T06:10:32.223178+0000","last_unstale":"2024-09-21T06:10:33.263995+0000","last_undegraded":"2024-09-21T06:10:33.263995+0000","last_fullsized":"2024-09-21T06:10:33.263995+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:27.061372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.238566+0000","last_change":"2024-09-21T06:10:33.238057+0000","last_active":"2024-09-21T06:10:33.238566+0000","last_peered":"2024-09-21T06:10:33.238566+0000","last_clean":"2024-09-21T06:10:33.238566+0000","last_became_active":"2024-09-21T06:10:33.237709+0000","last_became_peered":"2024-09-21T06:10:33.237709+0000","last_unstale":"2024-09-21T06:10:33.238566+0000","last_undegraded":"2024-09-21T06:10:33.238566+0000","last_fullsized":"2024-09-21T06:10:33.238566+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:49.522013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.264507+0000","last_change":"2024-09-21T06:10:32.230324+0000","last_active":"2024-09-21T06:10:33.264507+0000","last_peered":"2024-09-21T06:10:33.264507+0000","last_clean":"2024-09-21T06:10:33.264507+0000","last_became_active":"2024-09-21T06:10:32.229763+0000","last_became_peered":"2024-09-21T06:10:32.229763+0000","last_unstale":"2024-09-21T06:10:33.264507+0000","last_undegraded":"2024-09-21T06:10:33.264507+0000","last_fullsized":"2024-09-21T06:10:33.264507+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:21.376010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538175+0000","last_change":"2024-09-21T06:10:33.249626+0000","last_active":"2024-09-21T06:10:34.538175+0000","last_peered":"2024-09-21T06:10:34.538175+0000","last_clean":"2024-09-21T06:10:34.538175+0000","last_became_active":"2024-09-21T06:10:33.248208+0000","last_became_peered":"2024-09-21T06:10:33.248208+0000","last_unstale":"2024-09-21T06:10:34.538175+0000","last_undegraded":"2024-09-21T06:10:34.538175+0000","last_fullsized":"2024-09-21T06:10:34.538175+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:36.855344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"131'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.258696+0000","last_change":"2024-09-21T06:10:32.225020+0000","last_active":"2024-09-21T06:10:33.258696+0000","last_peered":"2024-09-21T06:10:33.258696+0000","last_clean":"2024-09-21T06:10:33.258696+0000","last_became_active":"2024-09-21T06:10:32.224508+0000","last_became_peered":"2024-09-21T06:10:32.224508+0000","last_unstale":"2024-09-21T06:10:33.258696+0000","last_undegraded":"2024-09-21T06:10:33.258696+0000","last_fullsized":"2024-09-21T06:10:33.258696+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:22.493497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252886+0000","last_change":"2024-09-21T06:10:33.252483+0000","last_active":"2024-09-21T06:10:33.252886+0000","last_peered":"2024-09-21T06:10:33.252886+0000","last_clean":"2024-09-21T06:10:33.252886+0000","last_became_active":"2024-09-21T06:10:33.249940+0000","last_became_peered":"2024-09-21T06:10:33.249940+0000","last_unstale":"2024-09-21T06:10:33.252886+0000","last_undegraded":"2024-09-21T06:10:33.252886+0000","last_fullsized":"2024-09-21T06:10:33.252886+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:04.197176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"131'1","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232373+0000","last_change":"2024-09-21T06:10:32.217983+0000","last_active":"2024-09-21T06:10:34.232373+0000","last_peered":"2024-09-21T06:10:34.232373+0000","last_clean":"2024-09-21T06:10:34.232373+0000","last_became_active":"2024-09-21T06:10:32.217733+0000","last_became_peered":"2024-09-21T06:10:32.217733+0000","last_unstale":"2024-09-21T06:10:34.232373+0000","last_undegraded":"2024-09-21T06:10:34.232373+0000","last_fullsized":"2024-09-21T06:10:34.232373+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:25.281216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538801+0000","last_change":"2024-09-21T06:10:33.250148+0000","last_active":"2024-09-21T06:10:34.538801+0000","last_peered":"2024-09-21T06:10:34.538801+0000","last_clean":"2024-09-21T06:10:34.538801+0000","last_became_active":"2024-09-21T06:10:33.249574+0000","last_became_peered":"2024-09-21T06:10:33.249574+0000","last_unstale":"2024-09-21T06:10:34.538801+0000","last_undegraded":"2024-09-21T06:10:34.538801+0000","last_fullsized":"2024-09-21T06:10:34.538801+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:30.213530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.240507+0000","last_change":"2024-09-21T06:10:32.226436+0000","last_active":"2024-09-21T06:10:33.240507+0000","last_peered":"2024-09-21T06:10:33.240507+0000","last_clean":"2024-09-21T06:10:33.240507+0000","last_became_active":"2024-09-21T06:10:32.226073+0000","last_became_peered":"2024-09-21T06:10:32.226073+0000","last_unstale":"2024-09-21T06:10:33.240507+0000","last_undegraded":"2024-09-21T06:10:33.240507+0000","last_fullsized":"2024-09-21T06:10:33.240507+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:50.596136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251329+0000","last_change":"2024-09-21T06:10:33.250222+0000","last_active":"2024-09-21T06:10:33.251329+0000","last_peered":"2024-09-21T06:10:33.251329+0000","last_clean":"2024-09-21T06:10:33.251329+0000","last_became_active":"2024-09-21T06:10:33.249940+0000","last_became_peered":"2024-09-21T06:10:33.249940+0000","last_unstale":"2024-09-21T06:10:33.251329+0000","last_undegraded":"2024-09-21T06:10:33.251329+0000","last_fullsized":"2024-09-21T06:10:33.251329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:49.635191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539117+0000","last_change":"2024-09-21T06:10:32.225087+0000","last_active":"2024-09-21T06:10:34.539117+0000","last_peered":"2024-09-21T06:10:34.539117+0000","last_clean":"2024-09-21T06:10:34.539117+0000","last_became_active":"2024-09-21T06:10:32.224584+0000","last_became_peered":"2024-09-21T06:10:32.224584+0000","last_unstale":"2024-09-21T06:10:34.539117+0000","last_undegraded":"2024-09-21T06:10:34.539117+0000","last_fullsized":"2024-09-21T06:10:34.539117+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.103558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251300+0000","last_change":"2024-09-21T06:10:33.249699+0000","last_active":"2024-09-21T06:10:33.251300+0000","last_peered":"2024-09-21T06:10:33.251300+0000","last_clean":"2024-09-21T06:10:33.251300+0000","last_became_active":"2024-09-21T06:10:33.247052+0000","last_became_peered":"2024-09-21T06:10:33.247052+0000","last_unstale":"2024-09-21T06:10:33.251300+0000","last_undegraded":"2024-09-21T06:10:33.251300+0000","last_fullsized":"2024-09-21T06:10:33.251300+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:19.433957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.235900+0000","last_change":"2024-09-21T06:10:32.230024+0000","last_active":"2024-09-21T06:10:33.235900+0000","last_peered":"2024-09-21T06:10:33.235900+0000","last_clean":"2024-09-21T06:10:33.235900+0000","last_became_active":"2024-09-21T06:10:32.229418+0000","last_became_peered":"2024-09-21T06:10:32.229418+0000","last_unstale":"2024-09-21T06:10:33.235900+0000","last_undegraded":"2024-09-21T06:10:33.235900+0000","last_fullsized":"2024-09-21T06:10:33.235900+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.326541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252943+0000","last_change":"2024-09-21T06:10:33.251978+0000","last_active":"2024-09-21T06:10:33.252943+0000","last_peered":"2024-09-21T06:10:33.252943+0000","last_clean":"2024-09-21T06:10:33.252943+0000","last_became_active":"2024-09-21T06:10:33.251555+0000","last_became_peered":"2024-09-21T06:10:33.251555+0000","last_unstale":"2024-09-21T06:10:33.252943+0000","last_undegraded":"2024-09-21T06:10:33.252943+0000","last_fullsized":"2024-09-21T06:10:33.252943+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:11.674940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232334+0000","last_change":"2024-09-21T06:10:32.220690+0000","last_active":"2024-09-21T06:10:34.232334+0000","last_peered":"2024-09-21T06:10:34.232334+0000","last_clean":"2024-09-21T06:10:34.232334+0000","last_became_active":"2024-09-21T06:10:32.220416+0000","last_became_peered":"2024-09-21T06:10:32.220416+0000","last_unstale":"2024-09-21T06:10:34.232334+0000","last_undegraded":"2024-09-21T06:10:34.232334+0000","last_fullsized":"2024-09-21T06:10:34.232334+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:54.723730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232256+0000","last_change":"2024-09-21T06:10:33.242847+0000","last_active":"2024-09-21T06:10:34.232256+0000","last_peered":"2024-09-21T06:10:34.232256+0000","last_clean":"2024-09-21T06:10:34.232256+0000","last_became_active":"2024-09-21T06:10:33.242577+0000","last_became_peered":"2024-09-21T06:10:33.242577+0000","last_unstale":"2024-09-21T06:10:34.232256+0000","last_undegraded":"2024-09-21T06:10:34.232256+0000","last_fullsized":"2024-09-21T06:10:34.232256+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:16.939288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"131'3","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539194+0000","last_change":"2024-09-21T06:10:32.233024+0000","last_active":"2024-09-21T06:10:34.539194+0000","last_peered":"2024-09-21T06:10:34.539194+0000","last_clean":"2024-09-21T06:10:34.539194+0000","last_became_active":"2024-09-21T06:10:32.232836+0000","last_became_peered":"2024-09-21T06:10:32.232836+0000","last_unstale":"2024-09-21T06:10:34.539194+0000","last_undegraded":"2024-09-21T06:10:34.539194+0000","last_fullsized":"2024-09-21T06:10:34.539194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:40.689837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248104+0000","last_change":"2024-09-21T06:10:33.247744+0000","last_active":"2024-09-21T06:10:33.248104+0000","last_peered":"2024-09-21T06:10:33.248104+0000","last_clean":"2024-09-21T06:10:33.248104+0000","last_became_active":"2024-09-21T06:10:33.247391+0000","last_became_peered":"2024-09-21T06:10:33.247391+0000","last_unstale":"2024-09-21T06:10:33.248104+0000","last_undegraded":"2024-09-21T06:10:33.248104+0000","last_fullsized":"2024-09-21T06:10:33.248104+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:46.729590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"131'6","reported_seq":21,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538447+0000","last_change":"2024-09-21T06:10:32.233128+0000","last_active":"2024-09-21T06:10:34.538447+0000","last_peered":"2024-09-21T06:10:34.538447+0000","last_clean":"2024-09-21T06:10:34.538447+0000","last_became_active":"2024-09-21T06:10:32.232711+0000","last_became_peered":"2024-09-21T06:10:32.232711+0000","last_unstale":"2024-09-21T06:10:34.538447+0000","last_undegraded":"2024-09-21T06:10:34.538447+0000","last_fullsized":"2024-09-21T06:10:34.538447+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.129003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232251+0000","last_change":"2024-09-21T06:10:33.240793+0000","last_active":"2024-09-21T06:10:34.232251+0000","last_peered":"2024-09-21T06:10:34.232251+0000","last_clean":"2024-09-21T06:10:34.232251+0000","last_became_active":"2024-09-21T06:10:33.240437+0000","last_became_peered":"2024-09-21T06:10:33.240437+0000","last_unstale":"2024-09-21T06:10:34.232251+0000","last_undegraded":"2024-09-21T06:10:34.232251+0000","last_fullsized":"2024-09-21T06:10:34.232251+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:52.786884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.262655+0000","last_change":"2024-09-21T06:10:32.224810+0000","last_active":"2024-09-21T06:10:33.262655+0000","last_peered":"2024-09-21T06:10:33.262655+0000","last_clean":"2024-09-21T06:10:33.262655+0000","last_became_active":"2024-09-21T06:10:32.224220+0000","last_became_peered":"2024-09-21T06:10:32.224220+0000","last_unstale":"2024-09-21T06:10:33.262655+0000","last_undegraded":"2024-09-21T06:10:33.262655+0000","last_fullsized":"2024-09-21T06:10:33.262655+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:28.241357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232287+0000","last_change":"2024-09-21T06:10:33.235201+0000","last_active":"2024-09-21T06:10:34.232287+0000","last_peered":"2024-09-21T06:10:34.232287+0000","last_clean":"2024-09-21T06:10:34.232287+0000","last_became_active":"2024-09-21T06:10:33.234905+0000","last_became_peered":"2024-09-21T06:10:33.234905+0000","last_unstale":"2024-09-21T06:10:34.232287+0000","last_undegraded":"2024-09-21T06:10:34.232287+0000","last_fullsized":"2024-09-21T06:10:34.232287+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:00.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.236675+0000","last_change":"2024-09-21T06:10:32.235701+0000","last_active":"2024-09-21T06:10:33.236675+0000","last_peered":"2024-09-21T06:10:33.236675+0000","last_clean":"2024-09-21T06:10:33.236675+0000","last_became_active":"2024-09-21T06:10:32.235465+0000","last_became_peered":"2024-09-21T06:10:32.235465+0000","last_unstale":"2024-09-21T06:10:33.236675+0000","last_undegraded":"2024-09-21T06:10:33.236675+0000","last_fullsized":"2024-09-21T06:10:33.236675+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:37.808775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232199+0000","last_change":"2024-09-21T06:10:33.250127+0000","last_active":"2024-09-21T06:10:34.232199+0000","last_peered":"2024-09-21T06:10:34.232199+0000","last_clean":"2024-09-21T06:10:34.232199+0000","last_became_active":"2024-09-21T06:10:33.249864+0000","last_became_peered":"2024-09-21T06:10:33.249864+0000","last_unstale":"2024-09-21T06:10:34.232199+0000","last_undegraded":"2024-09-21T06:10:34.232199+0000","last_fullsized":"2024-09-21T06:10:34.232199+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:19.488096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"131'8","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.266060+0000","last_change":"2024-09-21T06:10:32.235822+0000","last_active":"2024-09-21T06:10:33.266060+0000","last_peered":"2024-09-21T06:10:33.266060+0000","last_clean":"2024-09-21T06:10:33.266060+0000","last_became_active":"2024-09-21T06:10:32.235550+0000","last_became_peered":"2024-09-21T06:10:32.235550+0000","last_unstale":"2024-09-21T06:10:33.266060+0000","last_undegraded":"2024-09-21T06:10:33.266060+0000","last_fullsized":"2024-09-21T06:10:33.266060+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:42.635153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248743+0000","last_change":"2024-09-21T06:10:33.248554+0000","last_active":"2024-09-21T06:10:33.248743+0000","last_peered":"2024-09-21T06:10:33.248743+0000","last_clean":"2024-09-21T06:10:33.248743+0000","last_became_active":"2024-09-21T06:10:33.247931+0000","last_became_peered":"2024-09-21T06:10:33.247931+0000","last_unstale":"2024-09-21T06:10:33.248743+0000","last_undegraded":"2024-09-21T06:10:33.248743+0000","last_fullsized":"2024-09-21T06:10:33.248743+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:55.271253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"131'1","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538591+0000","last_change":"2024-09-21T06:10:32.232965+0000","last_active":"2024-09-21T06:10:34.538591+0000","last_peered":"2024-09-21T06:10:34.538591+0000","last_clean":"2024-09-21T06:10:34.538591+0000","last_became_active":"2024-09-21T06:10:32.232065+0000","last_became_peered":"2024-09-21T06:10:32.232065+0000","last_unstale":"2024-09-21T06:10:34.538591+0000","last_undegraded":"2024-09-21T06:10:34.538591+0000","last_fullsized":"2024-09-21T06:10:34.538591+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:32.441411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.254840+0000","last_change":"2024-09-21T06:10:33.254413+0000","last_active":"2024-09-21T06:10:33.254840+0000","last_peered":"2024-09-21T06:10:33.254840+0000","last_clean":"2024-09-21T06:10:33.254840+0000","last_became_active":"2024-09-21T06:10:33.254170+0000","last_became_peered":"2024-09-21T06:10:33.254170+0000","last_unstale":"2024-09-21T06:10:33.254840+0000","last_undegraded":"2024-09-21T06:10:33.254840+0000","last_fullsized":"2024-09-21T06:10:33.254840+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:59.998832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.263447+0000","last_change":"2024-09-21T06:10:32.225014+0000","last_active":"2024-09-21T06:10:33.263447+0000","last_peered":"2024-09-21T06:10:33.263447+0000","last_clean":"2024-09-21T06:10:33.263447+0000","last_became_active":"2024-09-21T06:10:32.223739+0000","last_became_peered":"2024-09-21T06:10:32.223739+0000","last_unstale":"2024-09-21T06:10:33.263447+0000","last_undegraded":"2024-09-21T06:10:33.263447+0000","last_fullsized":"2024-09-21T06:10:33.263447+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:21.713439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.249523+0000","last_change":"2024-09-21T06:10:33.248896+0000","last_active":"2024-09-21T06:10:33.249523+0000","last_peered":"2024-09-21T06:10:33.249523+0000","last_clean":"2024-09-21T06:10:33.249523+0000","last_became_active":"2024-09-21T06:10:33.248623+0000","last_became_peered":"2024-09-21T06:10:33.248623+0000","last_unstale":"2024-09-21T06:10:33.249523+0000","last_undegraded":"2024-09-21T06:10:33.249523+0000","last_fullsized":"2024-09-21T06:10:33.249523+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:13.350370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"131'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.262774+0000","last_change":"2024-09-21T06:10:32.219279+0000","last_active":"2024-09-21T06:10:33.262774+0000","last_peered":"2024-09-21T06:10:33.262774+0000","last_clean":"2024-09-21T06:10:33.262774+0000","last_became_active":"2024-09-21T06:10:32.218771+0000","last_became_peered":"2024-09-21T06:10:32.218771+0000","last_unstale":"2024-09-21T06:10:33.262774+0000","last_undegraded":"2024-09-21T06:10:33.262774+0000","last_fullsized":"2024-09-21T06:10:33.262774+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:37.535114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.243789+0000","last_change":"2024-09-21T06:10:33.243577+0000","last_active":"2024-09-21T06:10:33.243789+0000","last_peered":"2024-09-21T06:10:33.243789+0000","last_clean":"2024-09-21T06:10:33.243789+0000","last_became_active":"2024-09-21T06:10:33.243033+0000","last_became_peered":"2024-09-21T06:10:33.243033+0000","last_unstale":"2024-09-21T06:10:33.243789+0000","last_undegraded":"2024-09-21T06:10:33.243789+0000","last_fullsized":"2024-09-21T06:10:33.243789+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:01.562354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246730+0000","last_change":"2024-09-21T06:10:32.236954+0000","last_active":"2024-09-21T06:10:33.246730+0000","last_peered":"2024-09-21T06:10:33.246730+0000","last_clean":"2024-09-21T06:10:33.246730+0000","last_became_active":"2024-09-21T06:10:32.236409+0000","last_became_peered":"2024-09-21T06:10:32.236409+0000","last_unstale":"2024-09-21T06:10:33.246730+0000","last_undegraded":"2024-09-21T06:10:33.246730+0000","last_fullsized":"2024-09-21T06:10:33.246730+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:59.353391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244488+0000","last_change":"2024-09-21T06:10:33.244200+0000","last_active":"2024-09-21T06:10:33.244488+0000","last_peered":"2024-09-21T06:10:33.244488+0000","last_clean":"2024-09-21T06:10:33.244488+0000","last_became_active":"2024-09-21T06:10:33.242692+0000","last_became_peered":"2024-09-21T06:10:33.242692+0000","last_unstale":"2024-09-21T06:10:33.244488+0000","last_undegraded":"2024-09-21T06:10:33.244488+0000","last_fullsized":"2024-09-21T06:10:33.244488+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:52.635340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.264287+0000","last_change":"2024-09-21T06:10:32.228392+0000","last_active":"2024-09-21T06:10:33.264287+0000","last_peered":"2024-09-21T06:10:33.264287+0000","last_clean":"2024-09-21T06:10:33.264287+0000","last_became_active":"2024-09-21T06:10:32.227975+0000","last_became_peered":"2024-09-21T06:10:32.227975+0000","last_unstale":"2024-09-21T06:10:33.264287+0000","last_undegraded":"2024-09-21T06:10:33.264287+0000","last_fullsized":"2024-09-21T06:10:33.264287+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:00.471180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539104+0000","last_change":"2024-09-21T06:10:33.249195+0000","last_active":"2024-09-21T06:10:34.539104+0000","last_peered":"2024-09-21T06:10:34.539104+0000","last_clean":"2024-09-21T06:10:34.539104+0000","last_became_active":"2024-09-21T06:10:33.247729+0000","last_became_peered":"2024-09-21T06:10:33.247729+0000","last_unstale":"2024-09-21T06:10:34.539104+0000","last_undegraded":"2024-09-21T06:10:34.539104+0000","last_fullsized":"2024-09-21T06:10:34.539104+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:54.688917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.233030+0000","last_change":"2024-09-21T06:10:32.224467+0000","last_active":"2024-09-21T06:10:33.233030+0000","last_peered":"2024-09-21T06:10:33.233030+0000","last_clean":"2024-09-21T06:10:33.233030+0000","last_became_active":"2024-09-21T06:10:32.224190+0000","last_became_peered":"2024-09-21T06:10:32.224190+0000","last_unstale":"2024-09-21T06:10:33.233030+0000","last_undegraded":"2024-09-21T06:10:33.233030+0000","last_fullsized":"2024-09-21T06:10:33.233030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:05.427102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.243759+0000","last_change":"2024-09-21T06:10:33.243294+0000","last_active":"2024-09-21T06:10:33.243759+0000","last_peered":"2024-09-21T06:10:33.243759+0000","last_clean":"2024-09-21T06:10:33.243759+0000","last_became_active":"2024-09-21T06:10:33.242174+0000","last_became_peered":"2024-09-21T06:10:33.242174+0000","last_unstale":"2024-09-21T06:10:33.243759+0000","last_undegraded":"2024-09-21T06:10:33.243759+0000","last_fullsized":"2024-09-21T06:10:33.243759+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:16.565461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244462+0000","last_change":"2024-09-21T06:10:32.224512+0000","last_active":"2024-09-21T06:10:33.244462+0000","last_peered":"2024-09-21T06:10:33.244462+0000","last_clean":"2024-09-21T06:10:33.244462+0000","last_became_active":"2024-09-21T06:10:32.223872+0000","last_became_peered":"2024-09-21T06:10:32.223872+0000","last_unstale":"2024-09-21T06:10:33.244462+0000","last_undegraded":"2024-09-21T06:10:33.244462+0000","last_fullsized":"2024-09-21T06:10:33.244462+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:59.387686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232504+0000","last_change":"2024-09-21T06:10:33.241321+0000","last_active":"2024-09-21T06:10:34.232504+0000","last_peered":"2024-09-21T06:10:34.232504+0000","last_clean":"2024-09-21T06:10:34.232504+0000","last_became_active":"2024-09-21T06:10:33.241064+0000","last_became_peered":"2024-09-21T06:10:33.241064+0000","last_unstale":"2024-09-21T06:10:34.232504+0000","last_undegraded":"2024-09-21T06:10:34.232504+0000","last_fullsized":"2024-09-21T06:10:34.232504+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:33.671259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539521+0000","last_change":"2024-09-21T06:10:32.234599+0000","last_active":"2024-09-21T06:10:34.539521+0000","last_peered":"2024-09-21T06:10:34.539521+0000","last_clean":"2024-09-21T06:10:34.539521+0000","last_became_active":"2024-09-21T06:10:32.233968+0000","last_became_peered":"2024-09-21T06:10:32.233968+0000","last_unstale":"2024-09-21T06:10:34.539521+0000","last_undegraded":"2024-09-21T06:10:34.539521+0000","last_fullsized":"2024-09-21T06:10:34.539521+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:30.279941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252018+0000","last_change":"2024-09-21T06:10:33.251700+0000","last_active":"2024-09-21T06:10:33.252018+0000","last_peered":"2024-09-21T06:10:33.252018+0000","last_clean":"2024-09-21T06:10:33.252018+0000","last_became_active":"2024-09-21T06:10:33.251416+0000","last_became_peered":"2024-09-21T06:10:33.251416+0000","last_unstale":"2024-09-21T06:10:33.252018+0000","last_undegraded":"2024-09-21T06:10:33.252018+0000","last_fullsized":"2024-09-21T06:10:33.252018+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:08.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"131'2","reported_seq":17,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232596+0000","last_change":"2024-09-21T06:10:32.236502+0000","last_active":"2024-09-21T06:10:34.232596+0000","last_peered":"2024-09-21T06:10:34.232596+0000","last_clean":"2024-09-21T06:10:34.232596+0000","last_became_active":"2024-09-21T06:10:32.236251+0000","last_became_peered":"2024-09-21T06:10:32.236251+0000","last_unstale":"2024-09-21T06:10:34.232596+0000","last_undegraded":"2024-09-21T06:10:34.232596+0000","last_fullsized":"2024-09-21T06:10:34.232596+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:19.528465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538557+0000","last_change":"2024-09-21T06:10:33.250420+0000","last_active":"2024-09-21T06:10:34.538557+0000","last_peered":"2024-09-21T06:10:34.538557+0000","last_clean":"2024-09-21T06:10:34.538557+0000","last_became_active":"2024-09-21T06:10:33.250183+0000","last_became_peered":"2024-09-21T06:10:33.250183+0000","last_unstale":"2024-09-21T06:10:34.538557+0000","last_undegraded":"2024-09-21T06:10:34.538557+0000","last_fullsized":"2024-09-21T06:10:34.538557+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:41.517289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.239531+0000","last_change":"2024-09-21T06:10:32.224923+0000","last_active":"2024-09-21T06:10:33.239531+0000","last_peered":"2024-09-21T06:10:33.239531+0000","last_clean":"2024-09-21T06:10:33.239531+0000","last_became_active":"2024-09-21T06:10:32.224666+0000","last_became_peered":"2024-09-21T06:10:32.224666+0000","last_unstale":"2024-09-21T06:10:33.239531+0000","last_undegraded":"2024-09-21T06:10:33.239531+0000","last_fullsized":"2024-09-21T06:10:33.239531+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:00.927781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539006+0000","last_change":"2024-09-21T06:10:33.249837+0000","last_active":"2024-09-21T06:10:34.539006+0000","last_peered":"2024-09-21T06:10:34.539006+0000","last_clean":"2024-09-21T06:10:34.539006+0000","last_became_active":"2024-09-21T06:10:33.248966+0000","last_became_peered":"2024-09-21T06:10:33.248966+0000","last_unstale":"2024-09-21T06:10:34.539006+0000","last_undegraded":"2024-09-21T06:10:34.539006+0000","last_fullsized":"2024-09-21T06:10:34.539006+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:06.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538690+0000","last_change":"2024-09-21T06:10:32.235039+0000","last_active":"2024-09-21T06:10:34.538690+0000","last_peered":"2024-09-21T06:10:34.538690+0000","last_clean":"2024-09-21T06:10:34.538690+0000","last_became_active":"2024-09-21T06:10:32.234459+0000","last_became_peered":"2024-09-21T06:10:32.234459+0000","last_unstale":"2024-09-21T06:10:34.538690+0000","last_undegraded":"2024-09-21T06:10:34.538690+0000","last_fullsized":"2024-09-21T06:10:34.538690+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:54.184160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251713+0000","last_change":"2024-09-21T06:10:33.251478+0000","last_active":"2024-09-21T06:10:33.251713+0000","last_peered":"2024-09-21T06:10:33.251713+0000","last_clean":"2024-09-21T06:10:33.251713+0000","last_became_active":"2024-09-21T06:10:33.251020+0000","last_became_peered":"2024-09-21T06:10:33.251020+0000","last_unstale":"2024-09-21T06:10:33.251713+0000","last_undegraded":"2024-09-21T06:10:33.251713+0000","last_fullsized":"2024-09-21T06:10:33.251713+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:38.481749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232664+0000","last_change":"2024-09-21T06:10:32.228324+0000","last_active":"2024-09-21T06:10:34.232664+0000","last_peered":"2024-09-21T06:10:34.232664+0000","last_clean":"2024-09-21T06:10:34.232664+0000","last_became_active":"2024-09-21T06:10:32.223699+0000","last_became_peered":"2024-09-21T06:10:32.223699+0000","last_unstale":"2024-09-21T06:10:34.232664+0000","last_undegraded":"2024-09-21T06:10:34.232664+0000","last_fullsized":"2024-09-21T06:10:34.232664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:19.502822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.254270+0000","last_change":"2024-09-21T06:10:33.253985+0000","last_active":"2024-09-21T06:10:33.254270+0000","last_peered":"2024-09-21T06:10:33.254270+0000","last_clean":"2024-09-21T06:10:33.254270+0000","last_became_active":"2024-09-21T06:10:33.253210+0000","last_became_peered":"2024-09-21T06:10:33.253210+0000","last_unstale":"2024-09-21T06:10:33.254270+0000","last_undegraded":"2024-09-21T06:10:33.254270+0000","last_fullsized":"2024-09-21T06:10:33.254270+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:11.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.239000+0000","last_change":"2024-09-21T06:10:32.227182+0000","last_active":"2024-09-21T06:10:33.239000+0000","last_peered":"2024-09-21T06:10:33.239000+0000","last_clean":"2024-09-21T06:10:33.239000+0000","last_became_active":"2024-09-21T06:10:32.226846+0000","last_became_peered":"2024-09-21T06:10:32.226846+0000","last_unstale":"2024-09-21T06:10:33.239000+0000","last_undegraded":"2024-09-21T06:10:33.239000+0000","last_fullsized":"2024-09-21T06:10:33.239000+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.803917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251654+0000","last_change":"2024-09-21T06:10:33.251396+0000","last_active":"2024-09-21T06:10:33.251654+0000","last_peered":"2024-09-21T06:10:33.251654+0000","last_clean":"2024-09-21T06:10:33.251654+0000","last_became_active":"2024-09-21T06:10:33.251121+0000","last_became_peered":"2024-09-21T06:10:33.251121+0000","last_unstale":"2024-09-21T06:10:33.251654+0000","last_undegraded":"2024-09-21T06:10:33.251654+0000","last_fullsized":"2024-09-21T06:10:33.251654+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:08.950108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244457+0000","last_change":"2024-09-21T06:10:32.224636+0000","last_active":"2024-09-21T06:10:33.244457+0000","last_peered":"2024-09-21T06:10:33.244457+0000","last_clean":"2024-09-21T06:10:33.244457+0000","last_became_active":"2024-09-21T06:10:32.224200+0000","last_became_peered":"2024-09-21T06:10:32.224200+0000","last_unstale":"2024-09-21T06:10:33.244457+0000","last_undegraded":"2024-09-21T06:10:33.244457+0000","last_fullsized":"2024-09-21T06:10:33.244457+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:42.778071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241025+0000","last_change":"2024-09-21T06:10:33.239530+0000","last_active":"2024-09-21T06:10:33.241025+0000","last_peered":"2024-09-21T06:10:33.241025+0000","last_clean":"2024-09-21T06:10:33.241025+0000","last_became_active":"2024-09-21T06:10:33.238794+0000","last_became_peered":"2024-09-21T06:10:33.238794+0000","last_unstale":"2024-09-21T06:10:33.241025+0000","last_undegraded":"2024-09-21T06:10:33.241025+0000","last_fullsized":"2024-09-21T06:10:33.241025+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:55.179747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.234439+0000","last_change":"2024-09-21T06:10:32.223663+0000","last_active":"2024-09-21T06:10:33.234439+0000","last_peered":"2024-09-21T06:10:33.234439+0000","last_clean":"2024-09-21T06:10:33.234439+0000","last_became_active":"2024-09-21T06:10:32.223390+0000","last_became_peered":"2024-09-21T06:10:32.223390+0000","last_unstale":"2024-09-21T06:10:33.234439+0000","last_undegraded":"2024-09-21T06:10:33.234439+0000","last_fullsized":"2024-09-21T06:10:33.234439+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:12.651168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538825+0000","last_change":"2024-09-21T06:10:33.251398+0000","last_active":"2024-09-21T06:10:34.538825+0000","last_peered":"2024-09-21T06:10:34.538825+0000","last_clean":"2024-09-21T06:10:34.538825+0000","last_became_active":"2024-09-21T06:10:33.251125+0000","last_became_peered":"2024-09-21T06:10:33.251125+0000","last_unstale":"2024-09-21T06:10:34.538825+0000","last_undegraded":"2024-09-21T06:10:34.538825+0000","last_fullsized":"2024-09-21T06:10:34.538825+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:56.522412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538783+0000","last_change":"2024-09-21T06:10:32.234743+0000","last_active":"2024-09-21T06:10:34.538783+0000","last_peered":"2024-09-21T06:10:34.538783+0000","last_clean":"2024-09-21T06:10:34.538783+0000","last_became_active":"2024-09-21T06:10:32.234172+0000","last_became_peered":"2024-09-21T06:10:32.234172+0000","last_unstale":"2024-09-21T06:10:34.538783+0000","last_undegraded":"2024-09-21T06:10:34.538783+0000","last_fullsized":"2024-09-21T06:10:34.538783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:32.111729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232246+0000","last_change":"2024-09-21T06:10:33.235276+0000","last_active":"2024-09-21T06:10:34.232246+0000","last_peered":"2024-09-21T06:10:34.232246+0000","last_clean":"2024-09-21T06:10:34.232246+0000","last_became_active":"2024-09-21T06:10:33.235030+0000","last_became_peered":"2024-09-21T06:10:33.235030+0000","last_unstale":"2024-09-21T06:10:34.232246+0000","last_undegraded":"2024-09-21T06:10:34.232246+0000","last_fullsized":"2024-09-21T06:10:34.232246+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:40.995391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246485+0000","last_change":"2024-09-21T06:10:32.237229+0000","last_active":"2024-09-21T06:10:33.246485+0000","last_peered":"2024-09-21T06:10:33.246485+0000","last_clean":"2024-09-21T06:10:33.246485+0000","last_became_active":"2024-09-21T06:10:32.236693+0000","last_became_peered":"2024-09-21T06:10:32.236693+0000","last_unstale":"2024-09-21T06:10:33.246485+0000","last_undegraded":"2024-09-21T06:10:33.246485+0000","last_fullsized":"2024-09-21T06:10:33.246485+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:34.380761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":339,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.233382+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:10:33.233382+0000","last_peered":"2024-09-21T06:10:33.233382+0000","last_clean":"2024-09-21T06:10:33.233382+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:10:33.233382+0000","last_undegraded":"2024-09-21T06:10:33.233382+0000","last_fullsized":"2024-09-21T06:10:33.233382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199265821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1287,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194025,"statfs":{"total":200000000,"available":198681711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1286,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194026,"statfs":{"total":200000000,"available":198682819,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574932,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574932,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199273199,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:10:37.669 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:10:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.924+0000 7f8960a00640 1 -- 172.21.15.118:0/4238661915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8940003fd0 msgr2=0x7f8940004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.924+0000 7f8960a00640 1 --2- 172.21.15.118:0/4238661915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8940003fd0 0x7f8940004800 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8948009b50 tx=0x7f8940005830 comp rx=0 tx=0).stop 2024-09-21T06:10:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.924+0000 7f895be00640 1 -- 172.21.15.118:0/4238661915 reap_dead start 2024-09-21T06:10:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.924+0000 7f8960a00640 1 -- 172.21.15.118:0/4238661915 shutdown_connections 2024-09-21T06:10:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.924+0000 7f8960a00640 1 -- 172.21.15.118:0/4238661915 >> 172.21.15.118:0/4238661915 conn(0x7f895c06d1c0 msgr2=0x7f895c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.924+0000 7f8960a00640 1 -- 172.21.15.118:0/4238661915 shutdown_connections 2024-09-21T06:10:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.924+0000 7f8960a00640 1 -- 172.21.15.118:0/4238661915 wait complete. 2024-09-21T06:10:37.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.926+0000 7f8960a00640 1 Processor -- start 2024-09-21T06:10:37.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.926+0000 7f8960a00640 1 -- start start 2024-09-21T06:10:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f8960a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8940003fd0 0x7f895c140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f8960a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f895c153850 0x7f895c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f8960a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f895c14fe80 0x7f895c14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f8960a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f895c0d0670 con 0x7f895c14fe80 2024-09-21T06:10:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f8960a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f895c0d04f0 con 0x7f8940003fd0 2024-09-21T06:10:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f8960a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f895c0d07f0 con 0x7f895c153850 2024-09-21T06:10:37.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f895c14fe80 0x7f895c14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f895c14fe80 0x7f895c14f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40122/0 (socket says 172.21.15.118:40122) 2024-09-21T06:10:37.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 -- 172.21.15.118:0/1342846677 learned_addr learned my addr 172.21.15.118:0/1342846677 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895b400640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8940003fd0 0x7f895c140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895aa00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f895c153850 0x7f895c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 -- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f895c153850 msgr2=0x7f895c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f895c153850 0x7f895c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 -- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8940003fd0 msgr2=0x7f895c140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8940003fd0 0x7f895c140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.928+0000 7f895be00640 1 -- 172.21.15.118:0/1342846677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c141430 con 0x7f895c14fe80 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.929+0000 7f895be00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f895c14fe80 0x7f895c14f160 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f895c0d4c30 tx=0x7f895400e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.929+0000 7f8953400640 1 -- 172.21.15.118:0/1342846677 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89540107d0 con 0x7f895c14fe80 2024-09-21T06:10:37.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.929+0000 7f8953400640 1 -- 172.21.15.118:0/1342846677 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8954016070 con 0x7f895c14fe80 2024-09-21T06:10:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.929+0000 7f8953400640 1 -- 172.21.15.118:0/1342846677 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954010d20 con 0x7f895c14fe80 2024-09-21T06:10:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.929+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895c155fd0 con 0x7f895c14fe80 2024-09-21T06:10:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.929+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895c157630 con 0x7f895c14fe80 2024-09-21T06:10:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.930+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895c06db00 con 0x7f895c14fe80 2024-09-21T06:10:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.931+0000 7f8953400640 1 -- 172.21.15.118:0/1342846677 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f895401b460 con 0x7f895c14fe80 2024-09-21T06:10:37.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.932+0000 7f8953400640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f893c078b90 0x7f893c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:37.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.932+0000 7f8953400640 1 -- 172.21.15.118:0/1342846677 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f895409b270 con 0x7f895c14fe80 2024-09-21T06:10:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.933+0000 7f895b400640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f893c078b90 0x7f893c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.933+0000 7f895b400640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f893c078b90 0x7f893c07b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f894c005fd0 tx=0x7f894c009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:37.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:37.937+0000 7f8953400640 1 -- 172.21.15.118:0/1342846677 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f895c06db00 con 0x7f895c14fe80 2024-09-21T06:10:38.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.117+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f895c15f660 con 0x7f893c078b90 2024-09-21T06:10:38.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.122+0000 7f8953400640 1 -- 172.21.15.118:0/1342846677 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247977 (secure 0 0 0) 0x7f894c05c8c0 con 0x7f893c078b90 2024-09-21T06:10:38.126 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:38.128 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:10:38.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f893c078b90 msgr2=0x7f893c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f893c078b90 0x7f893c07b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f894c005fd0 tx=0x7f894c009500 comp rx=0 tx=0).stop 2024-09-21T06:10:38.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f895c14fe80 msgr2=0x7f895c14f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f895c14fe80 0x7f895c14f160 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f895c0d4c30 tx=0x7f895400e9a0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 shutdown_connections 2024-09-21T06:10:38.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f895c14fe80 0x7f895c14f160 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f893c078b90 0x7f893c07b0a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f895c153850 0x7f895c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 --2- 172.21.15.118:0/1342846677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8940003fd0 0x7f895c140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 >> 172.21.15.118:0/1342846677 conn(0x7f895c06d1c0 msgr2=0x7f895c159370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:38.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.126+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 shutdown_connections 2024-09-21T06:10:38.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.127+0000 7f8960a00640 1 -- 172.21.15.118:0/1342846677 wait complete. 2024-09-21T06:10:38.149 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-21T06:10:36.562042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6837,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555662,"statfs":{"total":1600000000,"available":1592998568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.352676"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538169+0000","last_change":"2024-09-21T06:10:33.246928+0000","last_active":"2024-09-21T06:10:34.538169+0000","last_peered":"2024-09-21T06:10:34.538169+0000","last_clean":"2024-09-21T06:10:34.538169+0000","last_became_active":"2024-09-21T06:10:33.244299+0000","last_became_peered":"2024-09-21T06:10:33.244299+0000","last_unstale":"2024-09-21T06:10:34.538169+0000","last_undegraded":"2024-09-21T06:10:34.538169+0000","last_fullsized":"2024-09-21T06:10:34.538169+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.236328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252978+0000","last_change":"2024-09-21T06:10:33.252782+0000","last_active":"2024-09-21T06:10:33.252978+0000","last_peered":"2024-09-21T06:10:33.252978+0000","last_clean":"2024-09-21T06:10:33.252978+0000","last_became_active":"2024-09-21T06:10:33.250312+0000","last_became_peered":"2024-09-21T06:10:33.250312+0000","last_unstale":"2024-09-21T06:10:33.252978+0000","last_undegraded":"2024-09-21T06:10:33.252978+0000","last_fullsized":"2024-09-21T06:10:33.252978+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:01.193133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246374+0000","last_change":"2024-09-21T06:10:33.246094+0000","last_active":"2024-09-21T06:10:33.246374+0000","last_peered":"2024-09-21T06:10:33.246374+0000","last_clean":"2024-09-21T06:10:33.246374+0000","last_became_active":"2024-09-21T06:10:33.245601+0000","last_became_peered":"2024-09-21T06:10:33.245601+0000","last_unstale":"2024-09-21T06:10:33.246374+0000","last_undegraded":"2024-09-21T06:10:33.246374+0000","last_fullsized":"2024-09-21T06:10:33.246374+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:45.113325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.537989+0000","last_change":"2024-09-21T06:10:33.251708+0000","last_active":"2024-09-21T06:10:34.537989+0000","last_peered":"2024-09-21T06:10:34.537989+0000","last_clean":"2024-09-21T06:10:34.537989+0000","last_became_active":"2024-09-21T06:10:33.251419+0000","last_became_peered":"2024-09-21T06:10:33.251419+0000","last_unstale":"2024-09-21T06:10:34.537989+0000","last_undegraded":"2024-09-21T06:10:34.537989+0000","last_fullsized":"2024-09-21T06:10:34.537989+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:57.396017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248452+0000","last_change":"2024-09-21T06:10:33.248235+0000","last_active":"2024-09-21T06:10:33.248452+0000","last_peered":"2024-09-21T06:10:33.248452+0000","last_clean":"2024-09-21T06:10:33.248452+0000","last_became_active":"2024-09-21T06:10:33.247466+0000","last_became_peered":"2024-09-21T06:10:33.247466+0000","last_unstale":"2024-09-21T06:10:33.248452+0000","last_undegraded":"2024-09-21T06:10:33.248452+0000","last_fullsized":"2024-09-21T06:10:33.248452+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:33.970381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248524+0000","last_change":"2024-09-21T06:10:33.248233+0000","last_active":"2024-09-21T06:10:33.248524+0000","last_peered":"2024-09-21T06:10:33.248524+0000","last_clean":"2024-09-21T06:10:33.248524+0000","last_became_active":"2024-09-21T06:10:33.247942+0000","last_became_peered":"2024-09-21T06:10:33.247942+0000","last_unstale":"2024-09-21T06:10:33.248524+0000","last_undegraded":"2024-09-21T06:10:33.248524+0000","last_fullsized":"2024-09-21T06:10:33.248524+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:44.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251369+0000","last_change":"2024-09-21T06:10:33.250479+0000","last_active":"2024-09-21T06:10:33.251369+0000","last_peered":"2024-09-21T06:10:33.251369+0000","last_clean":"2024-09-21T06:10:33.251369+0000","last_became_active":"2024-09-21T06:10:33.250130+0000","last_became_peered":"2024-09-21T06:10:33.250130+0000","last_unstale":"2024-09-21T06:10:33.251369+0000","last_undegraded":"2024-09-21T06:10:33.251369+0000","last_fullsized":"2024-09-21T06:10:33.251369+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:45.112186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244789+0000","last_change":"2024-09-21T06:10:33.243279+0000","last_active":"2024-09-21T06:10:33.244789+0000","last_peered":"2024-09-21T06:10:33.244789+0000","last_clean":"2024-09-21T06:10:33.244789+0000","last_became_active":"2024-09-21T06:10:33.242894+0000","last_became_peered":"2024-09-21T06:10:33.242894+0000","last_unstale":"2024-09-21T06:10:33.244789+0000","last_undegraded":"2024-09-21T06:10:33.244789+0000","last_fullsized":"2024-09-21T06:10:33.244789+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:33.051211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538220+0000","last_change":"2024-09-21T06:10:33.248077+0000","last_active":"2024-09-21T06:10:34.538220+0000","last_peered":"2024-09-21T06:10:34.538220+0000","last_clean":"2024-09-21T06:10:34.538220+0000","last_became_active":"2024-09-21T06:10:33.245768+0000","last_became_peered":"2024-09-21T06:10:33.245768+0000","last_unstale":"2024-09-21T06:10:34.538220+0000","last_undegraded":"2024-09-21T06:10:34.538220+0000","last_fullsized":"2024-09-21T06:10:34.538220+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:08.161566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538574+0000","last_change":"2024-09-21T06:10:33.245826+0000","last_active":"2024-09-21T06:10:34.538574+0000","last_peered":"2024-09-21T06:10:34.538574+0000","last_clean":"2024-09-21T06:10:34.538574+0000","last_became_active":"2024-09-21T06:10:33.245487+0000","last_became_peered":"2024-09-21T06:10:33.245487+0000","last_unstale":"2024-09-21T06:10:34.538574+0000","last_undegraded":"2024-09-21T06:10:34.538574+0000","last_fullsized":"2024-09-21T06:10:34.538574+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:38.756606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.247219+0000","last_change":"2024-09-21T06:10:33.245602+0000","last_active":"2024-09-21T06:10:33.247219+0000","last_peered":"2024-09-21T06:10:33.247219+0000","last_clean":"2024-09-21T06:10:33.247219+0000","last_became_active":"2024-09-21T06:10:33.245288+0000","last_became_peered":"2024-09-21T06:10:33.245288+0000","last_unstale":"2024-09-21T06:10:33.247219+0000","last_undegraded":"2024-09-21T06:10:33.247219+0000","last_fullsized":"2024-09-21T06:10:33.247219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:31.197116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538312+0000","last_change":"2024-09-21T06:10:33.249186+0000","last_active":"2024-09-21T06:10:34.538312+0000","last_peered":"2024-09-21T06:10:34.538312+0000","last_clean":"2024-09-21T06:10:34.538312+0000","last_became_active":"2024-09-21T06:10:33.248946+0000","last_became_peered":"2024-09-21T06:10:33.248946+0000","last_unstale":"2024-09-21T06:10:34.538312+0000","last_undegraded":"2024-09-21T06:10:34.538312+0000","last_fullsized":"2024-09-21T06:10:34.538312+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:56.114678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.243681+0000","last_change":"2024-09-21T06:10:33.241406+0000","last_active":"2024-09-21T06:10:33.243681+0000","last_peered":"2024-09-21T06:10:33.243681+0000","last_clean":"2024-09-21T06:10:33.243681+0000","last_became_active":"2024-09-21T06:10:33.238511+0000","last_became_peered":"2024-09-21T06:10:33.238511+0000","last_unstale":"2024-09-21T06:10:33.243681+0000","last_undegraded":"2024-09-21T06:10:33.243681+0000","last_fullsized":"2024-09-21T06:10:33.243681+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:14.629592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241055+0000","last_change":"2024-09-21T06:10:33.239918+0000","last_active":"2024-09-21T06:10:33.241055+0000","last_peered":"2024-09-21T06:10:33.241055+0000","last_clean":"2024-09-21T06:10:33.241055+0000","last_became_active":"2024-09-21T06:10:33.239166+0000","last_became_peered":"2024-09-21T06:10:33.239166+0000","last_unstale":"2024-09-21T06:10:33.241055+0000","last_undegraded":"2024-09-21T06:10:33.241055+0000","last_fullsized":"2024-09-21T06:10:33.241055+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:13.902900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251820+0000","last_change":"2024-09-21T06:10:33.251574+0000","last_active":"2024-09-21T06:10:33.251820+0000","last_peered":"2024-09-21T06:10:33.251820+0000","last_clean":"2024-09-21T06:10:33.251820+0000","last_became_active":"2024-09-21T06:10:33.250994+0000","last_became_peered":"2024-09-21T06:10:33.250994+0000","last_unstale":"2024-09-21T06:10:33.251820+0000","last_undegraded":"2024-09-21T06:10:33.251820+0000","last_fullsized":"2024-09-21T06:10:33.251820+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.954474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538444+0000","last_change":"2024-09-21T06:10:33.252287+0000","last_active":"2024-09-21T06:10:34.538444+0000","last_peered":"2024-09-21T06:10:34.538444+0000","last_clean":"2024-09-21T06:10:34.538444+0000","last_became_active":"2024-09-21T06:10:33.249394+0000","last_became_peered":"2024-09-21T06:10:33.249394+0000","last_unstale":"2024-09-21T06:10:34.538444+0000","last_undegraded":"2024-09-21T06:10:34.538444+0000","last_fullsized":"2024-09-21T06:10:34.538444+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:18.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252857+0000","last_change":"2024-09-21T06:10:33.251833+0000","last_active":"2024-09-21T06:10:33.252857+0000","last_peered":"2024-09-21T06:10:33.252857+0000","last_clean":"2024-09-21T06:10:33.252857+0000","last_became_active":"2024-09-21T06:10:33.248940+0000","last_became_peered":"2024-09-21T06:10:33.248940+0000","last_unstale":"2024-09-21T06:10:33.252857+0000","last_undegraded":"2024-09-21T06:10:33.252857+0000","last_fullsized":"2024-09-21T06:10:33.252857+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:43.023716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246441+0000","last_change":"2024-09-21T06:10:33.246197+0000","last_active":"2024-09-21T06:10:33.246441+0000","last_peered":"2024-09-21T06:10:33.246441+0000","last_clean":"2024-09-21T06:10:33.246441+0000","last_became_active":"2024-09-21T06:10:33.245964+0000","last_became_peered":"2024-09-21T06:10:33.245964+0000","last_unstale":"2024-09-21T06:10:33.246441+0000","last_undegraded":"2024-09-21T06:10:33.246441+0000","last_fullsized":"2024-09-21T06:10:33.246441+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:34.057054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.234990+0000","last_change":"2024-09-21T06:10:33.234713+0000","last_active":"2024-09-21T06:10:33.234990+0000","last_peered":"2024-09-21T06:10:33.234990+0000","last_clean":"2024-09-21T06:10:33.234990+0000","last_became_active":"2024-09-21T06:10:33.234490+0000","last_became_peered":"2024-09-21T06:10:33.234490+0000","last_unstale":"2024-09-21T06:10:33.234990+0000","last_undegraded":"2024-09-21T06:10:33.234990+0000","last_fullsized":"2024-09-21T06:10:33.234990+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:01.922400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248063+0000","last_change":"2024-09-21T06:10:33.247853+0000","last_active":"2024-09-21T06:10:33.248063+0000","last_peered":"2024-09-21T06:10:33.248063+0000","last_clean":"2024-09-21T06:10:33.248063+0000","last_became_active":"2024-09-21T06:10:33.247530+0000","last_became_peered":"2024-09-21T06:10:33.247530+0000","last_unstale":"2024-09-21T06:10:33.248063+0000","last_undegraded":"2024-09-21T06:10:33.248063+0000","last_fullsized":"2024-09-21T06:10:33.248063+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:25.883812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241947+0000","last_change":"2024-09-21T06:10:33.241773+0000","last_active":"2024-09-21T06:10:33.241947+0000","last_peered":"2024-09-21T06:10:33.241947+0000","last_clean":"2024-09-21T06:10:33.241947+0000","last_became_active":"2024-09-21T06:10:33.241525+0000","last_became_peered":"2024-09-21T06:10:33.241525+0000","last_unstale":"2024-09-21T06:10:33.241947+0000","last_undegraded":"2024-09-21T06:10:33.241947+0000","last_fullsized":"2024-09-21T06:10:33.241947+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:24.309227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.231946+0000","last_change":"2024-09-21T06:10:33.239527+0000","last_active":"2024-09-21T06:10:34.231946+0000","last_peered":"2024-09-21T06:10:34.231946+0000","last_clean":"2024-09-21T06:10:34.231946+0000","last_became_active":"2024-09-21T06:10:33.239134+0000","last_became_peered":"2024-09-21T06:10:33.239134+0000","last_unstale":"2024-09-21T06:10:34.231946+0000","last_undegraded":"2024-09-21T06:10:34.231946+0000","last_fullsized":"2024-09-21T06:10:34.231946+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:37.721459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.247247+0000","last_change":"2024-09-21T06:10:33.245941+0000","last_active":"2024-09-21T06:10:33.247247+0000","last_peered":"2024-09-21T06:10:33.247247+0000","last_clean":"2024-09-21T06:10:33.247247+0000","last_became_active":"2024-09-21T06:10:33.245604+0000","last_became_peered":"2024-09-21T06:10:33.245604+0000","last_unstale":"2024-09-21T06:10:33.247247+0000","last_undegraded":"2024-09-21T06:10:33.247247+0000","last_fullsized":"2024-09-21T06:10:33.247247+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:27.554800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.231990+0000","last_change":"2024-09-21T06:10:33.235010+0000","last_active":"2024-09-21T06:10:34.231990+0000","last_peered":"2024-09-21T06:10:34.231990+0000","last_clean":"2024-09-21T06:10:34.231990+0000","last_became_active":"2024-09-21T06:10:33.234740+0000","last_became_peered":"2024-09-21T06:10:33.234740+0000","last_unstale":"2024-09-21T06:10:34.231990+0000","last_undegraded":"2024-09-21T06:10:34.231990+0000","last_fullsized":"2024-09-21T06:10:34.231990+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:35.481842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.250390+0000","last_change":"2024-09-21T06:10:33.250158+0000","last_active":"2024-09-21T06:10:33.250390+0000","last_peered":"2024-09-21T06:10:33.250390+0000","last_clean":"2024-09-21T06:10:33.250390+0000","last_became_active":"2024-09-21T06:10:33.249869+0000","last_became_peered":"2024-09-21T06:10:33.249869+0000","last_unstale":"2024-09-21T06:10:33.250390+0000","last_undegraded":"2024-09-21T06:10:33.250390+0000","last_fullsized":"2024-09-21T06:10:33.250390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:07.470266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539106+0000","last_change":"2024-09-21T06:10:33.253122+0000","last_active":"2024-09-21T06:10:34.539106+0000","last_peered":"2024-09-21T06:10:34.539106+0000","last_clean":"2024-09-21T06:10:34.539106+0000","last_became_active":"2024-09-21T06:10:33.252088+0000","last_became_peered":"2024-09-21T06:10:33.252088+0000","last_unstale":"2024-09-21T06:10:34.539106+0000","last_undegraded":"2024-09-21T06:10:34.539106+0000","last_fullsized":"2024-09-21T06:10:34.539106+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:37.993310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251885+0000","last_change":"2024-09-21T06:10:33.251588+0000","last_active":"2024-09-21T06:10:33.251885+0000","last_peered":"2024-09-21T06:10:33.251885+0000","last_clean":"2024-09-21T06:10:33.251885+0000","last_became_active":"2024-09-21T06:10:33.251319+0000","last_became_peered":"2024-09-21T06:10:33.251319+0000","last_unstale":"2024-09-21T06:10:33.251885+0000","last_undegraded":"2024-09-21T06:10:33.251885+0000","last_fullsized":"2024-09-21T06:10:33.251885+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:39.734880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.231933+0000","last_change":"2024-09-21T06:10:33.255055+0000","last_active":"2024-09-21T06:10:34.231933+0000","last_peered":"2024-09-21T06:10:34.231933+0000","last_clean":"2024-09-21T06:10:34.231933+0000","last_became_active":"2024-09-21T06:10:33.254425+0000","last_became_peered":"2024-09-21T06:10:33.254425+0000","last_unstale":"2024-09-21T06:10:34.231933+0000","last_undegraded":"2024-09-21T06:10:34.231933+0000","last_fullsized":"2024-09-21T06:10:34.231933+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:52:34.660067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241890+0000","last_change":"2024-09-21T06:10:33.241674+0000","last_active":"2024-09-21T06:10:33.241890+0000","last_peered":"2024-09-21T06:10:33.241890+0000","last_clean":"2024-09-21T06:10:33.241890+0000","last_became_active":"2024-09-21T06:10:33.241382+0000","last_became_peered":"2024-09-21T06:10:33.241382+0000","last_unstale":"2024-09-21T06:10:33.241890+0000","last_undegraded":"2024-09-21T06:10:33.241890+0000","last_fullsized":"2024-09-21T06:10:33.241890+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:21.352303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241113+0000","last_change":"2024-09-21T06:10:33.240896+0000","last_active":"2024-09-21T06:10:33.241113+0000","last_peered":"2024-09-21T06:10:33.241113+0000","last_clean":"2024-09-21T06:10:33.241113+0000","last_became_active":"2024-09-21T06:10:33.239308+0000","last_became_peered":"2024-09-21T06:10:33.239308+0000","last_unstale":"2024-09-21T06:10:33.241113+0000","last_undegraded":"2024-09-21T06:10:33.241113+0000","last_fullsized":"2024-09-21T06:10:33.241113+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:30.698372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539334+0000","last_change":"2024-09-21T06:10:33.252661+0000","last_active":"2024-09-21T06:10:34.539334+0000","last_peered":"2024-09-21T06:10:34.539334+0000","last_clean":"2024-09-21T06:10:34.539334+0000","last_became_active":"2024-09-21T06:10:33.249805+0000","last_became_peered":"2024-09-21T06:10:33.249805+0000","last_unstale":"2024-09-21T06:10:34.539334+0000","last_undegraded":"2024-09-21T06:10:34.539334+0000","last_fullsized":"2024-09-21T06:10:34.539334+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:40.909833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.242428+0000","last_change":"2024-09-21T06:10:33.241977+0000","last_active":"2024-09-21T06:10:33.242428+0000","last_peered":"2024-09-21T06:10:33.242428+0000","last_clean":"2024-09-21T06:10:33.242428+0000","last_became_active":"2024-09-21T06:10:33.241511+0000","last_became_peered":"2024-09-21T06:10:33.241511+0000","last_unstale":"2024-09-21T06:10:33.242428+0000","last_undegraded":"2024-09-21T06:10:33.242428+0000","last_fullsized":"2024-09-21T06:10:33.242428+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:35.813837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.250327+0000","last_change":"2024-09-21T06:10:33.249891+0000","last_active":"2024-09-21T06:10:33.250327+0000","last_peered":"2024-09-21T06:10:33.250327+0000","last_clean":"2024-09-21T06:10:33.250327+0000","last_became_active":"2024-09-21T06:10:33.249620+0000","last_became_peered":"2024-09-21T06:10:33.249620+0000","last_unstale":"2024-09-21T06:10:33.250327+0000","last_undegraded":"2024-09-21T06:10:33.250327+0000","last_fullsized":"2024-09-21T06:10:33.250327+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:16.192701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"131'4","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.259645+0000","last_change":"2024-09-21T06:10:32.226894+0000","last_active":"2024-09-21T06:10:33.259645+0000","last_peered":"2024-09-21T06:10:33.259645+0000","last_clean":"2024-09-21T06:10:33.259645+0000","last_became_active":"2024-09-21T06:10:32.225456+0000","last_became_peered":"2024-09-21T06:10:32.225456+0000","last_unstale":"2024-09-21T06:10:33.259645+0000","last_undegraded":"2024-09-21T06:10:33.259645+0000","last_fullsized":"2024-09-21T06:10:33.259645+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:55.116141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248201+0000","last_change":"2024-09-21T06:10:33.247893+0000","last_active":"2024-09-21T06:10:33.248201+0000","last_peered":"2024-09-21T06:10:33.248201+0000","last_clean":"2024-09-21T06:10:33.248201+0000","last_became_active":"2024-09-21T06:10:33.247618+0000","last_became_peered":"2024-09-21T06:10:33.247618+0000","last_unstale":"2024-09-21T06:10:33.248201+0000","last_undegraded":"2024-09-21T06:10:33.248201+0000","last_fullsized":"2024-09-21T06:10:33.248201+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.642140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"131'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.260871+0000","last_change":"2024-09-21T06:10:32.220593+0000","last_active":"2024-09-21T06:10:33.260871+0000","last_peered":"2024-09-21T06:10:33.260871+0000","last_clean":"2024-09-21T06:10:33.260871+0000","last_became_active":"2024-09-21T06:10:32.220266+0000","last_became_peered":"2024-09-21T06:10:32.220266+0000","last_unstale":"2024-09-21T06:10:33.260871+0000","last_undegraded":"2024-09-21T06:10:33.260871+0000","last_fullsized":"2024-09-21T06:10:33.260871+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:43.385933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.247735+0000","last_change":"2024-09-21T06:10:33.246593+0000","last_active":"2024-09-21T06:10:33.247735+0000","last_peered":"2024-09-21T06:10:33.247735+0000","last_clean":"2024-09-21T06:10:33.247735+0000","last_became_active":"2024-09-21T06:10:33.246296+0000","last_became_peered":"2024-09-21T06:10:33.246296+0000","last_unstale":"2024-09-21T06:10:33.247735+0000","last_undegraded":"2024-09-21T06:10:33.247735+0000","last_fullsized":"2024-09-21T06:10:33.247735+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:17.999243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.263995+0000","last_change":"2024-09-21T06:10:32.224728+0000","last_active":"2024-09-21T06:10:33.263995+0000","last_peered":"2024-09-21T06:10:33.263995+0000","last_clean":"2024-09-21T06:10:33.263995+0000","last_became_active":"2024-09-21T06:10:32.223178+0000","last_became_peered":"2024-09-21T06:10:32.223178+0000","last_unstale":"2024-09-21T06:10:33.263995+0000","last_undegraded":"2024-09-21T06:10:33.263995+0000","last_fullsized":"2024-09-21T06:10:33.263995+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:27.061372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.238566+0000","last_change":"2024-09-21T06:10:33.238057+0000","last_active":"2024-09-21T06:10:33.238566+0000","last_peered":"2024-09-21T06:10:33.238566+0000","last_clean":"2024-09-21T06:10:33.238566+0000","last_became_active":"2024-09-21T06:10:33.237709+0000","last_became_peered":"2024-09-21T06:10:33.237709+0000","last_unstale":"2024-09-21T06:10:33.238566+0000","last_undegraded":"2024-09-21T06:10:33.238566+0000","last_fullsized":"2024-09-21T06:10:33.238566+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:49.522013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.264507+0000","last_change":"2024-09-21T06:10:32.230324+0000","last_active":"2024-09-21T06:10:33.264507+0000","last_peered":"2024-09-21T06:10:33.264507+0000","last_clean":"2024-09-21T06:10:33.264507+0000","last_became_active":"2024-09-21T06:10:32.229763+0000","last_became_peered":"2024-09-21T06:10:32.229763+0000","last_unstale":"2024-09-21T06:10:33.264507+0000","last_undegraded":"2024-09-21T06:10:33.264507+0000","last_fullsized":"2024-09-21T06:10:33.264507+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:21.376010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538175+0000","last_change":"2024-09-21T06:10:33.249626+0000","last_active":"2024-09-21T06:10:34.538175+0000","last_peered":"2024-09-21T06:10:34.538175+0000","last_clean":"2024-09-21T06:10:34.538175+0000","last_became_active":"2024-09-21T06:10:33.248208+0000","last_became_peered":"2024-09-21T06:10:33.248208+0000","last_unstale":"2024-09-21T06:10:34.538175+0000","last_undegraded":"2024-09-21T06:10:34.538175+0000","last_fullsized":"2024-09-21T06:10:34.538175+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:36.855344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"131'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.258696+0000","last_change":"2024-09-21T06:10:32.225020+0000","last_active":"2024-09-21T06:10:33.258696+0000","last_peered":"2024-09-21T06:10:33.258696+0000","last_clean":"2024-09-21T06:10:33.258696+0000","last_became_active":"2024-09-21T06:10:32.224508+0000","last_became_peered":"2024-09-21T06:10:32.224508+0000","last_unstale":"2024-09-21T06:10:33.258696+0000","last_undegraded":"2024-09-21T06:10:33.258696+0000","last_fullsized":"2024-09-21T06:10:33.258696+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:22.493497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252886+0000","last_change":"2024-09-21T06:10:33.252483+0000","last_active":"2024-09-21T06:10:33.252886+0000","last_peered":"2024-09-21T06:10:33.252886+0000","last_clean":"2024-09-21T06:10:33.252886+0000","last_became_active":"2024-09-21T06:10:33.249940+0000","last_became_peered":"2024-09-21T06:10:33.249940+0000","last_unstale":"2024-09-21T06:10:33.252886+0000","last_undegraded":"2024-09-21T06:10:33.252886+0000","last_fullsized":"2024-09-21T06:10:33.252886+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:04.197176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"131'1","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232373+0000","last_change":"2024-09-21T06:10:32.217983+0000","last_active":"2024-09-21T06:10:34.232373+0000","last_peered":"2024-09-21T06:10:34.232373+0000","last_clean":"2024-09-21T06:10:34.232373+0000","last_became_active":"2024-09-21T06:10:32.217733+0000","last_became_peered":"2024-09-21T06:10:32.217733+0000","last_unstale":"2024-09-21T06:10:34.232373+0000","last_undegraded":"2024-09-21T06:10:34.232373+0000","last_fullsized":"2024-09-21T06:10:34.232373+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:25.281216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538801+0000","last_change":"2024-09-21T06:10:33.250148+0000","last_active":"2024-09-21T06:10:34.538801+0000","last_peered":"2024-09-21T06:10:34.538801+0000","last_clean":"2024-09-21T06:10:34.538801+0000","last_became_active":"2024-09-21T06:10:33.249574+0000","last_became_peered":"2024-09-21T06:10:33.249574+0000","last_unstale":"2024-09-21T06:10:34.538801+0000","last_undegraded":"2024-09-21T06:10:34.538801+0000","last_fullsized":"2024-09-21T06:10:34.538801+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:30.213530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.240507+0000","last_change":"2024-09-21T06:10:32.226436+0000","last_active":"2024-09-21T06:10:33.240507+0000","last_peered":"2024-09-21T06:10:33.240507+0000","last_clean":"2024-09-21T06:10:33.240507+0000","last_became_active":"2024-09-21T06:10:32.226073+0000","last_became_peered":"2024-09-21T06:10:32.226073+0000","last_unstale":"2024-09-21T06:10:33.240507+0000","last_undegraded":"2024-09-21T06:10:33.240507+0000","last_fullsized":"2024-09-21T06:10:33.240507+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:50.596136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251329+0000","last_change":"2024-09-21T06:10:33.250222+0000","last_active":"2024-09-21T06:10:33.251329+0000","last_peered":"2024-09-21T06:10:33.251329+0000","last_clean":"2024-09-21T06:10:33.251329+0000","last_became_active":"2024-09-21T06:10:33.249940+0000","last_became_peered":"2024-09-21T06:10:33.249940+0000","last_unstale":"2024-09-21T06:10:33.251329+0000","last_undegraded":"2024-09-21T06:10:33.251329+0000","last_fullsized":"2024-09-21T06:10:33.251329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:49.635191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539117+0000","last_change":"2024-09-21T06:10:32.225087+0000","last_active":"2024-09-21T06:10:34.539117+0000","last_peered":"2024-09-21T06:10:34.539117+0000","last_clean":"2024-09-21T06:10:34.539117+0000","last_became_active":"2024-09-21T06:10:32.224584+0000","last_became_peered":"2024-09-21T06:10:32.224584+0000","last_unstale":"2024-09-21T06:10:34.539117+0000","last_undegraded":"2024-09-21T06:10:34.539117+0000","last_fullsized":"2024-09-21T06:10:34.539117+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:33.103558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251300+0000","last_change":"2024-09-21T06:10:33.249699+0000","last_active":"2024-09-21T06:10:33.251300+0000","last_peered":"2024-09-21T06:10:33.251300+0000","last_clean":"2024-09-21T06:10:33.251300+0000","last_became_active":"2024-09-21T06:10:33.247052+0000","last_became_peered":"2024-09-21T06:10:33.247052+0000","last_unstale":"2024-09-21T06:10:33.251300+0000","last_undegraded":"2024-09-21T06:10:33.251300+0000","last_fullsized":"2024-09-21T06:10:33.251300+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:19.433957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.235900+0000","last_change":"2024-09-21T06:10:32.230024+0000","last_active":"2024-09-21T06:10:33.235900+0000","last_peered":"2024-09-21T06:10:33.235900+0000","last_clean":"2024-09-21T06:10:33.235900+0000","last_became_active":"2024-09-21T06:10:32.229418+0000","last_became_peered":"2024-09-21T06:10:32.229418+0000","last_unstale":"2024-09-21T06:10:33.235900+0000","last_undegraded":"2024-09-21T06:10:33.235900+0000","last_fullsized":"2024-09-21T06:10:33.235900+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.326541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252943+0000","last_change":"2024-09-21T06:10:33.251978+0000","last_active":"2024-09-21T06:10:33.252943+0000","last_peered":"2024-09-21T06:10:33.252943+0000","last_clean":"2024-09-21T06:10:33.252943+0000","last_became_active":"2024-09-21T06:10:33.251555+0000","last_became_peered":"2024-09-21T06:10:33.251555+0000","last_unstale":"2024-09-21T06:10:33.252943+0000","last_undegraded":"2024-09-21T06:10:33.252943+0000","last_fullsized":"2024-09-21T06:10:33.252943+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:11.674940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232334+0000","last_change":"2024-09-21T06:10:32.220690+0000","last_active":"2024-09-21T06:10:34.232334+0000","last_peered":"2024-09-21T06:10:34.232334+0000","last_clean":"2024-09-21T06:10:34.232334+0000","last_became_active":"2024-09-21T06:10:32.220416+0000","last_became_peered":"2024-09-21T06:10:32.220416+0000","last_unstale":"2024-09-21T06:10:34.232334+0000","last_undegraded":"2024-09-21T06:10:34.232334+0000","last_fullsized":"2024-09-21T06:10:34.232334+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:54.723730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232256+0000","last_change":"2024-09-21T06:10:33.242847+0000","last_active":"2024-09-21T06:10:34.232256+0000","last_peered":"2024-09-21T06:10:34.232256+0000","last_clean":"2024-09-21T06:10:34.232256+0000","last_became_active":"2024-09-21T06:10:33.242577+0000","last_became_peered":"2024-09-21T06:10:33.242577+0000","last_unstale":"2024-09-21T06:10:34.232256+0000","last_undegraded":"2024-09-21T06:10:34.232256+0000","last_fullsized":"2024-09-21T06:10:34.232256+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:16.939288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"131'3","reported_seq":18,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539194+0000","last_change":"2024-09-21T06:10:32.233024+0000","last_active":"2024-09-21T06:10:34.539194+0000","last_peered":"2024-09-21T06:10:34.539194+0000","last_clean":"2024-09-21T06:10:34.539194+0000","last_became_active":"2024-09-21T06:10:32.232836+0000","last_became_peered":"2024-09-21T06:10:32.232836+0000","last_unstale":"2024-09-21T06:10:34.539194+0000","last_undegraded":"2024-09-21T06:10:34.539194+0000","last_fullsized":"2024-09-21T06:10:34.539194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:40.689837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248104+0000","last_change":"2024-09-21T06:10:33.247744+0000","last_active":"2024-09-21T06:10:33.248104+0000","last_peered":"2024-09-21T06:10:33.248104+0000","last_clean":"2024-09-21T06:10:33.248104+0000","last_became_active":"2024-09-21T06:10:33.247391+0000","last_became_peered":"2024-09-21T06:10:33.247391+0000","last_unstale":"2024-09-21T06:10:33.248104+0000","last_undegraded":"2024-09-21T06:10:33.248104+0000","last_fullsized":"2024-09-21T06:10:33.248104+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:46.729590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"131'6","reported_seq":21,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538447+0000","last_change":"2024-09-21T06:10:32.233128+0000","last_active":"2024-09-21T06:10:34.538447+0000","last_peered":"2024-09-21T06:10:34.538447+0000","last_clean":"2024-09-21T06:10:34.538447+0000","last_became_active":"2024-09-21T06:10:32.232711+0000","last_became_peered":"2024-09-21T06:10:32.232711+0000","last_unstale":"2024-09-21T06:10:34.538447+0000","last_undegraded":"2024-09-21T06:10:34.538447+0000","last_fullsized":"2024-09-21T06:10:34.538447+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.129003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232251+0000","last_change":"2024-09-21T06:10:33.240793+0000","last_active":"2024-09-21T06:10:34.232251+0000","last_peered":"2024-09-21T06:10:34.232251+0000","last_clean":"2024-09-21T06:10:34.232251+0000","last_became_active":"2024-09-21T06:10:33.240437+0000","last_became_peered":"2024-09-21T06:10:33.240437+0000","last_unstale":"2024-09-21T06:10:34.232251+0000","last_undegraded":"2024-09-21T06:10:34.232251+0000","last_fullsized":"2024-09-21T06:10:34.232251+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:52.786884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.262655+0000","last_change":"2024-09-21T06:10:32.224810+0000","last_active":"2024-09-21T06:10:33.262655+0000","last_peered":"2024-09-21T06:10:33.262655+0000","last_clean":"2024-09-21T06:10:33.262655+0000","last_became_active":"2024-09-21T06:10:32.224220+0000","last_became_peered":"2024-09-21T06:10:32.224220+0000","last_unstale":"2024-09-21T06:10:33.262655+0000","last_undegraded":"2024-09-21T06:10:33.262655+0000","last_fullsized":"2024-09-21T06:10:33.262655+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:28.241357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232287+0000","last_change":"2024-09-21T06:10:33.235201+0000","last_active":"2024-09-21T06:10:34.232287+0000","last_peered":"2024-09-21T06:10:34.232287+0000","last_clean":"2024-09-21T06:10:34.232287+0000","last_became_active":"2024-09-21T06:10:33.234905+0000","last_became_peered":"2024-09-21T06:10:33.234905+0000","last_unstale":"2024-09-21T06:10:34.232287+0000","last_undegraded":"2024-09-21T06:10:34.232287+0000","last_fullsized":"2024-09-21T06:10:34.232287+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:00.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.236675+0000","last_change":"2024-09-21T06:10:32.235701+0000","last_active":"2024-09-21T06:10:33.236675+0000","last_peered":"2024-09-21T06:10:33.236675+0000","last_clean":"2024-09-21T06:10:33.236675+0000","last_became_active":"2024-09-21T06:10:32.235465+0000","last_became_peered":"2024-09-21T06:10:32.235465+0000","last_unstale":"2024-09-21T06:10:33.236675+0000","last_undegraded":"2024-09-21T06:10:33.236675+0000","last_fullsized":"2024-09-21T06:10:33.236675+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:37.808775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232199+0000","last_change":"2024-09-21T06:10:33.250127+0000","last_active":"2024-09-21T06:10:34.232199+0000","last_peered":"2024-09-21T06:10:34.232199+0000","last_clean":"2024-09-21T06:10:34.232199+0000","last_became_active":"2024-09-21T06:10:33.249864+0000","last_became_peered":"2024-09-21T06:10:33.249864+0000","last_unstale":"2024-09-21T06:10:34.232199+0000","last_undegraded":"2024-09-21T06:10:34.232199+0000","last_fullsized":"2024-09-21T06:10:34.232199+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:19.488096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"131'8","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.266060+0000","last_change":"2024-09-21T06:10:32.235822+0000","last_active":"2024-09-21T06:10:33.266060+0000","last_peered":"2024-09-21T06:10:33.266060+0000","last_clean":"2024-09-21T06:10:33.266060+0000","last_became_active":"2024-09-21T06:10:32.235550+0000","last_became_peered":"2024-09-21T06:10:32.235550+0000","last_unstale":"2024-09-21T06:10:33.266060+0000","last_undegraded":"2024-09-21T06:10:33.266060+0000","last_fullsized":"2024-09-21T06:10:33.266060+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:42.635153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.248743+0000","last_change":"2024-09-21T06:10:33.248554+0000","last_active":"2024-09-21T06:10:33.248743+0000","last_peered":"2024-09-21T06:10:33.248743+0000","last_clean":"2024-09-21T06:10:33.248743+0000","last_became_active":"2024-09-21T06:10:33.247931+0000","last_became_peered":"2024-09-21T06:10:33.247931+0000","last_unstale":"2024-09-21T06:10:33.248743+0000","last_undegraded":"2024-09-21T06:10:33.248743+0000","last_fullsized":"2024-09-21T06:10:33.248743+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:55.271253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"131'1","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538591+0000","last_change":"2024-09-21T06:10:32.232965+0000","last_active":"2024-09-21T06:10:34.538591+0000","last_peered":"2024-09-21T06:10:34.538591+0000","last_clean":"2024-09-21T06:10:34.538591+0000","last_became_active":"2024-09-21T06:10:32.232065+0000","last_became_peered":"2024-09-21T06:10:32.232065+0000","last_unstale":"2024-09-21T06:10:34.538591+0000","last_undegraded":"2024-09-21T06:10:34.538591+0000","last_fullsized":"2024-09-21T06:10:34.538591+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:32.441411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.254840+0000","last_change":"2024-09-21T06:10:33.254413+0000","last_active":"2024-09-21T06:10:33.254840+0000","last_peered":"2024-09-21T06:10:33.254840+0000","last_clean":"2024-09-21T06:10:33.254840+0000","last_became_active":"2024-09-21T06:10:33.254170+0000","last_became_peered":"2024-09-21T06:10:33.254170+0000","last_unstale":"2024-09-21T06:10:33.254840+0000","last_undegraded":"2024-09-21T06:10:33.254840+0000","last_fullsized":"2024-09-21T06:10:33.254840+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:59.998832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.263447+0000","last_change":"2024-09-21T06:10:32.225014+0000","last_active":"2024-09-21T06:10:33.263447+0000","last_peered":"2024-09-21T06:10:33.263447+0000","last_clean":"2024-09-21T06:10:33.263447+0000","last_became_active":"2024-09-21T06:10:32.223739+0000","last_became_peered":"2024-09-21T06:10:32.223739+0000","last_unstale":"2024-09-21T06:10:33.263447+0000","last_undegraded":"2024-09-21T06:10:33.263447+0000","last_fullsized":"2024-09-21T06:10:33.263447+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:21.713439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.249523+0000","last_change":"2024-09-21T06:10:33.248896+0000","last_active":"2024-09-21T06:10:33.249523+0000","last_peered":"2024-09-21T06:10:33.249523+0000","last_clean":"2024-09-21T06:10:33.249523+0000","last_became_active":"2024-09-21T06:10:33.248623+0000","last_became_peered":"2024-09-21T06:10:33.248623+0000","last_unstale":"2024-09-21T06:10:33.249523+0000","last_undegraded":"2024-09-21T06:10:33.249523+0000","last_fullsized":"2024-09-21T06:10:33.249523+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:13.350370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"131'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.262774+0000","last_change":"2024-09-21T06:10:32.219279+0000","last_active":"2024-09-21T06:10:33.262774+0000","last_peered":"2024-09-21T06:10:33.262774+0000","last_clean":"2024-09-21T06:10:33.262774+0000","last_became_active":"2024-09-21T06:10:32.218771+0000","last_became_peered":"2024-09-21T06:10:32.218771+0000","last_unstale":"2024-09-21T06:10:33.262774+0000","last_undegraded":"2024-09-21T06:10:33.262774+0000","last_fullsized":"2024-09-21T06:10:33.262774+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:37.535114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.243789+0000","last_change":"2024-09-21T06:10:33.243577+0000","last_active":"2024-09-21T06:10:33.243789+0000","last_peered":"2024-09-21T06:10:33.243789+0000","last_clean":"2024-09-21T06:10:33.243789+0000","last_became_active":"2024-09-21T06:10:33.243033+0000","last_became_peered":"2024-09-21T06:10:33.243033+0000","last_unstale":"2024-09-21T06:10:33.243789+0000","last_undegraded":"2024-09-21T06:10:33.243789+0000","last_fullsized":"2024-09-21T06:10:33.243789+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:01.562354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246730+0000","last_change":"2024-09-21T06:10:32.236954+0000","last_active":"2024-09-21T06:10:33.246730+0000","last_peered":"2024-09-21T06:10:33.246730+0000","last_clean":"2024-09-21T06:10:33.246730+0000","last_became_active":"2024-09-21T06:10:32.236409+0000","last_became_peered":"2024-09-21T06:10:32.236409+0000","last_unstale":"2024-09-21T06:10:33.246730+0000","last_undegraded":"2024-09-21T06:10:33.246730+0000","last_fullsized":"2024-09-21T06:10:33.246730+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:59.353391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244488+0000","last_change":"2024-09-21T06:10:33.244200+0000","last_active":"2024-09-21T06:10:33.244488+0000","last_peered":"2024-09-21T06:10:33.244488+0000","last_clean":"2024-09-21T06:10:33.244488+0000","last_became_active":"2024-09-21T06:10:33.242692+0000","last_became_peered":"2024-09-21T06:10:33.242692+0000","last_unstale":"2024-09-21T06:10:33.244488+0000","last_undegraded":"2024-09-21T06:10:33.244488+0000","last_fullsized":"2024-09-21T06:10:33.244488+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:52.635340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"131'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.264287+0000","last_change":"2024-09-21T06:10:32.228392+0000","last_active":"2024-09-21T06:10:33.264287+0000","last_peered":"2024-09-21T06:10:33.264287+0000","last_clean":"2024-09-21T06:10:33.264287+0000","last_became_active":"2024-09-21T06:10:32.227975+0000","last_became_peered":"2024-09-21T06:10:32.227975+0000","last_unstale":"2024-09-21T06:10:33.264287+0000","last_undegraded":"2024-09-21T06:10:33.264287+0000","last_fullsized":"2024-09-21T06:10:33.264287+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:00.471180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539104+0000","last_change":"2024-09-21T06:10:33.249195+0000","last_active":"2024-09-21T06:10:34.539104+0000","last_peered":"2024-09-21T06:10:34.539104+0000","last_clean":"2024-09-21T06:10:34.539104+0000","last_became_active":"2024-09-21T06:10:33.247729+0000","last_became_peered":"2024-09-21T06:10:33.247729+0000","last_unstale":"2024-09-21T06:10:34.539104+0000","last_undegraded":"2024-09-21T06:10:34.539104+0000","last_fullsized":"2024-09-21T06:10:34.539104+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:54.688917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.233030+0000","last_change":"2024-09-21T06:10:32.224467+0000","last_active":"2024-09-21T06:10:33.233030+0000","last_peered":"2024-09-21T06:10:33.233030+0000","last_clean":"2024-09-21T06:10:33.233030+0000","last_became_active":"2024-09-21T06:10:32.224190+0000","last_became_peered":"2024-09-21T06:10:32.224190+0000","last_unstale":"2024-09-21T06:10:33.233030+0000","last_undegraded":"2024-09-21T06:10:33.233030+0000","last_fullsized":"2024-09-21T06:10:33.233030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:05.427102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.243759+0000","last_change":"2024-09-21T06:10:33.243294+0000","last_active":"2024-09-21T06:10:33.243759+0000","last_peered":"2024-09-21T06:10:33.243759+0000","last_clean":"2024-09-21T06:10:33.243759+0000","last_became_active":"2024-09-21T06:10:33.242174+0000","last_became_peered":"2024-09-21T06:10:33.242174+0000","last_unstale":"2024-09-21T06:10:33.243759+0000","last_undegraded":"2024-09-21T06:10:33.243759+0000","last_fullsized":"2024-09-21T06:10:33.243759+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:16.565461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244462+0000","last_change":"2024-09-21T06:10:32.224512+0000","last_active":"2024-09-21T06:10:33.244462+0000","last_peered":"2024-09-21T06:10:33.244462+0000","last_clean":"2024-09-21T06:10:33.244462+0000","last_became_active":"2024-09-21T06:10:32.223872+0000","last_became_peered":"2024-09-21T06:10:32.223872+0000","last_unstale":"2024-09-21T06:10:33.244462+0000","last_undegraded":"2024-09-21T06:10:33.244462+0000","last_fullsized":"2024-09-21T06:10:33.244462+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:59.387686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232504+0000","last_change":"2024-09-21T06:10:33.241321+0000","last_active":"2024-09-21T06:10:34.232504+0000","last_peered":"2024-09-21T06:10:34.232504+0000","last_clean":"2024-09-21T06:10:34.232504+0000","last_became_active":"2024-09-21T06:10:33.241064+0000","last_became_peered":"2024-09-21T06:10:33.241064+0000","last_unstale":"2024-09-21T06:10:34.232504+0000","last_undegraded":"2024-09-21T06:10:34.232504+0000","last_fullsized":"2024-09-21T06:10:34.232504+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:33.671259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539521+0000","last_change":"2024-09-21T06:10:32.234599+0000","last_active":"2024-09-21T06:10:34.539521+0000","last_peered":"2024-09-21T06:10:34.539521+0000","last_clean":"2024-09-21T06:10:34.539521+0000","last_became_active":"2024-09-21T06:10:32.233968+0000","last_became_peered":"2024-09-21T06:10:32.233968+0000","last_unstale":"2024-09-21T06:10:34.539521+0000","last_undegraded":"2024-09-21T06:10:34.539521+0000","last_fullsized":"2024-09-21T06:10:34.539521+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:30.279941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.252018+0000","last_change":"2024-09-21T06:10:33.251700+0000","last_active":"2024-09-21T06:10:33.252018+0000","last_peered":"2024-09-21T06:10:33.252018+0000","last_clean":"2024-09-21T06:10:33.252018+0000","last_became_active":"2024-09-21T06:10:33.251416+0000","last_became_peered":"2024-09-21T06:10:33.251416+0000","last_unstale":"2024-09-21T06:10:33.252018+0000","last_undegraded":"2024-09-21T06:10:33.252018+0000","last_fullsized":"2024-09-21T06:10:33.252018+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:08.573211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"131'2","reported_seq":17,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232596+0000","last_change":"2024-09-21T06:10:32.236502+0000","last_active":"2024-09-21T06:10:34.232596+0000","last_peered":"2024-09-21T06:10:34.232596+0000","last_clean":"2024-09-21T06:10:34.232596+0000","last_became_active":"2024-09-21T06:10:32.236251+0000","last_became_peered":"2024-09-21T06:10:32.236251+0000","last_unstale":"2024-09-21T06:10:34.232596+0000","last_undegraded":"2024-09-21T06:10:34.232596+0000","last_fullsized":"2024-09-21T06:10:34.232596+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:19.528465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538557+0000","last_change":"2024-09-21T06:10:33.250420+0000","last_active":"2024-09-21T06:10:34.538557+0000","last_peered":"2024-09-21T06:10:34.538557+0000","last_clean":"2024-09-21T06:10:34.538557+0000","last_became_active":"2024-09-21T06:10:33.250183+0000","last_became_peered":"2024-09-21T06:10:33.250183+0000","last_unstale":"2024-09-21T06:10:34.538557+0000","last_undegraded":"2024-09-21T06:10:34.538557+0000","last_fullsized":"2024-09-21T06:10:34.538557+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:41.517289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.239531+0000","last_change":"2024-09-21T06:10:32.224923+0000","last_active":"2024-09-21T06:10:33.239531+0000","last_peered":"2024-09-21T06:10:33.239531+0000","last_clean":"2024-09-21T06:10:33.239531+0000","last_became_active":"2024-09-21T06:10:32.224666+0000","last_became_peered":"2024-09-21T06:10:32.224666+0000","last_unstale":"2024-09-21T06:10:33.239531+0000","last_undegraded":"2024-09-21T06:10:33.239531+0000","last_fullsized":"2024-09-21T06:10:33.239531+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:00.927781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.539006+0000","last_change":"2024-09-21T06:10:33.249837+0000","last_active":"2024-09-21T06:10:34.539006+0000","last_peered":"2024-09-21T06:10:34.539006+0000","last_clean":"2024-09-21T06:10:34.539006+0000","last_became_active":"2024-09-21T06:10:33.248966+0000","last_became_peered":"2024-09-21T06:10:33.248966+0000","last_unstale":"2024-09-21T06:10:34.539006+0000","last_undegraded":"2024-09-21T06:10:34.539006+0000","last_fullsized":"2024-09-21T06:10:34.539006+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:06.660393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538690+0000","last_change":"2024-09-21T06:10:32.235039+0000","last_active":"2024-09-21T06:10:34.538690+0000","last_peered":"2024-09-21T06:10:34.538690+0000","last_clean":"2024-09-21T06:10:34.538690+0000","last_became_active":"2024-09-21T06:10:32.234459+0000","last_became_peered":"2024-09-21T06:10:32.234459+0000","last_unstale":"2024-09-21T06:10:34.538690+0000","last_undegraded":"2024-09-21T06:10:34.538690+0000","last_fullsized":"2024-09-21T06:10:34.538690+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:54.184160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251713+0000","last_change":"2024-09-21T06:10:33.251478+0000","last_active":"2024-09-21T06:10:33.251713+0000","last_peered":"2024-09-21T06:10:33.251713+0000","last_clean":"2024-09-21T06:10:33.251713+0000","last_became_active":"2024-09-21T06:10:33.251020+0000","last_became_peered":"2024-09-21T06:10:33.251020+0000","last_unstale":"2024-09-21T06:10:33.251713+0000","last_undegraded":"2024-09-21T06:10:33.251713+0000","last_fullsized":"2024-09-21T06:10:33.251713+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:38.481749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232664+0000","last_change":"2024-09-21T06:10:32.228324+0000","last_active":"2024-09-21T06:10:34.232664+0000","last_peered":"2024-09-21T06:10:34.232664+0000","last_clean":"2024-09-21T06:10:34.232664+0000","last_became_active":"2024-09-21T06:10:32.223699+0000","last_became_peered":"2024-09-21T06:10:32.223699+0000","last_unstale":"2024-09-21T06:10:34.232664+0000","last_undegraded":"2024-09-21T06:10:34.232664+0000","last_fullsized":"2024-09-21T06:10:34.232664+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:19.502822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.254270+0000","last_change":"2024-09-21T06:10:33.253985+0000","last_active":"2024-09-21T06:10:33.254270+0000","last_peered":"2024-09-21T06:10:33.254270+0000","last_clean":"2024-09-21T06:10:33.254270+0000","last_became_active":"2024-09-21T06:10:33.253210+0000","last_became_peered":"2024-09-21T06:10:33.253210+0000","last_unstale":"2024-09-21T06:10:33.254270+0000","last_undegraded":"2024-09-21T06:10:33.254270+0000","last_fullsized":"2024-09-21T06:10:33.254270+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:11.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.239000+0000","last_change":"2024-09-21T06:10:32.227182+0000","last_active":"2024-09-21T06:10:33.239000+0000","last_peered":"2024-09-21T06:10:33.239000+0000","last_clean":"2024-09-21T06:10:33.239000+0000","last_became_active":"2024-09-21T06:10:32.226846+0000","last_became_peered":"2024-09-21T06:10:32.226846+0000","last_unstale":"2024-09-21T06:10:33.239000+0000","last_undegraded":"2024-09-21T06:10:33.239000+0000","last_fullsized":"2024-09-21T06:10:33.239000+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.803917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.251654+0000","last_change":"2024-09-21T06:10:33.251396+0000","last_active":"2024-09-21T06:10:33.251654+0000","last_peered":"2024-09-21T06:10:33.251654+0000","last_clean":"2024-09-21T06:10:33.251654+0000","last_became_active":"2024-09-21T06:10:33.251121+0000","last_became_peered":"2024-09-21T06:10:33.251121+0000","last_unstale":"2024-09-21T06:10:33.251654+0000","last_undegraded":"2024-09-21T06:10:33.251654+0000","last_fullsized":"2024-09-21T06:10:33.251654+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:08.950108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.244457+0000","last_change":"2024-09-21T06:10:32.224636+0000","last_active":"2024-09-21T06:10:33.244457+0000","last_peered":"2024-09-21T06:10:33.244457+0000","last_clean":"2024-09-21T06:10:33.244457+0000","last_became_active":"2024-09-21T06:10:32.224200+0000","last_became_peered":"2024-09-21T06:10:32.224200+0000","last_unstale":"2024-09-21T06:10:33.244457+0000","last_undegraded":"2024-09-21T06:10:33.244457+0000","last_fullsized":"2024-09-21T06:10:33.244457+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:42.778071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.241025+0000","last_change":"2024-09-21T06:10:33.239530+0000","last_active":"2024-09-21T06:10:33.241025+0000","last_peered":"2024-09-21T06:10:33.241025+0000","last_clean":"2024-09-21T06:10:33.241025+0000","last_became_active":"2024-09-21T06:10:33.238794+0000","last_became_peered":"2024-09-21T06:10:33.238794+0000","last_unstale":"2024-09-21T06:10:33.241025+0000","last_undegraded":"2024-09-21T06:10:33.241025+0000","last_fullsized":"2024-09-21T06:10:33.241025+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:55.179747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.234439+0000","last_change":"2024-09-21T06:10:32.223663+0000","last_active":"2024-09-21T06:10:33.234439+0000","last_peered":"2024-09-21T06:10:33.234439+0000","last_clean":"2024-09-21T06:10:33.234439+0000","last_became_active":"2024-09-21T06:10:32.223390+0000","last_became_peered":"2024-09-21T06:10:32.223390+0000","last_unstale":"2024-09-21T06:10:33.234439+0000","last_undegraded":"2024-09-21T06:10:33.234439+0000","last_fullsized":"2024-09-21T06:10:33.234439+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:12.651168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538825+0000","last_change":"2024-09-21T06:10:33.251398+0000","last_active":"2024-09-21T06:10:34.538825+0000","last_peered":"2024-09-21T06:10:34.538825+0000","last_clean":"2024-09-21T06:10:34.538825+0000","last_became_active":"2024-09-21T06:10:33.251125+0000","last_became_peered":"2024-09-21T06:10:33.251125+0000","last_unstale":"2024-09-21T06:10:34.538825+0000","last_undegraded":"2024-09-21T06:10:34.538825+0000","last_fullsized":"2024-09-21T06:10:34.538825+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:56.522412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.538783+0000","last_change":"2024-09-21T06:10:32.234743+0000","last_active":"2024-09-21T06:10:34.538783+0000","last_peered":"2024-09-21T06:10:34.538783+0000","last_clean":"2024-09-21T06:10:34.538783+0000","last_became_active":"2024-09-21T06:10:32.234172+0000","last_became_peered":"2024-09-21T06:10:32.234172+0000","last_unstale":"2024-09-21T06:10:34.538783+0000","last_undegraded":"2024-09-21T06:10:34.538783+0000","last_fullsized":"2024-09-21T06:10:34.538783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:32.111729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-21T06:10:34.232246+0000","last_change":"2024-09-21T06:10:33.235276+0000","last_active":"2024-09-21T06:10:34.232246+0000","last_peered":"2024-09-21T06:10:34.232246+0000","last_clean":"2024-09-21T06:10:34.232246+0000","last_became_active":"2024-09-21T06:10:33.235030+0000","last_became_peered":"2024-09-21T06:10:33.235030+0000","last_unstale":"2024-09-21T06:10:34.232246+0000","last_undegraded":"2024-09-21T06:10:34.232246+0000","last_fullsized":"2024-09-21T06:10:34.232246+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:32.207870+0000","last_clean_scrub_stamp":"2024-09-21T06:10:32.207870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:40.995391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.246485+0000","last_change":"2024-09-21T06:10:32.237229+0000","last_active":"2024-09-21T06:10:33.246485+0000","last_peered":"2024-09-21T06:10:33.246485+0000","last_clean":"2024-09-21T06:10:33.246485+0000","last_became_active":"2024-09-21T06:10:32.236693+0000","last_became_peered":"2024-09-21T06:10:32.236693+0000","last_unstale":"2024-09-21T06:10:33.246485+0000","last_undegraded":"2024-09-21T06:10:33.246485+0000","last_fullsized":"2024-09-21T06:10:33.246485+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:31.201370+0000","last_clean_scrub_stamp":"2024-09-21T06:10:31.201370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:08:34.380761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":339,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-21T06:10:33.233382+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:10:33.233382+0000","last_peered":"2024-09-21T06:10:33.233382+0000","last_clean":"2024-09-21T06:10:33.233382+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:10:33.233382+0000","last_undegraded":"2024-09-21T06:10:33.233382+0000","last_fullsized":"2024-09-21T06:10:33.233382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194595,"statfs":{"total":200000000,"available":199265821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1287,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194025,"statfs":{"total":200000000,"available":198681711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1286,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194026,"statfs":{"total":200000000,"available":198682819,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574932,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273733,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574932,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199273199,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194603,"statfs":{"total":200000000,"available":199273679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:10:38.153 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:10:38.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 -- 172.21.15.118:0/4115953866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 msgr2=0x7fae3c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 --2- 172.21.15.118:0/4115953866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c0d0e80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0cedb0 tx=0x7fae2c02a4a0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 -- 172.21.15.118:0/4115953866 shutdown_connections 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 --2- 172.21.15.118:0/4115953866 >> v2:172.21.15.149:3300/0 conn(0x7fae3c13fef0 0x7fae3c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 --2- 172.21.15.118:0/4115953866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c0d0e80 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 -- 172.21.15.118:0/4115953866 >> 172.21.15.118:0/4115953866 conn(0x7fae3c06d110 msgr2=0x7fae3c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 -- 172.21.15.118:0/4115953866 shutdown_connections 2024-09-21T06:10:38.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.416+0000 7fae42000640 1 -- 172.21.15.118:0/4115953866 wait complete. 2024-09-21T06:10:38.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.418+0000 7fae42000640 1 Processor -- start 2024-09-21T06:10:38.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.418+0000 7fae42000640 1 -- start start 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae42000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae42000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae3c13fef0 0x7fae3c158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae42000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c142730 0x7fae3c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae42000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c0cfa70 con 0x7fae3c13fae0 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae42000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c0cf8f0 con 0x7fae3c142730 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae42000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fae3c0cfbf0 con 0x7fae3c13fef0 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae3b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae3b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c141c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40140/0 (socket says 172.21.15.118:40140) 2024-09-21T06:10:38.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae3b400640 1 -- 172.21.15.118:0/1604522639 learned_addr learned my addr 172.21.15.118:0/1604522639 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae3be00640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c142730 0x7fae3c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.420+0000 7fae32a00640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae3c13fef0 0x7fae3c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae3b400640 1 -- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae3c13fef0 msgr2=0x7fae3c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae3b400640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae3c13fef0 0x7fae3c158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae3b400640 1 -- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c142730 msgr2=0x7fae3c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae3b400640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c142730 0x7fae3c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae3b400640 1 -- 172.21.15.118:0/1604522639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c157c60 con 0x7fae3c13fae0 2024-09-21T06:10:38.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae32a00640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae3c13fef0 0x7fae3c158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:38.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae3b400640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c141c20 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009920 tx=0x7fae2c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:38.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae33e00640 1 -- 172.21.15.118:0/1604522639 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c031d60 con 0x7fae3c13fae0 2024-09-21T06:10:38.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae33e00640 1 -- 172.21.15.118:0/1604522639 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae2c033e10 con 0x7fae3c13fae0 2024-09-21T06:10:38.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3c157f40 con 0x7fae3c13fae0 2024-09-21T06:10:38.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae33e00640 1 -- 172.21.15.118:0/1604522639 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c005260 con 0x7fae3c13fae0 2024-09-21T06:10:38.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.421+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3c13d650 con 0x7fae3c13fae0 2024-09-21T06:10:38.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.422+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae3c13d160 con 0x7fae3c13fae0 2024-09-21T06:10:38.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.423+0000 7fae33e00640 1 -- 172.21.15.118:0/1604522639 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae2c005400 con 0x7fae3c13fae0 2024-09-21T06:10:38.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.424+0000 7fae33e00640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fae18078bc0 0x7fae1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.424+0000 7fae33e00640 1 -- 172.21.15.118:0/1604522639 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7fae2c0bbfd0 con 0x7fae3c13fae0 2024-09-21T06:10:38.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.425+0000 7fae32a00640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fae18078bc0 0x7fae1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.425+0000 7fae32a00640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fae18078bc0 0x7fae1807b0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fae24005d00 tx=0x7fae24005dd0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:38.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.429+0000 7fae33e00640 1 -- 172.21.15.118:0/1604522639 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fae2c03f030 con 0x7fae3c13fae0 2024-09-21T06:10:38.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.681+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fae3c0d0110 con 0x7fae3c13fae0 2024-09-21T06:10:38.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.685+0000 7fae33e00640 1 -- 172.21.15.118:0/1604522639 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fae2c084400 con 0x7fae3c13fae0 2024-09-21T06:10:38.686 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:10:38.687 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:10:38.687 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:10:38.687 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:10:38.687 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:10:38.687 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fae18078bc0 msgr2=0x7fae1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fae18078bc0 0x7fae1807b0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fae24005d00 tx=0x7fae24005dd0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 msgr2=0x7fae3c141c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c141c20 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009920 tx=0x7fae2c033c20 comp rx=0 tx=0).stop 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 shutdown_connections 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae3c142730 0x7fae3c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fae18078bc0 0x7fae1807b0d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae3c13fef0 0x7fae3c158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 --2- 172.21.15.118:0/1604522639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae3c13fae0 0x7fae3c141c20 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.687+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 >> 172.21.15.118:0/1604522639 conn(0x7fae3c06d110 msgr2=0x7fae3c15f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:38.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.688+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 shutdown_connections 2024-09-21T06:10:38.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.688+0000 7fae42000640 1 -- 172.21.15.118:0/1604522639 wait complete. 2024-09-21T06:10:38.711 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:38.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 -- 172.21.15.118:0/1132371581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a74144ea0 msgr2=0x7f2a74144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 --2- 172.21.15.118:0/1132371581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a74144ea0 0x7f2a74144760 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2a740afd60 tx=0x7f2a6402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 -- 172.21.15.118:0/1132371581 shutdown_connections 2024-09-21T06:10:38.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 --2- 172.21.15.118:0/1132371581 >> v2:172.21.15.149:3300/0 conn(0x7f2a740cedb0 0x7f2a740cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 --2- 172.21.15.118:0/1132371581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a74144ea0 0x7f2a74144760 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 -- 172.21.15.118:0/1132371581 >> 172.21.15.118:0/1132371581 conn(0x7f2a7406d6e0 msgr2=0x7f2a740b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:38.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 -- 172.21.15.118:0/1132371581 shutdown_connections 2024-09-21T06:10:38.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.929+0000 7f2a79800640 1 -- 172.21.15.118:0/1132371581 wait complete. 2024-09-21T06:10:38.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.931+0000 7f2a79800640 1 Processor -- start 2024-09-21T06:10:38.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.932+0000 7f2a79800640 1 -- start start 2024-09-21T06:10:38.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a79800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a740cedb0 0x7f2a741f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a79800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a740cf700 0x7f2a740c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a79800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a74144ea0 0x7f2a740c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a79800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7415fe40 con 0x7f2a740cf700 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a79800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a740b53a0 con 0x7f2a74144ea0 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a79800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7415ffc0 con 0x7f2a740cedb0 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a740cf700 0x7f2a740c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.933+0000 7f2a73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a740cf700 0x7f2a740c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40148/0 (socket says 172.21.15.118:40148) 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73400640 1 -- 172.21.15.118:0/1300834014 learned_addr learned my addr 172.21.15.118:0/1300834014 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73e00640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a740cedb0 0x7f2a741f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a78e00640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a74144ea0 0x7f2a740c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73400640 1 -- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a740cedb0 msgr2=0x7f2a741f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73400640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a740cedb0 0x7f2a741f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73400640 1 -- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a74144ea0 msgr2=0x7f2a740c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73400640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a74144ea0 0x7f2a740c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73400640 1 -- 172.21.15.118:0/1300834014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a741f9fa0 con 0x7f2a740cf700 2024-09-21T06:10:38.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a73400640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a740cf700 0x7f2a740c6b50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000e7c0 tx=0x7f2a6000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a6be00640 1 -- 172.21.15.118:0/1300834014 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000ccc0 con 0x7f2a740cf700 2024-09-21T06:10:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a6be00640 1 -- 172.21.15.118:0/1300834014 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a60010430 con 0x7f2a740cf700 2024-09-21T06:10:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.934+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a741fa280 con 0x7f2a740cf700 2024-09-21T06:10:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.935+0000 7f2a6be00640 1 -- 172.21.15.118:0/1300834014 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60010860 con 0x7f2a740cf700 2024-09-21T06:10:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.935+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a741f6160 con 0x7f2a740cf700 2024-09-21T06:10:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.936+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a741f9d10 con 0x7f2a740cf700 2024-09-21T06:10:38.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.937+0000 7f2a6be00640 1 -- 172.21.15.118:0/1300834014 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a60010a00 con 0x7f2a740cf700 2024-09-21T06:10:38.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.938+0000 7f2a6be00640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a54078bc0 0x7f2a5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.938+0000 7f2a6be00640 1 -- 172.21.15.118:0/1300834014 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f2a6009b7a0 con 0x7f2a740cf700 2024-09-21T06:10:38.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.938+0000 7f2a73e00640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a54078bc0 0x7f2a5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.939+0000 7f2a73e00640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a54078bc0 0x7f2a5407b0d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2a64034000 tx=0x7f2a64004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:38.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:38.942+0000 7f2a6be00640 1 -- 172.21.15.118:0/1300834014 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2a60063b40 con 0x7f2a740cf700 2024-09-21T06:10:39.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.164+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a74160470 con 0x7f2a740cf700 2024-09-21T06:10:39.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.165+0000 7f2a6be00640 1 -- 172.21.15.118:0/1300834014 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f2a60063440 con 0x7f2a740cf700 2024-09-21T06:10:39.166 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:39.167 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:10:39.167 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a54078bc0 msgr2=0x7f2a5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a54078bc0 0x7f2a5407b0d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2a64034000 tx=0x7f2a64004730 comp rx=0 tx=0).stop 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a740cf700 msgr2=0x7f2a740c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a740cf700 0x7f2a740c6b50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000e7c0 tx=0x7f2a6000ec80 comp rx=0 tx=0).stop 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 shutdown_connections 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a74144ea0 0x7f2a740c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a740cf700 0x7f2a740c6b50 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a54078bc0 0x7f2a5407b0d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 --2- 172.21.15.118:0/1300834014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a740cedb0 0x7f2a741f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 >> 172.21.15.118:0/1300834014 conn(0x7f2a7406d6e0 msgr2=0x7f2a74073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:39.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 shutdown_connections 2024-09-21T06:10:39.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.167+0000 7f2a79800640 1 -- 172.21.15.118:0/1300834014 wait complete. 2024-09-21T06:10:39.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:10:32.715815+0000', 'modified': '2024-09-21T06:10:35.747985+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6963}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6963': {'gid': 6963, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/2073034687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 2073034687}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 2073034687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6963, 'qdb_cluster': [6963]} 2024-09-21T06:10:39.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:10:39.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:10:39.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.816+0000 7f5fada00640 1 -- 172.21.15.118:0/1848980056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 msgr2=0x7f5f8c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.816+0000 7f5fada00640 1 --2- 172.21.15.118:0/1848980056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 0x7f5f8c005220 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0005fd0 tx=0x7f5f8c005830 comp rx=0 tx=0).stop 2024-09-21T06:10:39.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.816+0000 7f5fa7400640 1 -- 172.21.15.118:0/1848980056 reap_dead start 2024-09-21T06:10:39.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.816+0000 7f5fada00640 1 -- 172.21.15.118:0/1848980056 shutdown_connections 2024-09-21T06:10:39.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.816+0000 7f5fada00640 1 -- 172.21.15.118:0/1848980056 >> 172.21.15.118:0/1848980056 conn(0x7f5fa806d110 msgr2=0x7f5fa806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:39.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.816+0000 7f5fada00640 1 -- 172.21.15.118:0/1848980056 shutdown_connections 2024-09-21T06:10:39.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.816+0000 7f5fada00640 1 -- 172.21.15.118:0/1848980056 wait complete. 2024-09-21T06:10:39.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.818+0000 7f5fada00640 1 Processor -- start 2024-09-21T06:10:39.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.818+0000 7f5fada00640 1 -- start start 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fada00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 0x7f5fa80cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fada00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa8154480 0x7f5fa81f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fada00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8154890 0x7f5fa81f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fada00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8165d00 con 0x7f5f8c004d90 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fada00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8165b80 con 0x7f5fa8154480 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fada00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa8165e80 con 0x7f5fa8154890 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 0x7f5fa80cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 0x7f5fa80cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40164/0 (socket says 172.21.15.118:40164) 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3548314950 learned_addr learned my addr 172.21.15.118:0/3548314950 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:39.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6000640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa8154480 0x7f5fa81f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa7400640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8154890 0x7f5fa81f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8154890 msgr2=0x7f5fa81f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8154890 0x7f5fa81f9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa8154480 msgr2=0x7f5fa81f8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.820+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa8154480 0x7f5fa81f8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.821+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3548314950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa81552b0 con 0x7f5f8c004d90 2024-09-21T06:10:39.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.821+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 0x7f5fa80cd3d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5f98006630 tx=0x7f5f980039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:39.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.821+0000 7f5f9ea00640 1 -- 172.21.15.118:0/3548314950 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98015070 con 0x7f5f8c004d90 2024-09-21T06:10:39.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.821+0000 7f5f9ea00640 1 -- 172.21.15.118:0/3548314950 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f98011920 con 0x7f5f8c004d90 2024-09-21T06:10:39.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.821+0000 7f5f9ea00640 1 -- 172.21.15.118:0/3548314950 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98011d70 con 0x7f5f8c004d90 2024-09-21T06:10:39.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.821+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa8154fd0 con 0x7f5f8c004d90 2024-09-21T06:10:39.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.821+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa813d570 con 0x7f5f8c004d90 2024-09-21T06:10:39.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.823+0000 7f5f9ea00640 1 -- 172.21.15.118:0/3548314950 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f98018070 con 0x7f5f8c004d90 2024-09-21T06:10:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.824+0000 7f5f9ea00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5f88078b90 0x7f5f8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.825+0000 7f5f9ea00640 1 -- 172.21.15.118:0/3548314950 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f5f9809bbc0 con 0x7f5f8c004d90 2024-09-21T06:10:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.825+0000 7f5fb4a26740 1 Processor -- start 2024-09-21T06:10:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.825+0000 7f5fa6000640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5f88078b90 0x7f5f8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.825+0000 7f5fb4a26740 1 -- start start 2024-09-21T06:10:39.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.826+0000 7f5fa6000640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5f88078b90 0x7f5f8807b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5fa81555e0 tx=0x7f5f94006b10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:39.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.826+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39875270 0x55ba39c45970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.826+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39c45eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.826+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c15f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.826+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ba39b9f430 con 0x55ba39854590 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.826+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ba39b8f5d0 con 0x55ba3984c3b0 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.826+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ba39b7ea00 con 0x55ba39875270 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c15f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c15f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40174/0 (socket says 172.21.15.118:40174) 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 -- 172.21.15.118:0/1318370718 learned_addr learned my addr 172.21.15.118:0/1318370718 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39875270 0x55ba39c45970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa6000640 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39c45eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 -- 172.21.15.118:0/1318370718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39875270 msgr2=0x55ba39c45970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39875270 0x55ba39c45970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 -- 172.21.15.118:0/1318370718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 msgr2=0x55ba39c45eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39c45eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 -- 172.21.15.118:0/1318370718 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba39b47520 con 0x55ba39854590 2024-09-21T06:10:39.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.827+0000 7f5fa7400640 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c15f60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5fa002e020 tx=0x7f5fa0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbdc76cc9ebe280 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:39.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5f93400640 1 -- 172.21.15.118:0/1318370718 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0038040 con 0x55ba39854590 2024-09-21T06:10:39.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5f93400640 1 -- 172.21.15.118:0/1318370718 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fa0043070 con 0x55ba39854590 2024-09-21T06:10:39.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5f93400640 1 -- 172.21.15.118:0/1318370718 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0003bd0 con 0x55ba39854590 2024-09-21T06:10:39.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5fb4a26740 1 -- 172.21.15.118:0/1318370718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 msgr2=0x55ba39c15f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c15f60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5fa002e020 tx=0x7f5fa0004ab0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5fb4a26740 1 -- 172.21.15.118:0/1318370718 shutdown_connections 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c15f60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.828+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39c45eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.829+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/1318370718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39875270 0x55ba39c45970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.829+0000 7f5fb4a26740 1 -- 172.21.15.118:0/1318370718 >> 172.21.15.118:0/1318370718 conn(0x55ba398693c0 msgr2=0x55ba39c1b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.829+0000 7f5fb4a26740 1 -- 172.21.15.118:0/1318370718 shutdown_connections 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.829+0000 7f5fb4a26740 1 -- 172.21.15.118:0/1318370718 wait complete. 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.830+0000 7f5fb4a26740 1 -- start start 2024-09-21T06:10:39.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.830+0000 7f5fb4a26740 1 Processor -- start 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba3984c3b0 0x55ba39c61060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39854590 0x55ba39c3bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c73200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ba39b25330 con 0x55ba3984c3b0 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ba39b82810 con 0x55ba39875270 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ba398ef620 con 0x55ba39854590 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fb4a26740 10 client.0 _ll_register_callbacks cb 0x55ba39b2a420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.831+0000 7f5fa6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba3984c3b0 0x55ba39c61060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba3984c3b0 0x55ba39c61060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40186/0 (socket says 172.21.15.118:40186) 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3464439507 learned_addr learned my addr 172.21.15.118:0/3464439507 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6000640 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39854590 0x55ba39c3bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa7400640 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c73200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39854590 msgr2=0x55ba39c3bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39854590 0x55ba39c3bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 msgr2=0x55ba39c73200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c73200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 -- 172.21.15.118:0/3464439507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba398e0850 con 0x55ba3984c3b0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba3984c3b0 0x55ba39c61060 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5f98003ec0 tx=0x7f5f98063de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963ed8bb9714fe5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5f87e00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5f87e00640 1 -- 172.21.15.118:0/3464439507 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9801f040 con 0x55ba3984c3b0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5f87e00640 1 -- 172.21.15.118:0/3464439507 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f5f9806d000 con 0x55ba3984c3b0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.832+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fa0043070 con 0x55ba3984c3b0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5f87e00640 1 -- 172.21.15.118:0/3464439507 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f5f98064000 con 0x55ba3984c3b0 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 10 client.7092 fetch_fsmap learned FSMap version 68 2024-09-21T06:10:39.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55ba399576b0 con 0x55ba3984c3b0 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5f87e00640 1 -- 172.21.15.118:0/3464439507 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fa0043070 con 0x55ba3984c3b0 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5f87e00640 1 -- 172.21.15.118:0/3464439507 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f5f9804e020 con 0x55ba3984c3b0 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 10 client.7092 fetch_fsmap finished waiting for FSMap version 68 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 10 client.7092 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 20 client.7092 populate_metadata read hostname 'smithi118' 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39833e40 0x55ba39c6fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 4 client.7092 mds_command: new command op to 6963 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 --> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba39b91520 con 0x55ba39833e40 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.833+0000 7f5fa6000640 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39833e40 0x55ba39c6fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.834+0000 7f5fa6000640 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39833e40 0x55ba39c6fe20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dee2e36587f6629a server_cookie=e704d024bdea9727 in_seq=0 out_seq=0 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.834+0000 7f5f87e00640 10 client.7092 ms_handle_connect on v2:172.21.15.118:6833/2073034687 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5f87e00640 1 -- 172.21.15.118:0/3464439507 <== mds.0 v2:172.21.15.118:6833/2073034687 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba39b91520 con 0x55ba39833e40 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5f87e00640 10 client.7092 handle_command_reply: tid=0 2024-09-21T06:10:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 client.7092 shutdown 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba3984c3b0 msgr2=0x55ba39c61060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba3984c3b0 0x55ba39c61060 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5f98003ec0 tx=0x7f5f98063de0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 shutdown_connections 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39833e40 0x55ba39c6fe20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c73200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39854590 0x55ba39c3bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/3464439507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba3984c3b0 0x55ba39c61060 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5f87e00640 0 client.7092 ms_handle_reset on v2:172.21.15.118:6833/2073034687 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 >> 172.21.15.118:0/3464439507 conn(0x55ba398693c0 msgr2=0x55ba39c63d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 shutdown_connections 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 1 -- 172.21.15.118:0/3464439507 wait complete. 2024-09-21T06:10:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.835+0000 7f5fb4a26740 20 client.7092 trim_cache size 0 max 16384 2024-09-21T06:10:39.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.854+0000 7f5fb4a26740 1 Processor -- start 2024-09-21T06:10:39.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.854+0000 7f5fb4a26740 1 -- start start 2024-09-21T06:10:39.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.855+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba3984c3b0 0x55ba39c17590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c63160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c61820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8202860 con 0x55ba39854590 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa82018a0 con 0x55ba39875270 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa813e750 con 0x55ba3984c3b0 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c63160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c63160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40194/0 (socket says 172.21.15.118:40194) 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 -- 172.21.15.118:0/2959887760 learned_addr learned my addr 172.21.15.118:0/2959887760 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa7400640 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c61820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba3984c3b0 0x55ba39c17590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 -- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba3984c3b0 msgr2=0x55ba39c17590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba3984c3b0 0x55ba39c17590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 -- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 msgr2=0x55ba39c61820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c61820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 -- 172.21.15.118:0/2959887760 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba39c5bac0 con 0x55ba39854590 2024-09-21T06:10:39.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa7400640 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c61820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:39.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.856+0000 7f5fa6000640 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c63160 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5fa813f2a0 tx=0x7f5f94014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103a5af08d67ad51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:39.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.857+0000 7f5f92a00640 1 -- 172.21.15.118:0/2959887760 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94012640 con 0x55ba39854590 2024-09-21T06:10:39.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.857+0000 7f5f92a00640 1 -- 172.21.15.118:0/2959887760 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f94016070 con 0x55ba39854590 2024-09-21T06:10:39.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.857+0000 7f5f92a00640 1 -- 172.21.15.118:0/2959887760 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94012a20 con 0x55ba39854590 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.857+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2959887760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 msgr2=0x55ba39c63160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c63160 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5fa813f2a0 tx=0x7f5f94014000 comp rx=0 tx=0).stop 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2959887760 shutdown_connections 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba39875270 0x55ba39c61820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39854590 0x55ba39c63160 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2959887760 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba3984c3b0 0x55ba39c17590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2959887760 >> 172.21.15.118:0/2959887760 conn(0x55ba398693c0 msgr2=0x55ba39c5a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2959887760 shutdown_connections 2024-09-21T06:10:39.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.858+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2959887760 wait complete. 2024-09-21T06:10:39.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.859+0000 7f5fb4a26740 1 -- start start 2024-09-21T06:10:39.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.859+0000 7f5fb4a26740 1 Processor -- start 2024-09-21T06:10:39.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.860+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39ce3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.860+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39875270 0x55ba39cd7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.860+0000 7f5fb4a26740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39c79d60 0x55ba39c3d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.860+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ba39c73740 con 0x55ba39875270 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.860+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa82012a0 con 0x55ba3984c3b0 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.860+0000 7f5fb4a26740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ba39c3fc80 con 0x55ba39c79d60 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.860+0000 7f5fb4a26740 10 client.0 _ll_register_callbacks cb 0x7f5f98063340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39875270 0x55ba39cd7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39875270 0x55ba39cd7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40206/0 (socket says 172.21.15.118:40206) 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 -- 172.21.15.118:0/2623914396 learned_addr learned my addr 172.21.15.118:0/2623914396 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39ce3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa7400640 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39c79d60 0x55ba39c3d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 -- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39c79d60 msgr2=0x55ba39c3d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39c79d60 0x55ba39c3d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 -- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 msgr2=0x55ba39ce3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39ce3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 -- 172.21.15.118:0/2623914396 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba39c3b700 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5fa6000640 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39875270 0x55ba39cd7100 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006fd0 tx=0x7f5f94012440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03be89ef95e1175 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.861+0000 7f5f87e00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5f87e00640 1 -- 172.21.15.118:0/2623914396 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94012a40 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5f87e00640 1 -- 172.21.15.118:0/2623914396 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f5f94012be0 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f94016070 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5f87e00640 1 -- 172.21.15.118:0/2623914396 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f5f94044050 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 10 client.7098 fetch_fsmap learned FSMap version 68 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55ba39c618b0 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5f87e00640 1 -- 172.21.15.118:0/2623914396 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f94016070 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5f87e00640 1 -- 172.21.15.118:0/2623914396 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f5f9403e430 con 0x55ba39875270 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 10 client.7098 fetch_fsmap finished waiting for FSMap version 68 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 10 client.7098 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 20 client.7098 populate_metadata read hostname 'smithi118' 2024-09-21T06:10:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39c68d40 0x55ba39c69150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 4 client.7098 mds_command: new command op to 6963 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.862+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 --> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] -- command(tid 0: {"prefix": "status"}) -- 0x55ba39b8cfd0 con 0x55ba39c68d40 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39c68d40 0x55ba39c69150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5fa6a00640 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39c68d40 0x55ba39c69150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f0bc6603feb7d5d server_cookie=4b85c8904a4efdb0 in_seq=0 out_seq=0 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5f87e00640 10 client.7098 ms_handle_connect on v2:172.21.15.118:6833/2073034687 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5f87e00640 1 -- 172.21.15.118:0/2623914396 <== mds.0 v2:172.21.15.118:6833/2073034687 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ba39b8cfd0 con 0x55ba39c68d40 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5f87e00640 10 client.7098 handle_command_reply: tid=0 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5fb4a26740 1 client.7098 shutdown 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39875270 msgr2=0x55ba39cd7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.863+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39875270 0x55ba39cd7100 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006fd0 tx=0x7f5f94012440 comp rx=0 tx=0).stop 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 shutdown_connections 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:6833/2073034687,v1:172.21.15.118:6835/2073034687] conn(0x55ba39c68d40 0x55ba39c69150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba39c79d60 0x55ba39c3d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ba39875270 0x55ba39cd7100 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 --2- 172.21.15.118:0/2623914396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba3984c3b0 0x55ba39ce3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5f87e00640 0 client.7098 ms_handle_reset on v2:172.21.15.118:6833/2073034687 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 >> 172.21.15.118:0/2623914396 conn(0x55ba398693c0 msgr2=0x55ba39c1b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 shutdown_connections 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 1 -- 172.21.15.118:0/2623914396 wait complete. 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fb4a26740 20 client.7098 trim_cache size 0 max 16384 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:10:39.870 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 6963, 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 6.6346770980000001, 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 68, 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 132, 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 132, 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.651461499 2024-09-21T06:10:39.871 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5f88078b90 msgr2=0x7f5f8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fada00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5f88078b90 0x7f5f8807b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5fa81555e0 tx=0x7f5f94006b10 comp rx=0 tx=0).stop 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 msgr2=0x7f5fa80cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fada00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 0x7f5fa80cd3d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5f98006630 tx=0x7f5f980039c0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 shutdown_connections 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fada00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5f88078b90 0x7f5f8807b0a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.864+0000 7f5fada00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fa8154890 0x7f5fa81f9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.865+0000 7f5fada00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fa8154480 0x7f5fa81f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.865+0000 7f5fada00640 1 --2- 172.21.15.118:0/3548314950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f8c004d90 0x7f5fa80cd3d0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.865+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 >> 172.21.15.118:0/3548314950 conn(0x7f5fa806d110 msgr2=0x7f5fa8157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.865+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 shutdown_connections 2024-09-21T06:10:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:39.865+0000 7f5fada00640 1 -- 172.21.15.118:0/3548314950 wait complete. 2024-09-21T06:10:39.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:10:40.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 -- 172.21.15.118:0/2828606173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71640d1590 msgr2=0x7f7164142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:40.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 --2- 172.21.15.118:0/2828606173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71640d1590 0x7f7164142730 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f716415d420 tx=0x7f715002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 -- 172.21.15.118:0/2828606173 shutdown_connections 2024-09-21T06:10:40.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 --2- 172.21.15.118:0/2828606173 >> v2:172.21.15.149:3300/0 conn(0x7f716413fef0 0x7f7164142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 --2- 172.21.15.118:0/2828606173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71640d1590 0x7f7164142730 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 -- 172.21.15.118:0/2828606173 >> 172.21.15.118:0/2828606173 conn(0x7f716406d110 msgr2=0x7f716406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:40.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 -- 172.21.15.118:0/2828606173 shutdown_connections 2024-09-21T06:10:40.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.108+0000 7f716a000640 1 -- 172.21.15.118:0/2828606173 wait complete. 2024-09-21T06:10:40.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.110+0000 7f716a000640 1 Processor -- start 2024-09-21T06:10:40.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.110+0000 7f716a000640 1 -- start start 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f716a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f716413fae0 0x7f7164153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f716a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f716413fef0 0x7f716413a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f716a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f716413ad30 0x7f71641f9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f716a000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f71640cfa70 con 0x7f716413fae0 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f716a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71640cf8f0 con 0x7f716413fef0 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f716a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71640cfbf0 con 0x7f716413ad30 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f7163400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f716413fae0 0x7f7164153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f7163400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f716413fae0 0x7f7164153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40226/0 (socket says 172.21.15.118:40226) 2024-09-21T06:10:40.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f7163400640 1 -- 172.21.15.118:0/860853938 learned_addr learned my addr 172.21.15.118:0/860853938 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:40.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f7162a00640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f716413fef0 0x7f716413a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:40.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.112+0000 7f7163e00640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f716413ad30 0x7f71641f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:40.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f7163400640 1 -- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f716413ad30 msgr2=0x7f71641f9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:40.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f7163400640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f716413ad30 0x7f71641f9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f7163400640 1 -- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f716413fef0 msgr2=0x7f716413a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:40.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f7163400640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f716413fef0 0x7f716413a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f7163400640 1 -- 172.21.15.118:0/860853938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71640738c0 con 0x7f716413fae0 2024-09-21T06:10:40.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f7163e00640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f716413ad30 0x7f71641f9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:40.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f7163400640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f716413fae0 0x7f7164153170 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f715400b3f0 tx=0x7f715400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:40.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f715b400640 1 -- 172.21.15.118:0/860853938 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154015020 con 0x7f716413fae0 2024-09-21T06:10:40.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f715b400640 1 -- 172.21.15.118:0/860853938 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7154011920 con 0x7f716413fae0 2024-09-21T06:10:40.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7164073cb0 con 0x7f716413fae0 2024-09-21T06:10:40.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f715b400640 1 -- 172.21.15.118:0/860853938 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154011d70 con 0x7f716413fae0 2024-09-21T06:10:40.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.113+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7164074270 con 0x7f716413fae0 2024-09-21T06:10:40.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.115+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71640d0130 con 0x7f716413fae0 2024-09-21T06:10:40.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.116+0000 7f715b400640 1 -- 172.21.15.118:0/860853938 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7154018020 con 0x7f716413fae0 2024-09-21T06:10:40.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.116+0000 7f715b400640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7144078b90 0x7f714407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:40.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.117+0000 7f715b400640 1 -- 172.21.15.118:0/860853938 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f715409a960 con 0x7f716413fae0 2024-09-21T06:10:40.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.117+0000 7f7162a00640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7144078b90 0x7f714407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:40.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.118+0000 7f7162a00640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7144078b90 0x7f714407b0a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7150033000 tx=0x7f7150004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:40.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.121+0000 7f715b400640 1 -- 172.21.15.118:0/860853938 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f715401f030 con 0x7f716413fae0 2024-09-21T06:10:40.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.347+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7164161260 con 0x7f716413fae0 2024-09-21T06:10:40.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.348+0000 7f715b400640 1 -- 172.21.15.118:0/860853938 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f7154062d90 con 0x7f716413fae0 2024-09-21T06:10:40.349 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:10:40.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7144078b90 msgr2=0x7f714407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:40.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7144078b90 0x7f714407b0a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7150033000 tx=0x7f7150004730 comp rx=0 tx=0).stop 2024-09-21T06:10:40.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f716413fae0 msgr2=0x7f7164153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:40.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f716413fae0 0x7f7164153170 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f715400b3f0 tx=0x7f715400b8b0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 shutdown_connections 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7144078b90 0x7f714407b0a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f716413ad30 0x7f71641f9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f716413fef0 0x7f716413a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 --2- 172.21.15.118:0/860853938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f716413fae0 0x7f7164153170 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 >> 172.21.15.118:0/860853938 conn(0x7f716406d110 msgr2=0x7f7164153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 shutdown_connections 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40.350+0000 7f716a000640 1 -- 172.21.15.118:0/860853938 wait complete. 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:10:40.373 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:10:40.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.373 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:10:40.409 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:10:40.410 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:10:40.410 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:10:40.410 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:40.410 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:10:40.410 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:40.410 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:40.411 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:40.411 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:10:40.411 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:40.411 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:40.411 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:10:40.411 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:40.412 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:40.412 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:10:40.412 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:40.412 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:10:40.412 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42344sec preferred_lft 42344sec 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:10:40.413 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:40.414 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:40.414 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:10:40.414 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:10:40.414 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:40.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.414 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:10:40.503 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:10:40.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.506 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:10:40.541 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:10:40.541 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:10:40.542 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:10:40.542 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:10:40.542 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:10:40.542 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:40.542 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:10:40.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:10:40.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:10:40.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:10:40.542 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:10:40.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:40.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:40.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.738 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:10:40.773 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:10:40.773 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:10:40.773 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:10:40.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.773 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:10:40.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:40.870 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:40.905 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:10:40.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:40.905 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:40.979 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:10:40.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:10:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:10:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:10:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:10:41.206 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:10:41.206 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:10:41.206 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:10:41.206 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:10:41.209 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:10:41.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:41.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:10:41.268 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:41.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:41.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:41.364 INFO:teuthology.orchestra.run.smithi118.stdout:client7107 2024-09-21T06:10:41.365 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:41.365 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:41.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:10:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.659+0000 7f703fe00640 1 -- 172.21.15.118:0/3259534144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380ce0c0 msgr2=0x7f70381448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.659+0000 7f703fe00640 1 --2- 172.21.15.118:0/3259534144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380ce0c0 0x7f70381448a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f702c009be0 tx=0x7f702c02a890 comp rx=0 tx=0).stop 2024-09-21T06:10:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.659+0000 7f703fe00640 1 -- 172.21.15.118:0/3259534144 shutdown_connections 2024-09-21T06:10:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.659+0000 7f703fe00640 1 --2- 172.21.15.118:0/3259534144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380ce0c0 0x7f70381448a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.659+0000 7f703fe00640 1 -- 172.21.15.118:0/3259534144 >> 172.21.15.118:0/3259534144 conn(0x7f703806d110 msgr2=0x7f703806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.659+0000 7f703fe00640 1 -- 172.21.15.118:0/3259534144 shutdown_connections 2024-09-21T06:10:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.659+0000 7f703fe00640 1 -- 172.21.15.118:0/3259534144 wait complete. 2024-09-21T06:10:41.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.661+0000 7f703fe00640 1 Processor -- start 2024-09-21T06:10:41.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.661+0000 7f703fe00640 1 -- start start 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380ce0c0 0x7f70380cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380d0ec0 0x7f70380d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f703815fa00 0x7f70381f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7038167250 con 0x7f70380ce0c0 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70381670d0 con 0x7f703815fa00 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f70381673d0 con 0x7f70380d0ec0 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380ce0c0 0x7f70380cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380ce0c0 0x7f70380cfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40238/0 (socket says 172.21.15.118:40238) 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703d400640 1 -- 172.21.15.118:0/3278732111 learned_addr learned my addr 172.21.15.118:0/3278732111 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703ca00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380d0ec0 0x7f70380d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.663+0000 7f703de00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f703815fa00 0x7f70381f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703d400640 1 -- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380d0ec0 msgr2=0x7f70380d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703d400640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380d0ec0 0x7f70380d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703d400640 1 -- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f703815fa00 msgr2=0x7f70381f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703d400640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f703815fa00 0x7f70381f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703d400640 1 -- 172.21.15.118:0/3278732111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70380cf410 con 0x7f70380ce0c0 2024-09-21T06:10:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703d400640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380ce0c0 0x7f70380cfba0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f702c009b30 tx=0x7f702c033cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f7035600640 1 -- 172.21.15.118:0/3278732111 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c031d80 con 0x7f70380ce0c0 2024-09-21T06:10:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f7035600640 1 -- 172.21.15.118:0/3278732111 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f702c003a60 con 0x7f70380ce0c0 2024-09-21T06:10:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70380cf6f0 con 0x7f70380ce0c0 2024-09-21T06:10:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f7035600640 1 -- 172.21.15.118:0/3278732111 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0330d0 con 0x7f70380ce0c0 2024-09-21T06:10:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.664+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7038165250 con 0x7f70380ce0c0 2024-09-21T06:10:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.666+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70381448a0 con 0x7f70380ce0c0 2024-09-21T06:10:41.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.667+0000 7f7035600640 1 -- 172.21.15.118:0/3278732111 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f702c033270 con 0x7f70380ce0c0 2024-09-21T06:10:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.668+0000 7f7035600640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7018078b90 0x7f701807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.668+0000 7f7035600640 1 -- 172.21.15.118:0/3278732111 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f702c0bbf20 con 0x7f70380ce0c0 2024-09-21T06:10:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.668+0000 7f703ca00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7018078b90 0x7f701807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:41.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.669+0000 7f703ca00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7018078b90 0x7f701807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7024001120 tx=0x7f7024009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.673+0000 7f7035600640 1 -- 172.21.15.118:0/3278732111 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f702c03f030 con 0x7f70380ce0c0 2024-09-21T06:10:41.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.895+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f703815b290 con 0x7f70380ce0c0 2024-09-21T06:10:41.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.896+0000 7f7035600640 1 -- 172.21.15.118:0/3278732111 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f702c031790 con 0x7f70380ce0c0 2024-09-21T06:10:41.898 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:10:41.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7018078b90 msgr2=0x7f701807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:41.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7018078b90 0x7f701807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7024001120 tx=0x7f7024009040 comp rx=0 tx=0).stop 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380ce0c0 msgr2=0x7f70380cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380ce0c0 0x7f70380cfba0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f702c009b30 tx=0x7f702c033cb0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 shutdown_connections 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f703815fa00 0x7f70381f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7018078b90 0x7f701807b0a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70380d0ec0 0x7f70380d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 --2- 172.21.15.118:0/3278732111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380ce0c0 0x7f70380cfba0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 >> 172.21.15.118:0/3278732111 conn(0x7f703806d110 msgr2=0x7f7038141f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 shutdown_connections 2024-09-21T06:10:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:41.899+0000 7f703fe00640 1 -- 172.21.15.118:0/3278732111 wait complete. 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:10:41.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:10:41.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:41.924 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:10:41.964 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:10:41.964 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:10:41.964 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:10:41.964 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:41.964 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42317sec preferred_lft 42317sec 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:10:41.965 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:10:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:41.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:41.967 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:10:42.065 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:10:42.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:42.068 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:10:42.106 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:10:42.106 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:10:42.106 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:10:42.106 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:10:42.106 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:10:42.106 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:42.107 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:10:42.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:10:42.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:10:42.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:10:42.107 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:10:42.224 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:42.296 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:42.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:42.305 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:10:42.342 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:10:42.342 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:10:42.342 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:10:42.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:42.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:10:42.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:42.438 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:42.473 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:10:42.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:42.473 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:42.547 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:10:42.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:42.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:42.742 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:42.743 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:42.778 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:10:42.779 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:10:42.779 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:10:42.779 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:10:42.779 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:10:42.780 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:10:42.780 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:10:42.780 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:10:42.781 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:10:42.781 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:10:42.783 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:10:42.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:42.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:10:42.843 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:10:42.923 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:42.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:10:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:42.935 INFO:teuthology.orchestra.run.smithi149.stdout:client7116 2024-09-21T06:10:42.935 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:10:42.935 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:42.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 -- 172.21.15.118:0/959866631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a040d1590 msgr2=0x7f2a04142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 --2- 172.21.15.118:0/959866631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a040d1590 0x7f2a04142730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005fd0 tx=0x7f29f002a540 comp rx=0 tx=0).stop 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 -- 172.21.15.118:0/959866631 shutdown_connections 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 --2- 172.21.15.118:0/959866631 >> v2:172.21.15.149:3300/0 conn(0x7f2a0413fef0 0x7f2a04142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 --2- 172.21.15.118:0/959866631 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a040d1590 0x7f2a04142730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 -- 172.21.15.118:0/959866631 >> 172.21.15.118:0/959866631 conn(0x7f2a0406d110 msgr2=0x7f2a0406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 -- 172.21.15.118:0/959866631 shutdown_connections 2024-09-21T06:10:43.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.195+0000 7f2a0b000640 1 -- 172.21.15.118:0/959866631 wait complete. 2024-09-21T06:10:43.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.198+0000 7f2a0b000640 1 Processor -- start 2024-09-21T06:10:43.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.198+0000 7f2a0b000640 1 -- start start 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a0b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a0413fae0 0x7f2a040b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a0b000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a0413fef0 0x7f2a041f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a0b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a041f7f30 0x7f2a04140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a0b000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2a040cfb10 con 0x7f2a0413fef0 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a0b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a040cf990 con 0x7f2a041f7f30 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a0b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a040cfc90 con 0x7f2a0413fae0 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a03400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a0413fef0 0x7f2a041f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.199+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a0413fae0 0x7f2a040b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a0413fae0 0x7f2a040b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:47418/0 (socket says 172.21.15.118:47418) 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 -- 172.21.15.118:0/484065902 learned_addr learned my addr 172.21.15.118:0/484065902 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:43.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a09000640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a041f7f30 0x7f2a04140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 -- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a041f7f30 msgr2=0x7f2a04140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a041f7f30 0x7f2a04140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 -- 172.21.15.118:0/484065902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a0413fef0 msgr2=0x7f2a041f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a0413fef0 0x7f2a041f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 -- 172.21.15.118:0/484065902 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0413d6d0 con 0x7f2a0413fae0 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f2a03e00640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a0413fae0 0x7f2a040b4b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c460 tx=0x7f29f400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.200+0000 7f29fbe00640 1 -- 172.21.15.118:0/484065902 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4017070 con 0x7f2a0413fae0 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.201+0000 7f29fbe00640 1 -- 172.21.15.118:0/484065902 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29f40053e0 con 0x7f2a0413fae0 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.201+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a041f7050 con 0x7f2a0413fae0 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.201+0000 7f29fbe00640 1 -- 172.21.15.118:0/484065902 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4003850 con 0x7f2a0413fae0 2024-09-21T06:10:43.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.201+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0413dc50 con 0x7f2a0413fae0 2024-09-21T06:10:43.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.202+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a040d0140 con 0x7f2a0413fae0 2024-09-21T06:10:43.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.203+0000 7f29fbe00640 1 -- 172.21.15.118:0/484065902 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29f401a070 con 0x7f2a0413fae0 2024-09-21T06:10:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.204+0000 7f29fbe00640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29e4078bc0 0x7f29e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.204+0000 7f29fbe00640 1 -- 172.21.15.118:0/484065902 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(132..132 src has 1..132) ==== 5709+0+0 (secure 0 0 0) 0x7f29f4099fe0 con 0x7f2a0413fae0 2024-09-21T06:10:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.204+0000 7f2a03400640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29e4078bc0 0x7f29e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.205+0000 7f2a03400640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29e4078bc0 0x7f29e407b0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f29f0033000 tx=0x7f29f0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:43.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.208+0000 7f29fbe00640 1 -- 172.21.15.118:0/484065902 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f29f4061d50 con 0x7f2a0413fae0 2024-09-21T06:10:43.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.434+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a041429e0 con 0x7f2a0413fae0 2024-09-21T06:10:43.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.435+0000 7f29fbe00640 1 -- 172.21.15.118:0/484065902 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f29f4066780 con 0x7f2a0413fae0 2024-09-21T06:10:43.437 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:43.437 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:10:43.437 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:10:43.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29e4078bc0 msgr2=0x7f29e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29e4078bc0 0x7f29e407b0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f29f0033000 tx=0x7f29f0004730 comp rx=0 tx=0).stop 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a0413fae0 msgr2=0x7f2a040b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a0413fae0 0x7f2a040b4b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c460 tx=0x7f29f400c860 comp rx=0 tx=0).stop 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 shutdown_connections 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a041f7f30 0x7f2a04140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a0413fef0 0x7f2a041f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f29e4078bc0 0x7f29e407b0d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 --2- 172.21.15.118:0/484065902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a0413fae0 0x7f2a040b4b90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 >> 172.21.15.118:0/484065902 conn(0x7f2a0406d110 msgr2=0x7f2a0415f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 shutdown_connections 2024-09-21T06:10:43.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.438+0000 7f2a0b000640 1 -- 172.21.15.118:0/484065902 wait complete. 2024-09-21T06:10:43.461 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:10:43.702 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":6963,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.452789964000001,"mdsmap_epoch":68,"osdmap_epoch":133,"osdmap_epoch_barrier":132,"uptime":15.469577983000001} 2024-09-21T06:10:43.702 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 6963, "mdsmap_epoch": 68, "osdmap_epoch": 133, "osdmap_epoch_barrier": 132, "rank_uptime": 10.452789964, "state": "up:active", "uptime": 15.469577983, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:10:43.702 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 -- 172.21.15.118:0/3639726656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b300b3df0 msgr2=0x7f2b300cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 --2- 172.21.15.118:0/3639726656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b300b3df0 0x7f2b300cf7d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f2b300b0400 tx=0x7f2b2002a560 comp rx=0 tx=0).stop 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 -- 172.21.15.118:0/3639726656 shutdown_connections 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 --2- 172.21.15.118:0/3639726656 >> v2:172.21.15.149:3300/0 conn(0x7f2b3006f540 0x7f2b3006f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 --2- 172.21.15.118:0/3639726656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b300b3df0 0x7f2b300cf7d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 -- 172.21.15.118:0/3639726656 >> 172.21.15.118:0/3639726656 conn(0x7f2b3006d420 msgr2=0x7f2b300b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 -- 172.21.15.118:0/3639726656 shutdown_connections 2024-09-21T06:10:43.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.924+0000 7f2b35600640 1 -- 172.21.15.118:0/3639726656 wait complete. 2024-09-21T06:10:43.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.926+0000 7f2b35600640 1 Processor -- start 2024-09-21T06:10:43.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.927+0000 7f2b35600640 1 -- start start 2024-09-21T06:10:43.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b35600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b3006f540 0x7f2b30073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b35600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b3006fe90 0x7f2b30074320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b35600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b300b3df0 0x7f2b300ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b35600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3015d9e0 con 0x7f2b3006fe90 2024-09-21T06:10:43.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b35600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3015d860 con 0x7f2b3006f540 2024-09-21T06:10:43.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b35600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2b3015db60 con 0x7f2b300b3df0 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b27400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b3006fe90 0x7f2b30074320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b27400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b3006fe90 0x7f2b30074320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40254/0 (socket says 172.21.15.118:40254) 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b27400640 1 -- 172.21.15.118:0/686107321 learned_addr learned my addr 172.21.15.118:0/686107321 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.928+0000 7f2b2fe00640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b3006f540 0x7f2b30073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b34c00640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b300b3df0 0x7f2b300ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b27400640 1 -- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b300b3df0 msgr2=0x7f2b300ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b27400640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b300b3df0 0x7f2b300ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b27400640 1 -- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b3006f540 msgr2=0x7f2b30073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b27400640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b3006f540 0x7f2b30073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b27400640 1 -- 172.21.15.118:0/686107321 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b301f6180 con 0x7f2b3006fe90 2024-09-21T06:10:43.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b27400640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b3006fe90 0x7f2b30074320 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800e790 tx=0x7f2b1800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:43.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b2cc00640 1 -- 172.21.15.118:0/686107321 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1800eea0 con 0x7f2b3006fe90 2024-09-21T06:10:43.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b2cc00640 1 -- 172.21.15.118:0/686107321 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b1800cdb0 con 0x7f2b3006fe90 2024-09-21T06:10:43.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b301f6460 con 0x7f2b3006fe90 2024-09-21T06:10:43.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.929+0000 7f2b2cc00640 1 -- 172.21.15.118:0/686107321 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18010690 con 0x7f2b3006fe90 2024-09-21T06:10:43.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.930+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b301f6a20 con 0x7f2b3006fe90 2024-09-21T06:10:43.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.931+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3006f950 con 0x7f2b3006fe90 2024-09-21T06:10:43.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.932+0000 7f2b2cc00640 1 -- 172.21.15.118:0/686107321 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b18010830 con 0x7f2b3006fe90 2024-09-21T06:10:43.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.933+0000 7f2b2cc00640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.933+0000 7f2b2cc00640 1 -- 172.21.15.118:0/686107321 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5767+0+0 (secure 0 0 0) 0x7f2b1809b730 con 0x7f2b3006fe90 2024-09-21T06:10:43.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.933+0000 7f2b2fe00640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.934+0000 7f2b2fe00640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b20033000 tx=0x7f2b20004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:43.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:43.937+0000 7f2b2cc00640 1 -- 172.21.15.118:0/686107321 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2b180634d0 con 0x7f2b3006fe90 2024-09-21T06:10:44.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.120+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f2b300b3110 con 0x7f2b3006fe90 2024-09-21T06:10:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.315+0000 7f2b2cc00640 1 -- 172.21.15.118:0/686107321 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v134) ==== 181+0+0 (secure 0 0 0) 0x7f2b18067f00 con 0x7f2b3006fe90 2024-09-21T06:10:44.316 INFO:teuthology.orchestra.run.smithi118.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-21T06:10:44.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b0c078b90 msgr2=0x7f2b0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:44.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b20033000 tx=0x7f2b20004730 comp rx=0 tx=0).stop 2024-09-21T06:10:44.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b3006fe90 msgr2=0x7f2b30074320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b3006fe90 0x7f2b30074320 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800e790 tx=0x7f2b1800ec50 comp rx=0 tx=0).stop 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 shutdown_connections 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b300b3df0 0x7f2b300ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b3006fe90 0x7f2b30074320 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 --2- 172.21.15.118:0/686107321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b3006f540 0x7f2b30073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 >> 172.21.15.118:0/686107321 conn(0x7f2b3006d420 msgr2=0x7f2b3015f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 shutdown_connections 2024-09-21T06:10:44.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:44.318+0000 7f2b35600640 1 -- 172.21.15.118:0/686107321 wait complete. 2024-09-21T06:10:44.346 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:10:44.579 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:10:44.580 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:10:44.580 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-21T06:10:44.580 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:44.580 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:44.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:44.616 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-21T06:10:44.829 INFO:teuthology.orchestra.run.smithi118.stderr:16+0 records in 2024-09-21T06:10:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:16+0 records out 2024-09-21T06:10:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.132138 s, 127 MB/s 2024-09-21T06:10:44.831 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:44.831 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:44.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:44.866 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-21T06:10:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:17+0 records in 2024-09-21T06:10:45.078 INFO:teuthology.orchestra.run.smithi118.stderr:17+0 records out 2024-09-21T06:10:45.078 INFO:teuthology.orchestra.run.smithi118.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.134443 s, 133 MB/s 2024-09-21T06:10:45.079 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-21T06:10:45.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:10:45.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 -- 172.21.15.118:0/2071267626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44000d14f0 msgr2=0x7f44000cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:45.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 --2- 172.21.15.118:0/2071267626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44000d14f0 0x7f44000cf1e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f44000d1990 tx=0x7f43f802a5f0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 -- 172.21.15.118:0/2071267626 shutdown_connections 2024-09-21T06:10:45.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 --2- 172.21.15.118:0/2071267626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44000d14f0 0x7f44000cf1e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 --2- 172.21.15.118:0/2071267626 >> v2:172.21.15.149:3300/0 conn(0x7f440013fc50 0x7f4400160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 -- 172.21.15.118:0/2071267626 >> 172.21.15.118:0/2071267626 conn(0x7f440006d110 msgr2=0x7f440006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:45.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 -- 172.21.15.118:0/2071267626 shutdown_connections 2024-09-21T06:10:45.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.297+0000 7f4405c00640 1 -- 172.21.15.118:0/2071267626 wait complete. 2024-09-21T06:10:45.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.300+0000 7f4405c00640 1 Processor -- start 2024-09-21T06:10:45.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.300+0000 7f4405c00640 1 -- start start 2024-09-21T06:10:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f4405c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440013fc50 0x7f4400143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f4405c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4400161530 0x7f440013edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f4405c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440013d2e0 0x7f44001f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f4405c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f44000cfbf0 con 0x7f440013fc50 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f4405c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f44000cfa70 con 0x7f440013d2e0 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f4405c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f44000cfd70 con 0x7f4400161530 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f43fea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440013fc50 0x7f4400143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.301+0000 7f43fea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440013fc50 0x7f4400143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40270/0 (socket says 172.21.15.118:40270) 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fea00640 1 -- 172.21.15.118:0/3353922243 learned_addr learned my addr 172.21.15.118:0/3353922243 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fe000640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4400161530 0x7f440013edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43ff400640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440013d2e0 0x7f44001f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fea00640 1 -- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4400161530 msgr2=0x7f440013edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fea00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4400161530 0x7f440013edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fea00640 1 -- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440013d2e0 msgr2=0x7f44001f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fea00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440013d2e0 0x7f44001f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fea00640 1 -- 172.21.15.118:0/3353922243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440013c240 con 0x7f440013fc50 2024-09-21T06:10:45.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.302+0000 7f43fea00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440013fc50 0x7f4400143ea0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f43f000ea20 tx=0x7f43f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:45.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.303+0000 7f43f6a00640 1 -- 172.21.15.118:0/3353922243 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f000cde0 con 0x7f440013fc50 2024-09-21T06:10:45.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.303+0000 7f43f6a00640 1 -- 172.21.15.118:0/3353922243 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43f0004c10 con 0x7f440013fc50 2024-09-21T06:10:45.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.303+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440013c520 con 0x7f440013fc50 2024-09-21T06:10:45.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.303+0000 7f43f6a00640 1 -- 172.21.15.118:0/3353922243 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0005020 con 0x7f440013fc50 2024-09-21T06:10:45.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.303+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440013cae0 con 0x7f440013fc50 2024-09-21T06:10:45.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.304+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44000d0290 con 0x7f440013fc50 2024-09-21T06:10:45.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.305+0000 7f43f6a00640 1 -- 172.21.15.118:0/3353922243 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43f00051c0 con 0x7f440013fc50 2024-09-21T06:10:45.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.306+0000 7f43f6a00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43e0078b90 0x7f43e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:45.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.306+0000 7f43f6a00640 1 -- 172.21.15.118:0/3353922243 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5767+0+0 (secure 0 0 0) 0x7f43f009b6b0 con 0x7f440013fc50 2024-09-21T06:10:45.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.306+0000 7f43fe000640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43e0078b90 0x7f43e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:45.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.307+0000 7f43fe000640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43e0078b90 0x7f43e007b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f44000b0490 tx=0x7f43ec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:45.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.310+0000 7f43f6a00640 1 -- 172.21.15.118:0/3353922243 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f43f0016030 con 0x7f440013fc50 2024-09-21T06:10:45.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.498+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f44000b4010 con 0x7f440013fc50 2024-09-21T06:10:45.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.499+0000 7f43f6a00640 1 -- 172.21.15.118:0/3353922243 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) ==== 81+0+34730 (secure 0 0 0) 0x7f43f0063450 con 0x7f440013fc50 2024-09-21T06:10:45.501 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:45.501 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:45.501 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 134, 2024-09-21T06:10:45.501 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:10:45.501 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:10:45.501 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:10:44.309106+0000", 2024-09-21T06:10:45.501 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:45.502 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:10:45.503 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:45.504 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:45.505 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:45.506 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:45.507 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:45.508 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:45.509 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:10:45.510 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:45.511 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:10:45.512 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:45.513 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.514 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:10:45.515 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:45.516 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:45.517 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:10:45.518 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "134", 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:45.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:45.520 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:45.521 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:10:45.522 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:10:45.523 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.525 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.526 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.529 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.532 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.533 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.534 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.540 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.541 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.542 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.544 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.545 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.546 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.547 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.548 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.549 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.550 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.551 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.552 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.553 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.554 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.555 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:10:45.556 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.557 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:45.558 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.559 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.560 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.561 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.562 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:45.563 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.564 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:10:45.565 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.566 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.567 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.568 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:45.569 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.570 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.572 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.573 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:45.574 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:45.575 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:10:45.576 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:10:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:10:45.578 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:10:45.579 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:45.579 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.501+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43e0078b90 msgr2=0x7f43e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.501+0000 7f4405c00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43e0078b90 0x7f43e007b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f44000b0490 tx=0x7f43ec009040 comp rx=0 tx=0).stop 2024-09-21T06:10:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.501+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440013fc50 msgr2=0x7f4400143ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.501+0000 7f4405c00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440013fc50 0x7f4400143ea0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f43f000ea20 tx=0x7f43f000eee0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 shutdown_connections 2024-09-21T06:10:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f440013d2e0 0x7f44001f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43e0078b90 0x7f43e007b0a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4400161530 0x7f440013edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 --2- 172.21.15.118:0/3353922243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440013fc50 0x7f4400143ea0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 >> 172.21.15.118:0/3353922243 conn(0x7f440006d110 msgr2=0x7f440015c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 shutdown_connections 2024-09-21T06:10:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:45.502+0000 7f4405c00640 1 -- 172.21.15.118:0/3353922243 wait complete. 2024-09-21T06:10:45.582 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:10:49.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:49.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:50.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:10:50.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.810+0000 7ff22f200640 1 -- 172.21.15.118:0/871816225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144760 msgr2=0x7ff2300cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:50.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.810+0000 7ff22f200640 1 --2- 172.21.15.118:0/871816225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144760 0x7ff2300cf4c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff21c005fd0 tx=0x7ff21c02a5d0 comp rx=0 tx=0).stop 2024-09-21T06:10:50.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.811+0000 7ff22f200640 1 -- 172.21.15.118:0/871816225 shutdown_connections 2024-09-21T06:10:50.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.811+0000 7ff22f200640 1 --2- 172.21.15.118:0/871816225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cfa00 0x7ff2300b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:50.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.811+0000 7ff22f200640 1 --2- 172.21.15.118:0/871816225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144760 0x7ff2300cf4c0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:50.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.811+0000 7ff22f200640 1 -- 172.21.15.118:0/871816225 >> 172.21.15.118:0/871816225 conn(0x7ff23006d6e0 msgr2=0x7ff2300b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:50.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.811+0000 7ff22f200640 1 -- 172.21.15.118:0/871816225 shutdown_connections 2024-09-21T06:10:50.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.811+0000 7ff22f200640 1 -- 172.21.15.118:0/871816225 wait complete. 2024-09-21T06:10:50.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.813+0000 7ff22f200640 1 Processor -- start 2024-09-21T06:10:50.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.813+0000 7ff22f200640 1 -- start start 2024-09-21T06:10:50.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.814+0000 7ff22f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cfa00 0x7ff23015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:50.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff230144760 0x7ff23015db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144ea0 0x7ff2300b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300b4a10 con 0x7ff230144ea0 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300b4890 con 0x7ff230144760 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff2300b4b90 con 0x7ff2300cfa00 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144ea0 0x7ff2300b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144ea0 0x7ff2300b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42892/0 (socket says 172.21.15.118:42892) 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 -- 172.21.15.118:0/637255747 learned_addr learned my addr 172.21.15.118:0/637255747 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22de00640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cfa00 0x7ff23015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22d400640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff230144760 0x7ff23015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 -- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cfa00 msgr2=0x7ff23015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cfa00 0x7ff23015b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 -- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff230144760 msgr2=0x7ff23015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:50.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff230144760 0x7ff23015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:50.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.815+0000 7ff22e800640 1 -- 172.21.15.118:0/637255747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23015b750 con 0x7ff230144ea0 2024-09-21T06:10:50.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.816+0000 7ff22e800640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144ea0 0x7ff2300b17c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff22800e990 tx=0x7ff22800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:50.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.816+0000 7ff226000640 1 -- 172.21.15.118:0/637255747 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228004d20 con 0x7ff230144ea0 2024-09-21T06:10:50.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.816+0000 7ff226000640 1 -- 172.21.15.118:0/637255747 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff22800caa0 con 0x7ff230144ea0 2024-09-21T06:10:50.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.816+0000 7ff226000640 1 -- 172.21.15.118:0/637255747 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228005020 con 0x7ff230144ea0 2024-09-21T06:10:50.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.816+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23015e760 con 0x7ff230144ea0 2024-09-21T06:10:50.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.816+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23015ed20 con 0x7ff230144ea0 2024-09-21T06:10:50.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.817+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff23015e4d0 con 0x7ff230144ea0 2024-09-21T06:10:50.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.818+0000 7ff226000640 1 -- 172.21.15.118:0/637255747 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2280051c0 con 0x7ff230144ea0 2024-09-21T06:10:50.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.819+0000 7ff226000640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078b90 0x7ff21007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:50.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.819+0000 7ff226000640 1 -- 172.21.15.118:0/637255747 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5767+0+0 (secure 0 0 0) 0x7ff22809b5f0 con 0x7ff230144ea0 2024-09-21T06:10:50.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.820+0000 7ff22de00640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078b90 0x7ff21007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:50.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.821+0000 7ff22de00640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078b90 0x7ff21007b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff220000f60 tx=0x7ff220009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:50.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:50.824+0000 7ff226000640 1 -- 172.21.15.118:0/637255747 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff228016030 con 0x7ff230144ea0 2024-09-21T06:10:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.008+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff2300b4140 con 0x7ff230144ea0 2024-09-21T06:10:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.010+0000 7ff226000640 1 -- 172.21.15.118:0/637255747 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) ==== 81+0+34730 (secure 0 0 0) 0x7ff2280633a0 con 0x7ff230144ea0 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 134, 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:10:44.309106+0000", 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:10:51.012 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:10:51.013 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:51.014 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:10:51.015 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:51.016 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:51.017 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:51.018 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:10:51.020 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:51.021 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:10:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:51.023 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:51.024 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:10:51.025 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:10:51.026 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:51.027 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:10:51.028 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "134", 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:51.029 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:51.030 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:51.031 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:10:51.032 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.033 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.034 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.035 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.037 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:10:51.038 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.039 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.040 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.043 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.044 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.045 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.046 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.047 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.048 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:51.049 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.050 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.051 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.052 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.053 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:10:51.054 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.055 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.056 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.057 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.058 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.059 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.060 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.061 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.062 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.063 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.064 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:10:51.065 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.066 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.067 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.069 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:10:51.070 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:51.071 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.072 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.073 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.074 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:51.075 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.076 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.077 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:51.078 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.079 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.080 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:10:51.081 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.082 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:10:51.083 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:10:51.084 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:10:51.085 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:10:51.085 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:10:51.085 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:10:51.085 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:10:51.085 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:10:51.085 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:51.085 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:51.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.012+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078b90 msgr2=0x7ff21007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:51.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.012+0000 7ff22f200640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078b90 0x7ff21007b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff220000f60 tx=0x7ff220009040 comp rx=0 tx=0).stop 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.012+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144ea0 msgr2=0x7ff2300b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.012+0000 7ff22f200640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144ea0 0x7ff2300b17c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff22800e990 tx=0x7ff22800ee50 comp rx=0 tx=0).stop 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 shutdown_connections 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff230144ea0 0x7ff2300b17c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff230144760 0x7ff23015db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078b90 0x7ff21007b0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 --2- 172.21.15.118:0/637255747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cfa00 0x7ff23015b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 >> 172.21.15.118:0/637255747 conn(0x7ff23006d6e0 msgr2=0x7ff2301e5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 shutdown_connections 2024-09-21T06:10:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:51.013+0000 7ff22f200640 1 -- 172.21.15.118:0/637255747 wait complete. 2024-09-21T06:10:51.088 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:10:56.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 -- 172.21.15.118:0/2853309814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 msgr2=0x7ff120142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 --2- 172.21.15.118:0/2853309814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff120142c70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff118005fd0 tx=0x7ff11802aa00 comp rx=0 tx=0).stop 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 -- 172.21.15.118:0/2853309814 shutdown_connections 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 --2- 172.21.15.118:0/2853309814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff120142c70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 --2- 172.21.15.118:0/2853309814 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1200d1590 0x7ff120142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 -- 172.21.15.118:0/2853309814 >> 172.21.15.118:0/2853309814 conn(0x7ff12006d110 msgr2=0x7ff12006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 -- 172.21.15.118:0/2853309814 shutdown_connections 2024-09-21T06:10:56.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.320+0000 7ff128200640 1 -- 172.21.15.118:0/2853309814 wait complete. 2024-09-21T06:10:56.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.323+0000 7ff128200640 1 Processor -- start 2024-09-21T06:10:56.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.323+0000 7ff128200640 1 -- start start 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.324+0000 7ff128200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff12013fae0 0x7ff120139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.324+0000 7ff128200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff1201413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.324+0000 7ff128200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120157590 0x7ff120141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.324+0000 7ff128200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200cfb10 con 0x7ff12013fef0 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.324+0000 7ff128200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200cf990 con 0x7ff120157590 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.324+0000 7ff128200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff1200cfc90 con 0x7ff12013fae0 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.324+0000 7ff124e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff1201413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:56.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff1201413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39556/0 (socket says 172.21.15.118:39556) 2024-09-21T06:10:56.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 -- 172.21.15.118:0/2807403314 learned_addr learned my addr 172.21.15.118:0/2807403314 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:56.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff125800640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff12013fae0 0x7ff120139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:56.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff126200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120157590 0x7ff120141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:56.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 -- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff12013fae0 msgr2=0x7ff120139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff12013fae0 0x7ff120139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 -- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120157590 msgr2=0x7ff120141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120157590 0x7ff120141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 -- 172.21.15.118:0/2807403314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff120072d70 con 0x7ff12013fef0 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff126200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120157590 0x7ff120141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.325+0000 7ff124e00640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff1201413c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00d6a0 tx=0x7ff10c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.326+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c017070 con 0x7ff12013fef0 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.326+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff10c005310 con 0x7ff12013fef0 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.326+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1201f9e60 con 0x7ff12013fef0 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.326+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c009820 con 0x7ff12013fef0 2024-09-21T06:10:56.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.326+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff120139950 con 0x7ff12013fef0 2024-09-21T06:10:56.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.327+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1200d0140 con 0x7ff12013fef0 2024-09-21T06:10:56.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.328+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff10c0099c0 con 0x7ff12013fef0 2024-09-21T06:10:56.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.329+0000 7ff11d600640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff100078b90 0x7ff10007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:56.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.329+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5767+0+0 (secure 0 0 0) 0x7ff10c09ae40 con 0x7ff12013fef0 2024-09-21T06:10:56.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.329+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=136}) -- 0x7ff100080830 con 0x7ff12013fef0 2024-09-21T06:10:56.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.330+0000 7ff125800640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff100078b90 0x7ff10007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:56.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.330+0000 7ff125800640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff100078b90 0x7ff10007b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff114001720 tx=0x7ff114009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:56.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.333+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff10c062b50 con 0x7ff12013fef0 2024-09-21T06:10:56.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.521+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff12015c060 con 0x7ff12013fef0 2024-09-21T06:10:56.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.522+0000 7ff11d600640 1 -- 172.21.15.118:0/2807403314 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) ==== 81+0+34749 (secure 0 0 0) 0x7ff10c09d070 con 0x7ff12013fef0 2024-09-21T06:10:56.524 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:56.524 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:56.524 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 135, 2024-09-21T06:10:56.524 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:10:56.524 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:10:56.524 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:10:55.350705+0000", 2024-09-21T06:10:56.524 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:10:56.525 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:10:56.526 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:56.527 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:56.528 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:56.529 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:56.530 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:56.531 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:56.531 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:56.531 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:56.531 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:56.531 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:56.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.532 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:56.532 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:56.532 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:56.532 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:56.532 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:56.532 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:56.532 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:56.533 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:56.533 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:56.533 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:56.533 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:56.533 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:56.533 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:10:56.533 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:10:56.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.534 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:56.534 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:10:56.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.534 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:56.534 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:56.534 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:10:56.535 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:10:56.535 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:10:56.535 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:10:56.535 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:10:56.535 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:56.535 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:56.535 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:56.536 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.536 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.536 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:10:56.536 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:10:56.536 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:10:56.537 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:56.537 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:56.537 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:56.537 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:56.537 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:56.537 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:10:56.538 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:56.539 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:56.540 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:56.541 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:56.542 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:56.544 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:56.545 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "135", 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:10:56.546 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:10:56.548 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:56.549 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.550 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.551 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.552 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.553 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:10:56.554 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.555 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.556 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.557 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.558 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.559 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.560 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:10:56.561 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.562 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.563 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.564 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:10:56.565 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.566 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.567 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:10:56.568 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.569 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.570 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.571 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:10:56.572 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.573 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.574 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.575 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.576 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:10:56.577 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.578 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.580 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.581 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.582 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.583 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.584 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.585 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.586 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.587 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.589 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:56.590 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.591 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:56.592 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:56.593 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:10:56.594 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.595 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.596 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.597 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.598 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.599 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.600 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.601 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:10:56.602 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:10:56.603 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:10:56.604 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:10:56.605 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:10:56.605 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:56.605 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff100078b90 msgr2=0x7ff10007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff100078b90 0x7ff10007b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff114001720 tx=0x7ff114009040 comp rx=0 tx=0).stop 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 msgr2=0x7ff1201413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff1201413c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00d6a0 tx=0x7ff10c00db60 comp rx=0 tx=0).stop 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 shutdown_connections 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff120157590 0x7ff120141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff12013fef0 0x7ff1201413c0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff100078b90 0x7ff10007b0a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 --2- 172.21.15.118:0/2807403314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff12013fae0 0x7ff120139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:56.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 >> 172.21.15.118:0/2807403314 conn(0x7ff12006d110 msgr2=0x7ff120153ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:56.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 shutdown_connections 2024-09-21T06:10:56.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:56.525+0000 7ff128200640 1 -- 172.21.15.118:0/2807403314 wait complete. 2024-09-21T06:10:56.607 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-21T06:10:56.607 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:10:56.608 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:56.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:56.643 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-21T06:10:57.042 INFO:teuthology.orchestra.run.smithi118.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-21T06:10:57.042 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:10:57.042 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:10:57.043 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.319016 s, 164 MB/s 2024-09-21T06:10:57.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:10:57.044 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:10:57.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.267+0000 7f6d26400640 1 -- 172.21.15.118:0/2465461328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200d1590 msgr2=0x7f6d20142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.267+0000 7f6d26400640 1 --2- 172.21.15.118:0/2465461328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200d1590 0x7f6d20142730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009830 tx=0x7f6d0802a530 comp rx=0 tx=0).stop 2024-09-21T06:10:57.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.267+0000 7f6d26400640 1 -- 172.21.15.118:0/2465461328 shutdown_connections 2024-09-21T06:10:57.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.267+0000 7f6d26400640 1 --2- 172.21.15.118:0/2465461328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200d1590 0x7f6d20142730 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.267+0000 7f6d26400640 1 -- 172.21.15.118:0/2465461328 >> 172.21.15.118:0/2465461328 conn(0x7f6d2006d110 msgr2=0x7f6d2006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:57.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.267+0000 7f6d26400640 1 -- 172.21.15.118:0/2465461328 shutdown_connections 2024-09-21T06:10:57.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.267+0000 7f6d26400640 1 -- 172.21.15.118:0/2465461328 wait complete. 2024-09-21T06:10:57.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.269+0000 7f6d26400640 1 Processor -- start 2024-09-21T06:10:57.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.269+0000 7f6d26400640 1 -- start start 2024-09-21T06:10:57.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.270+0000 7f6d26400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d2013fae0 0x7f6d200b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.270+0000 7f6d26400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d2013fef0 0x7f6d2013e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.270+0000 7f6d26400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200b4a50 0x7f6d2013e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.270+0000 7f6d26400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20168280 con 0x7f6d2013fef0 2024-09-21T06:10:57.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.270+0000 7f6d26400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20168100 con 0x7f6d200b4a50 2024-09-21T06:10:57.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.270+0000 7f6d26400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d20168400 con 0x7f6d2013fae0 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d2013fef0 0x7f6d2013e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d2013fef0 0x7f6d2013e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39560/0 (socket says 172.21.15.118:39560) 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 -- 172.21.15.118:0/3417986198 learned_addr learned my addr 172.21.15.118:0/3417986198 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d1fe00640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200b4a50 0x7f6d2013e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d1f400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d2013fae0 0x7f6d200b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 -- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d2013fae0 msgr2=0x7f6d200b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d2013fae0 0x7f6d200b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 -- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200b4a50 msgr2=0x7f6d2013e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200b4a50 0x7f6d2013e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 -- 172.21.15.118:0/3417986198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d201f6ce0 con 0x7f6d2013fef0 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d1f400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d2013fae0 0x7f6d200b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.271+0000 7f6d16a00640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d2013fef0 0x7f6d2013e410 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009950 tx=0x7f6d08033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.272+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08031b50 con 0x7f6d2013fef0 2024-09-21T06:10:57.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.272+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d08031de0 con 0x7f6d2013fef0 2024-09-21T06:10:57.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.272+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d201f6fc0 con 0x7f6d2013fef0 2024-09-21T06:10:57.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.272+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08005280 con 0x7f6d2013fef0 2024-09-21T06:10:57.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.272+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d201f7580 con 0x7f6d2013fef0 2024-09-21T06:10:57.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.273+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d201f7960 con 0x7f6d2013fef0 2024-09-21T06:10:57.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.274+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d08005420 con 0x7f6d2013fef0 2024-09-21T06:10:57.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.275+0000 7f6d17e00640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6cfc078b90 0x7f6cfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.275+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5767+0+0 (secure 0 0 0) 0x7f6d080bbf30 con 0x7f6d2013fef0 2024-09-21T06:10:57.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.275+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=136}) -- 0x7f6cfc080830 con 0x7f6d2013fef0 2024-09-21T06:10:57.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.276+0000 7f6d1f400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6cfc078b90 0x7f6cfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.276+0000 7f6d1f400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6cfc078b90 0x7f6cfc07b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6d10007fd0 tx=0x7f6d10009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:57.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.280+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6d201f7960 con 0x7f6d2013fef0 2024-09-21T06:10:57.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.468+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f6d200d0e80 con 0x7f6d2013fef0 2024-09-21T06:10:57.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.469+0000 7f6d17e00640 1 -- 172.21.15.118:0/3417986198 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) ==== 81+0+34749 (secure 0 0 0) 0x7f6d0803f030 con 0x7f6d2013fef0 2024-09-21T06:10:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:57.471 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 135, 2024-09-21T06:10:57.471 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:10:55.350705+0000", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:10:57.472 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:10:57.473 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:10:57.474 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:57.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:57.476 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:57.477 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:10:57.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.479 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:57.480 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:57.481 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:57.482 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.483 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:10:57.484 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:10:57.485 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:57.486 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:57.487 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "135", 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:57.488 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:57.491 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.492 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:10:57.493 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:10:57.494 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:10:57.495 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.497 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:57.498 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.499 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.501 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.503 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.504 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.506 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:10:57.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.508 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.509 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.510 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.511 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.513 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.514 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.518 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:57.519 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.520 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:10:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.522 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.523 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:10:57.524 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.525 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.526 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.527 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.528 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:57.529 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:57.530 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.531 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.532 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.533 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:57.534 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:10:57.535 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.536 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:57.538 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.539 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.540 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.541 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:10:57.542 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.543 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:10:57.544 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:10:57.545 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:10:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:10:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:10:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:10:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:10:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:10:57.546 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:57.546 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:57.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6cfc078b90 msgr2=0x7f6cfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6cfc078b90 0x7f6cfc07b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6d10007fd0 tx=0x7f6d10009040 comp rx=0 tx=0).stop 2024-09-21T06:10:57.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d2013fef0 msgr2=0x7f6d2013e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d2013fef0 0x7f6d2013e410 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009950 tx=0x7f6d08033ba0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 shutdown_connections 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d200b4a50 0x7f6d2013e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d2013fef0 0x7f6d2013e410 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6cfc078b90 0x7f6cfc07b0a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 --2- 172.21.15.118:0/3417986198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d2013fae0 0x7f6d200b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 >> 172.21.15.118:0/3417986198 conn(0x7f6d2006d110 msgr2=0x7f6d2006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 shutdown_connections 2024-09-21T06:10:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.472+0000 7f6d26400640 1 -- 172.21.15.118:0/3417986198 wait complete. 2024-09-21T06:10:57.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 -- 172.21.15.118:0/3950463384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fae0 msgr2=0x7fb8080d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 --2- 172.21.15.118:0/3950463384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fae0 0x7fb8080d0e80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb8080ce7c0 tx=0x7fb7fc02a4d0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 -- 172.21.15.118:0/3950463384 shutdown_connections 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 --2- 172.21.15.118:0/3950463384 >> v2:172.21.15.149:3300/0 conn(0x7fb808142e40 0x7fb8080d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 --2- 172.21.15.118:0/3950463384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fae0 0x7fb8080d0e80 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 -- 172.21.15.118:0/3950463384 >> 172.21.15.118:0/3950463384 conn(0x7fb80806d110 msgr2=0x7fb80806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 -- 172.21.15.118:0/3950463384 shutdown_connections 2024-09-21T06:10:57.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.768+0000 7fb810600640 1 -- 172.21.15.118:0/3950463384 wait complete. 2024-09-21T06:10:57.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.770+0000 7fb810600640 1 Processor -- start 2024-09-21T06:10:57.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.771+0000 7fb810600640 1 -- start start 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb810600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb80813fae0 0x7fb808158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb810600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fef0 0x7fb8081342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb810600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb808142e40 0x7fb8081fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb810600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8080cfa70 con 0x7fb80813fef0 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb810600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8080cf8f0 con 0x7fb80813fae0 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb810600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8080cfbf0 con 0x7fb808142e40 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb80d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fef0 0x7fb8081342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb80d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fef0 0x7fb8081342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39580/0 (socket says 172.21.15.118:39580) 2024-09-21T06:10:57.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.772+0000 7fb80d200640 1 -- 172.21.15.118:0/2974834889 learned_addr learned my addr 172.21.15.118:0/2974834889 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80e600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb808142e40 0x7fb8081fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80dc00640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb80813fae0 0x7fb808158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80d200640 1 -- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb808142e40 msgr2=0x7fb8081fa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80d200640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb808142e40 0x7fb8081fa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80d200640 1 -- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb80813fae0 msgr2=0x7fb808158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80d200640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb80813fae0 0x7fb808158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80d200640 1 -- 172.21.15.118:0/2974834889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8081fa580 con 0x7fb80813fef0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb80d200640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fef0 0x7fb8081342c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400b420 tx=0x7fb7f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4011830 con 0x7fb80813fef0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7f4016070 con 0x7fb80813fef0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80815a9d0 con 0x7fb80813fef0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.773+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4011d60 con 0x7fb80813fef0 2024-09-21T06:10:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.774+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb808157e60 con 0x7fb80813fef0 2024-09-21T06:10:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.774+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8080d0190 con 0x7fb80813fef0 2024-09-21T06:10:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.776+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb7f401b460 con 0x7fb80813fef0 2024-09-21T06:10:57.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.777+0000 7fb805600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb7e8078bf0 0x7fb7e807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.777+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5767+0+0 (secure 0 0 0) 0x7fb7f409a880 con 0x7fb80813fef0 2024-09-21T06:10:57.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.777+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=136}) -- 0x7fb7e8080890 con 0x7fb80813fef0 2024-09-21T06:10:57.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.777+0000 7fb80dc00640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb7e8078bf0 0x7fb7e807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.778+0000 7fb80dc00640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb7e8078bf0 0x7fb7e807b100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc033000 tx=0x7fb7fc004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:57.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:57.781+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb7f4020020 con 0x7fb80813fef0 2024-09-21T06:10:58.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.002+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb80815bef0 con 0x7fb80813fef0 2024-09-21T06:10:58.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.002+0000 7fb805600640 1 -- 172.21.15.118:0/2974834889 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7fb8081fa580 con 0x7fb80813fef0 2024-09-21T06:10:58.004 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:58.004 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:10:58.004 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:10:58.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb7e8078bf0 msgr2=0x7fb7e807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb7e8078bf0 0x7fb7e807b100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc033000 tx=0x7fb7fc004730 comp rx=0 tx=0).stop 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fef0 msgr2=0x7fb8081342c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fef0 0x7fb8081342c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400b420 tx=0x7fb7f400b8e0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 shutdown_connections 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb7e8078bf0 0x7fb7e807b100 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb808142e40 0x7fb8081fa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb80813fef0 0x7fb8081342c0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 --2- 172.21.15.118:0/2974834889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb80813fae0 0x7fb808158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 >> 172.21.15.118:0/2974834889 conn(0x7fb80806d110 msgr2=0x7fb808142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 shutdown_connections 2024-09-21T06:10:58.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.005+0000 7fb810600640 1 -- 172.21.15.118:0/2974834889 wait complete. 2024-09-21T06:10:58.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:10:58.267 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":6963,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":25.019181322000001,"mdsmap_epoch":68,"osdmap_epoch":135,"osdmap_epoch_barrier":135,"uptime":30.035966518999999} 2024-09-21T06:10:58.267 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 6963, "mdsmap_epoch": 68, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "rank_uptime": 25.019181322, "state": "up:active", "uptime": 30.035966519, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:10:58.267 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:10:58.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:58.268 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-21T06:10:58.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:58.307 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-21T06:10:58.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:10:58.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.650+0000 7f20e1800640 1 -- 172.21.15.118:0/1057018741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc142e40 msgr2=0x7f20dc0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:58.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.650+0000 7f20e1800640 1 --2- 172.21.15.118:0/1057018741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc142e40 0x7f20dc0d13c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f20d4005fd0 tx=0x7f20d402aa10 comp rx=0 tx=0).stop 2024-09-21T06:10:58.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.650+0000 7f20e1800640 1 -- 172.21.15.118:0/1057018741 shutdown_connections 2024-09-21T06:10:58.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.650+0000 7f20e1800640 1 --2- 172.21.15.118:0/1057018741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc142e40 0x7f20dc0d13c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.650+0000 7f20e1800640 1 --2- 172.21.15.118:0/1057018741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 0x7f20dc0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.650+0000 7f20e1800640 1 -- 172.21.15.118:0/1057018741 >> 172.21.15.118:0/1057018741 conn(0x7f20dc06d110 msgr2=0x7f20dc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:58.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.650+0000 7f20e1800640 1 -- 172.21.15.118:0/1057018741 shutdown_connections 2024-09-21T06:10:58.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.651+0000 7f20e1800640 1 -- 172.21.15.118:0/1057018741 wait complete. 2024-09-21T06:10:58.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.653+0000 7f20e1800640 1 Processor -- start 2024-09-21T06:10:58.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.653+0000 7f20e1800640 1 -- start start 2024-09-21T06:10:58.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.654+0000 7f20e1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 0x7f20dc1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.654+0000 7f20e1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc13fef0 0x7f20dc14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.654+0000 7f20e1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc142e40 0x7f20dc073e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.654+0000 7f20e1800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc0cfac0 con 0x7f20dc13fef0 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.654+0000 7f20e1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc0cf940 con 0x7f20dc142e40 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.654+0000 7f20e1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f20dc0cfc40 con 0x7f20dc13fae0 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20daa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 0x7f20dc1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20da000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc13fef0 0x7f20dc14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20daa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 0x7f20dc1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:41332/0 (socket says 172.21.15.118:41332) 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20daa00640 1 -- 172.21.15.118:0/3878545629 learned_addr learned my addr 172.21.15.118:0/3878545629 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20db400640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc142e40 0x7f20dc073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20da000640 1 -- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 msgr2=0x7f20dc1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:58.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20da000640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 0x7f20dc1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20da000640 1 -- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc142e40 msgr2=0x7f20dc073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:58.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20da000640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc142e40 0x7f20dc073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20da000640 1 -- 172.21.15.118:0/3878545629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc1f9230 con 0x7f20dc13fef0 2024-09-21T06:10:58.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20daa00640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 0x7f20dc1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:58.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.655+0000 7f20da000640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc13fef0 0x7f20dc14dd70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c340 tx=0x7f20c800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.656+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8017070 con 0x7f20dc13fef0 2024-09-21T06:10:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.656+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20c80053c0 con 0x7f20dc13fef0 2024-09-21T06:10:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.656+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8003850 con 0x7f20dc13fef0 2024-09-21T06:10:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.656+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc1f9510 con 0x7f20dc13fef0 2024-09-21T06:10:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.656+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc1f9ad0 con 0x7f20dc13fef0 2024-09-21T06:10:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.657+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc0d00f0 con 0x7f20dc13fef0 2024-09-21T06:10:58.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.658+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20c801a070 con 0x7f20dc13fef0 2024-09-21T06:10:58.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.659+0000 7f20d2a00640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20bc078bc0 0x7f20bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:58.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.659+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5767+0+0 (secure 0 0 0) 0x7f20c809a0a0 con 0x7f20dc13fef0 2024-09-21T06:10:58.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.659+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=136}) -- 0x7f20bc080800 con 0x7f20dc13fef0 2024-09-21T06:10:58.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.660+0000 7f20daa00640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20bc078bc0 0x7f20bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:58.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.660+0000 7f20daa00640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20bc078bc0 0x7f20bc07b0d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f20cc011440 tx=0x7f20cc005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:58.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.664+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f20c8061db0 con 0x7f20dc13fef0 2024-09-21T06:10:58.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.847+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f20dc156610 con 0x7f20dc13fef0 2024-09-21T06:10:58.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.849+0000 7f20d2a00640 1 -- 172.21.15.118:0/3878545629 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) ==== 81+0+34749 (secure 0 0 0) 0x7f20c80667e0 con 0x7f20dc13fef0 2024-09-21T06:10:58.852 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:10:58.852 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:10:58.852 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 135, 2024-09-21T06:10:58.852 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:10:58.852 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:10:58.852 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:10:55.350705+0000", 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:10:58.853 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:10:58.854 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:10:58.855 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:10:58.855 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:10:58.855 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:10:58.855 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:10:58.855 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.855 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:10:58.855 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:58.856 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:58.857 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:58.858 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:58.859 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:58.860 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:10:58.861 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:10:58.862 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:58.863 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:58.864 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:58.866 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:58.868 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:58.869 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:58.870 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:58.871 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:10:58.872 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:10:58.873 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "135", 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:10:58.874 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:10:58.875 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:10:58.876 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:10:58.877 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:10:58.878 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.879 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.880 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:10:58.881 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:10:58.882 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:10:58.883 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:58.884 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:10:58.885 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:10:58.886 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.887 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.888 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:10:58.889 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.890 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.891 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.892 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.893 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.894 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:10:58.895 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.896 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:10:58.897 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.898 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.900 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.901 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:58.902 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.903 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.904 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.905 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.906 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.907 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.908 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.909 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.910 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.911 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.912 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:10:58.913 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.914 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.915 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.916 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:10:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:10:58.918 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.919 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:10:58.920 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.921 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:10:58.922 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:10:58.923 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:10:58.924 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.925 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.926 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.927 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.928 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.929 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:10:58.930 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.931 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:10:58.932 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:10:58.933 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:10:58.934 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:10:58.935 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:10:58.935 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:10:58.935 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:10:58.935 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:10:58.935 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:10:58.935 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:10:58.935 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:10:58.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.851+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20bc078bc0 msgr2=0x7f20bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20bc078bc0 0x7f20bc07b0d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f20cc011440 tx=0x7f20cc005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc13fef0 msgr2=0x7f20dc14dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc13fef0 0x7f20dc14dd70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c340 tx=0x7f20c800c800 comp rx=0 tx=0).stop 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 shutdown_connections 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc142e40 0x7f20dc073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20dc13fef0 0x7f20dc14dd70 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f20bc078bc0 0x7f20bc07b0d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 --2- 172.21.15.118:0/3878545629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20dc13fae0 0x7f20dc1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 >> 172.21.15.118:0/3878545629 conn(0x7f20dc06d110 msgr2=0x7f20dc15feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 shutdown_connections 2024-09-21T06:10:58.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:10:58.852+0000 7f20e1800640 1 -- 172.21.15.118:0/3878545629 wait complete. 2024-09-21T06:10:58.938 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:11:03.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:11:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.169+0000 7fd292400640 1 -- 172.21.15.118:0/4000125712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 msgr2=0x7fd28c142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.169+0000 7fd292400640 1 --2- 172.21.15.118:0/4000125712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c142e40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd284005fd0 tx=0x7fd28402aa10 comp rx=0 tx=0).stop 2024-09-21T06:11:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.169+0000 7fd292400640 1 -- 172.21.15.118:0/4000125712 shutdown_connections 2024-09-21T06:11:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.169+0000 7fd292400640 1 --2- 172.21.15.118:0/4000125712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c142e40 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.169+0000 7fd292400640 1 -- 172.21.15.118:0/4000125712 >> 172.21.15.118:0/4000125712 conn(0x7fd28c06d110 msgr2=0x7fd28c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.169+0000 7fd292400640 1 -- 172.21.15.118:0/4000125712 shutdown_connections 2024-09-21T06:11:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.169+0000 7fd292400640 1 -- 172.21.15.118:0/4000125712 wait complete. 2024-09-21T06:11:04.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.171+0000 7fd292400640 1 Processor -- start 2024-09-21T06:11:04.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.172+0000 7fd292400640 1 -- start start 2024-09-21T06:11:04.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd292400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd28c13fae0 0x7fd28c167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd292400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd292400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28c157f80 0x7fd28c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd292400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c168280 con 0x7fd28c13fef0 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd292400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c168100 con 0x7fd28c157f80 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd292400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c168400 con 0x7fd28c13fae0 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd28aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd28aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c15a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39602/0 (socket says 172.21.15.118:39602) 2024-09-21T06:11:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.173+0000 7fd28aa00640 1 -- 172.21.15.118:0/3482120139 learned_addr learned my addr 172.21.15.118:0/3482120139 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28be00640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28c157f80 0x7fd28c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28b400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd28c13fae0 0x7fd28c167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28aa00640 1 -- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd28c13fae0 msgr2=0x7fd28c167050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28aa00640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd28c13fae0 0x7fd28c167050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28aa00640 1 -- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28c157f80 msgr2=0x7fd28c15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28aa00640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28c157f80 0x7fd28c15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28aa00640 1 -- 172.21.15.118:0/3482120139 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c1577d0 con 0x7fd28c13fef0 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28be00640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28c157f80 0x7fd28c15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28b400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd28c13fae0 0x7fd28c167050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd28aa00640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c15a210 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b420 tx=0x7fd27800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278011830 con 0x7fd28c13fef0 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd278016070 con 0x7fd28c13fef0 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278011d60 con 0x7fd28c13fef0 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.174+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c158570 con 0x7fd28c13fef0 2024-09-21T06:11:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.175+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c158810 con 0x7fd28c13fef0 2024-09-21T06:11:04.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.176+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c157230 con 0x7fd28c13fef0 2024-09-21T06:11:04.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.177+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd27801b460 con 0x7fd28c13fef0 2024-09-21T06:11:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.178+0000 7fd283400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd26c078b90 0x7fd26c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.178+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5767+0+0 (secure 0 0 0) 0x7fd27809a870 con 0x7fd28c13fef0 2024-09-21T06:11:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.178+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=136}) -- 0x7fd26c080830 con 0x7fd28c13fef0 2024-09-21T06:11:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.178+0000 7fd28b400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd26c078b90 0x7fd26c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.179+0000 7fd28b400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd26c078b90 0x7fd26c07b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0016a0 tx=0x7fd27c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:04.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.182+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd28c157230 con 0x7fd28c13fef0 2024-09-21T06:11:04.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.372+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fd28c0d0e80 con 0x7fd28c13fef0 2024-09-21T06:11:04.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.373+0000 7fd283400640 1 -- 172.21.15.118:0/3482120139 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) ==== 81+0+34749 (secure 0 0 0) 0x7fd278020020 con 0x7fd28c13fef0 2024-09-21T06:11:04.376 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:04.376 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 135, 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:10:55.350705+0000", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:11:04.377 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:11:04.378 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:04.379 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:04.380 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:04.381 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:04.382 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:04.384 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:04.385 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:11:04.386 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:04.387 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:04.388 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:04.389 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.390 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:11:04.391 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:04.392 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "135", 2024-09-21T06:11:04.393 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:04.394 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.395 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:11:04.396 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.398 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.399 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.400 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.401 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:04.402 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:04.403 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.404 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:11:04.405 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:11:04.406 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:11:04.407 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.408 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.409 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.410 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:11:04.411 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.412 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:11:04.413 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.414 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.415 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.416 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.417 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.418 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:11:04.419 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.420 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.421 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:11:04.422 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.423 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.424 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.425 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.426 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.427 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.428 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.429 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:11:04.430 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.431 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.432 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.433 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.434 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.435 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.436 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:04.437 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.438 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.440 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.441 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.442 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:04.443 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.444 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:04.445 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.446 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.450 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:11:04.451 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:11:04.452 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:11:04.453 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:11:04.453 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:11:04.453 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:11:04.453 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:11:04.453 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:04.453 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:11:04.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd26c078b90 msgr2=0x7fd26c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd26c078b90 0x7fd26c07b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0016a0 tx=0x7fd27c009040 comp rx=0 tx=0).stop 2024-09-21T06:11:04.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 msgr2=0x7fd28c15a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c15a210 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b420 tx=0x7fd27800b8e0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 shutdown_connections 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28c157f80 0x7fd28c15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd28c13fef0 0x7fd28c15a210 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd26c078b90 0x7fd26c07b0a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 --2- 172.21.15.118:0/3482120139 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd28c13fae0 0x7fd28c167050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 >> 172.21.15.118:0/3482120139 conn(0x7fd28c06d110 msgr2=0x7fd28c06f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 shutdown_connections 2024-09-21T06:11:04.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:04.376+0000 7fd292400640 1 -- 172.21.15.118:0/3482120139 wait complete. 2024-09-21T06:11:04.456 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:11:09.456 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 -- 172.21.15.118:0/2824037912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56800d1590 msgr2=0x7f5680142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 --2- 172.21.15.118:0/2824037912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56800d1590 0x7f5680142730 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f568015d420 tx=0x7f566c02a560 comp rx=0 tx=0).stop 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 -- 172.21.15.118:0/2824037912 shutdown_connections 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 --2- 172.21.15.118:0/2824037912 >> v2:172.21.15.149:3300/0 conn(0x7f568013fef0 0x7f5680142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 --2- 172.21.15.118:0/2824037912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56800d1590 0x7f5680142730 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 -- 172.21.15.118:0/2824037912 >> 172.21.15.118:0/2824037912 conn(0x7f568006d110 msgr2=0x7f568006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 -- 172.21.15.118:0/2824037912 shutdown_connections 2024-09-21T06:11:09.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.698+0000 7f5688600640 1 -- 172.21.15.118:0/2824037912 wait complete. 2024-09-21T06:11:09.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.701+0000 7f5688600640 1 Processor -- start 2024-09-21T06:11:09.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.701+0000 7f5688600640 1 -- start start 2024-09-21T06:11:09.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.702+0000 7f5688600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568013fae0 0x7f56801f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.702+0000 7f5688600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f568013fef0 0x7f56801e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.702+0000 7f5688600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56801389e0 0x7f568015f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.702+0000 7f5688600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f56800cfa70 con 0x7f568013fae0 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.702+0000 7f5688600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f56800cf8f0 con 0x7f568013fef0 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.702+0000 7f5688600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f56800cfbf0 con 0x7f56801389e0 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568013fae0 0x7f56801f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568013fae0 0x7f56801f7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55232/0 (socket says 172.21.15.118:55232) 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 -- 172.21.15.118:0/2715985555 learned_addr learned my addr 172.21.15.118:0/2715985555 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5686600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56801389e0 0x7f568015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685200640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f568013fef0 0x7f56801e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 -- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56801389e0 msgr2=0x7f568015f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56801389e0 0x7f568015f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 -- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f568013fef0 msgr2=0x7f56801e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f568013fef0 0x7f56801e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 -- 172.21.15.118:0/2715985555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56801f8500 con 0x7f568013fae0 2024-09-21T06:11:09.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.703+0000 7f5685c00640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568013fae0 0x7f56801f7fc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f567400c3d0 tx=0x7f567400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:09.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.704+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674017070 con 0x7f568013fae0 2024-09-21T06:11:09.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.704+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56740053c0 con 0x7f568013fae0 2024-09-21T06:11:09.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.704+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674003850 con 0x7f568013fae0 2024-09-21T06:11:09.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.704+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56801e6bc0 con 0x7f568013fae0 2024-09-21T06:11:09.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.704+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56801e7180 con 0x7f568013fae0 2024-09-21T06:11:09.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.705+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56800d0110 con 0x7f568013fae0 2024-09-21T06:11:09.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.706+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f567401a070 con 0x7f568013fae0 2024-09-21T06:11:09.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.708+0000 7f567d600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5660078bc0 0x7f566007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.708+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5767+0+0 (secure 0 0 0) 0x7f567409a060 con 0x7f568013fae0 2024-09-21T06:11:09.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.708+0000 7f5685200640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5660078bc0 0x7f566007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.708+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=136}) -- 0x7f5660080800 con 0x7f568013fae0 2024-09-21T06:11:09.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.709+0000 7f5685200640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5660078bc0 0x7f566007b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f566c033000 tx=0x7f566c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:09.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.713+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f56801f8500 con 0x7f568013fae0 2024-09-21T06:11:09.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.898+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f568015c370 con 0x7f568013fae0 2024-09-21T06:11:09.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.899+0000 7f567d600640 1 -- 172.21.15.118:0/2715985555 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v135) ==== 81+0+34749 (secure 0 0 0) 0x7f5674061e00 con 0x7f568013fae0 2024-09-21T06:11:09.902 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:09.902 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:11:09.902 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 135, 2024-09-21T06:11:09.902 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:11:09.902 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:10:55.350705+0000", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:11:09.903 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:11:09.904 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:09.905 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:09.906 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:09.907 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:09.908 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:09.909 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:11:09.910 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:09.911 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:11:09.912 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:09.913 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:09.914 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:09.915 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:09.916 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.917 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:09.918 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:09.919 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "135", 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:09.920 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:09.921 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:09.922 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:09.922 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:09.922 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.922 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:09.922 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:09.922 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:09.923 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:09.923 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:09.923 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:09.923 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:09.923 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:09.923 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:09.924 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:09.924 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:09.924 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:09.924 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:11:09.924 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:11:09.924 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:11:09.925 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.926 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:11:09.927 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.928 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.929 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.930 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.931 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.931 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.931 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.931 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.931 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.931 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:11:09.932 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.932 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.932 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.932 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.932 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:11:09.932 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:09.932 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.933 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.933 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.933 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:11:09.933 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:11:09.933 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:11:09.933 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:11:09.933 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.934 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.935 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.935 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.935 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.935 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.935 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:09.936 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.936 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.936 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.936 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.936 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.936 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.937 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.938 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:11:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:11:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:11:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:11:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:11:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:11:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:11:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:11:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:11:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:11:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:11:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:11:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:11:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:09.988 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:11:09.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5660078bc0 msgr2=0x7f566007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5660078bc0 0x7f566007b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f566c033000 tx=0x7f566c004730 comp rx=0 tx=0).stop 2024-09-21T06:11:09.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568013fae0 msgr2=0x7f56801f7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568013fae0 0x7f56801f7fc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f567400c3d0 tx=0x7f567400c890 comp rx=0 tx=0).stop 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 shutdown_connections 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5660078bc0 0x7f566007b0d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56801389e0 0x7f568015f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f568013fef0 0x7f56801e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 --2- 172.21.15.118:0/2715985555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568013fae0 0x7f56801f7fc0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 >> 172.21.15.118:0/2715985555 conn(0x7f568006d110 msgr2=0x7f5680153ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 shutdown_connections 2024-09-21T06:11:09.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:09.902+0000 7f5688600640 1 -- 172.21.15.118:0/2715985555 wait complete. 2024-09-21T06:11:09.991 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:11:14.991 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:11:15.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 -- 172.21.15.118:0/1617831736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c142c00 msgr2=0x7f729c0cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 --2- 172.21.15.118:0/1617831736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c142c00 0x7f729c0cf240 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f729c154510 tx=0x7f729402aa30 comp rx=0 tx=0).stop 2024-09-21T06:11:15.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 -- 172.21.15.118:0/1617831736 shutdown_connections 2024-09-21T06:11:15.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 --2- 172.21.15.118:0/1617831736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c142c00 0x7f729c0cf240 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 --2- 172.21.15.118:0/1617831736 >> v2:172.21.15.149:3300/0 conn(0x7f729c0d15f0 0x7f729c1426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 -- 172.21.15.118:0/1617831736 >> 172.21.15.118:0/1617831736 conn(0x7f729c06d110 msgr2=0x7f729c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:15.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 -- 172.21.15.118:0/1617831736 shutdown_connections 2024-09-21T06:11:15.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.219+0000 7f72a4000640 1 -- 172.21.15.118:0/1617831736 wait complete. 2024-09-21T06:11:15.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.222+0000 7f72a4000640 1 Processor -- start 2024-09-21T06:11:15.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.222+0000 7f72a4000640 1 -- start start 2024-09-21T06:11:15.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.223+0000 7f72a4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f729c13fe10 0x7f729c1f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.223+0000 7f72a4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f729c142c00 0x7f729c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.223+0000 7f72a4000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c141a80 0x7f729c139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.223+0000 7f72a4000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f729c0cfb10 con 0x7f729c141a80 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.223+0000 7f72a4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f729c0cf990 con 0x7f729c13fe10 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.223+0000 7f72a4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f729c0cfc90 con 0x7f729c142c00 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c141a80 0x7f729c139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c141a80 0x7f729c139f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55252/0 (socket says 172.21.15.118:55252) 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 -- 172.21.15.118:0/990228794 learned_addr learned my addr 172.21.15.118:0/990228794 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a0c00640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f729c142c00 0x7f729c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a1600640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f729c13fe10 0x7f729c1f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 -- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f729c142c00 msgr2=0x7f729c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f729c142c00 0x7f729c156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 -- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f729c13fe10 msgr2=0x7f729c1f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f729c13fe10 0x7f729c1f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 -- 172.21.15.118:0/990228794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c1573e0 con 0x7f729c141a80 2024-09-21T06:11:15.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.224+0000 7f72a2000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c141a80 0x7f729c139f10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f729402b020 tx=0x7f7294003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:15.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.225+0000 7f7299600640 1 -- 172.21.15.118:0/990228794 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294033050 con 0x7f729c141a80 2024-09-21T06:11:15.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.225+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729c13a450 con 0x7f729c141a80 2024-09-21T06:11:15.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.225+0000 7f7299600640 1 -- 172.21.15.118:0/990228794 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7294004540 con 0x7f729c141a80 2024-09-21T06:11:15.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.225+0000 7f7299600640 1 -- 172.21.15.118:0/990228794 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294038450 con 0x7f729c141a80 2024-09-21T06:11:15.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.225+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729c1fa080 con 0x7f729c141a80 2024-09-21T06:11:15.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.226+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f729c0703c0 con 0x7f729c141a80 2024-09-21T06:11:15.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.227+0000 7f7299600640 1 -- 172.21.15.118:0/990228794 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7294036070 con 0x7f729c141a80 2024-09-21T06:11:15.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.229+0000 7f7299600640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f727c078bc0 0x7f727c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.229+0000 7f7299600640 1 -- 172.21.15.118:0/990228794 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f72940bc220 con 0x7f729c141a80 2024-09-21T06:11:15.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.229+0000 7f72a1600640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f727c078bc0 0x7f727c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.230+0000 7f72a1600640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f727c078bc0 0x7f727c07b0d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f729c143600 tx=0x7f7290009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:15.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.233+0000 7f7299600640 1 -- 172.21.15.118:0/990228794 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f729c0703c0 con 0x7f729c141a80 2024-09-21T06:11:15.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.422+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f729c15fd80 con 0x7f729c141a80 2024-09-21T06:11:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.423+0000 7f7299600640 1 -- 172.21.15.118:0/990228794 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) ==== 81+0+34730 (secure 0 0 0) 0x7f7294084500 con 0x7f729c141a80 2024-09-21T06:11:15.426 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:15.426 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:11:15.426 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 136, 2024-09-21T06:11:15.426 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:11:15.426 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:11:15.426 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:11:10.354572+0000", 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:11:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:11:15.428 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:11:15.429 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:11:15.430 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:15.431 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:15.432 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:11:15.433 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.434 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:15.435 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.436 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:15.437 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.438 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:11:15.439 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:11:15.440 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:15.441 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:15.442 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "136", 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:15.443 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:15.444 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:15.445 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:15.446 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:15.447 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.448 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:11:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:11:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:11:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:11:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:11:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:11:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:11:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:11:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:11:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:11:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:11:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:11:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:11:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.501 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:11:15.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f727c078bc0 msgr2=0x7f727c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f727c078bc0 0x7f727c07b0d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f729c143600 tx=0x7f7290009040 comp rx=0 tx=0).stop 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c141a80 msgr2=0x7f729c139f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c141a80 0x7f729c139f10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f729402b020 tx=0x7f7294003f10 comp rx=0 tx=0).stop 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 shutdown_connections 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f729c141a80 0x7f729c139f10 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f727c078bc0 0x7f727c07b0d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f729c142c00 0x7f729c156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 --2- 172.21.15.118:0/990228794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f729c13fe10 0x7f729c1f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 >> 172.21.15.118:0/990228794 conn(0x7f729c06d110 msgr2=0x7f729c06ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 shutdown_connections 2024-09-21T06:11:15.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.426+0000 7f72a4000640 1 -- 172.21.15.118:0/990228794 wait complete. 2024-09-21T06:11:15.504 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2024-09-21T06:11:15.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:11:15.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.721+0000 7f58cce00640 1 -- 172.21.15.118:0/1893614771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac004d40 msgr2=0x7f58ac005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.721+0000 7f58cce00640 1 --2- 172.21.15.118:0/1893614771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac004d40 0x7f58ac005190 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f58c80b5e20 tx=0x7f58ac005830 comp rx=0 tx=0).stop 2024-09-21T06:11:15.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.721+0000 7f58c6800640 1 -- 172.21.15.118:0/1893614771 reap_dead start 2024-09-21T06:11:15.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.721+0000 7f58cce00640 1 -- 172.21.15.118:0/1893614771 shutdown_connections 2024-09-21T06:11:15.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.721+0000 7f58cce00640 1 -- 172.21.15.118:0/1893614771 >> 172.21.15.118:0/1893614771 conn(0x7f58c806d110 msgr2=0x7f58c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:15.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.721+0000 7f58cce00640 1 -- 172.21.15.118:0/1893614771 shutdown_connections 2024-09-21T06:11:15.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.721+0000 7f58cce00640 1 -- 172.21.15.118:0/1893614771 wait complete. 2024-09-21T06:11:15.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.724+0000 7f58cce00640 1 Processor -- start 2024-09-21T06:11:15.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.724+0000 7f58cce00640 1 -- start start 2024-09-21T06:11:15.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.725+0000 7f58cce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ac004d40 0x7f58c81e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.725+0000 7f58cce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c81f7850 0x7f58c80cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.725+0000 7f58cce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c81f4a10 0x7f58c81f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.725+0000 7f58cce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8073700 con 0x7f58c81f7850 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.725+0000 7f58cce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8073580 con 0x7f58c81f4a10 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.725+0000 7f58cce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58c8073880 con 0x7f58ac004d40 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c81f7850 0x7f58c80cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c81f7850 0x7f58c80cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55278/0 (socket says 172.21.15.118:55278) 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 -- 172.21.15.118:0/3957963813 learned_addr learned my addr 172.21.15.118:0/3957963813 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5e00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ac004d40 0x7f58c81e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c6800640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c81f4a10 0x7f58c81f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 -- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ac004d40 msgr2=0x7f58c81e6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ac004d40 0x7f58c81e6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 -- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c81f4a10 msgr2=0x7f58c81f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c81f4a10 0x7f58c81f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 -- 172.21.15.118:0/3957963813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c80cc800 con 0x7f58c81f7850 2024-09-21T06:11:15.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5e00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ac004d40 0x7f58c81e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:15.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.726+0000 7f58c5400640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c81f7850 0x7f58c80cc2c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f58b400fa00 tx=0x7f58b400fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:15.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.727+0000 7f58be000640 1 -- 172.21.15.118:0/3957963813 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400bcb0 con 0x7f58c81f7850 2024-09-21T06:11:15.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.727+0000 7f58be000640 1 -- 172.21.15.118:0/3957963813 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58b4004030 con 0x7f58c81f7850 2024-09-21T06:11:15.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.727+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c81e52e0 con 0x7f58c81f7850 2024-09-21T06:11:15.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.727+0000 7f58be000640 1 -- 172.21.15.118:0/3957963813 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4004460 con 0x7f58c81f7850 2024-09-21T06:11:15.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.727+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c81e58a0 con 0x7f58c81f7850 2024-09-21T06:11:15.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.728+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c81e5050 con 0x7f58c81f7850 2024-09-21T06:11:15.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.729+0000 7f58be000640 1 -- 172.21.15.118:0/3957963813 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58b40035f0 con 0x7f58c81f7850 2024-09-21T06:11:15.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.730+0000 7f58be000640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58a8078b90 0x7f58a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.730+0000 7f58be000640 1 -- 172.21.15.118:0/3957963813 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f58b409b860 con 0x7f58c81f7850 2024-09-21T06:11:15.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.730+0000 7f58c5e00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58a8078b90 0x7f58a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.731+0000 7f58c5e00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58a8078b90 0x7f58a807b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f58b8006c90 tx=0x7f58b80067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:15.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.734+0000 7f58be000640 1 -- 172.21.15.118:0/3957963813 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58b4063570 con 0x7f58c81f7850 2024-09-21T06:11:15.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.920+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f58c81e68c0 con 0x7f58c81f7850 2024-09-21T06:11:15.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.922+0000 7f58be000640 1 -- 172.21.15.118:0/3957963813 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) ==== 81+0+34730 (secure 0 0 0) 0x7f58b4067fa0 con 0x7f58c81f7850 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 136, 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:11:10.354572+0000", 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:11:15.925 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 17, 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:11:15.926 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "luminous", 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:15.929 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:15.930 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 16, 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:30.625521+0000", 2024-09-21T06:11:15.933 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:11:15.934 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "131", 2024-09-21T06:11:15.935 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:15.936 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:15.937 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:11:15.938 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.75, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.75, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.75, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.75, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:15.939 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 17, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:10:31.678886+0000", 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:11:15.940 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:11:15.941 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "136", 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:11:15.942 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:11:15.943 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:11:15.944 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.6299999952316284, 2024-09-21T06:11:15.945 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.6299999952316284, 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.946 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.947 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.948 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.949 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.950 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:11:15.951 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.952 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:11:15.953 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:11:15.954 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.955 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:11:15.956 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.957 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.958 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.959 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.960 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.961 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.962 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.963 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.968 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.969 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.971 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.972 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:11:15.973 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.974 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.975 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.976 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.977 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.978 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.979 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 130, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.980 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.981 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.983 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:11:15.984 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:11:15.985 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 133, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.986 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.987 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.988 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:11:15.989 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.990 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.991 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:11:15.992 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:11:15.993 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.994 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.995 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [ 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.c", 2024-09-21T06:11:15.996 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 5 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: "pgid": "17.3c", 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: "mappings": [ 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: "from": 0, 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: "to": 2 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:15.997 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:11:15.998 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:15.999 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58a8078b90 msgr2=0x7f58a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58a8078b90 0x7f58a807b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f58b8006c90 tx=0x7f58b80067a0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c81f7850 msgr2=0x7f58c80cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c81f7850 0x7f58c80cc2c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f58b400fa00 tx=0x7f58b400fec0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 shutdown_connections 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c81f4a10 0x7f58c81f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c81f7850 0x7f58c80cc2c0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f58a8078b90 0x7f58a807b0a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 --2- 172.21.15.118:0/3957963813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58ac004d40 0x7f58c81e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 >> 172.21.15.118:0/3957963813 conn(0x7f58c806d110 msgr2=0x7f58c8156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:16.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 shutdown_connections 2024-09-21T06:11:16.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:15.924+0000 7f58cce00640 1 -- 172.21.15.118:0/3957963813 wait complete. 2024-09-21T06:11:16.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:16.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.219+0000 7f59f0400640 1 -- 172.21.15.118:0/109369436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d0005380 msgr2=0x7f59d000ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.219+0000 7f59f0400640 1 --2- 172.21.15.118:0/109369436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d0005380 0x7f59d000ba40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f59e0006ea0 tx=0x7f59d0005830 comp rx=0 tx=0).stop 2024-09-21T06:11:16.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.219+0000 7f59f0400640 1 -- 172.21.15.118:0/109369436 shutdown_connections 2024-09-21T06:11:16.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.219+0000 7f59f0400640 1 --2- 172.21.15.118:0/109369436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59d0005380 0x7f59d000ba40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.219+0000 7f59f0400640 1 -- 172.21.15.118:0/109369436 >> 172.21.15.118:0/109369436 conn(0x7f59e806d110 msgr2=0x7f59e806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.220+0000 7f59f0400640 1 -- 172.21.15.118:0/109369436 shutdown_connections 2024-09-21T06:11:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.220+0000 7f59f0400640 1 -- 172.21.15.118:0/109369436 wait complete. 2024-09-21T06:11:16.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.222+0000 7f59f0400640 1 Processor -- start 2024-09-21T06:11:16.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.222+0000 7f59f0400640 1 -- start start 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59f0400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d0005380 0x7f59e8152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59f0400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59e8157940 0x7f59e8143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59f0400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815a7b0 0x7f59e81f9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59f0400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59e815f7e0 con 0x7f59e815a7b0 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59f0400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59e815f660 con 0x7f59e8157940 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59f0400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59e815f960 con 0x7f59d0005380 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815a7b0 0x7f59e81f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815a7b0 0x7f59e81f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58068/0 (socket says 172.21.15.118:58068) 2024-09-21T06:11:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 -- 172.21.15.118:0/2944234113 learned_addr learned my addr 172.21.15.118:0/2944234113 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59eda00640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d0005380 0x7f59e8152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ed000640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59e8157940 0x7f59e8143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 -- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d0005380 msgr2=0x7f59e8152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d0005380 0x7f59e8152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 -- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59e8157940 msgr2=0x7f59e8143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59e8157940 0x7f59e8143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.224+0000 7f59ee400640 1 -- 172.21.15.118:0/2944234113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e8159710 con 0x7f59e815a7b0 2024-09-21T06:11:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.225+0000 7f59ee400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815a7b0 0x7f59e81f9140 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f59e002cc20 tx=0x7f59e0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:16.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.225+0000 7f59e5600640 1 -- 172.21.15.118:0/2944234113 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e0003b70 con 0x7f59e815a7b0 2024-09-21T06:11:16.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.225+0000 7f59e5600640 1 -- 172.21.15.118:0/2944234113 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59e0003e20 con 0x7f59e815a7b0 2024-09-21T06:11:16.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.225+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e81599f0 con 0x7f59e815a7b0 2024-09-21T06:11:16.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.225+0000 7f59e5600640 1 -- 172.21.15.118:0/2944234113 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e002db30 con 0x7f59e815a7b0 2024-09-21T06:11:16.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.225+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e8159fb0 con 0x7f59e815a7b0 2024-09-21T06:11:16.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.226+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e8158060 con 0x7f59e815a7b0 2024-09-21T06:11:16.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.227+0000 7f59e5600640 1 -- 172.21.15.118:0/2944234113 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59e002dcd0 con 0x7f59e815a7b0 2024-09-21T06:11:16.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.228+0000 7f59e5600640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59c8078bc0 0x7f59c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.228+0000 7f59e5600640 1 -- 172.21.15.118:0/2944234113 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f59e00bb2f0 con 0x7f59e815a7b0 2024-09-21T06:11:16.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.229+0000 7f59eda00640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59c8078bc0 0x7f59c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:16.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.229+0000 7f59eda00640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59c8078bc0 0x7f59c807b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00ac80 tx=0x7f59dc005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:16.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.233+0000 7f59e5600640 1 -- 172.21.15.118:0/2944234113 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f59e003c070 con 0x7f59e815a7b0 2024-09-21T06:11:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.455+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59e815c490 con 0x7f59e815a7b0 2024-09-21T06:11:16.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.455+0000 7f59e5600640 1 -- 172.21.15.118:0/2944234113 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f59e00836e0 con 0x7f59e815a7b0 2024-09-21T06:11:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:16.458 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:11:16.458 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:11:16.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59c8078bc0 msgr2=0x7f59c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59c8078bc0 0x7f59c807b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00ac80 tx=0x7f59dc005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:16.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815a7b0 msgr2=0x7f59e81f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815a7b0 0x7f59e81f9140 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f59e002cc20 tx=0x7f59e0005f30 comp rx=0 tx=0).stop 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 shutdown_connections 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815a7b0 0x7f59e81f9140 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59e8157940 0x7f59e8143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f59c8078bc0 0x7f59c807b0d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 --2- 172.21.15.118:0/2944234113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59d0005380 0x7f59e8152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 >> 172.21.15.118:0/2944234113 conn(0x7f59e806d110 msgr2=0x7f59e8073930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 shutdown_connections 2024-09-21T06:11:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:16.458+0000 7f59f0400640 1 -- 172.21.15.118:0/2944234113 wait complete. 2024-09-21T06:11:16.483 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:11:16.723 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":6963,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":43.472894730999997,"mdsmap_epoch":68,"osdmap_epoch":136,"osdmap_epoch_barrier":135,"uptime":48.489682492999997} 2024-09-21T06:11:16.723 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 6963, "mdsmap_epoch": 68, "osdmap_epoch": 136, "osdmap_epoch_barrier": 135, "rank_uptime": 43.472894731, "state": "up:active", "uptime": 48.489682493, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:11:16.723 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:11:16.723 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:11:16.723 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:16.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:16.759 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-21T06:11:17.212 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:11:17.212 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:11:17.212 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.376288 s, 139 MB/s 2024-09-21T06:11:17.213 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:11:17.213 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:11:17.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:11:17.388 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:11:17.388 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:11:17.388 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:11:17.388 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:17.424 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:11:17.424 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:17.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:11:17.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.759+0000 7f6b89200640 1 -- 172.21.15.118:0/3536907438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b84142e40 msgr2=0x7f6b840d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.759+0000 7f6b89200640 1 --2- 172.21.15.118:0/3536907438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b84142e40 0x7f6b840d13c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6b84071c00 tx=0x7f6b7c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:11:17.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.759+0000 7f6b89200640 1 -- 172.21.15.118:0/3536907438 shutdown_connections 2024-09-21T06:11:17.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.759+0000 7f6b89200640 1 --2- 172.21.15.118:0/3536907438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b84142e40 0x7f6b840d13c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.759+0000 7f6b89200640 1 --2- 172.21.15.118:0/3536907438 >> v2:172.21.15.149:3300/0 conn(0x7f6b8413fae0 0x7f6b840d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.759+0000 7f6b89200640 1 -- 172.21.15.118:0/3536907438 >> 172.21.15.118:0/3536907438 conn(0x7f6b8406d110 msgr2=0x7f6b8406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:17.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.760+0000 7f6b89200640 1 -- 172.21.15.118:0/3536907438 shutdown_connections 2024-09-21T06:11:17.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.760+0000 7f6b89200640 1 -- 172.21.15.118:0/3536907438 wait complete. 2024-09-21T06:11:17.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.762+0000 7f6b89200640 1 Processor -- start 2024-09-21T06:11:17.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.762+0000 7f6b89200640 1 -- start start 2024-09-21T06:11:17.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.763+0000 7f6b89200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b8413fae0 0x7f6b841f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.763+0000 7f6b89200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b8413fef0 0x7f6b8413e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.763+0000 7f6b89200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b84142e40 0x7f6b8413e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.763+0000 7f6b89200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b840cfa70 con 0x7f6b8413fef0 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.763+0000 7f6b89200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b840cf8f0 con 0x7f6b8413fae0 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.763+0000 7f6b89200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b840cfbf0 con 0x7f6b84142e40 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.763+0000 7f6b7be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b8413fef0 0x7f6b8413e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b81e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b8413fae0 0x7f6b841f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b8413fef0 0x7f6b8413e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58092/0 (socket says 172.21.15.118:58092) 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 -- 172.21.15.118:0/4144470946 learned_addr learned my addr 172.21.15.118:0/4144470946 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b81e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b8413fae0 0x7f6b841f6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:35990/0 (socket says 172.21.15.118:35990) 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b82800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b84142e40 0x7f6b8413e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 -- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b84142e40 msgr2=0x7f6b8413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b84142e40 0x7f6b8413e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 -- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b8413fae0 msgr2=0x7f6b841f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b8413fae0 0x7f6b841f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 -- 172.21.15.118:0/4144470946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b841575d0 con 0x7f6b8413fef0 2024-09-21T06:11:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.764+0000 7f6b7be00640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b8413fef0 0x7f6b8413e1b0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c400 tx=0x7f6b6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.765+0000 7f6b7a000640 1 -- 172.21.15.118:0/4144470946 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c017070 con 0x7f6b8413fef0 2024-09-21T06:11:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.765+0000 7f6b7a000640 1 -- 172.21.15.118:0/4144470946 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b6c0053c0 con 0x7f6b8413fef0 2024-09-21T06:11:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.765+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b841415b0 con 0x7f6b8413fef0 2024-09-21T06:11:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.765+0000 7f6b7a000640 1 -- 172.21.15.118:0/4144470946 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c003850 con 0x7f6b8413fef0 2024-09-21T06:11:17.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.765+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b84157b50 con 0x7f6b8413fef0 2024-09-21T06:11:17.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.766+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b841f4cc0 con 0x7f6b8413fef0 2024-09-21T06:11:17.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.767+0000 7f6b7a000640 1 -- 172.21.15.118:0/4144470946 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b6c01a070 con 0x7f6b8413fef0 2024-09-21T06:11:17.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.768+0000 7f6b7a000640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b60078b90 0x7f6b6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.768+0000 7f6b7a000640 1 -- 172.21.15.118:0/4144470946 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f6b6c099f00 con 0x7f6b8413fef0 2024-09-21T06:11:17.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.768+0000 7f6b81e00640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b60078b90 0x7f6b6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.769+0000 7f6b81e00640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b60078b90 0x7f6b6007b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009b30 tx=0x7f6b74005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:17.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.772+0000 7f6b7a000640 1 -- 172.21.15.118:0/4144470946 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6b6c061dd0 con 0x7f6b8413fef0 2024-09-21T06:11:17.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.966+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6b840d0110 con 0x7f6b8413fef0 2024-09-21T06:11:17.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.967+0000 7f6b7a000640 1 -- 172.21.15.118:0/4144470946 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v136) ==== 80+0+0 (secure 0 0 0) 0x7f6b6c066800 con 0x7f6b8413fef0 2024-09-21T06:11:17.969 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:11:17.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b60078b90 msgr2=0x7f6b6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b60078b90 0x7f6b6007b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009b30 tx=0x7f6b74005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b8413fef0 msgr2=0x7f6b8413e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b8413fef0 0x7f6b8413e1b0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c400 tx=0x7f6b6c00c8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 shutdown_connections 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6b60078b90 0x7f6b6007b0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b84142e40 0x7f6b8413e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b8413fef0 0x7f6b8413e1b0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 --2- 172.21.15.118:0/4144470946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b8413fae0 0x7f6b841f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 >> 172.21.15.118:0/4144470946 conn(0x7f6b8406d110 msgr2=0x7f6b8415f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 shutdown_connections 2024-09-21T06:11:17.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:17.969+0000 7f6b89200640 1 -- 172.21.15.118:0/4144470946 wait complete. 2024-09-21T06:11:17.996 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:11:17.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:17.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:11:18.099 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:11:18.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:18.100 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:11:18.140 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:11:18.140 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:11:18.140 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:18.177 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:11:18.177 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:18.252 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:11:18.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.471+0000 7f9e1e200640 1 -- 172.21.15.118:0/4144527939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fae0 msgr2=0x7f9e180d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.471+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4144527939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fae0 0x7f9e180d0e80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f9e180cedb0 tx=0x7f9e0802a560 comp rx=0 tx=0).stop 2024-09-21T06:11:18.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.471+0000 7f9e1e200640 1 -- 172.21.15.118:0/4144527939 shutdown_connections 2024-09-21T06:11:18.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.471+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4144527939 >> v2:172.21.15.149:3300/0 conn(0x7f9e1813fef0 0x7f9e180d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.472+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4144527939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fae0 0x7f9e180d0e80 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.472+0000 7f9e1e200640 1 -- 172.21.15.118:0/4144527939 >> 172.21.15.118:0/4144527939 conn(0x7f9e1806d110 msgr2=0x7f9e1806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:18.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.472+0000 7f9e1e200640 1 -- 172.21.15.118:0/4144527939 shutdown_connections 2024-09-21T06:11:18.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.472+0000 7f9e1e200640 1 -- 172.21.15.118:0/4144527939 wait complete. 2024-09-21T06:11:18.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.474+0000 7f9e1e200640 1 Processor -- start 2024-09-21T06:11:18.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.474+0000 7f9e1e200640 1 -- start start 2024-09-21T06:11:18.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.475+0000 7f9e1e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e1813fae0 0x7f9e181588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.475+0000 7f9e1e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fef0 0x7f9e180740e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.475+0000 7f9e1e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e18142730 0x7f9e1815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.475+0000 7f9e1e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9e180cfa70 con 0x7f9e1813fef0 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.475+0000 7f9e1e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e180cf8f0 con 0x7f9e1813fae0 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.475+0000 7f9e1e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e180cfbf0 con 0x7f9e18142730 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e0ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fef0 0x7f9e180740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e17400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e1813fae0 0x7f9e181588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e0ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fef0 0x7f9e180740e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58116/0 (socket says 172.21.15.118:58116) 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e0ea00640 1 -- 172.21.15.118:0/4110939964 learned_addr learned my addr 172.21.15.118:0/4110939964 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e17e00640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e18142730 0x7f9e1815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e17400640 1 -- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e18142730 msgr2=0x7f9e1815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e17400640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e18142730 0x7f9e1815a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e17400640 1 -- 172.21.15.118:0/4110939964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fef0 msgr2=0x7f9e180740e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e17400640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fef0 0x7f9e180740e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.476+0000 7f9e17400640 1 -- 172.21.15.118:0/4110939964 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e181f9bf0 con 0x7f9e1813fae0 2024-09-21T06:11:18.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.477+0000 7f9e17400640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e1813fae0 0x7f9e181588d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9e08031000 tx=0x7f9e080038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:18.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.477+0000 7f9e0fe00640 1 -- 172.21.15.118:0/4110939964 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0803e030 con 0x7f9e1813fae0 2024-09-21T06:11:18.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.477+0000 7f9e0fe00640 1 -- 172.21.15.118:0/4110939964 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e08003d90 con 0x7f9e1813fae0 2024-09-21T06:11:18.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.477+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e181f9ed0 con 0x7f9e1813fae0 2024-09-21T06:11:18.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.477+0000 7f9e0fe00640 1 -- 172.21.15.118:0/4110939964 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08035040 con 0x7f9e1813fae0 2024-09-21T06:11:18.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.477+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e181fa490 con 0x7f9e1813fae0 2024-09-21T06:11:18.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.478+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e180d0110 con 0x7f9e1813fae0 2024-09-21T06:11:18.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.479+0000 7f9e0fe00640 1 -- 172.21.15.118:0/4110939964 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e08041030 con 0x7f9e1813fae0 2024-09-21T06:11:18.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.480+0000 7f9e0fe00640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9df4078b90 0x7f9df407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.480+0000 7f9e0fe00640 1 -- 172.21.15.118:0/4110939964 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f9e080bb730 con 0x7f9e1813fae0 2024-09-21T06:11:18.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.481+0000 7f9e0ea00640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9df4078b90 0x7f9df407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.481+0000 7f9e0ea00640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9df4078b90 0x7f9df407b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9e18074e10 tx=0x7f9e00005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:18.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.485+0000 7f9e0fe00640 1 -- 172.21.15.118:0/4110939964 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e080834d0 con 0x7f9e1813fae0 2024-09-21T06:11:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.683+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9e1815cda0 con 0x7f9e1813fae0 2024-09-21T06:11:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.684+0000 7f9e0fe00640 1 -- 172.21.15.118:0/4110939964 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v136) ==== 80+0+0 (secure 0 0 0) 0x7f9e08087f00 con 0x7f9e1813fae0 2024-09-21T06:11:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:11:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9df4078b90 msgr2=0x7f9df407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9df4078b90 0x7f9df407b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9e18074e10 tx=0x7f9e00005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e1813fae0 msgr2=0x7f9e181588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e1813fae0 0x7f9e181588d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9e08031000 tx=0x7f9e080038a0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 shutdown_connections 2024-09-21T06:11:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9df4078b90 0x7f9df407b0a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e18142730 0x7f9e1815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e1813fef0 0x7f9e180740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 --2- 172.21.15.118:0/4110939964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e1813fae0 0x7f9e181588d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.686+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 >> 172.21.15.118:0/4110939964 conn(0x7f9e1806d110 msgr2=0x7f9e1815b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.687+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 shutdown_connections 2024-09-21T06:11:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:18.687+0000 7f9e1e200640 1 -- 172.21.15.118:0/4110939964 wait complete. 2024-09-21T06:11:18.711 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:11:18.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:18.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:11:18.772 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:11:18.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:18.773 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:11:18.808 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:11:18.809 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:11:18.809 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:18.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:11:18.844 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:11:18.844 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:11:18.844 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:18.884 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:11:18.884 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:19.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.100+0000 7f2206e00640 1 -- 172.21.15.118:0/827450078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 msgr2=0x7f22000d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.100+0000 7f2206e00640 1 --2- 172.21.15.118:0/827450078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 0x7f22000d1ae0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f2200070a00 tx=0x7f21f402a4b0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.100+0000 7f2206e00640 1 -- 172.21.15.118:0/827450078 shutdown_connections 2024-09-21T06:11:19.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.100+0000 7f2206e00640 1 --2- 172.21.15.118:0/827450078 >> v2:172.21.15.149:3300/0 conn(0x7f220006de00 0x7f220006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.100+0000 7f2206e00640 1 --2- 172.21.15.118:0/827450078 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22000cf3f0 0x7f22000cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.100+0000 7f2206e00640 1 --2- 172.21.15.118:0/827450078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 0x7f22000d1ae0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.100+0000 7f2206e00640 1 -- 172.21.15.118:0/827450078 >> 172.21.15.118:0/827450078 conn(0x7f22000d2900 msgr2=0x7f22000d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:19.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.101+0000 7f2206e00640 1 -- 172.21.15.118:0/827450078 shutdown_connections 2024-09-21T06:11:19.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.101+0000 7f2206e00640 1 -- 172.21.15.118:0/827450078 wait complete. 2024-09-21T06:11:19.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.103+0000 7f2206e00640 1 Processor -- start 2024-09-21T06:11:19.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.103+0000 7f2206e00640 1 -- start start 2024-09-21T06:11:19.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2206e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220006de00 0x7f22000caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2206e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22000cf3f0 0x7f22001f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2206e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 0x7f22001d86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2206e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f220006e750 con 0x7f22000d0000 2024-09-21T06:11:19.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2206e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f22000b3730 con 0x7f220006de00 2024-09-21T06:11:19.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2206e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f220006e8d0 con 0x7f22000cf3f0 2024-09-21T06:11:19.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2206400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 0x7f22001d86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2205a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220006de00 0x7f22000caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2205a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220006de00 0x7f22000caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:36028/0 (socket says 172.21.15.118:36028) 2024-09-21T06:11:19.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2205a00640 1 -- 172.21.15.118:0/2596352545 learned_addr learned my addr 172.21.15.118:0/2596352545 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:19.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.105+0000 7f2205000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22000cf3f0 0x7f22001f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206400640 1 -- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22000cf3f0 msgr2=0x7f22001f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206400640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22000cf3f0 0x7f22001f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206400640 1 -- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220006de00 msgr2=0x7f22000caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206400640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220006de00 0x7f22000caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206400640 1 -- 172.21.15.118:0/2596352545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000cb300 con 0x7f22000d0000 2024-09-21T06:11:19.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2205a00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220006de00 0x7f22000caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:19.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2205000640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22000cf3f0 0x7f22001f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:19.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206400640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 0x7f22001d86b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f21f8005fd0 tx=0x7f21f800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:19.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f21fd600640 1 -- 172.21.15.118:0/2596352545 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f800cd80 con 0x7f22000d0000 2024-09-21T06:11:19.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f21fd600640 1 -- 172.21.15.118:0/2596352545 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f8004b20 con 0x7f22000d0000 2024-09-21T06:11:19.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f21fd600640 1 -- 172.21.15.118:0/2596352545 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8005020 con 0x7f22000d0000 2024-09-21T06:11:19.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22000cb5e0 con 0x7f22000d0000 2024-09-21T06:11:19.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.106+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22000cbba0 con 0x7f22000d0000 2024-09-21T06:11:19.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.107+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22000cf800 con 0x7f22000d0000 2024-09-21T06:11:19.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.109+0000 7f21fd600640 1 -- 172.21.15.118:0/2596352545 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21f80051c0 con 0x7f22000d0000 2024-09-21T06:11:19.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.110+0000 7f21fd600640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f21e0078b90 0x7f21e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.110+0000 7f21fd600640 1 -- 172.21.15.118:0/2596352545 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f21f809b6c0 con 0x7f22000d0000 2024-09-21T06:11:19.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.111+0000 7f2205a00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f21e0078b90 0x7f21e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.111+0000 7f2205a00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f21e0078b90 0x7f21e007b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005f10 tx=0x7f21f4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:19.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.115+0000 7f21fd600640 1 -- 172.21.15.118:0/2596352545 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21f80634f0 con 0x7f22000d0000 2024-09-21T06:11:19.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.340+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22000cb090 con 0x7f22000d0000 2024-09-21T06:11:19.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.341+0000 7f21fd600640 1 -- 172.21.15.118:0/2596352545 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f21f8067f20 con 0x7f22000d0000 2024-09-21T06:11:19.343 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:19.343 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:11:19.344 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f21e0078b90 msgr2=0x7f21e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f21e0078b90 0x7f21e007b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005f10 tx=0x7f21f4004730 comp rx=0 tx=0).stop 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 msgr2=0x7f22001d86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 0x7f22001d86b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f21f8005fd0 tx=0x7f21f800edd0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 shutdown_connections 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22000d0000 0x7f22001d86b0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f21e0078b90 0x7f21e007b0a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22000cf3f0 0x7f22001f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 --2- 172.21.15.118:0/2596352545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220006de00 0x7f22000caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 >> 172.21.15.118:0/2596352545 conn(0x7f22000d2900 msgr2=0x7f22000cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:19.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 shutdown_connections 2024-09-21T06:11:19.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.343+0000 7f2206e00640 1 -- 172.21.15.118:0/2596352545 wait complete. 2024-09-21T06:11:19.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.585+0000 7f2aa2a00640 1 -- 172.21.15.118:0/1260421534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 msgr2=0x7f2a9c0749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.585+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/1260421534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0749f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009830 tx=0x7f2a9002a480 comp rx=0 tx=0).stop 2024-09-21T06:11:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.585+0000 7f2aa2a00640 1 -- 172.21.15.118:0/1260421534 shutdown_connections 2024-09-21T06:11:19.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.585+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/1260421534 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a9c0cfe30 0x7f2a9c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.585+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/1260421534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0749f0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.585+0000 7f2aa2a00640 1 -- 172.21.15.118:0/1260421534 >> 172.21.15.118:0/1260421534 conn(0x7f2a9c06d6e0 msgr2=0x7f2a9c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:19.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.585+0000 7f2aa2a00640 1 -- 172.21.15.118:0/1260421534 shutdown_connections 2024-09-21T06:11:19.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.586+0000 7f2aa2a00640 1 -- 172.21.15.118:0/1260421534 wait complete. 2024-09-21T06:11:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.588+0000 7f2aa2a00640 1 Processor -- start 2024-09-21T06:11:19.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.588+0000 7f2aa2a00640 1 -- start start 2024-09-21T06:11:19.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.589+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.589+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a9c0b5bb0 0x7f2a9c0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.589+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c0cfe30 0x7f2a9c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.589+0000 7f2aa2a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c15d9c0 con 0x7f2a9c073fa0 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.589+0000 7f2aa2a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c15d840 con 0x7f2a9c0cfe30 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.589+0000 7f2aa2a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9c15db40 con 0x7f2a9c0b5bb0 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.589+0000 7f2aa1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58170/0 (socket says 172.21.15.118:58170) 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 -- 172.21.15.118:0/4269131971 learned_addr learned my addr 172.21.15.118:0/4269131971 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa2000640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c0cfe30 0x7f2a9c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa0c00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a9c0b5bb0 0x7f2a9c0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 -- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a9c0b5bb0 msgr2=0x7f2a9c0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a9c0b5bb0 0x7f2a9c0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 -- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c0cfe30 msgr2=0x7f2a9c0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c0cfe30 0x7f2a9c0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 -- 172.21.15.118:0/4269131971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c0c58b0 con 0x7f2a9c073fa0 2024-09-21T06:11:19.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.590+0000 7f2aa1600640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0c6950 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f2a9002aa70 tx=0x7f2a90033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:19.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.591+0000 7f2a99600640 1 -- 172.21.15.118:0/4269131971 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90005c90 con 0x7f2a9c073fa0 2024-09-21T06:11:19.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.591+0000 7f2a99600640 1 -- 172.21.15.118:0/4269131971 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a90031e50 con 0x7f2a9c073fa0 2024-09-21T06:11:19.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.591+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c0c5b90 con 0x7f2a9c073fa0 2024-09-21T06:11:19.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.591+0000 7f2a99600640 1 -- 172.21.15.118:0/4269131971 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90005260 con 0x7f2a9c073fa0 2024-09-21T06:11:19.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.591+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c0c6150 con 0x7f2a9c073fa0 2024-09-21T06:11:19.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.592+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c15e030 con 0x7f2a9c073fa0 2024-09-21T06:11:19.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.593+0000 7f2a99600640 1 -- 172.21.15.118:0/4269131971 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a90005400 con 0x7f2a9c073fa0 2024-09-21T06:11:19.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.594+0000 7f2a99600640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a7c078b90 0x7f2a7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.594+0000 7f2a99600640 1 -- 172.21.15.118:0/4269131971 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f2a900bbeb0 con 0x7f2a9c073fa0 2024-09-21T06:11:19.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.594+0000 7f2aa0c00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a7c078b90 0x7f2a7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.595+0000 7f2aa0c00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a7c078b90 0x7f2a7c07b0a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0b2b00 tx=0x7f2a8800b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:19.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.598+0000 7f2a99600640 1 -- 172.21.15.118:0/4269131971 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2a9003f030 con 0x7f2a9c073fa0 2024-09-21T06:11:19.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:11:19.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:11:19.826 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:19.826 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:11:19.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.821+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a9c158980 con 0x7f2a9c073fa0 2024-09-21T06:11:19.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.821+0000 7f2a99600640 1 -- 172.21.15.118:0/4269131971 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f2a90083bc0 con 0x7f2a9c073fa0 2024-09-21T06:11:19.827 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:11:19.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a7c078b90 msgr2=0x7f2a7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a7c078b90 0x7f2a7c07b0a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0b2b00 tx=0x7f2a8800b2e0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 msgr2=0x7f2a9c0c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0c6950 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f2a9002aa70 tx=0x7f2a90033c20 comp rx=0 tx=0).stop 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 shutdown_connections 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a9c0cfe30 0x7f2a9c0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2a7c078b90 0x7f2a7c07b0a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a9c0b5bb0 0x7f2a9c0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 --2- 172.21.15.118:0/4269131971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a9c073fa0 0x7f2a9c0c6950 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 >> 172.21.15.118:0/4269131971 conn(0x7f2a9c06d6e0 msgr2=0x7f2a9c15f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 shutdown_connections 2024-09-21T06:11:19.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:19.824+0000 7f2aa2a00640 1 -- 172.21.15.118:0/4269131971 wait complete. 2024-09-21T06:11:19.851 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:11:20.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.110+0000 7f6395e00640 1 -- 172.21.15.118:0/127860858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6374003a50 msgr2=0x7f6374003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.110+0000 7f6395e00640 1 --2- 172.21.15.118:0/127860858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6374003a50 0x7f6374003ec0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f63800016c0 tx=0x7f6374005830 comp rx=0 tx=0).stop 2024-09-21T06:11:20.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.110+0000 7f6395e00640 1 -- 172.21.15.118:0/127860858 shutdown_connections 2024-09-21T06:11:20.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.110+0000 7f6395e00640 1 --2- 172.21.15.118:0/127860858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6374003a50 0x7f6374003ec0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.110+0000 7f6395e00640 1 -- 172.21.15.118:0/127860858 >> 172.21.15.118:0/127860858 conn(0x7f639006d110 msgr2=0x7f639006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:20.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.111+0000 7f6395e00640 1 -- 172.21.15.118:0/127860858 shutdown_connections 2024-09-21T06:11:20.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.111+0000 7f6395e00640 1 -- 172.21.15.118:0/127860858 wait complete. 2024-09-21T06:11:20.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.113+0000 7f6395e00640 1 Processor -- start 2024-09-21T06:11:20.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.113+0000 7f6395e00640 1 -- start start 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.114+0000 7f6395e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6374003a50 0x7f63900cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.114+0000 7f6395e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63900ca6f0 0x7f63901510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.114+0000 7f6395e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f639013ebf0 0x7f639013f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.114+0000 7f6395e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f63900d16a0 con 0x7f63900ca6f0 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.114+0000 7f6395e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6390142730 con 0x7f6374003a50 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.114+0000 7f6395e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6390151c80 con 0x7f639013ebf0 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63900ca6f0 0x7f63901510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63900ca6f0 0x7f63901510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58194/0 (socket says 172.21.15.118:58194) 2024-09-21T06:11:20.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 -- 172.21.15.118:0/10255296 learned_addr learned my addr 172.21.15.118:0/10255296 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:20.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f638f400640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f639013ebf0 0x7f639013f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f638ea00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6374003a50 0x7f63900cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 -- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f639013ebf0 msgr2=0x7f639013f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f639013ebf0 0x7f639013f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 -- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6374003a50 msgr2=0x7f63900cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6374003a50 0x7f63900cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 -- 172.21.15.118:0/10255296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63900cc680 con 0x7f63900ca6f0 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f638ea00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6374003a50 0x7f63900cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f638f400640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f639013ebf0 0x7f639013f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.115+0000 7f6387e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63900ca6f0 0x7f63901510e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6378011a70 tx=0x7f6378011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.116+0000 7f6387400640 1 -- 172.21.15.118:0/10255296 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637801e070 con 0x7f63900ca6f0 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.116+0000 7f6387400640 1 -- 172.21.15.118:0/10255296 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6378004460 con 0x7f63900ca6f0 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.116+0000 7f6387400640 1 -- 172.21.15.118:0/10255296 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637800fc60 con 0x7f63900ca6f0 2024-09-21T06:11:20.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.116+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63900cc960 con 0x7f63900ca6f0 2024-09-21T06:11:20.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.116+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63900ccf20 con 0x7f63900ca6f0 2024-09-21T06:11:20.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.117+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63900cc3f0 con 0x7f63900ca6f0 2024-09-21T06:11:20.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.118+0000 7f6387400640 1 -- 172.21.15.118:0/10255296 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6378021070 con 0x7f63900ca6f0 2024-09-21T06:11:20.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.120+0000 7f6387400640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f636c078b90 0x7f636c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.120+0000 7f6387400640 1 -- 172.21.15.118:0/10255296 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f637809b760 con 0x7f63900ca6f0 2024-09-21T06:11:20.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.120+0000 7f638ea00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f636c078b90 0x7f636c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.121+0000 7f638ea00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f636c078b90 0x7f636c07b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6380032000 tx=0x7f6380001190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.125+0000 7f6387400640 1 -- 172.21.15.118:0/10255296 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6378063470 con 0x7f63900ca6f0 2024-09-21T06:11:20.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.315+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6390142c90 con 0x7f63900ca6f0 2024-09-21T06:11:20.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.317+0000 7f6387400640 1 -- 172.21.15.118:0/10255296 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16920 (secure 0 0 0) 0x7f6378067ea0 con 0x7f63900ca6f0 2024-09-21T06:11:20.319 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:20.319 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":136,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:11:10.354572+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:30.625521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:31.678886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.c","mappings":[{"from":0,"to":5}]},{"pgid":"17.3c","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:20.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f636c078b90 msgr2=0x7f636c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f636c078b90 0x7f636c07b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6380032000 tx=0x7f6380001190 comp rx=0 tx=0).stop 2024-09-21T06:11:20.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63900ca6f0 msgr2=0x7f63901510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63900ca6f0 0x7f63901510e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6378011a70 tx=0x7f6378011f30 comp rx=0 tx=0).stop 2024-09-21T06:11:20.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 shutdown_connections 2024-09-21T06:11:20.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f636c078b90 0x7f636c07b0a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f639013ebf0 0x7f639013f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63900ca6f0 0x7f63901510e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 --2- 172.21.15.118:0/10255296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6374003a50 0x7f63900cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 >> 172.21.15.118:0/10255296 conn(0x7f639006d110 msgr2=0x7f6390074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 shutdown_connections 2024-09-21T06:11:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.319+0000 7f6395e00640 1 -- 172.21.15.118:0/10255296 wait complete. 2024-09-21T06:11:20.344 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:11:20.344 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:20.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.567+0000 7fc341400640 1 -- 172.21.15.118:0/1692936844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 msgr2=0x7fc33c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.567+0000 7fc341400640 1 --2- 172.21.15.118:0/1692936844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c0d0240 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc33c072570 tx=0x7fc32802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.568+0000 7fc341400640 1 -- 172.21.15.118:0/1692936844 shutdown_connections 2024-09-21T06:11:20.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.568+0000 7fc341400640 1 --2- 172.21.15.118:0/1692936844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c0d0240 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.568+0000 7fc341400640 1 --2- 172.21.15.118:0/1692936844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc33c0b5bb0 0x7fc33c0b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.568+0000 7fc341400640 1 --2- 172.21.15.118:0/1692936844 >> v2:172.21.15.149:3300/0 conn(0x7fc33c073fa0 0x7fc33c0749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.568+0000 7fc341400640 1 -- 172.21.15.118:0/1692936844 >> 172.21.15.118:0/1692936844 conn(0x7fc33c06d6e0 msgr2=0x7fc33c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:20.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.568+0000 7fc341400640 1 -- 172.21.15.118:0/1692936844 shutdown_connections 2024-09-21T06:11:20.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.568+0000 7fc341400640 1 -- 172.21.15.118:0/1692936844 wait complete. 2024-09-21T06:11:20.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.570+0000 7fc341400640 1 Processor -- start 2024-09-21T06:11:20.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.570+0000 7fc341400640 1 -- start start 2024-09-21T06:11:20.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.571+0000 7fc341400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc33c073fa0 0x7fc33c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.571+0000 7fc341400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc33c0b5bb0 0x7fc33c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.571+0000 7fc341400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.571+0000 7fc341400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c15d7b0 con 0x7fc33c0cfe30 2024-09-21T06:11:20.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.571+0000 7fc341400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c15d630 con 0x7fc33c073fa0 2024-09-21T06:11:20.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.571+0000 7fc341400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c15d930 con 0x7fc33c0b5bb0 2024-09-21T06:11:20.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c1f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58226/0 (socket says 172.21.15.118:58226) 2024-09-21T06:11:20.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 -- 172.21.15.118:0/2003238840 learned_addr learned my addr 172.21.15.118:0/2003238840 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:20.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc33be00640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc33c073fa0 0x7fc33c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc33b400640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc33c0b5bb0 0x7fc33c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 -- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc33c0b5bb0 msgr2=0x7fc33c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc33c0b5bb0 0x7fc33c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 -- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc33c073fa0 msgr2=0x7fc33c158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc33c073fa0 0x7fc33c158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.572+0000 7fc340a00640 1 -- 172.21.15.118:0/2003238840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c1f67d0 con 0x7fc33c0cfe30 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.573+0000 7fc340a00640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c1f5ae0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e990 tx=0x7fc33400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.573+0000 7fc333e00640 1 -- 172.21.15.118:0/2003238840 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334004d20 con 0x7fc33c0cfe30 2024-09-21T06:11:20.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.573+0000 7fc333e00640 1 -- 172.21.15.118:0/2003238840 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc33400caa0 con 0x7fc33c0cfe30 2024-09-21T06:11:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.573+0000 7fc333e00640 1 -- 172.21.15.118:0/2003238840 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334005020 con 0x7fc33c0cfe30 2024-09-21T06:11:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.573+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c157b40 con 0x7fc33c0cfe30 2024-09-21T06:11:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.573+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c158100 con 0x7fc33c0cfe30 2024-09-21T06:11:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.574+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c1f6540 con 0x7fc33c0cfe30 2024-09-21T06:11:20.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.575+0000 7fc333e00640 1 -- 172.21.15.118:0/2003238840 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3340051c0 con 0x7fc33c0cfe30 2024-09-21T06:11:20.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.576+0000 7fc333e00640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc31c078b90 0x7fc31c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.576+0000 7fc333e00640 1 -- 172.21.15.118:0/2003238840 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7fc33409b610 con 0x7fc33c0cfe30 2024-09-21T06:11:20.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.577+0000 7fc33be00640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc31c078b90 0x7fc31c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.577+0000 7fc33be00640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc31c078b90 0x7fc31c07b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009ab0 tx=0x7fc32c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.585+0000 7fc333e00640 1 -- 172.21.15.118:0/2003238840 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc334016030 con 0x7fc33c0cfe30 2024-09-21T06:11:20.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.817+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc33c0b5fc0 con 0x7fc33c0cfe30 2024-09-21T06:11:20.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.818+0000 7fc333e00640 1 -- 172.21.15.118:0/2003238840 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7fc334063320 con 0x7fc33c0cfe30 2024-09-21T06:11:20.820 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:20.820 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:11:20.821 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc31c078b90 msgr2=0x7fc31c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc31c078b90 0x7fc31c07b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009ab0 tx=0x7fc32c005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 msgr2=0x7fc33c1f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c1f5ae0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e990 tx=0x7fc33400ee50 comp rx=0 tx=0).stop 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 shutdown_connections 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cfe30 0x7fc33c1f5ae0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc31c078b90 0x7fc31c07b0a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc33c0b5bb0 0x7fc33c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 --2- 172.21.15.118:0/2003238840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc33c073fa0 0x7fc33c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.821+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 >> 172.21.15.118:0/2003238840 conn(0x7fc33c06d6e0 msgr2=0x7fc33c0729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:20.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.822+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 shutdown_connections 2024-09-21T06:11:20.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:20.822+0000 7fc341400640 1 -- 172.21.15.118:0/2003238840 wait complete. 2024-09-21T06:11:20.849 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:21.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.077+0000 7f755b200640 1 -- 172.21.15.118:0/1553563140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 msgr2=0x7f755c0d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.078+0000 7f755b200640 1 --2- 172.21.15.118:0/1553563140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 0x7f755c0d02e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f754c009830 tx=0x7f754c02a510 comp rx=0 tx=0).stop 2024-09-21T06:11:21.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.078+0000 7f755b200640 1 -- 172.21.15.118:0/1553563140 shutdown_connections 2024-09-21T06:11:21.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.078+0000 7f755b200640 1 --2- 172.21.15.118:0/1553563140 >> v2:172.21.15.118:3300/0 conn(0x7f755c0d1330 0x7f755c0d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.078+0000 7f755b200640 1 --2- 172.21.15.118:0/1553563140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 0x7f755c0d02e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.078+0000 7f755b200640 1 -- 172.21.15.118:0/1553563140 >> 172.21.15.118:0/1553563140 conn(0x7f755c06d1c0 msgr2=0x7f755c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.078+0000 7f755b200640 1 -- 172.21.15.118:0/1553563140 shutdown_connections 2024-09-21T06:11:21.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.078+0000 7f755b200640 1 -- 172.21.15.118:0/1553563140 wait complete. 2024-09-21T06:11:21.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.080+0000 7f755b200640 1 Processor -- start 2024-09-21T06:11:21.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.080+0000 7f755b200640 1 -- start start 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f755b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755c0d1330 0x7f755c14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f755b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 0x7f755c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f755b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755c163900 0x7f755c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f755b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f755c0d3aa0 con 0x7f755c0d1330 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f755b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f755c0d3920 con 0x7f755c163900 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f755b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f755c0d3c20 con 0x7f755c1634f0 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f7559e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755c0d1330 0x7f755c14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f7559e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755c0d1330 0x7f755c14ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58258/0 (socket says 172.21.15.118:58258) 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f7559e00640 1 -- 172.21.15.118:0/3089835703 learned_addr learned my addr 172.21.15.118:0/3089835703 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f755a800640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755c163900 0x7f755c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.082+0000 7f7553e00640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 0x7f755c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7559e00640 1 -- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 msgr2=0x7f755c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7559e00640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 0x7f755c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7559e00640 1 -- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755c163900 msgr2=0x7f755c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7559e00640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755c163900 0x7f755c15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7559e00640 1 -- 172.21.15.118:0/3089835703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755c15a0a0 con 0x7f755c0d1330 2024-09-21T06:11:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7559e00640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755c0d1330 0x7f755c14ec80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f754c009950 tx=0x7f754c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7552000640 1 -- 172.21.15.118:0/3089835703 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c005c90 con 0x7f755c0d1330 2024-09-21T06:11:21.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755c15a380 con 0x7f755c0d1330 2024-09-21T06:11:21.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7552000640 1 -- 172.21.15.118:0/3089835703 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f754c031e50 con 0x7f755c0d1330 2024-09-21T06:11:21.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f7552000640 1 -- 172.21.15.118:0/3089835703 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c005260 con 0x7f755c0d1330 2024-09-21T06:11:21.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.083+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755c15a940 con 0x7f755c0d1330 2024-09-21T06:11:21.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.085+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f755c0d1740 con 0x7f755c0d1330 2024-09-21T06:11:21.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.087+0000 7f7552000640 1 -- 172.21.15.118:0/3089835703 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f754c005400 con 0x7f755c0d1330 2024-09-21T06:11:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.088+0000 7f7552000640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7538078b90 0x7f753807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.088+0000 7f7552000640 1 -- 172.21.15.118:0/3089835703 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f754c0bbe80 con 0x7f755c0d1330 2024-09-21T06:11:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.088+0000 7f7553e00640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7538078b90 0x7f753807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.089+0000 7f7553e00640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7538078b90 0x7f753807b0a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7544007fd0 tx=0x7f75440013b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.093+0000 7f7552000640 1 -- 172.21.15.118:0/3089835703 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f754c03f030 con 0x7f755c0d1330 2024-09-21T06:11:21.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.328+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f755c0b7570 con 0x7f755c0d1330 2024-09-21T06:11:21.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.329+0000 7f7552000640 1 -- 172.21.15.118:0/3089835703 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f754c083b10 con 0x7f755c0d1330 2024-09-21T06:11:21.332 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:21.332 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":68,"btime":"2024-09-21T06:10:36:255427+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:32.715815+0000","modified":"2024-09-21T06:10:35.747985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6963},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6963":{"gid":6963,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2073034687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2073034687},{"type":"v1","addr":"172.21.15.118:6835","nonce":2073034687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6963,"qdb_cluster":[6963]},"id":8}]} 2024-09-21T06:11:21.332 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 68 2024-09-21T06:11:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7538078b90 msgr2=0x7f753807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7538078b90 0x7f753807b0a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7544007fd0 tx=0x7f75440013b0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755c0d1330 msgr2=0x7f755c14ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755c0d1330 0x7f755c14ec80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f754c009950 tx=0x7f754c033c20 comp rx=0 tx=0).stop 2024-09-21T06:11:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 shutdown_connections 2024-09-21T06:11:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755c163900 0x7f755c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7538078b90 0x7f753807b0a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f755c1634f0 0x7f755c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 --2- 172.21.15.118:0/3089835703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755c0d1330 0x7f755c14ec80 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 >> 172.21.15.118:0/3089835703 conn(0x7f755c06d1c0 msgr2=0x7f755c0cef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 shutdown_connections 2024-09-21T06:11:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.332+0000 7f755b200640 1 -- 172.21.15.118:0/3089835703 wait complete. 2024-09-21T06:11:21.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:11:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.586+0000 7f5b55200640 1 -- 172.21.15.118:0/38032284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b34003c30 msgr2=0x7f5b34004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.586+0000 7f5b55200640 1 --2- 172.21.15.118:0/38032284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b34003c30 0x7f5b34004080 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5b40001830 tx=0x7f5b34005830 comp rx=0 tx=0).stop 2024-09-21T06:11:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.586+0000 7f5b55200640 1 -- 172.21.15.118:0/38032284 shutdown_connections 2024-09-21T06:11:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.586+0000 7f5b55200640 1 --2- 172.21.15.118:0/38032284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b34003c30 0x7f5b34004080 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.586+0000 7f5b55200640 1 -- 172.21.15.118:0/38032284 >> 172.21.15.118:0/38032284 conn(0x7f5b5006d1c0 msgr2=0x7f5b5006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.586+0000 7f5b55200640 1 -- 172.21.15.118:0/38032284 shutdown_connections 2024-09-21T06:11:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.586+0000 7f5b55200640 1 -- 172.21.15.118:0/38032284 wait complete. 2024-09-21T06:11:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.588+0000 7f5b55200640 1 Processor -- start 2024-09-21T06:11:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.588+0000 7f5b55200640 1 -- start start 2024-09-21T06:11:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b55200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b34003c30 0x7f5b501f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b55200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b500cbd40 0x7f5b50152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b55200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b501f63b0 0x7f5b501f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b55200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5b500d0670 con 0x7f5b501f63b0 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b55200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b500d04f0 con 0x7f5b500cbd40 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b55200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b500d07f0 con 0x7f5b34003c30 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b501f63b0 0x7f5b501f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b501f63b0 0x7f5b501f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58278/0 (socket says 172.21.15.118:58278) 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b4fe00640 1 -- 172.21.15.118:0/1443111330 learned_addr learned my addr 172.21.15.118:0/1443111330 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b4f400640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b34003c30 0x7f5b501f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.590+0000 7f5b4ea00640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b500cbd40 0x7f5b50152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b4fe00640 1 -- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b34003c30 msgr2=0x7f5b501f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b4fe00640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b34003c30 0x7f5b501f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b4fe00640 1 -- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b500cbd40 msgr2=0x7f5b50152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b4fe00640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b500cbd40 0x7f5b50152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b4fe00640 1 -- 172.21.15.118:0/1443111330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b50152540 con 0x7f5b501f63b0 2024-09-21T06:11:21.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b4fe00640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b501f63b0 0x7f5b501f67c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5b500b7c10 tx=0x7f5b48006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b47400640 1 -- 172.21.15.118:0/1443111330 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800fa00 con 0x7f5b501f63b0 2024-09-21T06:11:21.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b47400640 1 -- 172.21.15.118:0/1443111330 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b4800fba0 con 0x7f5b501f63b0 2024-09-21T06:11:21.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.591+0000 7f5b47400640 1 -- 172.21.15.118:0/1443111330 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48011430 con 0x7f5b501f63b0 2024-09-21T06:11:21.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.592+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b500cc6f0 con 0x7f5b501f63b0 2024-09-21T06:11:21.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.592+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b501f5e90 con 0x7f5b501f63b0 2024-09-21T06:11:21.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.593+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b501562d0 con 0x7f5b501f63b0 2024-09-21T06:11:21.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.594+0000 7f5b47400640 1 -- 172.21.15.118:0/1443111330 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b480115d0 con 0x7f5b501f63b0 2024-09-21T06:11:21.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.595+0000 7f5b47400640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.595+0000 7f5b47400640 1 -- 172.21.15.118:0/1443111330 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7f5b4809c100 con 0x7f5b501f63b0 2024-09-21T06:11:21.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.596+0000 7f5b4f400640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.597+0000 7f5b4f400640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5b40032000 tx=0x7f5b40001360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.602+0000 7f5b47400640 1 -- 172.21.15.118:0/1443111330 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5b48064600 con 0x7f5b501f63b0 2024-09-21T06:11:21.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.795+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b500d1410 con 0x7f5b501f63b0 2024-09-21T06:11:21.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.797+0000 7f5b47400640 1 -- 172.21.15.118:0/1443111330 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16920 (secure 0 0 0) 0x7f5b48063f00 con 0x7f5b501f63b0 2024-09-21T06:11:21.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:21.800 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":136,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:11:10.354572+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:30.625521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:31.678886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.c","mappings":[{"from":0,"to":5}]},{"pgid":"17.3c","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.799+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b2c078b90 msgr2=0x7f5b2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.799+0000 7f5b55200640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5b40032000 tx=0x7f5b40001360 comp rx=0 tx=0).stop 2024-09-21T06:11:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.799+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b501f63b0 msgr2=0x7f5b501f67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.799+0000 7f5b55200640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b501f63b0 0x7f5b501f67c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5b500b7c10 tx=0x7f5b48006660 comp rx=0 tx=0).stop 2024-09-21T06:11:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.799+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 shutdown_connections 2024-09-21T06:11:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.799+0000 7f5b55200640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b501f63b0 0x7f5b501f67c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.800+0000 7f5b55200640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b500cbd40 0x7f5b50152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.800+0000 7f5b55200640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.800+0000 7f5b55200640 1 --2- 172.21.15.118:0/1443111330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b34003c30 0x7f5b501f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.800+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 >> 172.21.15.118:0/1443111330 conn(0x7f5b5006d1c0 msgr2=0x7f5b50152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.800+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 shutdown_connections 2024-09-21T06:11:21.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:21.800+0000 7f5b55200640 1 -- 172.21.15.118:0/1443111330 wait complete. 2024-09-21T06:11:21.824 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:11:22.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.042+0000 7fb98ce00640 1 -- 172.21.15.118:0/2462823198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb98815f660 msgr2=0x7fb98806ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.042+0000 7fb98ce00640 1 --2- 172.21.15.118:0/2462823198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb98815f660 0x7fb98806ecd0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fb97000a940 tx=0x7fb97002b8f0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.043+0000 7fb98ce00640 1 -- 172.21.15.118:0/2462823198 shutdown_connections 2024-09-21T06:11:22.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.043+0000 7fb98ce00640 1 --2- 172.21.15.118:0/2462823198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb98815f660 0x7fb98806ecd0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.043+0000 7fb98ce00640 1 -- 172.21.15.118:0/2462823198 >> 172.21.15.118:0/2462823198 conn(0x7fb98806d110 msgr2=0x7fb98806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:22.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.043+0000 7fb98ce00640 1 -- 172.21.15.118:0/2462823198 shutdown_connections 2024-09-21T06:11:22.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.043+0000 7fb98ce00640 1 -- 172.21.15.118:0/2462823198 wait complete. 2024-09-21T06:11:22.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.045+0000 7fb98ce00640 1 Processor -- start 2024-09-21T06:11:22.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.045+0000 7fb98ce00640 1 -- start start 2024-09-21T06:11:22.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.046+0000 7fb98ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb98806f210 0x7fb9881fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.046+0000 7fb98ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9880b44c0 0x7fb98814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.046+0000 7fb98ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98815f660 0x7fb9880c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.046+0000 7fb98ce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9880cfe80 con 0x7fb9880b44c0 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.046+0000 7fb98ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb988070fd0 con 0x7fb98806f210 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.046+0000 7fb98ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb9880d0000 con 0x7fb98815f660 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9880b44c0 0x7fb98814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9880b44c0 0x7fb98814a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58306/0 (socket says 172.21.15.118:58306) 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 -- 172.21.15.118:0/507794890 learned_addr learned my addr 172.21.15.118:0/507794890 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb985e00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb98806f210 0x7fb9881fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb986800640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98815f660 0x7fb9880c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 -- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98815f660 msgr2=0x7fb9880c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98815f660 0x7fb9880c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 -- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb98806f210 msgr2=0x7fb9881fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb98806f210 0x7fb9881fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 -- 172.21.15.118:0/507794890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9880cbf10 con 0x7fb9880b44c0 2024-09-21T06:11:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.047+0000 7fb97d400640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9880b44c0 0x7fb98814a860 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fb97000aa60 tx=0x7fb9700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.048+0000 7fb97ea00640 1 -- 172.21.15.118:0/507794890 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970005220 con 0x7fb9880b44c0 2024-09-21T06:11:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.048+0000 7fb97ea00640 1 -- 172.21.15.118:0/507794890 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb97002e070 con 0x7fb9880b44c0 2024-09-21T06:11:22.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.048+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9880cc1f0 con 0x7fb9880b44c0 2024-09-21T06:11:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.048+0000 7fb97ea00640 1 -- 172.21.15.118:0/507794890 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9700047a0 con 0x7fb9880b44c0 2024-09-21T06:11:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.048+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881f9df0 con 0x7fb9880b44c0 2024-09-21T06:11:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.049+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9880730f0 con 0x7fb9880b44c0 2024-09-21T06:11:22.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.050+0000 7fb97ea00640 1 -- 172.21.15.118:0/507794890 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb970004940 con 0x7fb9880b44c0 2024-09-21T06:11:22.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.051+0000 7fb97ea00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb964078b90 0x7fb96407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.051+0000 7fb97ea00640 1 -- 172.21.15.118:0/507794890 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5767+0+0 (secure 0 0 0) 0x7fb9700bc600 con 0x7fb9880b44c0 2024-09-21T06:11:22.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.051+0000 7fb985e00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb964078b90 0x7fb96407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.052+0000 7fb985e00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb964078b90 0x7fb96407b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9780012e0 tx=0x7fb978009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.057+0000 7fb97ea00640 1 -- 172.21.15.118:0/507794890 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb9880730f0 con 0x7fb9880b44c0 2024-09-21T06:11:22.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.277+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb98814b290 con 0x7fb9880b44c0 2024-09-21T06:11:22.279 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:11:22.277+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:11:22.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.279+0000 7fb97ea00640 1 -- 172.21.15.118:0/507794890 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) ==== 161+0+0 (secure 0 0 0) 0x7fb9700849f0 con 0x7fb9880b44c0 2024-09-21T06:11:22.281 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:11:22.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb964078b90 msgr2=0x7fb96407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb964078b90 0x7fb96407b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9780012e0 tx=0x7fb978009040 comp rx=0 tx=0).stop 2024-09-21T06:11:22.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9880b44c0 msgr2=0x7fb98814a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9880b44c0 0x7fb98814a860 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fb97000aa60 tx=0x7fb9700042f0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 shutdown_connections 2024-09-21T06:11:22.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb964078b90 0x7fb96407b0a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98815f660 0x7fb9880c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9880b44c0 0x7fb98814a860 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 --2- 172.21.15.118:0/507794890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb98806f210 0x7fb9881fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.284+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 >> 172.21.15.118:0/507794890 conn(0x7fb98806d110 msgr2=0x7fb988070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:22.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.285+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 shutdown_connections 2024-09-21T06:11:22.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.285+0000 7fb98ce00640 1 -- 172.21.15.118:0/507794890 wait complete. 2024-09-21T06:11:22.313 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:11:22.422 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:11:22.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.540+0000 7eff66200640 1 -- 172.21.15.118:0/4277014243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6013fef0 msgr2=0x7eff60142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.540+0000 7eff66200640 1 --2- 172.21.15.118:0/4277014243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6013fef0 0x7eff60142c70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7eff58005fd0 tx=0x7eff5802a820 comp rx=0 tx=0).stop 2024-09-21T06:11:22.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.540+0000 7eff66200640 1 -- 172.21.15.118:0/4277014243 shutdown_connections 2024-09-21T06:11:22.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.540+0000 7eff66200640 1 --2- 172.21.15.118:0/4277014243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6013fef0 0x7eff60142c70 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.540+0000 7eff66200640 1 --2- 172.21.15.118:0/4277014243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff600d1590 0x7eff60142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.540+0000 7eff66200640 1 -- 172.21.15.118:0/4277014243 >> 172.21.15.118:0/4277014243 conn(0x7eff6006d110 msgr2=0x7eff6006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:22.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.541+0000 7eff66200640 1 -- 172.21.15.118:0/4277014243 shutdown_connections 2024-09-21T06:11:22.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.541+0000 7eff66200640 1 -- 172.21.15.118:0/4277014243 wait complete. 2024-09-21T06:11:22.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.543+0000 7eff66200640 1 Processor -- start 2024-09-21T06:11:22.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.543+0000 7eff66200640 1 -- start start 2024-09-21T06:11:22.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.544+0000 7eff66200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff6013fae0 0x7eff601f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.544+0000 7eff66200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff6013fef0 0x7eff6013eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.544+0000 7eff66200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff60141760 0x7eff60158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.544+0000 7eff66200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7eff600cfac0 con 0x7eff60141760 2024-09-21T06:11:22.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.544+0000 7eff66200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff600cf940 con 0x7eff6013fae0 2024-09-21T06:11:22.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.544+0000 7eff66200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff600cfc40 con 0x7eff6013fef0 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff60141760 0x7eff60158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff60141760 0x7eff60158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58344/0 (socket says 172.21.15.118:58344) 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 -- 172.21.15.118:0/1820948400 learned_addr learned my addr 172.21.15.118:0/1820948400 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5f400640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff6013fae0 0x7eff601f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5ea00640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff6013fef0 0x7eff6013eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 -- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff6013fef0 msgr2=0x7eff6013eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff6013fef0 0x7eff6013eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 -- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff6013fae0 msgr2=0x7eff601f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff6013fae0 0x7eff601f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 -- 172.21.15.118:0/1820948400 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff601406c0 con 0x7eff60141760 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.545+0000 7eff5fe00640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff60141760 0x7eff60158340 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7eff58035040 tx=0x7eff58032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.546+0000 7eff57400640 1 -- 172.21.15.118:0/1820948400 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58037040 con 0x7eff60141760 2024-09-21T06:11:22.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.546+0000 7eff57400640 1 -- 172.21.15.118:0/1820948400 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff58042070 con 0x7eff60141760 2024-09-21T06:11:22.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.546+0000 7eff57400640 1 -- 172.21.15.118:0/1820948400 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58003e60 con 0x7eff60141760 2024-09-21T06:11:22.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.546+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff601409a0 con 0x7eff60141760 2024-09-21T06:11:22.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.546+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff60140f60 con 0x7eff60141760 2024-09-21T06:11:22.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.547+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff600d00f0 con 0x7eff60141760 2024-09-21T06:11:22.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.548+0000 7eff57400640 1 -- 172.21.15.118:0/1820948400 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff58004280 con 0x7eff60141760 2024-09-21T06:11:22.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.549+0000 7eff57400640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff40078b90 0x7eff4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.549+0000 7eff57400640 1 -- 172.21.15.118:0/1820948400 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5853+0+0 (secure 0 0 0) 0x7eff580bc6c0 con 0x7eff60141760 2024-09-21T06:11:22.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.550+0000 7eff5f400640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff40078b90 0x7eff4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.551+0000 7eff5f400640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff40078b90 0x7eff4007b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7eff50007fd0 tx=0x7eff50009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.553+0000 7eff57400640 1 -- 172.21.15.118:0/1820948400 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7eff58084ae0 con 0x7eff60141760 2024-09-21T06:11:22.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:22.775+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7eff6015b8a0 con 0x7eff60141760 2024-09-21T06:11:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.427+0000 7eff57400640 1 -- 172.21.15.118:0/1820948400 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) ==== 104+0+0 (secure 0 0 0) 0x7eff580843e0 con 0x7eff60141760 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff40078b90 msgr2=0x7eff4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff40078b90 0x7eff4007b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7eff50007fd0 tx=0x7eff50009040 comp rx=0 tx=0).stop 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff60141760 msgr2=0x7eff60158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff60141760 0x7eff60158340 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7eff58035040 tx=0x7eff58032d10 comp rx=0 tx=0).stop 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 shutdown_connections 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff60141760 0x7eff60158340 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7eff40078b90 0x7eff4007b0a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff6013fef0 0x7eff6013eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 --2- 172.21.15.118:0/1820948400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff6013fae0 0x7eff601f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.430+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 >> 172.21.15.118:0/1820948400 conn(0x7eff6006d110 msgr2=0x7eff6015ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:23.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.431+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 shutdown_connections 2024-09-21T06:11:23.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.431+0000 7eff66200640 1 -- 172.21.15.118:0/1820948400 wait complete. 2024-09-21T06:11:23.460 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:11:23.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.686+0000 7f95d0000640 1 -- 172.21.15.118:0/2801219706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 msgr2=0x7f95b0004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.686+0000 7f95d0000640 1 --2- 172.21.15.118:0/2801219706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 0x7f95b0004060 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f95c80b3e50 tx=0x7f95b0005830 comp rx=0 tx=0).stop 2024-09-21T06:11:23.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.686+0000 7f95ce000640 1 -- 172.21.15.118:0/2801219706 reap_dead start 2024-09-21T06:11:23.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.686+0000 7f95d0000640 1 -- 172.21.15.118:0/2801219706 shutdown_connections 2024-09-21T06:11:23.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.686+0000 7f95d0000640 1 -- 172.21.15.118:0/2801219706 >> 172.21.15.118:0/2801219706 conn(0x7f95c8074860 msgr2=0x7f95c8074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:23.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.686+0000 7f95d0000640 1 -- 172.21.15.118:0/2801219706 shutdown_connections 2024-09-21T06:11:23.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.686+0000 7f95d0000640 1 -- 172.21.15.118:0/2801219706 wait complete. 2024-09-21T06:11:23.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.688+0000 7f95d0000640 1 Processor -- start 2024-09-21T06:11:23.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.689+0000 7f95d0000640 1 -- start start 2024-09-21T06:11:23.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95d0000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 0x7f95c8158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95d0000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c814ae50 0x7f95c8159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95d0000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c815a7a0 0x7f95c815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95d0000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8161680 con 0x7f95b0003c10 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95d0000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8161500 con 0x7f95c814ae50 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95d0000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95c8161800 con 0x7f95c815a7a0 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95cd600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 0x7f95c8158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95cd600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 0x7f95c8158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58358/0 (socket says 172.21.15.118:58358) 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.690+0000 7f95cd600640 1 -- 172.21.15.118:0/2533059424 learned_addr learned my addr 172.21.15.118:0/2533059424 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95ccc00640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c814ae50 0x7f95c8159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95ce000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c815a7a0 0x7f95c815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95cd600640 1 -- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c815a7a0 msgr2=0x7f95c815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95cd600640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c815a7a0 0x7f95c815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95cd600640 1 -- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c814ae50 msgr2=0x7f95c8159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95cd600640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c814ae50 0x7f95c8159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95cd600640 1 -- 172.21.15.118:0/2533059424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81f6170 con 0x7f95b0003c10 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95ce000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c815a7a0 0x7f95c815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95cd600640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 0x7f95c8158c10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009b00 tx=0x7f95bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95c5600640 1 -- 172.21.15.118:0/2533059424 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc040020 con 0x7f95b0003c10 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95c5600640 1 -- 172.21.15.118:0/2533059424 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95bc004460 con 0x7f95b0003c10 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c81f6450 con 0x7f95b0003c10 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.691+0000 7f95c5600640 1 -- 172.21.15.118:0/2533059424 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc038040 con 0x7f95b0003c10 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.692+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81f6a10 con 0x7f95b0003c10 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.693+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c80b04c0 con 0x7f95b0003c10 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.694+0000 7f95c5600640 1 -- 172.21.15.118:0/2533059424 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95bc043020 con 0x7f95b0003c10 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.695+0000 7f95c5600640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95a8078bc0 0x7f95a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.695+0000 7f95c5600640 1 -- 172.21.15.118:0/2533059424 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5853+0+0 (secure 0 0 0) 0x7f95bc0bb690 con 0x7f95b0003c10 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.695+0000 7f95ccc00640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95a8078bc0 0x7f95a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.696+0000 7f95ccc00640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95a8078bc0 0x7f95a807b0d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001eb0 tx=0x7f95b40014f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:23.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.700+0000 7f95c5600640 1 -- 172.21.15.118:0/2533059424 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f95bc04a030 con 0x7f95b0003c10 2024-09-21T06:11:23.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:23.887+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f95c815ecc0 con 0x7f95b0003c10 2024-09-21T06:11:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.440+0000 7f95c5600640 1 -- 172.21.15.118:0/2533059424 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v138) ==== 181+0+0 (secure 0 0 0) 0x7f95bc0839a0 con 0x7f95b0003c10 2024-09-21T06:11:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.444+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95a8078bc0 msgr2=0x7f95a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.444+0000 7f95d0000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95a8078bc0 0x7f95a807b0d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001eb0 tx=0x7f95b40014f0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.444+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 msgr2=0x7f95c8158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.444+0000 7f95d0000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 0x7f95c8158c10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009b00 tx=0x7f95bc004270 comp rx=0 tx=0).stop 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 shutdown_connections 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95a8078bc0 0x7f95a807b0d0 secure :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001eb0 tx=0x7f95b40014f0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95c815a7a0 0x7f95c815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95c814ae50 0x7f95c8159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 --2- 172.21.15.118:0/2533059424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b0003c10 0x7f95c8158c10 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 >> 172.21.15.118:0/2533059424 conn(0x7f95c8074860 msgr2=0x7f95c806f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:24.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 shutdown_connections 2024-09-21T06:11:24.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.445+0000 7f95d0000640 1 -- 172.21.15.118:0/2533059424 wait complete. 2024-09-21T06:11:24.478 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:11:24.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.712+0000 7fc221000640 1 -- 172.21.15.118:0/3360776683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 msgr2=0x7fc200004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.712+0000 7fc221000640 1 --2- 172.21.15.118:0/3360776683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc200004c10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc208001690 tx=0x7fc200005830 comp rx=0 tx=0).stop 2024-09-21T06:11:24.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.712+0000 7fc221000640 1 -- 172.21.15.118:0/3360776683 shutdown_connections 2024-09-21T06:11:24.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.712+0000 7fc221000640 1 --2- 172.21.15.118:0/3360776683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc200004c10 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.712+0000 7fc221000640 1 -- 172.21.15.118:0/3360776683 >> 172.21.15.118:0/3360776683 conn(0x7fc21c0b27f0 msgr2=0x7fc21c0b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:24.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.712+0000 7fc221000640 1 -- 172.21.15.118:0/3360776683 shutdown_connections 2024-09-21T06:11:24.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.712+0000 7fc221000640 1 -- 172.21.15.118:0/3360776683 wait complete. 2024-09-21T06:11:24.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.714+0000 7fc221000640 1 Processor -- start 2024-09-21T06:11:24.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.715+0000 7fc221000640 1 -- start start 2024-09-21T06:11:24.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc221000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc21c08b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc221000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc21c16b1b0 0x7fc21c15f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc221000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc21c16b5c0 0x7fc21c15fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc221000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c0d00f0 con 0x7fc200004800 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc221000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c0cff70 con 0x7fc21c16b1b0 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc221000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc21c074380 con 0x7fc21c16b5c0 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc219e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc21c08b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc219e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc21c08b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58374/0 (socket says 172.21.15.118:58374) 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.716+0000 7fc219e00640 1 -- 172.21.15.118:0/775990565 learned_addr learned my addr 172.21.15.118:0/775990565 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc21a800640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc21c16b5c0 0x7fc21c15fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc219400640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc21c16b1b0 0x7fc21c15f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc219e00640 1 -- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc21c16b5c0 msgr2=0x7fc21c15fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc219e00640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc21c16b5c0 0x7fc21c15fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc219e00640 1 -- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc21c16b1b0 msgr2=0x7fc21c15f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc219e00640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc21c16b1b0 0x7fc21c15f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc219e00640 1 -- 172.21.15.118:0/775990565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c08ba90 con 0x7fc200004800 2024-09-21T06:11:24.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc219e00640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc21c08b550 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00d7a0 tx=0x7fc20c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:24.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.717+0000 7fc212000640 1 -- 172.21.15.118:0/775990565 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c018070 con 0x7fc200004800 2024-09-21T06:11:24.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.718+0000 7fc212000640 1 -- 172.21.15.118:0/775990565 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc20c0050d0 con 0x7fc200004800 2024-09-21T06:11:24.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.718+0000 7fc212000640 1 -- 172.21.15.118:0/775990565 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00b6c0 con 0x7fc200004800 2024-09-21T06:11:24.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.718+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c1634c0 con 0x7fc200004800 2024-09-21T06:11:24.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.718+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c163a80 con 0x7fc200004800 2024-09-21T06:11:24.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.719+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c0748e0 con 0x7fc200004800 2024-09-21T06:11:24.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.720+0000 7fc212000640 1 -- 172.21.15.118:0/775990565 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc20c01b070 con 0x7fc200004800 2024-09-21T06:11:24.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.721+0000 7fc212000640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1fc078b30 0x7fc1fc07b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.721+0000 7fc212000640 1 -- 172.21.15.118:0/775990565 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5415+0+0 (secure 0 0 0) 0x7fc20c09aa90 con 0x7fc200004800 2024-09-21T06:11:24.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.722+0000 7fc219400640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1fc078b30 0x7fc1fc07b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.722+0000 7fc219400640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1fc078b30 0x7fc1fc07b040 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc208032000 tx=0x7fc20802c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:24.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.724+0000 7fc212000640 1 -- 172.21.15.118:0/775990565 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc20c062a10 con 0x7fc200004800 2024-09-21T06:11:24.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:24.912+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc21c06a260 con 0x7fc200004800 2024-09-21T06:11:25.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.359+0000 7fc212000640 1 -- 172.21.15.118:0/775990565 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v139) ==== 169+0+0 (secure 0 0 0) 0x7fc20c067440 con 0x7fc200004800 2024-09-21T06:11:25.361 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:11:25.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.363+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1fc078b30 msgr2=0x7fc1fc07b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.363+0000 7fc221000640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1fc078b30 0x7fc1fc07b040 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc208032000 tx=0x7fc20802c040 comp rx=0 tx=0).stop 2024-09-21T06:11:25.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.363+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 msgr2=0x7fc21c08b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.363+0000 7fc221000640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc21c08b550 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00d7a0 tx=0x7fc20c00dc60 comp rx=0 tx=0).stop 2024-09-21T06:11:25.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 shutdown_connections 2024-09-21T06:11:25.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1fc078b30 0x7fc1fc07b040 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc21c16b5c0 0x7fc21c15fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc21c16b1b0 0x7fc21c15f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 --2- 172.21.15.118:0/775990565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc200004800 0x7fc21c08b550 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 >> 172.21.15.118:0/775990565 conn(0x7fc21c0b27f0 msgr2=0x7fc21c070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:25.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 shutdown_connections 2024-09-21T06:11:25.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.364+0000 7fc221000640 1 -- 172.21.15.118:0/775990565 wait complete. 2024-09-21T06:11:25.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:11:25.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1751918056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fef0 msgr2=0x7f5abc142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1751918056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fef0 0x7f5abc142c70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0ceaa0 tx=0x7f5ab402a820 comp rx=0 tx=0).stop 2024-09-21T06:11:25.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1751918056 shutdown_connections 2024-09-21T06:11:25.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1751918056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fef0 0x7f5abc142c70 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1751918056 >> v2:172.21.15.149:3300/0 conn(0x7f5abc0d1590 0x7f5abc142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1751918056 >> 172.21.15.118:0/1751918056 conn(0x7f5abc06d110 msgr2=0x7f5abc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:25.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1751918056 shutdown_connections 2024-09-21T06:11:25.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.611+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1751918056 wait complete. 2024-09-21T06:11:25.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.614+0000 7f5ac2c00640 1 Processor -- start 2024-09-21T06:11:25.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.614+0000 7f5ac2c00640 1 -- start start 2024-09-21T06:11:25.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.615+0000 7f5ac2c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fae0 0x7f5abc140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.615+0000 7f5ac2c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5abc13fef0 0x7f5abc13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.615+0000 7f5ac2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5abc1f5a00 0x7f5abc0b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.615+0000 7f5ac2c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc0cfa10 con 0x7f5abc13fae0 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.615+0000 7f5ac2c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc0cf890 con 0x7f5abc13fef0 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.615+0000 7f5ac2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc0cfb90 con 0x7f5abc1f5a00 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fae0 0x7f5abc140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fae0 0x7f5abc140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58404/0 (socket says 172.21.15.118:58404) 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5abc13fef0 0x7f5abc13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 -- 172.21.15.118:0/1780471035 learned_addr learned my addr 172.21.15.118:0/1780471035 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5ac0c00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5abc1f5a00 0x7f5abc0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 -- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5abc1f5a00 msgr2=0x7f5abc0b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5abc1f5a00 0x7f5abc0b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 -- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5abc13fef0 msgr2=0x7f5abc13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5abc13fef0 0x7f5abc13ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 -- 172.21.15.118:0/1780471035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc1399f0 con 0x7f5abc13fae0 2024-09-21T06:11:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.616+0000 7f5abbe00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fae0 0x7f5abc140370 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00c460 tx=0x7f5aac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.617+0000 7f5ab3e00640 1 -- 172.21.15.118:0/1780471035 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac016020 con 0x7f5abc13fae0 2024-09-21T06:11:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.617+0000 7f5ab3e00640 1 -- 172.21.15.118:0/1780471035 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5aac012940 con 0x7f5abc13fae0 2024-09-21T06:11:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.617+0000 7f5ab3e00640 1 -- 172.21.15.118:0/1780471035 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac012d90 con 0x7f5abc13fae0 2024-09-21T06:11:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.617+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc1604d0 con 0x7f5abc13fae0 2024-09-21T06:11:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.617+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5abc139710 con 0x7f5abc13fae0 2024-09-21T06:11:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.618+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5abc0d00b0 con 0x7f5abc13fae0 2024-09-21T06:11:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.619+0000 7f5ab3e00640 1 -- 172.21.15.118:0/1780471035 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5aac019020 con 0x7f5abc13fae0 2024-09-21T06:11:25.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.620+0000 7f5ab3e00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a9c078bc0 0x7f5a9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.620+0000 7f5ab3e00640 1 -- 172.21.15.118:0/1780471035 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f5aac09a500 con 0x7f5abc13fae0 2024-09-21T06:11:25.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.621+0000 7f5abb400640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a9c078bc0 0x7f5a9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.621+0000 7f5abb400640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a9c078bc0 0x7f5a9c07b0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5abc1508d0 tx=0x7f5aa8005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:25.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.625+0000 7f5ab3e00640 1 -- 172.21.15.118:0/1780471035 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5aac020030 con 0x7f5abc13fae0 2024-09-21T06:11:25.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.812+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f5abc153d10 con 0x7f5abc13fae0 2024-09-21T06:11:25.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.817+0000 7f5ab3e00640 1 -- 172.21.15.118:0/1780471035 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f5aac0625f0 con 0x7f5abc13fae0 2024-09-21T06:11:25.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a9c078bc0 msgr2=0x7f5a9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a9c078bc0 0x7f5a9c07b0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5abc1508d0 tx=0x7f5aa8005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fae0 msgr2=0x7f5abc140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fae0 0x7f5abc140370 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00c460 tx=0x7f5aac00c920 comp rx=0 tx=0).stop 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 shutdown_connections 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5a9c078bc0 0x7f5a9c07b0d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5abc1f5a00 0x7f5abc0b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5abc13fef0 0x7f5abc13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 --2- 172.21.15.118:0/1780471035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5abc13fae0 0x7f5abc140370 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 >> 172.21.15.118:0/1780471035 conn(0x7f5abc06d110 msgr2=0x7f5abc0d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 shutdown_connections 2024-09-21T06:11:25.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:25.820+0000 7f5ac2c00640 1 -- 172.21.15.118:0/1780471035 wait complete. 2024-09-21T06:11:25.843 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-21T06:11:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.063+0000 7fb7c1800640 1 -- 172.21.15.118:0/571583907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7a0005250 msgr2=0x7fb7a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.063+0000 7fb7c1800640 1 --2- 172.21.15.118:0/571583907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7a0005250 0x7fb7a000b9c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4001d90 tx=0x7fb7a0005830 comp rx=0 tx=0).stop 2024-09-21T06:11:26.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.063+0000 7fb7c1800640 1 -- 172.21.15.118:0/571583907 shutdown_connections 2024-09-21T06:11:26.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.063+0000 7fb7c1800640 1 --2- 172.21.15.118:0/571583907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7a0005250 0x7fb7a000b9c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.063+0000 7fb7c1800640 1 -- 172.21.15.118:0/571583907 >> 172.21.15.118:0/571583907 conn(0x7fb7bc0b2860 msgr2=0x7fb7bc0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.063+0000 7fb7c1800640 1 -- 172.21.15.118:0/571583907 shutdown_connections 2024-09-21T06:11:26.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.063+0000 7fb7c1800640 1 -- 172.21.15.118:0/571583907 wait complete. 2024-09-21T06:11:26.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.066+0000 7fb7c1800640 1 Processor -- start 2024-09-21T06:11:26.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.066+0000 7fb7c1800640 1 -- start start 2024-09-21T06:11:26.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.067+0000 7fb7c1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7a0005250 0x7fb7bc150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.067+0000 7fb7c1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7bc150990 0x7fb7bc13ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.067+0000 7fb7c1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7bc13efb0 0x7fb7bc13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.067+0000 7fb7c1800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc072bb0 con 0x7fb7bc13efb0 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.067+0000 7fb7c1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc15ca40 con 0x7fb7a0005250 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.067+0000 7fb7c1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb7bc072d30 con 0x7fb7bc150990 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.067+0000 7fb7bb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7bc13efb0 0x7fb7bc13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7bc13efb0 0x7fb7bc13d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35242/0 (socket says 172.21.15.118:35242) 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 -- 172.21.15.118:0/3027485962 learned_addr learned my addr 172.21.15.118:0/3027485962 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7ba000640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7bc150990 0x7fb7bc13ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7baa00640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7a0005250 0x7fb7bc150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 -- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7bc150990 msgr2=0x7fb7bc13ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7bc150990 0x7fb7bc13ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 -- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7a0005250 msgr2=0x7fb7bc150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7a0005250 0x7fb7bc150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 -- 172.21.15.118:0/3027485962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc13d910 con 0x7fb7bc13efb0 2024-09-21T06:11:26.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7bb400640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7bc13efb0 0x7fb7bc13d3d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb7b402ac80 tx=0x7fb7b4006d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.068+0000 7fb7b2a00640 1 -- 172.21.15.118:0/3027485962 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4003d80 con 0x7fb7bc13efb0 2024-09-21T06:11:26.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.069+0000 7fb7b2a00640 1 -- 172.21.15.118:0/3027485962 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7b4005a90 con 0x7fb7bc13efb0 2024-09-21T06:11:26.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.069+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc13bdf0 con 0x7fb7bc13efb0 2024-09-21T06:11:26.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.069+0000 7fb7b2a00640 1 -- 172.21.15.118:0/3027485962 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4005ec0 con 0x7fb7bc13efb0 2024-09-21T06:11:26.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.069+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc13c3b0 con 0x7fb7bc13efb0 2024-09-21T06:11:26.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.070+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc0b5720 con 0x7fb7bc13efb0 2024-09-21T06:11:26.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.071+0000 7fb7b2a00640 1 -- 172.21.15.118:0/3027485962 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb7b4006060 con 0x7fb7bc13efb0 2024-09-21T06:11:26.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.072+0000 7fb7b2a00640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb79c078b90 0x7fb79c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.072+0000 7fb7b2a00640 1 -- 172.21.15.118:0/3027485962 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7fb7b40ba730 con 0x7fb7bc13efb0 2024-09-21T06:11:26.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.072+0000 7fb7baa00640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb79c078b90 0x7fb79c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.073+0000 7fb7baa00640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb79c078b90 0x7fb79c07b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009bd0 tx=0x7fb7ac005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.076+0000 7fb7b2a00640 1 -- 172.21.15.118:0/3027485962 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb7b4043060 con 0x7fb7bc13efb0 2024-09-21T06:11:26.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.334+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7fb7bc15d450 con 0x7fb7bc13efb0 2024-09-21T06:11:26.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.447+0000 7fb7b2a00640 1 -- 172.21.15.118:0/3027485962 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v388) ==== 140+0+0 (secure 0 0 0) 0x7fb7b4082e90 con 0x7fb7bc13efb0 2024-09-21T06:11:26.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb79c078b90 msgr2=0x7fb79c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb79c078b90 0x7fb79c07b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009bd0 tx=0x7fb7ac005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:26.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7bc13efb0 msgr2=0x7fb7bc13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7bc13efb0 0x7fb7bc13d3d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb7b402ac80 tx=0x7fb7b4006d20 comp rx=0 tx=0).stop 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 shutdown_connections 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7bc13efb0 0x7fb7bc13d3d0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb79c078b90 0x7fb79c07b0a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7bc150990 0x7fb7bc13ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 --2- 172.21.15.118:0/3027485962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7a0005250 0x7fb7bc150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.449+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 >> 172.21.15.118:0/3027485962 conn(0x7fb7bc0b2860 msgr2=0x7fb7bc15e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.450+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 shutdown_connections 2024-09-21T06:11:26.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.450+0000 7fb7c1800640 1 -- 172.21.15.118:0/3027485962 wait complete. 2024-09-21T06:11:26.472 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-21T06:11:26.472 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2024-09-21T06:11:26.472 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:11:26.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.691+0000 7f7bd3e00640 1 -- 172.21.15.118:0/2001460779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 msgr2=0x7f7bb800cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.691+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/2001460779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bb800cad0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c610 tx=0x7f7bb8006940 comp rx=0 tx=0).stop 2024-09-21T06:11:26.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.691+0000 7f7bd3e00640 1 -- 172.21.15.118:0/2001460779 shutdown_connections 2024-09-21T06:11:26.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.691+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/2001460779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bb800cad0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.691+0000 7f7bd3e00640 1 -- 172.21.15.118:0/2001460779 >> 172.21.15.118:0/2001460779 conn(0x7f7bd406d6e0 msgr2=0x7f7bd40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.691+0000 7f7bd3e00640 1 -- 172.21.15.118:0/2001460779 shutdown_connections 2024-09-21T06:11:26.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.691+0000 7f7bd3e00640 1 -- 172.21.15.118:0/2001460779 wait complete. 2024-09-21T06:11:26.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.693+0000 7f7bd3e00640 1 Processor -- start 2024-09-21T06:11:26.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.693+0000 7f7bd3e00640 1 -- start start 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bd40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd40afa00 0x7f7bd41e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd41544a0 0x7f7bd41e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd4070d30 con 0x7f7bb8006380 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd4070bb0 con 0x7f7bd40afa00 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd40749d0 con 0x7f7bd41544a0 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bd40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bd40ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35256/0 (socket says 172.21.15.118:35256) 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 -- 172.21.15.118:0/951200746 learned_addr learned my addr 172.21.15.118:0/951200746 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bcbe00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd40afa00 0x7f7bd41e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3400640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd41544a0 0x7f7bd41e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 -- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd41544a0 msgr2=0x7f7bd41e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd41544a0 0x7f7bd41e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 -- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd40afa00 msgr2=0x7f7bd41e8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd40afa00 0x7f7bd41e8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd2a00640 1 -- 172.21.15.118:0/951200746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd41e8780 con 0x7f7bb8006380 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.695+0000 7f7bd3400640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd41544a0 0x7f7bd41e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.696+0000 7f7bd2a00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bd40ae8b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4011ae0 tx=0x7f7bc4009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.696+0000 7f7bcaa00640 1 -- 172.21.15.118:0/951200746 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc401e070 con 0x7f7bb8006380 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.696+0000 7f7bcaa00640 1 -- 172.21.15.118:0/951200746 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bc4004460 con 0x7f7bb8006380 2024-09-21T06:11:26.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.696+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd40af1b0 con 0x7f7bb8006380 2024-09-21T06:11:26.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.696+0000 7f7bcaa00640 1 -- 172.21.15.118:0/951200746 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400fc60 con 0x7f7bb8006380 2024-09-21T06:11:26.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.696+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd41e7a40 con 0x7f7bb8006380 2024-09-21T06:11:26.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.697+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd415ee20 con 0x7f7bb8006380 2024-09-21T06:11:26.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.698+0000 7f7bcaa00640 1 -- 172.21.15.118:0/951200746 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bc4021070 con 0x7f7bb8006380 2024-09-21T06:11:26.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.699+0000 7f7bcaa00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.699+0000 7f7bcaa00640 1 -- 172.21.15.118:0/951200746 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f7bc409b340 con 0x7f7bb8006380 2024-09-21T06:11:26.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.700+0000 7f7bcbe00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.700+0000 7f7bcbe00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40af850 tx=0x7f7bbc006b10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.704+0000 7f7bcaa00640 1 -- 172.21.15.118:0/951200746 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7bc4063430 con 0x7f7bb8006380 2024-09-21T06:11:26.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.891+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bd415ca50 con 0x7f7bb8006380 2024-09-21T06:11:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.892+0000 7f7bcaa00640 1 -- 172.21.15.118:0/951200746 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+13117 (secure 0 0 0) 0x7f7bc4067e60 con 0x7f7bb8006380 2024-09-21T06:11:26.893 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:26.893 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":139,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:11:25.358169+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6835/2073034687":"2024-09-22T06:11:22.278109+0000","172.21.15.118:6833/2073034687":"2024-09-22T06:11:22.278109+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 msgr2=0x7f7bb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40af850 tx=0x7f7bbc006b10 comp rx=0 tx=0).stop 2024-09-21T06:11:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 msgr2=0x7f7bd40ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bd40ae8b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4011ae0 tx=0x7f7bc4009e40 comp rx=0 tx=0).stop 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 shutdown_connections 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7bb0078bc0 0x7f7bb007b0d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd41544a0 0x7f7bd41e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd40afa00 0x7f7bd41e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 --2- 172.21.15.118:0/951200746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb8006380 0x7f7bd40ae8b0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 >> 172.21.15.118:0/951200746 conn(0x7f7bd406d6e0 msgr2=0x7f7bd415b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 shutdown_connections 2024-09-21T06:11:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:26.896+0000 7f7bd3e00640 1 -- 172.21.15.118:0/951200746 wait complete. 2024-09-21T06:11:26.921 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:11:26.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:11:27.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.142+0000 7f4af5000640 1 -- 172.21.15.118:0/4025316292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 msgr2=0x7f4af0072bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.142+0000 7f4af5000640 1 --2- 172.21.15.118:0/4025316292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0072bb0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4af00d05f0 tx=0x7f4ae002a560 comp rx=0 tx=0).stop 2024-09-21T06:11:27.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.143+0000 7f4af5000640 1 -- 172.21.15.118:0/4025316292 shutdown_connections 2024-09-21T06:11:27.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.143+0000 7f4af5000640 1 --2- 172.21.15.118:0/4025316292 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4af00b5720 0x7f4af00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.143+0000 7f4af5000640 1 --2- 172.21.15.118:0/4025316292 >> v2:172.21.15.149:3300/0 conn(0x7f4af015c1b0 0x7f4af015c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.143+0000 7f4af5000640 1 --2- 172.21.15.118:0/4025316292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0072bb0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.143+0000 7f4af5000640 1 -- 172.21.15.118:0/4025316292 >> 172.21.15.118:0/4025316292 conn(0x7f4af00b2860 msgr2=0x7f4af00b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:27.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.143+0000 7f4af5000640 1 -- 172.21.15.118:0/4025316292 shutdown_connections 2024-09-21T06:11:27.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.143+0000 7f4af5000640 1 -- 172.21.15.118:0/4025316292 wait complete. 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.145+0000 7f4af5000640 1 Processor -- start 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.145+0000 7f4af5000640 1 -- start start 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.146+0000 7f4af5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4af00b5720 0x7f4af01f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.146+0000 7f4af5000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.146+0000 7f4af5000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4af015c1b0 0x7f4af0158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.146+0000 7f4af5000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4af00b45c0 con 0x7f4af0152d10 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4af5000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4af00b4440 con 0x7f4af00b5720 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4af5000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4af00b4740 con 0x7f4af015c1b0 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35276/0 (socket says 172.21.15.118:35276) 2024-09-21T06:11:27.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 -- 172.21.15.118:0/424177913 learned_addr learned my addr 172.21.15.118:0/424177913 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aee800640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4af015c1b0 0x7f4af0158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aede00640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4af00b5720 0x7f4af01f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 -- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4af015c1b0 msgr2=0x7f4af0158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4af015c1b0 0x7f4af0158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 -- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4af00b5720 msgr2=0x7f4af01f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4af00b5720 0x7f4af01f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 -- 172.21.15.118:0/424177913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af0144870 con 0x7f4af0152d10 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aee800640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4af015c1b0 0x7f4af0158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aede00640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4af00b5720 0x7f4af01f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.147+0000 7f4aed400640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0144330 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d720 tx=0x7f4adc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.148+0000 7f4ae6000640 1 -- 172.21.15.118:0/424177913 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc017070 con 0x7f4af0152d10 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.148+0000 7f4ae6000640 1 -- 172.21.15.118:0/424177913 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4adc009d20 con 0x7f4af0152d10 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.148+0000 7f4ae6000640 1 -- 172.21.15.118:0/424177913 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0106c0 con 0x7f4af0152d10 2024-09-21T06:11:27.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.148+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af00b0f30 con 0x7f4af0152d10 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.148+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af0157b70 con 0x7f4af0152d10 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.149+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af00b4c60 con 0x7f4af0152d10 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.150+0000 7f4ae6000640 1 -- 172.21.15.118:0/424177913 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4adc01a070 con 0x7f4af0152d10 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.151+0000 7f4ae6000640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4ad0078bc0 0x7f4ad007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.151+0000 7f4ae6000640 1 -- 172.21.15.118:0/424177913 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f4adc09ab40 con 0x7f4af0152d10 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.151+0000 7f4aede00640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4ad0078bc0 0x7f4ad007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.152+0000 7f4aede00640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4ad0078bc0 0x7f4ad007b0d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0033000 tx=0x7f4ae0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.155+0000 7f4ae6000640 1 -- 172.21.15.118:0/424177913 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4af0144870 con 0x7f4af0152d10 2024-09-21T06:11:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.340+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4af00b0cc0 con 0x7f4af0152d10 2024-09-21T06:11:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.340+0000 7f4ae6000640 1 -- 172.21.15.118:0/424177913 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) ==== 93+0+10 (secure 0 0 0) 0x7f4adc0631e0 con 0x7f4af0152d10 2024-09-21T06:11:27.342 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:11:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4ad0078bc0 msgr2=0x7f4ad007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4ad0078bc0 0x7f4ad007b0d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0033000 tx=0x7f4ae0004730 comp rx=0 tx=0).stop 2024-09-21T06:11:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 msgr2=0x7f4af0144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0144330 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d720 tx=0x7f4adc00dbe0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 shutdown_connections 2024-09-21T06:11:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4ad0078bc0 0x7f4ad007b0d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4af015c1b0 0x7f4af0158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4af0152d10 0x7f4af0144330 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 --2- 172.21.15.118:0/424177913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4af00b5720 0x7f4af01f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 >> 172.21.15.118:0/424177913 conn(0x7f4af00b2860 msgr2=0x7f4af006fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 shutdown_connections 2024-09-21T06:11:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.343+0000 7f4af5000640 1 -- 172.21.15.118:0/424177913 wait complete. 2024-09-21T06:11:27.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-21T06:11:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 -- 172.21.15.118:0/1982801185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c0cedb0 msgr2=0x7f613c0cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 --2- 172.21.15.118:0/1982801185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c0cedb0 0x7f613c0cf1c0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f613c06dc80 tx=0x7f612402a560 comp rx=0 tx=0).stop 2024-09-21T06:11:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 -- 172.21.15.118:0/1982801185 shutdown_connections 2024-09-21T06:11:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 --2- 172.21.15.118:0/1982801185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c0cedb0 0x7f613c0cf1c0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 --2- 172.21.15.118:0/1982801185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613c0cf700 0x7f613c15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 --2- 172.21.15.118:0/1982801185 >> v2:172.21.15.149:3300/0 conn(0x7f613c144ea0 0x7f613c144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 -- 172.21.15.118:0/1982801185 >> 172.21.15.118:0/1982801185 conn(0x7f613c06d6e0 msgr2=0x7f613c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:27.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 -- 172.21.15.118:0/1982801185 shutdown_connections 2024-09-21T06:11:27.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.586+0000 7f6142000640 1 -- 172.21.15.118:0/1982801185 wait complete. 2024-09-21T06:11:27.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.588+0000 7f6142000640 1 Processor -- start 2024-09-21T06:11:27.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.588+0000 7f6142000640 1 -- start start 2024-09-21T06:11:27.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6142000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f613c0cedb0 0x7f613c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6142000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613c0cf700 0x7f613c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6142000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c144ea0 0x7f613c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6142000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f613c160000 con 0x7f613c144ea0 2024-09-21T06:11:27.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6142000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f613c15fe80 con 0x7f613c0cedb0 2024-09-21T06:11:27.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6142000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f613c160180 con 0x7f613c0cf700 2024-09-21T06:11:27.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6141600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c144ea0 0x7f613c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6141600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c144ea0 0x7f613c15cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35290/0 (socket says 172.21.15.118:35290) 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6141600640 1 -- 172.21.15.118:0/2043076074 learned_addr learned my addr 172.21.15.118:0/2043076074 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6133e00640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613c0cf700 0x7f613c15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.590+0000 7f6140c00640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f613c0cedb0 0x7f613c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6141600640 1 -- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613c0cf700 msgr2=0x7f613c15caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6141600640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613c0cf700 0x7f613c15caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6141600640 1 -- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f613c0cedb0 msgr2=0x7f613c15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6141600640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f613c0cedb0 0x7f613c15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6141600640 1 -- 172.21.15.118:0/2043076074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c15bdd0 con 0x7f613c144ea0 2024-09-21T06:11:27.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6141600640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c144ea0 0x7f613c15cfe0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f613400e9c0 tx=0x7f613400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6139600640 1 -- 172.21.15.118:0/2043076074 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134004d20 con 0x7f613c144ea0 2024-09-21T06:11:27.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6139600640 1 -- 172.21.15.118:0/2043076074 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f613400cb20 con 0x7f613c144ea0 2024-09-21T06:11:27.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c1f5d10 con 0x7f613c144ea0 2024-09-21T06:11:27.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6139600640 1 -- 172.21.15.118:0/2043076074 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134005020 con 0x7f613c144ea0 2024-09-21T06:11:27.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.591+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c1f62d0 con 0x7f613c144ea0 2024-09-21T06:11:27.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.592+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c15ef30 con 0x7f613c144ea0 2024-09-21T06:11:27.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.594+0000 7f6139600640 1 -- 172.21.15.118:0/2043076074 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61340051c0 con 0x7f613c144ea0 2024-09-21T06:11:27.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.595+0000 7f6139600640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6118078bc0 0x7f611807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.595+0000 7f6139600640 1 -- 172.21.15.118:0/2043076074 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f613409b270 con 0x7f613c144ea0 2024-09-21T06:11:27.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.595+0000 7f6140c00640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6118078bc0 0x7f611807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.596+0000 7f6140c00640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6118078bc0 0x7f611807b0d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f612c004510 tx=0x7f612c00b390 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.599+0000 7f6139600640 1 -- 172.21.15.118:0/2043076074 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6134016030 con 0x7f613c144ea0 2024-09-21T06:11:27.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:27.856+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7f613c1f7e00 con 0x7f613c144ea0 2024-09-21T06:11:28.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.455+0000 7f6139600640 1 -- 172.21.15.118:0/2043076074 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v390) ==== 135+0+0 (secure 0 0 0) 0x7f6134099e20 con 0x7f613c144ea0 2024-09-21T06:11:28.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6118078bc0 msgr2=0x7f611807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6118078bc0 0x7f611807b0d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f612c004510 tx=0x7f612c00b390 comp rx=0 tx=0).stop 2024-09-21T06:11:28.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c144ea0 msgr2=0x7f613c15cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c144ea0 0x7f613c15cfe0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f613400e9c0 tx=0x7f613400ee80 comp rx=0 tx=0).stop 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 shutdown_connections 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c144ea0 0x7f613c15cfe0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6118078bc0 0x7f611807b0d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f613c0cf700 0x7f613c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 --2- 172.21.15.118:0/2043076074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f613c0cedb0 0x7f613c15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 >> 172.21.15.118:0/2043076074 conn(0x7f613c06d6e0 msgr2=0x7f613c073540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 shutdown_connections 2024-09-21T06:11:28.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.458+0000 7f6142000640 1 -- 172.21.15.118:0/2043076074 wait complete. 2024-09-21T06:11:28.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:11:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.704+0000 7fd1bde00640 1 -- 172.21.15.118:0/901147608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b8074380 msgr2=0x7fd1b80cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.704+0000 7fd1bde00640 1 --2- 172.21.15.118:0/901147608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b8074380 0x7fd1b80cd150 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0005fd0 tx=0x7fd1b002a8b0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.704+0000 7fd1bde00640 1 -- 172.21.15.118:0/901147608 shutdown_connections 2024-09-21T06:11:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.704+0000 7fd1bde00640 1 --2- 172.21.15.118:0/901147608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b8074380 0x7fd1b80cd150 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.704+0000 7fd1bde00640 1 -- 172.21.15.118:0/901147608 >> 172.21.15.118:0/901147608 conn(0x7fd1b806d110 msgr2=0x7fd1b806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.704+0000 7fd1bde00640 1 -- 172.21.15.118:0/901147608 shutdown_connections 2024-09-21T06:11:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.704+0000 7fd1bde00640 1 -- 172.21.15.118:0/901147608 wait complete. 2024-09-21T06:11:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.706+0000 7fd1bde00640 1 Processor -- start 2024-09-21T06:11:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.707+0000 7fd1bde00640 1 -- start start 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1bde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1b8074380 0x7fd1b81f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1bde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1b80b3a60 0x7fd1b81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1bde00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b815cfd0 0x7fd1b80cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1bde00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8167260 con 0x7fd1b815cfd0 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1bde00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b81670e0 con 0x7fd1b80b3a60 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1bde00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b81673e0 con 0x7fd1b8074380 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1b7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b815cfd0 0x7fd1b80cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1b7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b815cfd0 0x7fd1b80cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35308/0 (socket says 172.21.15.118:35308) 2024-09-21T06:11:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.708+0000 7fd1b7400640 1 -- 172.21.15.118:0/3045434572 learned_addr learned my addr 172.21.15.118:0/3045434572 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1ae000640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1b80b3a60 0x7fd1b81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1b6a00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1b8074380 0x7fd1b81f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1b7400640 1 -- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1b8074380 msgr2=0x7fd1b81f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1b7400640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1b8074380 0x7fd1b81f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1b7400640 1 -- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1b80b3a60 msgr2=0x7fd1b81551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1b7400640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1b80b3a60 0x7fd1b81551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1b7400640 1 -- 172.21.15.118:0/3045434572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b81f6a60 con 0x7fd1b815cfd0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1b7400640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b815cfd0 0x7fd1b80cedd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0006010 tx=0x7fd1b0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1afe00640 1 -- 172.21.15.118:0/3045434572 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0031b90 con 0x7fd1b815cfd0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1afe00640 1 -- 172.21.15.118:0/3045434572 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1b0031e20 con 0x7fd1b815cfd0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1afe00640 1 -- 172.21.15.118:0/3045434572 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00332f0 con 0x7fd1b815cfd0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.709+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b81f6d40 con 0x7fd1b815cfd0 2024-09-21T06:11:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.710+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b8165520 con 0x7fd1b815cfd0 2024-09-21T06:11:28.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.711+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b80b5040 con 0x7fd1b815cfd0 2024-09-21T06:11:28.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.712+0000 7fd1afe00640 1 -- 172.21.15.118:0/3045434572 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd1b0031660 con 0x7fd1b815cfd0 2024-09-21T06:11:28.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.714+0000 7fd1afe00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd194078b90 0x7fd19407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.714+0000 7fd1afe00640 1 -- 172.21.15.118:0/3045434572 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7fd1b00bc5c0 con 0x7fd1b815cfd0 2024-09-21T06:11:28.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.714+0000 7fd1b6a00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd194078b90 0x7fd19407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.715+0000 7fd1b6a00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd194078b90 0x7fd19407b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80046b0 tx=0x7fd1a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:28.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.717+0000 7fd1afe00640 1 -- 172.21.15.118:0/3045434572 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd1b0052080 con 0x7fd1b815cfd0 2024-09-21T06:11:28.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.903+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd1b815e870 con 0x7fd1b815cfd0 2024-09-21T06:11:28.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.903+0000 7fd1afe00640 1 -- 172.21.15.118:0/3045434572 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+1472 (secure 0 0 0) 0x7fd1b003f030 con 0x7fd1b815cfd0 2024-09-21T06:11:28.905 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:11:28.905 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:11:28.905 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:11:28.905 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:11:28.905 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:11:28.905 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:11:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:11:28.907 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:11:28.907 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:11:28.907 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:11:28.907 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd194078b90 msgr2=0x7fd19407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd194078b90 0x7fd19407b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80046b0 tx=0x7fd1a8009040 comp rx=0 tx=0).stop 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b815cfd0 msgr2=0x7fd1b80cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b815cfd0 0x7fd1b80cedd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0006010 tx=0x7fd1b0003ba0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 shutdown_connections 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b815cfd0 0x7fd1b80cedd0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1b80b3a60 0x7fd1b81551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd194078b90 0x7fd19407b0a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 --2- 172.21.15.118:0/3045434572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1b8074380 0x7fd1b81f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 >> 172.21.15.118:0/3045434572 conn(0x7fd1b806d110 msgr2=0x7fd1b806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:28.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 shutdown_connections 2024-09-21T06:11:28.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:28.906+0000 7fd1bde00640 1 -- 172.21.15.118:0/3045434572 wait complete. 2024-09-21T06:11:28.929 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 -- 172.21.15.118:0/3198104384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134813fef0 msgr2=0x7f13480d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 --2- 172.21.15.118:0/3198104384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134813fef0 0x7f13480d13c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1334009830 tx=0x7f133402a480 comp rx=0 tx=0).stop 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 -- 172.21.15.118:0/3198104384 shutdown_connections 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 --2- 172.21.15.118:0/3198104384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134813fef0 0x7f13480d13c0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 --2- 172.21.15.118:0/3198104384 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f134813fae0 0x7f13480d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 -- 172.21.15.118:0/3198104384 >> 172.21.15.118:0/3198104384 conn(0x7f134806d110 msgr2=0x7f134806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 -- 172.21.15.118:0/3198104384 shutdown_connections 2024-09-21T06:11:29.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.152+0000 7f134fe00640 1 -- 172.21.15.118:0/3198104384 wait complete. 2024-09-21T06:11:29.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.154+0000 7f134fe00640 1 Processor -- start 2024-09-21T06:11:29.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.155+0000 7f134fe00640 1 -- start start 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f134813fae0 0x7f1348153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f134813fef0 0x7f13480b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348142730 0x7f13480b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13480cfac0 con 0x7f1348142730 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13480cf940 con 0x7f134813fef0 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f13480cfc40 con 0x7f134813fae0 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348142730 0x7f13480b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348142730 0x7f13480b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35312/0 (socket says 172.21.15.118:35312) 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134de00640 1 -- 172.21.15.118:0/325533689 learned_addr learned my addr 172.21.15.118:0/325533689 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134d400640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f134813fae0 0x7f1348153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.156+0000 7f134ca00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f134813fef0 0x7f13480b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134de00640 1 -- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f134813fae0 msgr2=0x7f1348153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134de00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f134813fae0 0x7f1348153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134de00640 1 -- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f134813fef0 msgr2=0x7f13480b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134de00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f134813fef0 0x7f13480b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134de00640 1 -- 172.21.15.118:0/325533689 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13480b3b90 con 0x7f1348142730 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134ca00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f134813fef0 0x7f13480b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134de00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348142730 0x7f13480b4b70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f134000cb10 tx=0x7f134000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f1345600640 1 -- 172.21.15.118:0/325533689 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340016020 con 0x7f1348142730 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f1345600640 1 -- 172.21.15.118:0/325533689 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f134000ad00 con 0x7f1348142730 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13481552e0 con 0x7f1348142730 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f1345600640 1 -- 172.21.15.118:0/325533689 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340012680 con 0x7f1348142730 2024-09-21T06:11:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.157+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13480b4110 con 0x7f1348142730 2024-09-21T06:11:29.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.159+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1348155050 con 0x7f1348142730 2024-09-21T06:11:29.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.160+0000 7f1345600640 1 -- 172.21.15.118:0/325533689 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1340019020 con 0x7f1348142730 2024-09-21T06:11:29.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.161+0000 7f1345600640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1328078bc0 0x7f132807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.161+0000 7f1345600640 1 -- 172.21.15.118:0/325533689 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f134009aba0 con 0x7f1348142730 2024-09-21T06:11:29.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.161+0000 7f134d400640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1328078bc0 0x7f132807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.162+0000 7f134d400640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1328078bc0 0x7f132807b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f133c009b30 tx=0x7f133c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.165+0000 7f1345600640 1 -- 172.21.15.118:0/325533689 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1340020030 con 0x7f1348142730 2024-09-21T06:11:29.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.350+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f13480d00f0 con 0x7f1348142730 2024-09-21T06:11:29.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.354+0000 7f1345600640 1 -- 172.21.15.118:0/325533689 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f1340063370 con 0x7f1348142730 2024-09-21T06:11:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1328078bc0 msgr2=0x7f132807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1328078bc0 0x7f132807b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f133c009b30 tx=0x7f133c005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:29.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348142730 msgr2=0x7f13480b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348142730 0x7f13480b4b70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f134000cb10 tx=0x7f134000a060 comp rx=0 tx=0).stop 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 shutdown_connections 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348142730 0x7f13480b4b70 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f134813fef0 0x7f13480b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1328078bc0 0x7f132807b0d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 --2- 172.21.15.118:0/325533689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f134813fae0 0x7f1348153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 >> 172.21.15.118:0/325533689 conn(0x7f134806d110 msgr2=0x7f134806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 shutdown_connections 2024-09-21T06:11:29.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.357+0000 7f134fe00640 1 -- 172.21.15.118:0/325533689 wait complete. 2024-09-21T06:11:29.383 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:11:29.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:11:29.473 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:11:29.569 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:11:29.569 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:11:29.569 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:29.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:11:29.605 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:11:29.605 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:29.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:11:29.641 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:11:29.641 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:29.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:11:29.680 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:11:29.680 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:29.717 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:11:29.717 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:11:29.717 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:29.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.940+0000 7fbb5d600640 1 -- 172.21.15.118:0/1888854629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 msgr2=0x7fbb58169de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.940+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1888854629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb58169de0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009830 tx=0x7fbb5002a530 comp rx=0 tx=0).stop 2024-09-21T06:11:29.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.940+0000 7fbb5d600640 1 -- 172.21.15.118:0/1888854629 shutdown_connections 2024-09-21T06:11:29.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.940+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1888854629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb58169de0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.940+0000 7fbb5d600640 1 -- 172.21.15.118:0/1888854629 >> 172.21.15.118:0/1888854629 conn(0x7fbb580d4bd0 msgr2=0x7fbb580d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.940+0000 7fbb5d600640 1 -- 172.21.15.118:0/1888854629 shutdown_connections 2024-09-21T06:11:29.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.940+0000 7fbb5d600640 1 -- 172.21.15.118:0/1888854629 wait complete. 2024-09-21T06:11:29.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.942+0000 7fbb5d600640 1 Processor -- start 2024-09-21T06:11:29.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.942+0000 7fbb5d600640 1 -- start start 2024-09-21T06:11:29.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb5814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb580b3be0 0x7fbb580cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5d600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb580ba170 0x7fbb581542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5d600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5816a530 con 0x7fbb5806e6f0 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5d600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb580ba690 con 0x7fbb580ba170 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5d600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5816a6b0 con 0x7fbb580b3be0 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb5814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb5814eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35328/0 (socket says 172.21.15.118:35328) 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 -- 172.21.15.118:0/1870538779 learned_addr learned my addr 172.21.15.118:0/1870538779 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5cc00640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb580ba170 0x7fbb581542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57400640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb580b3be0 0x7fbb580cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 -- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb580b3be0 msgr2=0x7fbb580cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb580b3be0 0x7fbb580cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 -- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb580ba170 msgr2=0x7fbb581542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb580ba170 0x7fbb581542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb57e00640 1 -- 172.21.15.118:0/1870538779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb580ce410 con 0x7fbb5806e6f0 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.944+0000 7fbb5cc00640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb580ba170 0x7fbb581542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.945+0000 7fbb57e00640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb5814eb30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c7a0 tx=0x7fbb4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.945+0000 7fbb4fe00640 1 -- 172.21.15.118:0/1870538779 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48017070 con 0x7fbb5806e6f0 2024-09-21T06:11:29.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.945+0000 7fbb4fe00640 1 -- 172.21.15.118:0/1870538779 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb48005070 con 0x7fbb5806e6f0 2024-09-21T06:11:29.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.945+0000 7fbb4fe00640 1 -- 172.21.15.118:0/1870538779 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb480054c0 con 0x7fbb5806e6f0 2024-09-21T06:11:29.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.945+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb580ce6f0 con 0x7fbb5806e6f0 2024-09-21T06:11:29.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.945+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb580cecb0 con 0x7fbb5806e6f0 2024-09-21T06:11:29.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.946+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb580d2ab0 con 0x7fbb5806e6f0 2024-09-21T06:11:29.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.947+0000 7fbb4fe00640 1 -- 172.21.15.118:0/1870538779 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb4801a070 con 0x7fbb5806e6f0 2024-09-21T06:11:29.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.948+0000 7fbb4fe00640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb38078b90 0x7fbb3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.948+0000 7fbb4fe00640 1 -- 172.21.15.118:0/1870538779 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7fbb4809a060 con 0x7fbb5806e6f0 2024-09-21T06:11:29.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.949+0000 7fbb57400640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb38078b90 0x7fbb3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.949+0000 7fbb57400640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb38078b90 0x7fbb3807b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbb580cb310 tx=0x7fbb44009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:29.953+0000 7fbb4fe00640 1 -- 172.21.15.118:0/1870538779 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbb48062860 con 0x7fbb5806e6f0 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.172+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb580ccdb0 con 0x7fbb5806e6f0 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.173+0000 7fbb4fe00640 1 -- 172.21.15.118:0/1870538779 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+3917 (secure 0 0 0) 0x7fbb48062160 con 0x7fbb5806e6f0 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":70,"btime":"2024-09-21T06:11:23:422558+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1216563618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1216563618},{"type":"v1","addr":"172.21.15.149:6837","nonce":1216563618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/556219332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":556219332},{"type":"v1","addr":"172.21.15.149:6835","nonce":556219332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3612749870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3612749870},{"type":"v1","addr":"172.21.15.118:6834","nonce":3612749870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/593996601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":593996601},{"type":"v1","addr":"172.21.15.118:6835","nonce":593996601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[]} 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 70 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb38078b90 msgr2=0x7fbb3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb38078b90 0x7fbb3807b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbb580cb310 tx=0x7fbb44009040 comp rx=0 tx=0).stop 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 msgr2=0x7fbb5814eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb5814eb30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c7a0 tx=0x7fbb4800cc60 comp rx=0 tx=0).stop 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 shutdown_connections 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb580ba170 0x7fbb581542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbb38078b90 0x7fbb3807b0a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb580b3be0 0x7fbb580cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 --2- 172.21.15.118:0/1870538779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb5806e6f0 0x7fbb5814eb30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 >> 172.21.15.118:0/1870538779 conn(0x7fbb580d4bd0 msgr2=0x7fbb580d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 shutdown_connections 2024-09-21T06:11:30.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.175+0000 7fbb5d600640 1 -- 172.21.15.118:0/1870538779 wait complete. 2024-09-21T06:11:30.201 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:11:30.202 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:11:30.202 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:11:30.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:11:30.202 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:11:30.202 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:11:30.202 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:11:30.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:11:30.203 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:11:30.203 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:11:30.203 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:11:30.203 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:11:30.203 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:11:30.203 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:11:30.203 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:11:30.203 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:11:30.226 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:11:30.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:11:30.227 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:11:30.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:11:30.228 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:11:30.228 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:11:30.229 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:11:30.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:11:30.269 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:11:30.270 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:30.272 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:11:30.272 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:30.272 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:11:30.273 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:30.274 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:11:30.274 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:30.275 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:11:30.465 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:11:30.468 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:11:30.470 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:11:30.471 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:11:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.506+0000 7f99da200640 1 -- 172.21.15.118:0/922420282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 msgr2=0x7f99d40b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.506+0000 7f99da200640 1 --2- 172.21.15.118:0/922420282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d40b04f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005fd0 tx=0x7f99c402aa10 comp rx=0 tx=0).stop 2024-09-21T06:11:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.506+0000 7f99da200640 1 -- 172.21.15.118:0/922420282 shutdown_connections 2024-09-21T06:11:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.506+0000 7f99da200640 1 --2- 172.21.15.118:0/922420282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d40b04f0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.506+0000 7f99da200640 1 -- 172.21.15.118:0/922420282 >> 172.21.15.118:0/922420282 conn(0x7f99d40d0f80 msgr2=0x7f99d40d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.506+0000 7f99da200640 1 -- 172.21.15.118:0/922420282 shutdown_connections 2024-09-21T06:11:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.506+0000 7f99da200640 1 -- 172.21.15.118:0/922420282 wait complete. 2024-09-21T06:11:30.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.508+0000 7f99da200640 1 Processor -- start 2024-09-21T06:11:30.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.508+0000 7f99da200640 1 -- start start 2024-09-21T06:11:30.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99da200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99d4073250 0x7f99d415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99da200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d41f9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99da200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99d415ed10 0x7f99d41610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99da200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4070ec0 con 0x7f99d40af560 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99da200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4070d40 con 0x7f99d415ed10 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99da200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f99d4073660 con 0x7f99d4073250 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99d3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d41f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99d3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d41f9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35382/0 (socket says 172.21.15.118:35382) 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99d3e00640 1 -- 172.21.15.118:0/2293909535 learned_addr learned my addr 172.21.15.118:0/2293909535 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99d9800640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99d415ed10 0x7f99d41610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.510+0000 7f99d8e00640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99d4073250 0x7f99d415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d3e00640 1 -- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99d4073250 msgr2=0x7f99d415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d3e00640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99d4073250 0x7f99d415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d3e00640 1 -- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99d415ed10 msgr2=0x7f99d41610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d3e00640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99d415ed10 0x7f99d41610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d3e00640 1 -- 172.21.15.118:0/2293909535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d41fa1e0 con 0x7f99d40af560 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d9800640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99d415ed10 0x7f99d41610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d3e00640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d41f9610 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c3a0 tx=0x7f99bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d0c00640 1 -- 172.21.15.118:0/2293909535 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc017070 con 0x7f99d40af560 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d0c00640 1 -- 172.21.15.118:0/2293909535 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99bc0053c0 con 0x7f99d40af560 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99d0c00640 1 -- 172.21.15.118:0/2293909535 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc003850 con 0x7f99d40af560 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d41f6190 con 0x7f99d40af560 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.511+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d41f6750 con 0x7f99d40af560 2024-09-21T06:11:30.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.512+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d40b04f0 con 0x7f99d40af560 2024-09-21T06:11:30.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.514+0000 7f99d0c00640 1 -- 172.21.15.118:0/2293909535 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99bc01a070 con 0x7f99d40af560 2024-09-21T06:11:30.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.514+0000 7f99d0c00640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99b0078b90 0x7f99b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.515+0000 7f99d0c00640 1 -- 172.21.15.118:0/2293909535 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f99bc099db0 con 0x7f99d40af560 2024-09-21T06:11:30.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.515+0000 7f99d8e00640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99b0078b90 0x7f99b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.515+0000 7f99d8e00640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99b0078b90 0x7f99b007b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f99c4035000 tx=0x7f99c403b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.519+0000 7f99d0c00640 1 -- 172.21.15.118:0/2293909535 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f99bc09e070 con 0x7f99d40af560 2024-09-21T06:11:30.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:30.720+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f99d41f9f30 con 0x7f99d40af560 2024-09-21T06:11:31.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.481+0000 7f99d0c00640 1 -- 172.21.15.118:0/2293909535 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v141) ==== 97+0+0 (secure 0 0 0) 0x7f99bc061e00 con 0x7f99d40af560 2024-09-21T06:11:31.483 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99b0078b90 msgr2=0x7f99b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99b0078b90 0x7f99b007b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f99c4035000 tx=0x7f99c403b040 comp rx=0 tx=0).stop 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 msgr2=0x7f99d41f9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d41f9610 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c3a0 tx=0x7f99bc00c860 comp rx=0 tx=0).stop 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 shutdown_connections 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99d415ed10 0x7f99d41610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99d40af560 0x7f99d41f9610 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f99b0078b90 0x7f99b007b0a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 --2- 172.21.15.118:0/2293909535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99d4073250 0x7f99d415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 >> 172.21.15.118:0/2293909535 conn(0x7f99d40d0f80 msgr2=0x7f99d40b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:31.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 shutdown_connections 2024-09-21T06:11:31.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.484+0000 7f99da200640 1 -- 172.21.15.118:0/2293909535 wait complete. 2024-09-21T06:11:31.513 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 -- 172.21.15.118:0/802712849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e415cfd0 msgr2=0x7f72e40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 --2- 172.21.15.118:0/802712849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e415cfd0 0x7f72e40b3a60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009830 tx=0x7f72d402a480 comp rx=0 tx=0).stop 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 -- 172.21.15.118:0/802712849 shutdown_connections 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 --2- 172.21.15.118:0/802712849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72e40b5450 0x7f72e40cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 --2- 172.21.15.118:0/802712849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e415cfd0 0x7f72e40b3a60 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 -- 172.21.15.118:0/802712849 >> 172.21.15.118:0/802712849 conn(0x7f72e406d110 msgr2=0x7f72e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 -- 172.21.15.118:0/802712849 shutdown_connections 2024-09-21T06:11:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.734+0000 7f72ea000640 1 -- 172.21.15.118:0/802712849 wait complete. 2024-09-21T06:11:31.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.736+0000 7f72ea000640 1 Processor -- start 2024-09-21T06:11:31.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.737+0000 7f72ea000640 1 -- start start 2024-09-21T06:11:31.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72ea000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e40b5040 0x7f72e4144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72ea000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e40b5450 0x7f72e41424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72ea000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72e415cfd0 0x7f72e41f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72ea000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f72e4073c60 con 0x7f72e40b5040 2024-09-21T06:11:31.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72ea000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72e4073ae0 con 0x7f72e40b5450 2024-09-21T06:11:31.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72ea000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72e4073de0 con 0x7f72e415cfd0 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72e3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e40b5040 0x7f72e4144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72e3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e40b5040 0x7f72e4144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35402/0 (socket says 172.21.15.118:35402) 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72e3400640 1 -- 172.21.15.118:0/1357042354 learned_addr learned my addr 172.21.15.118:0/1357042354 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.738+0000 7f72e2a00640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e40b5450 0x7f72e41424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3e00640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72e415cfd0 0x7f72e41f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3400640 1 -- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72e415cfd0 msgr2=0x7f72e41f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3400640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72e415cfd0 0x7f72e41f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3400640 1 -- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e40b5450 msgr2=0x7f72e41424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3400640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e40b5450 0x7f72e41424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3400640 1 -- 172.21.15.118:0/1357042354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e41ea1a0 con 0x7f72e40b5040 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3e00640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72e415cfd0 0x7f72e41f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:31.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72e3400640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e40b5040 0x7f72e4144e70 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f72d4000c00 tx=0x7f72d4033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:31.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72db400640 1 -- 172.21.15.118:0/1357042354 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4005c90 con 0x7f72e40b5040 2024-09-21T06:11:31.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72db400640 1 -- 172.21.15.118:0/1357042354 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72d4031e50 con 0x7f72e40b5040 2024-09-21T06:11:31.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e41ea6a0 con 0x7f72e40b5040 2024-09-21T06:11:31.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.739+0000 7f72db400640 1 -- 172.21.15.118:0/1357042354 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d40332f0 con 0x7f72e40b5040 2024-09-21T06:11:31.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.740+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e4144390 con 0x7f72e40b5040 2024-09-21T06:11:31.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.740+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e40b3a60 con 0x7f72e40b5040 2024-09-21T06:11:31.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.742+0000 7f72db400640 1 -- 172.21.15.118:0/1357042354 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72d4033490 con 0x7f72e40b5040 2024-09-21T06:11:31.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.742+0000 7f72db400640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f72c4078bc0 0x7f72c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.743+0000 7f72db400640 1 -- 172.21.15.118:0/1357042354 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7f72d40bbf80 con 0x7f72e40b5040 2024-09-21T06:11:31.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.743+0000 7f72e2a00640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f72c4078bc0 0x7f72c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.744+0000 7f72e2a00640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f72c4078bc0 0x7f72c407b0d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f72e415bf40 tx=0x7f72d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:31.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:31.747+0000 7f72db400640 1 -- 172.21.15.118:0/1357042354 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f72d403f030 con 0x7f72e40b5040 2024-09-21T06:11:32.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.005+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f72e40d12a0 con 0x7f72e40b5040 2024-09-21T06:11:32.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.006+0000 7f72db400640 1 -- 172.21.15.118:0/1357042354 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f72d4084670 con 0x7f72e40b5040 2024-09-21T06:11:32.007 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:32.007 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:11:32.007 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:11:32.007 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:11:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.011 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.012 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.013 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:11:32.014 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.015 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:11:32.016 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:11:32.018 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:11:32.020 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:11:32.021 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:11:32.021 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:11:32.021 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:11:32.021 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.021 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.021 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:11:32.021 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:11:32.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f72c4078bc0 msgr2=0x7f72c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f72c4078bc0 0x7f72c407b0d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f72e415bf40 tx=0x7f72d0009040 comp rx=0 tx=0).stop 2024-09-21T06:11:32.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e40b5040 msgr2=0x7f72e4144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e40b5040 0x7f72e4144e70 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f72d4000c00 tx=0x7f72d4033c90 comp rx=0 tx=0).stop 2024-09-21T06:11:32.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 shutdown_connections 2024-09-21T06:11:32.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f72c4078bc0 0x7f72c407b0d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72e415cfd0 0x7f72e41f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e40b5450 0x7f72e41424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 --2- 172.21.15.118:0/1357042354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e40b5040 0x7f72e4144e70 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 >> 172.21.15.118:0/1357042354 conn(0x7f72e406d110 msgr2=0x7f72e415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 shutdown_connections 2024-09-21T06:11:32.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.008+0000 7f72ea000640 1 -- 172.21.15.118:0/1357042354 wait complete. 2024-09-21T06:11:32.031 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.248+0000 7faddd800640 1 -- 172.21.15.118:0/3409289130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd8074380 msgr2=0x7fadd80cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.248+0000 7faddd800640 1 --2- 172.21.15.118:0/3409289130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd8074380 0x7fadd80cd150 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fadd0005fd0 tx=0x7fadd002aaa0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.249+0000 7faddd800640 1 -- 172.21.15.118:0/3409289130 shutdown_connections 2024-09-21T06:11:32.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.249+0000 7faddd800640 1 --2- 172.21.15.118:0/3409289130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd8074380 0x7fadd80cd150 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.249+0000 7faddd800640 1 -- 172.21.15.118:0/3409289130 >> 172.21.15.118:0/3409289130 conn(0x7fadd806d110 msgr2=0x7fadd806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.249+0000 7faddd800640 1 -- 172.21.15.118:0/3409289130 shutdown_connections 2024-09-21T06:11:32.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.249+0000 7faddd800640 1 -- 172.21.15.118:0/3409289130 wait complete. 2024-09-21T06:11:32.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.251+0000 7faddd800640 1 Processor -- start 2024-09-21T06:11:32.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.251+0000 7faddd800640 1 -- start start 2024-09-21T06:11:32.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.252+0000 7faddd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd8074380 0x7fadd813d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.252+0000 7faddd800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadd80b3a60 0x7fadd813c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.252+0000 7faddd800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd815cfd0 0x7fadd815fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.252+0000 7faddd800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8167320 con 0x7fadd815cfd0 2024-09-21T06:11:32.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.252+0000 7faddd800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81671a0 con 0x7fadd8074380 2024-09-21T06:11:32.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.252+0000 7faddd800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fadd81674a0 con 0x7fadd80b3a60 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd815cfd0 0x7fadd815fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd815cfd0 0x7fadd815fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35406/0 (socket says 172.21.15.118:35406) 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 -- 172.21.15.118:0/516335111 learned_addr learned my addr 172.21.15.118:0/516335111 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd6a00640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd8074380 0x7fadd813d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadce000640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadd80b3a60 0x7fadd813c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 -- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadd80b3a60 msgr2=0x7fadd813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadd80b3a60 0x7fadd813c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 -- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd8074380 msgr2=0x7fadd813d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd8074380 0x7fadd813d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 -- 172.21.15.118:0/516335111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd813de40 con 0x7fadd815cfd0 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadce000640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadd80b3a60 0x7fadd813c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.253+0000 7fadd7400640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd815cfd0 0x7fadd815fcd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.254+0000 7fadcf400640 1 -- 172.21.15.118:0/516335111 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0044070 con 0x7fadd815cfd0 2024-09-21T06:11:32.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.254+0000 7fadcf400640 1 -- 172.21.15.118:0/516335111 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadd0004250 con 0x7fadd815cfd0 2024-09-21T06:11:32.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.254+0000 7fadcf400640 1 -- 172.21.15.118:0/516335111 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004680 con 0x7fadd815cfd0 2024-09-21T06:11:32.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.254+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd813c8f0 con 0x7fadd815cfd0 2024-09-21T06:11:32.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.254+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd80cf2f0 con 0x7fadd815cfd0 2024-09-21T06:11:32.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.255+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd80cf060 con 0x7fadd815cfd0 2024-09-21T06:11:32.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.256+0000 7fadcf400640 1 -- 172.21.15.118:0/516335111 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fadd0047070 con 0x7fadd815cfd0 2024-09-21T06:11:32.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.258+0000 7fadcf400640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadb4078bc0 0x7fadb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.258+0000 7fadcf400640 1 -- 172.21.15.118:0/516335111 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7fadd00bbb40 con 0x7fadd815cfd0 2024-09-21T06:11:32.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.258+0000 7fadd6a00640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadb4078bc0 0x7fadb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.259+0000 7fadd6a00640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadb4078bc0 0x7fadb407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000f60 tx=0x7fadc8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.262+0000 7fadcf400640 1 -- 172.21.15.118:0/516335111 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fadd0032030 con 0x7fadd815cfd0 2024-09-21T06:11:32.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.447+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fadd80b5040 con 0x7fadd815cfd0 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.447+0000 7fadcf400640 1 -- 172.21.15.118:0/516335111 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v143) ==== 84+0+65 (secure 0 0 0) 0x7fadd0004820 con 0x7fadd815cfd0 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:11:32.449 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:11:32.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadb4078bc0 msgr2=0x7fadb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadb4078bc0 0x7fadb407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000f60 tx=0x7fadc8009040 comp rx=0 tx=0).stop 2024-09-21T06:11:32.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd815cfd0 msgr2=0x7fadd815fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd815cfd0 0x7fadd815fcd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd0003f10 comp rx=0 tx=0).stop 2024-09-21T06:11:32.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 shutdown_connections 2024-09-21T06:11:32.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadd815cfd0 0x7fadd815fcd0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fadb4078bc0 0x7fadb407b0d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadd80b3a60 0x7fadd813c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 --2- 172.21.15.118:0/516335111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd8074380 0x7fadd813d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 >> 172.21.15.118:0/516335111 conn(0x7fadd806d110 msgr2=0x7fadd815d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 shutdown_connections 2024-09-21T06:11:32.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.450+0000 7faddd800640 1 -- 172.21.15.118:0/516335111 wait complete. 2024-09-21T06:11:32.474 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:11:32.474 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 -- 172.21.15.118:0/1629342674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540160df0 msgr2=0x7f354006f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 --2- 172.21.15.118:0/1629342674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540160df0 0x7f354006f0f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3540072460 tx=0x7f353802aa30 comp rx=0 tx=0).stop 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 -- 172.21.15.118:0/1629342674 shutdown_connections 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 --2- 172.21.15.118:0/1629342674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540160df0 0x7f354006f0f0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 --2- 172.21.15.118:0/1629342674 >> v2:172.21.15.149:3300/0 conn(0x7f35400cf790 0x7f35400cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 -- 172.21.15.118:0/1629342674 >> 172.21.15.118:0/1629342674 conn(0x7f354006d420 msgr2=0x7f35400b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 -- 172.21.15.118:0/1629342674 shutdown_connections 2024-09-21T06:11:32.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.697+0000 7f3546600640 1 -- 172.21.15.118:0/1629342674 wait complete. 2024-09-21T06:11:32.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.699+0000 7f3546600640 1 Processor -- start 2024-09-21T06:11:32.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.700+0000 7f3546600640 1 -- start start 2024-09-21T06:11:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3546600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35400cf790 0x7f3540142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3546600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3540156ef0 0x7f35401f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3546600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540074650 0x7f35400ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3546600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f354006f9c0 con 0x7f3540074650 2024-09-21T06:11:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3546600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f354006f840 con 0x7f35400cf790 2024-09-21T06:11:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3546600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f354006fb40 con 0x7f3540156ef0 2024-09-21T06:11:32.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3545c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540074650 0x7f35400ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3545c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540074650 0x7f35400ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35430/0 (socket says 172.21.15.118:35430) 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3545c00640 1 -- 172.21.15.118:0/1283838242 learned_addr learned my addr 172.21.15.118:0/1283838242 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3545200640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35400cf790 0x7f3540142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.701+0000 7f3537e00640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3540156ef0 0x7f35401f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.702+0000 7f3545c00640 1 -- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3540156ef0 msgr2=0x7f35401f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.702+0000 7f3545c00640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3540156ef0 0x7f35401f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.702+0000 7f3545c00640 1 -- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35400cf790 msgr2=0x7f3540142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.702+0000 7f3545c00640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35400cf790 0x7f3540142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.702+0000 7f3545c00640 1 -- 172.21.15.118:0/1283838242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35401fa010 con 0x7f3540074650 2024-09-21T06:11:32.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.702+0000 7f3545c00640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540074650 0x7f35400ae8e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3538009d60 tx=0x7f3538003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.702+0000 7f353d600640 1 -- 172.21.15.118:0/1283838242 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538033050 con 0x7f3540074650 2024-09-21T06:11:32.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.703+0000 7f353d600640 1 -- 172.21.15.118:0/1283838242 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3538004450 con 0x7f3540074650 2024-09-21T06:11:32.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.703+0000 7f353d600640 1 -- 172.21.15.118:0/1283838242 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538038450 con 0x7f3540074650 2024-09-21T06:11:32.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.703+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35400b10a0 con 0x7f3540074650 2024-09-21T06:11:32.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.703+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35400b08e0 con 0x7f3540074650 2024-09-21T06:11:32.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.704+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35401f5930 con 0x7f3540074650 2024-09-21T06:11:32.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.705+0000 7f353d600640 1 -- 172.21.15.118:0/1283838242 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3538036070 con 0x7f3540074650 2024-09-21T06:11:32.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.706+0000 7f353d600640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f351c078b90 0x7f351c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.706+0000 7f353d600640 1 -- 172.21.15.118:0/1283838242 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7f35380bbcb0 con 0x7f3540074650 2024-09-21T06:11:32.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.706+0000 7f3545200640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f351c078b90 0x7f351c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.707+0000 7f3545200640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f351c078b90 0x7f351c07b0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3530009b30 tx=0x7f3530005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.711+0000 7f353d600640 1 -- 172.21.15.118:0/1283838242 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f35401fa010 con 0x7f3540074650 2024-09-21T06:11:32.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:32.898+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3540070060 con 0x7f3540074650 2024-09-21T06:11:33.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.481+0000 7f353d600640 1 -- 172.21.15.118:0/1283838242 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v144) ==== 138+0+0 (secure 0 0 0) 0x7f3538083f10 con 0x7f3540074650 2024-09-21T06:11:33.482 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:11:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.484+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f351c078b90 msgr2=0x7f351c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.484+0000 7f3546600640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f351c078b90 0x7f351c07b0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3530009b30 tx=0x7f3530005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.484+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540074650 msgr2=0x7f35400ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.484+0000 7f3546600640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540074650 0x7f35400ae8e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3538009d60 tx=0x7f3538003f10 comp rx=0 tx=0).stop 2024-09-21T06:11:33.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.485+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 shutdown_connections 2024-09-21T06:11:33.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.485+0000 7f3546600640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3540074650 0x7f35400ae8e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.485+0000 7f3546600640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f351c078b90 0x7f351c07b0a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.485+0000 7f3546600640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3540156ef0 0x7f35401f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.485+0000 7f3546600640 1 --2- 172.21.15.118:0/1283838242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35400cf790 0x7f3540142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.485+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 >> 172.21.15.118:0/1283838242 conn(0x7f354006d420 msgr2=0x7f354015c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:33.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.486+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 shutdown_connections 2024-09-21T06:11:33.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.486+0000 7f3546600640 1 -- 172.21.15.118:0/1283838242 wait complete. 2024-09-21T06:11:33.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:11:33.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 -- 172.21.15.118:0/3057851911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 msgr2=0x7fd8900b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 --2- 172.21.15.118:0/3057851911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd8900b4050 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd888005fd0 tx=0x7fd88802aa10 comp rx=0 tx=0).stop 2024-09-21T06:11:33.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 -- 172.21.15.118:0/3057851911 shutdown_connections 2024-09-21T06:11:33.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 --2- 172.21.15.118:0/3057851911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd8900b4050 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 --2- 172.21.15.118:0/3057851911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8900b6950 0x7fd89015f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 -- 172.21.15.118:0/3057851911 >> 172.21.15.118:0/3057851911 conn(0x7fd8900748d0 msgr2=0x7fd890074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:33.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 -- 172.21.15.118:0/3057851911 shutdown_connections 2024-09-21T06:11:33.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.740+0000 7fd897400640 1 -- 172.21.15.118:0/3057851911 wait complete. 2024-09-21T06:11:33.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.742+0000 7fd897400640 1 Processor -- start 2024-09-21T06:11:33.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.742+0000 7fd897400640 1 -- start start 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.743+0000 7fd897400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd890075580 0x7fd8900c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.743+0000 7fd897400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8900b6950 0x7fd89009cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd897400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd89009bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd897400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900b4920 con 0x7fd8900cdfd0 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd897400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900b47a0 con 0x7fd8900b6950 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd897400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8900b4aa0 con 0x7fd890075580 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd89009bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd89009bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35458/0 (socket says 172.21.15.118:35458) 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 -- 172.21.15.118:0/218556360 learned_addr learned my addr 172.21.15.118:0/218556360 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd894a00640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd890075580 0x7fd8900c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd887e00640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8900b6950 0x7fd89009cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 -- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd890075580 msgr2=0x7fd8900c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd890075580 0x7fd8900c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 -- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8900b6950 msgr2=0x7fd89009cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8900b6950 0x7fd89009cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.744+0000 7fd895400640 1 -- 172.21.15.118:0/218556360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89009d660 con 0x7fd8900cdfd0 2024-09-21T06:11:33.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.745+0000 7fd895400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd89009bc00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd888009d90 tx=0x7fd888003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:33.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.745+0000 7fd88d600640 1 -- 172.21.15.118:0/218556360 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888033050 con 0x7fd8900cdfd0 2024-09-21T06:11:33.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.745+0000 7fd88d600640 1 -- 172.21.15.118:0/218556360 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd888004450 con 0x7fd8900cdfd0 2024-09-21T06:11:33.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.745+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89009d940 con 0x7fd8900cdfd0 2024-09-21T06:11:33.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.745+0000 7fd88d600640 1 -- 172.21.15.118:0/218556360 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888004860 con 0x7fd8900cdfd0 2024-09-21T06:11:33.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.745+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89009b6e0 con 0x7fd8900cdfd0 2024-09-21T06:11:33.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.746+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89009d3d0 con 0x7fd8900cdfd0 2024-09-21T06:11:33.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.748+0000 7fd88d600640 1 -- 172.21.15.118:0/218556360 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd888036070 con 0x7fd8900cdfd0 2024-09-21T06:11:33.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.749+0000 7fd88d600640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd86c078bc0 0x7fd86c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.749+0000 7fd88d600640 1 -- 172.21.15.118:0/218556360 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5227+0+0 (secure 0 0 0) 0x7fd8880bc640 con 0x7fd8900cdfd0 2024-09-21T06:11:33.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.749+0000 7fd894a00640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd86c078bc0 0x7fd86c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.750+0000 7fd894a00640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd86c078bc0 0x7fd86c07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd88000bb50 tx=0x7fd88000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:33.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.752+0000 7fd88d600640 1 -- 172.21.15.118:0/218556360 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd888084680 con 0x7fd8900cdfd0 2024-09-21T06:11:33.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:33.937+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd8900b4f50 con 0x7fd8900cdfd0 2024-09-21T06:11:34.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.489+0000 7fd88d600640 1 -- 172.21.15.118:0/218556360 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v145) ==== 170+0+0 (secure 0 0 0) 0x7fd8880890b0 con 0x7fd8900cdfd0 2024-09-21T06:11:34.490 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd86c078bc0 msgr2=0x7fd86c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd86c078bc0 0x7fd86c07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd88000bb50 tx=0x7fd88000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 msgr2=0x7fd89009bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd89009bc00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd888009d90 tx=0x7fd888003f90 comp rx=0 tx=0).stop 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 shutdown_connections 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8900cdfd0 0x7fd89009bc00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8900b6950 0x7fd89009cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd86c078bc0 0x7fd86c07b0d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 --2- 172.21.15.118:0/218556360 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd890075580 0x7fd8900c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.495+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 >> 172.21.15.118:0/218556360 conn(0x7fd8900748d0 msgr2=0x7fd89006f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:34.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.496+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 shutdown_connections 2024-09-21T06:11:34.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.496+0000 7fd897400640 1 -- 172.21.15.118:0/218556360 wait complete. 2024-09-21T06:11:34.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:11:34.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.757+0000 7f6220e00640 1 -- 172.21.15.118:0/3964594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 msgr2=0x7f621c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.757+0000 7f6220e00640 1 --2- 172.21.15.118:0/3964594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c0d0e80 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f620c005fd0 tx=0x7f620c02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.757+0000 7f6220e00640 1 -- 172.21.15.118:0/3964594827 shutdown_connections 2024-09-21T06:11:34.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.757+0000 7f6220e00640 1 --2- 172.21.15.118:0/3964594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c0d0e80 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.757+0000 7f6220e00640 1 -- 172.21.15.118:0/3964594827 >> 172.21.15.118:0/3964594827 conn(0x7f621c06d110 msgr2=0x7f621c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:34.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.758+0000 7f6220e00640 1 -- 172.21.15.118:0/3964594827 shutdown_connections 2024-09-21T06:11:34.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.758+0000 7f6220e00640 1 -- 172.21.15.118:0/3964594827 wait complete. 2024-09-21T06:11:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.760+0000 7f6220e00640 1 Processor -- start 2024-09-21T06:11:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.760+0000 7f6220e00640 1 -- start start 2024-09-21T06:11:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.761+0000 7f6220e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c1f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.761+0000 7f6220e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c13fef0 0x7f621c13e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.761+0000 7f6220e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621c142e40 0x7f621c13eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.761+0000 7f6220e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0cfce0 con 0x7f621c13fae0 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.761+0000 7f6220e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0cfb60 con 0x7f621c13fef0 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.761+0000 7f6220e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f621c0cfe60 con 0x7f621c142e40 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c1f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c1f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35478/0 (socket says 172.21.15.118:35478) 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 -- 172.21.15.118:0/3303714327 learned_addr learned my addr 172.21.15.118:0/3303714327 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6211400640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c13fef0 0x7f621c13e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f621a800640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621c142e40 0x7f621c13eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 -- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621c142e40 msgr2=0x7f621c13eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621c142e40 0x7f621c13eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 -- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c13fef0 msgr2=0x7f621c13e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c13fef0 0x7f621c13e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 -- 172.21.15.118:0/3303714327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c13e240 con 0x7f621c13fae0 2024-09-21T06:11:34.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.762+0000 7f6219e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c1f43b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f620c009230 tx=0x7f620c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:34.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.763+0000 7f6212a00640 1 -- 172.21.15.118:0/3303714327 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c03e030 con 0x7f621c13fae0 2024-09-21T06:11:34.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.763+0000 7f6212a00640 1 -- 172.21.15.118:0/3303714327 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f620c003e00 con 0x7f621c13fae0 2024-09-21T06:11:34.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.763+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c140430 con 0x7f621c13fae0 2024-09-21T06:11:34.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.763+0000 7f6212a00640 1 -- 172.21.15.118:0/3303714327 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c035040 con 0x7f621c13fae0 2024-09-21T06:11:34.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.763+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c1409b0 con 0x7f621c13fae0 2024-09-21T06:11:34.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.764+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c0d0310 con 0x7f621c13fae0 2024-09-21T06:11:34.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.765+0000 7f6212a00640 1 -- 172.21.15.118:0/3303714327 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f620c041030 con 0x7f621c13fae0 2024-09-21T06:11:34.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.766+0000 7f6212a00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f61f8078bc0 0x7f61f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.766+0000 7f6212a00640 1 -- 172.21.15.118:0/3303714327 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5609+0+0 (secure 0 0 0) 0x7f620c0bb4d0 con 0x7f621c13fae0 2024-09-21T06:11:34.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.767+0000 7f6211400640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f61f8078bc0 0x7f61f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.767+0000 7f6211400640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f61f8078bc0 0x7f61f807b0d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f621c13d210 tx=0x7f6204009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:34.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.771+0000 7f6212a00640 1 -- 172.21.15.118:0/3303714327 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f620c083310 con 0x7f621c13fae0 2024-09-21T06:11:34.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:34.993+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f621c0cf2a0 con 0x7f621c13fae0 2024-09-21T06:11:35.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.494+0000 7f6212a00640 1 -- 172.21.15.118:0/3303714327 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v73) ==== 174+0+0 (secure 0 0 0) 0x7f620c087d40 con 0x7f621c13fae0 2024-09-21T06:11:35.496 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 18 and data pool 19 2024-09-21T06:11:35.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f61f8078bc0 msgr2=0x7f61f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f61f8078bc0 0x7f61f807b0d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f621c13d210 tx=0x7f6204009040 comp rx=0 tx=0).stop 2024-09-21T06:11:35.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 msgr2=0x7f621c1f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c1f43b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f620c009230 tx=0x7f620c003910 comp rx=0 tx=0).stop 2024-09-21T06:11:35.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 shutdown_connections 2024-09-21T06:11:35.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f61f8078bc0 0x7f61f807b0d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621c142e40 0x7f621c13eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f621c13fef0 0x7f621c13e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 --2- 172.21.15.118:0/3303714327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f621c13fae0 0x7f621c1f43b0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 >> 172.21.15.118:0/3303714327 conn(0x7f621c06d110 msgr2=0x7f621c153cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 shutdown_connections 2024-09-21T06:11:35.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.497+0000 7f6220e00640 1 -- 172.21.15.118:0/3303714327 wait complete. 2024-09-21T06:11:35.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:11:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.746+0000 7f9662600640 1 -- 172.21.15.118:0/3940554065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 msgr2=0x7f965c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.746+0000 7f9662600640 1 --2- 172.21.15.118:0/3940554065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 0x7f965c0d0610 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f964c009820 tx=0x7f964c02a4a0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.746+0000 7f9662600640 1 -- 172.21.15.118:0/3940554065 shutdown_connections 2024-09-21T06:11:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.746+0000 7f9662600640 1 --2- 172.21.15.118:0/3940554065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 0x7f965c0d0610 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.746+0000 7f9662600640 1 -- 172.21.15.118:0/3940554065 >> 172.21.15.118:0/3940554065 conn(0x7f965c0d4bc0 msgr2=0x7f965c0d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.746+0000 7f9662600640 1 -- 172.21.15.118:0/3940554065 shutdown_connections 2024-09-21T06:11:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.746+0000 7f9662600640 1 -- 172.21.15.118:0/3940554065 wait complete. 2024-09-21T06:11:35.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.748+0000 7f9662600640 1 Processor -- start 2024-09-21T06:11:35.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.749+0000 7f9662600640 1 -- start start 2024-09-21T06:11:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9662600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 0x7f965c16a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9662600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f965c0b42f0 0x7f965c169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9662600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f965c0d1240 0x7f965c1f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9662600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0b4f90 con 0x7f965c0d1240 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9662600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0b4e10 con 0x7f965c0b3ae0 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9662600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f965c16a8a0 con 0x7f965c0b42f0 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9661c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f965c0d1240 0x7f965c1f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9661c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f965c0d1240 0x7f965c1f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35484/0 (socket says 172.21.15.118:35484) 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.750+0000 7f9661c00640 1 -- 172.21.15.118:0/3911829914 learned_addr learned my addr 172.21.15.118:0/3911829914 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661200640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 0x7f965c16a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9653e00640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f965c0b42f0 0x7f965c169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661c00640 1 -- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f965c0b42f0 msgr2=0x7f965c169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661c00640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f965c0b42f0 0x7f965c169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661c00640 1 -- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 msgr2=0x7f965c16a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661c00640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 0x7f965c16a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661c00640 1 -- 172.21.15.118:0/3911829914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c1655c0 con 0x7f965c0d1240 2024-09-21T06:11:35.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661200640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 0x7f965c16a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:35.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9661c00640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f965c0d1240 0x7f965c1f6460 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9654002230 tx=0x7f965400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9659600640 1 -- 172.21.15.118:0/3911829914 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654003b70 con 0x7f965c0d1240 2024-09-21T06:11:35.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.751+0000 7f9659600640 1 -- 172.21.15.118:0/3911829914 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9654003d10 con 0x7f965c0d1240 2024-09-21T06:11:35.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.752+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c1658a0 con 0x7f965c0d1240 2024-09-21T06:11:35.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.752+0000 7f9659600640 1 -- 172.21.15.118:0/3911829914 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654005330 con 0x7f965c0d1240 2024-09-21T06:11:35.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.752+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c160da0 con 0x7f965c0d1240 2024-09-21T06:11:35.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.753+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965c167c70 con 0x7f965c0d1240 2024-09-21T06:11:35.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.754+0000 7f9659600640 1 -- 172.21.15.118:0/3911829914 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96540056e0 con 0x7f965c0d1240 2024-09-21T06:11:35.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.755+0000 7f9659600640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9638078b90 0x7f963807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.755+0000 7f9659600640 1 -- 172.21.15.118:0/3911829914 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5709+0+0 (secure 0 0 0) 0x7f965409ae40 con 0x7f965c0d1240 2024-09-21T06:11:35.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.755+0000 7f9661200640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9638078b90 0x7f963807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.756+0000 7f9661200640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9638078b90 0x7f963807b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f964c034000 tx=0x7f964c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.760+0000 7f9659600640 1 -- 172.21.15.118:0/3911829914 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f96540631e0 con 0x7f965c0d1240 2024-09-21T06:11:35.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.945+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f965c0d0610 con 0x7f965c0d1240 2024-09-21T06:11:35.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.946+0000 7f9659600640 1 -- 172.21.15.118:0/3911829914 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16825 (secure 0 0 0) 0x7f9654062ae0 con 0x7f965c0d1240 2024-09-21T06:11:35.948 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:35.948 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":146,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:11:34.994588+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:11:32.912143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T06:11:33.950347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:35.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9638078b90 msgr2=0x7f963807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9638078b90 0x7f963807b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f964c034000 tx=0x7f964c004730 comp rx=0 tx=0).stop 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f965c0d1240 msgr2=0x7f965c1f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f965c0d1240 0x7f965c1f6460 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9654002230 tx=0x7f965400cb90 comp rx=0 tx=0).stop 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 shutdown_connections 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f965c0d1240 0x7f965c1f6460 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9638078b90 0x7f963807b0a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f965c0b42f0 0x7f965c169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 --2- 172.21.15.118:0/3911829914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f965c0b3ae0 0x7f965c16a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 >> 172.21.15.118:0/3911829914 conn(0x7f965c0d4bc0 msgr2=0x7f965c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 shutdown_connections 2024-09-21T06:11:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:35.949+0000 7f9662600640 1 -- 172.21.15.118:0/3911829914 wait complete. 2024-09-21T06:11:35.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:11:36.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.192+0000 7f5be7400640 1 -- 172.21.15.118:0/1451683241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00d1590 msgr2=0x7f5be0142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.192+0000 7f5be7400640 1 --2- 172.21.15.118:0/1451683241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00d1590 0x7f5be0142730 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009830 tx=0x7f5bc802a510 comp rx=0 tx=0).stop 2024-09-21T06:11:36.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.192+0000 7f5be7400640 1 -- 172.21.15.118:0/1451683241 shutdown_connections 2024-09-21T06:11:36.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.192+0000 7f5be7400640 1 --2- 172.21.15.118:0/1451683241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5be013fef0 0x7f5be0142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.193+0000 7f5be7400640 1 --2- 172.21.15.118:0/1451683241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00d1590 0x7f5be0142730 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.193+0000 7f5be7400640 1 -- 172.21.15.118:0/1451683241 >> 172.21.15.118:0/1451683241 conn(0x7f5be006d110 msgr2=0x7f5be006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:36.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.193+0000 7f5be7400640 1 -- 172.21.15.118:0/1451683241 shutdown_connections 2024-09-21T06:11:36.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.193+0000 7f5be7400640 1 -- 172.21.15.118:0/1451683241 wait complete. 2024-09-21T06:11:36.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.195+0000 7f5be7400640 1 Processor -- start 2024-09-21T06:11:36.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.195+0000 7f5be7400640 1 -- start start 2024-09-21T06:11:36.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.196+0000 7f5be7400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5be013fae0 0x7f5be01f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.196+0000 7f5be7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5be013fef0 0x7f5be013e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.196+0000 7f5be7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00ccea0 0x7f5be01408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.196+0000 7f5be7400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5be00cfac0 con 0x7f5be00ccea0 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.196+0000 7f5be7400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5be00cf940 con 0x7f5be013fae0 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.196+0000 7f5be7400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5be00cfc40 con 0x7f5be013fef0 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00ccea0 0x7f5be01408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00ccea0 0x7f5be01408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59376/0 (socket says 172.21.15.118:59376) 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 -- 172.21.15.118:0/1521515455 learned_addr learned my addr 172.21.15.118:0/1521515455 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5bd7e00640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5be013fef0 0x7f5be013e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be4a00640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5be013fae0 0x7f5be01f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 -- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5be013fef0 msgr2=0x7f5be013e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5be013fef0 0x7f5be013e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 -- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5be013fae0 msgr2=0x7f5be01f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5be013fae0 0x7f5be01f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 -- 172.21.15.118:0/1521515455 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be00cd730 con 0x7f5be00ccea0 2024-09-21T06:11:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.197+0000 7f5be5400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00ccea0 0x7f5be01408c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800dac0 tx=0x7f5bd800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:36.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.198+0000 7f5bdd600640 1 -- 172.21.15.118:0/1521515455 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8017070 con 0x7f5be00ccea0 2024-09-21T06:11:36.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.198+0000 7f5bdd600640 1 -- 172.21.15.118:0/1521515455 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bd8003970 con 0x7f5be00ccea0 2024-09-21T06:11:36.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.198+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be00b3bb0 con 0x7f5be00ccea0 2024-09-21T06:11:36.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.198+0000 7f5bdd600640 1 -- 172.21.15.118:0/1521515455 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8003da0 con 0x7f5be00ccea0 2024-09-21T06:11:36.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.198+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be013dd10 con 0x7f5be00ccea0 2024-09-21T06:11:36.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.199+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be00d00f0 con 0x7f5be00ccea0 2024-09-21T06:11:36.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.200+0000 7f5bdd600640 1 -- 172.21.15.118:0/1521515455 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bd8003f40 con 0x7f5be00ccea0 2024-09-21T06:11:36.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.201+0000 7f5bdd600640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5bbc078bc0 0x7f5bbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.201+0000 7f5bdd600640 1 -- 172.21.15.118:0/1521515455 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5709+0+0 (secure 0 0 0) 0x7f5bd809b0b0 con 0x7f5be00ccea0 2024-09-21T06:11:36.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.202+0000 7f5be4a00640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5bbc078bc0 0x7f5bbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.202+0000 7f5be4a00640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5bbc078bc0 0x7f5bbc07b0d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0007fd0 tx=0x7f5bd0001370 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:36.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.205+0000 7f5bdd600640 1 -- 172.21.15.118:0/1521515455 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5bd8062f30 con 0x7f5be00ccea0 2024-09-21T06:11:36.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.395+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5be00b5320 con 0x7f5be00ccea0 2024-09-21T06:11:36.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.396+0000 7f5bdd600640 1 -- 172.21.15.118:0/1521515455 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16812 (secure 0 0 0) 0x7f5bd8067960 con 0x7f5be00ccea0 2024-09-21T06:11:36.398 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:36.398 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":147,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:11:36.363257+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:11:32.912143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T06:11:33.950347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5bbc078bc0 msgr2=0x7f5bbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5bbc078bc0 0x7f5bbc07b0d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0007fd0 tx=0x7f5bd0001370 comp rx=0 tx=0).stop 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00ccea0 msgr2=0x7f5be01408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00ccea0 0x7f5be01408c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800dac0 tx=0x7f5bd800df80 comp rx=0 tx=0).stop 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 shutdown_connections 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5be00ccea0 0x7f5be01408c0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5bbc078bc0 0x7f5bbc07b0d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5be013fef0 0x7f5be013e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 --2- 172.21.15.118:0/1521515455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5be013fae0 0x7f5be01f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 >> 172.21.15.118:0/1521515455 conn(0x7f5be006d110 msgr2=0x7f5be0142b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:36.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.398+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 shutdown_connections 2024-09-21T06:11:36.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.399+0000 7f5be7400640 1 -- 172.21.15.118:0/1521515455 wait complete. 2024-09-21T06:11:36.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:11:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.648+0000 7f1df4a00640 1 -- 172.21.15.118:0/1925692583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dd4004d40 msgr2=0x7f1dd4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.648+0000 7f1df4a00640 1 --2- 172.21.15.118:0/1925692583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1dd4004d40 0x7f1dd4005150 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f1de8005fd0 tx=0x7f1dd4005830 comp rx=0 tx=0).stop 2024-09-21T06:11:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.649+0000 7f1dee800640 1 -- 172.21.15.118:0/1925692583 reap_dead start 2024-09-21T06:11:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.649+0000 7f1df4a00640 1 -- 172.21.15.118:0/1925692583 shutdown_connections 2024-09-21T06:11:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.649+0000 7f1df4a00640 1 -- 172.21.15.118:0/1925692583 >> 172.21.15.118:0/1925692583 conn(0x7f1df006d110 msgr2=0x7f1df006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.649+0000 7f1df4a00640 1 -- 172.21.15.118:0/1925692583 shutdown_connections 2024-09-21T06:11:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.649+0000 7f1df4a00640 1 -- 172.21.15.118:0/1925692583 wait complete. 2024-09-21T06:11:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.651+0000 7f1df4a00640 1 Processor -- start 2024-09-21T06:11:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.651+0000 7f1df4a00640 1 -- start start 2024-09-21T06:11:36.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1df4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df01e8430 0x7f1df0152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1df4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df01f5ec0 0x7f1df014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1df4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df01537c0 0x7f1df014fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1df4a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1df006f260 con 0x7f1df01537c0 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1df4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1df006f0e0 con 0x7f1df01e8430 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1df4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1df006f3e0 con 0x7f1df01f5ec0 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1dee800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df01537c0 0x7f1df014fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1ded400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df01f5ec0 0x7f1df014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1dede00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df01e8430 0x7f1df0152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1ded400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df01f5ec0 0x7f1df014f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:36200/0 (socket says 172.21.15.118:36200) 2024-09-21T06:11:36.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1ded400640 1 -- 172.21.15.118:0/498323098 learned_addr learned my addr 172.21.15.118:0/498323098 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1dede00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df01e8430 0x7f1df0152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:43900/0 (socket says 172.21.15.118:43900) 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1dee800640 1 -- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df01f5ec0 msgr2=0x7f1df014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1dee800640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df01f5ec0 0x7f1df014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1dee800640 1 -- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df01e8430 msgr2=0x7f1df0152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.653+0000 7f1dee800640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df01e8430 0x7f1df0152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.654+0000 7f1dee800640 1 -- 172.21.15.118:0/498323098 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df0153480 con 0x7f1df01537c0 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.654+0000 7f1dee800640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df01537c0 0x7f1df014fa70 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f1de8032000 tx=0x7f1de8033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.654+0000 7f1de6000640 1 -- 172.21.15.118:0/498323098 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8038040 con 0x7f1df01537c0 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.654+0000 7f1de6000640 1 -- 172.21.15.118:0/498323098 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1de802bc30 con 0x7f1df01537c0 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.654+0000 7f1de6000640 1 -- 172.21.15.118:0/498323098 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8009200 con 0x7f1df01537c0 2024-09-21T06:11:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.654+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df01f6410 con 0x7f1df01537c0 2024-09-21T06:11:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.654+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df01f69d0 con 0x7f1df01537c0 2024-09-21T06:11:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.655+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df00d11f0 con 0x7f1df01537c0 2024-09-21T06:11:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.657+0000 7f1de6000640 1 -- 172.21.15.118:0/498323098 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1de8044030 con 0x7f1df01537c0 2024-09-21T06:11:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.657+0000 7f1de6000640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1dd0078b90 0x7f1dd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.658+0000 7f1de6000640 1 -- 172.21.15.118:0/498323098 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f1de80bae80 con 0x7f1df01537c0 2024-09-21T06:11:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.658+0000 7f1dede00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1dd0078b90 0x7f1dd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.658+0000 7f1dede00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1dd0078b90 0x7f1dd007b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1de0001410 tx=0x7f1de0001d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:36.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.662+0000 7f1de6000640 1 -- 172.21.15.118:0/498323098 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1de804b060 con 0x7f1df01537c0 2024-09-21T06:11:36.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:36.883+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1df00b03b0 con 0x7f1df01537c0 2024-09-21T06:11:37.484 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-09-21T06:11:37.483+0000 7f0c49000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:11:37.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.514+0000 7f1de6000640 1 -- 172.21.15.118:0/498323098 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) ==== 118+0+0 (secure 0 0 0) 0x7f1de8082c60 con 0x7f1df01537c0 2024-09-21T06:11:37.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.516+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1dd0078b90 msgr2=0x7f1dd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.516+0000 7f1df4a00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1dd0078b90 0x7f1dd007b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1de0001410 tx=0x7f1de0001d60 comp rx=0 tx=0).stop 2024-09-21T06:11:37.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.516+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df01537c0 msgr2=0x7f1df014fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.516+0000 7f1df4a00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df01537c0 0x7f1df014fa70 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f1de8032000 tx=0x7f1de8033c30 comp rx=0 tx=0).stop 2024-09-21T06:11:37.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 shutdown_connections 2024-09-21T06:11:37.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1df01537c0 0x7f1df014fa70 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1dd0078b90 0x7f1dd007b0a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1df01f5ec0 0x7f1df014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 --2- 172.21.15.118:0/498323098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1df01e8430 0x7f1df0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 >> 172.21.15.118:0/498323098 conn(0x7f1df006d110 msgr2=0x7f1df0075fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:37.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 shutdown_connections 2024-09-21T06:11:37.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.517+0000 7f1df4a00640 1 -- 172.21.15.118:0/498323098 wait complete. 2024-09-21T06:11:37.543 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:11:37.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:11:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.765+0000 7fe752a00640 1 -- 172.21.15.118:0/1610433022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730004800 msgr2=0x7fe730004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.765+0000 7fe752a00640 1 --2- 172.21.15.118:0/1610433022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730004800 0x7fe730004c10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe7340016c0 tx=0x7fe730005830 comp rx=0 tx=0).stop 2024-09-21T06:11:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.765+0000 7fe752a00640 1 -- 172.21.15.118:0/1610433022 shutdown_connections 2024-09-21T06:11:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.765+0000 7fe752a00640 1 --2- 172.21.15.118:0/1610433022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730004800 0x7fe730004c10 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.765+0000 7fe752a00640 1 -- 172.21.15.118:0/1610433022 >> 172.21.15.118:0/1610433022 conn(0x7fe74c06d110 msgr2=0x7fe74c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.765+0000 7fe752a00640 1 -- 172.21.15.118:0/1610433022 shutdown_connections 2024-09-21T06:11:37.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.765+0000 7fe752a00640 1 -- 172.21.15.118:0/1610433022 wait complete. 2024-09-21T06:11:37.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.768+0000 7fe752a00640 1 Processor -- start 2024-09-21T06:11:37.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.768+0000 7fe752a00640 1 -- start start 2024-09-21T06:11:37.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe752a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe730004800 0x7fe74c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe752a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74c158580 0x7fe74c1f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe752a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c158990 0x7fe74c072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe752a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c0d16a0 con 0x7fe74c158990 2024-09-21T06:11:37.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe752a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c142730 con 0x7fe730004800 2024-09-21T06:11:37.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe752a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe74c0737a0 con 0x7fe74c158580 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe750a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c158990 0x7fe74c072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe750a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c158990 0x7fe74c072cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59400/0 (socket says 172.21.15.118:59400) 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.769+0000 7fe750a00640 1 -- 172.21.15.118:0/322492966 learned_addr learned my addr 172.21.15.118:0/322492966 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe74be00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe730004800 0x7fe74c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe743400640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74c158580 0x7fe74c1f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe750a00640 1 -- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74c158580 msgr2=0x7fe74c1f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe750a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74c158580 0x7fe74c1f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe750a00640 1 -- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe730004800 msgr2=0x7fe74c0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe750a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe730004800 0x7fe74c0cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe750a00640 1 -- 172.21.15.118:0/322492966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c157ae0 con 0x7fe74c158990 2024-09-21T06:11:37.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe750a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c158990 0x7fe74c072cd0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe74c154510 tx=0x7fe74400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:37.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe748c00640 1 -- 172.21.15.118:0/322492966 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744003d80 con 0x7fe74c158990 2024-09-21T06:11:37.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe748c00640 1 -- 172.21.15.118:0/322492966 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe744004b20 con 0x7fe74c158990 2024-09-21T06:11:37.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74c1f6370 con 0x7fe74c158990 2024-09-21T06:11:37.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.770+0000 7fe748c00640 1 -- 172.21.15.118:0/322492966 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744004030 con 0x7fe74c158990 2024-09-21T06:11:37.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.771+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74c157d80 con 0x7fe74c158990 2024-09-21T06:11:37.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.772+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74c142c90 con 0x7fe74c158990 2024-09-21T06:11:37.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.773+0000 7fe748c00640 1 -- 172.21.15.118:0/322492966 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7440041d0 con 0x7fe74c158990 2024-09-21T06:11:37.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.774+0000 7fe748c00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe728078b90 0x7fe72807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.774+0000 7fe748c00640 1 -- 172.21.15.118:0/322492966 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fe74409bc10 con 0x7fe74c158990 2024-09-21T06:11:37.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.774+0000 7fe74be00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe728078b90 0x7fe72807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.775+0000 7fe74be00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe728078b90 0x7fe72807b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000fb0 tx=0x7fe73c006040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:37.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:37.778+0000 7fe748c00640 1 -- 172.21.15.118:0/322492966 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe744063960 con 0x7fe74c158990 2024-09-21T06:11:38.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.003+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe74c158da0 con 0x7fe74c158990 2024-09-21T06:11:38.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.522+0000 7fe748c00640 1 -- 172.21.15.118:0/322492966 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v77) ==== 122+0+0 (secure 0 0 0) 0x7fe744068390 con 0x7fe74c158990 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe728078b90 msgr2=0x7fe72807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe728078b90 0x7fe72807b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000fb0 tx=0x7fe73c006040 comp rx=0 tx=0).stop 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c158990 msgr2=0x7fe74c072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c158990 0x7fe74c072cd0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe74c154510 tx=0x7fe74400f790 comp rx=0 tx=0).stop 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 shutdown_connections 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c158990 0x7fe74c072cd0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe728078b90 0x7fe72807b0a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe74c158580 0x7fe74c1f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 --2- 172.21.15.118:0/322492966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe730004800 0x7fe74c0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 >> 172.21.15.118:0/322492966 conn(0x7fe74c06d110 msgr2=0x7fe74c0cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:38.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 shutdown_connections 2024-09-21T06:11:38.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.525+0000 7fe752a00640 1 -- 172.21.15.118:0/322492966 wait complete. 2024-09-21T06:11:38.549 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:11:38.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:38.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 -- 172.21.15.118:0/494240936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e440d0ec0 msgr2=0x7f4e440d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 --2- 172.21.15.118:0/494240936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e440d0ec0 0x7f4e440d12d0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009900 tx=0x7f4e2c02a580 comp rx=0 tx=0).stop 2024-09-21T06:11:38.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 -- 172.21.15.118:0/494240936 shutdown_connections 2024-09-21T06:11:38.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 --2- 172.21.15.118:0/494240936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e440d0ec0 0x7f4e440d12d0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 --2- 172.21.15.118:0/494240936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e440ce0c0 0x7f4e441448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 -- 172.21.15.118:0/494240936 >> 172.21.15.118:0/494240936 conn(0x7f4e4406d110 msgr2=0x7f4e4406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:38.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 -- 172.21.15.118:0/494240936 shutdown_connections 2024-09-21T06:11:38.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.771+0000 7f4e4a400640 1 -- 172.21.15.118:0/494240936 wait complete. 2024-09-21T06:11:38.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.773+0000 7f4e4a400640 1 Processor -- start 2024-09-21T06:11:38.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.773+0000 7f4e4a400640 1 -- start start 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e4a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e440ce0c0 0x7f4e4413e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e4a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e440d0ec0 0x7f4e440b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e4a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e4415fa00 0x7f4e440b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e4a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4e44073ed0 con 0x7f4e4415fa00 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e4a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e44073d50 con 0x7f4e440d0ec0 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e4a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e44074050 con 0x7f4e440ce0c0 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e43e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e4415fa00 0x7f4e440b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e43400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e440ce0c0 0x7f4e4413e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e43e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e4415fa00 0x7f4e440b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59418/0 (socket says 172.21.15.118:59418) 2024-09-21T06:11:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e3aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e440d0ec0 0x7f4e440b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.775+0000 7f4e43e00640 1 -- 172.21.15.118:0/2527683079 learned_addr learned my addr 172.21.15.118:0/2527683079 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:38.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e43e00640 1 -- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e440ce0c0 msgr2=0x7f4e4413e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e43e00640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e440ce0c0 0x7f4e4413e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e43e00640 1 -- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e440d0ec0 msgr2=0x7f4e440b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e43e00640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e440d0ec0 0x7f4e440b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e43e00640 1 -- 172.21.15.118:0/2527683079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4414c2f0 con 0x7f4e4415fa00 2024-09-21T06:11:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e43e00640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e4415fa00 0x7f4e440b2dc0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c6b0 tx=0x7f4e3c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e3be00640 1 -- 172.21.15.118:0/2527683079 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c003b70 con 0x7f4e4415fa00 2024-09-21T06:11:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e3be00640 1 -- 172.21.15.118:0/2527683079 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e3c003d30 con 0x7f4e4415fa00 2024-09-21T06:11:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e3be00640 1 -- 172.21.15.118:0/2527683079 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c005330 con 0x7f4e4415fa00 2024-09-21T06:11:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4414c7f0 con 0x7f4e4415fa00 2024-09-21T06:11:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.776+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e440cf6c0 con 0x7f4e4415fa00 2024-09-21T06:11:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.777+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e44160340 con 0x7f4e4415fa00 2024-09-21T06:11:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.779+0000 7f4e3be00640 1 -- 172.21.15.118:0/2527683079 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e3c0054d0 con 0x7f4e4415fa00 2024-09-21T06:11:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.780+0000 7f4e3be00640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e20078bc0 0x7f4e2007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.780+0000 7f4e3be00640 1 -- 172.21.15.118:0/2527683079 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f4e3c09aa60 con 0x7f4e4415fa00 2024-09-21T06:11:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.780+0000 7f4e43400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e20078bc0 0x7f4e2007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.781+0000 7f4e43400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e20078bc0 0x7f4e2007b0d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4e34005fd0 tx=0x7f4e3400b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:38.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:38.784+0000 7f4e3be00640 1 -- 172.21.15.118:0/2527683079 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4e44160340 con 0x7f4e4415fa00 2024-09-21T06:11:39.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.007+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e440745e0 con 0x7f4e4415fa00 2024-09-21T06:11:39.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.008+0000 7f4e3be00640 1 -- 172.21.15.118:0/2527683079 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5237 (secure 0 0 0) 0x7f4e440d1810 con 0x7f4e4415fa00 2024-09-21T06:11:39.009 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:39.009 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:11:34.994541+0000","modified":"2024-09-21T06:11:38.003984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1596006114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1596006114},{"type":"v1","addr":"172.21.15.118:6835","nonce":1596006114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7377,"qdb_cluster":[7377]},"id":9}]} 2024-09-21T06:11:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 77 2024-09-21T06:11:39.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.010+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e20078bc0 msgr2=0x7f4e2007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.010+0000 7f4e4a400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e20078bc0 0x7f4e2007b0d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4e34005fd0 tx=0x7f4e3400b2e0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.010+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e4415fa00 msgr2=0x7f4e440b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.010+0000 7f4e4a400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e4415fa00 0x7f4e440b2dc0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c6b0 tx=0x7f4e3c00cb70 comp rx=0 tx=0).stop 2024-09-21T06:11:39.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.010+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 shutdown_connections 2024-09-21T06:11:39.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.010+0000 7f4e4a400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e4415fa00 0x7f4e440b2dc0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.010+0000 7f4e4a400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e440d0ec0 0x7f4e440b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.011+0000 7f4e4a400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e20078bc0 0x7f4e2007b0d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.011+0000 7f4e4a400640 1 --2- 172.21.15.118:0/2527683079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e440ce0c0 0x7f4e4413e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.011+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 >> 172.21.15.118:0/2527683079 conn(0x7f4e4406d110 msgr2=0x7f4e4415b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:39.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.011+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 shutdown_connections 2024-09-21T06:11:39.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.011+0000 7f4e4a400640 1 -- 172.21.15.118:0/2527683079 wait complete. 2024-09-21T06:11:39.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:11:39.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 -- 172.21.15.118:0/2252534780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80b42f0 msgr2=0x7f21b80b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 --2- 172.21.15.118:0/2252534780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80b42f0 0x7f21b80b4700 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f21b808d6f0 tx=0x7f21b002aa30 comp rx=0 tx=0).stop 2024-09-21T06:11:39.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 -- 172.21.15.118:0/2252534780 shutdown_connections 2024-09-21T06:11:39.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 --2- 172.21.15.118:0/2252534780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80b42f0 0x7f21b80b4700 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 --2- 172.21.15.118:0/2252534780 >> v2:172.21.15.149:3300/0 conn(0x7f21b80b3ae0 0x7f21b80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 -- 172.21.15.118:0/2252534780 >> 172.21.15.118:0/2252534780 conn(0x7f21b80d4bc0 msgr2=0x7f21b80d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:39.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 -- 172.21.15.118:0/2252534780 shutdown_connections 2024-09-21T06:11:39.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.251+0000 7f21bce00640 1 -- 172.21.15.118:0/2252534780 wait complete. 2024-09-21T06:11:39.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.253+0000 7f21bce00640 1 Processor -- start 2024-09-21T06:11:39.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.254+0000 7f21bce00640 1 -- start start 2024-09-21T06:11:39.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21bce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b80b3ae0 0x7f21b81eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21bce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21b80b42f0 0x7f21b81f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21bce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80d1240 0x7f21b809ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21bce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21b80b4dc0 con 0x7f21b80d1240 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21bce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f21b80b4c40 con 0x7f21b80b3ae0 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21bce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f21b80b4f40 con 0x7f21b80b42f0 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21b7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80d1240 0x7f21b809ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21b7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80d1240 0x7f21b809ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59438/0 (socket says 172.21.15.118:59438) 2024-09-21T06:11:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.255+0000 7f21b7e00640 1 -- 172.21.15.118:0/3572953996 learned_addr learned my addr 172.21.15.118:0/3572953996 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:39.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7400640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b80b3ae0 0x7f21b81eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21aea00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21b80b42f0 0x7f21b81f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7e00640 1 -- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21b80b42f0 msgr2=0x7f21b81f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7e00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21b80b42f0 0x7f21b81f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7e00640 1 -- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b80b3ae0 msgr2=0x7f21b81eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7e00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b80b3ae0 0x7f21b81eaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7e00640 1 -- 172.21.15.118:0/3572953996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b81f9fc0 con 0x7f21b80d1240 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7400640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b80b3ae0 0x7f21b81eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21b7e00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80d1240 0x7f21b809ed40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f21b002b020 tx=0x7f21b0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.256+0000 7f21afe00640 1 -- 172.21.15.118:0/3572953996 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0033050 con 0x7f21b80d1240 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.257+0000 7f21afe00640 1 -- 172.21.15.118:0/3572953996 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21b0004450 con 0x7f21b80d1240 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.257+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b81f5e90 con 0x7f21b80d1240 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.257+0000 7f21afe00640 1 -- 172.21.15.118:0/3572953996 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0038450 con 0x7f21b80d1240 2024-09-21T06:11:39.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.257+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b81f6450 con 0x7f21b80d1240 2024-09-21T06:11:39.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.258+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b81f9d30 con 0x7f21b80d1240 2024-09-21T06:11:39.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.259+0000 7f21afe00640 1 -- 172.21.15.118:0/3572953996 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21b0036070 con 0x7f21b80d1240 2024-09-21T06:11:39.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.260+0000 7f21afe00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2194078b90 0x7f219407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.260+0000 7f21afe00640 1 -- 172.21.15.118:0/3572953996 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f21b00bc2d0 con 0x7f21b80d1240 2024-09-21T06:11:39.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.261+0000 7f21b7400640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2194078b90 0x7f219407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.261+0000 7f21b7400640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2194078b90 0x7f219407b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a8005ee0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:39.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.264+0000 7f21afe00640 1 -- 172.21.15.118:0/3572953996 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21b0084700 con 0x7f21b80d1240 2024-09-21T06:11:39.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.450+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21b80d0610 con 0x7f21b80d1240 2024-09-21T06:11:39.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.451+0000 7f21afe00640 1 -- 172.21.15.118:0/3572953996 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16812 (secure 0 0 0) 0x7f21b0084000 con 0x7f21b80d1240 2024-09-21T06:11:39.453 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:39.453 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":147,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:11:36.363257+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:11:32.912143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T06:11:33.950347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2194078b90 msgr2=0x7f219407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2194078b90 0x7f219407b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a8005ee0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80d1240 msgr2=0x7f21b809ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80d1240 0x7f21b809ed40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f21b002b020 tx=0x7f21b0003f10 comp rx=0 tx=0).stop 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 shutdown_connections 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21b80d1240 0x7f21b809ed40 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2194078b90 0x7f219407b0a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21b80b42f0 0x7f21b81f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 --2- 172.21.15.118:0/3572953996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b80b3ae0 0x7f21b81eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 >> 172.21.15.118:0/3572953996 conn(0x7f21b80d4bc0 msgr2=0x7f21b80b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:39.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 shutdown_connections 2024-09-21T06:11:39.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.454+0000 7f21bce00640 1 -- 172.21.15.118:0/3572953996 wait complete. 2024-09-21T06:11:39.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:11:39.478 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.696+0000 7fd3e1e00640 1 -- 172.21.15.118:0/1503481735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0003c30 msgr2=0x7fd3c0004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.696+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/1503481735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0003c30 0x7fd3c0004080 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009b50 tx=0x7fd3c0005830 comp rx=0 tx=0).stop 2024-09-21T06:11:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.696+0000 7fd3e1e00640 1 -- 172.21.15.118:0/1503481735 shutdown_connections 2024-09-21T06:11:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.696+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/1503481735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3c0003c30 0x7fd3c0004080 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.696+0000 7fd3e1e00640 1 -- 172.21.15.118:0/1503481735 >> 172.21.15.118:0/1503481735 conn(0x7fd3dc06d6e0 msgr2=0x7fd3dc0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.696+0000 7fd3e1e00640 1 -- 172.21.15.118:0/1503481735 shutdown_connections 2024-09-21T06:11:39.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.696+0000 7fd3e1e00640 1 -- 172.21.15.118:0/1503481735 wait complete. 2024-09-21T06:11:39.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.698+0000 7fd3e1e00640 1 Processor -- start 2024-09-21T06:11:39.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.698+0000 7fd3e1e00640 1 -- start start 2024-09-21T06:11:39.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e1e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c0003c30 0x7fd3dc1f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3dc144a10 0x7fd3dc144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0729c0 0x7fd3dc072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e1e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc074d80 con 0x7fd3dc144a10 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e1e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc074c00 con 0x7fd3c0003c30 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e1e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc1e7d50 con 0x7fd3dc0729c0 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3d3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3dc144a10 0x7fd3dc144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3d3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3dc144a10 0x7fd3dc144e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59462/0 (socket says 172.21.15.118:59462) 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3d3e00640 1 -- 172.21.15.118:0/500297864 learned_addr learned my addr 172.21.15.118:0/500297864 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e0a00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c0003c30 0x7fd3dc1f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.700+0000 7fd3e1400640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0729c0 0x7fd3dc072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d3e00640 1 -- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0729c0 msgr2=0x7fd3dc072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d3e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0729c0 0x7fd3dc072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d3e00640 1 -- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c0003c30 msgr2=0x7fd3dc1f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d3e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c0003c30 0x7fd3dc1f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d3e00640 1 -- 172.21.15.118:0/500297864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc1f5cf0 con 0x7fd3dc144a10 2024-09-21T06:11:39.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d3e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3dc144a10 0x7fd3dc144e20 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400e390 tx=0x7fd3c400e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:39.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d9600640 1 -- 172.21.15.118:0/500297864 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4010890 con 0x7fd3dc144a10 2024-09-21T06:11:39.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d9600640 1 -- 172.21.15.118:0/500297864 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3c4016070 con 0x7fd3dc144a10 2024-09-21T06:11:39.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3d9600640 1 -- 172.21.15.118:0/500297864 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4010d20 con 0x7fd3dc144a10 2024-09-21T06:11:39.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc1f5fd0 con 0x7fd3dc144a10 2024-09-21T06:11:39.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.701+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc1f57b0 con 0x7fd3dc144a10 2024-09-21T06:11:39.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.702+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc0d05b0 con 0x7fd3dc144a10 2024-09-21T06:11:39.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.704+0000 7fd3d9600640 1 -- 172.21.15.118:0/500297864 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3c401b460 con 0x7fd3dc144a10 2024-09-21T06:11:39.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.704+0000 7fd3d9600640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3b8078b90 0x7fd3b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.705+0000 7fd3d9600640 1 -- 172.21.15.118:0/500297864 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fd3c409b070 con 0x7fd3dc144a10 2024-09-21T06:11:39.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.705+0000 7fd3e0a00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3b8078b90 0x7fd3b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.706+0000 7fd3e0a00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3b8078b90 0x7fd3b807b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc035000 tx=0x7fd3cc0046c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:39.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.709+0000 7fd3d9600640 1 -- 172.21.15.118:0/500297864 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd3c4062e50 con 0x7fd3dc144a10 2024-09-21T06:11:39.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.891+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3dc161840 con 0x7fd3b8078b90 2024-09-21T06:11:39.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.896+0000 7fd3d9600640 1 -- 172.21.15.118:0/500297864 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238873 (secure 0 0 0) 0x7fd3cc02bbe0 con 0x7fd3b8078b90 2024-09-21T06:11:39.900 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:39.901 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:39.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3b8078b90 msgr2=0x7fd3b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3b8078b90 0x7fd3b807b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc035000 tx=0x7fd3cc0046c0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3dc144a10 msgr2=0x7fd3dc144e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3dc144a10 0x7fd3dc144e20 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400e390 tx=0x7fd3c400e850 comp rx=0 tx=0).stop 2024-09-21T06:11:39.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 shutdown_connections 2024-09-21T06:11:39.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd3b8078b90 0x7fd3b807b0a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0729c0 0x7fd3dc072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3dc144a10 0x7fd3dc144e20 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 --2- 172.21.15.118:0/500297864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c0003c30 0x7fd3dc1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.900+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 >> 172.21.15.118:0/500297864 conn(0x7fd3dc06d6e0 msgr2=0x7fd3dc146020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:39.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.901+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 shutdown_connections 2024-09-21T06:11:39.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:39.901+0000 7fd3e1e00640 1 -- 172.21.15.118:0/500297864 wait complete. 2024-09-21T06:11:39.923 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2024-09-21T06:11:38.579439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555086,"statfs":{"total":1600000000,"available":1592408599,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.096108"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.498968+0000","last_change":"2024-09-21T06:11:34.498968+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.498968+0000","last_undegraded":"2024-09-21T06:11:34.498968+0000","last_fullsized":"2024-09-21T06:11:34.498968+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.501290+0000","last_change":"2024-09-21T06:11:34.501290+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.501290+0000","last_undegraded":"2024-09-21T06:11:34.501290+0000","last_fullsized":"2024-09-21T06:11:34.501290+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.499583+0000","last_change":"2024-09-21T06:11:34.499583+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.499583+0000","last_undegraded":"2024-09-21T06:11:34.499583+0000","last_fullsized":"2024-09-21T06:11:34.499583+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.496077+0000","last_change":"2024-09-21T06:11:34.496077+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.496077+0000","last_undegraded":"2024-09-21T06:11:34.496077+0000","last_fullsized":"2024-09-21T06:11:34.496077+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.499703+0000","last_change":"2024-09-21T06:11:34.499703+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.499703+0000","last_undegraded":"2024-09-21T06:11:34.499703+0000","last_fullsized":"2024-09-21T06:11:34.499703+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.501740+0000","last_change":"2024-09-21T06:11:34.501740+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.501740+0000","last_undegraded":"2024-09-21T06:11:34.501740+0000","last_fullsized":"2024-09-21T06:11:34.501740+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.495665+0000","last_change":"2024-09-21T06:11:34.495665+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.495665+0000","last_undegraded":"2024-09-21T06:11:34.495665+0000","last_fullsized":"2024-09-21T06:11:34.495665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.500936+0000","last_change":"2024-09-21T06:11:34.500936+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.500936+0000","last_undegraded":"2024-09-21T06:11:34.500936+0000","last_fullsized":"2024-09-21T06:11:34.500936+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.502026+0000","last_change":"2024-09-21T06:11:34.502026+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.502026+0000","last_undegraded":"2024-09-21T06:11:34.502026+0000","last_fullsized":"2024-09-21T06:11:34.502026+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486904+0000","last_change":"2024-09-21T06:11:33.486904+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486904+0000","last_undegraded":"2024-09-21T06:11:33.486904+0000","last_fullsized":"2024-09-21T06:11:33.486904+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485067+0000","last_change":"2024-09-21T06:11:33.485067+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485067+0000","last_undegraded":"2024-09-21T06:11:33.485067+0000","last_fullsized":"2024-09-21T06:11:33.485067+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.505112+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:34.505112+0000","last_peered":"2024-09-21T06:11:34.505112+0000","last_clean":"2024-09-21T06:11:34.505112+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:34.505112+0000","last_undegraded":"2024-09-21T06:11:34.505112+0000","last_fullsized":"2024-09-21T06:11:34.505112+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:52.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484417+0000","last_change":"2024-09-21T06:11:33.484417+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484417+0000","last_undegraded":"2024-09-21T06:11:33.484417+0000","last_fullsized":"2024-09-21T06:11:33.484417+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.497867+0000","last_change":"2024-09-21T06:11:34.497867+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.497867+0000","last_undegraded":"2024-09-21T06:11:34.497867+0000","last_fullsized":"2024-09-21T06:11:34.497867+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484396+0000","last_change":"2024-09-21T06:11:33.484396+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484396+0000","last_undegraded":"2024-09-21T06:11:33.484396+0000","last_fullsized":"2024-09-21T06:11:33.484396+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.494531+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:34.494531+0000","last_peered":"2024-09-21T06:11:34.494531+0000","last_clean":"2024-09-21T06:11:34.494531+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:34.494531+0000","last_undegraded":"2024-09-21T06:11:34.494531+0000","last_fullsized":"2024-09-21T06:11:34.494531+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:53.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487476+0000","last_change":"2024-09-21T06:11:33.487476+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487476+0000","last_undegraded":"2024-09-21T06:11:33.487476+0000","last_fullsized":"2024-09-21T06:11:33.487476+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484066+0000","last_change":"2024-09-21T06:11:33.484066+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484066+0000","last_undegraded":"2024-09-21T06:11:33.484066+0000","last_fullsized":"2024-09-21T06:11:33.484066+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485680+0000","last_change":"2024-09-21T06:11:33.485680+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485680+0000","last_undegraded":"2024-09-21T06:11:33.485680+0000","last_fullsized":"2024-09-21T06:11:33.485680+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510664+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:34.510664+0000","last_peered":"2024-09-21T06:11:34.510664+0000","last_clean":"2024-09-21T06:11:34.510664+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:34.510664+0000","last_undegraded":"2024-09-21T06:11:34.510664+0000","last_fullsized":"2024-09-21T06:11:34.510664+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:09.951383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485154+0000","last_change":"2024-09-21T06:11:33.485154+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485154+0000","last_undegraded":"2024-09-21T06:11:33.485154+0000","last_fullsized":"2024-09-21T06:11:33.485154+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486078+0000","last_change":"2024-09-21T06:11:33.486078+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486078+0000","last_undegraded":"2024-09-21T06:11:33.486078+0000","last_fullsized":"2024-09-21T06:11:33.486078+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485541+0000","last_change":"2024-09-21T06:11:33.485541+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485541+0000","last_undegraded":"2024-09-21T06:11:33.485541+0000","last_fullsized":"2024-09-21T06:11:33.485541+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484038+0000","last_change":"2024-09-21T06:11:33.484038+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484038+0000","last_undegraded":"2024-09-21T06:11:33.484038+0000","last_fullsized":"2024-09-21T06:11:33.484038+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485827+0000","last_change":"2024-09-21T06:11:33.485827+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485827+0000","last_undegraded":"2024-09-21T06:11:33.485827+0000","last_fullsized":"2024-09-21T06:11:33.485827+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484374+0000","last_change":"2024-09-21T06:11:33.484374+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484374+0000","last_undegraded":"2024-09-21T06:11:33.484374+0000","last_fullsized":"2024-09-21T06:11:33.484374+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510092+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:34.510092+0000","last_peered":"2024-09-21T06:11:34.510092+0000","last_clean":"2024-09-21T06:11:34.510092+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:34.510092+0000","last_undegraded":"2024-09-21T06:11:34.510092+0000","last_fullsized":"2024-09-21T06:11:34.510092+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:00.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.500067+0000","last_change":"2024-09-21T06:11:34.500067+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.500067+0000","last_undegraded":"2024-09-21T06:11:34.500067+0000","last_fullsized":"2024-09-21T06:11:34.500067+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487099+0000","last_change":"2024-09-21T06:11:33.487099+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487099+0000","last_undegraded":"2024-09-21T06:11:33.487099+0000","last_fullsized":"2024-09-21T06:11:33.487099+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484378+0000","last_change":"2024-09-21T06:11:33.484378+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484378+0000","last_undegraded":"2024-09-21T06:11:33.484378+0000","last_fullsized":"2024-09-21T06:11:33.484378+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484466+0000","last_change":"2024-09-21T06:11:33.484466+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484466+0000","last_undegraded":"2024-09-21T06:11:33.484466+0000","last_fullsized":"2024-09-21T06:11:33.484466+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510916+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:34.510916+0000","last_peered":"2024-09-21T06:11:34.510916+0000","last_clean":"2024-09-21T06:11:34.510916+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:34.510916+0000","last_undegraded":"2024-09-21T06:11:34.510916+0000","last_fullsized":"2024-09-21T06:11:34.510916+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:05.325168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.495840+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:34.495840+0000","last_peered":"2024-09-21T06:11:34.495840+0000","last_clean":"2024-09-21T06:11:34.495840+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:34.495840+0000","last_undegraded":"2024-09-21T06:11:34.495840+0000","last_fullsized":"2024-09-21T06:11:34.495840+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:21.150972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.507115+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:34.507115+0000","last_peered":"2024-09-21T06:11:34.507115+0000","last_clean":"2024-09-21T06:11:34.507115+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:34.507115+0000","last_undegraded":"2024-09-21T06:11:34.507115+0000","last_fullsized":"2024-09-21T06:11:34.507115+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:54.264880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486966+0000","last_change":"2024-09-21T06:11:33.486966+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486966+0000","last_undegraded":"2024-09-21T06:11:33.486966+0000","last_fullsized":"2024-09-21T06:11:33.486966+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486435+0000","last_change":"2024-09-21T06:11:33.486435+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486435+0000","last_undegraded":"2024-09-21T06:11:33.486435+0000","last_fullsized":"2024-09-21T06:11:33.486435+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.483976+0000","last_change":"2024-09-21T06:11:33.483976+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.483976+0000","last_undegraded":"2024-09-21T06:11:33.483976+0000","last_fullsized":"2024-09-21T06:11:33.483976+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.504602+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:34.504602+0000","last_peered":"2024-09-21T06:11:34.504602+0000","last_clean":"2024-09-21T06:11:34.504602+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:34.504602+0000","last_undegraded":"2024-09-21T06:11:34.504602+0000","last_fullsized":"2024-09-21T06:11:34.504602+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:57.225702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484058+0000","last_change":"2024-09-21T06:11:33.484058+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484058+0000","last_undegraded":"2024-09-21T06:11:33.484058+0000","last_fullsized":"2024-09-21T06:11:33.484058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487502+0000","last_change":"2024-09-21T06:11:33.487502+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487502+0000","last_undegraded":"2024-09-21T06:11:33.487502+0000","last_fullsized":"2024-09-21T06:11:33.487502+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.497194+0000","last_change":"2024-09-21T06:11:34.497194+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.497194+0000","last_undegraded":"2024-09-21T06:11:34.497194+0000","last_fullsized":"2024-09-21T06:11:34.497194+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510030+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:34.510030+0000","last_peered":"2024-09-21T06:11:34.510030+0000","last_clean":"2024-09-21T06:11:34.510030+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:34.510030+0000","last_undegraded":"2024-09-21T06:11:34.510030+0000","last_fullsized":"2024-09-21T06:11:34.510030+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.272435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.507625+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:34.507625+0000","last_peered":"2024-09-21T06:11:34.507625+0000","last_clean":"2024-09-21T06:11:34.507625+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:34.507625+0000","last_undegraded":"2024-09-21T06:11:34.507625+0000","last_fullsized":"2024-09-21T06:11:34.507625+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:50.183410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487058+0000","last_change":"2024-09-21T06:11:33.487058+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487058+0000","last_undegraded":"2024-09-21T06:11:33.487058+0000","last_fullsized":"2024-09-21T06:11:33.487058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":365,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-21T06:11:33.486597+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:33.486597+0000","last_peered":"2024-09-21T06:11:33.486597+0000","last_clean":"2024-09-21T06:11:33.486597+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:33.486597+0000","last_undegraded":"2024-09-21T06:11:33.486597+0000","last_fullsized":"2024-09-21T06:11:33.486597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":789,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194523,"statfs":{"total":200000000,"available":199191722,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193952,"statfs":{"total":200000000,"available":198607629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193952,"statfs":{"total":200000000,"available":198607629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":777,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":777,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:39.927 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 -- 172.21.15.118:0/1770060852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1448142730 msgr2=0x7f1448142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 --2- 172.21.15.118:0/1770060852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1448142730 0x7f1448142b40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1448071c00 tx=0x7f144002aa10 comp rx=0 tx=0).stop 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 -- 172.21.15.118:0/1770060852 shutdown_connections 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 --2- 172.21.15.118:0/1770060852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1448142730 0x7f1448142b40 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 --2- 172.21.15.118:0/1770060852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f144813fef0 0x7f14480d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 --2- 172.21.15.118:0/1770060852 >> v2:172.21.15.149:3300/0 conn(0x7f144813fae0 0x7f14480d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 -- 172.21.15.118:0/1770060852 >> 172.21.15.118:0/1770060852 conn(0x7f144806d110 msgr2=0x7f144806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 -- 172.21.15.118:0/1770060852 shutdown_connections 2024-09-21T06:11:40.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.182+0000 7f144f400640 1 -- 172.21.15.118:0/1770060852 wait complete. 2024-09-21T06:11:40.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.184+0000 7f144f400640 1 Processor -- start 2024-09-21T06:11:40.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.185+0000 7f144f400640 1 -- start start 2024-09-21T06:11:40.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144813fae0 0x7f1448137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f144813fef0 0x7f14481effa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1448142730 0x7f14480b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f144806f330 con 0x7f144813fae0 2024-09-21T06:11:40.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f144806f1b0 con 0x7f144813fef0 2024-09-21T06:11:40.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f144806f4b0 con 0x7f1448142730 2024-09-21T06:11:40.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144813fae0 0x7f1448137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144813fae0 0x7f1448137760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59470/0 (socket says 172.21.15.118:59470) 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144ca00640 1 -- 172.21.15.118:0/195502133 learned_addr learned my addr 172.21.15.118:0/195502133 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f144d400640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1448142730 0x7f14480b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.186+0000 7f143fe00640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f144813fef0 0x7f14481effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f144ca00640 1 -- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1448142730 msgr2=0x7f14480b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f144ca00640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1448142730 0x7f14480b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f144ca00640 1 -- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f144813fef0 msgr2=0x7f14481effa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f144ca00640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f144813fef0 0x7f14481effa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f144ca00640 1 -- 172.21.15.118:0/195502133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1448138090 con 0x7f144813fae0 2024-09-21T06:11:40.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f144ca00640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144813fae0 0x7f1448137760 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f143800d770 tx=0x7f143800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f1445600640 1 -- 172.21.15.118:0/195502133 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438017070 con 0x7f144813fae0 2024-09-21T06:11:40.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f1445600640 1 -- 172.21.15.118:0/195502133 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1438009d20 con 0x7f144813fae0 2024-09-21T06:11:40.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f1445600640 1 -- 172.21.15.118:0/195502133 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14380106c0 con 0x7f144813fae0 2024-09-21T06:11:40.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.187+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144813d820 con 0x7f144813fae0 2024-09-21T06:11:40.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.188+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144813dde0 con 0x7f144813fae0 2024-09-21T06:11:40.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.189+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f144813d640 con 0x7f144813fae0 2024-09-21T06:11:40.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.190+0000 7f1445600640 1 -- 172.21.15.118:0/195502133 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f143801a070 con 0x7f144813fae0 2024-09-21T06:11:40.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.191+0000 7f1445600640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1424078b90 0x7f142407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.191+0000 7f1445600640 1 -- 172.21.15.118:0/195502133 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f143809ae00 con 0x7f144813fae0 2024-09-21T06:11:40.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.191+0000 7f143fe00640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1424078b90 0x7f142407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.192+0000 7f143fe00640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1424078b90 0x7f142407b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f14481373c0 tx=0x7f143000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.195+0000 7f1445600640 1 -- 172.21.15.118:0/195502133 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f144813d640 con 0x7f144813fae0 2024-09-21T06:11:40.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.376+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f144806f9d0 con 0x7f1424078b90 2024-09-21T06:11:40.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.380+0000 7f1445600640 1 -- 172.21.15.118:0/195502133 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238873 (secure 0 0 0) 0x7f144806f9d0 con 0x7f1424078b90 2024-09-21T06:11:40.384 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:40.385 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1424078b90 msgr2=0x7f142407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1424078b90 0x7f142407b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f14481373c0 tx=0x7f143000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144813fae0 msgr2=0x7f1448137760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144813fae0 0x7f1448137760 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f143800d770 tx=0x7f143800dc30 comp rx=0 tx=0).stop 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 shutdown_connections 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1424078b90 0x7f142407b0a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1448142730 0x7f14480b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f144813fef0 0x7f14481effa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 --2- 172.21.15.118:0/195502133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144813fae0 0x7f1448137760 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 >> 172.21.15.118:0/195502133 conn(0x7f144806d110 msgr2=0x7f144815bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 shutdown_connections 2024-09-21T06:11:40.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.384+0000 7f144f400640 1 -- 172.21.15.118:0/195502133 wait complete. 2024-09-21T06:11:40.412 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2024-09-21T06:11:38.579439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555086,"statfs":{"total":1600000000,"available":1592408599,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.096108"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.498968+0000","last_change":"2024-09-21T06:11:34.498968+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.498968+0000","last_undegraded":"2024-09-21T06:11:34.498968+0000","last_fullsized":"2024-09-21T06:11:34.498968+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.501290+0000","last_change":"2024-09-21T06:11:34.501290+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.501290+0000","last_undegraded":"2024-09-21T06:11:34.501290+0000","last_fullsized":"2024-09-21T06:11:34.501290+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.499583+0000","last_change":"2024-09-21T06:11:34.499583+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.499583+0000","last_undegraded":"2024-09-21T06:11:34.499583+0000","last_fullsized":"2024-09-21T06:11:34.499583+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.496077+0000","last_change":"2024-09-21T06:11:34.496077+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.496077+0000","last_undegraded":"2024-09-21T06:11:34.496077+0000","last_fullsized":"2024-09-21T06:11:34.496077+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.499703+0000","last_change":"2024-09-21T06:11:34.499703+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.499703+0000","last_undegraded":"2024-09-21T06:11:34.499703+0000","last_fullsized":"2024-09-21T06:11:34.499703+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.501740+0000","last_change":"2024-09-21T06:11:34.501740+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.501740+0000","last_undegraded":"2024-09-21T06:11:34.501740+0000","last_fullsized":"2024-09-21T06:11:34.501740+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.495665+0000","last_change":"2024-09-21T06:11:34.495665+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.495665+0000","last_undegraded":"2024-09-21T06:11:34.495665+0000","last_fullsized":"2024-09-21T06:11:34.495665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.500936+0000","last_change":"2024-09-21T06:11:34.500936+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.500936+0000","last_undegraded":"2024-09-21T06:11:34.500936+0000","last_fullsized":"2024-09-21T06:11:34.500936+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.502026+0000","last_change":"2024-09-21T06:11:34.502026+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.502026+0000","last_undegraded":"2024-09-21T06:11:34.502026+0000","last_fullsized":"2024-09-21T06:11:34.502026+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486904+0000","last_change":"2024-09-21T06:11:33.486904+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486904+0000","last_undegraded":"2024-09-21T06:11:33.486904+0000","last_fullsized":"2024-09-21T06:11:33.486904+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485067+0000","last_change":"2024-09-21T06:11:33.485067+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485067+0000","last_undegraded":"2024-09-21T06:11:33.485067+0000","last_fullsized":"2024-09-21T06:11:33.485067+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.505112+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:34.505112+0000","last_peered":"2024-09-21T06:11:34.505112+0000","last_clean":"2024-09-21T06:11:34.505112+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:34.505112+0000","last_undegraded":"2024-09-21T06:11:34.505112+0000","last_fullsized":"2024-09-21T06:11:34.505112+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:52.910959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484417+0000","last_change":"2024-09-21T06:11:33.484417+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484417+0000","last_undegraded":"2024-09-21T06:11:33.484417+0000","last_fullsized":"2024-09-21T06:11:33.484417+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.497867+0000","last_change":"2024-09-21T06:11:34.497867+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.497867+0000","last_undegraded":"2024-09-21T06:11:34.497867+0000","last_fullsized":"2024-09-21T06:11:34.497867+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484396+0000","last_change":"2024-09-21T06:11:33.484396+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484396+0000","last_undegraded":"2024-09-21T06:11:33.484396+0000","last_fullsized":"2024-09-21T06:11:33.484396+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.494531+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:34.494531+0000","last_peered":"2024-09-21T06:11:34.494531+0000","last_clean":"2024-09-21T06:11:34.494531+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:34.494531+0000","last_undegraded":"2024-09-21T06:11:34.494531+0000","last_fullsized":"2024-09-21T06:11:34.494531+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:53.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487476+0000","last_change":"2024-09-21T06:11:33.487476+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487476+0000","last_undegraded":"2024-09-21T06:11:33.487476+0000","last_fullsized":"2024-09-21T06:11:33.487476+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484066+0000","last_change":"2024-09-21T06:11:33.484066+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484066+0000","last_undegraded":"2024-09-21T06:11:33.484066+0000","last_fullsized":"2024-09-21T06:11:33.484066+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485680+0000","last_change":"2024-09-21T06:11:33.485680+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485680+0000","last_undegraded":"2024-09-21T06:11:33.485680+0000","last_fullsized":"2024-09-21T06:11:33.485680+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510664+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:34.510664+0000","last_peered":"2024-09-21T06:11:34.510664+0000","last_clean":"2024-09-21T06:11:34.510664+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:34.510664+0000","last_undegraded":"2024-09-21T06:11:34.510664+0000","last_fullsized":"2024-09-21T06:11:34.510664+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:09.951383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485154+0000","last_change":"2024-09-21T06:11:33.485154+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485154+0000","last_undegraded":"2024-09-21T06:11:33.485154+0000","last_fullsized":"2024-09-21T06:11:33.485154+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486078+0000","last_change":"2024-09-21T06:11:33.486078+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486078+0000","last_undegraded":"2024-09-21T06:11:33.486078+0000","last_fullsized":"2024-09-21T06:11:33.486078+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485541+0000","last_change":"2024-09-21T06:11:33.485541+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485541+0000","last_undegraded":"2024-09-21T06:11:33.485541+0000","last_fullsized":"2024-09-21T06:11:33.485541+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484038+0000","last_change":"2024-09-21T06:11:33.484038+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484038+0000","last_undegraded":"2024-09-21T06:11:33.484038+0000","last_fullsized":"2024-09-21T06:11:33.484038+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.485827+0000","last_change":"2024-09-21T06:11:33.485827+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.485827+0000","last_undegraded":"2024-09-21T06:11:33.485827+0000","last_fullsized":"2024-09-21T06:11:33.485827+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484374+0000","last_change":"2024-09-21T06:11:33.484374+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484374+0000","last_undegraded":"2024-09-21T06:11:33.484374+0000","last_fullsized":"2024-09-21T06:11:33.484374+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510092+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:34.510092+0000","last_peered":"2024-09-21T06:11:34.510092+0000","last_clean":"2024-09-21T06:11:34.510092+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:34.510092+0000","last_undegraded":"2024-09-21T06:11:34.510092+0000","last_fullsized":"2024-09-21T06:11:34.510092+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:00.999119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.500067+0000","last_change":"2024-09-21T06:11:34.500067+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.500067+0000","last_undegraded":"2024-09-21T06:11:34.500067+0000","last_fullsized":"2024-09-21T06:11:34.500067+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487099+0000","last_change":"2024-09-21T06:11:33.487099+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487099+0000","last_undegraded":"2024-09-21T06:11:33.487099+0000","last_fullsized":"2024-09-21T06:11:33.487099+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484378+0000","last_change":"2024-09-21T06:11:33.484378+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484378+0000","last_undegraded":"2024-09-21T06:11:33.484378+0000","last_fullsized":"2024-09-21T06:11:33.484378+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484466+0000","last_change":"2024-09-21T06:11:33.484466+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484466+0000","last_undegraded":"2024-09-21T06:11:33.484466+0000","last_fullsized":"2024-09-21T06:11:33.484466+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510916+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:34.510916+0000","last_peered":"2024-09-21T06:11:34.510916+0000","last_clean":"2024-09-21T06:11:34.510916+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:34.510916+0000","last_undegraded":"2024-09-21T06:11:34.510916+0000","last_fullsized":"2024-09-21T06:11:34.510916+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:05.325168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.495840+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:34.495840+0000","last_peered":"2024-09-21T06:11:34.495840+0000","last_clean":"2024-09-21T06:11:34.495840+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:34.495840+0000","last_undegraded":"2024-09-21T06:11:34.495840+0000","last_fullsized":"2024-09-21T06:11:34.495840+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:21.150972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.507115+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:34.507115+0000","last_peered":"2024-09-21T06:11:34.507115+0000","last_clean":"2024-09-21T06:11:34.507115+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:34.507115+0000","last_undegraded":"2024-09-21T06:11:34.507115+0000","last_fullsized":"2024-09-21T06:11:34.507115+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:54.264880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486966+0000","last_change":"2024-09-21T06:11:33.486966+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486966+0000","last_undegraded":"2024-09-21T06:11:33.486966+0000","last_fullsized":"2024-09-21T06:11:33.486966+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.486435+0000","last_change":"2024-09-21T06:11:33.486435+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.486435+0000","last_undegraded":"2024-09-21T06:11:33.486435+0000","last_fullsized":"2024-09-21T06:11:33.486435+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.483976+0000","last_change":"2024-09-21T06:11:33.483976+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.483976+0000","last_undegraded":"2024-09-21T06:11:33.483976+0000","last_fullsized":"2024-09-21T06:11:33.483976+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.504602+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:34.504602+0000","last_peered":"2024-09-21T06:11:34.504602+0000","last_clean":"2024-09-21T06:11:34.504602+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:34.504602+0000","last_undegraded":"2024-09-21T06:11:34.504602+0000","last_fullsized":"2024-09-21T06:11:34.504602+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:57.225702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.484058+0000","last_change":"2024-09-21T06:11:33.484058+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.484058+0000","last_undegraded":"2024-09-21T06:11:33.484058+0000","last_fullsized":"2024-09-21T06:11:33.484058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487502+0000","last_change":"2024-09-21T06:11:33.487502+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487502+0000","last_undegraded":"2024-09-21T06:11:33.487502+0000","last_fullsized":"2024-09-21T06:11:33.487502+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":145,"state":"creating+peering","last_fresh":"2024-09-21T06:11:34.497194+0000","last_change":"2024-09-21T06:11:34.497194+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.497194+0000","last_undegraded":"2024-09-21T06:11:34.497194+0000","last_fullsized":"2024-09-21T06:11:34.497194+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.510030+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:34.510030+0000","last_peered":"2024-09-21T06:11:34.510030+0000","last_clean":"2024-09-21T06:11:34.510030+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:34.510030+0000","last_undegraded":"2024-09-21T06:11:34.510030+0000","last_fullsized":"2024-09-21T06:11:34.510030+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.272435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-21T06:11:34.507625+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:34.507625+0000","last_peered":"2024-09-21T06:11:34.507625+0000","last_clean":"2024-09-21T06:11:34.507625+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:34.507625+0000","last_undegraded":"2024-09-21T06:11:34.507625+0000","last_fullsized":"2024-09-21T06:11:34.507625+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:50.183410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:11:34.482163+0000","last_change":"2024-09-21T06:11:34.482163+0000","last_active":"2024-09-21T06:11:34.482163+0000","last_peered":"2024-09-21T06:11:34.482163+0000","last_clean":"2024-09-21T06:11:34.482163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:34.482163+0000","last_undegraded":"2024-09-21T06:11:34.482163+0000","last_fullsized":"2024-09-21T06:11:34.482163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":144,"state":"creating+peering","last_fresh":"2024-09-21T06:11:33.487058+0000","last_change":"2024-09-21T06:11:33.487058+0000","last_active":"2024-09-21T06:11:33.475684+0000","last_peered":"2024-09-21T06:11:33.475684+0000","last_clean":"2024-09-21T06:11:33.475684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:11:33.487058+0000","last_undegraded":"2024-09-21T06:11:33.487058+0000","last_fullsized":"2024-09-21T06:11:33.487058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":365,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-21T06:11:33.486597+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:33.486597+0000","last_peered":"2024-09-21T06:11:33.486597+0000","last_clean":"2024-09-21T06:11:33.486597+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:33.486597+0000","last_undegraded":"2024-09-21T06:11:33.486597+0000","last_fullsized":"2024-09-21T06:11:33.486597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":789,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194523,"statfs":{"total":200000000,"available":199191722,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193952,"statfs":{"total":200000000,"available":198607629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193952,"statfs":{"total":200000000,"available":198607629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":777,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":777,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:40.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:40.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.671+0000 7f2134800640 1 -- 172.21.15.118:0/2735790376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 msgr2=0x7f212c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.671+0000 7f2134800640 1 --2- 172.21.15.118:0/2735790376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 0x7f212c0d0e80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2120009830 tx=0x7f212002a530 comp rx=0 tx=0).stop 2024-09-21T06:11:40.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.671+0000 7f2134800640 1 -- 172.21.15.118:0/2735790376 shutdown_connections 2024-09-21T06:11:40.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.671+0000 7f2134800640 1 --2- 172.21.15.118:0/2735790376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 0x7f212c0d0e80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.671+0000 7f2134800640 1 -- 172.21.15.118:0/2735790376 >> 172.21.15.118:0/2735790376 conn(0x7f212c06d110 msgr2=0x7f212c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.671+0000 7f2134800640 1 -- 172.21.15.118:0/2735790376 shutdown_connections 2024-09-21T06:11:40.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.671+0000 7f2134800640 1 -- 172.21.15.118:0/2735790376 wait complete. 2024-09-21T06:11:40.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.674+0000 7f2134800640 1 Processor -- start 2024-09-21T06:11:40.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.674+0000 7f2134800640 1 -- start start 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.675+0000 7f2134800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 0x7f212c13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.675+0000 7f2134800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212c13fef0 0x7f212c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.675+0000 7f2134800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f212c142e40 0x7f212c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.675+0000 7f2134800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f212c0cfce0 con 0x7f212c142e40 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.675+0000 7f2134800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f212c0cfb60 con 0x7f212c13fae0 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.675+0000 7f2134800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f212c0cfe60 con 0x7f212c13fef0 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.675+0000 7f2132800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f212c142e40 0x7f212c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f212c142e40 0x7f212c156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59476/0 (socket says 172.21.15.118:59476) 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2131e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 0x7f212c13aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 -- 172.21.15.118:0/1058988216 learned_addr learned my addr 172.21.15.118:0/1058988216 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:40.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2131400640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212c13fef0 0x7f212c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 -- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212c13fef0 msgr2=0x7f212c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212c13fef0 0x7f212c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 -- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 msgr2=0x7f212c13aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 0x7f212c13aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 -- 172.21.15.118:0/1058988216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c1551f0 con 0x7f212c142e40 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2132800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f212c142e40 0x7f212c156bb0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f212800c730 tx=0x7f212800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.676+0000 7f2126000640 1 -- 172.21.15.118:0/1058988216 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128003b70 con 0x7f212c142e40 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.677+0000 7f2126000640 1 -- 172.21.15.118:0/1058988216 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2128003d10 con 0x7f212c142e40 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.677+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212c1545e0 con 0x7f212c142e40 2024-09-21T06:11:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.677+0000 7f2126000640 1 -- 172.21.15.118:0/1058988216 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212800aab0 con 0x7f212c142e40 2024-09-21T06:11:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.677+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f212c072e70 con 0x7f212c142e40 2024-09-21T06:11:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.678+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212c154b00 con 0x7f212c142e40 2024-09-21T06:11:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.679+0000 7f2126000640 1 -- 172.21.15.118:0/1058988216 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f212800ac50 con 0x7f212c142e40 2024-09-21T06:11:40.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.680+0000 7f2126000640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2110078bc0 0x7f211007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.680+0000 7f2126000640 1 -- 172.21.15.118:0/1058988216 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f212809a9a0 con 0x7f212c142e40 2024-09-21T06:11:40.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.680+0000 7f2131e00640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2110078bc0 0x7f211007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.681+0000 7f2131e00640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2110078bc0 0x7f211007b0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2120034000 tx=0x7f2120004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.684+0000 7f2126000640 1 -- 172.21.15.118:0/1058988216 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f212c154b00 con 0x7f212c142e40 2024-09-21T06:11:40.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.866+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f212c1f6e90 con 0x7f2110078bc0 2024-09-21T06:11:40.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.871+0000 7f2126000640 1 -- 172.21.15.118:0/1058988216 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7f212c1f6e90 con 0x7f2110078bc0 2024-09-21T06:11:40.876 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:40.877 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2110078bc0 msgr2=0x7f211007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2110078bc0 0x7f211007b0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2120034000 tx=0x7f2120004730 comp rx=0 tx=0).stop 2024-09-21T06:11:40.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f212c142e40 msgr2=0x7f212c156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f212c142e40 0x7f212c156bb0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f212800c730 tx=0x7f212800cbf0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 shutdown_connections 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f212c142e40 0x7f212c156bb0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2110078bc0 0x7f211007b0d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f212c13fef0 0x7f212c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 --2- 172.21.15.118:0/1058988216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f212c13fae0 0x7f212c13aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 >> 172.21.15.118:0/1058988216 conn(0x7f212c06d110 msgr2=0x7f212c1609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 shutdown_connections 2024-09-21T06:11:40.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:40.875+0000 7f2134800640 1 -- 172.21.15.118:0/1058988216 wait complete. 2024-09-21T06:11:40.899 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-21T06:11:40.579988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7574,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554925,"statfs":{"total":1600000000,"available":1592243620,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088851"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595451+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:36.595451+0000","last_peered":"2024-09-21T06:11:36.595451+0000","last_clean":"2024-09-21T06:11:36.595451+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:36.595451+0000","last_undegraded":"2024-09-21T06:11:36.595451+0000","last_fullsized":"2024-09-21T06:11:36.595451+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595096+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:36.595096+0000","last_peered":"2024-09-21T06:11:36.595096+0000","last_clean":"2024-09-21T06:11:36.595096+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:36.595096+0000","last_undegraded":"2024-09-21T06:11:36.595096+0000","last_fullsized":"2024-09-21T06:11:36.595096+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595198+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:36.595198+0000","last_peered":"2024-09-21T06:11:36.595198+0000","last_clean":"2024-09-21T06:11:36.595198+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:36.595198+0000","last_undegraded":"2024-09-21T06:11:36.595198+0000","last_fullsized":"2024-09-21T06:11:36.595198+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594592+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:36.594592+0000","last_peered":"2024-09-21T06:11:36.594592+0000","last_clean":"2024-09-21T06:11:36.594592+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:36.594592+0000","last_undegraded":"2024-09-21T06:11:36.594592+0000","last_fullsized":"2024-09-21T06:11:36.594592+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368632+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:36.368632+0000","last_peered":"2024-09-21T06:11:36.368632+0000","last_clean":"2024-09-21T06:11:36.368632+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:36.368632+0000","last_undegraded":"2024-09-21T06:11:36.368632+0000","last_fullsized":"2024-09-21T06:11:36.368632+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595655+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:36.595655+0000","last_peered":"2024-09-21T06:11:36.595655+0000","last_clean":"2024-09-21T06:11:36.595655+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:36.595655+0000","last_undegraded":"2024-09-21T06:11:36.595655+0000","last_fullsized":"2024-09-21T06:11:36.595655+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596113+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:36.596113+0000","last_peered":"2024-09-21T06:11:36.596113+0000","last_clean":"2024-09-21T06:11:36.596113+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:36.596113+0000","last_undegraded":"2024-09-21T06:11:36.596113+0000","last_fullsized":"2024-09-21T06:11:36.596113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595448+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:36.595448+0000","last_peered":"2024-09-21T06:11:36.595448+0000","last_clean":"2024-09-21T06:11:36.595448+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:36.595448+0000","last_undegraded":"2024-09-21T06:11:36.595448+0000","last_fullsized":"2024-09-21T06:11:36.595448+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594979+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:36.594979+0000","last_peered":"2024-09-21T06:11:36.594979+0000","last_clean":"2024-09-21T06:11:36.594979+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:36.594979+0000","last_undegraded":"2024-09-21T06:11:36.594979+0000","last_fullsized":"2024-09-21T06:11:36.594979+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595384+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:36.595384+0000","last_peered":"2024-09-21T06:11:36.595384+0000","last_clean":"2024-09-21T06:11:36.595384+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:36.595384+0000","last_undegraded":"2024-09-21T06:11:36.595384+0000","last_fullsized":"2024-09-21T06:11:36.595384+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367697+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:36.367697+0000","last_peered":"2024-09-21T06:11:36.367697+0000","last_clean":"2024-09-21T06:11:36.367697+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:36.367697+0000","last_undegraded":"2024-09-21T06:11:36.367697+0000","last_fullsized":"2024-09-21T06:11:36.367697+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595876+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:36.595876+0000","last_peered":"2024-09-21T06:11:36.595876+0000","last_clean":"2024-09-21T06:11:36.595876+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:36.595876+0000","last_undegraded":"2024-09-21T06:11:36.595876+0000","last_fullsized":"2024-09-21T06:11:36.595876+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594584+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:36.594584+0000","last_peered":"2024-09-21T06:11:36.594584+0000","last_clean":"2024-09-21T06:11:36.594584+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:36.594584+0000","last_undegraded":"2024-09-21T06:11:36.594584+0000","last_fullsized":"2024-09-21T06:11:36.594584+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594534+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:36.594534+0000","last_peered":"2024-09-21T06:11:36.594534+0000","last_clean":"2024-09-21T06:11:36.594534+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:36.594534+0000","last_undegraded":"2024-09-21T06:11:36.594534+0000","last_fullsized":"2024-09-21T06:11:36.594534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595279+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:36.595279+0000","last_peered":"2024-09-21T06:11:36.595279+0000","last_clean":"2024-09-21T06:11:36.595279+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:36.595279+0000","last_undegraded":"2024-09-21T06:11:36.595279+0000","last_fullsized":"2024-09-21T06:11:36.595279+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.369427+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.368620+0000","last_became_peered":"2024-09-21T06:11:35.368620+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:57.943956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596608+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:36.596608+0000","last_peered":"2024-09-21T06:11:36.596608+0000","last_clean":"2024-09-21T06:11:36.596608+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:36.596608+0000","last_undegraded":"2024-09-21T06:11:36.596608+0000","last_fullsized":"2024-09-21T06:11:36.596608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366827+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:36.366827+0000","last_peered":"2024-09-21T06:11:36.366827+0000","last_clean":"2024-09-21T06:11:36.366827+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:36.366827+0000","last_undegraded":"2024-09-21T06:11:36.366827+0000","last_fullsized":"2024-09-21T06:11:36.366827+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367656+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:36.367656+0000","last_peered":"2024-09-21T06:11:36.367656+0000","last_clean":"2024-09-21T06:11:36.367656+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:36.367656+0000","last_undegraded":"2024-09-21T06:11:36.367656+0000","last_fullsized":"2024-09-21T06:11:36.367656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368891+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:36.368891+0000","last_peered":"2024-09-21T06:11:36.368891+0000","last_clean":"2024-09-21T06:11:36.368891+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:36.368891+0000","last_undegraded":"2024-09-21T06:11:36.368891+0000","last_fullsized":"2024-09-21T06:11:36.368891+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367939+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:36.367939+0000","last_peered":"2024-09-21T06:11:36.367939+0000","last_clean":"2024-09-21T06:11:36.367939+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:36.367939+0000","last_undegraded":"2024-09-21T06:11:36.367939+0000","last_fullsized":"2024-09-21T06:11:36.367939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596023+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:36.596023+0000","last_peered":"2024-09-21T06:11:36.596023+0000","last_clean":"2024-09-21T06:11:36.596023+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:36.596023+0000","last_undegraded":"2024-09-21T06:11:36.596023+0000","last_fullsized":"2024-09-21T06:11:36.596023+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367813+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:36.367813+0000","last_peered":"2024-09-21T06:11:36.367813+0000","last_clean":"2024-09-21T06:11:36.367813+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:36.367813+0000","last_undegraded":"2024-09-21T06:11:36.367813+0000","last_fullsized":"2024-09-21T06:11:36.367813+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595609+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:36.595609+0000","last_peered":"2024-09-21T06:11:36.595609+0000","last_clean":"2024-09-21T06:11:36.595609+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:36.595609+0000","last_undegraded":"2024-09-21T06:11:36.595609+0000","last_fullsized":"2024-09-21T06:11:36.595609+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367019+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:36.367019+0000","last_peered":"2024-09-21T06:11:36.367019+0000","last_clean":"2024-09-21T06:11:36.367019+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:36.367019+0000","last_undegraded":"2024-09-21T06:11:36.367019+0000","last_fullsized":"2024-09-21T06:11:36.367019+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594615+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:36.594615+0000","last_peered":"2024-09-21T06:11:36.594615+0000","last_clean":"2024-09-21T06:11:36.594615+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:36.594615+0000","last_undegraded":"2024-09-21T06:11:36.594615+0000","last_fullsized":"2024-09-21T06:11:36.594615+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596145+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:36.596145+0000","last_peered":"2024-09-21T06:11:36.596145+0000","last_clean":"2024-09-21T06:11:36.596145+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:36.596145+0000","last_undegraded":"2024-09-21T06:11:36.596145+0000","last_fullsized":"2024-09-21T06:11:36.596145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594912+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:36.594912+0000","last_peered":"2024-09-21T06:11:36.594912+0000","last_clean":"2024-09-21T06:11:36.594912+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:36.594912+0000","last_undegraded":"2024-09-21T06:11:36.594912+0000","last_fullsized":"2024-09-21T06:11:36.594912+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595512+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:36.595512+0000","last_peered":"2024-09-21T06:11:36.595512+0000","last_clean":"2024-09-21T06:11:36.595512+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:36.595512+0000","last_undegraded":"2024-09-21T06:11:36.595512+0000","last_fullsized":"2024-09-21T06:11:36.595512+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368057+0000","last_change":"2024-09-21T06:11:35.369978+0000","last_active":"2024-09-21T06:11:36.368057+0000","last_peered":"2024-09-21T06:11:36.368057+0000","last_clean":"2024-09-21T06:11:36.368057+0000","last_became_active":"2024-09-21T06:11:35.369656+0000","last_became_peered":"2024-09-21T06:11:35.369656+0000","last_unstale":"2024-09-21T06:11:36.368057+0000","last_undegraded":"2024-09-21T06:11:36.368057+0000","last_fullsized":"2024-09-21T06:11:36.368057+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:45.913366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596364+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:36.596364+0000","last_peered":"2024-09-21T06:11:36.596364+0000","last_clean":"2024-09-21T06:11:36.596364+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:36.596364+0000","last_undegraded":"2024-09-21T06:11:36.596364+0000","last_fullsized":"2024-09-21T06:11:36.596364+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366666+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:36.366666+0000","last_peered":"2024-09-21T06:11:36.366666+0000","last_clean":"2024-09-21T06:11:36.366666+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:36.366666+0000","last_undegraded":"2024-09-21T06:11:36.366666+0000","last_fullsized":"2024-09-21T06:11:36.366666+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":19,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368249+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:36.368249+0000","last_peered":"2024-09-21T06:11:36.368249+0000","last_clean":"2024-09-21T06:11:36.368249+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:36.368249+0000","last_undegraded":"2024-09-21T06:11:36.368249+0000","last_fullsized":"2024-09-21T06:11:36.368249+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595514+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:36.595514+0000","last_peered":"2024-09-21T06:11:36.595514+0000","last_clean":"2024-09-21T06:11:36.595514+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:36.595514+0000","last_undegraded":"2024-09-21T06:11:36.595514+0000","last_fullsized":"2024-09-21T06:11:36.595514+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368328+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:36.368328+0000","last_peered":"2024-09-21T06:11:36.368328+0000","last_clean":"2024-09-21T06:11:36.368328+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:36.368328+0000","last_undegraded":"2024-09-21T06:11:36.368328+0000","last_fullsized":"2024-09-21T06:11:36.368328+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368148+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:36.368148+0000","last_peered":"2024-09-21T06:11:36.368148+0000","last_clean":"2024-09-21T06:11:36.368148+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:36.368148+0000","last_undegraded":"2024-09-21T06:11:36.368148+0000","last_fullsized":"2024-09-21T06:11:36.368148+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368885+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:36.368885+0000","last_peered":"2024-09-21T06:11:36.368885+0000","last_clean":"2024-09-21T06:11:36.368885+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:36.368885+0000","last_undegraded":"2024-09-21T06:11:36.368885+0000","last_fullsized":"2024-09-21T06:11:36.368885+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595742+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:36.595742+0000","last_peered":"2024-09-21T06:11:36.595742+0000","last_clean":"2024-09-21T06:11:36.595742+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:36.595742+0000","last_undegraded":"2024-09-21T06:11:36.595742+0000","last_fullsized":"2024-09-21T06:11:36.595742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367098+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:36.367098+0000","last_peered":"2024-09-21T06:11:36.367098+0000","last_clean":"2024-09-21T06:11:36.367098+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:36.367098+0000","last_undegraded":"2024-09-21T06:11:36.367098+0000","last_fullsized":"2024-09-21T06:11:36.367098+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595169+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:36.595169+0000","last_peered":"2024-09-21T06:11:36.595169+0000","last_clean":"2024-09-21T06:11:36.595169+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:36.595169+0000","last_undegraded":"2024-09-21T06:11:36.595169+0000","last_fullsized":"2024-09-21T06:11:36.595169+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596842+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:36.596842+0000","last_peered":"2024-09-21T06:11:36.596842+0000","last_clean":"2024-09-21T06:11:36.596842+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:36.596842+0000","last_undegraded":"2024-09-21T06:11:36.596842+0000","last_fullsized":"2024-09-21T06:11:36.596842+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367337+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:36.367337+0000","last_peered":"2024-09-21T06:11:36.367337+0000","last_clean":"2024-09-21T06:11:36.367337+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:36.367337+0000","last_undegraded":"2024-09-21T06:11:36.367337+0000","last_fullsized":"2024-09-21T06:11:36.367337+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596665+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:36.596665+0000","last_peered":"2024-09-21T06:11:36.596665+0000","last_clean":"2024-09-21T06:11:36.596665+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:36.596665+0000","last_undegraded":"2024-09-21T06:11:36.596665+0000","last_fullsized":"2024-09-21T06:11:36.596665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595121+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:36.595121+0000","last_peered":"2024-09-21T06:11:36.595121+0000","last_clean":"2024-09-21T06:11:36.595121+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:36.595121+0000","last_undegraded":"2024-09-21T06:11:36.595121+0000","last_fullsized":"2024-09-21T06:11:36.595121+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594755+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:36.594755+0000","last_peered":"2024-09-21T06:11:36.594755+0000","last_clean":"2024-09-21T06:11:36.594755+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:36.594755+0000","last_undegraded":"2024-09-21T06:11:36.594755+0000","last_fullsized":"2024-09-21T06:11:36.594755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595886+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:36.595886+0000","last_peered":"2024-09-21T06:11:36.595886+0000","last_clean":"2024-09-21T06:11:36.595886+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:36.595886+0000","last_undegraded":"2024-09-21T06:11:36.595886+0000","last_fullsized":"2024-09-21T06:11:36.595886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595317+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:36.595317+0000","last_peered":"2024-09-21T06:11:36.595317+0000","last_clean":"2024-09-21T06:11:36.595317+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:36.595317+0000","last_undegraded":"2024-09-21T06:11:36.595317+0000","last_fullsized":"2024-09-21T06:11:36.595317+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597135+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:36.597135+0000","last_peered":"2024-09-21T06:11:36.597135+0000","last_clean":"2024-09-21T06:11:36.597135+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:36.597135+0000","last_undegraded":"2024-09-21T06:11:36.597135+0000","last_fullsized":"2024-09-21T06:11:36.597135+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596772+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:36.596772+0000","last_peered":"2024-09-21T06:11:36.596772+0000","last_clean":"2024-09-21T06:11:36.596772+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:36.596772+0000","last_undegraded":"2024-09-21T06:11:36.596772+0000","last_fullsized":"2024-09-21T06:11:36.596772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366955+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:36.366955+0000","last_peered":"2024-09-21T06:11:36.366955+0000","last_clean":"2024-09-21T06:11:36.366955+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:36.366955+0000","last_undegraded":"2024-09-21T06:11:36.366955+0000","last_fullsized":"2024-09-21T06:11:36.366955+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368451+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:36.368451+0000","last_peered":"2024-09-21T06:11:36.368451+0000","last_clean":"2024-09-21T06:11:36.368451+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:36.368451+0000","last_undegraded":"2024-09-21T06:11:36.368451+0000","last_fullsized":"2024-09-21T06:11:36.368451+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596236+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:36.596236+0000","last_peered":"2024-09-21T06:11:36.596236+0000","last_clean":"2024-09-21T06:11:36.596236+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:36.596236+0000","last_undegraded":"2024-09-21T06:11:36.596236+0000","last_fullsized":"2024-09-21T06:11:36.596236+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368113+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:36.368113+0000","last_peered":"2024-09-21T06:11:36.368113+0000","last_clean":"2024-09-21T06:11:36.368113+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:36.368113+0000","last_undegraded":"2024-09-21T06:11:36.368113+0000","last_fullsized":"2024-09-21T06:11:36.368113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595218+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:36.595218+0000","last_peered":"2024-09-21T06:11:36.595218+0000","last_clean":"2024-09-21T06:11:36.595218+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:36.595218+0000","last_undegraded":"2024-09-21T06:11:36.595218+0000","last_fullsized":"2024-09-21T06:11:36.595218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595799+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:36.595799+0000","last_peered":"2024-09-21T06:11:36.595799+0000","last_clean":"2024-09-21T06:11:36.595799+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:36.595799+0000","last_undegraded":"2024-09-21T06:11:36.595799+0000","last_fullsized":"2024-09-21T06:11:36.595799+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595603+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:36.595603+0000","last_peered":"2024-09-21T06:11:36.595603+0000","last_clean":"2024-09-21T06:11:36.595603+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:36.595603+0000","last_undegraded":"2024-09-21T06:11:36.595603+0000","last_fullsized":"2024-09-21T06:11:36.595603+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594658+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:36.594658+0000","last_peered":"2024-09-21T06:11:36.594658+0000","last_clean":"2024-09-21T06:11:36.594658+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:36.594658+0000","last_undegraded":"2024-09-21T06:11:36.594658+0000","last_fullsized":"2024-09-21T06:11:36.594658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595287+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:36.595287+0000","last_peered":"2024-09-21T06:11:36.595287+0000","last_clean":"2024-09-21T06:11:36.595287+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:36.595287+0000","last_undegraded":"2024-09-21T06:11:36.595287+0000","last_fullsized":"2024-09-21T06:11:36.595287+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596103+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:36.596103+0000","last_peered":"2024-09-21T06:11:36.596103+0000","last_clean":"2024-09-21T06:11:36.596103+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:36.596103+0000","last_undegraded":"2024-09-21T06:11:36.596103+0000","last_fullsized":"2024-09-21T06:11:36.596103+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596177+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:36.596177+0000","last_peered":"2024-09-21T06:11:36.596177+0000","last_clean":"2024-09-21T06:11:36.596177+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:36.596177+0000","last_undegraded":"2024-09-21T06:11:36.596177+0000","last_fullsized":"2024-09-21T06:11:36.596177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596919+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:36.596919+0000","last_peered":"2024-09-21T06:11:36.596919+0000","last_clean":"2024-09-21T06:11:36.596919+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:36.596919+0000","last_undegraded":"2024-09-21T06:11:36.596919+0000","last_fullsized":"2024-09-21T06:11:36.596919+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595651+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:36.595651+0000","last_peered":"2024-09-21T06:11:36.595651+0000","last_clean":"2024-09-21T06:11:36.595651+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:36.595651+0000","last_undegraded":"2024-09-21T06:11:36.595651+0000","last_fullsized":"2024-09-21T06:11:36.595651+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595428+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:36.595428+0000","last_peered":"2024-09-21T06:11:36.595428+0000","last_clean":"2024-09-21T06:11:36.595428+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:36.595428+0000","last_undegraded":"2024-09-21T06:11:36.595428+0000","last_fullsized":"2024-09-21T06:11:36.595428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368209+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:36.368209+0000","last_peered":"2024-09-21T06:11:36.368209+0000","last_clean":"2024-09-21T06:11:36.368209+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:36.368209+0000","last_undegraded":"2024-09-21T06:11:36.368209+0000","last_fullsized":"2024-09-21T06:11:36.368209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366649+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:36.366649+0000","last_peered":"2024-09-21T06:11:36.366649+0000","last_clean":"2024-09-21T06:11:36.366649+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:36.366649+0000","last_undegraded":"2024-09-21T06:11:36.366649+0000","last_fullsized":"2024-09-21T06:11:36.366649+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595830+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:36.595830+0000","last_peered":"2024-09-21T06:11:36.595830+0000","last_clean":"2024-09-21T06:11:36.595830+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:36.595830+0000","last_undegraded":"2024-09-21T06:11:36.595830+0000","last_fullsized":"2024-09-21T06:11:36.595830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595890+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:36.595890+0000","last_peered":"2024-09-21T06:11:36.595890+0000","last_clean":"2024-09-21T06:11:36.595890+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:36.595890+0000","last_undegraded":"2024-09-21T06:11:36.595890+0000","last_fullsized":"2024-09-21T06:11:36.595890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596647+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:36.596647+0000","last_peered":"2024-09-21T06:11:36.596647+0000","last_clean":"2024-09-21T06:11:36.596647+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:36.596647+0000","last_undegraded":"2024-09-21T06:11:36.596647+0000","last_fullsized":"2024-09-21T06:11:36.596647+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595128+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:36.595128+0000","last_peered":"2024-09-21T06:11:36.595128+0000","last_clean":"2024-09-21T06:11:36.595128+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:36.595128+0000","last_undegraded":"2024-09-21T06:11:36.595128+0000","last_fullsized":"2024-09-21T06:11:36.595128+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596392+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:36.596392+0000","last_peered":"2024-09-21T06:11:36.596392+0000","last_clean":"2024-09-21T06:11:36.596392+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:36.596392+0000","last_undegraded":"2024-09-21T06:11:36.596392+0000","last_fullsized":"2024-09-21T06:11:36.596392+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595330+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:36.595330+0000","last_peered":"2024-09-21T06:11:36.595330+0000","last_clean":"2024-09-21T06:11:36.595330+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:36.595330+0000","last_undegraded":"2024-09-21T06:11:36.595330+0000","last_fullsized":"2024-09-21T06:11:36.595330+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367082+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:36.367082+0000","last_peered":"2024-09-21T06:11:36.367082+0000","last_clean":"2024-09-21T06:11:36.367082+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:36.367082+0000","last_undegraded":"2024-09-21T06:11:36.367082+0000","last_fullsized":"2024-09-21T06:11:36.367082+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366923+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:36.366923+0000","last_peered":"2024-09-21T06:11:36.366923+0000","last_clean":"2024-09-21T06:11:36.366923+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:36.366923+0000","last_undegraded":"2024-09-21T06:11:36.366923+0000","last_fullsized":"2024-09-21T06:11:36.366923+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368355+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:36.368355+0000","last_peered":"2024-09-21T06:11:36.368355+0000","last_clean":"2024-09-21T06:11:36.368355+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:36.368355+0000","last_undegraded":"2024-09-21T06:11:36.368355+0000","last_fullsized":"2024-09-21T06:11:36.368355+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368076+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:36.368076+0000","last_peered":"2024-09-21T06:11:36.368076+0000","last_clean":"2024-09-21T06:11:36.368076+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:36.368076+0000","last_undegraded":"2024-09-21T06:11:36.368076+0000","last_fullsized":"2024-09-21T06:11:36.368076+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595597+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:36.595597+0000","last_peered":"2024-09-21T06:11:36.595597+0000","last_clean":"2024-09-21T06:11:36.595597+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:36.595597+0000","last_undegraded":"2024-09-21T06:11:36.595597+0000","last_fullsized":"2024-09-21T06:11:36.595597+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595623+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:36.595623+0000","last_peered":"2024-09-21T06:11:36.595623+0000","last_clean":"2024-09-21T06:11:36.595623+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:36.595623+0000","last_undegraded":"2024-09-21T06:11:36.595623+0000","last_fullsized":"2024-09-21T06:11:36.595623+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595554+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:36.595554+0000","last_peered":"2024-09-21T06:11:36.595554+0000","last_clean":"2024-09-21T06:11:36.595554+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:36.595554+0000","last_undegraded":"2024-09-21T06:11:36.595554+0000","last_fullsized":"2024-09-21T06:11:36.595554+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368450+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:36.368450+0000","last_peered":"2024-09-21T06:11:36.368450+0000","last_clean":"2024-09-21T06:11:36.368450+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:36.368450+0000","last_undegraded":"2024-09-21T06:11:36.368450+0000","last_fullsized":"2024-09-21T06:11:36.368450+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595824+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:36.595824+0000","last_peered":"2024-09-21T06:11:36.595824+0000","last_clean":"2024-09-21T06:11:36.595824+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:36.595824+0000","last_undegraded":"2024-09-21T06:11:36.595824+0000","last_fullsized":"2024-09-21T06:11:36.595824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594822+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:36.594822+0000","last_peered":"2024-09-21T06:11:36.594822+0000","last_clean":"2024-09-21T06:11:36.594822+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:36.594822+0000","last_undegraded":"2024-09-21T06:11:36.594822+0000","last_fullsized":"2024-09-21T06:11:36.594822+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595038+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:36.595038+0000","last_peered":"2024-09-21T06:11:36.595038+0000","last_clean":"2024-09-21T06:11:36.595038+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:36.595038+0000","last_undegraded":"2024-09-21T06:11:36.595038+0000","last_fullsized":"2024-09-21T06:11:36.595038+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368262+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:36.368262+0000","last_peered":"2024-09-21T06:11:36.368262+0000","last_clean":"2024-09-21T06:11:36.368262+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:36.368262+0000","last_undegraded":"2024-09-21T06:11:36.368262+0000","last_fullsized":"2024-09-21T06:11:36.368262+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368021+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:36.368021+0000","last_peered":"2024-09-21T06:11:36.368021+0000","last_clean":"2024-09-21T06:11:36.368021+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:36.368021+0000","last_undegraded":"2024-09-21T06:11:36.368021+0000","last_fullsized":"2024-09-21T06:11:36.368021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595928+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:36.595928+0000","last_peered":"2024-09-21T06:11:36.595928+0000","last_clean":"2024-09-21T06:11:36.595928+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:36.595928+0000","last_undegraded":"2024-09-21T06:11:36.595928+0000","last_fullsized":"2024-09-21T06:11:36.595928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597046+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:36.597046+0000","last_peered":"2024-09-21T06:11:36.597046+0000","last_clean":"2024-09-21T06:11:36.597046+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:36.597046+0000","last_undegraded":"2024-09-21T06:11:36.597046+0000","last_fullsized":"2024-09-21T06:11:36.597046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368196+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:36.368196+0000","last_peered":"2024-09-21T06:11:36.368196+0000","last_clean":"2024-09-21T06:11:36.368196+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:36.368196+0000","last_undegraded":"2024-09-21T06:11:36.368196+0000","last_fullsized":"2024-09-21T06:11:36.368196+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366928+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:36.366928+0000","last_peered":"2024-09-21T06:11:36.366928+0000","last_clean":"2024-09-21T06:11:36.366928+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:36.366928+0000","last_undegraded":"2024-09-21T06:11:36.366928+0000","last_fullsized":"2024-09-21T06:11:36.366928+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367448+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:36.367448+0000","last_peered":"2024-09-21T06:11:36.367448+0000","last_clean":"2024-09-21T06:11:36.367448+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:36.367448+0000","last_undegraded":"2024-09-21T06:11:36.367448+0000","last_fullsized":"2024-09-21T06:11:36.367448+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594875+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:36.594875+0000","last_peered":"2024-09-21T06:11:36.594875+0000","last_clean":"2024-09-21T06:11:36.594875+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:36.594875+0000","last_undegraded":"2024-09-21T06:11:36.594875+0000","last_fullsized":"2024-09-21T06:11:36.594875+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367981+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:36.367981+0000","last_peered":"2024-09-21T06:11:36.367981+0000","last_clean":"2024-09-21T06:11:36.367981+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:36.367981+0000","last_undegraded":"2024-09-21T06:11:36.367981+0000","last_fullsized":"2024-09-21T06:11:36.367981+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368633+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:36.368633+0000","last_peered":"2024-09-21T06:11:36.368633+0000","last_clean":"2024-09-21T06:11:36.368633+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:36.368633+0000","last_undegraded":"2024-09-21T06:11:36.368633+0000","last_fullsized":"2024-09-21T06:11:36.368633+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368976+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:36.368976+0000","last_peered":"2024-09-21T06:11:36.368976+0000","last_clean":"2024-09-21T06:11:36.368976+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:36.368976+0000","last_undegraded":"2024-09-21T06:11:36.368976+0000","last_fullsized":"2024-09-21T06:11:36.368976+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":371,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368639+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:36.368639+0000","last_peered":"2024-09-21T06:11:36.368639+0000","last_clean":"2024-09-21T06:11:36.368639+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:36.368639+0000","last_undegraded":"2024-09-21T06:11:36.368639+0000","last_fullsized":"2024-09-21T06:11:36.368639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178487,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1378,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193933,"statfs":{"total":200000000,"available":198588279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1380,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193931,"statfs":{"total":200000000,"available":198586029,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194508,"statfs":{"total":200000000,"available":199177035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:40.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T06:11:41.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 -- 172.21.15.118:0/615387894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 msgr2=0x7f32600b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 --2- 172.21.15.118:0/615387894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f32600b5fc0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3258005fd0 tx=0x7f325802aa10 comp rx=0 tx=0).stop 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 -- 172.21.15.118:0/615387894 shutdown_connections 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 --2- 172.21.15.118:0/615387894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f32600b5fc0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 --2- 172.21.15.118:0/615387894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32600cfe30 0x7f32600d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 -- 172.21.15.118:0/615387894 >> 172.21.15.118:0/615387894 conn(0x7f326006d6e0 msgr2=0x7f32600b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 -- 172.21.15.118:0/615387894 shutdown_connections 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.156+0000 7f325f200640 1 -- 172.21.15.118:0/615387894 wait complete. 2024-09-21T06:11:41.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.158+0000 7f325f200640 1 Processor -- start 2024-09-21T06:11:41.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.158+0000 7f325f200640 1 -- start start 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3260073fa0 0x7f32600b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f326015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32600cfe30 0x7f3260158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f326015d9c0 con 0x7f32600b5bb0 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f326015d840 con 0x7f32600cfe30 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f326015db40 con 0x7f3260073fa0 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f326015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f326015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59500/0 (socket says 172.21.15.118:59500) 2024-09-21T06:11:41.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 -- 172.21.15.118:0/3630333119 learned_addr learned my addr 172.21.15.118:0/3630333119 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:41.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325de00640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3260073fa0 0x7f32600b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325e800640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32600cfe30 0x7f3260158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 -- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3260073fa0 msgr2=0x7f32600b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3260073fa0 0x7f32600b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 -- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32600cfe30 msgr2=0x7f3260158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32600cfe30 0x7f3260158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f3255400640 1 -- 172.21.15.118:0/3630333119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32600b4610 con 0x7f32600b5bb0 2024-09-21T06:11:41.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.160+0000 7f325de00640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3260073fa0 0x7f32600b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:41.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.161+0000 7f3255400640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f326015a0f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f324800e7f0 tx=0x7f324800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.161+0000 7f3256a00640 1 -- 172.21.15.118:0/3630333119 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324800eea0 con 0x7f32600b5bb0 2024-09-21T06:11:41.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.161+0000 7f3256a00640 1 -- 172.21.15.118:0/3630333119 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f324800cdb0 con 0x7f32600b5bb0 2024-09-21T06:11:41.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.161+0000 7f3256a00640 1 -- 172.21.15.118:0/3630333119 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248010690 con 0x7f32600b5bb0 2024-09-21T06:11:41.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.161+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32600b48f0 con 0x7f32600b5bb0 2024-09-21T06:11:41.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.161+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32600b4eb0 con 0x7f32600b5bb0 2024-09-21T06:11:41.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.162+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32601f6c50 con 0x7f32600b5bb0 2024-09-21T06:11:41.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.163+0000 7f3256a00640 1 -- 172.21.15.118:0/3630333119 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3248010830 con 0x7f32600b5bb0 2024-09-21T06:11:41.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.164+0000 7f3256a00640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f323c078b90 0x7f323c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.164+0000 7f3256a00640 1 -- 172.21.15.118:0/3630333119 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f324809b5c0 con 0x7f32600b5bb0 2024-09-21T06:11:41.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.165+0000 7f325de00640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f323c078b90 0x7f323c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.165+0000 7f325de00640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f323c078b90 0x7f323c07b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3250007fd0 tx=0x7f3250009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.169+0000 7f3256a00640 1 -- 172.21.15.118:0/3630333119 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3248063440 con 0x7f32600b5bb0 2024-09-21T06:11:41.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.423+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f326015e060 con 0x7f32600b5bb0 2024-09-21T06:11:41.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.423+0000 7f3256a00640 1 -- 172.21.15.118:0/3630333119 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1308 (secure 0 0 0) 0x7f3248067e70 con 0x7f32600b5bb0 2024-09-21T06:11:41.425 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:41.425 INFO:teuthology.orchestra.run.smithi118.stdout:{"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":486,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726898623,"num_in_osds":8,"osd_in_since":1726898620,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":52},{"state_name":"creating+peering","count":34},{"state_name":"active+clean","count":11}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":7591401,"bytes_avail":1592408599,"bytes_total":1600000000,"unknown_pgs_ratio":0.53608244657516479,"inactive_pgs_ratio":0.3505154550075531},"fsmap":{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":7377}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-21T06:11:30.577592+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T06:11:41.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.425+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f323c078b90 msgr2=0x7f323c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.425+0000 7f325f200640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f323c078b90 0x7f323c07b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3250007fd0 tx=0x7f3250009040 comp rx=0 tx=0).stop 2024-09-21T06:11:41.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.425+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 msgr2=0x7f326015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.425+0000 7f325f200640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f326015a0f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f324800e7f0 tx=0x7f324800ecb0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 shutdown_connections 2024-09-21T06:11:41.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32600cfe30 0x7f3260158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32600b5bb0 0x7f326015a0f0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f323c078b90 0x7f323c07b0a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 --2- 172.21.15.118:0/3630333119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3260073fa0 0x7f32600b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 >> 172.21.15.118:0/3630333119 conn(0x7f326006d6e0 msgr2=0x7f326015eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 shutdown_connections 2024-09-21T06:11:41.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.426+0000 7f325f200640 1 -- 172.21.15.118:0/3630333119 wait complete. 2024-09-21T06:11:41.452 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T06:11:41.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:41.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 -- 172.21.15.118:0/2882901201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8813fef0 msgr2=0x7fca88142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 --2- 172.21.15.118:0/2882901201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8813fef0 0x7fca88142c70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fca880ceaa0 tx=0x7fca8002aa30 comp rx=0 tx=0).stop 2024-09-21T06:11:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 -- 172.21.15.118:0/2882901201 shutdown_connections 2024-09-21T06:11:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 --2- 172.21.15.118:0/2882901201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8813fef0 0x7fca88142c70 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 --2- 172.21.15.118:0/2882901201 >> v2:172.21.15.149:3300/0 conn(0x7fca880d1590 0x7fca88142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 -- 172.21.15.118:0/2882901201 >> 172.21.15.118:0/2882901201 conn(0x7fca8806d110 msgr2=0x7fca8806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 -- 172.21.15.118:0/2882901201 shutdown_connections 2024-09-21T06:11:41.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.672+0000 7fca8ce00640 1 -- 172.21.15.118:0/2882901201 wait complete. 2024-09-21T06:11:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.674+0000 7fca8ce00640 1 Processor -- start 2024-09-21T06:11:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.674+0000 7fca8ce00640 1 -- start start 2024-09-21T06:11:41.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca8ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca8813fae0 0x7fca88139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca8ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8813fef0 0x7fca881f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca8ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca88139be0 0x7fca88139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca8ce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca880cfa70 con 0x7fca88139be0 2024-09-21T06:11:41.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca8ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca880cf8f0 con 0x7fca8813fef0 2024-09-21T06:11:41.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca8ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fca880cfbf0 con 0x7fca8813fae0 2024-09-21T06:11:41.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca88139be0 0x7fca88139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca88139be0 0x7fca88139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59508/0 (socket says 172.21.15.118:59508) 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 -- 172.21.15.118:0/605590453 learned_addr learned my addr 172.21.15.118:0/605590453 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca7d400640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8813fef0 0x7fca881f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca85e00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca8813fae0 0x7fca88139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 -- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca8813fae0 msgr2=0x7fca88139280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca8813fae0 0x7fca88139280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 -- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8813fef0 msgr2=0x7fca881f9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8813fef0 0x7fca881f9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.676+0000 7fca86800640 1 -- 172.21.15.118:0/605590453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca881f66d0 con 0x7fca88139be0 2024-09-21T06:11:41.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.677+0000 7fca86800640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca88139be0 0x7fca88139ff0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fca8002b020 tx=0x7fca80003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.677+0000 7fca7ea00640 1 -- 172.21.15.118:0/605590453 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80033050 con 0x7fca88139be0 2024-09-21T06:11:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.677+0000 7fca7ea00640 1 -- 172.21.15.118:0/605590453 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca80004450 con 0x7fca88139be0 2024-09-21T06:11:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.677+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca881f69b0 con 0x7fca88139be0 2024-09-21T06:11:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.677+0000 7fca7ea00640 1 -- 172.21.15.118:0/605590453 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80038450 con 0x7fca88139be0 2024-09-21T06:11:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.677+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8813a560 con 0x7fca88139be0 2024-09-21T06:11:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.678+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca881f6bf0 con 0x7fca88139be0 2024-09-21T06:11:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.679+0000 7fca7ea00640 1 -- 172.21.15.118:0/605590453 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca80036070 con 0x7fca88139be0 2024-09-21T06:11:41.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.681+0000 7fca7ea00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca64078b90 0x7fca6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.681+0000 7fca7ea00640 1 -- 172.21.15.118:0/605590453 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fca800bc260 con 0x7fca88139be0 2024-09-21T06:11:41.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.681+0000 7fca85e00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca64078b90 0x7fca6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.682+0000 7fca85e00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca64078b90 0x7fca6407b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca78001720 tx=0x7fca78009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.686+0000 7fca7ea00640 1 -- 172.21.15.118:0/605590453 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fca881f6bf0 con 0x7fca88139be0 2024-09-21T06:11:41.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.866+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca881f9290 con 0x7fca64078b90 2024-09-21T06:11:41.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.871+0000 7fca7ea00640 1 -- 172.21.15.118:0/605590453 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7fca78001d00 con 0x7fca64078b90 2024-09-21T06:11:41.876 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:41.877 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:41.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca64078b90 msgr2=0x7fca6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca64078b90 0x7fca6407b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca78001720 tx=0x7fca78009040 comp rx=0 tx=0).stop 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca88139be0 msgr2=0x7fca88139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca88139be0 0x7fca88139ff0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fca8002b020 tx=0x7fca80003f10 comp rx=0 tx=0).stop 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 shutdown_connections 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca88139be0 0x7fca88139ff0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8813fef0 0x7fca881f9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca64078b90 0x7fca6407b0a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 --2- 172.21.15.118:0/605590453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca8813fae0 0x7fca88139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 >> 172.21.15.118:0/605590453 conn(0x7fca8806d110 msgr2=0x7fca8815ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 shutdown_connections 2024-09-21T06:11:41.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:41.875+0000 7fca8ce00640 1 -- 172.21.15.118:0/605590453 wait complete. 2024-09-21T06:11:41.898 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-21T06:11:40.579988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7574,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554925,"statfs":{"total":1600000000,"available":1592243620,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088851"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595451+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:36.595451+0000","last_peered":"2024-09-21T06:11:36.595451+0000","last_clean":"2024-09-21T06:11:36.595451+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:36.595451+0000","last_undegraded":"2024-09-21T06:11:36.595451+0000","last_fullsized":"2024-09-21T06:11:36.595451+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595096+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:36.595096+0000","last_peered":"2024-09-21T06:11:36.595096+0000","last_clean":"2024-09-21T06:11:36.595096+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:36.595096+0000","last_undegraded":"2024-09-21T06:11:36.595096+0000","last_fullsized":"2024-09-21T06:11:36.595096+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595198+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:36.595198+0000","last_peered":"2024-09-21T06:11:36.595198+0000","last_clean":"2024-09-21T06:11:36.595198+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:36.595198+0000","last_undegraded":"2024-09-21T06:11:36.595198+0000","last_fullsized":"2024-09-21T06:11:36.595198+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594592+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:36.594592+0000","last_peered":"2024-09-21T06:11:36.594592+0000","last_clean":"2024-09-21T06:11:36.594592+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:36.594592+0000","last_undegraded":"2024-09-21T06:11:36.594592+0000","last_fullsized":"2024-09-21T06:11:36.594592+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368632+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:36.368632+0000","last_peered":"2024-09-21T06:11:36.368632+0000","last_clean":"2024-09-21T06:11:36.368632+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:36.368632+0000","last_undegraded":"2024-09-21T06:11:36.368632+0000","last_fullsized":"2024-09-21T06:11:36.368632+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595655+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:36.595655+0000","last_peered":"2024-09-21T06:11:36.595655+0000","last_clean":"2024-09-21T06:11:36.595655+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:36.595655+0000","last_undegraded":"2024-09-21T06:11:36.595655+0000","last_fullsized":"2024-09-21T06:11:36.595655+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596113+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:36.596113+0000","last_peered":"2024-09-21T06:11:36.596113+0000","last_clean":"2024-09-21T06:11:36.596113+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:36.596113+0000","last_undegraded":"2024-09-21T06:11:36.596113+0000","last_fullsized":"2024-09-21T06:11:36.596113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595448+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:36.595448+0000","last_peered":"2024-09-21T06:11:36.595448+0000","last_clean":"2024-09-21T06:11:36.595448+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:36.595448+0000","last_undegraded":"2024-09-21T06:11:36.595448+0000","last_fullsized":"2024-09-21T06:11:36.595448+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594979+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:36.594979+0000","last_peered":"2024-09-21T06:11:36.594979+0000","last_clean":"2024-09-21T06:11:36.594979+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:36.594979+0000","last_undegraded":"2024-09-21T06:11:36.594979+0000","last_fullsized":"2024-09-21T06:11:36.594979+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595384+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:36.595384+0000","last_peered":"2024-09-21T06:11:36.595384+0000","last_clean":"2024-09-21T06:11:36.595384+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:36.595384+0000","last_undegraded":"2024-09-21T06:11:36.595384+0000","last_fullsized":"2024-09-21T06:11:36.595384+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367697+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:36.367697+0000","last_peered":"2024-09-21T06:11:36.367697+0000","last_clean":"2024-09-21T06:11:36.367697+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:36.367697+0000","last_undegraded":"2024-09-21T06:11:36.367697+0000","last_fullsized":"2024-09-21T06:11:36.367697+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595876+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:36.595876+0000","last_peered":"2024-09-21T06:11:36.595876+0000","last_clean":"2024-09-21T06:11:36.595876+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:36.595876+0000","last_undegraded":"2024-09-21T06:11:36.595876+0000","last_fullsized":"2024-09-21T06:11:36.595876+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594584+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:36.594584+0000","last_peered":"2024-09-21T06:11:36.594584+0000","last_clean":"2024-09-21T06:11:36.594584+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:36.594584+0000","last_undegraded":"2024-09-21T06:11:36.594584+0000","last_fullsized":"2024-09-21T06:11:36.594584+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594534+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:36.594534+0000","last_peered":"2024-09-21T06:11:36.594534+0000","last_clean":"2024-09-21T06:11:36.594534+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:36.594534+0000","last_undegraded":"2024-09-21T06:11:36.594534+0000","last_fullsized":"2024-09-21T06:11:36.594534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595279+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:36.595279+0000","last_peered":"2024-09-21T06:11:36.595279+0000","last_clean":"2024-09-21T06:11:36.595279+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:36.595279+0000","last_undegraded":"2024-09-21T06:11:36.595279+0000","last_fullsized":"2024-09-21T06:11:36.595279+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.369427+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.368620+0000","last_became_peered":"2024-09-21T06:11:35.368620+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:57.943956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596608+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:36.596608+0000","last_peered":"2024-09-21T06:11:36.596608+0000","last_clean":"2024-09-21T06:11:36.596608+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:36.596608+0000","last_undegraded":"2024-09-21T06:11:36.596608+0000","last_fullsized":"2024-09-21T06:11:36.596608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366827+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:36.366827+0000","last_peered":"2024-09-21T06:11:36.366827+0000","last_clean":"2024-09-21T06:11:36.366827+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:36.366827+0000","last_undegraded":"2024-09-21T06:11:36.366827+0000","last_fullsized":"2024-09-21T06:11:36.366827+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367656+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:36.367656+0000","last_peered":"2024-09-21T06:11:36.367656+0000","last_clean":"2024-09-21T06:11:36.367656+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:36.367656+0000","last_undegraded":"2024-09-21T06:11:36.367656+0000","last_fullsized":"2024-09-21T06:11:36.367656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368891+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:36.368891+0000","last_peered":"2024-09-21T06:11:36.368891+0000","last_clean":"2024-09-21T06:11:36.368891+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:36.368891+0000","last_undegraded":"2024-09-21T06:11:36.368891+0000","last_fullsized":"2024-09-21T06:11:36.368891+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367939+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:36.367939+0000","last_peered":"2024-09-21T06:11:36.367939+0000","last_clean":"2024-09-21T06:11:36.367939+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:36.367939+0000","last_undegraded":"2024-09-21T06:11:36.367939+0000","last_fullsized":"2024-09-21T06:11:36.367939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596023+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:36.596023+0000","last_peered":"2024-09-21T06:11:36.596023+0000","last_clean":"2024-09-21T06:11:36.596023+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:36.596023+0000","last_undegraded":"2024-09-21T06:11:36.596023+0000","last_fullsized":"2024-09-21T06:11:36.596023+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367813+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:36.367813+0000","last_peered":"2024-09-21T06:11:36.367813+0000","last_clean":"2024-09-21T06:11:36.367813+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:36.367813+0000","last_undegraded":"2024-09-21T06:11:36.367813+0000","last_fullsized":"2024-09-21T06:11:36.367813+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595609+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:36.595609+0000","last_peered":"2024-09-21T06:11:36.595609+0000","last_clean":"2024-09-21T06:11:36.595609+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:36.595609+0000","last_undegraded":"2024-09-21T06:11:36.595609+0000","last_fullsized":"2024-09-21T06:11:36.595609+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367019+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:36.367019+0000","last_peered":"2024-09-21T06:11:36.367019+0000","last_clean":"2024-09-21T06:11:36.367019+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:36.367019+0000","last_undegraded":"2024-09-21T06:11:36.367019+0000","last_fullsized":"2024-09-21T06:11:36.367019+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594615+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:36.594615+0000","last_peered":"2024-09-21T06:11:36.594615+0000","last_clean":"2024-09-21T06:11:36.594615+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:36.594615+0000","last_undegraded":"2024-09-21T06:11:36.594615+0000","last_fullsized":"2024-09-21T06:11:36.594615+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596145+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:36.596145+0000","last_peered":"2024-09-21T06:11:36.596145+0000","last_clean":"2024-09-21T06:11:36.596145+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:36.596145+0000","last_undegraded":"2024-09-21T06:11:36.596145+0000","last_fullsized":"2024-09-21T06:11:36.596145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594912+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:36.594912+0000","last_peered":"2024-09-21T06:11:36.594912+0000","last_clean":"2024-09-21T06:11:36.594912+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:36.594912+0000","last_undegraded":"2024-09-21T06:11:36.594912+0000","last_fullsized":"2024-09-21T06:11:36.594912+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595512+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:36.595512+0000","last_peered":"2024-09-21T06:11:36.595512+0000","last_clean":"2024-09-21T06:11:36.595512+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:36.595512+0000","last_undegraded":"2024-09-21T06:11:36.595512+0000","last_fullsized":"2024-09-21T06:11:36.595512+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368057+0000","last_change":"2024-09-21T06:11:35.369978+0000","last_active":"2024-09-21T06:11:36.368057+0000","last_peered":"2024-09-21T06:11:36.368057+0000","last_clean":"2024-09-21T06:11:36.368057+0000","last_became_active":"2024-09-21T06:11:35.369656+0000","last_became_peered":"2024-09-21T06:11:35.369656+0000","last_unstale":"2024-09-21T06:11:36.368057+0000","last_undegraded":"2024-09-21T06:11:36.368057+0000","last_fullsized":"2024-09-21T06:11:36.368057+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:45.913366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596364+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:36.596364+0000","last_peered":"2024-09-21T06:11:36.596364+0000","last_clean":"2024-09-21T06:11:36.596364+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:36.596364+0000","last_undegraded":"2024-09-21T06:11:36.596364+0000","last_fullsized":"2024-09-21T06:11:36.596364+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366666+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:36.366666+0000","last_peered":"2024-09-21T06:11:36.366666+0000","last_clean":"2024-09-21T06:11:36.366666+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:36.366666+0000","last_undegraded":"2024-09-21T06:11:36.366666+0000","last_fullsized":"2024-09-21T06:11:36.366666+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":19,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368249+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:36.368249+0000","last_peered":"2024-09-21T06:11:36.368249+0000","last_clean":"2024-09-21T06:11:36.368249+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:36.368249+0000","last_undegraded":"2024-09-21T06:11:36.368249+0000","last_fullsized":"2024-09-21T06:11:36.368249+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595514+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:36.595514+0000","last_peered":"2024-09-21T06:11:36.595514+0000","last_clean":"2024-09-21T06:11:36.595514+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:36.595514+0000","last_undegraded":"2024-09-21T06:11:36.595514+0000","last_fullsized":"2024-09-21T06:11:36.595514+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368328+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:36.368328+0000","last_peered":"2024-09-21T06:11:36.368328+0000","last_clean":"2024-09-21T06:11:36.368328+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:36.368328+0000","last_undegraded":"2024-09-21T06:11:36.368328+0000","last_fullsized":"2024-09-21T06:11:36.368328+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368148+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:36.368148+0000","last_peered":"2024-09-21T06:11:36.368148+0000","last_clean":"2024-09-21T06:11:36.368148+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:36.368148+0000","last_undegraded":"2024-09-21T06:11:36.368148+0000","last_fullsized":"2024-09-21T06:11:36.368148+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368885+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:36.368885+0000","last_peered":"2024-09-21T06:11:36.368885+0000","last_clean":"2024-09-21T06:11:36.368885+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:36.368885+0000","last_undegraded":"2024-09-21T06:11:36.368885+0000","last_fullsized":"2024-09-21T06:11:36.368885+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595742+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:36.595742+0000","last_peered":"2024-09-21T06:11:36.595742+0000","last_clean":"2024-09-21T06:11:36.595742+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:36.595742+0000","last_undegraded":"2024-09-21T06:11:36.595742+0000","last_fullsized":"2024-09-21T06:11:36.595742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367098+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:36.367098+0000","last_peered":"2024-09-21T06:11:36.367098+0000","last_clean":"2024-09-21T06:11:36.367098+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:36.367098+0000","last_undegraded":"2024-09-21T06:11:36.367098+0000","last_fullsized":"2024-09-21T06:11:36.367098+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595169+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:36.595169+0000","last_peered":"2024-09-21T06:11:36.595169+0000","last_clean":"2024-09-21T06:11:36.595169+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:36.595169+0000","last_undegraded":"2024-09-21T06:11:36.595169+0000","last_fullsized":"2024-09-21T06:11:36.595169+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596842+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:36.596842+0000","last_peered":"2024-09-21T06:11:36.596842+0000","last_clean":"2024-09-21T06:11:36.596842+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:36.596842+0000","last_undegraded":"2024-09-21T06:11:36.596842+0000","last_fullsized":"2024-09-21T06:11:36.596842+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367337+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:36.367337+0000","last_peered":"2024-09-21T06:11:36.367337+0000","last_clean":"2024-09-21T06:11:36.367337+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:36.367337+0000","last_undegraded":"2024-09-21T06:11:36.367337+0000","last_fullsized":"2024-09-21T06:11:36.367337+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596665+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:36.596665+0000","last_peered":"2024-09-21T06:11:36.596665+0000","last_clean":"2024-09-21T06:11:36.596665+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:36.596665+0000","last_undegraded":"2024-09-21T06:11:36.596665+0000","last_fullsized":"2024-09-21T06:11:36.596665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595121+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:36.595121+0000","last_peered":"2024-09-21T06:11:36.595121+0000","last_clean":"2024-09-21T06:11:36.595121+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:36.595121+0000","last_undegraded":"2024-09-21T06:11:36.595121+0000","last_fullsized":"2024-09-21T06:11:36.595121+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594755+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:36.594755+0000","last_peered":"2024-09-21T06:11:36.594755+0000","last_clean":"2024-09-21T06:11:36.594755+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:36.594755+0000","last_undegraded":"2024-09-21T06:11:36.594755+0000","last_fullsized":"2024-09-21T06:11:36.594755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595886+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:36.595886+0000","last_peered":"2024-09-21T06:11:36.595886+0000","last_clean":"2024-09-21T06:11:36.595886+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:36.595886+0000","last_undegraded":"2024-09-21T06:11:36.595886+0000","last_fullsized":"2024-09-21T06:11:36.595886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595317+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:36.595317+0000","last_peered":"2024-09-21T06:11:36.595317+0000","last_clean":"2024-09-21T06:11:36.595317+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:36.595317+0000","last_undegraded":"2024-09-21T06:11:36.595317+0000","last_fullsized":"2024-09-21T06:11:36.595317+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597135+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:36.597135+0000","last_peered":"2024-09-21T06:11:36.597135+0000","last_clean":"2024-09-21T06:11:36.597135+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:36.597135+0000","last_undegraded":"2024-09-21T06:11:36.597135+0000","last_fullsized":"2024-09-21T06:11:36.597135+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596772+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:36.596772+0000","last_peered":"2024-09-21T06:11:36.596772+0000","last_clean":"2024-09-21T06:11:36.596772+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:36.596772+0000","last_undegraded":"2024-09-21T06:11:36.596772+0000","last_fullsized":"2024-09-21T06:11:36.596772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366955+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:36.366955+0000","last_peered":"2024-09-21T06:11:36.366955+0000","last_clean":"2024-09-21T06:11:36.366955+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:36.366955+0000","last_undegraded":"2024-09-21T06:11:36.366955+0000","last_fullsized":"2024-09-21T06:11:36.366955+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368451+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:36.368451+0000","last_peered":"2024-09-21T06:11:36.368451+0000","last_clean":"2024-09-21T06:11:36.368451+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:36.368451+0000","last_undegraded":"2024-09-21T06:11:36.368451+0000","last_fullsized":"2024-09-21T06:11:36.368451+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596236+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:36.596236+0000","last_peered":"2024-09-21T06:11:36.596236+0000","last_clean":"2024-09-21T06:11:36.596236+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:36.596236+0000","last_undegraded":"2024-09-21T06:11:36.596236+0000","last_fullsized":"2024-09-21T06:11:36.596236+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368113+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:36.368113+0000","last_peered":"2024-09-21T06:11:36.368113+0000","last_clean":"2024-09-21T06:11:36.368113+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:36.368113+0000","last_undegraded":"2024-09-21T06:11:36.368113+0000","last_fullsized":"2024-09-21T06:11:36.368113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595218+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:36.595218+0000","last_peered":"2024-09-21T06:11:36.595218+0000","last_clean":"2024-09-21T06:11:36.595218+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:36.595218+0000","last_undegraded":"2024-09-21T06:11:36.595218+0000","last_fullsized":"2024-09-21T06:11:36.595218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595799+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:36.595799+0000","last_peered":"2024-09-21T06:11:36.595799+0000","last_clean":"2024-09-21T06:11:36.595799+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:36.595799+0000","last_undegraded":"2024-09-21T06:11:36.595799+0000","last_fullsized":"2024-09-21T06:11:36.595799+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595603+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:36.595603+0000","last_peered":"2024-09-21T06:11:36.595603+0000","last_clean":"2024-09-21T06:11:36.595603+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:36.595603+0000","last_undegraded":"2024-09-21T06:11:36.595603+0000","last_fullsized":"2024-09-21T06:11:36.595603+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594658+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:36.594658+0000","last_peered":"2024-09-21T06:11:36.594658+0000","last_clean":"2024-09-21T06:11:36.594658+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:36.594658+0000","last_undegraded":"2024-09-21T06:11:36.594658+0000","last_fullsized":"2024-09-21T06:11:36.594658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595287+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:36.595287+0000","last_peered":"2024-09-21T06:11:36.595287+0000","last_clean":"2024-09-21T06:11:36.595287+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:36.595287+0000","last_undegraded":"2024-09-21T06:11:36.595287+0000","last_fullsized":"2024-09-21T06:11:36.595287+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596103+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:36.596103+0000","last_peered":"2024-09-21T06:11:36.596103+0000","last_clean":"2024-09-21T06:11:36.596103+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:36.596103+0000","last_undegraded":"2024-09-21T06:11:36.596103+0000","last_fullsized":"2024-09-21T06:11:36.596103+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596177+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:36.596177+0000","last_peered":"2024-09-21T06:11:36.596177+0000","last_clean":"2024-09-21T06:11:36.596177+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:36.596177+0000","last_undegraded":"2024-09-21T06:11:36.596177+0000","last_fullsized":"2024-09-21T06:11:36.596177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596919+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:36.596919+0000","last_peered":"2024-09-21T06:11:36.596919+0000","last_clean":"2024-09-21T06:11:36.596919+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:36.596919+0000","last_undegraded":"2024-09-21T06:11:36.596919+0000","last_fullsized":"2024-09-21T06:11:36.596919+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595651+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:36.595651+0000","last_peered":"2024-09-21T06:11:36.595651+0000","last_clean":"2024-09-21T06:11:36.595651+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:36.595651+0000","last_undegraded":"2024-09-21T06:11:36.595651+0000","last_fullsized":"2024-09-21T06:11:36.595651+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595428+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:36.595428+0000","last_peered":"2024-09-21T06:11:36.595428+0000","last_clean":"2024-09-21T06:11:36.595428+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:36.595428+0000","last_undegraded":"2024-09-21T06:11:36.595428+0000","last_fullsized":"2024-09-21T06:11:36.595428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368209+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:36.368209+0000","last_peered":"2024-09-21T06:11:36.368209+0000","last_clean":"2024-09-21T06:11:36.368209+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:36.368209+0000","last_undegraded":"2024-09-21T06:11:36.368209+0000","last_fullsized":"2024-09-21T06:11:36.368209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366649+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:36.366649+0000","last_peered":"2024-09-21T06:11:36.366649+0000","last_clean":"2024-09-21T06:11:36.366649+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:36.366649+0000","last_undegraded":"2024-09-21T06:11:36.366649+0000","last_fullsized":"2024-09-21T06:11:36.366649+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595830+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:36.595830+0000","last_peered":"2024-09-21T06:11:36.595830+0000","last_clean":"2024-09-21T06:11:36.595830+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:36.595830+0000","last_undegraded":"2024-09-21T06:11:36.595830+0000","last_fullsized":"2024-09-21T06:11:36.595830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595890+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:36.595890+0000","last_peered":"2024-09-21T06:11:36.595890+0000","last_clean":"2024-09-21T06:11:36.595890+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:36.595890+0000","last_undegraded":"2024-09-21T06:11:36.595890+0000","last_fullsized":"2024-09-21T06:11:36.595890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596647+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:36.596647+0000","last_peered":"2024-09-21T06:11:36.596647+0000","last_clean":"2024-09-21T06:11:36.596647+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:36.596647+0000","last_undegraded":"2024-09-21T06:11:36.596647+0000","last_fullsized":"2024-09-21T06:11:36.596647+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595128+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:36.595128+0000","last_peered":"2024-09-21T06:11:36.595128+0000","last_clean":"2024-09-21T06:11:36.595128+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:36.595128+0000","last_undegraded":"2024-09-21T06:11:36.595128+0000","last_fullsized":"2024-09-21T06:11:36.595128+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596392+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:36.596392+0000","last_peered":"2024-09-21T06:11:36.596392+0000","last_clean":"2024-09-21T06:11:36.596392+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:36.596392+0000","last_undegraded":"2024-09-21T06:11:36.596392+0000","last_fullsized":"2024-09-21T06:11:36.596392+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595330+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:36.595330+0000","last_peered":"2024-09-21T06:11:36.595330+0000","last_clean":"2024-09-21T06:11:36.595330+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:36.595330+0000","last_undegraded":"2024-09-21T06:11:36.595330+0000","last_fullsized":"2024-09-21T06:11:36.595330+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367082+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:36.367082+0000","last_peered":"2024-09-21T06:11:36.367082+0000","last_clean":"2024-09-21T06:11:36.367082+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:36.367082+0000","last_undegraded":"2024-09-21T06:11:36.367082+0000","last_fullsized":"2024-09-21T06:11:36.367082+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366923+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:36.366923+0000","last_peered":"2024-09-21T06:11:36.366923+0000","last_clean":"2024-09-21T06:11:36.366923+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:36.366923+0000","last_undegraded":"2024-09-21T06:11:36.366923+0000","last_fullsized":"2024-09-21T06:11:36.366923+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368355+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:36.368355+0000","last_peered":"2024-09-21T06:11:36.368355+0000","last_clean":"2024-09-21T06:11:36.368355+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:36.368355+0000","last_undegraded":"2024-09-21T06:11:36.368355+0000","last_fullsized":"2024-09-21T06:11:36.368355+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368076+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:36.368076+0000","last_peered":"2024-09-21T06:11:36.368076+0000","last_clean":"2024-09-21T06:11:36.368076+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:36.368076+0000","last_undegraded":"2024-09-21T06:11:36.368076+0000","last_fullsized":"2024-09-21T06:11:36.368076+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595597+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:36.595597+0000","last_peered":"2024-09-21T06:11:36.595597+0000","last_clean":"2024-09-21T06:11:36.595597+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:36.595597+0000","last_undegraded":"2024-09-21T06:11:36.595597+0000","last_fullsized":"2024-09-21T06:11:36.595597+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595623+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:36.595623+0000","last_peered":"2024-09-21T06:11:36.595623+0000","last_clean":"2024-09-21T06:11:36.595623+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:36.595623+0000","last_undegraded":"2024-09-21T06:11:36.595623+0000","last_fullsized":"2024-09-21T06:11:36.595623+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595554+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:36.595554+0000","last_peered":"2024-09-21T06:11:36.595554+0000","last_clean":"2024-09-21T06:11:36.595554+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:36.595554+0000","last_undegraded":"2024-09-21T06:11:36.595554+0000","last_fullsized":"2024-09-21T06:11:36.595554+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368450+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:36.368450+0000","last_peered":"2024-09-21T06:11:36.368450+0000","last_clean":"2024-09-21T06:11:36.368450+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:36.368450+0000","last_undegraded":"2024-09-21T06:11:36.368450+0000","last_fullsized":"2024-09-21T06:11:36.368450+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595824+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:36.595824+0000","last_peered":"2024-09-21T06:11:36.595824+0000","last_clean":"2024-09-21T06:11:36.595824+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:36.595824+0000","last_undegraded":"2024-09-21T06:11:36.595824+0000","last_fullsized":"2024-09-21T06:11:36.595824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594822+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:36.594822+0000","last_peered":"2024-09-21T06:11:36.594822+0000","last_clean":"2024-09-21T06:11:36.594822+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:36.594822+0000","last_undegraded":"2024-09-21T06:11:36.594822+0000","last_fullsized":"2024-09-21T06:11:36.594822+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595038+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:36.595038+0000","last_peered":"2024-09-21T06:11:36.595038+0000","last_clean":"2024-09-21T06:11:36.595038+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:36.595038+0000","last_undegraded":"2024-09-21T06:11:36.595038+0000","last_fullsized":"2024-09-21T06:11:36.595038+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368262+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:36.368262+0000","last_peered":"2024-09-21T06:11:36.368262+0000","last_clean":"2024-09-21T06:11:36.368262+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:36.368262+0000","last_undegraded":"2024-09-21T06:11:36.368262+0000","last_fullsized":"2024-09-21T06:11:36.368262+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368021+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:36.368021+0000","last_peered":"2024-09-21T06:11:36.368021+0000","last_clean":"2024-09-21T06:11:36.368021+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:36.368021+0000","last_undegraded":"2024-09-21T06:11:36.368021+0000","last_fullsized":"2024-09-21T06:11:36.368021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595928+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:36.595928+0000","last_peered":"2024-09-21T06:11:36.595928+0000","last_clean":"2024-09-21T06:11:36.595928+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:36.595928+0000","last_undegraded":"2024-09-21T06:11:36.595928+0000","last_fullsized":"2024-09-21T06:11:36.595928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597046+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:36.597046+0000","last_peered":"2024-09-21T06:11:36.597046+0000","last_clean":"2024-09-21T06:11:36.597046+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:36.597046+0000","last_undegraded":"2024-09-21T06:11:36.597046+0000","last_fullsized":"2024-09-21T06:11:36.597046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368196+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:36.368196+0000","last_peered":"2024-09-21T06:11:36.368196+0000","last_clean":"2024-09-21T06:11:36.368196+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:36.368196+0000","last_undegraded":"2024-09-21T06:11:36.368196+0000","last_fullsized":"2024-09-21T06:11:36.368196+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366928+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:36.366928+0000","last_peered":"2024-09-21T06:11:36.366928+0000","last_clean":"2024-09-21T06:11:36.366928+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:36.366928+0000","last_undegraded":"2024-09-21T06:11:36.366928+0000","last_fullsized":"2024-09-21T06:11:36.366928+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367448+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:36.367448+0000","last_peered":"2024-09-21T06:11:36.367448+0000","last_clean":"2024-09-21T06:11:36.367448+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:36.367448+0000","last_undegraded":"2024-09-21T06:11:36.367448+0000","last_fullsized":"2024-09-21T06:11:36.367448+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594875+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:36.594875+0000","last_peered":"2024-09-21T06:11:36.594875+0000","last_clean":"2024-09-21T06:11:36.594875+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:36.594875+0000","last_undegraded":"2024-09-21T06:11:36.594875+0000","last_fullsized":"2024-09-21T06:11:36.594875+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367981+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:36.367981+0000","last_peered":"2024-09-21T06:11:36.367981+0000","last_clean":"2024-09-21T06:11:36.367981+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:36.367981+0000","last_undegraded":"2024-09-21T06:11:36.367981+0000","last_fullsized":"2024-09-21T06:11:36.367981+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368633+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:36.368633+0000","last_peered":"2024-09-21T06:11:36.368633+0000","last_clean":"2024-09-21T06:11:36.368633+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:36.368633+0000","last_undegraded":"2024-09-21T06:11:36.368633+0000","last_fullsized":"2024-09-21T06:11:36.368633+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368976+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:36.368976+0000","last_peered":"2024-09-21T06:11:36.368976+0000","last_clean":"2024-09-21T06:11:36.368976+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:36.368976+0000","last_undegraded":"2024-09-21T06:11:36.368976+0000","last_fullsized":"2024-09-21T06:11:36.368976+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":371,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368639+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:36.368639+0000","last_peered":"2024-09-21T06:11:36.368639+0000","last_clean":"2024-09-21T06:11:36.368639+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:36.368639+0000","last_undegraded":"2024-09-21T06:11:36.368639+0000","last_fullsized":"2024-09-21T06:11:36.368639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178487,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1378,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193933,"statfs":{"total":200000000,"available":198588279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1380,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193931,"statfs":{"total":200000000,"available":198586029,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194508,"statfs":{"total":200000000,"available":199177035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:44.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:45.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.131+0000 7f7918600640 1 -- 172.21.15.118:0/54282988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8003c10 msgr2=0x7f78f8004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.131+0000 7f7918600640 1 --2- 172.21.15.118:0/54282988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8003c10 0x7f78f8004060 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7904009b50 tx=0x7f78f8005830 comp rx=0 tx=0).stop 2024-09-21T06:11:45.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.131+0000 7f7916600640 1 -- 172.21.15.118:0/54282988 reap_dead start 2024-09-21T06:11:45.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.131+0000 7f7918600640 1 -- 172.21.15.118:0/54282988 shutdown_connections 2024-09-21T06:11:45.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.131+0000 7f7918600640 1 -- 172.21.15.118:0/54282988 >> 172.21.15.118:0/54282988 conn(0x7f791006d110 msgr2=0x7f791006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:45.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.131+0000 7f7918600640 1 -- 172.21.15.118:0/54282988 shutdown_connections 2024-09-21T06:11:45.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.131+0000 7f7918600640 1 -- 172.21.15.118:0/54282988 wait complete. 2024-09-21T06:11:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.133+0000 7f7918600640 1 Processor -- start 2024-09-21T06:11:45.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.134+0000 7f7918600640 1 -- start start 2024-09-21T06:11:45.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7918600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78f8003c10 0x7f7910138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7918600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f791013c030 0x7f7910160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7918600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f791013c440 0x7f7910160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7918600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79100d1830 con 0x7f791013c440 2024-09-21T06:11:45.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7918600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f79100d16b0 con 0x7f791013c030 2024-09-21T06:11:45.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7918600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f79100cf950 con 0x7f78f8003c10 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7916600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f791013c440 0x7f7910160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7916600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f791013c440 0x7f7910160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59520/0 (socket says 172.21.15.118:59520) 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7916600640 1 -- 172.21.15.118:0/1893745154 learned_addr learned my addr 172.21.15.118:0/1893745154 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7915c00640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78f8003c10 0x7f7910138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.135+0000 7f7915200640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f791013c030 0x7f7910160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f7916600640 1 -- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78f8003c10 msgr2=0x7f7910138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f7916600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78f8003c10 0x7f7910138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f7916600640 1 -- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f791013c030 msgr2=0x7f7910160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f7916600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f791013c030 0x7f7910160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f7916600640 1 -- 172.21.15.118:0/1893745154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791013c910 con 0x7f791013c440 2024-09-21T06:11:45.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f7916600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f791013c440 0x7f7910160eb0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7908001350 tx=0x7f790800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:45.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f790d600640 1 -- 172.21.15.118:0/1893745154 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790800c910 con 0x7f791013c440 2024-09-21T06:11:45.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f790d600640 1 -- 172.21.15.118:0/1893745154 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7908017070 con 0x7f791013c440 2024-09-21T06:11:45.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f790d600640 1 -- 172.21.15.118:0/1893745154 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790800ce40 con 0x7f791013c440 2024-09-21T06:11:45.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.136+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79101f3d20 con 0x7f791013c440 2024-09-21T06:11:45.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.137+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101f42e0 con 0x7f791013c440 2024-09-21T06:11:45.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.138+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79100cfee0 con 0x7f791013c440 2024-09-21T06:11:45.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.139+0000 7f790d600640 1 -- 172.21.15.118:0/1893745154 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f790801c460 con 0x7f791013c440 2024-09-21T06:11:45.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.140+0000 7f790d600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f78f0078b90 0x7f78f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.140+0000 7f790d600640 1 -- 172.21.15.118:0/1893745154 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f790809aef0 con 0x7f791013c440 2024-09-21T06:11:45.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.140+0000 7f7915c00640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f78f0078b90 0x7f78f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.141+0000 7f7915c00640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f78f0078b90 0x7f78f007b0a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7904035000 tx=0x7f790402d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:45.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.144+0000 7f790d600640 1 -- 172.21.15.118:0/1893745154 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7908062d30 con 0x7f791013c440 2024-09-21T06:11:45.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.323+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7910142980 con 0x7f78f0078b90 2024-09-21T06:11:45.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.329+0000 7f790d600640 1 -- 172.21.15.118:0/1893745154 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247943 (secure 0 0 0) 0x7f7910142980 con 0x7f78f0078b90 2024-09-21T06:11:45.334 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:45.335 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f78f0078b90 msgr2=0x7f78f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f78f0078b90 0x7f78f007b0a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7904035000 tx=0x7f790402d040 comp rx=0 tx=0).stop 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f791013c440 msgr2=0x7f7910160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f791013c440 0x7f7910160eb0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7908001350 tx=0x7f790800ea90 comp rx=0 tx=0).stop 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 shutdown_connections 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f791013c440 0x7f7910160eb0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f791013c030 0x7f7910160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f78f0078b90 0x7f78f007b0a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 --2- 172.21.15.118:0/1893745154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78f8003c10 0x7f7910138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 >> 172.21.15.118:0/1893745154 conn(0x7f791006d110 msgr2=0x7f79101415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 shutdown_connections 2024-09-21T06:11:45.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.333+0000 7f7918600640 1 -- 172.21.15.118:0/1893745154 wait complete. 2024-09-21T06:11:45.360 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-21T06:11:44.581181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7580,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554919,"statfs":{"total":1600000000,"available":1592237595,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002246"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551281+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:43.551281+0000","last_peered":"2024-09-21T06:11:43.551281+0000","last_clean":"2024-09-21T06:11:43.551281+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:43.551281+0000","last_undegraded":"2024-09-21T06:11:43.551281+0000","last_fullsized":"2024-09-21T06:11:43.551281+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595096+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:36.595096+0000","last_peered":"2024-09-21T06:11:36.595096+0000","last_clean":"2024-09-21T06:11:36.595096+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:36.595096+0000","last_undegraded":"2024-09-21T06:11:36.595096+0000","last_fullsized":"2024-09-21T06:11:36.595096+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595198+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:36.595198+0000","last_peered":"2024-09-21T06:11:36.595198+0000","last_clean":"2024-09-21T06:11:36.595198+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:36.595198+0000","last_undegraded":"2024-09-21T06:11:36.595198+0000","last_fullsized":"2024-09-21T06:11:36.595198+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.548994+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:43.548994+0000","last_peered":"2024-09-21T06:11:43.548994+0000","last_clean":"2024-09-21T06:11:43.548994+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:43.548994+0000","last_undegraded":"2024-09-21T06:11:43.548994+0000","last_fullsized":"2024-09-21T06:11:43.548994+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549524+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:43.549524+0000","last_peered":"2024-09-21T06:11:43.549524+0000","last_clean":"2024-09-21T06:11:43.549524+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:43.549524+0000","last_undegraded":"2024-09-21T06:11:43.549524+0000","last_fullsized":"2024-09-21T06:11:43.549524+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595655+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:36.595655+0000","last_peered":"2024-09-21T06:11:36.595655+0000","last_clean":"2024-09-21T06:11:36.595655+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:36.595655+0000","last_undegraded":"2024-09-21T06:11:36.595655+0000","last_fullsized":"2024-09-21T06:11:36.595655+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596113+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:36.596113+0000","last_peered":"2024-09-21T06:11:36.596113+0000","last_clean":"2024-09-21T06:11:36.596113+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:36.596113+0000","last_undegraded":"2024-09-21T06:11:36.596113+0000","last_fullsized":"2024-09-21T06:11:36.596113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595448+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:36.595448+0000","last_peered":"2024-09-21T06:11:36.595448+0000","last_clean":"2024-09-21T06:11:36.595448+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:36.595448+0000","last_undegraded":"2024-09-21T06:11:36.595448+0000","last_fullsized":"2024-09-21T06:11:36.595448+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594979+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:36.594979+0000","last_peered":"2024-09-21T06:11:36.594979+0000","last_clean":"2024-09-21T06:11:36.594979+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:36.594979+0000","last_undegraded":"2024-09-21T06:11:36.594979+0000","last_fullsized":"2024-09-21T06:11:36.594979+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595384+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:36.595384+0000","last_peered":"2024-09-21T06:11:36.595384+0000","last_clean":"2024-09-21T06:11:36.595384+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:36.595384+0000","last_undegraded":"2024-09-21T06:11:36.595384+0000","last_fullsized":"2024-09-21T06:11:36.595384+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367697+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:36.367697+0000","last_peered":"2024-09-21T06:11:36.367697+0000","last_clean":"2024-09-21T06:11:36.367697+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:36.367697+0000","last_undegraded":"2024-09-21T06:11:36.367697+0000","last_fullsized":"2024-09-21T06:11:36.367697+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595876+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:36.595876+0000","last_peered":"2024-09-21T06:11:36.595876+0000","last_clean":"2024-09-21T06:11:36.595876+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:36.595876+0000","last_undegraded":"2024-09-21T06:11:36.595876+0000","last_fullsized":"2024-09-21T06:11:36.595876+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549046+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:43.549046+0000","last_peered":"2024-09-21T06:11:43.549046+0000","last_clean":"2024-09-21T06:11:43.549046+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:43.549046+0000","last_undegraded":"2024-09-21T06:11:43.549046+0000","last_fullsized":"2024-09-21T06:11:43.549046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594534+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:36.594534+0000","last_peered":"2024-09-21T06:11:36.594534+0000","last_clean":"2024-09-21T06:11:36.594534+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:36.594534+0000","last_undegraded":"2024-09-21T06:11:36.594534+0000","last_fullsized":"2024-09-21T06:11:36.594534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549824+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:43.549824+0000","last_peered":"2024-09-21T06:11:43.549824+0000","last_clean":"2024-09-21T06:11:43.549824+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:43.549824+0000","last_undegraded":"2024-09-21T06:11:43.549824+0000","last_fullsized":"2024-09-21T06:11:43.549824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.369427+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.368620+0000","last_became_peered":"2024-09-21T06:11:35.368620+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:57.943956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596608+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:36.596608+0000","last_peered":"2024-09-21T06:11:36.596608+0000","last_clean":"2024-09-21T06:11:36.596608+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:36.596608+0000","last_undegraded":"2024-09-21T06:11:36.596608+0000","last_fullsized":"2024-09-21T06:11:36.596608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366827+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:36.366827+0000","last_peered":"2024-09-21T06:11:36.366827+0000","last_clean":"2024-09-21T06:11:36.366827+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:36.366827+0000","last_undegraded":"2024-09-21T06:11:36.366827+0000","last_fullsized":"2024-09-21T06:11:36.366827+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367656+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:36.367656+0000","last_peered":"2024-09-21T06:11:36.367656+0000","last_clean":"2024-09-21T06:11:36.367656+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:36.367656+0000","last_undegraded":"2024-09-21T06:11:36.367656+0000","last_fullsized":"2024-09-21T06:11:36.367656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550076+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:43.550076+0000","last_peered":"2024-09-21T06:11:43.550076+0000","last_clean":"2024-09-21T06:11:43.550076+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:43.550076+0000","last_undegraded":"2024-09-21T06:11:43.550076+0000","last_fullsized":"2024-09-21T06:11:43.550076+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367939+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:36.367939+0000","last_peered":"2024-09-21T06:11:36.367939+0000","last_clean":"2024-09-21T06:11:36.367939+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:36.367939+0000","last_undegraded":"2024-09-21T06:11:36.367939+0000","last_fullsized":"2024-09-21T06:11:36.367939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596023+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:36.596023+0000","last_peered":"2024-09-21T06:11:36.596023+0000","last_clean":"2024-09-21T06:11:36.596023+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:36.596023+0000","last_undegraded":"2024-09-21T06:11:36.596023+0000","last_fullsized":"2024-09-21T06:11:36.596023+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367813+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:36.367813+0000","last_peered":"2024-09-21T06:11:36.367813+0000","last_clean":"2024-09-21T06:11:36.367813+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:36.367813+0000","last_undegraded":"2024-09-21T06:11:36.367813+0000","last_fullsized":"2024-09-21T06:11:36.367813+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595609+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:36.595609+0000","last_peered":"2024-09-21T06:11:36.595609+0000","last_clean":"2024-09-21T06:11:36.595609+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:36.595609+0000","last_undegraded":"2024-09-21T06:11:36.595609+0000","last_fullsized":"2024-09-21T06:11:36.595609+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367019+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:36.367019+0000","last_peered":"2024-09-21T06:11:36.367019+0000","last_clean":"2024-09-21T06:11:36.367019+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:36.367019+0000","last_undegraded":"2024-09-21T06:11:36.367019+0000","last_fullsized":"2024-09-21T06:11:36.367019+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549144+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:43.549144+0000","last_peered":"2024-09-21T06:11:43.549144+0000","last_clean":"2024-09-21T06:11:43.549144+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:43.549144+0000","last_undegraded":"2024-09-21T06:11:43.549144+0000","last_fullsized":"2024-09-21T06:11:43.549144+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596145+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:36.596145+0000","last_peered":"2024-09-21T06:11:36.596145+0000","last_clean":"2024-09-21T06:11:36.596145+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:36.596145+0000","last_undegraded":"2024-09-21T06:11:36.596145+0000","last_fullsized":"2024-09-21T06:11:36.596145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549182+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:43.549182+0000","last_peered":"2024-09-21T06:11:43.549182+0000","last_clean":"2024-09-21T06:11:43.549182+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:43.549182+0000","last_undegraded":"2024-09-21T06:11:43.549182+0000","last_fullsized":"2024-09-21T06:11:43.549182+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549944+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:43.549944+0000","last_peered":"2024-09-21T06:11:43.549944+0000","last_clean":"2024-09-21T06:11:43.549944+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:43.549944+0000","last_undegraded":"2024-09-21T06:11:43.549944+0000","last_fullsized":"2024-09-21T06:11:43.549944+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"peering","last_fresh":"2024-09-21T06:11:39.059335+0000","last_change":"2024-09-21T06:11:43.549661+0000","last_active":"2024-09-21T06:11:43.549661+0000","last_peered":"2024-09-21T06:11:39.059335+0000","last_clean":"2024-09-21T06:11:39.059335+0000","last_became_active":"2024-09-21T06:11:35.369656+0000","last_became_peered":"2024-09-21T06:11:35.369656+0000","last_unstale":"2024-09-21T06:11:39.059335+0000","last_undegraded":"2024-09-21T06:11:39.059335+0000","last_fullsized":"2024-09-21T06:11:39.059335+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596364+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:36.596364+0000","last_peered":"2024-09-21T06:11:36.596364+0000","last_clean":"2024-09-21T06:11:36.596364+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:36.596364+0000","last_undegraded":"2024-09-21T06:11:36.596364+0000","last_fullsized":"2024-09-21T06:11:36.596364+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366666+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:36.366666+0000","last_peered":"2024-09-21T06:11:36.366666+0000","last_clean":"2024-09-21T06:11:36.366666+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:36.366666+0000","last_undegraded":"2024-09-21T06:11:36.366666+0000","last_fullsized":"2024-09-21T06:11:36.366666+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":21,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549248+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:43.549248+0000","last_peered":"2024-09-21T06:11:43.549248+0000","last_clean":"2024-09-21T06:11:43.549248+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:43.549248+0000","last_undegraded":"2024-09-21T06:11:43.549248+0000","last_fullsized":"2024-09-21T06:11:43.549248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595514+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:36.595514+0000","last_peered":"2024-09-21T06:11:36.595514+0000","last_clean":"2024-09-21T06:11:36.595514+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:36.595514+0000","last_undegraded":"2024-09-21T06:11:36.595514+0000","last_fullsized":"2024-09-21T06:11:36.595514+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549868+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:43.549868+0000","last_peered":"2024-09-21T06:11:43.549868+0000","last_clean":"2024-09-21T06:11:43.549868+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:43.549868+0000","last_undegraded":"2024-09-21T06:11:43.549868+0000","last_fullsized":"2024-09-21T06:11:43.549868+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368148+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:36.368148+0000","last_peered":"2024-09-21T06:11:36.368148+0000","last_clean":"2024-09-21T06:11:36.368148+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:36.368148+0000","last_undegraded":"2024-09-21T06:11:36.368148+0000","last_fullsized":"2024-09-21T06:11:36.368148+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549628+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:43.549628+0000","last_peered":"2024-09-21T06:11:43.549628+0000","last_clean":"2024-09-21T06:11:43.549628+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:43.549628+0000","last_undegraded":"2024-09-21T06:11:43.549628+0000","last_fullsized":"2024-09-21T06:11:43.549628+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595742+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:36.595742+0000","last_peered":"2024-09-21T06:11:36.595742+0000","last_clean":"2024-09-21T06:11:36.595742+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:36.595742+0000","last_undegraded":"2024-09-21T06:11:36.595742+0000","last_fullsized":"2024-09-21T06:11:36.595742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367098+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:36.367098+0000","last_peered":"2024-09-21T06:11:36.367098+0000","last_clean":"2024-09-21T06:11:36.367098+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:36.367098+0000","last_undegraded":"2024-09-21T06:11:36.367098+0000","last_fullsized":"2024-09-21T06:11:36.367098+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595169+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:36.595169+0000","last_peered":"2024-09-21T06:11:36.595169+0000","last_clean":"2024-09-21T06:11:36.595169+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:36.595169+0000","last_undegraded":"2024-09-21T06:11:36.595169+0000","last_fullsized":"2024-09-21T06:11:36.595169+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596842+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:36.596842+0000","last_peered":"2024-09-21T06:11:36.596842+0000","last_clean":"2024-09-21T06:11:36.596842+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:36.596842+0000","last_undegraded":"2024-09-21T06:11:36.596842+0000","last_fullsized":"2024-09-21T06:11:36.596842+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367337+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:36.367337+0000","last_peered":"2024-09-21T06:11:36.367337+0000","last_clean":"2024-09-21T06:11:36.367337+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:36.367337+0000","last_undegraded":"2024-09-21T06:11:36.367337+0000","last_fullsized":"2024-09-21T06:11:36.367337+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596665+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:36.596665+0000","last_peered":"2024-09-21T06:11:36.596665+0000","last_clean":"2024-09-21T06:11:36.596665+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:36.596665+0000","last_undegraded":"2024-09-21T06:11:36.596665+0000","last_fullsized":"2024-09-21T06:11:36.596665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595121+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:36.595121+0000","last_peered":"2024-09-21T06:11:36.595121+0000","last_clean":"2024-09-21T06:11:36.595121+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:36.595121+0000","last_undegraded":"2024-09-21T06:11:36.595121+0000","last_fullsized":"2024-09-21T06:11:36.595121+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594755+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:36.594755+0000","last_peered":"2024-09-21T06:11:36.594755+0000","last_clean":"2024-09-21T06:11:36.594755+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:36.594755+0000","last_undegraded":"2024-09-21T06:11:36.594755+0000","last_fullsized":"2024-09-21T06:11:36.594755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595886+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:36.595886+0000","last_peered":"2024-09-21T06:11:36.595886+0000","last_clean":"2024-09-21T06:11:36.595886+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:36.595886+0000","last_undegraded":"2024-09-21T06:11:36.595886+0000","last_fullsized":"2024-09-21T06:11:36.595886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549366+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:43.549366+0000","last_peered":"2024-09-21T06:11:43.549366+0000","last_clean":"2024-09-21T06:11:43.549366+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:43.549366+0000","last_undegraded":"2024-09-21T06:11:43.549366+0000","last_fullsized":"2024-09-21T06:11:43.549366+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597135+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:36.597135+0000","last_peered":"2024-09-21T06:11:36.597135+0000","last_clean":"2024-09-21T06:11:36.597135+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:36.597135+0000","last_undegraded":"2024-09-21T06:11:36.597135+0000","last_fullsized":"2024-09-21T06:11:36.597135+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596772+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:36.596772+0000","last_peered":"2024-09-21T06:11:36.596772+0000","last_clean":"2024-09-21T06:11:36.596772+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:36.596772+0000","last_undegraded":"2024-09-21T06:11:36.596772+0000","last_fullsized":"2024-09-21T06:11:36.596772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366955+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:36.366955+0000","last_peered":"2024-09-21T06:11:36.366955+0000","last_clean":"2024-09-21T06:11:36.366955+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:36.366955+0000","last_undegraded":"2024-09-21T06:11:36.366955+0000","last_fullsized":"2024-09-21T06:11:36.366955+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549243+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:43.549243+0000","last_peered":"2024-09-21T06:11:43.549243+0000","last_clean":"2024-09-21T06:11:43.549243+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:43.549243+0000","last_undegraded":"2024-09-21T06:11:43.549243+0000","last_fullsized":"2024-09-21T06:11:43.549243+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596236+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:36.596236+0000","last_peered":"2024-09-21T06:11:36.596236+0000","last_clean":"2024-09-21T06:11:36.596236+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:36.596236+0000","last_undegraded":"2024-09-21T06:11:36.596236+0000","last_fullsized":"2024-09-21T06:11:36.596236+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549112+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:43.549112+0000","last_peered":"2024-09-21T06:11:43.549112+0000","last_clean":"2024-09-21T06:11:43.549112+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:43.549112+0000","last_undegraded":"2024-09-21T06:11:43.549112+0000","last_fullsized":"2024-09-21T06:11:43.549112+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595218+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:36.595218+0000","last_peered":"2024-09-21T06:11:36.595218+0000","last_clean":"2024-09-21T06:11:36.595218+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:36.595218+0000","last_undegraded":"2024-09-21T06:11:36.595218+0000","last_fullsized":"2024-09-21T06:11:36.595218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550127+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:43.550127+0000","last_peered":"2024-09-21T06:11:43.550127+0000","last_clean":"2024-09-21T06:11:43.550127+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:43.550127+0000","last_undegraded":"2024-09-21T06:11:43.550127+0000","last_fullsized":"2024-09-21T06:11:43.550127+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551486+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:43.551486+0000","last_peered":"2024-09-21T06:11:43.551486+0000","last_clean":"2024-09-21T06:11:43.551486+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:43.551486+0000","last_undegraded":"2024-09-21T06:11:43.551486+0000","last_fullsized":"2024-09-21T06:11:43.551486+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594658+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:36.594658+0000","last_peered":"2024-09-21T06:11:36.594658+0000","last_clean":"2024-09-21T06:11:36.594658+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:36.594658+0000","last_undegraded":"2024-09-21T06:11:36.594658+0000","last_fullsized":"2024-09-21T06:11:36.594658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595287+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:36.595287+0000","last_peered":"2024-09-21T06:11:36.595287+0000","last_clean":"2024-09-21T06:11:36.595287+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:36.595287+0000","last_undegraded":"2024-09-21T06:11:36.595287+0000","last_fullsized":"2024-09-21T06:11:36.595287+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596103+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:36.596103+0000","last_peered":"2024-09-21T06:11:36.596103+0000","last_clean":"2024-09-21T06:11:36.596103+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:36.596103+0000","last_undegraded":"2024-09-21T06:11:36.596103+0000","last_fullsized":"2024-09-21T06:11:36.596103+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596177+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:36.596177+0000","last_peered":"2024-09-21T06:11:36.596177+0000","last_clean":"2024-09-21T06:11:36.596177+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:36.596177+0000","last_undegraded":"2024-09-21T06:11:36.596177+0000","last_fullsized":"2024-09-21T06:11:36.596177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596919+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:36.596919+0000","last_peered":"2024-09-21T06:11:36.596919+0000","last_clean":"2024-09-21T06:11:36.596919+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:36.596919+0000","last_undegraded":"2024-09-21T06:11:36.596919+0000","last_fullsized":"2024-09-21T06:11:36.596919+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595651+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:36.595651+0000","last_peered":"2024-09-21T06:11:36.595651+0000","last_clean":"2024-09-21T06:11:36.595651+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:36.595651+0000","last_undegraded":"2024-09-21T06:11:36.595651+0000","last_fullsized":"2024-09-21T06:11:36.595651+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595428+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:36.595428+0000","last_peered":"2024-09-21T06:11:36.595428+0000","last_clean":"2024-09-21T06:11:36.595428+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:36.595428+0000","last_undegraded":"2024-09-21T06:11:36.595428+0000","last_fullsized":"2024-09-21T06:11:36.595428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368209+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:36.368209+0000","last_peered":"2024-09-21T06:11:36.368209+0000","last_clean":"2024-09-21T06:11:36.368209+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:36.368209+0000","last_undegraded":"2024-09-21T06:11:36.368209+0000","last_fullsized":"2024-09-21T06:11:36.368209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366649+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:36.366649+0000","last_peered":"2024-09-21T06:11:36.366649+0000","last_clean":"2024-09-21T06:11:36.366649+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:36.366649+0000","last_undegraded":"2024-09-21T06:11:36.366649+0000","last_fullsized":"2024-09-21T06:11:36.366649+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595830+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:36.595830+0000","last_peered":"2024-09-21T06:11:36.595830+0000","last_clean":"2024-09-21T06:11:36.595830+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:36.595830+0000","last_undegraded":"2024-09-21T06:11:36.595830+0000","last_fullsized":"2024-09-21T06:11:36.595830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595890+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:36.595890+0000","last_peered":"2024-09-21T06:11:36.595890+0000","last_clean":"2024-09-21T06:11:36.595890+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:36.595890+0000","last_undegraded":"2024-09-21T06:11:36.595890+0000","last_fullsized":"2024-09-21T06:11:36.595890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596647+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:36.596647+0000","last_peered":"2024-09-21T06:11:36.596647+0000","last_clean":"2024-09-21T06:11:36.596647+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:36.596647+0000","last_undegraded":"2024-09-21T06:11:36.596647+0000","last_fullsized":"2024-09-21T06:11:36.596647+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549290+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:43.549290+0000","last_peered":"2024-09-21T06:11:43.549290+0000","last_clean":"2024-09-21T06:11:43.549290+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:43.549290+0000","last_undegraded":"2024-09-21T06:11:43.549290+0000","last_fullsized":"2024-09-21T06:11:43.549290+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596392+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:36.596392+0000","last_peered":"2024-09-21T06:11:36.596392+0000","last_clean":"2024-09-21T06:11:36.596392+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:36.596392+0000","last_undegraded":"2024-09-21T06:11:36.596392+0000","last_fullsized":"2024-09-21T06:11:36.596392+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595330+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:36.595330+0000","last_peered":"2024-09-21T06:11:36.595330+0000","last_clean":"2024-09-21T06:11:36.595330+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:36.595330+0000","last_undegraded":"2024-09-21T06:11:36.595330+0000","last_fullsized":"2024-09-21T06:11:36.595330+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367082+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:36.367082+0000","last_peered":"2024-09-21T06:11:36.367082+0000","last_clean":"2024-09-21T06:11:36.367082+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:36.367082+0000","last_undegraded":"2024-09-21T06:11:36.367082+0000","last_fullsized":"2024-09-21T06:11:36.367082+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366923+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:36.366923+0000","last_peered":"2024-09-21T06:11:36.366923+0000","last_clean":"2024-09-21T06:11:36.366923+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:36.366923+0000","last_undegraded":"2024-09-21T06:11:36.366923+0000","last_fullsized":"2024-09-21T06:11:36.366923+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549387+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:43.549387+0000","last_peered":"2024-09-21T06:11:43.549387+0000","last_clean":"2024-09-21T06:11:43.549387+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:43.549387+0000","last_undegraded":"2024-09-21T06:11:43.549387+0000","last_fullsized":"2024-09-21T06:11:43.549387+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368076+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:36.368076+0000","last_peered":"2024-09-21T06:11:36.368076+0000","last_clean":"2024-09-21T06:11:36.368076+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:36.368076+0000","last_undegraded":"2024-09-21T06:11:36.368076+0000","last_fullsized":"2024-09-21T06:11:36.368076+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595597+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:36.595597+0000","last_peered":"2024-09-21T06:11:36.595597+0000","last_clean":"2024-09-21T06:11:36.595597+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:36.595597+0000","last_undegraded":"2024-09-21T06:11:36.595597+0000","last_fullsized":"2024-09-21T06:11:36.595597+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549607+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:43.549607+0000","last_peered":"2024-09-21T06:11:43.549607+0000","last_clean":"2024-09-21T06:11:43.549607+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:43.549607+0000","last_undegraded":"2024-09-21T06:11:43.549607+0000","last_fullsized":"2024-09-21T06:11:43.549607+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549488+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:43.549488+0000","last_peered":"2024-09-21T06:11:43.549488+0000","last_clean":"2024-09-21T06:11:43.549488+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:43.549488+0000","last_undegraded":"2024-09-21T06:11:43.549488+0000","last_fullsized":"2024-09-21T06:11:43.549488+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":18,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549416+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:43.549416+0000","last_peered":"2024-09-21T06:11:43.549416+0000","last_clean":"2024-09-21T06:11:43.549416+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:43.549416+0000","last_undegraded":"2024-09-21T06:11:43.549416+0000","last_fullsized":"2024-09-21T06:11:43.549416+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595824+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:36.595824+0000","last_peered":"2024-09-21T06:11:36.595824+0000","last_clean":"2024-09-21T06:11:36.595824+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:36.595824+0000","last_undegraded":"2024-09-21T06:11:36.595824+0000","last_fullsized":"2024-09-21T06:11:36.595824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594822+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:36.594822+0000","last_peered":"2024-09-21T06:11:36.594822+0000","last_clean":"2024-09-21T06:11:36.594822+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:36.594822+0000","last_undegraded":"2024-09-21T06:11:36.594822+0000","last_fullsized":"2024-09-21T06:11:36.594822+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595038+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:36.595038+0000","last_peered":"2024-09-21T06:11:36.595038+0000","last_clean":"2024-09-21T06:11:36.595038+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:36.595038+0000","last_undegraded":"2024-09-21T06:11:36.595038+0000","last_fullsized":"2024-09-21T06:11:36.595038+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368262+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:36.368262+0000","last_peered":"2024-09-21T06:11:36.368262+0000","last_clean":"2024-09-21T06:11:36.368262+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:36.368262+0000","last_undegraded":"2024-09-21T06:11:36.368262+0000","last_fullsized":"2024-09-21T06:11:36.368262+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549087+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:43.549087+0000","last_peered":"2024-09-21T06:11:43.549087+0000","last_clean":"2024-09-21T06:11:43.549087+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:43.549087+0000","last_undegraded":"2024-09-21T06:11:43.549087+0000","last_fullsized":"2024-09-21T06:11:43.549087+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595928+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:36.595928+0000","last_peered":"2024-09-21T06:11:36.595928+0000","last_clean":"2024-09-21T06:11:36.595928+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:36.595928+0000","last_undegraded":"2024-09-21T06:11:36.595928+0000","last_fullsized":"2024-09-21T06:11:36.595928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597046+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:36.597046+0000","last_peered":"2024-09-21T06:11:36.597046+0000","last_clean":"2024-09-21T06:11:36.597046+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:36.597046+0000","last_undegraded":"2024-09-21T06:11:36.597046+0000","last_fullsized":"2024-09-21T06:11:36.597046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549297+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:43.549297+0000","last_peered":"2024-09-21T06:11:43.549297+0000","last_clean":"2024-09-21T06:11:43.549297+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:43.549297+0000","last_undegraded":"2024-09-21T06:11:43.549297+0000","last_fullsized":"2024-09-21T06:11:43.549297+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366928+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:36.366928+0000","last_peered":"2024-09-21T06:11:36.366928+0000","last_clean":"2024-09-21T06:11:36.366928+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:36.366928+0000","last_undegraded":"2024-09-21T06:11:36.366928+0000","last_fullsized":"2024-09-21T06:11:36.366928+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367448+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:36.367448+0000","last_peered":"2024-09-21T06:11:36.367448+0000","last_clean":"2024-09-21T06:11:36.367448+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:36.367448+0000","last_undegraded":"2024-09-21T06:11:36.367448+0000","last_fullsized":"2024-09-21T06:11:36.367448+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594875+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:36.594875+0000","last_peered":"2024-09-21T06:11:36.594875+0000","last_clean":"2024-09-21T06:11:36.594875+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:36.594875+0000","last_undegraded":"2024-09-21T06:11:36.594875+0000","last_fullsized":"2024-09-21T06:11:36.594875+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367981+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:36.367981+0000","last_peered":"2024-09-21T06:11:36.367981+0000","last_clean":"2024-09-21T06:11:36.367981+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:36.367981+0000","last_undegraded":"2024-09-21T06:11:36.367981+0000","last_fullsized":"2024-09-21T06:11:36.367981+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549989+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:43.549989+0000","last_peered":"2024-09-21T06:11:43.549989+0000","last_clean":"2024-09-21T06:11:43.549989+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:43.549989+0000","last_undegraded":"2024-09-21T06:11:43.549989+0000","last_fullsized":"2024-09-21T06:11:43.549989+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549730+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:43.549730+0000","last_peered":"2024-09-21T06:11:43.549730+0000","last_clean":"2024-09-21T06:11:43.549730+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:43.549730+0000","last_undegraded":"2024-09-21T06:11:43.549730+0000","last_fullsized":"2024-09-21T06:11:43.549730+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":373,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549467+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:43.549467+0000","last_peered":"2024-09-21T06:11:43.549467+0000","last_clean":"2024-09-21T06:11:43.549467+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:43.549467+0000","last_undegraded":"2024-09-21T06:11:43.549467+0000","last_fullsized":"2024-09-21T06:11:43.549467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178487,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1378,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193933,"statfs":{"total":200000000,"available":198588279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1386,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198580004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194508,"statfs":{"total":200000000,"available":199177035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:45.364 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.621+0000 7fa501c00640 1 -- 172.21.15.118:0/359354886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc0b5450 msgr2=0x7fa4fc0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.621+0000 7fa501c00640 1 --2- 172.21.15.118:0/359354886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc0b5450 0x7fa4fc0cd150 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0b3800 tx=0x7fa4f402a980 comp rx=0 tx=0).stop 2024-09-21T06:11:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.621+0000 7fa501c00640 1 -- 172.21.15.118:0/359354886 shutdown_connections 2024-09-21T06:11:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.621+0000 7fa501c00640 1 --2- 172.21.15.118:0/359354886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc0b5450 0x7fa4fc0cd150 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.621+0000 7fa501c00640 1 --2- 172.21.15.118:0/359354886 >> v2:172.21.15.149:3300/0 conn(0x7fa4fc15cfd0 0x7fa4fc0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.621+0000 7fa501c00640 1 -- 172.21.15.118:0/359354886 >> 172.21.15.118:0/359354886 conn(0x7fa4fc06d110 msgr2=0x7fa4fc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.622+0000 7fa501c00640 1 -- 172.21.15.118:0/359354886 shutdown_connections 2024-09-21T06:11:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.622+0000 7fa501c00640 1 -- 172.21.15.118:0/359354886 wait complete. 2024-09-21T06:11:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.624+0000 7fa501c00640 1 Processor -- start 2024-09-21T06:11:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.624+0000 7fa501c00640 1 -- start start 2024-09-21T06:11:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.625+0000 7fa501c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0b5040 0x7fa4fc0aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.625+0000 7fa501c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0b5450 0x7fa4fc0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.625+0000 7fa501c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc15cfd0 0x7fa4fc144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.625+0000 7fa501c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc073c60 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.625+0000 7fa501c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc073ae0 con 0x7fa4fc0b5450 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.625+0000 7fa501c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc073de0 con 0x7fa4fc0b5040 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc15cfd0 0x7fa4fc144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc15cfd0 0x7fa4fc144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59530/0 (socket says 172.21.15.118:59530) 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 -- 172.21.15.118:0/431534314 learned_addr learned my addr 172.21.15.118:0/431534314 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fa000640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0b5450 0x7fa4fc0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4faa00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0b5040 0x7fa4fc0aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 -- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0b5040 msgr2=0x7fa4fc0aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0b5040 0x7fa4fc0aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 -- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0b5450 msgr2=0x7fa4fc0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0b5450 0x7fa4fc0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 -- 172.21.15.118:0/431534314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc0abc90 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.626+0000 7fa4fb400640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc15cfd0 0x7fa4fc144b70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4033040 tx=0x7fa4f4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:45.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.627+0000 7fa4f2a00640 1 -- 172.21.15.118:0/431534314 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4034040 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.627+0000 7fa4f2a00640 1 -- 172.21.15.118:0/431534314 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4f4004540 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.627+0000 7fa4f2a00640 1 -- 172.21.15.118:0/431534314 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4045480 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.627+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc0abf70 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.627+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc0ac530 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.628+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc0cd180 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.629+0000 7fa4f2a00640 1 -- 172.21.15.118:0/431534314 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4f4037020 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.630+0000 7fa4f2a00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa4dc078bc0 0x7fa4dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.630+0000 7fa4f2a00640 1 -- 172.21.15.118:0/431534314 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7fa4f40bc620 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.630+0000 7fa4faa00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa4dc078bc0 0x7fa4dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.631+0000 7fa4faa00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa4dc078bc0 0x7fa4dc07b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00bb50 tx=0x7fa4ec00b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:45.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.634+0000 7fa4f2a00640 1 -- 172.21.15.118:0/431534314 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa4f4084340 con 0x7fa4fc15cfd0 2024-09-21T06:11:45.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.816+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4fc0b3a60 con 0x7fa4dc078bc0 2024-09-21T06:11:45.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.822+0000 7fa4f2a00640 1 -- 172.21.15.118:0/431534314 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247943 (secure 0 0 0) 0x7fa4fc0b3a60 con 0x7fa4dc078bc0 2024-09-21T06:11:45.827 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa4dc078bc0 msgr2=0x7fa4dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa4dc078bc0 0x7fa4dc07b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00bb50 tx=0x7fa4ec00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc15cfd0 msgr2=0x7fa4fc144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc15cfd0 0x7fa4fc144b70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4033040 tx=0x7fa4f4003f10 comp rx=0 tx=0).stop 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 shutdown_connections 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4fc15cfd0 0x7fa4fc144b70 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0b5450 0x7fa4fc0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa4dc078bc0 0x7fa4dc07b0d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 --2- 172.21.15.118:0/431534314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0b5040 0x7fa4fc0aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 >> 172.21.15.118:0/431534314 conn(0x7fa4fc06d110 msgr2=0x7fa4fc074240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 shutdown_connections 2024-09-21T06:11:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:45.826+0000 7fa501c00640 1 -- 172.21.15.118:0/431534314 wait complete. 2024-09-21T06:11:45.852 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-21T06:11:44.581181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7580,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554919,"statfs":{"total":1600000000,"available":1592237595,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002246"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551281+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:43.551281+0000","last_peered":"2024-09-21T06:11:43.551281+0000","last_clean":"2024-09-21T06:11:43.551281+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:43.551281+0000","last_undegraded":"2024-09-21T06:11:43.551281+0000","last_fullsized":"2024-09-21T06:11:43.551281+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595096+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:36.595096+0000","last_peered":"2024-09-21T06:11:36.595096+0000","last_clean":"2024-09-21T06:11:36.595096+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:36.595096+0000","last_undegraded":"2024-09-21T06:11:36.595096+0000","last_fullsized":"2024-09-21T06:11:36.595096+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595198+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:36.595198+0000","last_peered":"2024-09-21T06:11:36.595198+0000","last_clean":"2024-09-21T06:11:36.595198+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:36.595198+0000","last_undegraded":"2024-09-21T06:11:36.595198+0000","last_fullsized":"2024-09-21T06:11:36.595198+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.548994+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:43.548994+0000","last_peered":"2024-09-21T06:11:43.548994+0000","last_clean":"2024-09-21T06:11:43.548994+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:43.548994+0000","last_undegraded":"2024-09-21T06:11:43.548994+0000","last_fullsized":"2024-09-21T06:11:43.548994+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549524+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:43.549524+0000","last_peered":"2024-09-21T06:11:43.549524+0000","last_clean":"2024-09-21T06:11:43.549524+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:43.549524+0000","last_undegraded":"2024-09-21T06:11:43.549524+0000","last_fullsized":"2024-09-21T06:11:43.549524+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595655+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:36.595655+0000","last_peered":"2024-09-21T06:11:36.595655+0000","last_clean":"2024-09-21T06:11:36.595655+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:36.595655+0000","last_undegraded":"2024-09-21T06:11:36.595655+0000","last_fullsized":"2024-09-21T06:11:36.595655+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596113+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:36.596113+0000","last_peered":"2024-09-21T06:11:36.596113+0000","last_clean":"2024-09-21T06:11:36.596113+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:36.596113+0000","last_undegraded":"2024-09-21T06:11:36.596113+0000","last_fullsized":"2024-09-21T06:11:36.596113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595448+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:36.595448+0000","last_peered":"2024-09-21T06:11:36.595448+0000","last_clean":"2024-09-21T06:11:36.595448+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:36.595448+0000","last_undegraded":"2024-09-21T06:11:36.595448+0000","last_fullsized":"2024-09-21T06:11:36.595448+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594979+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:36.594979+0000","last_peered":"2024-09-21T06:11:36.594979+0000","last_clean":"2024-09-21T06:11:36.594979+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:36.594979+0000","last_undegraded":"2024-09-21T06:11:36.594979+0000","last_fullsized":"2024-09-21T06:11:36.594979+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595384+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:36.595384+0000","last_peered":"2024-09-21T06:11:36.595384+0000","last_clean":"2024-09-21T06:11:36.595384+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:36.595384+0000","last_undegraded":"2024-09-21T06:11:36.595384+0000","last_fullsized":"2024-09-21T06:11:36.595384+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367697+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:36.367697+0000","last_peered":"2024-09-21T06:11:36.367697+0000","last_clean":"2024-09-21T06:11:36.367697+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:36.367697+0000","last_undegraded":"2024-09-21T06:11:36.367697+0000","last_fullsized":"2024-09-21T06:11:36.367697+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595876+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:36.595876+0000","last_peered":"2024-09-21T06:11:36.595876+0000","last_clean":"2024-09-21T06:11:36.595876+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:36.595876+0000","last_undegraded":"2024-09-21T06:11:36.595876+0000","last_fullsized":"2024-09-21T06:11:36.595876+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549046+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:43.549046+0000","last_peered":"2024-09-21T06:11:43.549046+0000","last_clean":"2024-09-21T06:11:43.549046+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:43.549046+0000","last_undegraded":"2024-09-21T06:11:43.549046+0000","last_fullsized":"2024-09-21T06:11:43.549046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594534+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:36.594534+0000","last_peered":"2024-09-21T06:11:36.594534+0000","last_clean":"2024-09-21T06:11:36.594534+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:36.594534+0000","last_undegraded":"2024-09-21T06:11:36.594534+0000","last_fullsized":"2024-09-21T06:11:36.594534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549824+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:43.549824+0000","last_peered":"2024-09-21T06:11:43.549824+0000","last_clean":"2024-09-21T06:11:43.549824+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:43.549824+0000","last_undegraded":"2024-09-21T06:11:43.549824+0000","last_fullsized":"2024-09-21T06:11:43.549824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.369427+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.368620+0000","last_became_peered":"2024-09-21T06:11:35.368620+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:57.943956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596608+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:36.596608+0000","last_peered":"2024-09-21T06:11:36.596608+0000","last_clean":"2024-09-21T06:11:36.596608+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:36.596608+0000","last_undegraded":"2024-09-21T06:11:36.596608+0000","last_fullsized":"2024-09-21T06:11:36.596608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366827+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:36.366827+0000","last_peered":"2024-09-21T06:11:36.366827+0000","last_clean":"2024-09-21T06:11:36.366827+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:36.366827+0000","last_undegraded":"2024-09-21T06:11:36.366827+0000","last_fullsized":"2024-09-21T06:11:36.366827+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367656+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:36.367656+0000","last_peered":"2024-09-21T06:11:36.367656+0000","last_clean":"2024-09-21T06:11:36.367656+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:36.367656+0000","last_undegraded":"2024-09-21T06:11:36.367656+0000","last_fullsized":"2024-09-21T06:11:36.367656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366743+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:36.366743+0000","last_peered":"2024-09-21T06:11:36.366743+0000","last_clean":"2024-09-21T06:11:36.366743+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:36.366743+0000","last_undegraded":"2024-09-21T06:11:36.366743+0000","last_fullsized":"2024-09-21T06:11:36.366743+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550076+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:43.550076+0000","last_peered":"2024-09-21T06:11:43.550076+0000","last_clean":"2024-09-21T06:11:43.550076+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:43.550076+0000","last_undegraded":"2024-09-21T06:11:43.550076+0000","last_fullsized":"2024-09-21T06:11:43.550076+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367939+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:36.367939+0000","last_peered":"2024-09-21T06:11:36.367939+0000","last_clean":"2024-09-21T06:11:36.367939+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:36.367939+0000","last_undegraded":"2024-09-21T06:11:36.367939+0000","last_fullsized":"2024-09-21T06:11:36.367939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596023+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:36.596023+0000","last_peered":"2024-09-21T06:11:36.596023+0000","last_clean":"2024-09-21T06:11:36.596023+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:36.596023+0000","last_undegraded":"2024-09-21T06:11:36.596023+0000","last_fullsized":"2024-09-21T06:11:36.596023+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367813+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:36.367813+0000","last_peered":"2024-09-21T06:11:36.367813+0000","last_clean":"2024-09-21T06:11:36.367813+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:36.367813+0000","last_undegraded":"2024-09-21T06:11:36.367813+0000","last_fullsized":"2024-09-21T06:11:36.367813+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595609+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:36.595609+0000","last_peered":"2024-09-21T06:11:36.595609+0000","last_clean":"2024-09-21T06:11:36.595609+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:36.595609+0000","last_undegraded":"2024-09-21T06:11:36.595609+0000","last_fullsized":"2024-09-21T06:11:36.595609+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367019+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:36.367019+0000","last_peered":"2024-09-21T06:11:36.367019+0000","last_clean":"2024-09-21T06:11:36.367019+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:36.367019+0000","last_undegraded":"2024-09-21T06:11:36.367019+0000","last_fullsized":"2024-09-21T06:11:36.367019+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549144+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:43.549144+0000","last_peered":"2024-09-21T06:11:43.549144+0000","last_clean":"2024-09-21T06:11:43.549144+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:43.549144+0000","last_undegraded":"2024-09-21T06:11:43.549144+0000","last_fullsized":"2024-09-21T06:11:43.549144+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596145+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:36.596145+0000","last_peered":"2024-09-21T06:11:36.596145+0000","last_clean":"2024-09-21T06:11:36.596145+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:36.596145+0000","last_undegraded":"2024-09-21T06:11:36.596145+0000","last_fullsized":"2024-09-21T06:11:36.596145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549182+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:43.549182+0000","last_peered":"2024-09-21T06:11:43.549182+0000","last_clean":"2024-09-21T06:11:43.549182+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:43.549182+0000","last_undegraded":"2024-09-21T06:11:43.549182+0000","last_fullsized":"2024-09-21T06:11:43.549182+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549944+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:43.549944+0000","last_peered":"2024-09-21T06:11:43.549944+0000","last_clean":"2024-09-21T06:11:43.549944+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:43.549944+0000","last_undegraded":"2024-09-21T06:11:43.549944+0000","last_fullsized":"2024-09-21T06:11:43.549944+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"peering","last_fresh":"2024-09-21T06:11:39.059335+0000","last_change":"2024-09-21T06:11:43.549661+0000","last_active":"2024-09-21T06:11:43.549661+0000","last_peered":"2024-09-21T06:11:39.059335+0000","last_clean":"2024-09-21T06:11:39.059335+0000","last_became_active":"2024-09-21T06:11:35.369656+0000","last_became_peered":"2024-09-21T06:11:35.369656+0000","last_unstale":"2024-09-21T06:11:39.059335+0000","last_undegraded":"2024-09-21T06:11:39.059335+0000","last_fullsized":"2024-09-21T06:11:39.059335+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596364+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:36.596364+0000","last_peered":"2024-09-21T06:11:36.596364+0000","last_clean":"2024-09-21T06:11:36.596364+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:36.596364+0000","last_undegraded":"2024-09-21T06:11:36.596364+0000","last_fullsized":"2024-09-21T06:11:36.596364+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366666+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:36.366666+0000","last_peered":"2024-09-21T06:11:36.366666+0000","last_clean":"2024-09-21T06:11:36.366666+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:36.366666+0000","last_undegraded":"2024-09-21T06:11:36.366666+0000","last_fullsized":"2024-09-21T06:11:36.366666+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":21,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549248+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:43.549248+0000","last_peered":"2024-09-21T06:11:43.549248+0000","last_clean":"2024-09-21T06:11:43.549248+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:43.549248+0000","last_undegraded":"2024-09-21T06:11:43.549248+0000","last_fullsized":"2024-09-21T06:11:43.549248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595514+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:36.595514+0000","last_peered":"2024-09-21T06:11:36.595514+0000","last_clean":"2024-09-21T06:11:36.595514+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:36.595514+0000","last_undegraded":"2024-09-21T06:11:36.595514+0000","last_fullsized":"2024-09-21T06:11:36.595514+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549868+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:43.549868+0000","last_peered":"2024-09-21T06:11:43.549868+0000","last_clean":"2024-09-21T06:11:43.549868+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:43.549868+0000","last_undegraded":"2024-09-21T06:11:43.549868+0000","last_fullsized":"2024-09-21T06:11:43.549868+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368148+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:36.368148+0000","last_peered":"2024-09-21T06:11:36.368148+0000","last_clean":"2024-09-21T06:11:36.368148+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:36.368148+0000","last_undegraded":"2024-09-21T06:11:36.368148+0000","last_fullsized":"2024-09-21T06:11:36.368148+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549628+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:43.549628+0000","last_peered":"2024-09-21T06:11:43.549628+0000","last_clean":"2024-09-21T06:11:43.549628+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:43.549628+0000","last_undegraded":"2024-09-21T06:11:43.549628+0000","last_fullsized":"2024-09-21T06:11:43.549628+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595742+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:36.595742+0000","last_peered":"2024-09-21T06:11:36.595742+0000","last_clean":"2024-09-21T06:11:36.595742+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:36.595742+0000","last_undegraded":"2024-09-21T06:11:36.595742+0000","last_fullsized":"2024-09-21T06:11:36.595742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367098+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:36.367098+0000","last_peered":"2024-09-21T06:11:36.367098+0000","last_clean":"2024-09-21T06:11:36.367098+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:36.367098+0000","last_undegraded":"2024-09-21T06:11:36.367098+0000","last_fullsized":"2024-09-21T06:11:36.367098+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595169+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:36.595169+0000","last_peered":"2024-09-21T06:11:36.595169+0000","last_clean":"2024-09-21T06:11:36.595169+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:36.595169+0000","last_undegraded":"2024-09-21T06:11:36.595169+0000","last_fullsized":"2024-09-21T06:11:36.595169+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596842+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:36.596842+0000","last_peered":"2024-09-21T06:11:36.596842+0000","last_clean":"2024-09-21T06:11:36.596842+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:36.596842+0000","last_undegraded":"2024-09-21T06:11:36.596842+0000","last_fullsized":"2024-09-21T06:11:36.596842+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367337+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:36.367337+0000","last_peered":"2024-09-21T06:11:36.367337+0000","last_clean":"2024-09-21T06:11:36.367337+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:36.367337+0000","last_undegraded":"2024-09-21T06:11:36.367337+0000","last_fullsized":"2024-09-21T06:11:36.367337+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596665+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:36.596665+0000","last_peered":"2024-09-21T06:11:36.596665+0000","last_clean":"2024-09-21T06:11:36.596665+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:36.596665+0000","last_undegraded":"2024-09-21T06:11:36.596665+0000","last_fullsized":"2024-09-21T06:11:36.596665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595121+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:36.595121+0000","last_peered":"2024-09-21T06:11:36.595121+0000","last_clean":"2024-09-21T06:11:36.595121+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:36.595121+0000","last_undegraded":"2024-09-21T06:11:36.595121+0000","last_fullsized":"2024-09-21T06:11:36.595121+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594755+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:36.594755+0000","last_peered":"2024-09-21T06:11:36.594755+0000","last_clean":"2024-09-21T06:11:36.594755+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:36.594755+0000","last_undegraded":"2024-09-21T06:11:36.594755+0000","last_fullsized":"2024-09-21T06:11:36.594755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595886+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:36.595886+0000","last_peered":"2024-09-21T06:11:36.595886+0000","last_clean":"2024-09-21T06:11:36.595886+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:36.595886+0000","last_undegraded":"2024-09-21T06:11:36.595886+0000","last_fullsized":"2024-09-21T06:11:36.595886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549366+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:43.549366+0000","last_peered":"2024-09-21T06:11:43.549366+0000","last_clean":"2024-09-21T06:11:43.549366+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:43.549366+0000","last_undegraded":"2024-09-21T06:11:43.549366+0000","last_fullsized":"2024-09-21T06:11:43.549366+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597135+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:36.597135+0000","last_peered":"2024-09-21T06:11:36.597135+0000","last_clean":"2024-09-21T06:11:36.597135+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:36.597135+0000","last_undegraded":"2024-09-21T06:11:36.597135+0000","last_fullsized":"2024-09-21T06:11:36.597135+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596772+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:36.596772+0000","last_peered":"2024-09-21T06:11:36.596772+0000","last_clean":"2024-09-21T06:11:36.596772+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:36.596772+0000","last_undegraded":"2024-09-21T06:11:36.596772+0000","last_fullsized":"2024-09-21T06:11:36.596772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366955+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:36.366955+0000","last_peered":"2024-09-21T06:11:36.366955+0000","last_clean":"2024-09-21T06:11:36.366955+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:36.366955+0000","last_undegraded":"2024-09-21T06:11:36.366955+0000","last_fullsized":"2024-09-21T06:11:36.366955+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549243+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:43.549243+0000","last_peered":"2024-09-21T06:11:43.549243+0000","last_clean":"2024-09-21T06:11:43.549243+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:43.549243+0000","last_undegraded":"2024-09-21T06:11:43.549243+0000","last_fullsized":"2024-09-21T06:11:43.549243+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596236+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:36.596236+0000","last_peered":"2024-09-21T06:11:36.596236+0000","last_clean":"2024-09-21T06:11:36.596236+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:36.596236+0000","last_undegraded":"2024-09-21T06:11:36.596236+0000","last_fullsized":"2024-09-21T06:11:36.596236+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549112+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:43.549112+0000","last_peered":"2024-09-21T06:11:43.549112+0000","last_clean":"2024-09-21T06:11:43.549112+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:43.549112+0000","last_undegraded":"2024-09-21T06:11:43.549112+0000","last_fullsized":"2024-09-21T06:11:43.549112+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595218+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:36.595218+0000","last_peered":"2024-09-21T06:11:36.595218+0000","last_clean":"2024-09-21T06:11:36.595218+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:36.595218+0000","last_undegraded":"2024-09-21T06:11:36.595218+0000","last_fullsized":"2024-09-21T06:11:36.595218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550127+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:43.550127+0000","last_peered":"2024-09-21T06:11:43.550127+0000","last_clean":"2024-09-21T06:11:43.550127+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:43.550127+0000","last_undegraded":"2024-09-21T06:11:43.550127+0000","last_fullsized":"2024-09-21T06:11:43.550127+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551486+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:43.551486+0000","last_peered":"2024-09-21T06:11:43.551486+0000","last_clean":"2024-09-21T06:11:43.551486+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:43.551486+0000","last_undegraded":"2024-09-21T06:11:43.551486+0000","last_fullsized":"2024-09-21T06:11:43.551486+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594658+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:36.594658+0000","last_peered":"2024-09-21T06:11:36.594658+0000","last_clean":"2024-09-21T06:11:36.594658+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:36.594658+0000","last_undegraded":"2024-09-21T06:11:36.594658+0000","last_fullsized":"2024-09-21T06:11:36.594658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595287+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:36.595287+0000","last_peered":"2024-09-21T06:11:36.595287+0000","last_clean":"2024-09-21T06:11:36.595287+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:36.595287+0000","last_undegraded":"2024-09-21T06:11:36.595287+0000","last_fullsized":"2024-09-21T06:11:36.595287+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596103+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:36.596103+0000","last_peered":"2024-09-21T06:11:36.596103+0000","last_clean":"2024-09-21T06:11:36.596103+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:36.596103+0000","last_undegraded":"2024-09-21T06:11:36.596103+0000","last_fullsized":"2024-09-21T06:11:36.596103+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596177+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:36.596177+0000","last_peered":"2024-09-21T06:11:36.596177+0000","last_clean":"2024-09-21T06:11:36.596177+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:36.596177+0000","last_undegraded":"2024-09-21T06:11:36.596177+0000","last_fullsized":"2024-09-21T06:11:36.596177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596919+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:36.596919+0000","last_peered":"2024-09-21T06:11:36.596919+0000","last_clean":"2024-09-21T06:11:36.596919+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:36.596919+0000","last_undegraded":"2024-09-21T06:11:36.596919+0000","last_fullsized":"2024-09-21T06:11:36.596919+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595651+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:36.595651+0000","last_peered":"2024-09-21T06:11:36.595651+0000","last_clean":"2024-09-21T06:11:36.595651+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:36.595651+0000","last_undegraded":"2024-09-21T06:11:36.595651+0000","last_fullsized":"2024-09-21T06:11:36.595651+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595428+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:36.595428+0000","last_peered":"2024-09-21T06:11:36.595428+0000","last_clean":"2024-09-21T06:11:36.595428+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:36.595428+0000","last_undegraded":"2024-09-21T06:11:36.595428+0000","last_fullsized":"2024-09-21T06:11:36.595428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368209+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:36.368209+0000","last_peered":"2024-09-21T06:11:36.368209+0000","last_clean":"2024-09-21T06:11:36.368209+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:36.368209+0000","last_undegraded":"2024-09-21T06:11:36.368209+0000","last_fullsized":"2024-09-21T06:11:36.368209+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366649+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:36.366649+0000","last_peered":"2024-09-21T06:11:36.366649+0000","last_clean":"2024-09-21T06:11:36.366649+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:36.366649+0000","last_undegraded":"2024-09-21T06:11:36.366649+0000","last_fullsized":"2024-09-21T06:11:36.366649+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595830+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:36.595830+0000","last_peered":"2024-09-21T06:11:36.595830+0000","last_clean":"2024-09-21T06:11:36.595830+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:36.595830+0000","last_undegraded":"2024-09-21T06:11:36.595830+0000","last_fullsized":"2024-09-21T06:11:36.595830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595890+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:36.595890+0000","last_peered":"2024-09-21T06:11:36.595890+0000","last_clean":"2024-09-21T06:11:36.595890+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:36.595890+0000","last_undegraded":"2024-09-21T06:11:36.595890+0000","last_fullsized":"2024-09-21T06:11:36.595890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596647+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:36.596647+0000","last_peered":"2024-09-21T06:11:36.596647+0000","last_clean":"2024-09-21T06:11:36.596647+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:36.596647+0000","last_undegraded":"2024-09-21T06:11:36.596647+0000","last_fullsized":"2024-09-21T06:11:36.596647+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549290+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:43.549290+0000","last_peered":"2024-09-21T06:11:43.549290+0000","last_clean":"2024-09-21T06:11:43.549290+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:43.549290+0000","last_undegraded":"2024-09-21T06:11:43.549290+0000","last_fullsized":"2024-09-21T06:11:43.549290+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596392+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:36.596392+0000","last_peered":"2024-09-21T06:11:36.596392+0000","last_clean":"2024-09-21T06:11:36.596392+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:36.596392+0000","last_undegraded":"2024-09-21T06:11:36.596392+0000","last_fullsized":"2024-09-21T06:11:36.596392+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595330+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:36.595330+0000","last_peered":"2024-09-21T06:11:36.595330+0000","last_clean":"2024-09-21T06:11:36.595330+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:36.595330+0000","last_undegraded":"2024-09-21T06:11:36.595330+0000","last_fullsized":"2024-09-21T06:11:36.595330+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367082+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:36.367082+0000","last_peered":"2024-09-21T06:11:36.367082+0000","last_clean":"2024-09-21T06:11:36.367082+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:36.367082+0000","last_undegraded":"2024-09-21T06:11:36.367082+0000","last_fullsized":"2024-09-21T06:11:36.367082+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366923+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:36.366923+0000","last_peered":"2024-09-21T06:11:36.366923+0000","last_clean":"2024-09-21T06:11:36.366923+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:36.366923+0000","last_undegraded":"2024-09-21T06:11:36.366923+0000","last_fullsized":"2024-09-21T06:11:36.366923+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549387+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:43.549387+0000","last_peered":"2024-09-21T06:11:43.549387+0000","last_clean":"2024-09-21T06:11:43.549387+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:43.549387+0000","last_undegraded":"2024-09-21T06:11:43.549387+0000","last_fullsized":"2024-09-21T06:11:43.549387+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368076+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:36.368076+0000","last_peered":"2024-09-21T06:11:36.368076+0000","last_clean":"2024-09-21T06:11:36.368076+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:36.368076+0000","last_undegraded":"2024-09-21T06:11:36.368076+0000","last_fullsized":"2024-09-21T06:11:36.368076+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595597+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:36.595597+0000","last_peered":"2024-09-21T06:11:36.595597+0000","last_clean":"2024-09-21T06:11:36.595597+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:36.595597+0000","last_undegraded":"2024-09-21T06:11:36.595597+0000","last_fullsized":"2024-09-21T06:11:36.595597+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549607+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:43.549607+0000","last_peered":"2024-09-21T06:11:43.549607+0000","last_clean":"2024-09-21T06:11:43.549607+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:43.549607+0000","last_undegraded":"2024-09-21T06:11:43.549607+0000","last_fullsized":"2024-09-21T06:11:43.549607+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549488+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:43.549488+0000","last_peered":"2024-09-21T06:11:43.549488+0000","last_clean":"2024-09-21T06:11:43.549488+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:43.549488+0000","last_undegraded":"2024-09-21T06:11:43.549488+0000","last_fullsized":"2024-09-21T06:11:43.549488+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":18,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549416+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:43.549416+0000","last_peered":"2024-09-21T06:11:43.549416+0000","last_clean":"2024-09-21T06:11:43.549416+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:43.549416+0000","last_undegraded":"2024-09-21T06:11:43.549416+0000","last_fullsized":"2024-09-21T06:11:43.549416+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595824+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:36.595824+0000","last_peered":"2024-09-21T06:11:36.595824+0000","last_clean":"2024-09-21T06:11:36.595824+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:36.595824+0000","last_undegraded":"2024-09-21T06:11:36.595824+0000","last_fullsized":"2024-09-21T06:11:36.595824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594822+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:36.594822+0000","last_peered":"2024-09-21T06:11:36.594822+0000","last_clean":"2024-09-21T06:11:36.594822+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:36.594822+0000","last_undegraded":"2024-09-21T06:11:36.594822+0000","last_fullsized":"2024-09-21T06:11:36.594822+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595038+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:36.595038+0000","last_peered":"2024-09-21T06:11:36.595038+0000","last_clean":"2024-09-21T06:11:36.595038+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:36.595038+0000","last_undegraded":"2024-09-21T06:11:36.595038+0000","last_fullsized":"2024-09-21T06:11:36.595038+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.368262+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:36.368262+0000","last_peered":"2024-09-21T06:11:36.368262+0000","last_clean":"2024-09-21T06:11:36.368262+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:36.368262+0000","last_undegraded":"2024-09-21T06:11:36.368262+0000","last_fullsized":"2024-09-21T06:11:36.368262+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549087+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:43.549087+0000","last_peered":"2024-09-21T06:11:43.549087+0000","last_clean":"2024-09-21T06:11:43.549087+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:43.549087+0000","last_undegraded":"2024-09-21T06:11:43.549087+0000","last_fullsized":"2024-09-21T06:11:43.549087+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595928+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:36.595928+0000","last_peered":"2024-09-21T06:11:36.595928+0000","last_clean":"2024-09-21T06:11:36.595928+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:36.595928+0000","last_undegraded":"2024-09-21T06:11:36.595928+0000","last_fullsized":"2024-09-21T06:11:36.595928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597046+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:36.597046+0000","last_peered":"2024-09-21T06:11:36.597046+0000","last_clean":"2024-09-21T06:11:36.597046+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:36.597046+0000","last_undegraded":"2024-09-21T06:11:36.597046+0000","last_fullsized":"2024-09-21T06:11:36.597046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549297+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:43.549297+0000","last_peered":"2024-09-21T06:11:43.549297+0000","last_clean":"2024-09-21T06:11:43.549297+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:43.549297+0000","last_undegraded":"2024-09-21T06:11:43.549297+0000","last_fullsized":"2024-09-21T06:11:43.549297+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.366928+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:36.366928+0000","last_peered":"2024-09-21T06:11:36.366928+0000","last_clean":"2024-09-21T06:11:36.366928+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:36.366928+0000","last_undegraded":"2024-09-21T06:11:36.366928+0000","last_fullsized":"2024-09-21T06:11:36.366928+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367448+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:36.367448+0000","last_peered":"2024-09-21T06:11:36.367448+0000","last_clean":"2024-09-21T06:11:36.367448+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:36.367448+0000","last_undegraded":"2024-09-21T06:11:36.367448+0000","last_fullsized":"2024-09-21T06:11:36.367448+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594875+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:36.594875+0000","last_peered":"2024-09-21T06:11:36.594875+0000","last_clean":"2024-09-21T06:11:36.594875+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:36.594875+0000","last_undegraded":"2024-09-21T06:11:36.594875+0000","last_fullsized":"2024-09-21T06:11:36.594875+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.367981+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:36.367981+0000","last_peered":"2024-09-21T06:11:36.367981+0000","last_clean":"2024-09-21T06:11:36.367981+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:36.367981+0000","last_undegraded":"2024-09-21T06:11:36.367981+0000","last_fullsized":"2024-09-21T06:11:36.367981+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549989+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:43.549989+0000","last_peered":"2024-09-21T06:11:43.549989+0000","last_clean":"2024-09-21T06:11:43.549989+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:43.549989+0000","last_undegraded":"2024-09-21T06:11:43.549989+0000","last_fullsized":"2024-09-21T06:11:43.549989+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549730+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:43.549730+0000","last_peered":"2024-09-21T06:11:43.549730+0000","last_clean":"2024-09-21T06:11:43.549730+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:43.549730+0000","last_undegraded":"2024-09-21T06:11:43.549730+0000","last_fullsized":"2024-09-21T06:11:43.549730+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":373,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549467+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:43.549467+0000","last_peered":"2024-09-21T06:11:43.549467+0000","last_clean":"2024-09-21T06:11:43.549467+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:43.549467+0000","last_undegraded":"2024-09-21T06:11:43.549467+0000","last_fullsized":"2024-09-21T06:11:43.549467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178487,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1378,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193933,"statfs":{"total":200000000,"available":198588279,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1386,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198580004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194508,"statfs":{"total":200000000,"available":199177035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:45.856 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-09-21T06:11:45.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 147, 'state': 'peering', 'last_fresh': '2024-09-21T06:11:39.059335+0000', 'last_change': '2024-09-21T06:11:43.549661+0000', 'last_active': '2024-09-21T06:11:43.549661+0000', 'last_peered': '2024-09-21T06:11:39.059335+0000', 'last_clean': '2024-09-21T06:11:39.059335+0000', 'last_became_active': '2024-09-21T06:11:35.369656+0000', 'last_became_peered': '2024-09-21T06:11:35.369656+0000', 'last_unstale': '2024-09-21T06:11:39.059335+0000', 'last_undegraded': '2024-09-21T06:11:39.059335+0000', 'last_fullsized': '2024-09-21T06:11:39.059335+0000', 'mapping_epoch': 148, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 145, 'last_epoch_clean': 146, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:11:34.482163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:11:34.482163+0000', 'last_clean_scrub_stamp': '2024-09-21T06:11:34.482163+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:11:45.856 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T06:11:46.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 -- 172.21.15.118:0/2985008652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580b3ae0 msgr2=0x7f0f580d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 --2- 172.21.15.118:0/2985008652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580b3ae0 0x7f0f580d0610 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0f580a2a50 tx=0x7f0f4802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 -- 172.21.15.118:0/2985008652 shutdown_connections 2024-09-21T06:11:46.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 --2- 172.21.15.118:0/2985008652 >> v2:172.21.15.149:3300/0 conn(0x7f0f580d1240 0x7f0f580d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 --2- 172.21.15.118:0/2985008652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580b3ae0 0x7f0f580d0610 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 -- 172.21.15.118:0/2985008652 >> 172.21.15.118:0/2985008652 conn(0x7f0f580d4bc0 msgr2=0x7f0f580d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:46.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 -- 172.21.15.118:0/2985008652 shutdown_connections 2024-09-21T06:11:46.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.107+0000 7f0f57e00640 1 -- 172.21.15.118:0/2985008652 wait complete. 2024-09-21T06:11:46.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.109+0000 7f0f57e00640 1 Processor -- start 2024-09-21T06:11:46.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.109+0000 7f0f57e00640 1 -- start start 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f580b3ae0 0x7f0f580c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f580d1240 0x7f0f580cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580d1b90 0x7f0f580ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0f580b4b80 con 0x7f0f580d1b90 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f580b4a00 con 0x7f0f580b3ae0 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0f580b4d00 con 0x7f0f580d1240 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580d1b90 0x7f0f580ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580d1b90 0x7f0f580ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41934/0 (socket says 172.21.15.118:41934) 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 -- 172.21.15.118:0/1965681948 learned_addr learned my addr 172.21.15.118:0/1965681948 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:46.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f4fe00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f580d1240 0x7f0f580cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f56a00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f580b3ae0 0x7f0f580c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 -- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f580d1240 msgr2=0x7f0f580cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f580d1240 0x7f0f580cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 -- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f580b3ae0 msgr2=0x7f0f580c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f580b3ae0 0x7f0f580c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.111+0000 7f0f57400640 1 -- 172.21.15.118:0/1965681948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f581f9690 con 0x7f0f580d1b90 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.112+0000 7f0f57400640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580d1b90 0x7f0f580ca750 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c700 tx=0x7f0f5000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.112+0000 7f0f4f400640 1 -- 172.21.15.118:0/1965681948 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50003b70 con 0x7f0f580d1b90 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.112+0000 7f0f4f400640 1 -- 172.21.15.118:0/1965681948 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f50003d10 con 0x7f0f580d1b90 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.112+0000 7f0f4f400640 1 -- 172.21.15.118:0/1965681948 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000aab0 con 0x7f0f580d1b90 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.112+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f581f9970 con 0x7f0f580d1b90 2024-09-21T06:11:46.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.112+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f581f9f30 con 0x7f0f580d1b90 2024-09-21T06:11:46.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.113+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f580d0610 con 0x7f0f580d1b90 2024-09-21T06:11:46.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.114+0000 7f0f4f400640 1 -- 172.21.15.118:0/1965681948 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f5000ac50 con 0x7f0f580d1b90 2024-09-21T06:11:46.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.116+0000 7f0f4f400640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0f34078b90 0x7f0f3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.116+0000 7f0f4f400640 1 -- 172.21.15.118:0/1965681948 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f0f5009aa10 con 0x7f0f580d1b90 2024-09-21T06:11:46.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.116+0000 7f0f56a00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0f34078b90 0x7f0f3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.117+0000 7f0f56a00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0f34078b90 0x7f0f3407b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f48034000 tx=0x7f0f48004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:46.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.121+0000 7f0f4f400640 1 -- 172.21.15.118:0/1965681948 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0f500627b0 con 0x7f0f580d1b90 2024-09-21T06:11:46.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.379+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0f581f9420 con 0x7f0f580d1b90 2024-09-21T06:11:46.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.380+0000 7f0f4f400640 1 -- 172.21.15.118:0/1965681948 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1289 (secure 0 0 0) 0x7f0f500671e0 con 0x7f0f580d1b90 2024-09-21T06:11:46.382 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:46.382 INFO:teuthology.orchestra.run.smithi118.stdout:{"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":491,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":149,"num_osds":8,"num_up_osds":8,"osd_up_since":1726898623,"num_in_osds":8,"osd_in_since":1726898620,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":7762405,"bytes_avail":1592237595,"bytes_total":1600000000,"inactive_pgs_ratio":0.010309278033673763,"write_bytes_sec":1791,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":7377}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-21T06:11:30.577592+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T06:11:46.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0f34078b90 msgr2=0x7f0f3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0f34078b90 0x7f0f3407b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f48034000 tx=0x7f0f48004730 comp rx=0 tx=0).stop 2024-09-21T06:11:46.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580d1b90 msgr2=0x7f0f580ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580d1b90 0x7f0f580ca750 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c700 tx=0x7f0f5000cbc0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 shutdown_connections 2024-09-21T06:11:46.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f580d1b90 0x7f0f580ca750 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0f34078b90 0x7f0f3407b0a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f580d1240 0x7f0f580cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 --2- 172.21.15.118:0/1965681948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f580b3ae0 0x7f0f580c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.382+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 >> 172.21.15.118:0/1965681948 conn(0x7f0f580d4bc0 msgr2=0x7f0f581e6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:46.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.383+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 shutdown_connections 2024-09-21T06:11:46.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.383+0000 7f0f57e00640 1 -- 172.21.15.118:0/1965681948 wait complete. 2024-09-21T06:11:46.411 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T06:11:46.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:46.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 -- 172.21.15.118:0/2160181470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fef0 msgr2=0x7f304c142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 --2- 172.21.15.118:0/2160181470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fef0 0x7f304c142c70 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3044005fd0 tx=0x7f304402aa00 comp rx=0 tx=0).stop 2024-09-21T06:11:46.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 -- 172.21.15.118:0/2160181470 shutdown_connections 2024-09-21T06:11:46.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 --2- 172.21.15.118:0/2160181470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fef0 0x7f304c142c70 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 --2- 172.21.15.118:0/2160181470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f304c0d1590 0x7f304c142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 -- 172.21.15.118:0/2160181470 >> 172.21.15.118:0/2160181470 conn(0x7f304c06d110 msgr2=0x7f304c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:46.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 -- 172.21.15.118:0/2160181470 shutdown_connections 2024-09-21T06:11:46.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.628+0000 7f3052c00640 1 -- 172.21.15.118:0/2160181470 wait complete. 2024-09-21T06:11:46.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.631+0000 7f3052c00640 1 Processor -- start 2024-09-21T06:11:46.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.631+0000 7f3052c00640 1 -- start start 2024-09-21T06:11:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.632+0000 7f3052c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fae0 0x7f304c13e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.632+0000 7f3052c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f304c13fef0 0x7f304c0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.632+0000 7f3052c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c13b500 0x7f304c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.632+0000 7f3052c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f304c0cfb10 con 0x7f304c13fae0 2024-09-21T06:11:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.632+0000 7f3052c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f304c0cf990 con 0x7f304c13b500 2024-09-21T06:11:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.632+0000 7f3052c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f304c0cfc90 con 0x7f304c13fef0 2024-09-21T06:11:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.632+0000 7f304be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fae0 0x7f304c13e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fae0 0x7f304c13e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41946/0 (socket says 172.21.15.118:41946) 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 -- 172.21.15.118:0/274619908 learned_addr learned my addr 172.21.15.118:0/274619908 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f3043400640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f304c13fef0 0x7f304c0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f3050c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c13b500 0x7f304c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 -- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f304c13fef0 msgr2=0x7f304c0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f304c13fef0 0x7f304c0b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 -- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c13b500 msgr2=0x7f304c0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c13b500 0x7f304c0b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 -- 172.21.15.118:0/274619908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304c1f6d60 con 0x7f304c13fae0 2024-09-21T06:11:46.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f304be00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fae0 0x7f304c13e990 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c3a0 tx=0x7f303c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:46.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.633+0000 7f3048c00640 1 -- 172.21.15.118:0/274619908 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c017070 con 0x7f304c13fae0 2024-09-21T06:11:46.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.634+0000 7f3048c00640 1 -- 172.21.15.118:0/274619908 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f303c0053c0 con 0x7f304c13fae0 2024-09-21T06:11:46.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.634+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f304c1f7020 con 0x7f304c13fae0 2024-09-21T06:11:46.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.634+0000 7f3048c00640 1 -- 172.21.15.118:0/274619908 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c003850 con 0x7f304c13fae0 2024-09-21T06:11:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.634+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f304c1f75e0 con 0x7f304c13fae0 2024-09-21T06:11:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.635+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f304c0d0140 con 0x7f304c13fae0 2024-09-21T06:11:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.636+0000 7f3048c00640 1 -- 172.21.15.118:0/274619908 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f303c01a070 con 0x7f304c13fae0 2024-09-21T06:11:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.637+0000 7f3048c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3028078b90 0x7f302807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.637+0000 7f3048c00640 1 -- 172.21.15.118:0/274619908 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f303c09a110 con 0x7f304c13fae0 2024-09-21T06:11:46.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.637+0000 7f3043400640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3028078b90 0x7f302807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:46.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.638+0000 7f3043400640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3028078b90 0x7f302807b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f304c15ca20 tx=0x7f3034005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:46.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.641+0000 7f3048c00640 1 -- 172.21.15.118:0/274619908 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f303c061e20 con 0x7f304c13fae0 2024-09-21T06:11:46.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.824+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f304c15b8c0 con 0x7f3028078b90 2024-09-21T06:11:46.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.830+0000 7f3048c00640 1 -- 172.21.15.118:0/274619908 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247943 (secure 0 0 0) 0x7f304c15b8c0 con 0x7f3028078b90 2024-09-21T06:11:46.835 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:46.836 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:46.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3028078b90 msgr2=0x7f302807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3028078b90 0x7f302807b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f304c15ca20 tx=0x7f3034005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fae0 msgr2=0x7f304c13e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fae0 0x7f304c13e990 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c3a0 tx=0x7f303c00c860 comp rx=0 tx=0).stop 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 shutdown_connections 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f304c13b500 0x7f304c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3028078b90 0x7f302807b0a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f304c13fef0 0x7f304c0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 --2- 172.21.15.118:0/274619908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c13fae0 0x7f304c13e990 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 >> 172.21.15.118:0/274619908 conn(0x7f304c06d110 msgr2=0x7f304c1427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 shutdown_connections 2024-09-21T06:11:46.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:46.834+0000 7f3052c00640 1 -- 172.21.15.118:0/274619908 wait complete. 2024-09-21T06:11:46.859 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-09-21T06:11:46.581602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554907,"statfs":{"total":1600000000,"available":1592225545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002162"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551281+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:43.551281+0000","last_peered":"2024-09-21T06:11:43.551281+0000","last_clean":"2024-09-21T06:11:43.551281+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:43.551281+0000","last_undegraded":"2024-09-21T06:11:43.551281+0000","last_fullsized":"2024-09-21T06:11:43.551281+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595096+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:36.595096+0000","last_peered":"2024-09-21T06:11:36.595096+0000","last_clean":"2024-09-21T06:11:36.595096+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:36.595096+0000","last_undegraded":"2024-09-21T06:11:36.595096+0000","last_fullsized":"2024-09-21T06:11:36.595096+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595198+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:36.595198+0000","last_peered":"2024-09-21T06:11:36.595198+0000","last_clean":"2024-09-21T06:11:36.595198+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:36.595198+0000","last_undegraded":"2024-09-21T06:11:36.595198+0000","last_fullsized":"2024-09-21T06:11:36.595198+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.548994+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:43.548994+0000","last_peered":"2024-09-21T06:11:43.548994+0000","last_clean":"2024-09-21T06:11:43.548994+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:43.548994+0000","last_undegraded":"2024-09-21T06:11:43.548994+0000","last_fullsized":"2024-09-21T06:11:43.548994+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549524+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:43.549524+0000","last_peered":"2024-09-21T06:11:43.549524+0000","last_clean":"2024-09-21T06:11:43.549524+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:43.549524+0000","last_undegraded":"2024-09-21T06:11:43.549524+0000","last_fullsized":"2024-09-21T06:11:43.549524+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595655+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:36.595655+0000","last_peered":"2024-09-21T06:11:36.595655+0000","last_clean":"2024-09-21T06:11:36.595655+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:36.595655+0000","last_undegraded":"2024-09-21T06:11:36.595655+0000","last_fullsized":"2024-09-21T06:11:36.595655+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596113+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:36.596113+0000","last_peered":"2024-09-21T06:11:36.596113+0000","last_clean":"2024-09-21T06:11:36.596113+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:36.596113+0000","last_undegraded":"2024-09-21T06:11:36.596113+0000","last_fullsized":"2024-09-21T06:11:36.596113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595448+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:36.595448+0000","last_peered":"2024-09-21T06:11:36.595448+0000","last_clean":"2024-09-21T06:11:36.595448+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:36.595448+0000","last_undegraded":"2024-09-21T06:11:36.595448+0000","last_fullsized":"2024-09-21T06:11:36.595448+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594979+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:36.594979+0000","last_peered":"2024-09-21T06:11:36.594979+0000","last_clean":"2024-09-21T06:11:36.594979+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:36.594979+0000","last_undegraded":"2024-09-21T06:11:36.594979+0000","last_fullsized":"2024-09-21T06:11:36.594979+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595384+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:36.595384+0000","last_peered":"2024-09-21T06:11:36.595384+0000","last_clean":"2024-09-21T06:11:36.595384+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:36.595384+0000","last_undegraded":"2024-09-21T06:11:36.595384+0000","last_fullsized":"2024-09-21T06:11:36.595384+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630050+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:44.630050+0000","last_peered":"2024-09-21T06:11:44.630050+0000","last_clean":"2024-09-21T06:11:44.630050+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:44.630050+0000","last_undegraded":"2024-09-21T06:11:44.630050+0000","last_fullsized":"2024-09-21T06:11:44.630050+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595876+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:36.595876+0000","last_peered":"2024-09-21T06:11:36.595876+0000","last_clean":"2024-09-21T06:11:36.595876+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:36.595876+0000","last_undegraded":"2024-09-21T06:11:36.595876+0000","last_fullsized":"2024-09-21T06:11:36.595876+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549046+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:43.549046+0000","last_peered":"2024-09-21T06:11:43.549046+0000","last_clean":"2024-09-21T06:11:43.549046+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:43.549046+0000","last_undegraded":"2024-09-21T06:11:43.549046+0000","last_fullsized":"2024-09-21T06:11:43.549046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594534+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:36.594534+0000","last_peered":"2024-09-21T06:11:36.594534+0000","last_clean":"2024-09-21T06:11:36.594534+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:36.594534+0000","last_undegraded":"2024-09-21T06:11:36.594534+0000","last_fullsized":"2024-09-21T06:11:36.594534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549824+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:43.549824+0000","last_peered":"2024-09-21T06:11:43.549824+0000","last_clean":"2024-09-21T06:11:43.549824+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:43.549824+0000","last_undegraded":"2024-09-21T06:11:43.549824+0000","last_fullsized":"2024-09-21T06:11:43.549824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631444+0000","last_change":"2024-09-21T06:11:44.631330+0000","last_active":"2024-09-21T06:11:44.631444+0000","last_peered":"2024-09-21T06:11:44.631444+0000","last_clean":"2024-09-21T06:11:44.631444+0000","last_became_active":"2024-09-21T06:11:44.631036+0000","last_became_peered":"2024-09-21T06:11:44.631036+0000","last_unstale":"2024-09-21T06:11:44.631444+0000","last_undegraded":"2024-09-21T06:11:44.631444+0000","last_fullsized":"2024-09-21T06:11:44.631444+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:14.653905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596608+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:36.596608+0000","last_peered":"2024-09-21T06:11:36.596608+0000","last_clean":"2024-09-21T06:11:36.596608+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:36.596608+0000","last_undegraded":"2024-09-21T06:11:36.596608+0000","last_fullsized":"2024-09-21T06:11:36.596608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550178+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:44.550178+0000","last_peered":"2024-09-21T06:11:44.550178+0000","last_clean":"2024-09-21T06:11:44.550178+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:44.550178+0000","last_undegraded":"2024-09-21T06:11:44.550178+0000","last_fullsized":"2024-09-21T06:11:44.550178+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628895+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:44.628895+0000","last_peered":"2024-09-21T06:11:44.628895+0000","last_clean":"2024-09-21T06:11:44.628895+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:44.628895+0000","last_undegraded":"2024-09-21T06:11:44.628895+0000","last_fullsized":"2024-09-21T06:11:44.628895+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550152+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:44.550152+0000","last_peered":"2024-09-21T06:11:44.550152+0000","last_clean":"2024-09-21T06:11:44.550152+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:44.550152+0000","last_undegraded":"2024-09-21T06:11:44.550152+0000","last_fullsized":"2024-09-21T06:11:44.550152+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550076+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:43.550076+0000","last_peered":"2024-09-21T06:11:43.550076+0000","last_clean":"2024-09-21T06:11:43.550076+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:43.550076+0000","last_undegraded":"2024-09-21T06:11:43.550076+0000","last_fullsized":"2024-09-21T06:11:43.550076+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629110+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:44.629110+0000","last_peered":"2024-09-21T06:11:44.629110+0000","last_clean":"2024-09-21T06:11:44.629110+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:44.629110+0000","last_undegraded":"2024-09-21T06:11:44.629110+0000","last_fullsized":"2024-09-21T06:11:44.629110+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596023+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:36.596023+0000","last_peered":"2024-09-21T06:11:36.596023+0000","last_clean":"2024-09-21T06:11:36.596023+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:36.596023+0000","last_undegraded":"2024-09-21T06:11:36.596023+0000","last_fullsized":"2024-09-21T06:11:36.596023+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595609+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:36.595609+0000","last_peered":"2024-09-21T06:11:36.595609+0000","last_clean":"2024-09-21T06:11:36.595609+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:36.595609+0000","last_undegraded":"2024-09-21T06:11:36.595609+0000","last_fullsized":"2024-09-21T06:11:36.595609+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550695+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:44.550695+0000","last_peered":"2024-09-21T06:11:44.550695+0000","last_clean":"2024-09-21T06:11:44.550695+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:44.550695+0000","last_undegraded":"2024-09-21T06:11:44.550695+0000","last_fullsized":"2024-09-21T06:11:44.550695+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549144+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:43.549144+0000","last_peered":"2024-09-21T06:11:43.549144+0000","last_clean":"2024-09-21T06:11:43.549144+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:43.549144+0000","last_undegraded":"2024-09-21T06:11:43.549144+0000","last_fullsized":"2024-09-21T06:11:43.549144+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596145+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:36.596145+0000","last_peered":"2024-09-21T06:11:36.596145+0000","last_clean":"2024-09-21T06:11:36.596145+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:36.596145+0000","last_undegraded":"2024-09-21T06:11:36.596145+0000","last_fullsized":"2024-09-21T06:11:36.596145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549182+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:43.549182+0000","last_peered":"2024-09-21T06:11:43.549182+0000","last_clean":"2024-09-21T06:11:43.549182+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:43.549182+0000","last_undegraded":"2024-09-21T06:11:43.549182+0000","last_fullsized":"2024-09-21T06:11:43.549182+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549944+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:43.549944+0000","last_peered":"2024-09-21T06:11:43.549944+0000","last_clean":"2024-09-21T06:11:43.549944+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:43.549944+0000","last_undegraded":"2024-09-21T06:11:43.549944+0000","last_fullsized":"2024-09-21T06:11:43.549944+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"peering","last_fresh":"2024-09-21T06:11:39.059335+0000","last_change":"2024-09-21T06:11:43.549661+0000","last_active":"2024-09-21T06:11:43.549661+0000","last_peered":"2024-09-21T06:11:39.059335+0000","last_clean":"2024-09-21T06:11:39.059335+0000","last_became_active":"2024-09-21T06:11:35.369656+0000","last_became_peered":"2024-09-21T06:11:35.369656+0000","last_unstale":"2024-09-21T06:11:39.059335+0000","last_undegraded":"2024-09-21T06:11:39.059335+0000","last_fullsized":"2024-09-21T06:11:39.059335+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596364+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:36.596364+0000","last_peered":"2024-09-21T06:11:36.596364+0000","last_clean":"2024-09-21T06:11:36.596364+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:36.596364+0000","last_undegraded":"2024-09-21T06:11:36.596364+0000","last_fullsized":"2024-09-21T06:11:36.596364+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550085+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:44.550085+0000","last_peered":"2024-09-21T06:11:44.550085+0000","last_clean":"2024-09-21T06:11:44.550085+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:44.550085+0000","last_undegraded":"2024-09-21T06:11:44.550085+0000","last_fullsized":"2024-09-21T06:11:44.550085+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":21,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549248+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:43.549248+0000","last_peered":"2024-09-21T06:11:43.549248+0000","last_clean":"2024-09-21T06:11:43.549248+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:43.549248+0000","last_undegraded":"2024-09-21T06:11:43.549248+0000","last_fullsized":"2024-09-21T06:11:43.549248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595514+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:36.595514+0000","last_peered":"2024-09-21T06:11:36.595514+0000","last_clean":"2024-09-21T06:11:36.595514+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:36.595514+0000","last_undegraded":"2024-09-21T06:11:36.595514+0000","last_fullsized":"2024-09-21T06:11:36.595514+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549868+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:43.549868+0000","last_peered":"2024-09-21T06:11:43.549868+0000","last_clean":"2024-09-21T06:11:43.549868+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:43.549868+0000","last_undegraded":"2024-09-21T06:11:43.549868+0000","last_fullsized":"2024-09-21T06:11:43.549868+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629527+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:44.629527+0000","last_peered":"2024-09-21T06:11:44.629527+0000","last_clean":"2024-09-21T06:11:44.629527+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:44.629527+0000","last_undegraded":"2024-09-21T06:11:44.629527+0000","last_fullsized":"2024-09-21T06:11:44.629527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549628+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:43.549628+0000","last_peered":"2024-09-21T06:11:43.549628+0000","last_clean":"2024-09-21T06:11:43.549628+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:43.549628+0000","last_undegraded":"2024-09-21T06:11:43.549628+0000","last_fullsized":"2024-09-21T06:11:43.549628+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595742+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:36.595742+0000","last_peered":"2024-09-21T06:11:36.595742+0000","last_clean":"2024-09-21T06:11:36.595742+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:36.595742+0000","last_undegraded":"2024-09-21T06:11:36.595742+0000","last_fullsized":"2024-09-21T06:11:36.595742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550350+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:44.550350+0000","last_peered":"2024-09-21T06:11:44.550350+0000","last_clean":"2024-09-21T06:11:44.550350+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:44.550350+0000","last_undegraded":"2024-09-21T06:11:44.550350+0000","last_fullsized":"2024-09-21T06:11:44.550350+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595169+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:36.595169+0000","last_peered":"2024-09-21T06:11:36.595169+0000","last_clean":"2024-09-21T06:11:36.595169+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:36.595169+0000","last_undegraded":"2024-09-21T06:11:36.595169+0000","last_fullsized":"2024-09-21T06:11:36.595169+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596842+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:36.596842+0000","last_peered":"2024-09-21T06:11:36.596842+0000","last_clean":"2024-09-21T06:11:36.596842+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:36.596842+0000","last_undegraded":"2024-09-21T06:11:36.596842+0000","last_fullsized":"2024-09-21T06:11:36.596842+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550583+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:44.550583+0000","last_peered":"2024-09-21T06:11:44.550583+0000","last_clean":"2024-09-21T06:11:44.550583+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:44.550583+0000","last_undegraded":"2024-09-21T06:11:44.550583+0000","last_fullsized":"2024-09-21T06:11:44.550583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596665+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:36.596665+0000","last_peered":"2024-09-21T06:11:36.596665+0000","last_clean":"2024-09-21T06:11:36.596665+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:36.596665+0000","last_undegraded":"2024-09-21T06:11:36.596665+0000","last_fullsized":"2024-09-21T06:11:36.596665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595121+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:36.595121+0000","last_peered":"2024-09-21T06:11:36.595121+0000","last_clean":"2024-09-21T06:11:36.595121+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:36.595121+0000","last_undegraded":"2024-09-21T06:11:36.595121+0000","last_fullsized":"2024-09-21T06:11:36.595121+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594755+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:36.594755+0000","last_peered":"2024-09-21T06:11:36.594755+0000","last_clean":"2024-09-21T06:11:36.594755+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:36.594755+0000","last_undegraded":"2024-09-21T06:11:36.594755+0000","last_fullsized":"2024-09-21T06:11:36.594755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595886+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:36.595886+0000","last_peered":"2024-09-21T06:11:36.595886+0000","last_clean":"2024-09-21T06:11:36.595886+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:36.595886+0000","last_undegraded":"2024-09-21T06:11:36.595886+0000","last_fullsized":"2024-09-21T06:11:36.595886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549366+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:43.549366+0000","last_peered":"2024-09-21T06:11:43.549366+0000","last_clean":"2024-09-21T06:11:43.549366+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:43.549366+0000","last_undegraded":"2024-09-21T06:11:43.549366+0000","last_fullsized":"2024-09-21T06:11:43.549366+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597135+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:36.597135+0000","last_peered":"2024-09-21T06:11:36.597135+0000","last_clean":"2024-09-21T06:11:36.597135+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:36.597135+0000","last_undegraded":"2024-09-21T06:11:36.597135+0000","last_fullsized":"2024-09-21T06:11:36.597135+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596772+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:36.596772+0000","last_peered":"2024-09-21T06:11:36.596772+0000","last_clean":"2024-09-21T06:11:36.596772+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:36.596772+0000","last_undegraded":"2024-09-21T06:11:36.596772+0000","last_fullsized":"2024-09-21T06:11:36.596772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550286+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:44.550286+0000","last_peered":"2024-09-21T06:11:44.550286+0000","last_clean":"2024-09-21T06:11:44.550286+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:44.550286+0000","last_undegraded":"2024-09-21T06:11:44.550286+0000","last_fullsized":"2024-09-21T06:11:44.550286+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549243+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:43.549243+0000","last_peered":"2024-09-21T06:11:43.549243+0000","last_clean":"2024-09-21T06:11:43.549243+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:43.549243+0000","last_undegraded":"2024-09-21T06:11:43.549243+0000","last_fullsized":"2024-09-21T06:11:43.549243+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596236+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:36.596236+0000","last_peered":"2024-09-21T06:11:36.596236+0000","last_clean":"2024-09-21T06:11:36.596236+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:36.596236+0000","last_undegraded":"2024-09-21T06:11:36.596236+0000","last_fullsized":"2024-09-21T06:11:36.596236+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549112+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:43.549112+0000","last_peered":"2024-09-21T06:11:43.549112+0000","last_clean":"2024-09-21T06:11:43.549112+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:43.549112+0000","last_undegraded":"2024-09-21T06:11:43.549112+0000","last_fullsized":"2024-09-21T06:11:43.549112+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595218+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:36.595218+0000","last_peered":"2024-09-21T06:11:36.595218+0000","last_clean":"2024-09-21T06:11:36.595218+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:36.595218+0000","last_undegraded":"2024-09-21T06:11:36.595218+0000","last_fullsized":"2024-09-21T06:11:36.595218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550127+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:43.550127+0000","last_peered":"2024-09-21T06:11:43.550127+0000","last_clean":"2024-09-21T06:11:43.550127+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:43.550127+0000","last_undegraded":"2024-09-21T06:11:43.550127+0000","last_fullsized":"2024-09-21T06:11:43.550127+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551486+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:43.551486+0000","last_peered":"2024-09-21T06:11:43.551486+0000","last_clean":"2024-09-21T06:11:43.551486+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:43.551486+0000","last_undegraded":"2024-09-21T06:11:43.551486+0000","last_fullsized":"2024-09-21T06:11:43.551486+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594658+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:36.594658+0000","last_peered":"2024-09-21T06:11:36.594658+0000","last_clean":"2024-09-21T06:11:36.594658+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:36.594658+0000","last_undegraded":"2024-09-21T06:11:36.594658+0000","last_fullsized":"2024-09-21T06:11:36.594658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595287+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:36.595287+0000","last_peered":"2024-09-21T06:11:36.595287+0000","last_clean":"2024-09-21T06:11:36.595287+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:36.595287+0000","last_undegraded":"2024-09-21T06:11:36.595287+0000","last_fullsized":"2024-09-21T06:11:36.595287+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596103+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:36.596103+0000","last_peered":"2024-09-21T06:11:36.596103+0000","last_clean":"2024-09-21T06:11:36.596103+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:36.596103+0000","last_undegraded":"2024-09-21T06:11:36.596103+0000","last_fullsized":"2024-09-21T06:11:36.596103+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596177+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:36.596177+0000","last_peered":"2024-09-21T06:11:36.596177+0000","last_clean":"2024-09-21T06:11:36.596177+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:36.596177+0000","last_undegraded":"2024-09-21T06:11:36.596177+0000","last_fullsized":"2024-09-21T06:11:36.596177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596919+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:36.596919+0000","last_peered":"2024-09-21T06:11:36.596919+0000","last_clean":"2024-09-21T06:11:36.596919+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:36.596919+0000","last_undegraded":"2024-09-21T06:11:36.596919+0000","last_fullsized":"2024-09-21T06:11:36.596919+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595651+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:36.595651+0000","last_peered":"2024-09-21T06:11:36.595651+0000","last_clean":"2024-09-21T06:11:36.595651+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:36.595651+0000","last_undegraded":"2024-09-21T06:11:36.595651+0000","last_fullsized":"2024-09-21T06:11:36.595651+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595428+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:36.595428+0000","last_peered":"2024-09-21T06:11:36.595428+0000","last_clean":"2024-09-21T06:11:36.595428+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:36.595428+0000","last_undegraded":"2024-09-21T06:11:36.595428+0000","last_fullsized":"2024-09-21T06:11:36.595428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629660+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:44.629660+0000","last_peered":"2024-09-21T06:11:44.629660+0000","last_clean":"2024-09-21T06:11:44.629660+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:44.629660+0000","last_undegraded":"2024-09-21T06:11:44.629660+0000","last_fullsized":"2024-09-21T06:11:44.629660+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550034+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:44.550034+0000","last_peered":"2024-09-21T06:11:44.550034+0000","last_clean":"2024-09-21T06:11:44.550034+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:44.550034+0000","last_undegraded":"2024-09-21T06:11:44.550034+0000","last_fullsized":"2024-09-21T06:11:44.550034+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595830+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:36.595830+0000","last_peered":"2024-09-21T06:11:36.595830+0000","last_clean":"2024-09-21T06:11:36.595830+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:36.595830+0000","last_undegraded":"2024-09-21T06:11:36.595830+0000","last_fullsized":"2024-09-21T06:11:36.595830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595890+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:36.595890+0000","last_peered":"2024-09-21T06:11:36.595890+0000","last_clean":"2024-09-21T06:11:36.595890+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:36.595890+0000","last_undegraded":"2024-09-21T06:11:36.595890+0000","last_fullsized":"2024-09-21T06:11:36.595890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596647+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:36.596647+0000","last_peered":"2024-09-21T06:11:36.596647+0000","last_clean":"2024-09-21T06:11:36.596647+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:36.596647+0000","last_undegraded":"2024-09-21T06:11:36.596647+0000","last_fullsized":"2024-09-21T06:11:36.596647+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549290+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:43.549290+0000","last_peered":"2024-09-21T06:11:43.549290+0000","last_clean":"2024-09-21T06:11:43.549290+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:43.549290+0000","last_undegraded":"2024-09-21T06:11:43.549290+0000","last_fullsized":"2024-09-21T06:11:43.549290+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596392+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:36.596392+0000","last_peered":"2024-09-21T06:11:36.596392+0000","last_clean":"2024-09-21T06:11:36.596392+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:36.596392+0000","last_undegraded":"2024-09-21T06:11:36.596392+0000","last_fullsized":"2024-09-21T06:11:36.596392+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595330+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:36.595330+0000","last_peered":"2024-09-21T06:11:36.595330+0000","last_clean":"2024-09-21T06:11:36.595330+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:36.595330+0000","last_undegraded":"2024-09-21T06:11:36.595330+0000","last_fullsized":"2024-09-21T06:11:36.595330+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550387+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:44.550387+0000","last_peered":"2024-09-21T06:11:44.550387+0000","last_clean":"2024-09-21T06:11:44.550387+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:44.550387+0000","last_undegraded":"2024-09-21T06:11:44.550387+0000","last_fullsized":"2024-09-21T06:11:44.550387+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549387+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:43.549387+0000","last_peered":"2024-09-21T06:11:43.549387+0000","last_clean":"2024-09-21T06:11:43.549387+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:43.549387+0000","last_undegraded":"2024-09-21T06:11:43.549387+0000","last_fullsized":"2024-09-21T06:11:43.549387+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630352+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:44.630352+0000","last_peered":"2024-09-21T06:11:44.630352+0000","last_clean":"2024-09-21T06:11:44.630352+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:44.630352+0000","last_undegraded":"2024-09-21T06:11:44.630352+0000","last_fullsized":"2024-09-21T06:11:44.630352+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595597+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:36.595597+0000","last_peered":"2024-09-21T06:11:36.595597+0000","last_clean":"2024-09-21T06:11:36.595597+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:36.595597+0000","last_undegraded":"2024-09-21T06:11:36.595597+0000","last_fullsized":"2024-09-21T06:11:36.595597+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549607+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:43.549607+0000","last_peered":"2024-09-21T06:11:43.549607+0000","last_clean":"2024-09-21T06:11:43.549607+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:43.549607+0000","last_undegraded":"2024-09-21T06:11:43.549607+0000","last_fullsized":"2024-09-21T06:11:43.549607+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549488+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:43.549488+0000","last_peered":"2024-09-21T06:11:43.549488+0000","last_clean":"2024-09-21T06:11:43.549488+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:43.549488+0000","last_undegraded":"2024-09-21T06:11:43.549488+0000","last_fullsized":"2024-09-21T06:11:43.549488+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":18,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549416+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:43.549416+0000","last_peered":"2024-09-21T06:11:43.549416+0000","last_clean":"2024-09-21T06:11:43.549416+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:43.549416+0000","last_undegraded":"2024-09-21T06:11:43.549416+0000","last_fullsized":"2024-09-21T06:11:43.549416+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595824+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:36.595824+0000","last_peered":"2024-09-21T06:11:36.595824+0000","last_clean":"2024-09-21T06:11:36.595824+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:36.595824+0000","last_undegraded":"2024-09-21T06:11:36.595824+0000","last_fullsized":"2024-09-21T06:11:36.595824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594822+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:36.594822+0000","last_peered":"2024-09-21T06:11:36.594822+0000","last_clean":"2024-09-21T06:11:36.594822+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:36.594822+0000","last_undegraded":"2024-09-21T06:11:36.594822+0000","last_fullsized":"2024-09-21T06:11:36.594822+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595038+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:36.595038+0000","last_peered":"2024-09-21T06:11:36.595038+0000","last_clean":"2024-09-21T06:11:36.595038+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:36.595038+0000","last_undegraded":"2024-09-21T06:11:36.595038+0000","last_fullsized":"2024-09-21T06:11:36.595038+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629788+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:44.629788+0000","last_peered":"2024-09-21T06:11:44.629788+0000","last_clean":"2024-09-21T06:11:44.629788+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:44.629788+0000","last_undegraded":"2024-09-21T06:11:44.629788+0000","last_fullsized":"2024-09-21T06:11:44.629788+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549087+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:43.549087+0000","last_peered":"2024-09-21T06:11:43.549087+0000","last_clean":"2024-09-21T06:11:43.549087+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:43.549087+0000","last_undegraded":"2024-09-21T06:11:43.549087+0000","last_fullsized":"2024-09-21T06:11:43.549087+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595928+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:36.595928+0000","last_peered":"2024-09-21T06:11:36.595928+0000","last_clean":"2024-09-21T06:11:36.595928+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:36.595928+0000","last_undegraded":"2024-09-21T06:11:36.595928+0000","last_fullsized":"2024-09-21T06:11:36.595928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597046+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:36.597046+0000","last_peered":"2024-09-21T06:11:36.597046+0000","last_clean":"2024-09-21T06:11:36.597046+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:36.597046+0000","last_undegraded":"2024-09-21T06:11:36.597046+0000","last_fullsized":"2024-09-21T06:11:36.597046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549297+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:43.549297+0000","last_peered":"2024-09-21T06:11:43.549297+0000","last_clean":"2024-09-21T06:11:43.549297+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:43.549297+0000","last_undegraded":"2024-09-21T06:11:43.549297+0000","last_fullsized":"2024-09-21T06:11:43.549297+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550719+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:44.550719+0000","last_peered":"2024-09-21T06:11:44.550719+0000","last_clean":"2024-09-21T06:11:44.550719+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:44.550719+0000","last_undegraded":"2024-09-21T06:11:44.550719+0000","last_fullsized":"2024-09-21T06:11:44.550719+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594875+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:36.594875+0000","last_peered":"2024-09-21T06:11:36.594875+0000","last_clean":"2024-09-21T06:11:36.594875+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:36.594875+0000","last_undegraded":"2024-09-21T06:11:36.594875+0000","last_fullsized":"2024-09-21T06:11:36.594875+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629188+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:44.629188+0000","last_peered":"2024-09-21T06:11:44.629188+0000","last_clean":"2024-09-21T06:11:44.629188+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:44.629188+0000","last_undegraded":"2024-09-21T06:11:44.629188+0000","last_fullsized":"2024-09-21T06:11:44.629188+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549989+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:43.549989+0000","last_peered":"2024-09-21T06:11:43.549989+0000","last_clean":"2024-09-21T06:11:43.549989+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:43.549989+0000","last_undegraded":"2024-09-21T06:11:43.549989+0000","last_fullsized":"2024-09-21T06:11:43.549989+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549730+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:43.549730+0000","last_peered":"2024-09-21T06:11:43.549730+0000","last_clean":"2024-09-21T06:11:43.549730+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:43.549730+0000","last_undegraded":"2024-09-21T06:11:43.549730+0000","last_fullsized":"2024-09-21T06:11:43.549730+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":373,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549467+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:43.549467+0000","last_peered":"2024-09-21T06:11:43.549467+0000","last_clean":"2024-09-21T06:11:43.549467+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:43.549467+0000","last_undegraded":"2024-09-21T06:11:43.549467+0000","last_fullsized":"2024-09-21T06:11:43.549467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194504,"statfs":{"total":200000000,"available":199172462,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1384,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193927,"statfs":{"total":200000000,"available":198582254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1386,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198580004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194508,"statfs":{"total":200000000,"available":199177035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:49.864 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:49.928 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:11:49.932 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:11:50.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 -- 172.21.15.118:0/6700701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d2ab0 msgr2=0x7f7d240d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 --2- 172.21.15.118:0/6700701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d2ab0 0x7f7d240d2ec0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7d2408da70 tx=0x7f7d0c02a560 comp rx=0 tx=0).stop 2024-09-21T06:11:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 -- 172.21.15.118:0/6700701 shutdown_connections 2024-09-21T06:11:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 --2- 172.21.15.118:0/6700701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d2ab0 0x7f7d240d2ec0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 --2- 172.21.15.118:0/6700701 >> v2:172.21.15.149:3300/0 conn(0x7f7d240b3be0 0x7f7d240ba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 -- 172.21.15.118:0/6700701 >> 172.21.15.118:0/6700701 conn(0x7f7d240d4bd0 msgr2=0x7f7d240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 -- 172.21.15.118:0/6700701 shutdown_connections 2024-09-21T06:11:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.097+0000 7f7d29600640 1 -- 172.21.15.118:0/6700701 wait complete. 2024-09-21T06:11:50.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.099+0000 7f7d29600640 1 Processor -- start 2024-09-21T06:11:50.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.099+0000 7f7d29600640 1 -- start start 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.100+0000 7f7d29600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d240b3be0 0x7f7d241e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d29600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d240d2ab0 0x7f7d241620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d29600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d3400 0x7f7d240d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d29600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d240b6d60 con 0x7f7d240d3400 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d29600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2406e900 con 0x7f7d240b3be0 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d29600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d240b6ee0 con 0x7f7d240d2ab0 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d3400 0x7f7d240d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d3400 0x7f7d240d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41962/0 (socket says 172.21.15.118:41962) 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 -- 172.21.15.118:0/1727447978 learned_addr learned my addr 172.21.15.118:0/1727447978 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d23e00640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d240b3be0 0x7f7d241e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d1b400640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d240d2ab0 0x7f7d241620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 -- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d240d2ab0 msgr2=0x7f7d241620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d240d2ab0 0x7f7d241620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 -- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d240b3be0 msgr2=0x7f7d241e9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d240b3be0 0x7f7d241e9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.101+0000 7f7d28c00640 1 -- 172.21.15.118:0/1727447978 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d24162620 con 0x7f7d240d3400 2024-09-21T06:11:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.102+0000 7f7d28c00640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d3400 0x7f7d240d1dc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c760 tx=0x7f7d1c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.102+0000 7f7d20c00640 1 -- 172.21.15.118:0/1727447978 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c003b70 con 0x7f7d240d3400 2024-09-21T06:11:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.102+0000 7f7d20c00640 1 -- 172.21.15.118:0/1727447978 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d1c003d10 con 0x7f7d240d3400 2024-09-21T06:11:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.102+0000 7f7d20c00640 1 -- 172.21.15.118:0/1727447978 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0052d0 con 0x7f7d240d3400 2024-09-21T06:11:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.102+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d240cbd40 con 0x7f7d240d3400 2024-09-21T06:11:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.102+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d240cc300 con 0x7f7d240d3400 2024-09-21T06:11:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.103+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d240b7400 con 0x7f7d240d3400 2024-09-21T06:11:50.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.104+0000 7f7d20c00640 1 -- 172.21.15.118:0/1727447978 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d1c005470 con 0x7f7d240d3400 2024-09-21T06:11:50.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.105+0000 7f7d20c00640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d00078b90 0x7f7d0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.105+0000 7f7d20c00640 1 -- 172.21.15.118:0/1727447978 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f7d1c09a9e0 con 0x7f7d240d3400 2024-09-21T06:11:50.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.105+0000 7f7d23e00640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d00078b90 0x7f7d0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.106+0000 7f7d23e00640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d00078b90 0x7f7d0007b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7d2406fae0 tx=0x7f7d14005f30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:50.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.109+0000 7f7d20c00640 1 -- 172.21.15.118:0/1727447978 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d1c062780 con 0x7f7d240d3400 2024-09-21T06:11:50.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.292+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d241eb740 con 0x7f7d00078b90 2024-09-21T06:11:50.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.298+0000 7f7d20c00640 1 -- 172.21.15.118:0/1727447978 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247934 (secure 0 0 0) 0x7f7d241eb740 con 0x7f7d00078b90 2024-09-21T06:11:50.303 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:50.304 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d00078b90 msgr2=0x7f7d0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d00078b90 0x7f7d0007b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7d2406fae0 tx=0x7f7d14005f30 comp rx=0 tx=0).stop 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d3400 msgr2=0x7f7d240d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d3400 0x7f7d240d1dc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c760 tx=0x7f7d1c00cb60 comp rx=0 tx=0).stop 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 shutdown_connections 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d240d3400 0x7f7d240d1dc0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d00078b90 0x7f7d0007b0a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d240d2ab0 0x7f7d241620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 --2- 172.21.15.118:0/1727447978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d240b3be0 0x7f7d241e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 >> 172.21.15.118:0/1727447978 conn(0x7f7d240d4bd0 msgr2=0x7f7d240b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:50.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 shutdown_connections 2024-09-21T06:11:50.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.302+0000 7f7d29600640 1 -- 172.21.15.118:0/1727447978 wait complete. 2024-09-21T06:11:50.327 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":386,"stamp":"2024-09-21T06:11:48.582092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554907,"statfs":{"total":1600000000,"available":1592225545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002103"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551281+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:43.551281+0000","last_peered":"2024-09-21T06:11:43.551281+0000","last_clean":"2024-09-21T06:11:43.551281+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:43.551281+0000","last_undegraded":"2024-09-21T06:11:43.551281+0000","last_fullsized":"2024-09-21T06:11:43.551281+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595096+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:36.595096+0000","last_peered":"2024-09-21T06:11:36.595096+0000","last_clean":"2024-09-21T06:11:36.595096+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:36.595096+0000","last_undegraded":"2024-09-21T06:11:36.595096+0000","last_fullsized":"2024-09-21T06:11:36.595096+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595198+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:36.595198+0000","last_peered":"2024-09-21T06:11:36.595198+0000","last_clean":"2024-09-21T06:11:36.595198+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:36.595198+0000","last_undegraded":"2024-09-21T06:11:36.595198+0000","last_fullsized":"2024-09-21T06:11:36.595198+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.548994+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:43.548994+0000","last_peered":"2024-09-21T06:11:43.548994+0000","last_clean":"2024-09-21T06:11:43.548994+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:43.548994+0000","last_undegraded":"2024-09-21T06:11:43.548994+0000","last_fullsized":"2024-09-21T06:11:43.548994+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549524+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:43.549524+0000","last_peered":"2024-09-21T06:11:43.549524+0000","last_clean":"2024-09-21T06:11:43.549524+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:43.549524+0000","last_undegraded":"2024-09-21T06:11:43.549524+0000","last_fullsized":"2024-09-21T06:11:43.549524+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595655+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:36.595655+0000","last_peered":"2024-09-21T06:11:36.595655+0000","last_clean":"2024-09-21T06:11:36.595655+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:36.595655+0000","last_undegraded":"2024-09-21T06:11:36.595655+0000","last_fullsized":"2024-09-21T06:11:36.595655+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596113+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:36.596113+0000","last_peered":"2024-09-21T06:11:36.596113+0000","last_clean":"2024-09-21T06:11:36.596113+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:36.596113+0000","last_undegraded":"2024-09-21T06:11:36.596113+0000","last_fullsized":"2024-09-21T06:11:36.596113+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595448+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:36.595448+0000","last_peered":"2024-09-21T06:11:36.595448+0000","last_clean":"2024-09-21T06:11:36.595448+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:36.595448+0000","last_undegraded":"2024-09-21T06:11:36.595448+0000","last_fullsized":"2024-09-21T06:11:36.595448+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594979+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:36.594979+0000","last_peered":"2024-09-21T06:11:36.594979+0000","last_clean":"2024-09-21T06:11:36.594979+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:36.594979+0000","last_undegraded":"2024-09-21T06:11:36.594979+0000","last_fullsized":"2024-09-21T06:11:36.594979+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595384+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:36.595384+0000","last_peered":"2024-09-21T06:11:36.595384+0000","last_clean":"2024-09-21T06:11:36.595384+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:36.595384+0000","last_undegraded":"2024-09-21T06:11:36.595384+0000","last_fullsized":"2024-09-21T06:11:36.595384+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630050+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:44.630050+0000","last_peered":"2024-09-21T06:11:44.630050+0000","last_clean":"2024-09-21T06:11:44.630050+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:44.630050+0000","last_undegraded":"2024-09-21T06:11:44.630050+0000","last_fullsized":"2024-09-21T06:11:44.630050+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595876+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:36.595876+0000","last_peered":"2024-09-21T06:11:36.595876+0000","last_clean":"2024-09-21T06:11:36.595876+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:36.595876+0000","last_undegraded":"2024-09-21T06:11:36.595876+0000","last_fullsized":"2024-09-21T06:11:36.595876+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549046+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:43.549046+0000","last_peered":"2024-09-21T06:11:43.549046+0000","last_clean":"2024-09-21T06:11:43.549046+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:43.549046+0000","last_undegraded":"2024-09-21T06:11:43.549046+0000","last_fullsized":"2024-09-21T06:11:43.549046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594534+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:36.594534+0000","last_peered":"2024-09-21T06:11:36.594534+0000","last_clean":"2024-09-21T06:11:36.594534+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:36.594534+0000","last_undegraded":"2024-09-21T06:11:36.594534+0000","last_fullsized":"2024-09-21T06:11:36.594534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549824+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:43.549824+0000","last_peered":"2024-09-21T06:11:43.549824+0000","last_clean":"2024-09-21T06:11:43.549824+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:43.549824+0000","last_undegraded":"2024-09-21T06:11:43.549824+0000","last_fullsized":"2024-09-21T06:11:43.549824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631444+0000","last_change":"2024-09-21T06:11:44.631330+0000","last_active":"2024-09-21T06:11:44.631444+0000","last_peered":"2024-09-21T06:11:44.631444+0000","last_clean":"2024-09-21T06:11:44.631444+0000","last_became_active":"2024-09-21T06:11:44.631036+0000","last_became_peered":"2024-09-21T06:11:44.631036+0000","last_unstale":"2024-09-21T06:11:44.631444+0000","last_undegraded":"2024-09-21T06:11:44.631444+0000","last_fullsized":"2024-09-21T06:11:44.631444+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:14.653905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596608+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:36.596608+0000","last_peered":"2024-09-21T06:11:36.596608+0000","last_clean":"2024-09-21T06:11:36.596608+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:36.596608+0000","last_undegraded":"2024-09-21T06:11:36.596608+0000","last_fullsized":"2024-09-21T06:11:36.596608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550178+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:44.550178+0000","last_peered":"2024-09-21T06:11:44.550178+0000","last_clean":"2024-09-21T06:11:44.550178+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:44.550178+0000","last_undegraded":"2024-09-21T06:11:44.550178+0000","last_fullsized":"2024-09-21T06:11:44.550178+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628895+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:44.628895+0000","last_peered":"2024-09-21T06:11:44.628895+0000","last_clean":"2024-09-21T06:11:44.628895+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:44.628895+0000","last_undegraded":"2024-09-21T06:11:44.628895+0000","last_fullsized":"2024-09-21T06:11:44.628895+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550152+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:44.550152+0000","last_peered":"2024-09-21T06:11:44.550152+0000","last_clean":"2024-09-21T06:11:44.550152+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:44.550152+0000","last_undegraded":"2024-09-21T06:11:44.550152+0000","last_fullsized":"2024-09-21T06:11:44.550152+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550076+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:43.550076+0000","last_peered":"2024-09-21T06:11:43.550076+0000","last_clean":"2024-09-21T06:11:43.550076+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:43.550076+0000","last_undegraded":"2024-09-21T06:11:43.550076+0000","last_fullsized":"2024-09-21T06:11:43.550076+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629110+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:44.629110+0000","last_peered":"2024-09-21T06:11:44.629110+0000","last_clean":"2024-09-21T06:11:44.629110+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:44.629110+0000","last_undegraded":"2024-09-21T06:11:44.629110+0000","last_fullsized":"2024-09-21T06:11:44.629110+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596023+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:36.596023+0000","last_peered":"2024-09-21T06:11:36.596023+0000","last_clean":"2024-09-21T06:11:36.596023+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:36.596023+0000","last_undegraded":"2024-09-21T06:11:36.596023+0000","last_fullsized":"2024-09-21T06:11:36.596023+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595609+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:36.595609+0000","last_peered":"2024-09-21T06:11:36.595609+0000","last_clean":"2024-09-21T06:11:36.595609+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:36.595609+0000","last_undegraded":"2024-09-21T06:11:36.595609+0000","last_fullsized":"2024-09-21T06:11:36.595609+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550695+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:44.550695+0000","last_peered":"2024-09-21T06:11:44.550695+0000","last_clean":"2024-09-21T06:11:44.550695+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:44.550695+0000","last_undegraded":"2024-09-21T06:11:44.550695+0000","last_fullsized":"2024-09-21T06:11:44.550695+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549144+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:43.549144+0000","last_peered":"2024-09-21T06:11:43.549144+0000","last_clean":"2024-09-21T06:11:43.549144+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:43.549144+0000","last_undegraded":"2024-09-21T06:11:43.549144+0000","last_fullsized":"2024-09-21T06:11:43.549144+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596145+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:36.596145+0000","last_peered":"2024-09-21T06:11:36.596145+0000","last_clean":"2024-09-21T06:11:36.596145+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:36.596145+0000","last_undegraded":"2024-09-21T06:11:36.596145+0000","last_fullsized":"2024-09-21T06:11:36.596145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549182+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:43.549182+0000","last_peered":"2024-09-21T06:11:43.549182+0000","last_clean":"2024-09-21T06:11:43.549182+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:43.549182+0000","last_undegraded":"2024-09-21T06:11:43.549182+0000","last_fullsized":"2024-09-21T06:11:43.549182+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549944+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:43.549944+0000","last_peered":"2024-09-21T06:11:43.549944+0000","last_clean":"2024-09-21T06:11:43.549944+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:43.549944+0000","last_undegraded":"2024-09-21T06:11:43.549944+0000","last_fullsized":"2024-09-21T06:11:43.549944+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"peering","last_fresh":"2024-09-21T06:11:39.059335+0000","last_change":"2024-09-21T06:11:43.549661+0000","last_active":"2024-09-21T06:11:43.549661+0000","last_peered":"2024-09-21T06:11:39.059335+0000","last_clean":"2024-09-21T06:11:39.059335+0000","last_became_active":"2024-09-21T06:11:35.369656+0000","last_became_peered":"2024-09-21T06:11:35.369656+0000","last_unstale":"2024-09-21T06:11:39.059335+0000","last_undegraded":"2024-09-21T06:11:39.059335+0000","last_fullsized":"2024-09-21T06:11:39.059335+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596364+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:36.596364+0000","last_peered":"2024-09-21T06:11:36.596364+0000","last_clean":"2024-09-21T06:11:36.596364+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:36.596364+0000","last_undegraded":"2024-09-21T06:11:36.596364+0000","last_fullsized":"2024-09-21T06:11:36.596364+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550085+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:44.550085+0000","last_peered":"2024-09-21T06:11:44.550085+0000","last_clean":"2024-09-21T06:11:44.550085+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:44.550085+0000","last_undegraded":"2024-09-21T06:11:44.550085+0000","last_fullsized":"2024-09-21T06:11:44.550085+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":21,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549248+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:43.549248+0000","last_peered":"2024-09-21T06:11:43.549248+0000","last_clean":"2024-09-21T06:11:43.549248+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:43.549248+0000","last_undegraded":"2024-09-21T06:11:43.549248+0000","last_fullsized":"2024-09-21T06:11:43.549248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595514+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:36.595514+0000","last_peered":"2024-09-21T06:11:36.595514+0000","last_clean":"2024-09-21T06:11:36.595514+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:36.595514+0000","last_undegraded":"2024-09-21T06:11:36.595514+0000","last_fullsized":"2024-09-21T06:11:36.595514+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549868+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:43.549868+0000","last_peered":"2024-09-21T06:11:43.549868+0000","last_clean":"2024-09-21T06:11:43.549868+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:43.549868+0000","last_undegraded":"2024-09-21T06:11:43.549868+0000","last_fullsized":"2024-09-21T06:11:43.549868+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629527+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:44.629527+0000","last_peered":"2024-09-21T06:11:44.629527+0000","last_clean":"2024-09-21T06:11:44.629527+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:44.629527+0000","last_undegraded":"2024-09-21T06:11:44.629527+0000","last_fullsized":"2024-09-21T06:11:44.629527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549628+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:43.549628+0000","last_peered":"2024-09-21T06:11:43.549628+0000","last_clean":"2024-09-21T06:11:43.549628+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:43.549628+0000","last_undegraded":"2024-09-21T06:11:43.549628+0000","last_fullsized":"2024-09-21T06:11:43.549628+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595742+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:36.595742+0000","last_peered":"2024-09-21T06:11:36.595742+0000","last_clean":"2024-09-21T06:11:36.595742+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:36.595742+0000","last_undegraded":"2024-09-21T06:11:36.595742+0000","last_fullsized":"2024-09-21T06:11:36.595742+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550350+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:44.550350+0000","last_peered":"2024-09-21T06:11:44.550350+0000","last_clean":"2024-09-21T06:11:44.550350+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:44.550350+0000","last_undegraded":"2024-09-21T06:11:44.550350+0000","last_fullsized":"2024-09-21T06:11:44.550350+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595169+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:36.595169+0000","last_peered":"2024-09-21T06:11:36.595169+0000","last_clean":"2024-09-21T06:11:36.595169+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:36.595169+0000","last_undegraded":"2024-09-21T06:11:36.595169+0000","last_fullsized":"2024-09-21T06:11:36.595169+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596842+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:36.596842+0000","last_peered":"2024-09-21T06:11:36.596842+0000","last_clean":"2024-09-21T06:11:36.596842+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:36.596842+0000","last_undegraded":"2024-09-21T06:11:36.596842+0000","last_fullsized":"2024-09-21T06:11:36.596842+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550583+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:44.550583+0000","last_peered":"2024-09-21T06:11:44.550583+0000","last_clean":"2024-09-21T06:11:44.550583+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:44.550583+0000","last_undegraded":"2024-09-21T06:11:44.550583+0000","last_fullsized":"2024-09-21T06:11:44.550583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596665+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:36.596665+0000","last_peered":"2024-09-21T06:11:36.596665+0000","last_clean":"2024-09-21T06:11:36.596665+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:36.596665+0000","last_undegraded":"2024-09-21T06:11:36.596665+0000","last_fullsized":"2024-09-21T06:11:36.596665+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595121+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:36.595121+0000","last_peered":"2024-09-21T06:11:36.595121+0000","last_clean":"2024-09-21T06:11:36.595121+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:36.595121+0000","last_undegraded":"2024-09-21T06:11:36.595121+0000","last_fullsized":"2024-09-21T06:11:36.595121+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594755+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:36.594755+0000","last_peered":"2024-09-21T06:11:36.594755+0000","last_clean":"2024-09-21T06:11:36.594755+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:36.594755+0000","last_undegraded":"2024-09-21T06:11:36.594755+0000","last_fullsized":"2024-09-21T06:11:36.594755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595886+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:36.595886+0000","last_peered":"2024-09-21T06:11:36.595886+0000","last_clean":"2024-09-21T06:11:36.595886+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:36.595886+0000","last_undegraded":"2024-09-21T06:11:36.595886+0000","last_fullsized":"2024-09-21T06:11:36.595886+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549366+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:43.549366+0000","last_peered":"2024-09-21T06:11:43.549366+0000","last_clean":"2024-09-21T06:11:43.549366+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:43.549366+0000","last_undegraded":"2024-09-21T06:11:43.549366+0000","last_fullsized":"2024-09-21T06:11:43.549366+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597135+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:36.597135+0000","last_peered":"2024-09-21T06:11:36.597135+0000","last_clean":"2024-09-21T06:11:36.597135+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:36.597135+0000","last_undegraded":"2024-09-21T06:11:36.597135+0000","last_fullsized":"2024-09-21T06:11:36.597135+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596772+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:36.596772+0000","last_peered":"2024-09-21T06:11:36.596772+0000","last_clean":"2024-09-21T06:11:36.596772+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:36.596772+0000","last_undegraded":"2024-09-21T06:11:36.596772+0000","last_fullsized":"2024-09-21T06:11:36.596772+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550286+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:44.550286+0000","last_peered":"2024-09-21T06:11:44.550286+0000","last_clean":"2024-09-21T06:11:44.550286+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:44.550286+0000","last_undegraded":"2024-09-21T06:11:44.550286+0000","last_fullsized":"2024-09-21T06:11:44.550286+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549243+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:43.549243+0000","last_peered":"2024-09-21T06:11:43.549243+0000","last_clean":"2024-09-21T06:11:43.549243+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:43.549243+0000","last_undegraded":"2024-09-21T06:11:43.549243+0000","last_fullsized":"2024-09-21T06:11:43.549243+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596236+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:36.596236+0000","last_peered":"2024-09-21T06:11:36.596236+0000","last_clean":"2024-09-21T06:11:36.596236+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:36.596236+0000","last_undegraded":"2024-09-21T06:11:36.596236+0000","last_fullsized":"2024-09-21T06:11:36.596236+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549112+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:43.549112+0000","last_peered":"2024-09-21T06:11:43.549112+0000","last_clean":"2024-09-21T06:11:43.549112+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:43.549112+0000","last_undegraded":"2024-09-21T06:11:43.549112+0000","last_fullsized":"2024-09-21T06:11:43.549112+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595218+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:36.595218+0000","last_peered":"2024-09-21T06:11:36.595218+0000","last_clean":"2024-09-21T06:11:36.595218+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:36.595218+0000","last_undegraded":"2024-09-21T06:11:36.595218+0000","last_fullsized":"2024-09-21T06:11:36.595218+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.550127+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:43.550127+0000","last_peered":"2024-09-21T06:11:43.550127+0000","last_clean":"2024-09-21T06:11:43.550127+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:43.550127+0000","last_undegraded":"2024-09-21T06:11:43.550127+0000","last_fullsized":"2024-09-21T06:11:43.550127+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.551486+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:43.551486+0000","last_peered":"2024-09-21T06:11:43.551486+0000","last_clean":"2024-09-21T06:11:43.551486+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:43.551486+0000","last_undegraded":"2024-09-21T06:11:43.551486+0000","last_fullsized":"2024-09-21T06:11:43.551486+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594658+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:36.594658+0000","last_peered":"2024-09-21T06:11:36.594658+0000","last_clean":"2024-09-21T06:11:36.594658+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:36.594658+0000","last_undegraded":"2024-09-21T06:11:36.594658+0000","last_fullsized":"2024-09-21T06:11:36.594658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595287+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:36.595287+0000","last_peered":"2024-09-21T06:11:36.595287+0000","last_clean":"2024-09-21T06:11:36.595287+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:36.595287+0000","last_undegraded":"2024-09-21T06:11:36.595287+0000","last_fullsized":"2024-09-21T06:11:36.595287+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596103+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:36.596103+0000","last_peered":"2024-09-21T06:11:36.596103+0000","last_clean":"2024-09-21T06:11:36.596103+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:36.596103+0000","last_undegraded":"2024-09-21T06:11:36.596103+0000","last_fullsized":"2024-09-21T06:11:36.596103+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596177+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:36.596177+0000","last_peered":"2024-09-21T06:11:36.596177+0000","last_clean":"2024-09-21T06:11:36.596177+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:36.596177+0000","last_undegraded":"2024-09-21T06:11:36.596177+0000","last_fullsized":"2024-09-21T06:11:36.596177+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596919+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:36.596919+0000","last_peered":"2024-09-21T06:11:36.596919+0000","last_clean":"2024-09-21T06:11:36.596919+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:36.596919+0000","last_undegraded":"2024-09-21T06:11:36.596919+0000","last_fullsized":"2024-09-21T06:11:36.596919+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595651+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:36.595651+0000","last_peered":"2024-09-21T06:11:36.595651+0000","last_clean":"2024-09-21T06:11:36.595651+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:36.595651+0000","last_undegraded":"2024-09-21T06:11:36.595651+0000","last_fullsized":"2024-09-21T06:11:36.595651+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595428+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:36.595428+0000","last_peered":"2024-09-21T06:11:36.595428+0000","last_clean":"2024-09-21T06:11:36.595428+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:36.595428+0000","last_undegraded":"2024-09-21T06:11:36.595428+0000","last_fullsized":"2024-09-21T06:11:36.595428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629660+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:44.629660+0000","last_peered":"2024-09-21T06:11:44.629660+0000","last_clean":"2024-09-21T06:11:44.629660+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:44.629660+0000","last_undegraded":"2024-09-21T06:11:44.629660+0000","last_fullsized":"2024-09-21T06:11:44.629660+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550034+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:44.550034+0000","last_peered":"2024-09-21T06:11:44.550034+0000","last_clean":"2024-09-21T06:11:44.550034+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:44.550034+0000","last_undegraded":"2024-09-21T06:11:44.550034+0000","last_fullsized":"2024-09-21T06:11:44.550034+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595830+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:36.595830+0000","last_peered":"2024-09-21T06:11:36.595830+0000","last_clean":"2024-09-21T06:11:36.595830+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:36.595830+0000","last_undegraded":"2024-09-21T06:11:36.595830+0000","last_fullsized":"2024-09-21T06:11:36.595830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595890+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:36.595890+0000","last_peered":"2024-09-21T06:11:36.595890+0000","last_clean":"2024-09-21T06:11:36.595890+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:36.595890+0000","last_undegraded":"2024-09-21T06:11:36.595890+0000","last_fullsized":"2024-09-21T06:11:36.595890+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596647+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:36.596647+0000","last_peered":"2024-09-21T06:11:36.596647+0000","last_clean":"2024-09-21T06:11:36.596647+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:36.596647+0000","last_undegraded":"2024-09-21T06:11:36.596647+0000","last_fullsized":"2024-09-21T06:11:36.596647+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549290+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:43.549290+0000","last_peered":"2024-09-21T06:11:43.549290+0000","last_clean":"2024-09-21T06:11:43.549290+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:43.549290+0000","last_undegraded":"2024-09-21T06:11:43.549290+0000","last_fullsized":"2024-09-21T06:11:43.549290+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.596392+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:36.596392+0000","last_peered":"2024-09-21T06:11:36.596392+0000","last_clean":"2024-09-21T06:11:36.596392+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:36.596392+0000","last_undegraded":"2024-09-21T06:11:36.596392+0000","last_fullsized":"2024-09-21T06:11:36.596392+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595330+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:36.595330+0000","last_peered":"2024-09-21T06:11:36.595330+0000","last_clean":"2024-09-21T06:11:36.595330+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:36.595330+0000","last_undegraded":"2024-09-21T06:11:36.595330+0000","last_fullsized":"2024-09-21T06:11:36.595330+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550387+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:44.550387+0000","last_peered":"2024-09-21T06:11:44.550387+0000","last_clean":"2024-09-21T06:11:44.550387+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:44.550387+0000","last_undegraded":"2024-09-21T06:11:44.550387+0000","last_fullsized":"2024-09-21T06:11:44.550387+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595683+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:36.595683+0000","last_peered":"2024-09-21T06:11:36.595683+0000","last_clean":"2024-09-21T06:11:36.595683+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:36.595683+0000","last_undegraded":"2024-09-21T06:11:36.595683+0000","last_fullsized":"2024-09-21T06:11:36.595683+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549387+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:43.549387+0000","last_peered":"2024-09-21T06:11:43.549387+0000","last_clean":"2024-09-21T06:11:43.549387+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:43.549387+0000","last_undegraded":"2024-09-21T06:11:43.549387+0000","last_fullsized":"2024-09-21T06:11:43.549387+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630352+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:44.630352+0000","last_peered":"2024-09-21T06:11:44.630352+0000","last_clean":"2024-09-21T06:11:44.630352+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:44.630352+0000","last_undegraded":"2024-09-21T06:11:44.630352+0000","last_fullsized":"2024-09-21T06:11:44.630352+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595597+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:36.595597+0000","last_peered":"2024-09-21T06:11:36.595597+0000","last_clean":"2024-09-21T06:11:36.595597+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:36.595597+0000","last_undegraded":"2024-09-21T06:11:36.595597+0000","last_fullsized":"2024-09-21T06:11:36.595597+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549607+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:43.549607+0000","last_peered":"2024-09-21T06:11:43.549607+0000","last_clean":"2024-09-21T06:11:43.549607+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:43.549607+0000","last_undegraded":"2024-09-21T06:11:43.549607+0000","last_fullsized":"2024-09-21T06:11:43.549607+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549488+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:43.549488+0000","last_peered":"2024-09-21T06:11:43.549488+0000","last_clean":"2024-09-21T06:11:43.549488+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:43.549488+0000","last_undegraded":"2024-09-21T06:11:43.549488+0000","last_fullsized":"2024-09-21T06:11:43.549488+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":18,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549416+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:43.549416+0000","last_peered":"2024-09-21T06:11:43.549416+0000","last_clean":"2024-09-21T06:11:43.549416+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:43.549416+0000","last_undegraded":"2024-09-21T06:11:43.549416+0000","last_fullsized":"2024-09-21T06:11:43.549416+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595824+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:36.595824+0000","last_peered":"2024-09-21T06:11:36.595824+0000","last_clean":"2024-09-21T06:11:36.595824+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:36.595824+0000","last_undegraded":"2024-09-21T06:11:36.595824+0000","last_fullsized":"2024-09-21T06:11:36.595824+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594822+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:36.594822+0000","last_peered":"2024-09-21T06:11:36.594822+0000","last_clean":"2024-09-21T06:11:36.594822+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:36.594822+0000","last_undegraded":"2024-09-21T06:11:36.594822+0000","last_fullsized":"2024-09-21T06:11:36.594822+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595038+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:36.595038+0000","last_peered":"2024-09-21T06:11:36.595038+0000","last_clean":"2024-09-21T06:11:36.595038+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:36.595038+0000","last_undegraded":"2024-09-21T06:11:36.595038+0000","last_fullsized":"2024-09-21T06:11:36.595038+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629788+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:44.629788+0000","last_peered":"2024-09-21T06:11:44.629788+0000","last_clean":"2024-09-21T06:11:44.629788+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:44.629788+0000","last_undegraded":"2024-09-21T06:11:44.629788+0000","last_fullsized":"2024-09-21T06:11:44.629788+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549087+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:43.549087+0000","last_peered":"2024-09-21T06:11:43.549087+0000","last_clean":"2024-09-21T06:11:43.549087+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:43.549087+0000","last_undegraded":"2024-09-21T06:11:43.549087+0000","last_fullsized":"2024-09-21T06:11:43.549087+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.595928+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:36.595928+0000","last_peered":"2024-09-21T06:11:36.595928+0000","last_clean":"2024-09-21T06:11:36.595928+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:36.595928+0000","last_undegraded":"2024-09-21T06:11:36.595928+0000","last_fullsized":"2024-09-21T06:11:36.595928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.597046+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:36.597046+0000","last_peered":"2024-09-21T06:11:36.597046+0000","last_clean":"2024-09-21T06:11:36.597046+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:36.597046+0000","last_undegraded":"2024-09-21T06:11:36.597046+0000","last_fullsized":"2024-09-21T06:11:36.597046+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":17,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549297+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:43.549297+0000","last_peered":"2024-09-21T06:11:43.549297+0000","last_clean":"2024-09-21T06:11:43.549297+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:43.549297+0000","last_undegraded":"2024-09-21T06:11:43.549297+0000","last_fullsized":"2024-09-21T06:11:43.549297+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550719+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:44.550719+0000","last_peered":"2024-09-21T06:11:44.550719+0000","last_clean":"2024-09-21T06:11:44.550719+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:44.550719+0000","last_undegraded":"2024-09-21T06:11:44.550719+0000","last_fullsized":"2024-09-21T06:11:44.550719+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-21T06:11:36.594875+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:36.594875+0000","last_peered":"2024-09-21T06:11:36.594875+0000","last_clean":"2024-09-21T06:11:36.594875+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:36.594875+0000","last_undegraded":"2024-09-21T06:11:36.594875+0000","last_fullsized":"2024-09-21T06:11:36.594875+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629188+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:44.629188+0000","last_peered":"2024-09-21T06:11:44.629188+0000","last_clean":"2024-09-21T06:11:44.629188+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:44.629188+0000","last_undegraded":"2024-09-21T06:11:44.629188+0000","last_fullsized":"2024-09-21T06:11:44.629188+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549989+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:43.549989+0000","last_peered":"2024-09-21T06:11:43.549989+0000","last_clean":"2024-09-21T06:11:43.549989+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:43.549989+0000","last_undegraded":"2024-09-21T06:11:43.549989+0000","last_fullsized":"2024-09-21T06:11:43.549989+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":19,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549730+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:43.549730+0000","last_peered":"2024-09-21T06:11:43.549730+0000","last_clean":"2024-09-21T06:11:43.549730+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:43.549730+0000","last_undegraded":"2024-09-21T06:11:43.549730+0000","last_fullsized":"2024-09-21T06:11:43.549730+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":373,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-21T06:11:43.549467+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:43.549467+0000","last_peered":"2024-09-21T06:11:43.549467+0000","last_clean":"2024-09-21T06:11:43.549467+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:43.549467+0000","last_undegraded":"2024-09-21T06:11:43.549467+0000","last_fullsized":"2024-09-21T06:11:43.549467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194504,"statfs":{"total":200000000,"available":199172462,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1384,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193927,"statfs":{"total":200000000,"available":198582254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1386,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198580004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194508,"statfs":{"total":200000000,"available":199177035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178577,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194510,"statfs":{"total":200000000,"available":199178647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:50.331 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:50.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 -- 172.21.15.118:0/2900959674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00cca00 msgr2=0x7f54f00ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 --2- 172.21.15.118:0/2900959674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00cca00 0x7f54f00ce5e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f54e0005fd0 tx=0x7f54e002aa50 comp rx=0 tx=0).stop 2024-09-21T06:11:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 -- 172.21.15.118:0/2900959674 shutdown_connections 2024-09-21T06:11:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 --2- 172.21.15.118:0/2900959674 >> v2:172.21.15.149:3300/0 conn(0x7f54f00b1010 0x7f54f00b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 --2- 172.21.15.118:0/2900959674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f00b1ee0 0x7f54f00b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 --2- 172.21.15.118:0/2900959674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00cca00 0x7f54f00ce5e0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 -- 172.21.15.118:0/2900959674 >> 172.21.15.118:0/2900959674 conn(0x7f54f00748d0 msgr2=0x7f54f0074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 -- 172.21.15.118:0/2900959674 shutdown_connections 2024-09-21T06:11:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.588+0000 7f54f6600640 1 -- 172.21.15.118:0/2900959674 wait complete. 2024-09-21T06:11:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.590+0000 7f54f6600640 1 Processor -- start 2024-09-21T06:11:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.590+0000 7f54f6600640 1 -- start start 2024-09-21T06:11:50.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.591+0000 7f54f6600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f00b1010 0x7f54f0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.591+0000 7f54f6600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00b1ee0 0x7f54f0158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54f6600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cca00 0x7f54f00af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54f6600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00b6400 con 0x7f54f00b1ee0 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54f6600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00b6280 con 0x7f54f00cca00 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54f6600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f54f00b6580 con 0x7f54f00b1010 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00b1ee0 0x7f54f0158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00b1ee0 0x7f54f0158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41988/0 (socket says 172.21.15.118:41988) 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 -- 172.21.15.118:0/268751710 learned_addr learned my addr 172.21.15.118:0/268751710 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54ef400640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f00b1010 0x7f54f0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54efe00640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cca00 0x7f54f00af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 -- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f00b1010 msgr2=0x7f54f0156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f00b1010 0x7f54f0156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 -- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cca00 msgr2=0x7f54f00af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cca00 0x7f54f00af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.592+0000 7f54e6a00640 1 -- 172.21.15.118:0/268751710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f0159290 con 0x7f54f00b1ee0 2024-09-21T06:11:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.593+0000 7f54e6a00640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00b1ee0 0x7f54f0158200 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f54d800d740 tx=0x7f54d800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.593+0000 7f54e7e00640 1 -- 172.21.15.118:0/268751710 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8017070 con 0x7f54f00b1ee0 2024-09-21T06:11:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.593+0000 7f54e7e00640 1 -- 172.21.15.118:0/268751710 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54d8009d20 con 0x7f54f00b1ee0 2024-09-21T06:11:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.593+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f0159840 con 0x7f54f00b1ee0 2024-09-21T06:11:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.593+0000 7f54e7e00640 1 -- 172.21.15.118:0/268751710 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d80106c0 con 0x7f54f00b1ee0 2024-09-21T06:11:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.593+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f01e6aa0 con 0x7f54f00b1ee0 2024-09-21T06:11:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.594+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f0158d00 con 0x7f54f00b1ee0 2024-09-21T06:11:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.595+0000 7f54e7e00640 1 -- 172.21.15.118:0/268751710 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54d801a070 con 0x7f54f00b1ee0 2024-09-21T06:11:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.596+0000 7f54e7e00640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54cc078bc0 0x7f54cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.596+0000 7f54e7e00640 1 -- 172.21.15.118:0/268751710 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f54d809ae40 con 0x7f54f00b1ee0 2024-09-21T06:11:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.597+0000 7f54ef400640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54cc078bc0 0x7f54cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.597+0000 7f54ef400640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54cc078bc0 0x7f54cc07b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54e0035000 tx=0x7f54e0004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.601+0000 7f54e7e00640 1 -- 172.21.15.118:0/268751710 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f54f0159290 con 0x7f54f00b1ee0 2024-09-21T06:11:50.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.786+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54f00b6aa0 con 0x7f54cc078bc0 2024-09-21T06:11:50.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.791+0000 7f54e7e00640 1 -- 172.21.15.118:0/268751710 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247973 (secure 0 0 0) 0x7f54f00b6aa0 con 0x7f54cc078bc0 2024-09-21T06:11:50.796 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:50.797 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.795+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54cc078bc0 msgr2=0x7f54cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.795+0000 7f54f6600640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54cc078bc0 0x7f54cc07b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54e0035000 tx=0x7f54e0004ab0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.795+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00b1ee0 msgr2=0x7f54f0158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.795+0000 7f54f6600640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00b1ee0 0x7f54f0158200 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f54d800d740 tx=0x7f54d800dc00 comp rx=0 tx=0).stop 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 shutdown_connections 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cca00 0x7f54f00af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54f00b1ee0 0x7f54f0158200 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f54cc078bc0 0x7f54cc07b0d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 --2- 172.21.15.118:0/268751710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f00b1010 0x7f54f0156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 >> 172.21.15.118:0/268751710 conn(0x7f54f00748d0 msgr2=0x7f54f00762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:50.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 shutdown_connections 2024-09-21T06:11:50.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:50.796+0000 7f54f6600640 1 -- 172.21.15.118:0/268751710 wait complete. 2024-09-21T06:11:50.820 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-21T06:11:50.582578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554831,"statfs":{"total":1600000000,"available":1592147556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001780"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551975+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:44.551975+0000","last_peered":"2024-09-21T06:11:44.551975+0000","last_clean":"2024-09-21T06:11:44.551975+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:44.551975+0000","last_undegraded":"2024-09-21T06:11:44.551975+0000","last_fullsized":"2024-09-21T06:11:44.551975+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629267+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:44.629267+0000","last_peered":"2024-09-21T06:11:44.629267+0000","last_clean":"2024-09-21T06:11:44.629267+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:44.629267+0000","last_undegraded":"2024-09-21T06:11:44.629267+0000","last_fullsized":"2024-09-21T06:11:44.629267+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629773+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:44.629773+0000","last_peered":"2024-09-21T06:11:44.629773+0000","last_clean":"2024-09-21T06:11:44.629773+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:44.629773+0000","last_undegraded":"2024-09-21T06:11:44.629773+0000","last_fullsized":"2024-09-21T06:11:44.629773+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551234+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:44.551234+0000","last_peered":"2024-09-21T06:11:44.551234+0000","last_clean":"2024-09-21T06:11:44.551234+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:44.551234+0000","last_undegraded":"2024-09-21T06:11:44.551234+0000","last_fullsized":"2024-09-21T06:11:44.551234+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551873+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:44.551873+0000","last_peered":"2024-09-21T06:11:44.551873+0000","last_clean":"2024-09-21T06:11:44.551873+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:44.551873+0000","last_undegraded":"2024-09-21T06:11:44.551873+0000","last_fullsized":"2024-09-21T06:11:44.551873+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630159+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:44.630159+0000","last_peered":"2024-09-21T06:11:44.630159+0000","last_clean":"2024-09-21T06:11:44.630159+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:44.630159+0000","last_undegraded":"2024-09-21T06:11:44.630159+0000","last_fullsized":"2024-09-21T06:11:44.630159+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630590+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:44.630590+0000","last_peered":"2024-09-21T06:11:44.630590+0000","last_clean":"2024-09-21T06:11:44.630590+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:44.630590+0000","last_undegraded":"2024-09-21T06:11:44.630590+0000","last_fullsized":"2024-09-21T06:11:44.630590+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629885+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:44.629885+0000","last_peered":"2024-09-21T06:11:44.629885+0000","last_clean":"2024-09-21T06:11:44.629885+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:44.629885+0000","last_undegraded":"2024-09-21T06:11:44.629885+0000","last_fullsized":"2024-09-21T06:11:44.629885+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629886+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:44.629886+0000","last_peered":"2024-09-21T06:11:44.629886+0000","last_clean":"2024-09-21T06:11:44.629886+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:44.629886+0000","last_undegraded":"2024-09-21T06:11:44.629886+0000","last_fullsized":"2024-09-21T06:11:44.629886+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629656+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:44.629656+0000","last_peered":"2024-09-21T06:11:44.629656+0000","last_clean":"2024-09-21T06:11:44.629656+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:44.629656+0000","last_undegraded":"2024-09-21T06:11:44.629656+0000","last_fullsized":"2024-09-21T06:11:44.629656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630050+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:44.630050+0000","last_peered":"2024-09-21T06:11:44.630050+0000","last_clean":"2024-09-21T06:11:44.630050+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:44.630050+0000","last_undegraded":"2024-09-21T06:11:44.630050+0000","last_fullsized":"2024-09-21T06:11:44.630050+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630180+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:44.630180+0000","last_peered":"2024-09-21T06:11:44.630180+0000","last_clean":"2024-09-21T06:11:44.630180+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:44.630180+0000","last_undegraded":"2024-09-21T06:11:44.630180+0000","last_fullsized":"2024-09-21T06:11:44.630180+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551235+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:44.551235+0000","last_peered":"2024-09-21T06:11:44.551235+0000","last_clean":"2024-09-21T06:11:44.551235+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:44.551235+0000","last_undegraded":"2024-09-21T06:11:44.551235+0000","last_fullsized":"2024-09-21T06:11:44.551235+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628870+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:44.628870+0000","last_peered":"2024-09-21T06:11:44.628870+0000","last_clean":"2024-09-21T06:11:44.628870+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:44.628870+0000","last_undegraded":"2024-09-21T06:11:44.628870+0000","last_fullsized":"2024-09-21T06:11:44.628870+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551569+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:44.551569+0000","last_peered":"2024-09-21T06:11:44.551569+0000","last_clean":"2024-09-21T06:11:44.551569+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:44.551569+0000","last_undegraded":"2024-09-21T06:11:44.551569+0000","last_fullsized":"2024-09-21T06:11:44.551569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631444+0000","last_change":"2024-09-21T06:11:44.631330+0000","last_active":"2024-09-21T06:11:44.631444+0000","last_peered":"2024-09-21T06:11:44.631444+0000","last_clean":"2024-09-21T06:11:44.631444+0000","last_became_active":"2024-09-21T06:11:44.631036+0000","last_became_peered":"2024-09-21T06:11:44.631036+0000","last_unstale":"2024-09-21T06:11:44.631444+0000","last_undegraded":"2024-09-21T06:11:44.631444+0000","last_fullsized":"2024-09-21T06:11:44.631444+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:14.653905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630725+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:44.630725+0000","last_peered":"2024-09-21T06:11:44.630725+0000","last_clean":"2024-09-21T06:11:44.630725+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:44.630725+0000","last_undegraded":"2024-09-21T06:11:44.630725+0000","last_fullsized":"2024-09-21T06:11:44.630725+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550178+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:44.550178+0000","last_peered":"2024-09-21T06:11:44.550178+0000","last_clean":"2024-09-21T06:11:44.550178+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:44.550178+0000","last_undegraded":"2024-09-21T06:11:44.550178+0000","last_fullsized":"2024-09-21T06:11:44.550178+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628895+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:44.628895+0000","last_peered":"2024-09-21T06:11:44.628895+0000","last_clean":"2024-09-21T06:11:44.628895+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:44.628895+0000","last_undegraded":"2024-09-21T06:11:44.628895+0000","last_fullsized":"2024-09-21T06:11:44.628895+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550152+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:44.550152+0000","last_peered":"2024-09-21T06:11:44.550152+0000","last_clean":"2024-09-21T06:11:44.550152+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:44.550152+0000","last_undegraded":"2024-09-21T06:11:44.550152+0000","last_fullsized":"2024-09-21T06:11:44.550152+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552618+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:44.552618+0000","last_peered":"2024-09-21T06:11:44.552618+0000","last_clean":"2024-09-21T06:11:44.552618+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:44.552618+0000","last_undegraded":"2024-09-21T06:11:44.552618+0000","last_fullsized":"2024-09-21T06:11:44.552618+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629110+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:44.629110+0000","last_peered":"2024-09-21T06:11:44.629110+0000","last_clean":"2024-09-21T06:11:44.629110+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:44.629110+0000","last_undegraded":"2024-09-21T06:11:44.629110+0000","last_fullsized":"2024-09-21T06:11:44.629110+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630160+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:44.630160+0000","last_peered":"2024-09-21T06:11:44.630160+0000","last_clean":"2024-09-21T06:11:44.630160+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:44.630160+0000","last_undegraded":"2024-09-21T06:11:44.630160+0000","last_fullsized":"2024-09-21T06:11:44.630160+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629755+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:44.629755+0000","last_peered":"2024-09-21T06:11:44.629755+0000","last_clean":"2024-09-21T06:11:44.629755+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:44.629755+0000","last_undegraded":"2024-09-21T06:11:44.629755+0000","last_fullsized":"2024-09-21T06:11:44.629755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550695+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:44.550695+0000","last_peered":"2024-09-21T06:11:44.550695+0000","last_clean":"2024-09-21T06:11:44.550695+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:44.550695+0000","last_undegraded":"2024-09-21T06:11:44.550695+0000","last_fullsized":"2024-09-21T06:11:44.550695+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551170+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:44.551170+0000","last_peered":"2024-09-21T06:11:44.551170+0000","last_clean":"2024-09-21T06:11:44.551170+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:44.551170+0000","last_undegraded":"2024-09-21T06:11:44.551170+0000","last_fullsized":"2024-09-21T06:11:44.551170+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629266+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:44.629266+0000","last_peered":"2024-09-21T06:11:44.629266+0000","last_clean":"2024-09-21T06:11:44.629266+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:44.629266+0000","last_undegraded":"2024-09-21T06:11:44.629266+0000","last_fullsized":"2024-09-21T06:11:44.629266+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551530+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:44.551530+0000","last_peered":"2024-09-21T06:11:44.551530+0000","last_clean":"2024-09-21T06:11:44.551530+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:44.551530+0000","last_undegraded":"2024-09-21T06:11:44.551530+0000","last_fullsized":"2024-09-21T06:11:44.551530+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551738+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:44.551738+0000","last_peered":"2024-09-21T06:11:44.551738+0000","last_clean":"2024-09-21T06:11:44.551738+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:44.551738+0000","last_undegraded":"2024-09-21T06:11:44.551738+0000","last_fullsized":"2024-09-21T06:11:44.551738+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631400+0000","last_change":"2024-09-21T06:11:44.631304+0000","last_active":"2024-09-21T06:11:44.631400+0000","last_peered":"2024-09-21T06:11:44.631400+0000","last_clean":"2024-09-21T06:11:44.631400+0000","last_became_active":"2024-09-21T06:11:44.631094+0000","last_became_peered":"2024-09-21T06:11:44.631094+0000","last_unstale":"2024-09-21T06:11:44.631400+0000","last_undegraded":"2024-09-21T06:11:44.631400+0000","last_fullsized":"2024-09-21T06:11:44.631400+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:44.784235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630658+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:44.630658+0000","last_peered":"2024-09-21T06:11:44.630658+0000","last_clean":"2024-09-21T06:11:44.630658+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:44.630658+0000","last_undegraded":"2024-09-21T06:11:44.630658+0000","last_fullsized":"2024-09-21T06:11:44.630658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550085+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:44.550085+0000","last_peered":"2024-09-21T06:11:44.550085+0000","last_clean":"2024-09-21T06:11:44.550085+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:44.550085+0000","last_undegraded":"2024-09-21T06:11:44.550085+0000","last_fullsized":"2024-09-21T06:11:44.550085+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551828+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:44.551828+0000","last_peered":"2024-09-21T06:11:44.551828+0000","last_clean":"2024-09-21T06:11:44.551828+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:44.551828+0000","last_undegraded":"2024-09-21T06:11:44.551828+0000","last_fullsized":"2024-09-21T06:11:44.551828+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630001+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:44.630001+0000","last_peered":"2024-09-21T06:11:44.630001+0000","last_clean":"2024-09-21T06:11:44.630001+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:44.630001+0000","last_undegraded":"2024-09-21T06:11:44.630001+0000","last_fullsized":"2024-09-21T06:11:44.630001+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629475+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:44.629475+0000","last_peered":"2024-09-21T06:11:44.629475+0000","last_clean":"2024-09-21T06:11:44.629475+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:44.629475+0000","last_undegraded":"2024-09-21T06:11:44.629475+0000","last_fullsized":"2024-09-21T06:11:44.629475+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552385+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:44.552385+0000","last_peered":"2024-09-21T06:11:44.552385+0000","last_clean":"2024-09-21T06:11:44.552385+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:44.552385+0000","last_undegraded":"2024-09-21T06:11:44.552385+0000","last_fullsized":"2024-09-21T06:11:44.552385+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629527+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:44.629527+0000","last_peered":"2024-09-21T06:11:44.629527+0000","last_clean":"2024-09-21T06:11:44.629527+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:44.629527+0000","last_undegraded":"2024-09-21T06:11:44.629527+0000","last_fullsized":"2024-09-21T06:11:44.629527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551999+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:44.551999+0000","last_peered":"2024-09-21T06:11:44.551999+0000","last_clean":"2024-09-21T06:11:44.551999+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:44.551999+0000","last_undegraded":"2024-09-21T06:11:44.551999+0000","last_fullsized":"2024-09-21T06:11:44.551999+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629504+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:44.629504+0000","last_peered":"2024-09-21T06:11:44.629504+0000","last_clean":"2024-09-21T06:11:44.629504+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:44.629504+0000","last_undegraded":"2024-09-21T06:11:44.629504+0000","last_fullsized":"2024-09-21T06:11:44.629504+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550350+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:44.550350+0000","last_peered":"2024-09-21T06:11:44.550350+0000","last_clean":"2024-09-21T06:11:44.550350+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:44.550350+0000","last_undegraded":"2024-09-21T06:11:44.550350+0000","last_fullsized":"2024-09-21T06:11:44.550350+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629382+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:44.629382+0000","last_peered":"2024-09-21T06:11:44.629382+0000","last_clean":"2024-09-21T06:11:44.629382+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:44.629382+0000","last_undegraded":"2024-09-21T06:11:44.629382+0000","last_fullsized":"2024-09-21T06:11:44.629382+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630861+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:44.630861+0000","last_peered":"2024-09-21T06:11:44.630861+0000","last_clean":"2024-09-21T06:11:44.630861+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:44.630861+0000","last_undegraded":"2024-09-21T06:11:44.630861+0000","last_fullsized":"2024-09-21T06:11:44.630861+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550583+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:44.550583+0000","last_peered":"2024-09-21T06:11:44.550583+0000","last_clean":"2024-09-21T06:11:44.550583+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:44.550583+0000","last_undegraded":"2024-09-21T06:11:44.550583+0000","last_fullsized":"2024-09-21T06:11:44.550583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630453+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:44.630453+0000","last_peered":"2024-09-21T06:11:44.630453+0000","last_clean":"2024-09-21T06:11:44.630453+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:44.630453+0000","last_undegraded":"2024-09-21T06:11:44.630453+0000","last_fullsized":"2024-09-21T06:11:44.630453+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629892+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:44.629892+0000","last_peered":"2024-09-21T06:11:44.629892+0000","last_clean":"2024-09-21T06:11:44.629892+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:44.629892+0000","last_undegraded":"2024-09-21T06:11:44.629892+0000","last_fullsized":"2024-09-21T06:11:44.629892+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629006+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:44.629006+0000","last_peered":"2024-09-21T06:11:44.629006+0000","last_clean":"2024-09-21T06:11:44.629006+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:44.629006+0000","last_undegraded":"2024-09-21T06:11:44.629006+0000","last_fullsized":"2024-09-21T06:11:44.629006+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629896+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:44.629896+0000","last_peered":"2024-09-21T06:11:44.629896+0000","last_clean":"2024-09-21T06:11:44.629896+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:44.629896+0000","last_undegraded":"2024-09-21T06:11:44.629896+0000","last_fullsized":"2024-09-21T06:11:44.629896+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551428+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:44.551428+0000","last_peered":"2024-09-21T06:11:44.551428+0000","last_clean":"2024-09-21T06:11:44.551428+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:44.551428+0000","last_undegraded":"2024-09-21T06:11:44.551428+0000","last_fullsized":"2024-09-21T06:11:44.551428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629867+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:44.629867+0000","last_peered":"2024-09-21T06:11:44.629867+0000","last_clean":"2024-09-21T06:11:44.629867+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:44.629867+0000","last_undegraded":"2024-09-21T06:11:44.629867+0000","last_fullsized":"2024-09-21T06:11:44.629867+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629302+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:44.629302+0000","last_peered":"2024-09-21T06:11:44.629302+0000","last_clean":"2024-09-21T06:11:44.629302+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:44.629302+0000","last_undegraded":"2024-09-21T06:11:44.629302+0000","last_fullsized":"2024-09-21T06:11:44.629302+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550286+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:44.550286+0000","last_peered":"2024-09-21T06:11:44.550286+0000","last_clean":"2024-09-21T06:11:44.550286+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:44.550286+0000","last_undegraded":"2024-09-21T06:11:44.550286+0000","last_fullsized":"2024-09-21T06:11:44.550286+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551730+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:44.551730+0000","last_peered":"2024-09-21T06:11:44.551730+0000","last_clean":"2024-09-21T06:11:44.551730+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:44.551730+0000","last_undegraded":"2024-09-21T06:11:44.551730+0000","last_fullsized":"2024-09-21T06:11:44.551730+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":22,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629419+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:44.629419+0000","last_peered":"2024-09-21T06:11:44.629419+0000","last_clean":"2024-09-21T06:11:44.629419+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:44.629419+0000","last_undegraded":"2024-09-21T06:11:44.629419+0000","last_fullsized":"2024-09-21T06:11:44.629419+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551578+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:44.551578+0000","last_peered":"2024-09-21T06:11:44.551578+0000","last_clean":"2024-09-21T06:11:44.551578+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:44.551578+0000","last_undegraded":"2024-09-21T06:11:44.551578+0000","last_fullsized":"2024-09-21T06:11:44.551578+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":25,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630145+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:44.630145+0000","last_peered":"2024-09-21T06:11:44.630145+0000","last_clean":"2024-09-21T06:11:44.630145+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:44.630145+0000","last_undegraded":"2024-09-21T06:11:44.630145+0000","last_fullsized":"2024-09-21T06:11:44.630145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551939+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:44.551939+0000","last_peered":"2024-09-21T06:11:44.551939+0000","last_clean":"2024-09-21T06:11:44.551939+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:44.551939+0000","last_undegraded":"2024-09-21T06:11:44.551939+0000","last_fullsized":"2024-09-21T06:11:44.551939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552151+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:44.552151+0000","last_peered":"2024-09-21T06:11:44.552151+0000","last_clean":"2024-09-21T06:11:44.552151+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:44.552151+0000","last_undegraded":"2024-09-21T06:11:44.552151+0000","last_fullsized":"2024-09-21T06:11:44.552151+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629501+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:44.629501+0000","last_peered":"2024-09-21T06:11:44.629501+0000","last_clean":"2024-09-21T06:11:44.629501+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:44.629501+0000","last_undegraded":"2024-09-21T06:11:44.629501+0000","last_fullsized":"2024-09-21T06:11:44.629501+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630306+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:44.630306+0000","last_peered":"2024-09-21T06:11:44.630306+0000","last_clean":"2024-09-21T06:11:44.630306+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:44.630306+0000","last_undegraded":"2024-09-21T06:11:44.630306+0000","last_fullsized":"2024-09-21T06:11:44.630306+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":27,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630346+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:44.630346+0000","last_peered":"2024-09-21T06:11:44.630346+0000","last_clean":"2024-09-21T06:11:44.630346+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:44.630346+0000","last_undegraded":"2024-09-21T06:11:44.630346+0000","last_fullsized":"2024-09-21T06:11:44.630346+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630521+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:44.630521+0000","last_peered":"2024-09-21T06:11:44.630521+0000","last_clean":"2024-09-21T06:11:44.630521+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:44.630521+0000","last_undegraded":"2024-09-21T06:11:44.630521+0000","last_fullsized":"2024-09-21T06:11:44.630521+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629597+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:44.629597+0000","last_peered":"2024-09-21T06:11:44.629597+0000","last_clean":"2024-09-21T06:11:44.629597+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:44.629597+0000","last_undegraded":"2024-09-21T06:11:44.629597+0000","last_fullsized":"2024-09-21T06:11:44.629597+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629300+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:44.629300+0000","last_peered":"2024-09-21T06:11:44.629300+0000","last_clean":"2024-09-21T06:11:44.629300+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:44.629300+0000","last_undegraded":"2024-09-21T06:11:44.629300+0000","last_fullsized":"2024-09-21T06:11:44.629300+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629660+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:44.629660+0000","last_peered":"2024-09-21T06:11:44.629660+0000","last_clean":"2024-09-21T06:11:44.629660+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:44.629660+0000","last_undegraded":"2024-09-21T06:11:44.629660+0000","last_fullsized":"2024-09-21T06:11:44.629660+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550034+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:44.550034+0000","last_peered":"2024-09-21T06:11:44.550034+0000","last_clean":"2024-09-21T06:11:44.550034+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:44.550034+0000","last_undegraded":"2024-09-21T06:11:44.550034+0000","last_fullsized":"2024-09-21T06:11:44.550034+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630354+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:44.630354+0000","last_peered":"2024-09-21T06:11:44.630354+0000","last_clean":"2024-09-21T06:11:44.630354+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:44.630354+0000","last_undegraded":"2024-09-21T06:11:44.630354+0000","last_fullsized":"2024-09-21T06:11:44.630354+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629612+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:44.629612+0000","last_peered":"2024-09-21T06:11:44.629612+0000","last_clean":"2024-09-21T06:11:44.629612+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:44.629612+0000","last_undegraded":"2024-09-21T06:11:44.629612+0000","last_fullsized":"2024-09-21T06:11:44.629612+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629850+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:44.629850+0000","last_peered":"2024-09-21T06:11:44.629850+0000","last_clean":"2024-09-21T06:11:44.629850+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:44.629850+0000","last_undegraded":"2024-09-21T06:11:44.629850+0000","last_fullsized":"2024-09-21T06:11:44.629850+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551626+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:44.551626+0000","last_peered":"2024-09-21T06:11:44.551626+0000","last_clean":"2024-09-21T06:11:44.551626+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:44.551626+0000","last_undegraded":"2024-09-21T06:11:44.551626+0000","last_fullsized":"2024-09-21T06:11:44.551626+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629547+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:44.629547+0000","last_peered":"2024-09-21T06:11:44.629547+0000","last_clean":"2024-09-21T06:11:44.629547+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:44.629547+0000","last_undegraded":"2024-09-21T06:11:44.629547+0000","last_fullsized":"2024-09-21T06:11:44.629547+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630294+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:44.630294+0000","last_peered":"2024-09-21T06:11:44.630294+0000","last_clean":"2024-09-21T06:11:44.630294+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:44.630294+0000","last_undegraded":"2024-09-21T06:11:44.630294+0000","last_fullsized":"2024-09-21T06:11:44.630294+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550387+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:44.550387+0000","last_peered":"2024-09-21T06:11:44.550387+0000","last_clean":"2024-09-21T06:11:44.550387+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:44.550387+0000","last_undegraded":"2024-09-21T06:11:44.550387+0000","last_fullsized":"2024-09-21T06:11:44.550387+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629393+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:44.629393+0000","last_peered":"2024-09-21T06:11:44.629393+0000","last_clean":"2024-09-21T06:11:44.629393+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:44.629393+0000","last_undegraded":"2024-09-21T06:11:44.629393+0000","last_fullsized":"2024-09-21T06:11:44.629393+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551746+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:44.551746+0000","last_peered":"2024-09-21T06:11:44.551746+0000","last_clean":"2024-09-21T06:11:44.551746+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:44.551746+0000","last_undegraded":"2024-09-21T06:11:44.551746+0000","last_fullsized":"2024-09-21T06:11:44.551746+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630352+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:44.630352+0000","last_peered":"2024-09-21T06:11:44.630352+0000","last_clean":"2024-09-21T06:11:44.630352+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:44.630352+0000","last_undegraded":"2024-09-21T06:11:44.630352+0000","last_fullsized":"2024-09-21T06:11:44.630352+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630468+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:44.630468+0000","last_peered":"2024-09-21T06:11:44.630468+0000","last_clean":"2024-09-21T06:11:44.630468+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:44.630468+0000","last_undegraded":"2024-09-21T06:11:44.630468+0000","last_fullsized":"2024-09-21T06:11:44.630468+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551714+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:44.551714+0000","last_peered":"2024-09-21T06:11:44.551714+0000","last_clean":"2024-09-21T06:11:44.551714+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:44.551714+0000","last_undegraded":"2024-09-21T06:11:44.551714+0000","last_fullsized":"2024-09-21T06:11:44.551714+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551574+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:44.551574+0000","last_peered":"2024-09-21T06:11:44.551574+0000","last_clean":"2024-09-21T06:11:44.551574+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:44.551574+0000","last_undegraded":"2024-09-21T06:11:44.551574+0000","last_fullsized":"2024-09-21T06:11:44.551574+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551983+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:44.551983+0000","last_peered":"2024-09-21T06:11:44.551983+0000","last_clean":"2024-09-21T06:11:44.551983+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:44.551983+0000","last_undegraded":"2024-09-21T06:11:44.551983+0000","last_fullsized":"2024-09-21T06:11:44.551983+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629818+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:44.629818+0000","last_peered":"2024-09-21T06:11:44.629818+0000","last_clean":"2024-09-21T06:11:44.629818+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:44.629818+0000","last_undegraded":"2024-09-21T06:11:44.629818+0000","last_fullsized":"2024-09-21T06:11:44.629818+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629128+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:44.629128+0000","last_peered":"2024-09-21T06:11:44.629128+0000","last_clean":"2024-09-21T06:11:44.629128+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:44.629128+0000","last_undegraded":"2024-09-21T06:11:44.629128+0000","last_fullsized":"2024-09-21T06:11:44.629128+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629775+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:44.629775+0000","last_peered":"2024-09-21T06:11:44.629775+0000","last_clean":"2024-09-21T06:11:44.629775+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:44.629775+0000","last_undegraded":"2024-09-21T06:11:44.629775+0000","last_fullsized":"2024-09-21T06:11:44.629775+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629788+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:44.629788+0000","last_peered":"2024-09-21T06:11:44.629788+0000","last_clean":"2024-09-21T06:11:44.629788+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:44.629788+0000","last_undegraded":"2024-09-21T06:11:44.629788+0000","last_fullsized":"2024-09-21T06:11:44.629788+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551490+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:44.551490+0000","last_peered":"2024-09-21T06:11:44.551490+0000","last_clean":"2024-09-21T06:11:44.551490+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:44.551490+0000","last_undegraded":"2024-09-21T06:11:44.551490+0000","last_fullsized":"2024-09-21T06:11:44.551490+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629717+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:44.629717+0000","last_peered":"2024-09-21T06:11:44.629717+0000","last_clean":"2024-09-21T06:11:44.629717+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:44.629717+0000","last_undegraded":"2024-09-21T06:11:44.629717+0000","last_fullsized":"2024-09-21T06:11:44.629717+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629754+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:44.629754+0000","last_peered":"2024-09-21T06:11:44.629754+0000","last_clean":"2024-09-21T06:11:44.629754+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:44.629754+0000","last_undegraded":"2024-09-21T06:11:44.629754+0000","last_fullsized":"2024-09-21T06:11:44.629754+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551789+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:44.551789+0000","last_peered":"2024-09-21T06:11:44.551789+0000","last_clean":"2024-09-21T06:11:44.551789+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:44.551789+0000","last_undegraded":"2024-09-21T06:11:44.551789+0000","last_fullsized":"2024-09-21T06:11:44.551789+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550719+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:44.550719+0000","last_peered":"2024-09-21T06:11:44.550719+0000","last_clean":"2024-09-21T06:11:44.550719+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:44.550719+0000","last_undegraded":"2024-09-21T06:11:44.550719+0000","last_fullsized":"2024-09-21T06:11:44.550719+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629129+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:44.629129+0000","last_peered":"2024-09-21T06:11:44.629129+0000","last_clean":"2024-09-21T06:11:44.629129+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:44.629129+0000","last_undegraded":"2024-09-21T06:11:44.629129+0000","last_fullsized":"2024-09-21T06:11:44.629129+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629188+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:44.629188+0000","last_peered":"2024-09-21T06:11:44.629188+0000","last_clean":"2024-09-21T06:11:44.629188+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:44.629188+0000","last_undegraded":"2024-09-21T06:11:44.629188+0000","last_fullsized":"2024-09-21T06:11:44.629188+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552507+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:44.552507+0000","last_peered":"2024-09-21T06:11:44.552507+0000","last_clean":"2024-09-21T06:11:44.552507+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:44.552507+0000","last_undegraded":"2024-09-21T06:11:44.552507+0000","last_fullsized":"2024-09-21T06:11:44.552507+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552145+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:44.552145+0000","last_peered":"2024-09-21T06:11:44.552145+0000","last_clean":"2024-09-21T06:11:44.552145+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:44.552145+0000","last_undegraded":"2024-09-21T06:11:44.552145+0000","last_fullsized":"2024-09-21T06:11:44.552145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":376,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552122+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:44.552122+0000","last_peered":"2024-09-21T06:11:44.552122+0000","last_clean":"2024-09-21T06:11:44.552122+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:44.552122+0000","last_undegraded":"2024-09-21T06:11:44.552122+0000","last_fullsized":"2024-09-21T06:11:44.552122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166479,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1390,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193922,"statfs":{"total":200000000,"available":198576271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1392,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193919,"statfs":{"total":200000000,"available":198574021,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":814,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166023,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:50.824 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T06:11:51.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.076+0000 7f36abe00640 1 -- 172.21.15.118:0/1451439889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 msgr2=0x7f36a40cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.076+0000 7f36abe00640 1 --2- 172.21.15.118:0/1451439889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40cca40 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3690005fd0 tx=0x7f369002a670 comp rx=0 tx=0).stop 2024-09-21T06:11:51.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.077+0000 7f36abe00640 1 -- 172.21.15.118:0/1451439889 shutdown_connections 2024-09-21T06:11:51.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.077+0000 7f36abe00640 1 --2- 172.21.15.118:0/1451439889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40cca40 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.077+0000 7f36abe00640 1 -- 172.21.15.118:0/1451439889 >> 172.21.15.118:0/1451439889 conn(0x7f36a406d110 msgr2=0x7f36a406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:51.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.077+0000 7f36abe00640 1 -- 172.21.15.118:0/1451439889 shutdown_connections 2024-09-21T06:11:51.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.077+0000 7f36abe00640 1 -- 172.21.15.118:0/1451439889 wait complete. 2024-09-21T06:11:51.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.079+0000 7f36abe00640 1 Processor -- start 2024-09-21T06:11:51.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.079+0000 7f36abe00640 1 -- start start 2024-09-21T06:11:51.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.080+0000 7f36abe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.080+0000 7f36abe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36a40ccf80 0x7f36a41f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.080+0000 7f36abe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a415cfd0 0x7f36a41f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.080+0000 7f36abe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4073ec0 con 0x7f36a40b3a60 2024-09-21T06:11:51.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.080+0000 7f36abe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4073d40 con 0x7f36a415cfd0 2024-09-21T06:11:51.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.080+0000 7f36abe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f36a4074040 con 0x7f36a40ccf80 2024-09-21T06:11:51.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42010/0 (socket says 172.21.15.118:42010) 2024-09-21T06:11:51.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 -- 172.21.15.118:0/2301921935 learned_addr learned my addr 172.21.15.118:0/2301921935 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:51.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9e00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a415cfd0 0x7f36a41f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a8a00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36a40ccf80 0x7f36a41f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 -- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36a40ccf80 msgr2=0x7f36a41f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36a40ccf80 0x7f36a41f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 -- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a415cfd0 msgr2=0x7f36a41f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a415cfd0 0x7f36a41f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.081+0000 7f36a9400640 1 -- 172.21.15.118:0/2301921935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a40c7830 con 0x7f36a40b3a60 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.082+0000 7f36a9400640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40b2d00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f369800c370 tx=0x7f369800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.082+0000 7f36a1600640 1 -- 172.21.15.118:0/2301921935 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698017070 con 0x7f36a40b3a60 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.082+0000 7f36a1600640 1 -- 172.21.15.118:0/2301921935 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36980035f0 con 0x7f36a40b3a60 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.082+0000 7f36a1600640 1 -- 172.21.15.118:0/2301921935 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698003a40 con 0x7f36a40b3a60 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.082+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a4138fb0 con 0x7f36a40b3a60 2024-09-21T06:11:51.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.082+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a40c5fb0 con 0x7f36a40b3a60 2024-09-21T06:11:51.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.083+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a40744f0 con 0x7f36a40b3a60 2024-09-21T06:11:51.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.084+0000 7f36a1600640 1 -- 172.21.15.118:0/2301921935 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f369801a070 con 0x7f36a40b3a60 2024-09-21T06:11:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.085+0000 7f36a1600640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3684078b90 0x7f368407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.085+0000 7f36a1600640 1 -- 172.21.15.118:0/2301921935 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f3698099ee0 con 0x7f36a40b3a60 2024-09-21T06:11:51.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.086+0000 7f36a8a00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3684078b90 0x7f368407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.087+0000 7f36a8a00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3684078b90 0x7f368407b0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3690033000 tx=0x7f3690004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:51.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.090+0000 7f36a1600640 1 -- 172.21.15.118:0/2301921935 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3698061d20 con 0x7f36a40b3a60 2024-09-21T06:11:51.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.346+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f36a4156560 con 0x7f36a40b3a60 2024-09-21T06:11:51.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.346+0000 7f36a1600640 1 -- 172.21.15.118:0/2301921935 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1148 (secure 0 0 0) 0x7f3698066750 con 0x7f36a40b3a60 2024-09-21T06:11:51.349 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:51.349 INFO:teuthology.orchestra.run.smithi118.stdout:{"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":496,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":149,"num_osds":8,"num_up_osds":8,"osd_up_since":1726898623,"num_in_osds":8,"osd_in_since":1726898620,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":7852444,"bytes_avail":1592147556,"bytes_total":1600000000},"fsmap":{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":7377}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-21T06:11:30.577592+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T06:11:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.348+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3684078b90 msgr2=0x7f368407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.348+0000 7f36abe00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3684078b90 0x7f368407b0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3690033000 tx=0x7f3690004730 comp rx=0 tx=0).stop 2024-09-21T06:11:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.348+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 msgr2=0x7f36a40b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.348+0000 7f36abe00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40b2d00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f369800c370 tx=0x7f369800c830 comp rx=0 tx=0).stop 2024-09-21T06:11:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 shutdown_connections 2024-09-21T06:11:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36a415cfd0 0x7f36a41f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3684078b90 0x7f368407b0a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f36a40ccf80 0x7f36a41f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 --2- 172.21.15.118:0/2301921935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36a40b3a60 0x7f36a40b2d00 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 >> 172.21.15.118:0/2301921935 conn(0x7f36a406d110 msgr2=0x7f36a40b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 shutdown_connections 2024-09-21T06:11:51.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.349+0000 7f36abe00640 1 -- 172.21.15.118:0/2301921935 wait complete. 2024-09-21T06:11:51.377 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T06:11:51.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:51.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 -- 172.21.15.118:0/3210282299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fae0 msgr2=0x7f40880d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 --2- 172.21.15.118:0/3210282299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fae0 0x7f40880d0e80 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4078005fd0 tx=0x7f407802a530 comp rx=0 tx=0).stop 2024-09-21T06:11:51.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 -- 172.21.15.118:0/3210282299 shutdown_connections 2024-09-21T06:11:51.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 --2- 172.21.15.118:0/3210282299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408813fef0 0x7f40880d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 --2- 172.21.15.118:0/3210282299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fae0 0x7f40880d0e80 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 -- 172.21.15.118:0/3210282299 >> 172.21.15.118:0/3210282299 conn(0x7f408806d110 msgr2=0x7f408806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:51.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 -- 172.21.15.118:0/3210282299 shutdown_connections 2024-09-21T06:11:51.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.596+0000 7f408ec00640 1 -- 172.21.15.118:0/3210282299 wait complete. 2024-09-21T06:11:51.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.599+0000 7f408ec00640 1 Processor -- start 2024-09-21T06:11:51.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.599+0000 7f408ec00640 1 -- start start 2024-09-21T06:11:51.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f408ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408813fae0 0x7f4088152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f408ec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fef0 0x7f40880b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f408ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4088142730 0x7f40880b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f408ec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f40880cfab0 con 0x7f408813fef0 2024-09-21T06:11:51.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f408ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40880cf930 con 0x7f4088142730 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f408ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f40880cfc30 con 0x7f408813fae0 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f4087400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fef0 0x7f40880b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f4087400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fef0 0x7f40880b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42024/0 (socket says 172.21.15.118:42024) 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.600+0000 7f4087400640 1 -- 172.21.15.118:0/2827921954 learned_addr learned my addr 172.21.15.118:0/2827921954 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087e00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408813fae0 0x7f4088152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f408cc00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4088142730 0x7f40880b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087400640 1 -- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408813fae0 msgr2=0x7f4088152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087400640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408813fae0 0x7f4088152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087400640 1 -- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4088142730 msgr2=0x7f40880b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087400640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4088142730 0x7f40880b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087400640 1 -- 172.21.15.118:0/2827921954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088152e40 con 0x7f408813fef0 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087e00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408813fae0 0x7f4088152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f408cc00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4088142730 0x7f40880b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:51.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f4087400640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fef0 0x7f40880b4be0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f407400c970 tx=0x7f407400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f407fe00640 1 -- 172.21.15.118:0/2827921954 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074007bb0 con 0x7f408813fef0 2024-09-21T06:11:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f407fe00640 1 -- 172.21.15.118:0/2827921954 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4074007e40 con 0x7f408813fef0 2024-09-21T06:11:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.601+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40881f3f70 con 0x7f408813fef0 2024-09-21T06:11:51.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.602+0000 7f407fe00640 1 -- 172.21.15.118:0/2827921954 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407400f6b0 con 0x7f408813fef0 2024-09-21T06:11:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.602+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881f44d0 con 0x7f408813fef0 2024-09-21T06:11:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.603+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40881f82c0 con 0x7f408813fef0 2024-09-21T06:11:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.604+0000 7f407fe00640 1 -- 172.21.15.118:0/2827921954 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f407400f850 con 0x7f408813fef0 2024-09-21T06:11:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.605+0000 7f407fe00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4068078bc0 0x7f406807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.605+0000 7f407fe00640 1 -- 172.21.15.118:0/2827921954 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f407409b6a0 con 0x7f408813fef0 2024-09-21T06:11:51.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.605+0000 7f4087e00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4068078bc0 0x7f406807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:51.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.606+0000 7f4087e00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4068078bc0 0x7f406807b0d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4078033000 tx=0x7f4078004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:51.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.609+0000 7f407fe00640 1 -- 172.21.15.118:0/2827921954 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f40881f3f70 con 0x7f408813fef0 2024-09-21T06:11:51.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.794+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40880d0190 con 0x7f4068078bc0 2024-09-21T06:11:51.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.800+0000 7f407fe00640 1 -- 172.21.15.118:0/2827921954 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247973 (secure 0 0 0) 0x7f40880d0190 con 0x7f4068078bc0 2024-09-21T06:11:51.805 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:51.806 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4068078bc0 msgr2=0x7f406807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4068078bc0 0x7f406807b0d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4078033000 tx=0x7f4078004730 comp rx=0 tx=0).stop 2024-09-21T06:11:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fef0 msgr2=0x7f40880b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fef0 0x7f40880b4be0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f407400c970 tx=0x7f407400ce30 comp rx=0 tx=0).stop 2024-09-21T06:11:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 shutdown_connections 2024-09-21T06:11:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4088142730 0x7f40880b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f408813fef0 0x7f40880b4be0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4068078bc0 0x7f406807b0d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 --2- 172.21.15.118:0/2827921954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f408813fae0 0x7f4088152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 >> 172.21.15.118:0/2827921954 conn(0x7f408806d110 msgr2=0x7f408815f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 shutdown_connections 2024-09-21T06:11:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:51.804+0000 7f408ec00640 1 -- 172.21.15.118:0/2827921954 wait complete. 2024-09-21T06:11:51.831 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-21T06:11:50.582578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554831,"statfs":{"total":1600000000,"available":1592147556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001780"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551975+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:44.551975+0000","last_peered":"2024-09-21T06:11:44.551975+0000","last_clean":"2024-09-21T06:11:44.551975+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:44.551975+0000","last_undegraded":"2024-09-21T06:11:44.551975+0000","last_fullsized":"2024-09-21T06:11:44.551975+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629267+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:44.629267+0000","last_peered":"2024-09-21T06:11:44.629267+0000","last_clean":"2024-09-21T06:11:44.629267+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:44.629267+0000","last_undegraded":"2024-09-21T06:11:44.629267+0000","last_fullsized":"2024-09-21T06:11:44.629267+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629773+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:44.629773+0000","last_peered":"2024-09-21T06:11:44.629773+0000","last_clean":"2024-09-21T06:11:44.629773+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:44.629773+0000","last_undegraded":"2024-09-21T06:11:44.629773+0000","last_fullsized":"2024-09-21T06:11:44.629773+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551234+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:44.551234+0000","last_peered":"2024-09-21T06:11:44.551234+0000","last_clean":"2024-09-21T06:11:44.551234+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:44.551234+0000","last_undegraded":"2024-09-21T06:11:44.551234+0000","last_fullsized":"2024-09-21T06:11:44.551234+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551873+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:44.551873+0000","last_peered":"2024-09-21T06:11:44.551873+0000","last_clean":"2024-09-21T06:11:44.551873+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:44.551873+0000","last_undegraded":"2024-09-21T06:11:44.551873+0000","last_fullsized":"2024-09-21T06:11:44.551873+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630159+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:44.630159+0000","last_peered":"2024-09-21T06:11:44.630159+0000","last_clean":"2024-09-21T06:11:44.630159+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:44.630159+0000","last_undegraded":"2024-09-21T06:11:44.630159+0000","last_fullsized":"2024-09-21T06:11:44.630159+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630590+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:44.630590+0000","last_peered":"2024-09-21T06:11:44.630590+0000","last_clean":"2024-09-21T06:11:44.630590+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:44.630590+0000","last_undegraded":"2024-09-21T06:11:44.630590+0000","last_fullsized":"2024-09-21T06:11:44.630590+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629885+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:44.629885+0000","last_peered":"2024-09-21T06:11:44.629885+0000","last_clean":"2024-09-21T06:11:44.629885+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:44.629885+0000","last_undegraded":"2024-09-21T06:11:44.629885+0000","last_fullsized":"2024-09-21T06:11:44.629885+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629886+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:44.629886+0000","last_peered":"2024-09-21T06:11:44.629886+0000","last_clean":"2024-09-21T06:11:44.629886+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:44.629886+0000","last_undegraded":"2024-09-21T06:11:44.629886+0000","last_fullsized":"2024-09-21T06:11:44.629886+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629656+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:44.629656+0000","last_peered":"2024-09-21T06:11:44.629656+0000","last_clean":"2024-09-21T06:11:44.629656+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:44.629656+0000","last_undegraded":"2024-09-21T06:11:44.629656+0000","last_fullsized":"2024-09-21T06:11:44.629656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630050+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:44.630050+0000","last_peered":"2024-09-21T06:11:44.630050+0000","last_clean":"2024-09-21T06:11:44.630050+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:44.630050+0000","last_undegraded":"2024-09-21T06:11:44.630050+0000","last_fullsized":"2024-09-21T06:11:44.630050+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630180+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:44.630180+0000","last_peered":"2024-09-21T06:11:44.630180+0000","last_clean":"2024-09-21T06:11:44.630180+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:44.630180+0000","last_undegraded":"2024-09-21T06:11:44.630180+0000","last_fullsized":"2024-09-21T06:11:44.630180+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551235+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:44.551235+0000","last_peered":"2024-09-21T06:11:44.551235+0000","last_clean":"2024-09-21T06:11:44.551235+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:44.551235+0000","last_undegraded":"2024-09-21T06:11:44.551235+0000","last_fullsized":"2024-09-21T06:11:44.551235+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628870+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:44.628870+0000","last_peered":"2024-09-21T06:11:44.628870+0000","last_clean":"2024-09-21T06:11:44.628870+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:44.628870+0000","last_undegraded":"2024-09-21T06:11:44.628870+0000","last_fullsized":"2024-09-21T06:11:44.628870+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551569+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:44.551569+0000","last_peered":"2024-09-21T06:11:44.551569+0000","last_clean":"2024-09-21T06:11:44.551569+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:44.551569+0000","last_undegraded":"2024-09-21T06:11:44.551569+0000","last_fullsized":"2024-09-21T06:11:44.551569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631444+0000","last_change":"2024-09-21T06:11:44.631330+0000","last_active":"2024-09-21T06:11:44.631444+0000","last_peered":"2024-09-21T06:11:44.631444+0000","last_clean":"2024-09-21T06:11:44.631444+0000","last_became_active":"2024-09-21T06:11:44.631036+0000","last_became_peered":"2024-09-21T06:11:44.631036+0000","last_unstale":"2024-09-21T06:11:44.631444+0000","last_undegraded":"2024-09-21T06:11:44.631444+0000","last_fullsized":"2024-09-21T06:11:44.631444+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:14.653905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630725+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:44.630725+0000","last_peered":"2024-09-21T06:11:44.630725+0000","last_clean":"2024-09-21T06:11:44.630725+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:44.630725+0000","last_undegraded":"2024-09-21T06:11:44.630725+0000","last_fullsized":"2024-09-21T06:11:44.630725+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550178+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:44.550178+0000","last_peered":"2024-09-21T06:11:44.550178+0000","last_clean":"2024-09-21T06:11:44.550178+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:44.550178+0000","last_undegraded":"2024-09-21T06:11:44.550178+0000","last_fullsized":"2024-09-21T06:11:44.550178+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628895+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:44.628895+0000","last_peered":"2024-09-21T06:11:44.628895+0000","last_clean":"2024-09-21T06:11:44.628895+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:44.628895+0000","last_undegraded":"2024-09-21T06:11:44.628895+0000","last_fullsized":"2024-09-21T06:11:44.628895+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550152+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:44.550152+0000","last_peered":"2024-09-21T06:11:44.550152+0000","last_clean":"2024-09-21T06:11:44.550152+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:44.550152+0000","last_undegraded":"2024-09-21T06:11:44.550152+0000","last_fullsized":"2024-09-21T06:11:44.550152+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552618+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:44.552618+0000","last_peered":"2024-09-21T06:11:44.552618+0000","last_clean":"2024-09-21T06:11:44.552618+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:44.552618+0000","last_undegraded":"2024-09-21T06:11:44.552618+0000","last_fullsized":"2024-09-21T06:11:44.552618+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629110+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:44.629110+0000","last_peered":"2024-09-21T06:11:44.629110+0000","last_clean":"2024-09-21T06:11:44.629110+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:44.629110+0000","last_undegraded":"2024-09-21T06:11:44.629110+0000","last_fullsized":"2024-09-21T06:11:44.629110+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630160+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:44.630160+0000","last_peered":"2024-09-21T06:11:44.630160+0000","last_clean":"2024-09-21T06:11:44.630160+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:44.630160+0000","last_undegraded":"2024-09-21T06:11:44.630160+0000","last_fullsized":"2024-09-21T06:11:44.630160+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629755+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:44.629755+0000","last_peered":"2024-09-21T06:11:44.629755+0000","last_clean":"2024-09-21T06:11:44.629755+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:44.629755+0000","last_undegraded":"2024-09-21T06:11:44.629755+0000","last_fullsized":"2024-09-21T06:11:44.629755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550695+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:44.550695+0000","last_peered":"2024-09-21T06:11:44.550695+0000","last_clean":"2024-09-21T06:11:44.550695+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:44.550695+0000","last_undegraded":"2024-09-21T06:11:44.550695+0000","last_fullsized":"2024-09-21T06:11:44.550695+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551170+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:44.551170+0000","last_peered":"2024-09-21T06:11:44.551170+0000","last_clean":"2024-09-21T06:11:44.551170+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:44.551170+0000","last_undegraded":"2024-09-21T06:11:44.551170+0000","last_fullsized":"2024-09-21T06:11:44.551170+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629266+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:44.629266+0000","last_peered":"2024-09-21T06:11:44.629266+0000","last_clean":"2024-09-21T06:11:44.629266+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:44.629266+0000","last_undegraded":"2024-09-21T06:11:44.629266+0000","last_fullsized":"2024-09-21T06:11:44.629266+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551530+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:44.551530+0000","last_peered":"2024-09-21T06:11:44.551530+0000","last_clean":"2024-09-21T06:11:44.551530+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:44.551530+0000","last_undegraded":"2024-09-21T06:11:44.551530+0000","last_fullsized":"2024-09-21T06:11:44.551530+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551738+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:44.551738+0000","last_peered":"2024-09-21T06:11:44.551738+0000","last_clean":"2024-09-21T06:11:44.551738+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:44.551738+0000","last_undegraded":"2024-09-21T06:11:44.551738+0000","last_fullsized":"2024-09-21T06:11:44.551738+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631400+0000","last_change":"2024-09-21T06:11:44.631304+0000","last_active":"2024-09-21T06:11:44.631400+0000","last_peered":"2024-09-21T06:11:44.631400+0000","last_clean":"2024-09-21T06:11:44.631400+0000","last_became_active":"2024-09-21T06:11:44.631094+0000","last_became_peered":"2024-09-21T06:11:44.631094+0000","last_unstale":"2024-09-21T06:11:44.631400+0000","last_undegraded":"2024-09-21T06:11:44.631400+0000","last_fullsized":"2024-09-21T06:11:44.631400+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:44.784235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630658+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:44.630658+0000","last_peered":"2024-09-21T06:11:44.630658+0000","last_clean":"2024-09-21T06:11:44.630658+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:44.630658+0000","last_undegraded":"2024-09-21T06:11:44.630658+0000","last_fullsized":"2024-09-21T06:11:44.630658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550085+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:44.550085+0000","last_peered":"2024-09-21T06:11:44.550085+0000","last_clean":"2024-09-21T06:11:44.550085+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:44.550085+0000","last_undegraded":"2024-09-21T06:11:44.550085+0000","last_fullsized":"2024-09-21T06:11:44.550085+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551828+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:44.551828+0000","last_peered":"2024-09-21T06:11:44.551828+0000","last_clean":"2024-09-21T06:11:44.551828+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:44.551828+0000","last_undegraded":"2024-09-21T06:11:44.551828+0000","last_fullsized":"2024-09-21T06:11:44.551828+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630001+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:44.630001+0000","last_peered":"2024-09-21T06:11:44.630001+0000","last_clean":"2024-09-21T06:11:44.630001+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:44.630001+0000","last_undegraded":"2024-09-21T06:11:44.630001+0000","last_fullsized":"2024-09-21T06:11:44.630001+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629475+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:44.629475+0000","last_peered":"2024-09-21T06:11:44.629475+0000","last_clean":"2024-09-21T06:11:44.629475+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:44.629475+0000","last_undegraded":"2024-09-21T06:11:44.629475+0000","last_fullsized":"2024-09-21T06:11:44.629475+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552385+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:44.552385+0000","last_peered":"2024-09-21T06:11:44.552385+0000","last_clean":"2024-09-21T06:11:44.552385+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:44.552385+0000","last_undegraded":"2024-09-21T06:11:44.552385+0000","last_fullsized":"2024-09-21T06:11:44.552385+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629527+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:44.629527+0000","last_peered":"2024-09-21T06:11:44.629527+0000","last_clean":"2024-09-21T06:11:44.629527+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:44.629527+0000","last_undegraded":"2024-09-21T06:11:44.629527+0000","last_fullsized":"2024-09-21T06:11:44.629527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551999+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:44.551999+0000","last_peered":"2024-09-21T06:11:44.551999+0000","last_clean":"2024-09-21T06:11:44.551999+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:44.551999+0000","last_undegraded":"2024-09-21T06:11:44.551999+0000","last_fullsized":"2024-09-21T06:11:44.551999+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629504+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:44.629504+0000","last_peered":"2024-09-21T06:11:44.629504+0000","last_clean":"2024-09-21T06:11:44.629504+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:44.629504+0000","last_undegraded":"2024-09-21T06:11:44.629504+0000","last_fullsized":"2024-09-21T06:11:44.629504+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550350+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:44.550350+0000","last_peered":"2024-09-21T06:11:44.550350+0000","last_clean":"2024-09-21T06:11:44.550350+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:44.550350+0000","last_undegraded":"2024-09-21T06:11:44.550350+0000","last_fullsized":"2024-09-21T06:11:44.550350+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629382+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:44.629382+0000","last_peered":"2024-09-21T06:11:44.629382+0000","last_clean":"2024-09-21T06:11:44.629382+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:44.629382+0000","last_undegraded":"2024-09-21T06:11:44.629382+0000","last_fullsized":"2024-09-21T06:11:44.629382+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630861+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:44.630861+0000","last_peered":"2024-09-21T06:11:44.630861+0000","last_clean":"2024-09-21T06:11:44.630861+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:44.630861+0000","last_undegraded":"2024-09-21T06:11:44.630861+0000","last_fullsized":"2024-09-21T06:11:44.630861+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550583+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:44.550583+0000","last_peered":"2024-09-21T06:11:44.550583+0000","last_clean":"2024-09-21T06:11:44.550583+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:44.550583+0000","last_undegraded":"2024-09-21T06:11:44.550583+0000","last_fullsized":"2024-09-21T06:11:44.550583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630453+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:44.630453+0000","last_peered":"2024-09-21T06:11:44.630453+0000","last_clean":"2024-09-21T06:11:44.630453+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:44.630453+0000","last_undegraded":"2024-09-21T06:11:44.630453+0000","last_fullsized":"2024-09-21T06:11:44.630453+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629892+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:44.629892+0000","last_peered":"2024-09-21T06:11:44.629892+0000","last_clean":"2024-09-21T06:11:44.629892+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:44.629892+0000","last_undegraded":"2024-09-21T06:11:44.629892+0000","last_fullsized":"2024-09-21T06:11:44.629892+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629006+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:44.629006+0000","last_peered":"2024-09-21T06:11:44.629006+0000","last_clean":"2024-09-21T06:11:44.629006+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:44.629006+0000","last_undegraded":"2024-09-21T06:11:44.629006+0000","last_fullsized":"2024-09-21T06:11:44.629006+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629896+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:44.629896+0000","last_peered":"2024-09-21T06:11:44.629896+0000","last_clean":"2024-09-21T06:11:44.629896+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:44.629896+0000","last_undegraded":"2024-09-21T06:11:44.629896+0000","last_fullsized":"2024-09-21T06:11:44.629896+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551428+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:44.551428+0000","last_peered":"2024-09-21T06:11:44.551428+0000","last_clean":"2024-09-21T06:11:44.551428+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:44.551428+0000","last_undegraded":"2024-09-21T06:11:44.551428+0000","last_fullsized":"2024-09-21T06:11:44.551428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629867+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:44.629867+0000","last_peered":"2024-09-21T06:11:44.629867+0000","last_clean":"2024-09-21T06:11:44.629867+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:44.629867+0000","last_undegraded":"2024-09-21T06:11:44.629867+0000","last_fullsized":"2024-09-21T06:11:44.629867+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629302+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:44.629302+0000","last_peered":"2024-09-21T06:11:44.629302+0000","last_clean":"2024-09-21T06:11:44.629302+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:44.629302+0000","last_undegraded":"2024-09-21T06:11:44.629302+0000","last_fullsized":"2024-09-21T06:11:44.629302+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550286+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:44.550286+0000","last_peered":"2024-09-21T06:11:44.550286+0000","last_clean":"2024-09-21T06:11:44.550286+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:44.550286+0000","last_undegraded":"2024-09-21T06:11:44.550286+0000","last_fullsized":"2024-09-21T06:11:44.550286+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551730+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:44.551730+0000","last_peered":"2024-09-21T06:11:44.551730+0000","last_clean":"2024-09-21T06:11:44.551730+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:44.551730+0000","last_undegraded":"2024-09-21T06:11:44.551730+0000","last_fullsized":"2024-09-21T06:11:44.551730+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":22,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629419+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:44.629419+0000","last_peered":"2024-09-21T06:11:44.629419+0000","last_clean":"2024-09-21T06:11:44.629419+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:44.629419+0000","last_undegraded":"2024-09-21T06:11:44.629419+0000","last_fullsized":"2024-09-21T06:11:44.629419+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551578+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:44.551578+0000","last_peered":"2024-09-21T06:11:44.551578+0000","last_clean":"2024-09-21T06:11:44.551578+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:44.551578+0000","last_undegraded":"2024-09-21T06:11:44.551578+0000","last_fullsized":"2024-09-21T06:11:44.551578+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":25,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630145+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:44.630145+0000","last_peered":"2024-09-21T06:11:44.630145+0000","last_clean":"2024-09-21T06:11:44.630145+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:44.630145+0000","last_undegraded":"2024-09-21T06:11:44.630145+0000","last_fullsized":"2024-09-21T06:11:44.630145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551939+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:44.551939+0000","last_peered":"2024-09-21T06:11:44.551939+0000","last_clean":"2024-09-21T06:11:44.551939+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:44.551939+0000","last_undegraded":"2024-09-21T06:11:44.551939+0000","last_fullsized":"2024-09-21T06:11:44.551939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552151+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:44.552151+0000","last_peered":"2024-09-21T06:11:44.552151+0000","last_clean":"2024-09-21T06:11:44.552151+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:44.552151+0000","last_undegraded":"2024-09-21T06:11:44.552151+0000","last_fullsized":"2024-09-21T06:11:44.552151+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629501+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:44.629501+0000","last_peered":"2024-09-21T06:11:44.629501+0000","last_clean":"2024-09-21T06:11:44.629501+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:44.629501+0000","last_undegraded":"2024-09-21T06:11:44.629501+0000","last_fullsized":"2024-09-21T06:11:44.629501+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630306+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:44.630306+0000","last_peered":"2024-09-21T06:11:44.630306+0000","last_clean":"2024-09-21T06:11:44.630306+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:44.630306+0000","last_undegraded":"2024-09-21T06:11:44.630306+0000","last_fullsized":"2024-09-21T06:11:44.630306+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":27,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630346+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:44.630346+0000","last_peered":"2024-09-21T06:11:44.630346+0000","last_clean":"2024-09-21T06:11:44.630346+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:44.630346+0000","last_undegraded":"2024-09-21T06:11:44.630346+0000","last_fullsized":"2024-09-21T06:11:44.630346+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630521+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:44.630521+0000","last_peered":"2024-09-21T06:11:44.630521+0000","last_clean":"2024-09-21T06:11:44.630521+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:44.630521+0000","last_undegraded":"2024-09-21T06:11:44.630521+0000","last_fullsized":"2024-09-21T06:11:44.630521+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629597+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:44.629597+0000","last_peered":"2024-09-21T06:11:44.629597+0000","last_clean":"2024-09-21T06:11:44.629597+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:44.629597+0000","last_undegraded":"2024-09-21T06:11:44.629597+0000","last_fullsized":"2024-09-21T06:11:44.629597+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629300+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:44.629300+0000","last_peered":"2024-09-21T06:11:44.629300+0000","last_clean":"2024-09-21T06:11:44.629300+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:44.629300+0000","last_undegraded":"2024-09-21T06:11:44.629300+0000","last_fullsized":"2024-09-21T06:11:44.629300+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629660+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:44.629660+0000","last_peered":"2024-09-21T06:11:44.629660+0000","last_clean":"2024-09-21T06:11:44.629660+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:44.629660+0000","last_undegraded":"2024-09-21T06:11:44.629660+0000","last_fullsized":"2024-09-21T06:11:44.629660+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550034+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:44.550034+0000","last_peered":"2024-09-21T06:11:44.550034+0000","last_clean":"2024-09-21T06:11:44.550034+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:44.550034+0000","last_undegraded":"2024-09-21T06:11:44.550034+0000","last_fullsized":"2024-09-21T06:11:44.550034+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630354+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:44.630354+0000","last_peered":"2024-09-21T06:11:44.630354+0000","last_clean":"2024-09-21T06:11:44.630354+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:44.630354+0000","last_undegraded":"2024-09-21T06:11:44.630354+0000","last_fullsized":"2024-09-21T06:11:44.630354+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629612+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:44.629612+0000","last_peered":"2024-09-21T06:11:44.629612+0000","last_clean":"2024-09-21T06:11:44.629612+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:44.629612+0000","last_undegraded":"2024-09-21T06:11:44.629612+0000","last_fullsized":"2024-09-21T06:11:44.629612+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629850+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:44.629850+0000","last_peered":"2024-09-21T06:11:44.629850+0000","last_clean":"2024-09-21T06:11:44.629850+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:44.629850+0000","last_undegraded":"2024-09-21T06:11:44.629850+0000","last_fullsized":"2024-09-21T06:11:44.629850+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551626+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:44.551626+0000","last_peered":"2024-09-21T06:11:44.551626+0000","last_clean":"2024-09-21T06:11:44.551626+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:44.551626+0000","last_undegraded":"2024-09-21T06:11:44.551626+0000","last_fullsized":"2024-09-21T06:11:44.551626+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629547+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:44.629547+0000","last_peered":"2024-09-21T06:11:44.629547+0000","last_clean":"2024-09-21T06:11:44.629547+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:44.629547+0000","last_undegraded":"2024-09-21T06:11:44.629547+0000","last_fullsized":"2024-09-21T06:11:44.629547+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630294+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:44.630294+0000","last_peered":"2024-09-21T06:11:44.630294+0000","last_clean":"2024-09-21T06:11:44.630294+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:44.630294+0000","last_undegraded":"2024-09-21T06:11:44.630294+0000","last_fullsized":"2024-09-21T06:11:44.630294+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550387+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:44.550387+0000","last_peered":"2024-09-21T06:11:44.550387+0000","last_clean":"2024-09-21T06:11:44.550387+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:44.550387+0000","last_undegraded":"2024-09-21T06:11:44.550387+0000","last_fullsized":"2024-09-21T06:11:44.550387+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629393+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:44.629393+0000","last_peered":"2024-09-21T06:11:44.629393+0000","last_clean":"2024-09-21T06:11:44.629393+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:44.629393+0000","last_undegraded":"2024-09-21T06:11:44.629393+0000","last_fullsized":"2024-09-21T06:11:44.629393+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551746+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:44.551746+0000","last_peered":"2024-09-21T06:11:44.551746+0000","last_clean":"2024-09-21T06:11:44.551746+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:44.551746+0000","last_undegraded":"2024-09-21T06:11:44.551746+0000","last_fullsized":"2024-09-21T06:11:44.551746+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630352+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:44.630352+0000","last_peered":"2024-09-21T06:11:44.630352+0000","last_clean":"2024-09-21T06:11:44.630352+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:44.630352+0000","last_undegraded":"2024-09-21T06:11:44.630352+0000","last_fullsized":"2024-09-21T06:11:44.630352+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630468+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:44.630468+0000","last_peered":"2024-09-21T06:11:44.630468+0000","last_clean":"2024-09-21T06:11:44.630468+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:44.630468+0000","last_undegraded":"2024-09-21T06:11:44.630468+0000","last_fullsized":"2024-09-21T06:11:44.630468+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551714+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:44.551714+0000","last_peered":"2024-09-21T06:11:44.551714+0000","last_clean":"2024-09-21T06:11:44.551714+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:44.551714+0000","last_undegraded":"2024-09-21T06:11:44.551714+0000","last_fullsized":"2024-09-21T06:11:44.551714+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551574+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:44.551574+0000","last_peered":"2024-09-21T06:11:44.551574+0000","last_clean":"2024-09-21T06:11:44.551574+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:44.551574+0000","last_undegraded":"2024-09-21T06:11:44.551574+0000","last_fullsized":"2024-09-21T06:11:44.551574+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551983+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:44.551983+0000","last_peered":"2024-09-21T06:11:44.551983+0000","last_clean":"2024-09-21T06:11:44.551983+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:44.551983+0000","last_undegraded":"2024-09-21T06:11:44.551983+0000","last_fullsized":"2024-09-21T06:11:44.551983+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629818+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:44.629818+0000","last_peered":"2024-09-21T06:11:44.629818+0000","last_clean":"2024-09-21T06:11:44.629818+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:44.629818+0000","last_undegraded":"2024-09-21T06:11:44.629818+0000","last_fullsized":"2024-09-21T06:11:44.629818+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629128+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:44.629128+0000","last_peered":"2024-09-21T06:11:44.629128+0000","last_clean":"2024-09-21T06:11:44.629128+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:44.629128+0000","last_undegraded":"2024-09-21T06:11:44.629128+0000","last_fullsized":"2024-09-21T06:11:44.629128+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629775+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:44.629775+0000","last_peered":"2024-09-21T06:11:44.629775+0000","last_clean":"2024-09-21T06:11:44.629775+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:44.629775+0000","last_undegraded":"2024-09-21T06:11:44.629775+0000","last_fullsized":"2024-09-21T06:11:44.629775+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629788+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:44.629788+0000","last_peered":"2024-09-21T06:11:44.629788+0000","last_clean":"2024-09-21T06:11:44.629788+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:44.629788+0000","last_undegraded":"2024-09-21T06:11:44.629788+0000","last_fullsized":"2024-09-21T06:11:44.629788+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551490+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:44.551490+0000","last_peered":"2024-09-21T06:11:44.551490+0000","last_clean":"2024-09-21T06:11:44.551490+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:44.551490+0000","last_undegraded":"2024-09-21T06:11:44.551490+0000","last_fullsized":"2024-09-21T06:11:44.551490+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629717+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:44.629717+0000","last_peered":"2024-09-21T06:11:44.629717+0000","last_clean":"2024-09-21T06:11:44.629717+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:44.629717+0000","last_undegraded":"2024-09-21T06:11:44.629717+0000","last_fullsized":"2024-09-21T06:11:44.629717+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629754+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:44.629754+0000","last_peered":"2024-09-21T06:11:44.629754+0000","last_clean":"2024-09-21T06:11:44.629754+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:44.629754+0000","last_undegraded":"2024-09-21T06:11:44.629754+0000","last_fullsized":"2024-09-21T06:11:44.629754+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551789+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:44.551789+0000","last_peered":"2024-09-21T06:11:44.551789+0000","last_clean":"2024-09-21T06:11:44.551789+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:44.551789+0000","last_undegraded":"2024-09-21T06:11:44.551789+0000","last_fullsized":"2024-09-21T06:11:44.551789+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550719+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:44.550719+0000","last_peered":"2024-09-21T06:11:44.550719+0000","last_clean":"2024-09-21T06:11:44.550719+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:44.550719+0000","last_undegraded":"2024-09-21T06:11:44.550719+0000","last_fullsized":"2024-09-21T06:11:44.550719+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629129+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:44.629129+0000","last_peered":"2024-09-21T06:11:44.629129+0000","last_clean":"2024-09-21T06:11:44.629129+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:44.629129+0000","last_undegraded":"2024-09-21T06:11:44.629129+0000","last_fullsized":"2024-09-21T06:11:44.629129+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629188+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:44.629188+0000","last_peered":"2024-09-21T06:11:44.629188+0000","last_clean":"2024-09-21T06:11:44.629188+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:44.629188+0000","last_undegraded":"2024-09-21T06:11:44.629188+0000","last_fullsized":"2024-09-21T06:11:44.629188+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552507+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:44.552507+0000","last_peered":"2024-09-21T06:11:44.552507+0000","last_clean":"2024-09-21T06:11:44.552507+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:44.552507+0000","last_undegraded":"2024-09-21T06:11:44.552507+0000","last_fullsized":"2024-09-21T06:11:44.552507+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552145+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:44.552145+0000","last_peered":"2024-09-21T06:11:44.552145+0000","last_clean":"2024-09-21T06:11:44.552145+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:44.552145+0000","last_undegraded":"2024-09-21T06:11:44.552145+0000","last_fullsized":"2024-09-21T06:11:44.552145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":376,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552122+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:44.552122+0000","last_peered":"2024-09-21T06:11:44.552122+0000","last_clean":"2024-09-21T06:11:44.552122+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:44.552122+0000","last_undegraded":"2024-09-21T06:11:44.552122+0000","last_fullsized":"2024-09-21T06:11:44.552122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166479,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1390,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193922,"statfs":{"total":200000000,"available":198576271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1392,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193919,"statfs":{"total":200000000,"available":198574021,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":814,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166023,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:54.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:11:55.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.063+0000 7f62c0600640 1 -- 172.21.15.118:0/1576772310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5040 msgr2=0x7f62b80cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.063+0000 7f62c0600640 1 --2- 172.21.15.118:0/1576772310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5040 0x7f62b80cca40 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f62a4005fd0 tx=0x7f62a402a540 comp rx=0 tx=0).stop 2024-09-21T06:11:55.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.064+0000 7f62c0600640 1 -- 172.21.15.118:0/1576772310 shutdown_connections 2024-09-21T06:11:55.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.064+0000 7f62c0600640 1 --2- 172.21.15.118:0/1576772310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5040 0x7f62b80cca40 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.064+0000 7f62c0600640 1 --2- 172.21.15.118:0/1576772310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62b815cfd0 0x7f62b80b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.064+0000 7f62c0600640 1 -- 172.21.15.118:0/1576772310 >> 172.21.15.118:0/1576772310 conn(0x7f62b806d110 msgr2=0x7f62b806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:55.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.064+0000 7f62c0600640 1 -- 172.21.15.118:0/1576772310 shutdown_connections 2024-09-21T06:11:55.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.064+0000 7f62c0600640 1 -- 172.21.15.118:0/1576772310 wait complete. 2024-09-21T06:11:55.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.066+0000 7f62c0600640 1 Processor -- start 2024-09-21T06:11:55.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.066+0000 7f62c0600640 1 -- start start 2024-09-21T06:11:55.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.067+0000 7f62c0600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62b80b5040 0x7f62b80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.067+0000 7f62c0600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5450 0x7f62b80b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.067+0000 7f62c0600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62b815cfd0 0x7f62b8137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.067+0000 7f62c0600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8073c10 con 0x7f62b80b5450 2024-09-21T06:11:55.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.067+0000 7f62c0600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8073a90 con 0x7f62b815cfd0 2024-09-21T06:11:55.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.067+0000 7f62c0600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62b8073d90 con 0x7f62b80b5040 2024-09-21T06:11:55.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5450 0x7f62b80b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5450 0x7f62b80b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42050/0 (socket says 172.21.15.118:42050) 2024-09-21T06:11:55.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 -- 172.21.15.118:0/4277093746 learned_addr learned my addr 172.21.15.118:0/4277093746 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:55.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bdc00640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62b80b5040 0x7f62b80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62be600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62b815cfd0 0x7f62b8137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 -- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62b80b5040 msgr2=0x7f62b80cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62b80b5040 0x7f62b80cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 -- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62b815cfd0 msgr2=0x7f62b8137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62b815cfd0 0x7f62b8137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.068+0000 7f62bd200640 1 -- 172.21.15.118:0/4277093746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b80ccf30 con 0x7f62b80b5450 2024-09-21T06:11:55.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.069+0000 7f62bd200640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5450 0x7f62b80b2f90 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000c00 tx=0x7f62a40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:55.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.069+0000 7f62b5600640 1 -- 172.21.15.118:0/4277093746 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a403e030 con 0x7f62b80b5450 2024-09-21T06:11:55.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.069+0000 7f62b5600640 1 -- 172.21.15.118:0/4277093746 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a4003db0 con 0x7f62b80b5450 2024-09-21T06:11:55.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.069+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b80cedf0 con 0x7f62b80b5450 2024-09-21T06:11:55.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.069+0000 7f62b5600640 1 -- 172.21.15.118:0/4277093746 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4035040 con 0x7f62b80b5450 2024-09-21T06:11:55.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.069+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b80cc9c0 con 0x7f62b80b5450 2024-09-21T06:11:55.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.070+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b80ccca0 con 0x7f62b80b5450 2024-09-21T06:11:55.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.071+0000 7f62b5600640 1 -- 172.21.15.118:0/4277093746 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62a4041030 con 0x7f62b80b5450 2024-09-21T06:11:55.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.072+0000 7f62b5600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6298078bc0 0x7f629807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.072+0000 7f62b5600640 1 -- 172.21.15.118:0/4277093746 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f62a40bb4a0 con 0x7f62b80b5450 2024-09-21T06:11:55.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.073+0000 7f62bdc00640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6298078bc0 0x7f629807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.073+0000 7f62bdc00640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6298078bc0 0x7f629807b0d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009b30 tx=0x7f62ac005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:55.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.077+0000 7f62b5600640 1 -- 172.21.15.118:0/4277093746 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f62a40831b0 con 0x7f62b80b5450 2024-09-21T06:11:55.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.258+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62b80cec10 con 0x7f6298078bc0 2024-09-21T06:11:55.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.263+0000 7f62b5600640 1 -- 172.21.15.118:0/4277093746 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247974 (secure 0 0 0) 0x7f62b80cec10 con 0x7f6298078bc0 2024-09-21T06:11:55.268 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:55.269 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6298078bc0 msgr2=0x7f629807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6298078bc0 0x7f629807b0d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009b30 tx=0x7f62ac005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5450 msgr2=0x7f62b80b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5450 0x7f62b80b2f90 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000c00 tx=0x7f62a40038a0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 shutdown_connections 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62b815cfd0 0x7f62b8137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b80b5450 0x7f62b80b2f90 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6298078bc0 0x7f629807b0d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 --2- 172.21.15.118:0/4277093746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62b80b5040 0x7f62b80cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 >> 172.21.15.118:0/4277093746 conn(0x7f62b806d110 msgr2=0x7f62b806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 shutdown_connections 2024-09-21T06:11:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.267+0000 7f62c0600640 1 -- 172.21.15.118:0/4277093746 wait complete. 2024-09-21T06:11:55.296 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":389,"stamp":"2024-09-21T06:11:54.583763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554831,"statfs":{"total":1600000000,"available":1592147556,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.032960"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551975+0000","last_change":"2024-09-21T06:11:35.376598+0000","last_active":"2024-09-21T06:11:44.551975+0000","last_peered":"2024-09-21T06:11:44.551975+0000","last_clean":"2024-09-21T06:11:44.551975+0000","last_became_active":"2024-09-21T06:11:35.376347+0000","last_became_peered":"2024-09-21T06:11:35.376347+0000","last_unstale":"2024-09-21T06:11:44.551975+0000","last_undegraded":"2024-09-21T06:11:44.551975+0000","last_fullsized":"2024-09-21T06:11:44.551975+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:39.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629267+0000","last_change":"2024-09-21T06:11:35.381399+0000","last_active":"2024-09-21T06:11:44.629267+0000","last_peered":"2024-09-21T06:11:44.629267+0000","last_clean":"2024-09-21T06:11:44.629267+0000","last_became_active":"2024-09-21T06:11:35.381123+0000","last_became_peered":"2024-09-21T06:11:35.381123+0000","last_unstale":"2024-09-21T06:11:44.629267+0000","last_undegraded":"2024-09-21T06:11:44.629267+0000","last_fullsized":"2024-09-21T06:11:44.629267+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:50.235071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629773+0000","last_change":"2024-09-21T06:11:35.387473+0000","last_active":"2024-09-21T06:11:44.629773+0000","last_peered":"2024-09-21T06:11:44.629773+0000","last_clean":"2024-09-21T06:11:44.629773+0000","last_became_active":"2024-09-21T06:11:35.386014+0000","last_became_peered":"2024-09-21T06:11:35.386014+0000","last_unstale":"2024-09-21T06:11:44.629773+0000","last_undegraded":"2024-09-21T06:11:44.629773+0000","last_fullsized":"2024-09-21T06:11:44.629773+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:05.791079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551234+0000","last_change":"2024-09-21T06:11:35.369232+0000","last_active":"2024-09-21T06:11:44.551234+0000","last_peered":"2024-09-21T06:11:44.551234+0000","last_clean":"2024-09-21T06:11:44.551234+0000","last_became_active":"2024-09-21T06:11:35.368967+0000","last_became_peered":"2024-09-21T06:11:35.368967+0000","last_unstale":"2024-09-21T06:11:44.551234+0000","last_undegraded":"2024-09-21T06:11:44.551234+0000","last_fullsized":"2024-09-21T06:11:44.551234+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:19.211573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551873+0000","last_change":"2024-09-21T06:11:35.378332+0000","last_active":"2024-09-21T06:11:44.551873+0000","last_peered":"2024-09-21T06:11:44.551873+0000","last_clean":"2024-09-21T06:11:44.551873+0000","last_became_active":"2024-09-21T06:11:35.377566+0000","last_became_peered":"2024-09-21T06:11:35.377566+0000","last_unstale":"2024-09-21T06:11:44.551873+0000","last_undegraded":"2024-09-21T06:11:44.551873+0000","last_fullsized":"2024-09-21T06:11:44.551873+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:46.622858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630159+0000","last_change":"2024-09-21T06:11:35.378876+0000","last_active":"2024-09-21T06:11:44.630159+0000","last_peered":"2024-09-21T06:11:44.630159+0000","last_clean":"2024-09-21T06:11:44.630159+0000","last_became_active":"2024-09-21T06:11:35.376221+0000","last_became_peered":"2024-09-21T06:11:35.376221+0000","last_unstale":"2024-09-21T06:11:44.630159+0000","last_undegraded":"2024-09-21T06:11:44.630159+0000","last_fullsized":"2024-09-21T06:11:44.630159+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:11.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630590+0000","last_change":"2024-09-21T06:11:35.380417+0000","last_active":"2024-09-21T06:11:44.630590+0000","last_peered":"2024-09-21T06:11:44.630590+0000","last_clean":"2024-09-21T06:11:44.630590+0000","last_became_active":"2024-09-21T06:11:35.380125+0000","last_became_peered":"2024-09-21T06:11:35.380125+0000","last_unstale":"2024-09-21T06:11:44.630590+0000","last_undegraded":"2024-09-21T06:11:44.630590+0000","last_fullsized":"2024-09-21T06:11:44.630590+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:41.966865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629885+0000","last_change":"2024-09-21T06:11:35.387951+0000","last_active":"2024-09-21T06:11:44.629885+0000","last_peered":"2024-09-21T06:11:44.629885+0000","last_clean":"2024-09-21T06:11:44.629885+0000","last_became_active":"2024-09-21T06:11:35.386435+0000","last_became_peered":"2024-09-21T06:11:35.386435+0000","last_unstale":"2024-09-21T06:11:44.629885+0000","last_undegraded":"2024-09-21T06:11:44.629885+0000","last_fullsized":"2024-09-21T06:11:44.629885+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:30.847466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629886+0000","last_change":"2024-09-21T06:11:35.376176+0000","last_active":"2024-09-21T06:11:44.629886+0000","last_peered":"2024-09-21T06:11:44.629886+0000","last_clean":"2024-09-21T06:11:44.629886+0000","last_became_active":"2024-09-21T06:11:35.375890+0000","last_became_peered":"2024-09-21T06:11:35.375890+0000","last_unstale":"2024-09-21T06:11:44.629886+0000","last_undegraded":"2024-09-21T06:11:44.629886+0000","last_fullsized":"2024-09-21T06:11:44.629886+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:46.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629656+0000","last_change":"2024-09-21T06:11:35.381520+0000","last_active":"2024-09-21T06:11:44.629656+0000","last_peered":"2024-09-21T06:11:44.629656+0000","last_clean":"2024-09-21T06:11:44.629656+0000","last_became_active":"2024-09-21T06:11:35.381264+0000","last_became_peered":"2024-09-21T06:11:35.381264+0000","last_unstale":"2024-09-21T06:11:44.629656+0000","last_undegraded":"2024-09-21T06:11:44.629656+0000","last_fullsized":"2024-09-21T06:11:44.629656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:20.803987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630050+0000","last_change":"2024-09-21T06:11:35.379406+0000","last_active":"2024-09-21T06:11:44.630050+0000","last_peered":"2024-09-21T06:11:44.630050+0000","last_clean":"2024-09-21T06:11:44.630050+0000","last_became_active":"2024-09-21T06:11:35.379089+0000","last_became_peered":"2024-09-21T06:11:35.379089+0000","last_unstale":"2024-09-21T06:11:44.630050+0000","last_undegraded":"2024-09-21T06:11:44.630050+0000","last_fullsized":"2024-09-21T06:11:44.630050+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:11.045806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630180+0000","last_change":"2024-09-21T06:11:35.385232+0000","last_active":"2024-09-21T06:11:44.630180+0000","last_peered":"2024-09-21T06:11:44.630180+0000","last_clean":"2024-09-21T06:11:44.630180+0000","last_became_active":"2024-09-21T06:11:35.384052+0000","last_became_peered":"2024-09-21T06:11:35.384052+0000","last_unstale":"2024-09-21T06:11:44.630180+0000","last_undegraded":"2024-09-21T06:11:44.630180+0000","last_fullsized":"2024-09-21T06:11:44.630180+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:17.407716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551235+0000","last_change":"2024-09-21T06:11:35.376540+0000","last_active":"2024-09-21T06:11:44.551235+0000","last_peered":"2024-09-21T06:11:44.551235+0000","last_clean":"2024-09-21T06:11:44.551235+0000","last_became_active":"2024-09-21T06:11:35.376257+0000","last_became_peered":"2024-09-21T06:11:35.376257+0000","last_unstale":"2024-09-21T06:11:44.551235+0000","last_undegraded":"2024-09-21T06:11:44.551235+0000","last_fullsized":"2024-09-21T06:11:44.551235+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:01.392371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628870+0000","last_change":"2024-09-21T06:11:35.378460+0000","last_active":"2024-09-21T06:11:44.628870+0000","last_peered":"2024-09-21T06:11:44.628870+0000","last_clean":"2024-09-21T06:11:44.628870+0000","last_became_active":"2024-09-21T06:11:35.378161+0000","last_became_peered":"2024-09-21T06:11:35.378161+0000","last_unstale":"2024-09-21T06:11:44.628870+0000","last_undegraded":"2024-09-21T06:11:44.628870+0000","last_fullsized":"2024-09-21T06:11:44.628870+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:47.710255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551569+0000","last_change":"2024-09-21T06:11:35.383190+0000","last_active":"2024-09-21T06:11:44.551569+0000","last_peered":"2024-09-21T06:11:44.551569+0000","last_clean":"2024-09-21T06:11:44.551569+0000","last_became_active":"2024-09-21T06:11:35.382883+0000","last_became_peered":"2024-09-21T06:11:35.382883+0000","last_unstale":"2024-09-21T06:11:44.551569+0000","last_undegraded":"2024-09-21T06:11:44.551569+0000","last_fullsized":"2024-09-21T06:11:44.551569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:19.621780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631444+0000","last_change":"2024-09-21T06:11:44.631330+0000","last_active":"2024-09-21T06:11:44.631444+0000","last_peered":"2024-09-21T06:11:44.631444+0000","last_clean":"2024-09-21T06:11:44.631444+0000","last_became_active":"2024-09-21T06:11:44.631036+0000","last_became_peered":"2024-09-21T06:11:44.631036+0000","last_unstale":"2024-09-21T06:11:44.631444+0000","last_undegraded":"2024-09-21T06:11:44.631444+0000","last_fullsized":"2024-09-21T06:11:44.631444+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:14.653905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630725+0000","last_change":"2024-09-21T06:11:35.385092+0000","last_active":"2024-09-21T06:11:44.630725+0000","last_peered":"2024-09-21T06:11:44.630725+0000","last_clean":"2024-09-21T06:11:44.630725+0000","last_became_active":"2024-09-21T06:11:35.384351+0000","last_became_peered":"2024-09-21T06:11:35.384351+0000","last_unstale":"2024-09-21T06:11:44.630725+0000","last_undegraded":"2024-09-21T06:11:44.630725+0000","last_fullsized":"2024-09-21T06:11:44.630725+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:37.950197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550178+0000","last_change":"2024-09-21T06:11:35.377298+0000","last_active":"2024-09-21T06:11:44.550178+0000","last_peered":"2024-09-21T06:11:44.550178+0000","last_clean":"2024-09-21T06:11:44.550178+0000","last_became_active":"2024-09-21T06:11:35.376794+0000","last_became_peered":"2024-09-21T06:11:35.376794+0000","last_unstale":"2024-09-21T06:11:44.550178+0000","last_undegraded":"2024-09-21T06:11:44.550178+0000","last_fullsized":"2024-09-21T06:11:44.550178+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:11.274463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.628895+0000","last_change":"2024-09-21T06:11:35.381039+0000","last_active":"2024-09-21T06:11:44.628895+0000","last_peered":"2024-09-21T06:11:44.628895+0000","last_clean":"2024-09-21T06:11:44.628895+0000","last_became_active":"2024-09-21T06:11:35.380634+0000","last_became_peered":"2024-09-21T06:11:35.380634+0000","last_unstale":"2024-09-21T06:11:44.628895+0000","last_undegraded":"2024-09-21T06:11:44.628895+0000","last_fullsized":"2024-09-21T06:11:44.628895+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:37.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550152+0000","last_change":"2024-09-21T06:11:35.374899+0000","last_active":"2024-09-21T06:11:44.550152+0000","last_peered":"2024-09-21T06:11:44.550152+0000","last_clean":"2024-09-21T06:11:44.550152+0000","last_became_active":"2024-09-21T06:11:35.374628+0000","last_became_peered":"2024-09-21T06:11:35.374628+0000","last_unstale":"2024-09-21T06:11:44.550152+0000","last_undegraded":"2024-09-21T06:11:44.550152+0000","last_fullsized":"2024-09-21T06:11:44.550152+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:24.907744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552618+0000","last_change":"2024-09-21T06:11:35.378028+0000","last_active":"2024-09-21T06:11:44.552618+0000","last_peered":"2024-09-21T06:11:44.552618+0000","last_clean":"2024-09-21T06:11:44.552618+0000","last_became_active":"2024-09-21T06:11:35.377483+0000","last_became_peered":"2024-09-21T06:11:35.377483+0000","last_unstale":"2024-09-21T06:11:44.552618+0000","last_undegraded":"2024-09-21T06:11:44.552618+0000","last_fullsized":"2024-09-21T06:11:44.552618+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:44.179958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629110+0000","last_change":"2024-09-21T06:11:35.377321+0000","last_active":"2024-09-21T06:11:44.629110+0000","last_peered":"2024-09-21T06:11:44.629110+0000","last_clean":"2024-09-21T06:11:44.629110+0000","last_became_active":"2024-09-21T06:11:35.375043+0000","last_became_peered":"2024-09-21T06:11:35.375043+0000","last_unstale":"2024-09-21T06:11:44.629110+0000","last_undegraded":"2024-09-21T06:11:44.629110+0000","last_fullsized":"2024-09-21T06:11:44.629110+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:09.200552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630160+0000","last_change":"2024-09-21T06:11:35.386813+0000","last_active":"2024-09-21T06:11:44.630160+0000","last_peered":"2024-09-21T06:11:44.630160+0000","last_clean":"2024-09-21T06:11:44.630160+0000","last_became_active":"2024-09-21T06:11:35.384354+0000","last_became_peered":"2024-09-21T06:11:35.384354+0000","last_unstale":"2024-09-21T06:11:44.630160+0000","last_undegraded":"2024-09-21T06:11:44.630160+0000","last_fullsized":"2024-09-21T06:11:44.630160+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:50.016626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.378364+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.376834+0000","last_became_peered":"2024-09-21T06:11:35.376834+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:31.143711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629755+0000","last_change":"2024-09-21T06:11:35.380865+0000","last_active":"2024-09-21T06:11:44.629755+0000","last_peered":"2024-09-21T06:11:44.629755+0000","last_clean":"2024-09-21T06:11:44.629755+0000","last_became_active":"2024-09-21T06:11:35.380185+0000","last_became_peered":"2024-09-21T06:11:35.380185+0000","last_unstale":"2024-09-21T06:11:44.629755+0000","last_undegraded":"2024-09-21T06:11:44.629755+0000","last_fullsized":"2024-09-21T06:11:44.629755+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:41.564235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550695+0000","last_change":"2024-09-21T06:11:35.368982+0000","last_active":"2024-09-21T06:11:44.550695+0000","last_peered":"2024-09-21T06:11:44.550695+0000","last_clean":"2024-09-21T06:11:44.550695+0000","last_became_active":"2024-09-21T06:11:35.368227+0000","last_became_peered":"2024-09-21T06:11:35.368227+0000","last_unstale":"2024-09-21T06:11:44.550695+0000","last_undegraded":"2024-09-21T06:11:44.550695+0000","last_fullsized":"2024-09-21T06:11:44.550695+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:36.518858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551170+0000","last_change":"2024-09-21T06:11:35.379936+0000","last_active":"2024-09-21T06:11:44.551170+0000","last_peered":"2024-09-21T06:11:44.551170+0000","last_clean":"2024-09-21T06:11:44.551170+0000","last_became_active":"2024-09-21T06:11:35.379662+0000","last_became_peered":"2024-09-21T06:11:35.379662+0000","last_unstale":"2024-09-21T06:11:44.551170+0000","last_undegraded":"2024-09-21T06:11:44.551170+0000","last_fullsized":"2024-09-21T06:11:44.551170+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:33.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629266+0000","last_change":"2024-09-21T06:11:35.376999+0000","last_active":"2024-09-21T06:11:44.629266+0000","last_peered":"2024-09-21T06:11:44.629266+0000","last_clean":"2024-09-21T06:11:44.629266+0000","last_became_active":"2024-09-21T06:11:35.376721+0000","last_became_peered":"2024-09-21T06:11:35.376721+0000","last_unstale":"2024-09-21T06:11:44.629266+0000","last_undegraded":"2024-09-21T06:11:44.629266+0000","last_fullsized":"2024-09-21T06:11:44.629266+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:13.304068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551530+0000","last_change":"2024-09-21T06:11:35.377846+0000","last_active":"2024-09-21T06:11:44.551530+0000","last_peered":"2024-09-21T06:11:44.551530+0000","last_clean":"2024-09-21T06:11:44.551530+0000","last_became_active":"2024-09-21T06:11:35.376448+0000","last_became_peered":"2024-09-21T06:11:35.376448+0000","last_unstale":"2024-09-21T06:11:44.551530+0000","last_undegraded":"2024-09-21T06:11:44.551530+0000","last_fullsized":"2024-09-21T06:11:44.551530+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:04.574765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551738+0000","last_change":"2024-09-21T06:11:35.382469+0000","last_active":"2024-09-21T06:11:44.551738+0000","last_peered":"2024-09-21T06:11:44.551738+0000","last_clean":"2024-09-21T06:11:44.551738+0000","last_became_active":"2024-09-21T06:11:35.382069+0000","last_became_peered":"2024-09-21T06:11:35.382069+0000","last_unstale":"2024-09-21T06:11:44.551738+0000","last_undegraded":"2024-09-21T06:11:44.551738+0000","last_fullsized":"2024-09-21T06:11:44.551738+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:36.565274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.631400+0000","last_change":"2024-09-21T06:11:44.631304+0000","last_active":"2024-09-21T06:11:44.631400+0000","last_peered":"2024-09-21T06:11:44.631400+0000","last_clean":"2024-09-21T06:11:44.631400+0000","last_became_active":"2024-09-21T06:11:44.631094+0000","last_became_peered":"2024-09-21T06:11:44.631094+0000","last_unstale":"2024-09-21T06:11:44.631400+0000","last_undegraded":"2024-09-21T06:11:44.631400+0000","last_fullsized":"2024-09-21T06:11:44.631400+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:44.784235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630658+0000","last_change":"2024-09-21T06:11:35.384768+0000","last_active":"2024-09-21T06:11:44.630658+0000","last_peered":"2024-09-21T06:11:44.630658+0000","last_clean":"2024-09-21T06:11:44.630658+0000","last_became_active":"2024-09-21T06:11:35.383789+0000","last_became_peered":"2024-09-21T06:11:35.383789+0000","last_unstale":"2024-09-21T06:11:44.630658+0000","last_undegraded":"2024-09-21T06:11:44.630658+0000","last_fullsized":"2024-09-21T06:11:44.630658+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:31.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550085+0000","last_change":"2024-09-21T06:11:35.379239+0000","last_active":"2024-09-21T06:11:44.550085+0000","last_peered":"2024-09-21T06:11:44.550085+0000","last_clean":"2024-09-21T06:11:44.550085+0000","last_became_active":"2024-09-21T06:11:35.375612+0000","last_became_peered":"2024-09-21T06:11:35.375612+0000","last_unstale":"2024-09-21T06:11:44.550085+0000","last_undegraded":"2024-09-21T06:11:44.550085+0000","last_fullsized":"2024-09-21T06:11:44.550085+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:37:09.240228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"146'4","reported_seq":23,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551828+0000","last_change":"2024-09-21T06:11:34.503380+0000","last_active":"2024-09-21T06:11:44.551828+0000","last_peered":"2024-09-21T06:11:44.551828+0000","last_clean":"2024-09-21T06:11:44.551828+0000","last_became_active":"2024-09-21T06:11:34.503091+0000","last_became_peered":"2024-09-21T06:11:34.503091+0000","last_unstale":"2024-09-21T06:11:44.551828+0000","last_undegraded":"2024-09-21T06:11:44.551828+0000","last_fullsized":"2024-09-21T06:11:44.551828+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:09.512731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630001+0000","last_change":"2024-09-21T06:11:35.387126+0000","last_active":"2024-09-21T06:11:44.630001+0000","last_peered":"2024-09-21T06:11:44.630001+0000","last_clean":"2024-09-21T06:11:44.630001+0000","last_became_active":"2024-09-21T06:11:35.385592+0000","last_became_peered":"2024-09-21T06:11:35.385592+0000","last_unstale":"2024-09-21T06:11:44.630001+0000","last_undegraded":"2024-09-21T06:11:44.630001+0000","last_fullsized":"2024-09-21T06:11:44.630001+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:39.280330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629475+0000","last_change":"2024-09-21T06:11:34.504577+0000","last_active":"2024-09-21T06:11:44.629475+0000","last_peered":"2024-09-21T06:11:44.629475+0000","last_clean":"2024-09-21T06:11:44.629475+0000","last_became_active":"2024-09-21T06:11:34.504275+0000","last_became_peered":"2024-09-21T06:11:34.504275+0000","last_unstale":"2024-09-21T06:11:44.629475+0000","last_undegraded":"2024-09-21T06:11:44.629475+0000","last_fullsized":"2024-09-21T06:11:44.629475+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:04.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552385+0000","last_change":"2024-09-21T06:11:35.375126+0000","last_active":"2024-09-21T06:11:44.552385+0000","last_peered":"2024-09-21T06:11:44.552385+0000","last_clean":"2024-09-21T06:11:44.552385+0000","last_became_active":"2024-09-21T06:11:35.374486+0000","last_became_peered":"2024-09-21T06:11:35.374486+0000","last_unstale":"2024-09-21T06:11:44.552385+0000","last_undegraded":"2024-09-21T06:11:44.552385+0000","last_fullsized":"2024-09-21T06:11:44.552385+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:00.377638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629527+0000","last_change":"2024-09-21T06:11:34.504370+0000","last_active":"2024-09-21T06:11:44.629527+0000","last_peered":"2024-09-21T06:11:44.629527+0000","last_clean":"2024-09-21T06:11:44.629527+0000","last_became_active":"2024-09-21T06:11:34.503779+0000","last_became_peered":"2024-09-21T06:11:34.503779+0000","last_unstale":"2024-09-21T06:11:44.629527+0000","last_undegraded":"2024-09-21T06:11:44.629527+0000","last_fullsized":"2024-09-21T06:11:44.629527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:38.011340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551999+0000","last_change":"2024-09-21T06:11:35.379162+0000","last_active":"2024-09-21T06:11:44.551999+0000","last_peered":"2024-09-21T06:11:44.551999+0000","last_clean":"2024-09-21T06:11:44.551999+0000","last_became_active":"2024-09-21T06:11:35.378060+0000","last_became_peered":"2024-09-21T06:11:35.378060+0000","last_unstale":"2024-09-21T06:11:44.551999+0000","last_undegraded":"2024-09-21T06:11:44.551999+0000","last_fullsized":"2024-09-21T06:11:44.551999+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:58.367860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629504+0000","last_change":"2024-09-21T06:11:34.503858+0000","last_active":"2024-09-21T06:11:44.629504+0000","last_peered":"2024-09-21T06:11:44.629504+0000","last_clean":"2024-09-21T06:11:44.629504+0000","last_became_active":"2024-09-21T06:11:34.503555+0000","last_became_peered":"2024-09-21T06:11:34.503555+0000","last_unstale":"2024-09-21T06:11:44.629504+0000","last_undegraded":"2024-09-21T06:11:44.629504+0000","last_fullsized":"2024-09-21T06:11:44.629504+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:32.679866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550350+0000","last_change":"2024-09-21T06:11:35.377036+0000","last_active":"2024-09-21T06:11:44.550350+0000","last_peered":"2024-09-21T06:11:44.550350+0000","last_clean":"2024-09-21T06:11:44.550350+0000","last_became_active":"2024-09-21T06:11:35.376445+0000","last_became_peered":"2024-09-21T06:11:35.376445+0000","last_unstale":"2024-09-21T06:11:44.550350+0000","last_undegraded":"2024-09-21T06:11:44.550350+0000","last_fullsized":"2024-09-21T06:11:44.550350+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:01.788271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629382+0000","last_change":"2024-09-21T06:11:34.497743+0000","last_active":"2024-09-21T06:11:44.629382+0000","last_peered":"2024-09-21T06:11:44.629382+0000","last_clean":"2024-09-21T06:11:44.629382+0000","last_became_active":"2024-09-21T06:11:34.497331+0000","last_became_peered":"2024-09-21T06:11:34.497331+0000","last_unstale":"2024-09-21T06:11:44.629382+0000","last_undegraded":"2024-09-21T06:11:44.629382+0000","last_fullsized":"2024-09-21T06:11:44.629382+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:26.676797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630861+0000","last_change":"2024-09-21T06:11:35.378166+0000","last_active":"2024-09-21T06:11:44.630861+0000","last_peered":"2024-09-21T06:11:44.630861+0000","last_clean":"2024-09-21T06:11:44.630861+0000","last_became_active":"2024-09-21T06:11:35.377331+0000","last_became_peered":"2024-09-21T06:11:35.377331+0000","last_unstale":"2024-09-21T06:11:44.630861+0000","last_undegraded":"2024-09-21T06:11:44.630861+0000","last_fullsized":"2024-09-21T06:11:44.630861+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:56.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550583+0000","last_change":"2024-09-21T06:11:34.494231+0000","last_active":"2024-09-21T06:11:44.550583+0000","last_peered":"2024-09-21T06:11:44.550583+0000","last_clean":"2024-09-21T06:11:44.550583+0000","last_became_active":"2024-09-21T06:11:34.493086+0000","last_became_peered":"2024-09-21T06:11:34.493086+0000","last_unstale":"2024-09-21T06:11:44.550583+0000","last_undegraded":"2024-09-21T06:11:44.550583+0000","last_fullsized":"2024-09-21T06:11:44.550583+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:46.449410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630453+0000","last_change":"2024-09-21T06:11:35.382633+0000","last_active":"2024-09-21T06:11:44.630453+0000","last_peered":"2024-09-21T06:11:44.630453+0000","last_clean":"2024-09-21T06:11:44.630453+0000","last_became_active":"2024-09-21T06:11:35.381943+0000","last_became_peered":"2024-09-21T06:11:35.381943+0000","last_unstale":"2024-09-21T06:11:44.630453+0000","last_undegraded":"2024-09-21T06:11:44.630453+0000","last_fullsized":"2024-09-21T06:11:44.630453+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:54.655269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629892+0000","last_change":"2024-09-21T06:11:34.506421+0000","last_active":"2024-09-21T06:11:44.629892+0000","last_peered":"2024-09-21T06:11:44.629892+0000","last_clean":"2024-09-21T06:11:44.629892+0000","last_became_active":"2024-09-21T06:11:34.506079+0000","last_became_peered":"2024-09-21T06:11:34.506079+0000","last_unstale":"2024-09-21T06:11:44.629892+0000","last_undegraded":"2024-09-21T06:11:44.629892+0000","last_fullsized":"2024-09-21T06:11:44.629892+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:07.215957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629006+0000","last_change":"2024-09-21T06:11:35.372854+0000","last_active":"2024-09-21T06:11:44.629006+0000","last_peered":"2024-09-21T06:11:44.629006+0000","last_clean":"2024-09-21T06:11:44.629006+0000","last_became_active":"2024-09-21T06:11:35.372581+0000","last_became_peered":"2024-09-21T06:11:35.372581+0000","last_unstale":"2024-09-21T06:11:44.629006+0000","last_undegraded":"2024-09-21T06:11:44.629006+0000","last_fullsized":"2024-09-21T06:11:44.629006+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:02.205682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629896+0000","last_change":"2024-09-21T06:11:34.509069+0000","last_active":"2024-09-21T06:11:44.629896+0000","last_peered":"2024-09-21T06:11:44.629896+0000","last_clean":"2024-09-21T06:11:44.629896+0000","last_became_active":"2024-09-21T06:11:34.508749+0000","last_became_peered":"2024-09-21T06:11:34.508749+0000","last_unstale":"2024-09-21T06:11:44.629896+0000","last_undegraded":"2024-09-21T06:11:44.629896+0000","last_fullsized":"2024-09-21T06:11:44.629896+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:52.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551428+0000","last_change":"2024-09-21T06:11:35.374486+0000","last_active":"2024-09-21T06:11:44.551428+0000","last_peered":"2024-09-21T06:11:44.551428+0000","last_clean":"2024-09-21T06:11:44.551428+0000","last_became_active":"2024-09-21T06:11:35.374209+0000","last_became_peered":"2024-09-21T06:11:35.374209+0000","last_unstale":"2024-09-21T06:11:44.551428+0000","last_undegraded":"2024-09-21T06:11:44.551428+0000","last_fullsized":"2024-09-21T06:11:44.551428+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:26.451336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629867+0000","last_change":"2024-09-21T06:11:34.502878+0000","last_active":"2024-09-21T06:11:44.629867+0000","last_peered":"2024-09-21T06:11:44.629867+0000","last_clean":"2024-09-21T06:11:44.629867+0000","last_became_active":"2024-09-21T06:11:34.502596+0000","last_became_peered":"2024-09-21T06:11:34.502596+0000","last_unstale":"2024-09-21T06:11:44.629867+0000","last_undegraded":"2024-09-21T06:11:44.629867+0000","last_fullsized":"2024-09-21T06:11:44.629867+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:01.234872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629302+0000","last_change":"2024-09-21T06:11:35.377070+0000","last_active":"2024-09-21T06:11:44.629302+0000","last_peered":"2024-09-21T06:11:44.629302+0000","last_clean":"2024-09-21T06:11:44.629302+0000","last_became_active":"2024-09-21T06:11:35.376377+0000","last_became_peered":"2024-09-21T06:11:35.376377+0000","last_unstale":"2024-09-21T06:11:44.629302+0000","last_undegraded":"2024-09-21T06:11:44.629302+0000","last_fullsized":"2024-09-21T06:11:44.629302+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:50.299933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550286+0000","last_change":"2024-09-21T06:11:34.510436+0000","last_active":"2024-09-21T06:11:44.550286+0000","last_peered":"2024-09-21T06:11:44.550286+0000","last_clean":"2024-09-21T06:11:44.550286+0000","last_became_active":"2024-09-21T06:11:34.509496+0000","last_became_peered":"2024-09-21T06:11:34.509496+0000","last_unstale":"2024-09-21T06:11:44.550286+0000","last_undegraded":"2024-09-21T06:11:44.550286+0000","last_fullsized":"2024-09-21T06:11:44.550286+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:44.016028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551730+0000","last_change":"2024-09-21T06:11:35.368714+0000","last_active":"2024-09-21T06:11:44.551730+0000","last_peered":"2024-09-21T06:11:44.551730+0000","last_clean":"2024-09-21T06:11:44.551730+0000","last_became_active":"2024-09-21T06:11:35.368294+0000","last_became_peered":"2024-09-21T06:11:35.368294+0000","last_unstale":"2024-09-21T06:11:44.551730+0000","last_undegraded":"2024-09-21T06:11:44.551730+0000","last_fullsized":"2024-09-21T06:11:44.551730+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:29.671217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"146'3","reported_seq":22,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629419+0000","last_change":"2024-09-21T06:11:34.499834+0000","last_active":"2024-09-21T06:11:44.629419+0000","last_peered":"2024-09-21T06:11:44.629419+0000","last_clean":"2024-09-21T06:11:44.629419+0000","last_became_active":"2024-09-21T06:11:34.499206+0000","last_became_peered":"2024-09-21T06:11:34.499206+0000","last_unstale":"2024-09-21T06:11:44.629419+0000","last_undegraded":"2024-09-21T06:11:44.629419+0000","last_fullsized":"2024-09-21T06:11:44.629419+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:02.581363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551578+0000","last_change":"2024-09-21T06:11:35.385351+0000","last_active":"2024-09-21T06:11:44.551578+0000","last_peered":"2024-09-21T06:11:44.551578+0000","last_clean":"2024-09-21T06:11:44.551578+0000","last_became_active":"2024-09-21T06:11:35.385047+0000","last_became_peered":"2024-09-21T06:11:35.385047+0000","last_unstale":"2024-09-21T06:11:44.551578+0000","last_undegraded":"2024-09-21T06:11:44.551578+0000","last_fullsized":"2024-09-21T06:11:44.551578+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.074472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"146'6","reported_seq":25,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630145+0000","last_change":"2024-09-21T06:11:34.505817+0000","last_active":"2024-09-21T06:11:44.630145+0000","last_peered":"2024-09-21T06:11:44.630145+0000","last_clean":"2024-09-21T06:11:44.630145+0000","last_became_active":"2024-09-21T06:11:34.505389+0000","last_became_peered":"2024-09-21T06:11:34.505389+0000","last_unstale":"2024-09-21T06:11:44.630145+0000","last_undegraded":"2024-09-21T06:11:44.630145+0000","last_fullsized":"2024-09-21T06:11:44.630145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:01.287657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551939+0000","last_change":"2024-09-21T06:11:35.381060+0000","last_active":"2024-09-21T06:11:44.551939+0000","last_peered":"2024-09-21T06:11:44.551939+0000","last_clean":"2024-09-21T06:11:44.551939+0000","last_became_active":"2024-09-21T06:11:35.380752+0000","last_became_peered":"2024-09-21T06:11:35.380752+0000","last_unstale":"2024-09-21T06:11:44.551939+0000","last_undegraded":"2024-09-21T06:11:44.551939+0000","last_fullsized":"2024-09-21T06:11:44.551939+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:50.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552151+0000","last_change":"2024-09-21T06:11:34.509281+0000","last_active":"2024-09-21T06:11:44.552151+0000","last_peered":"2024-09-21T06:11:44.552151+0000","last_clean":"2024-09-21T06:11:44.552151+0000","last_became_active":"2024-09-21T06:11:34.508971+0000","last_became_peered":"2024-09-21T06:11:34.508971+0000","last_unstale":"2024-09-21T06:11:44.552151+0000","last_undegraded":"2024-09-21T06:11:44.552151+0000","last_fullsized":"2024-09-21T06:11:44.552151+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:26.875570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629021+0000","last_change":"2024-09-21T06:11:35.387096+0000","last_active":"2024-09-21T06:11:44.629021+0000","last_peered":"2024-09-21T06:11:44.629021+0000","last_clean":"2024-09-21T06:11:44.629021+0000","last_became_active":"2024-09-21T06:11:35.386934+0000","last_became_peered":"2024-09-21T06:11:35.386934+0000","last_unstale":"2024-09-21T06:11:44.629021+0000","last_undegraded":"2024-09-21T06:11:44.629021+0000","last_fullsized":"2024-09-21T06:11:44.629021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:34.604694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629501+0000","last_change":"2024-09-21T06:11:34.506449+0000","last_active":"2024-09-21T06:11:44.629501+0000","last_peered":"2024-09-21T06:11:44.629501+0000","last_clean":"2024-09-21T06:11:44.629501+0000","last_became_active":"2024-09-21T06:11:34.505974+0000","last_became_peered":"2024-09-21T06:11:34.505974+0000","last_unstale":"2024-09-21T06:11:44.629501+0000","last_undegraded":"2024-09-21T06:11:44.629501+0000","last_fullsized":"2024-09-21T06:11:44.629501+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:55.304180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630306+0000","last_change":"2024-09-21T06:11:35.384450+0000","last_active":"2024-09-21T06:11:44.630306+0000","last_peered":"2024-09-21T06:11:44.630306+0000","last_clean":"2024-09-21T06:11:44.630306+0000","last_became_active":"2024-09-21T06:11:35.382777+0000","last_became_peered":"2024-09-21T06:11:35.382777+0000","last_unstale":"2024-09-21T06:11:44.630306+0000","last_undegraded":"2024-09-21T06:11:44.630306+0000","last_fullsized":"2024-09-21T06:11:44.630306+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"146'8","reported_seq":27,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630346+0000","last_change":"2024-09-21T06:11:34.506753+0000","last_active":"2024-09-21T06:11:44.630346+0000","last_peered":"2024-09-21T06:11:44.630346+0000","last_clean":"2024-09-21T06:11:44.630346+0000","last_became_active":"2024-09-21T06:11:34.506190+0000","last_became_peered":"2024-09-21T06:11:34.506190+0000","last_unstale":"2024-09-21T06:11:44.630346+0000","last_undegraded":"2024-09-21T06:11:44.630346+0000","last_fullsized":"2024-09-21T06:11:44.630346+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:15.989826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630521+0000","last_change":"2024-09-21T06:11:35.382910+0000","last_active":"2024-09-21T06:11:44.630521+0000","last_peered":"2024-09-21T06:11:44.630521+0000","last_clean":"2024-09-21T06:11:44.630521+0000","last_became_active":"2024-09-21T06:11:35.382308+0000","last_became_peered":"2024-09-21T06:11:35.382308+0000","last_unstale":"2024-09-21T06:11:44.630521+0000","last_undegraded":"2024-09-21T06:11:44.630521+0000","last_fullsized":"2024-09-21T06:11:44.630521+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:24.149001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629597+0000","last_change":"2024-09-21T06:11:34.502247+0000","last_active":"2024-09-21T06:11:44.629597+0000","last_peered":"2024-09-21T06:11:44.629597+0000","last_clean":"2024-09-21T06:11:44.629597+0000","last_became_active":"2024-09-21T06:11:34.501986+0000","last_became_peered":"2024-09-21T06:11:34.501986+0000","last_unstale":"2024-09-21T06:11:44.629597+0000","last_undegraded":"2024-09-21T06:11:44.629597+0000","last_fullsized":"2024-09-21T06:11:44.629597+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:20.964313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629300+0000","last_change":"2024-09-21T06:11:35.381899+0000","last_active":"2024-09-21T06:11:44.629300+0000","last_peered":"2024-09-21T06:11:44.629300+0000","last_clean":"2024-09-21T06:11:44.629300+0000","last_became_active":"2024-09-21T06:11:35.381594+0000","last_became_peered":"2024-09-21T06:11:35.381594+0000","last_unstale":"2024-09-21T06:11:44.629300+0000","last_undegraded":"2024-09-21T06:11:44.629300+0000","last_fullsized":"2024-09-21T06:11:44.629300+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:45.316986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629660+0000","last_change":"2024-09-21T06:11:34.509685+0000","last_active":"2024-09-21T06:11:44.629660+0000","last_peered":"2024-09-21T06:11:44.629660+0000","last_clean":"2024-09-21T06:11:44.629660+0000","last_became_active":"2024-09-21T06:11:34.509436+0000","last_became_peered":"2024-09-21T06:11:34.509436+0000","last_unstale":"2024-09-21T06:11:44.629660+0000","last_undegraded":"2024-09-21T06:11:44.629660+0000","last_fullsized":"2024-09-21T06:11:44.629660+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:25.466516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550034+0000","last_change":"2024-09-21T06:11:35.370044+0000","last_active":"2024-09-21T06:11:44.550034+0000","last_peered":"2024-09-21T06:11:44.550034+0000","last_clean":"2024-09-21T06:11:44.550034+0000","last_became_active":"2024-09-21T06:11:35.369766+0000","last_became_peered":"2024-09-21T06:11:35.369766+0000","last_unstale":"2024-09-21T06:11:44.550034+0000","last_undegraded":"2024-09-21T06:11:44.550034+0000","last_fullsized":"2024-09-21T06:11:44.550034+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:47.403593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"146'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630354+0000","last_change":"2024-09-21T06:11:34.506470+0000","last_active":"2024-09-21T06:11:44.630354+0000","last_peered":"2024-09-21T06:11:44.630354+0000","last_clean":"2024-09-21T06:11:44.630354+0000","last_became_active":"2024-09-21T06:11:34.506087+0000","last_became_peered":"2024-09-21T06:11:34.506087+0000","last_unstale":"2024-09-21T06:11:44.630354+0000","last_undegraded":"2024-09-21T06:11:44.630354+0000","last_fullsized":"2024-09-21T06:11:44.630354+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:54.372464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629612+0000","last_change":"2024-09-21T06:11:35.374838+0000","last_active":"2024-09-21T06:11:44.629612+0000","last_peered":"2024-09-21T06:11:44.629612+0000","last_clean":"2024-09-21T06:11:44.629612+0000","last_became_active":"2024-09-21T06:11:35.374547+0000","last_became_peered":"2024-09-21T06:11:35.374547+0000","last_unstale":"2024-09-21T06:11:44.629612+0000","last_undegraded":"2024-09-21T06:11:44.629612+0000","last_fullsized":"2024-09-21T06:11:44.629612+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:56.254197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629850+0000","last_change":"2024-09-21T06:11:34.506633+0000","last_active":"2024-09-21T06:11:44.629850+0000","last_peered":"2024-09-21T06:11:44.629850+0000","last_clean":"2024-09-21T06:11:44.629850+0000","last_became_active":"2024-09-21T06:11:34.505859+0000","last_became_peered":"2024-09-21T06:11:34.505859+0000","last_unstale":"2024-09-21T06:11:44.629850+0000","last_undegraded":"2024-09-21T06:11:44.629850+0000","last_fullsized":"2024-09-21T06:11:44.629850+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:25.005224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551626+0000","last_change":"2024-09-21T06:11:35.378610+0000","last_active":"2024-09-21T06:11:44.551626+0000","last_peered":"2024-09-21T06:11:44.551626+0000","last_clean":"2024-09-21T06:11:44.551626+0000","last_became_active":"2024-09-21T06:11:35.378347+0000","last_became_peered":"2024-09-21T06:11:35.378347+0000","last_unstale":"2024-09-21T06:11:44.551626+0000","last_undegraded":"2024-09-21T06:11:44.551626+0000","last_fullsized":"2024-09-21T06:11:44.551626+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:34.677320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629547+0000","last_change":"2024-09-21T06:11:34.500157+0000","last_active":"2024-09-21T06:11:44.629547+0000","last_peered":"2024-09-21T06:11:44.629547+0000","last_clean":"2024-09-21T06:11:44.629547+0000","last_became_active":"2024-09-21T06:11:34.499577+0000","last_became_peered":"2024-09-21T06:11:34.499577+0000","last_unstale":"2024-09-21T06:11:44.629547+0000","last_undegraded":"2024-09-21T06:11:44.629547+0000","last_fullsized":"2024-09-21T06:11:44.629547+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:02:25.035520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630294+0000","last_change":"2024-09-21T06:11:35.387256+0000","last_active":"2024-09-21T06:11:44.630294+0000","last_peered":"2024-09-21T06:11:44.630294+0000","last_clean":"2024-09-21T06:11:44.630294+0000","last_became_active":"2024-09-21T06:11:35.386964+0000","last_became_peered":"2024-09-21T06:11:35.386964+0000","last_unstale":"2024-09-21T06:11:44.630294+0000","last_undegraded":"2024-09-21T06:11:44.630294+0000","last_fullsized":"2024-09-21T06:11:44.630294+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:01.593290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550387+0000","last_change":"2024-09-21T06:11:34.510726+0000","last_active":"2024-09-21T06:11:44.550387+0000","last_peered":"2024-09-21T06:11:44.550387+0000","last_clean":"2024-09-21T06:11:44.550387+0000","last_became_active":"2024-09-21T06:11:34.509805+0000","last_became_peered":"2024-09-21T06:11:34.509805+0000","last_unstale":"2024-09-21T06:11:44.550387+0000","last_undegraded":"2024-09-21T06:11:44.550387+0000","last_fullsized":"2024-09-21T06:11:44.550387+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:14.109895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629393+0000","last_change":"2024-09-21T06:11:35.384021+0000","last_active":"2024-09-21T06:11:44.629393+0000","last_peered":"2024-09-21T06:11:44.629393+0000","last_clean":"2024-09-21T06:11:44.629393+0000","last_became_active":"2024-09-21T06:11:35.383622+0000","last_became_peered":"2024-09-21T06:11:35.383622+0000","last_unstale":"2024-09-21T06:11:44.629393+0000","last_undegraded":"2024-09-21T06:11:44.629393+0000","last_fullsized":"2024-09-21T06:11:44.629393+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:41.222144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:34.495264+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:34.494820+0000","last_became_peered":"2024-09-21T06:11:34.494820+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:23.532417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551746+0000","last_change":"2024-09-21T06:11:35.369669+0000","last_active":"2024-09-21T06:11:44.551746+0000","last_peered":"2024-09-21T06:11:44.551746+0000","last_clean":"2024-09-21T06:11:44.551746+0000","last_became_active":"2024-09-21T06:11:35.369358+0000","last_became_peered":"2024-09-21T06:11:35.369358+0000","last_unstale":"2024-09-21T06:11:44.551746+0000","last_undegraded":"2024-09-21T06:11:44.551746+0000","last_fullsized":"2024-09-21T06:11:44.551746+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:37.379587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630352+0000","last_change":"2024-09-21T06:11:34.506914+0000","last_active":"2024-09-21T06:11:44.630352+0000","last_peered":"2024-09-21T06:11:44.630352+0000","last_clean":"2024-09-21T06:11:44.630352+0000","last_became_active":"2024-09-21T06:11:34.506624+0000","last_became_peered":"2024-09-21T06:11:34.506624+0000","last_unstale":"2024-09-21T06:11:44.630352+0000","last_undegraded":"2024-09-21T06:11:44.630352+0000","last_fullsized":"2024-09-21T06:11:44.630352+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:01.441713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.630468+0000","last_change":"2024-09-21T06:11:35.376854+0000","last_active":"2024-09-21T06:11:44.630468+0000","last_peered":"2024-09-21T06:11:44.630468+0000","last_clean":"2024-09-21T06:11:44.630468+0000","last_became_active":"2024-09-21T06:11:35.376582+0000","last_became_peered":"2024-09-21T06:11:35.376582+0000","last_unstale":"2024-09-21T06:11:44.630468+0000","last_undegraded":"2024-09-21T06:11:44.630468+0000","last_fullsized":"2024-09-21T06:11:44.630468+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:47.859458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551714+0000","last_change":"2024-09-21T06:11:34.499951+0000","last_active":"2024-09-21T06:11:44.551714+0000","last_peered":"2024-09-21T06:11:44.551714+0000","last_clean":"2024-09-21T06:11:44.551714+0000","last_became_active":"2024-09-21T06:11:34.499650+0000","last_became_peered":"2024-09-21T06:11:34.499650+0000","last_unstale":"2024-09-21T06:11:44.551714+0000","last_undegraded":"2024-09-21T06:11:44.551714+0000","last_fullsized":"2024-09-21T06:11:44.551714+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:58.628251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551574+0000","last_change":"2024-09-21T06:11:35.382131+0000","last_active":"2024-09-21T06:11:44.551574+0000","last_peered":"2024-09-21T06:11:44.551574+0000","last_clean":"2024-09-21T06:11:44.551574+0000","last_became_active":"2024-09-21T06:11:35.381872+0000","last_became_peered":"2024-09-21T06:11:35.381872+0000","last_unstale":"2024-09-21T06:11:44.551574+0000","last_undegraded":"2024-09-21T06:11:44.551574+0000","last_fullsized":"2024-09-21T06:11:44.551574+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:58.855880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"147'1","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551983+0000","last_change":"2024-09-21T06:11:34.508812+0000","last_active":"2024-09-21T06:11:44.551983+0000","last_peered":"2024-09-21T06:11:44.551983+0000","last_clean":"2024-09-21T06:11:44.551983+0000","last_became_active":"2024-09-21T06:11:34.508442+0000","last_became_peered":"2024-09-21T06:11:34.508442+0000","last_unstale":"2024-09-21T06:11:44.551983+0000","last_undegraded":"2024-09-21T06:11:44.551983+0000","last_fullsized":"2024-09-21T06:11:44.551983+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:52.255971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629818+0000","last_change":"2024-09-21T06:11:35.380594+0000","last_active":"2024-09-21T06:11:44.629818+0000","last_peered":"2024-09-21T06:11:44.629818+0000","last_clean":"2024-09-21T06:11:44.629818+0000","last_became_active":"2024-09-21T06:11:35.379833+0000","last_became_peered":"2024-09-21T06:11:35.379833+0000","last_unstale":"2024-09-21T06:11:44.629818+0000","last_undegraded":"2024-09-21T06:11:44.629818+0000","last_fullsized":"2024-09-21T06:11:44.629818+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.339516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629128+0000","last_change":"2024-09-21T06:11:34.509085+0000","last_active":"2024-09-21T06:11:44.629128+0000","last_peered":"2024-09-21T06:11:44.629128+0000","last_clean":"2024-09-21T06:11:44.629128+0000","last_became_active":"2024-09-21T06:11:34.508657+0000","last_became_peered":"2024-09-21T06:11:34.508657+0000","last_unstale":"2024-09-21T06:11:44.629128+0000","last_undegraded":"2024-09-21T06:11:44.629128+0000","last_fullsized":"2024-09-21T06:11:44.629128+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.275264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629775+0000","last_change":"2024-09-21T06:11:35.379891+0000","last_active":"2024-09-21T06:11:44.629775+0000","last_peered":"2024-09-21T06:11:44.629775+0000","last_clean":"2024-09-21T06:11:44.629775+0000","last_became_active":"2024-09-21T06:11:35.379486+0000","last_became_peered":"2024-09-21T06:11:35.379486+0000","last_unstale":"2024-09-21T06:11:44.629775+0000","last_undegraded":"2024-09-21T06:11:44.629775+0000","last_fullsized":"2024-09-21T06:11:44.629775+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:00.979404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629788+0000","last_change":"2024-09-21T06:11:34.504088+0000","last_active":"2024-09-21T06:11:44.629788+0000","last_peered":"2024-09-21T06:11:44.629788+0000","last_clean":"2024-09-21T06:11:44.629788+0000","last_became_active":"2024-09-21T06:11:34.503409+0000","last_became_peered":"2024-09-21T06:11:34.503409+0000","last_unstale":"2024-09-21T06:11:44.629788+0000","last_undegraded":"2024-09-21T06:11:44.629788+0000","last_fullsized":"2024-09-21T06:11:44.629788+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:46.194388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551490+0000","last_change":"2024-09-21T06:11:35.381018+0000","last_active":"2024-09-21T06:11:44.551490+0000","last_peered":"2024-09-21T06:11:44.551490+0000","last_clean":"2024-09-21T06:11:44.551490+0000","last_became_active":"2024-09-21T06:11:35.380765+0000","last_became_peered":"2024-09-21T06:11:35.380765+0000","last_unstale":"2024-09-21T06:11:44.551490+0000","last_undegraded":"2024-09-21T06:11:44.551490+0000","last_fullsized":"2024-09-21T06:11:44.551490+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:26.280779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629717+0000","last_change":"2024-09-21T06:11:34.499871+0000","last_active":"2024-09-21T06:11:44.629717+0000","last_peered":"2024-09-21T06:11:44.629717+0000","last_clean":"2024-09-21T06:11:44.629717+0000","last_became_active":"2024-09-21T06:11:34.499621+0000","last_became_peered":"2024-09-21T06:11:34.499621+0000","last_unstale":"2024-09-21T06:11:44.629717+0000","last_undegraded":"2024-09-21T06:11:44.629717+0000","last_fullsized":"2024-09-21T06:11:44.629717+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:29.620985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629754+0000","last_change":"2024-09-21T06:11:35.377363+0000","last_active":"2024-09-21T06:11:44.629754+0000","last_peered":"2024-09-21T06:11:44.629754+0000","last_clean":"2024-09-21T06:11:44.629754+0000","last_became_active":"2024-09-21T06:11:35.376768+0000","last_became_peered":"2024-09-21T06:11:35.376768+0000","last_unstale":"2024-09-21T06:11:44.629754+0000","last_undegraded":"2024-09-21T06:11:44.629754+0000","last_fullsized":"2024-09-21T06:11:44.629754+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:21.987635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.551789+0000","last_change":"2024-09-21T06:11:34.505982+0000","last_active":"2024-09-21T06:11:44.551789+0000","last_peered":"2024-09-21T06:11:44.551789+0000","last_clean":"2024-09-21T06:11:44.551789+0000","last_became_active":"2024-09-21T06:11:34.505716+0000","last_became_peered":"2024-09-21T06:11:34.505716+0000","last_unstale":"2024-09-21T06:11:44.551789+0000","last_undegraded":"2024-09-21T06:11:44.551789+0000","last_fullsized":"2024-09-21T06:11:44.551789+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:13.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550265+0000","last_change":"2024-09-21T06:11:35.379633+0000","last_active":"2024-09-21T06:11:44.550265+0000","last_peered":"2024-09-21T06:11:44.550265+0000","last_clean":"2024-09-21T06:11:44.550265+0000","last_became_active":"2024-09-21T06:11:35.378970+0000","last_became_peered":"2024-09-21T06:11:35.378970+0000","last_unstale":"2024-09-21T06:11:44.550265+0000","last_undegraded":"2024-09-21T06:11:44.550265+0000","last_fullsized":"2024-09-21T06:11:44.550265+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.861496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.550719+0000","last_change":"2024-09-21T06:11:34.509856+0000","last_active":"2024-09-21T06:11:44.550719+0000","last_peered":"2024-09-21T06:11:44.550719+0000","last_clean":"2024-09-21T06:11:44.550719+0000","last_became_active":"2024-09-21T06:11:34.509305+0000","last_became_peered":"2024-09-21T06:11:34.509305+0000","last_unstale":"2024-09-21T06:11:44.550719+0000","last_undegraded":"2024-09-21T06:11:44.550719+0000","last_fullsized":"2024-09-21T06:11:44.550719+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:56.980781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629129+0000","last_change":"2024-09-21T06:11:35.377448+0000","last_active":"2024-09-21T06:11:44.629129+0000","last_peered":"2024-09-21T06:11:44.629129+0000","last_clean":"2024-09-21T06:11:44.629129+0000","last_became_active":"2024-09-21T06:11:35.377182+0000","last_became_peered":"2024-09-21T06:11:35.377182+0000","last_unstale":"2024-09-21T06:11:44.629129+0000","last_undegraded":"2024-09-21T06:11:44.629129+0000","last_fullsized":"2024-09-21T06:11:44.629129+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:26.534544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.629188+0000","last_change":"2024-09-21T06:11:34.507346+0000","last_active":"2024-09-21T06:11:44.629188+0000","last_peered":"2024-09-21T06:11:44.629188+0000","last_clean":"2024-09-21T06:11:44.629188+0000","last_became_active":"2024-09-21T06:11:34.506990+0000","last_became_peered":"2024-09-21T06:11:34.506990+0000","last_unstale":"2024-09-21T06:11:44.629188+0000","last_undegraded":"2024-09-21T06:11:44.629188+0000","last_fullsized":"2024-09-21T06:11:44.629188+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:30.978019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552507+0000","last_change":"2024-09-21T06:11:35.376759+0000","last_active":"2024-09-21T06:11:44.552507+0000","last_peered":"2024-09-21T06:11:44.552507+0000","last_clean":"2024-09-21T06:11:44.552507+0000","last_became_active":"2024-09-21T06:11:35.374853+0000","last_became_peered":"2024-09-21T06:11:35.374853+0000","last_unstale":"2024-09-21T06:11:44.552507+0000","last_undegraded":"2024-09-21T06:11:44.552507+0000","last_fullsized":"2024-09-21T06:11:44.552507+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:34.482163+0000","last_clean_scrub_stamp":"2024-09-21T06:11:34.482163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:02.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"146'2","reported_seq":21,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552145+0000","last_change":"2024-09-21T06:11:34.503041+0000","last_active":"2024-09-21T06:11:44.552145+0000","last_peered":"2024-09-21T06:11:44.552145+0000","last_clean":"2024-09-21T06:11:44.552145+0000","last_became_active":"2024-09-21T06:11:34.502758+0000","last_became_peered":"2024-09-21T06:11:34.502758+0000","last_unstale":"2024-09-21T06:11:44.552145+0000","last_undegraded":"2024-09-21T06:11:44.552145+0000","last_fullsized":"2024-09-21T06:11:44.552145+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:11:33.475684+0000","last_clean_scrub_stamp":"2024-09-21T06:11:33.475684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:36.000273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":376,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-21T06:11:44.552122+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:11:44.552122+0000","last_peered":"2024-09-21T06:11:44.552122+0000","last_clean":"2024-09-21T06:11:44.552122+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:11:44.552122+0000","last_undegraded":"2024-09-21T06:11:44.552122+0000","last_fullsized":"2024-09-21T06:11:44.552122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166479,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1390,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193922,"statfs":{"total":200000000,"available":198576271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1392,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193919,"statfs":{"total":200000000,"available":198574021,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":815,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194497,"statfs":{"total":200000000,"available":199165027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166569,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":814,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166023,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:11:55.299 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:11:55.300 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:11:55.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 -- 172.21.15.118:0/1114718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 msgr2=0x7f55e0142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 --2- 172.21.15.118:0/1114718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e0142b40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f55e0071c00 tx=0x7f55d802aa30 comp rx=0 tx=0).stop 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 -- 172.21.15.118:0/1114718306 shutdown_connections 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 --2- 172.21.15.118:0/1114718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e0142b40 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 --2- 172.21.15.118:0/1114718306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55e013fef0 0x7f55e00d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 --2- 172.21.15.118:0/1114718306 >> v2:172.21.15.149:3300/0 conn(0x7f55e013fae0 0x7f55e00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 -- 172.21.15.118:0/1114718306 >> 172.21.15.118:0/1114718306 conn(0x7f55e006d110 msgr2=0x7f55e006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 -- 172.21.15.118:0/1114718306 shutdown_connections 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.564+0000 7f55e6400640 1 -- 172.21.15.118:0/1114718306 wait complete. 2024-09-21T06:11:55.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.566+0000 7f55e6400640 1 Processor -- start 2024-09-21T06:11:55.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.566+0000 7f55e6400640 1 -- start start 2024-09-21T06:11:55.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55e6400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55e013fae0 0x7f55e01572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55e6400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55e013fef0 0x7f55e012fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55e6400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55e6400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f55e006f330 con 0x7f55e0142730 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55e6400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f55e006f1b0 con 0x7f55e013fae0 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55e6400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f55e006f4b0 con 0x7f55e013fef0 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42058/0 (socket says 172.21.15.118:42058) 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 -- 172.21.15.118:0/2541240099 learned_addr learned my addr 172.21.15.118:0/2541240099 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55df400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55e013fae0 0x7f55e01572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55d6a00640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55e013fef0 0x7f55e012fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 -- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55e013fef0 msgr2=0x7f55e012fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55e013fef0 0x7f55e012fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 -- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55e013fae0 msgr2=0x7f55e01572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55e013fae0 0x7f55e01572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55dfe00640 1 -- 172.21.15.118:0/2541240099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e0157d30 con 0x7f55e0142730 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.568+0000 7f55d6a00640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55e013fef0 0x7f55e012fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.569+0000 7f55dfe00640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e012ff60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f55d8005fd0 tx=0x7f55d8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.569+0000 7f55d7e00640 1 -- 172.21.15.118:0/2541240099 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8033050 con 0x7f55e0142730 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.569+0000 7f55d7e00640 1 -- 172.21.15.118:0/2541240099 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d8004450 con 0x7f55e0142730 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.569+0000 7f55d7e00640 1 -- 172.21.15.118:0/2541240099 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8004840 con 0x7f55e0142730 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.569+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e0158010 con 0x7f55e0142730 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.569+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e0157810 con 0x7f55e0142730 2024-09-21T06:11:55.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.570+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e006f9d0 con 0x7f55e0142730 2024-09-21T06:11:55.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.571+0000 7f55d7e00640 1 -- 172.21.15.118:0/2541240099 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55d8036070 con 0x7f55e0142730 2024-09-21T06:11:55.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.572+0000 7f55d7e00640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.572+0000 7f55d7e00640 1 -- 172.21.15.118:0/2541240099 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f55d80bc250 con 0x7f55e0142730 2024-09-21T06:11:55.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.573+0000 7f55df400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.573+0000 7f55df400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f55bc078b90 0x7f55bc07b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f55d0005fd0 tx=0x7f55d000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.577+0000 7f55d7e00640 1 -- 172.21.15.118:0/2541240099 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f55d8084640 con 0x7f55e0142730 2024-09-21T06:11:55.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.830+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f55e0153570 con 0x7f55e0142730 2024-09-21T06:11:55.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.833+0000 7f55d7e00640 1 -- 172.21.15.118:0/2541240099 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f55d8083f40 con 0x7f55e0142730 2024-09-21T06:11:55.836 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:11:55.836 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:11:55.836 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:11:55.836 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:11:55.836 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:11:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:11:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f55bc078b90 msgr2=0x7f55bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f55bc078b90 0x7f55bc07b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f55d0005fd0 tx=0x7f55d000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 msgr2=0x7f55e012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e012ff60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f55d8005fd0 tx=0x7f55d8003f10 comp rx=0 tx=0).stop 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 shutdown_connections 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55e0142730 0x7f55e012ff60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55e013fef0 0x7f55e012fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 --2- 172.21.15.118:0/2541240099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55e013fae0 0x7f55e01572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 >> 172.21.15.118:0/2541240099 conn(0x7f55e006d110 msgr2=0x7f55e01609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 shutdown_connections 2024-09-21T06:11:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:55.836+0000 7f55e6400640 1 -- 172.21.15.118:0/2541240099 wait complete. 2024-09-21T06:11:55.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:11:56.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.079+0000 7f1e10200640 1 -- 172.21.15.118:0/2603041103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e080aea60 msgr2=0x7f1e080aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.079+0000 7f1e10200640 1 --2- 172.21.15.118:0/2603041103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e080aea60 0x7f1e080aee70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f1e080711e0 tx=0x7f1e0002aac0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.080+0000 7f1e10200640 1 -- 172.21.15.118:0/2603041103 shutdown_connections 2024-09-21T06:11:56.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.080+0000 7f1e10200640 1 --2- 172.21.15.118:0/2603041103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e080aea60 0x7f1e080aee70 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.080+0000 7f1e10200640 1 --2- 172.21.15.118:0/2603041103 >> v2:172.21.15.149:3300/0 conn(0x7f1e080d0e80 0x7f1e080d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.080+0000 7f1e10200640 1 -- 172.21.15.118:0/2603041103 >> 172.21.15.118:0/2603041103 conn(0x7f1e0806d110 msgr2=0x7f1e0806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:56.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.080+0000 7f1e10200640 1 -- 172.21.15.118:0/2603041103 shutdown_connections 2024-09-21T06:11:56.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.080+0000 7f1e10200640 1 -- 172.21.15.118:0/2603041103 wait complete. 2024-09-21T06:11:56.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.082+0000 7f1e10200640 1 Processor -- start 2024-09-21T06:11:56.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.082+0000 7f1e10200640 1 -- start start 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.083+0000 7f1e10200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08073e30 0x7f1e0814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.083+0000 7f1e10200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080aea60 0x7f1e0815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e10200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e080d0e80 0x7f1e08152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e10200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080af530 con 0x7f1e08073e30 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e10200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080af3b0 con 0x7f1e080d0e80 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e10200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1e080af6b0 con 0x7f1e080aea60 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08073e30 0x7f1e0814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08073e30 0x7f1e0814fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43012/0 (socket says 172.21.15.118:43012) 2024-09-21T06:11:56.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 -- 172.21.15.118:0/696058019 learned_addr learned my addr 172.21.15.118:0/696058019 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0ce00640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080aea60 0x7f1e0815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0e200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e080d0e80 0x7f1e08152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 -- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080aea60 msgr2=0x7f1e0815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080aea60 0x7f1e0815e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 -- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e080d0e80 msgr2=0x7f1e08152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e080d0e80 0x7f1e08152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0d800640 1 -- 172.21.15.118:0/696058019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e08151a70 con 0x7f1e08073e30 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.084+0000 7f1e0e200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e080d0e80 0x7f1e08152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:56.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.085+0000 7f1e0d800640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08073e30 0x7f1e0814fed0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c3a0 tx=0x7f1dfc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:56.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.085+0000 7f1e05600640 1 -- 172.21.15.118:0/696058019 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc017070 con 0x7f1e08073e30 2024-09-21T06:11:56.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.085+0000 7f1e05600640 1 -- 172.21.15.118:0/696058019 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dfc0053c0 con 0x7f1e08073e30 2024-09-21T06:11:56.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.085+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e081509d0 con 0x7f1e08073e30 2024-09-21T06:11:56.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.085+0000 7f1e05600640 1 -- 172.21.15.118:0/696058019 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc003850 con 0x7f1e08073e30 2024-09-21T06:11:56.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.085+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e08150f90 con 0x7f1e08073e30 2024-09-21T06:11:56.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.086+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e080afb60 con 0x7f1e08073e30 2024-09-21T06:11:56.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.087+0000 7f1e05600640 1 -- 172.21.15.118:0/696058019 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1dfc01a070 con 0x7f1e08073e30 2024-09-21T06:11:56.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.088+0000 7f1e05600640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.088+0000 7f1e05600640 1 -- 172.21.15.118:0/696058019 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f1dfc09a080 con 0x7f1e08073e30 2024-09-21T06:11:56.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.089+0000 7f1e0ce00640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.090+0000 7f1e0ce00640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e0814fe60 tx=0x7f1df4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:56.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.093+0000 7f1e05600640 1 -- 172.21.15.118:0/696058019 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1e0815f5f0 con 0x7f1e08073e30 2024-09-21T06:11:56.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.312+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e081617a0 con 0x7f1e08073e30 2024-09-21T06:11:56.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.313+0000 7f1e05600640 1 -- 172.21.15.118:0/696058019 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5237 (secure 0 0 0) 0x7f1dfc061e20 con 0x7f1e08073e30 2024-09-21T06:11:56.316 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:11:56.316 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:11:34.994541+0000","modified":"2024-09-21T06:11:38.003984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1596006114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1596006114},{"type":"v1","addr":"172.21.15.118:6835","nonce":1596006114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7377,"qdb_cluster":[7377]},"id":9}]} 2024-09-21T06:11:56.316 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 77 2024-09-21T06:11:56.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.315+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 msgr2=0x7f1de807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.315+0000 7f1e10200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e0814fe60 tx=0x7f1df4005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:56.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.315+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08073e30 msgr2=0x7f1e0814fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.315+0000 7f1e10200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08073e30 0x7f1e0814fed0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c3a0 tx=0x7f1dfc00c860 comp rx=0 tx=0).stop 2024-09-21T06:11:56.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 shutdown_connections 2024-09-21T06:11:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e080d0e80 0x7f1e08152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080aea60 0x7f1e0815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 --2- 172.21.15.118:0/696058019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08073e30 0x7f1e0814fed0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 >> 172.21.15.118:0/696058019 conn(0x7f1e0806d110 msgr2=0x7f1e080b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 shutdown_connections 2024-09-21T06:11:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.316+0000 7f1e10200640 1 -- 172.21.15.118:0/696058019 wait complete. 2024-09-21T06:11:56.742 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:11:34.994541+0000', 'modified': '2024-09-21T06:11:38.003984+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7377}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7377': {'gid': 7377, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/1596006114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 1596006114}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1596006114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7377, 'qdb_cluster': [7377]} 2024-09-21T06:11:56.742 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:11:56.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T06:11:56.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.963+0000 7fdf2c400640 1 -- 172.21.15.118:0/1155438202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fef0 msgr2=0x7fdf24142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.963+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1155438202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fef0 0x7fdf24142c70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005fd0 tx=0x7fdf1c02aa10 comp rx=0 tx=0).stop 2024-09-21T06:11:56.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.963+0000 7fdf2c400640 1 -- 172.21.15.118:0/1155438202 shutdown_connections 2024-09-21T06:11:56.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.963+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1155438202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fef0 0x7fdf24142c70 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.963+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1155438202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf240d1590 0x7fdf24142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.963+0000 7fdf2c400640 1 -- 172.21.15.118:0/1155438202 >> 172.21.15.118:0/1155438202 conn(0x7fdf2406d110 msgr2=0x7fdf2406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:56.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.963+0000 7fdf2c400640 1 -- 172.21.15.118:0/1155438202 shutdown_connections 2024-09-21T06:11:56.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.964+0000 7fdf2c400640 1 -- 172.21.15.118:0/1155438202 wait complete. 2024-09-21T06:11:56.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.966+0000 7fdf2c400640 1 Processor -- start 2024-09-21T06:11:56.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.966+0000 7fdf2c400640 1 -- start start 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf2c400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fae0 0x7fdf24151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf2c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2413fef0 0x7fdf24152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf2c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf24140370 0x7fdf241531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf2c400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdf240cfb10 con 0x7fdf2413fae0 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf2c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf240cf990 con 0x7fdf24140370 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf2c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdf240cfc90 con 0x7fdf2413fef0 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf29a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fae0 0x7fdf24151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.967+0000 7fdf29a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fae0 0x7fdf24151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43042/0 (socket says 172.21.15.118:43042) 2024-09-21T06:11:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29a00640 1 -- 172.21.15.118:0/1908072251 learned_addr learned my addr 172.21.15.118:0/1908072251 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29000640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2413fef0 0x7fdf24152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf2a400640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf24140370 0x7fdf241531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29a00640 1 -- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2413fef0 msgr2=0x7fdf24152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2413fef0 0x7fdf24152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29a00640 1 -- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf24140370 msgr2=0x7fdf241531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf24140370 0x7fdf241531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29a00640 1 -- 172.21.15.118:0/1908072251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf24141b50 con 0x7fdf2413fae0 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.968+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fae0 0x7fdf24151fd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c3f0 tx=0x7fdf1800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.969+0000 7fdf21600640 1 -- 172.21.15.118:0/1908072251 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18017070 con 0x7fdf2413fae0 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.969+0000 7fdf21600640 1 -- 172.21.15.118:0/1908072251 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf180035f0 con 0x7fdf2413fae0 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.969+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf241f9cf0 con 0x7fdf2413fae0 2024-09-21T06:11:56.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.969+0000 7fdf21600640 1 -- 172.21.15.118:0/1908072251 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18003a40 con 0x7fdf2413fae0 2024-09-21T06:11:56.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.969+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf241fa2b0 con 0x7fdf2413fae0 2024-09-21T06:11:56.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.971+0000 7fdf21600640 1 -- 172.21.15.118:0/1908072251 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf1801a070 con 0x7fdf2413fae0 2024-09-21T06:11:56.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.972+0000 7fdf21600640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdf04078b90 0x7fdf0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.972+0000 7fdf21600640 1 -- 172.21.15.118:0/1908072251 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7fdf1809a0a0 con 0x7fdf2413fae0 2024-09-21T06:11:56.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.973+0000 7fdf3348e740 1 Processor -- start 2024-09-21T06:11:56.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.973+0000 7fdf29000640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdf04078b90 0x7fdf0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.973+0000 7fdf3348e740 1 -- start start 2024-09-21T06:11:56.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.973+0000 7fdf29000640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdf04078b90 0x7fdf0407b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdf2406f460 tx=0x7fdf1000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:56.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af65b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af65beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf3348e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5582af5b5430 con 0x5582af26a590 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5582af5a55d0 con 0x5582af2623b0 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5582af594a00 con 0x5582af28b270 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf2a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf2a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43046/0 (socket says 172.21.15.118:43046) 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.974+0000 7fdf2a400640 1 -- 172.21.15.118:0/272223844 learned_addr learned my addr 172.21.15.118:0/272223844 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf29a00640 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af65b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf29000640 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af65beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf2a400640 1 -- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 msgr2=0x5582af65b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf2a400640 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af65b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf2a400640 1 -- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 msgr2=0x5582af65beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf2a400640 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af65beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf2a400640 1 -- 172.21.15.118:0/272223844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582af55d520 con 0x5582af26a590 2024-09-21T06:11:56.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf2a400640 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62bf60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c02b000 tx=0x7fdf1c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1362d648ae395ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf16000640 1 -- 172.21.15.118:0/272223844 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c047070 con 0x5582af26a590 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf16000640 1 -- 172.21.15.118:0/272223844 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf1c003cb0 con 0x5582af26a590 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.975+0000 7fdf16000640 1 -- 172.21.15.118:0/272223844 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c033070 con 0x5582af26a590 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 -- 172.21.15.118:0/272223844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 msgr2=0x5582af62bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62bf60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c02b000 tx=0x7fdf1c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 -- 172.21.15.118:0/272223844 shutdown_connections 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62bf60 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af65beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 --2- 172.21.15.118:0/272223844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af65b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 -- 172.21.15.118:0/272223844 >> 172.21.15.118:0/272223844 conn(0x5582af27f3c0 msgr2=0x5582af631970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 -- 172.21.15.118:0/272223844 shutdown_connections 2024-09-21T06:11:56.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.976+0000 7fdf3348e740 1 -- 172.21.15.118:0/272223844 wait complete. 2024-09-21T06:11:56.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.977+0000 7fdf3348e740 1 -- start start 2024-09-21T06:11:56.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.978+0000 7fdf3348e740 1 Processor -- start 2024-09-21T06:11:56.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af2623b0 0x5582af6573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af650a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af6891a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf3348e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5582af53b330 con 0x5582af26a590 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5582af598810 con 0x5582af28b270 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5582af305620 con 0x5582af2623b0 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf3348e740 10 client.0 _ll_register_callbacks cb 0x5582af540420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf29000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af650a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf29000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af650a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43054/0 (socket says 172.21.15.118:43054) 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf29000640 1 -- 172.21.15.118:0/1715275177 learned_addr learned my addr 172.21.15.118:0/1715275177 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.979+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af2623b0 0x5582af6573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf2a400640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af6891a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf29000640 1 -- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af2623b0 msgr2=0x5582af6573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf29000640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af2623b0 0x5582af6573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf29000640 1 -- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 msgr2=0x5582af6891a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:56.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf29000640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af6891a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf29000640 1 -- 172.21.15.118:0/1715275177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582af2f6850 con 0x5582af26a590 2024-09-21T06:11:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af2623b0 0x5582af6573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf29000640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af650a50 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdf100116f0 tx=0x7fdf10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfe7de165ff00e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1715275177 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1001fa40 con 0x5582af26a590 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1715275177 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7fdf1001fbe0 con 0x5582af26a590 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.980+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf1c003cb0 con 0x5582af26a590 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1715275177 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdf1001fde0 con 0x5582af26a590 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 10 client.7599 fetch_fsmap learned FSMap version 77 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5582af36d6b0 con 0x5582af26a590 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1715275177 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf1c003cb0 con 0x5582af26a590 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1715275177 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fdf10030050 con 0x5582af26a590 2024-09-21T06:11:56.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 10 client.7599 fetch_fsmap finished waiting for FSMap version 77 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 10 client.7599 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 20 client.7599 populate_metadata read hostname 'smithi118' 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af249e40 0x5582af671060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 4 client.7599 mds_command: new command op to 7377 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 --> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582af5a7520 con 0x5582af249e40 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.981+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af249e40 0x5582af671060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.982+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af249e40 0x5582af671060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ae7eabf74673f7 server_cookie=f598979013ae4dae in_seq=0 out_seq=0 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.982+0000 7fdf0aa00640 10 client.7599 ms_handle_connect on v2:172.21.15.118:6833/1596006114 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1715275177 <== mds.0 v2:172.21.15.118:6833/1596006114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582af5a7520 con 0x5582af249e40 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf0aa00640 10 client.7599 handle_command_reply: tid=0 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 client.7599 shutdown 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 msgr2=0x5582af650a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:56.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af650a50 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdf100116f0 tx=0x7fdf10004730 comp rx=0 tx=0).stop 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 shutdown_connections 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af6891a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af650a50 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af249e40 0x5582af671060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1715275177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af2623b0 0x5582af6573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 >> 172.21.15.118:0/1715275177 conn(0x5582af27f3c0 msgr2=0x5582af6793d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf0aa00640 0 client.7599 ms_handle_reset on v2:172.21.15.118:6833/1596006114 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 shutdown_connections 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.983+0000 7fdf3348e740 1 -- 172.21.15.118:0/1715275177 wait complete. 2024-09-21T06:11:56.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:56.984+0000 7fdf3348e740 20 client.7599 trim_cache size 0 max 16384 2024-09-21T06:11:57.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.002+0000 7fdf3348e740 1 Processor -- start 2024-09-21T06:11:57.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.002+0000 7fdf3348e740 1 -- start start 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af62cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af6784f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf3348e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdf24201940 con 0x5582af26a590 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf24073fb0 con 0x5582af2623b0 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdf24074600 con 0x5582af28b270 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43058/0 (socket says 172.21.15.118:43058) 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 -- 172.21.15.118:0/2132919970 learned_addr learned my addr 172.21.15.118:0/2132919970 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf2a400640 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af6784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29a00640 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af62cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 -- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 msgr2=0x5582af6784f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:57.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af6784f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 -- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 msgr2=0x5582af62cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:57.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af62cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29000640 1 -- 172.21.15.118:0/2132919970 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582af656340 con 0x5582af26a590 2024-09-21T06:11:57.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf2a400640 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af6784f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:57.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.004+0000 7fdf29a00640 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af62cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:57.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.005+0000 7fdf29000640 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62d1b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fdf100116c0 tx=0x7fdf10032600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa157be228bf0aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:57.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.005+0000 7fdf15600640 1 -- 172.21.15.118:0/2132919970 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1001fa40 con 0x5582af26a590 2024-09-21T06:11:57.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.005+0000 7fdf15600640 1 -- 172.21.15.118:0/2132919970 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf1000b3d0 con 0x5582af26a590 2024-09-21T06:11:57.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.005+0000 7fdf15600640 1 -- 172.21.15.118:0/2132919970 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10032a40 con 0x5582af26a590 2024-09-21T06:11:57.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 -- 172.21.15.118:0/2132919970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 msgr2=0x5582af62d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62d1b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fdf100116c0 tx=0x7fdf10032600 comp rx=0 tx=0).stop 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 -- 172.21.15.118:0/2132919970 shutdown_connections 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af28b270 0x5582af6784f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af26a590 0x5582af62d1b0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 --2- 172.21.15.118:0/2132919970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af2623b0 0x5582af62cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 -- 172.21.15.118:0/2132919970 >> 172.21.15.118:0/2132919970 conn(0x5582af27f3c0 msgr2=0x5582af657220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 -- 172.21.15.118:0/2132919970 shutdown_connections 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.006+0000 7fdf3348e740 1 -- 172.21.15.118:0/2132919970 wait complete. 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.007+0000 7fdf3348e740 1 -- start start 2024-09-21T06:11:57.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.007+0000 7fdf3348e740 1 Processor -- start 2024-09-21T06:11:57.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.008+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af2623b0 0x5582af6ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.008+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af62cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.008+0000 7fdf3348e740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af6f6350 0x5582af62d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.008+0000 7fdf3348e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5582af655270 con 0x5582af2623b0 2024-09-21T06:11:57.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.008+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5582af689d90 con 0x5582af28b270 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.008+0000 7fdf3348e740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5582af6558c0 con 0x5582af6f6350 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf3348e740 10 client.0 _ll_register_callbacks cb 0x7fdf10010e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af2623b0 0x5582af6ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af2623b0 0x5582af6ecb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43068/0 (socket says 172.21.15.118:43068) 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 -- 172.21.15.118:0/1892479931 learned_addr learned my addr 172.21.15.118:0/1892479931 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf2a400640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af6f6350 0x5582af62d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29000640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af62cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 -- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af6f6350 msgr2=0x5582af62d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af6f6350 0x5582af62d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 -- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 msgr2=0x5582af62cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af62cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 -- 172.21.15.118:0/1892479931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582af679180 con 0x5582af2623b0 2024-09-21T06:11:57.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29000640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af62cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf29a00640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af2623b0 0x5582af6ecb70 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fdf1805f020 tx=0x7fdf18014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdd74646a95e178 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.009+0000 7fdf0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1892479931 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf180667e0 con 0x5582af2623b0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1892479931 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7fdf18061010 con 0x5582af2623b0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf1000b3d0 con 0x5582af2623b0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1892479931 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdf18073050 con 0x5582af2623b0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 10 client.7605 fetch_fsmap learned FSMap version 77 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5582af6ed0b0 con 0x5582af2623b0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1892479931 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf1000b3d0 con 0x5582af2623b0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1892479931 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fdf18076020 con 0x5582af2623b0 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 10 client.7605 fetch_fsmap finished waiting for FSMap version 77 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 10 client.7605 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T06:11:57.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 20 client.7605 populate_metadata read hostname 'smithi118' 2024-09-21T06:11:57.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af657a50 0x5582af657e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 4 client.7605 mds_command: new command op to 7377 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:11:57.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.010+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 --> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] -- command(tid 0: {"prefix": "status"}) -- 0x5582af5a2fd0 con 0x5582af657a50 2024-09-21T06:11:57.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.011+0000 7fdf29000640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af657a50 0x5582af657e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.011+0000 7fdf0aa00640 10 client.7605 ms_handle_connect on v2:172.21.15.118:6833/1596006114 2024-09-21T06:11:57.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.011+0000 7fdf29000640 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af657a50 0x5582af657e60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dcbd4b3eac4fed7 server_cookie=c84ecd70b9eb51f9 in_seq=0 out_seq=0 2024-09-21T06:11:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.011+0000 7fdf0aa00640 1 -- 172.21.15.118:0/1892479931 <== mds.0 v2:172.21.15.118:6833/1596006114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5582af5a2fd0 con 0x5582af657a50 2024-09-21T06:11:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.011+0000 7fdf0aa00640 10 client.7605 handle_command_reply: tid=0 2024-09-21T06:11:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.011+0000 7fdf3348e740 1 client.7605 shutdown 2024-09-21T06:11:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af2623b0 msgr2=0x5582af6ecb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af2623b0 0x5582af6ecb70 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fdf1805f020 tx=0x7fdf18014040 comp rx=0 tx=0).stop 2024-09-21T06:11:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 shutdown_connections 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:6833/1596006114,v1:172.21.15.118:6835/1596006114] conn(0x5582af657a50 0x5582af657e60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5582af6f6350 0x5582af62d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582af28b270 0x5582af62cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 --2- 172.21.15.118:0/1892479931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582af2623b0 0x5582af6ecb70 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf0aa00640 0 client.7605 ms_handle_reset on v2:172.21.15.118:6833/1596006114 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 >> 172.21.15.118:0/1892479931 conn(0x5582af27f3c0 msgr2=0x5582af677970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 shutdown_connections 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 1 -- 172.21.15.118:0/1892479931 wait complete. 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf3348e740 20 client.7605 trim_cache size 0 max 16384 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:11:57.018 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 7377, 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 21.517393352999999, 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 77, 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 149, 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 147, 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 26.538188032000001 2024-09-21T06:11:57.019 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdf04078b90 msgr2=0x7fdf0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdf04078b90 0x7fdf0407b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdf2406f460 tx=0x7fdf1000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fae0 msgr2=0x7fdf24151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.012+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fae0 0x7fdf24151fd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c3f0 tx=0x7fdf1800c8b0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 shutdown_connections 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf24140370 0x7fdf241531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fdf04078b90 0x7fdf0407b0a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf2413fef0 0x7fdf24152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 --2- 172.21.15.118:0/1908072251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2413fae0 0x7fdf24151fd0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 >> 172.21.15.118:0/1908072251 conn(0x7fdf2406d110 msgr2=0x7fdf2406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:57.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 shutdown_connections 2024-09-21T06:11:57.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.013+0000 7fdf2c400640 1 -- 172.21.15.118:0/1908072251 wait complete. 2024-09-21T06:11:57.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:11:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.258+0000 7fd2a1600640 1 -- 172.21.15.118:0/3451686069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c073fa0 msgr2=0x7fd29c0749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.258+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3451686069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c073fa0 0x7fd29c0749f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009be0 tx=0x7fd28c02a890 comp rx=0 tx=0).stop 2024-09-21T06:11:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.258+0000 7fd2a1600640 1 -- 172.21.15.118:0/3451686069 shutdown_connections 2024-09-21T06:11:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.258+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3451686069 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c073fa0 0x7fd29c0749f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.258+0000 7fd2a1600640 1 -- 172.21.15.118:0/3451686069 >> 172.21.15.118:0/3451686069 conn(0x7fd29c06d6e0 msgr2=0x7fd29c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.258+0000 7fd2a1600640 1 -- 172.21.15.118:0/3451686069 shutdown_connections 2024-09-21T06:11:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.258+0000 7fd2a1600640 1 -- 172.21.15.118:0/3451686069 wait complete. 2024-09-21T06:11:57.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.261+0000 7fd2a1600640 1 Processor -- start 2024-09-21T06:11:57.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.261+0000 7fd2a1600640 1 -- start start 2024-09-21T06:11:57.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.262+0000 7fd2a1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c073fa0 0x7fd29c1e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.262+0000 7fd2a1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0cfe30 0x7fd29c1f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.262+0000 7fd2a1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c159880 0x7fd29c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.262+0000 7fd2a1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c0d0610 con 0x7fd29c0cfe30 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.262+0000 7fd2a1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c0d0490 con 0x7fd29c073fa0 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.262+0000 7fd2a1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd29c15dd40 con 0x7fd29c159880 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0cfe30 0x7fd29c1f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0cfe30 0x7fd29c1f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43070/0 (socket says 172.21.15.118:43070) 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 -- 172.21.15.118:0/3660124282 learned_addr learned my addr 172.21.15.118:0/3660124282 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c073fa0 0x7fd29c1e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd2a0c00640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c159880 0x7fd29c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 -- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c159880 msgr2=0x7fd29c159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c159880 0x7fd29c159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 -- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c073fa0 msgr2=0x7fd29c1e76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c073fa0 0x7fd29c1e76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 -- 172.21.15.118:0/3660124282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c15a1d0 con 0x7fd29c0cfe30 2024-09-21T06:11:57.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd29b400640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0cfe30 0x7fd29c1f5170 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c3d0 tx=0x7fd28800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:57.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.263+0000 7fd293e00640 1 -- 172.21.15.118:0/3660124282 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288017070 con 0x7fd29c0cfe30 2024-09-21T06:11:57.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.264+0000 7fd293e00640 1 -- 172.21.15.118:0/3660124282 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2880053c0 con 0x7fd29c0cfe30 2024-09-21T06:11:57.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.264+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29c1e7c30 con 0x7fd29c0cfe30 2024-09-21T06:11:57.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.264+0000 7fd293e00640 1 -- 172.21.15.118:0/3660124282 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288003850 con 0x7fd29c0cfe30 2024-09-21T06:11:57.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.264+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd29c0c9ee0 con 0x7fd29c0cfe30 2024-09-21T06:11:57.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.265+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd29c1e7eb0 con 0x7fd29c0cfe30 2024-09-21T06:11:57.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.266+0000 7fd293e00640 1 -- 172.21.15.118:0/3660124282 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd28801a070 con 0x7fd29c0cfe30 2024-09-21T06:11:57.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.267+0000 7fd293e00640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd27c078bc0 0x7fd27c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.267+0000 7fd293e00640 1 -- 172.21.15.118:0/3660124282 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7fd28809a170 con 0x7fd29c0cfe30 2024-09-21T06:11:57.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.267+0000 7fd29be00640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd27c078bc0 0x7fd27c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.268+0000 7fd29be00640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd27c078bc0 0x7fd27c07b0d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd28c034000 tx=0x7fd28c004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:57.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.271+0000 7fd293e00640 1 -- 172.21.15.118:0/3660124282 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd29c15a1d0 con 0x7fd29c0cfe30 2024-09-21T06:11:57.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.492+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd29c15e9f0 con 0x7fd29c0cfe30 2024-09-21T06:11:57.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.492+0000 7fd293e00640 1 -- 172.21.15.118:0/3660124282 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) ==== 53+0+73 (secure 0 0 0) 0x7fd288061e80 con 0x7fd29c0cfe30 2024-09-21T06:11:57.495 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:11:57.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.494+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd27c078bc0 msgr2=0x7fd27c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.494+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd27c078bc0 0x7fd27c07b0d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd28c034000 tx=0x7fd28c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.494+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0cfe30 msgr2=0x7fd29c1f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.494+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0cfe30 0x7fd29c1f5170 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c3d0 tx=0x7fd28800c890 comp rx=0 tx=0).stop 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 shutdown_connections 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd27c078bc0 0x7fd27c07b0d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd29c159880 0x7fd29c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0cfe30 0x7fd29c1f5170 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 --2- 172.21.15.118:0/3660124282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c073fa0 0x7fd29c1e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 >> 172.21.15.118:0/3660124282 conn(0x7fd29c06d6e0 msgr2=0x7fd29c145d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:57.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 shutdown_connections 2024-09-21T06:11:57.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57.495+0000 7fd2a1600640 1 -- 172.21.15.118:0/3660124282 wait complete. 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:11:57.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:11:57.525 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:11:57.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:57.525 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:11:57.559 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42267sec preferred_lft 42267sec 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:11:57.562 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:57.562 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:11:57.562 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:57.562 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:11:57.562 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:57.562 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:11:57.563 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:11:57.563 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:11:57.563 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:57.563 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:11:57.563 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:11:57.563 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:11:57.563 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:57.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:57.565 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:11:57.658 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:11:57.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:57.661 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:11:57.698 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:11:57.698 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:11:57.698 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:11:57.698 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:11:57.698 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:11:57.698 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:11:57.698 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:11:57.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:11:57.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:11:57.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:11:57.699 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:11:57.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:11:57.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:11:57.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:57.897 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:11:57.932 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:11:57.932 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:11:57.933 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:11:57.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:57.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:11:58.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:11:58.028 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:11:58.063 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:11:58.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:11:58.064 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:11:58.137 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:11:58.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:58.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:11:58.331 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:11:58.331 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:11:58.365 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:11:58.365 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:11:58.365 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:11:58.365 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:11:58.365 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:11:58.366 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:11:58.367 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:11:58.367 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:11:58.367 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:11:58.367 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:11:58.369 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:11:58.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:58.370 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:11:58.426 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:11:58.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:11:58.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:11:58.525 INFO:teuthology.orchestra.run.smithi118.stdout:client7614 2024-09-21T06:11:58.525 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:11:58.525 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:11:58.561 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:11:58.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.819+0000 7f108d000640 1 -- 172.21.15.118:0/2181736532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1088160050 msgr2=0x7f108815d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:58.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.819+0000 7f108d000640 1 --2- 172.21.15.118:0/2181736532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1088160050 0x7f108815d940 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f1080005fd0 tx=0x7f108002a940 comp rx=0 tx=0).stop 2024-09-21T06:11:58.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.819+0000 7f108d000640 1 -- 172.21.15.118:0/2181736532 shutdown_connections 2024-09-21T06:11:58.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.819+0000 7f108d000640 1 --2- 172.21.15.118:0/2181736532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1088160050 0x7f108815d940 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:58.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.819+0000 7f108d000640 1 -- 172.21.15.118:0/2181736532 >> 172.21.15.118:0/2181736532 conn(0x7f108806d6e0 msgr2=0x7f10880b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:58.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.819+0000 7f108d000640 1 -- 172.21.15.118:0/2181736532 shutdown_connections 2024-09-21T06:11:58.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.819+0000 7f108d000640 1 -- 172.21.15.118:0/2181736532 wait complete. 2024-09-21T06:11:58.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.821+0000 7f108d000640 1 Processor -- start 2024-09-21T06:11:58.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.822+0000 7f108d000640 1 -- start start 2024-09-21T06:11:58.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f108d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1088146230 0x7f10881f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:58.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f108d000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1088160050 0x7f10881f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:58.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f108d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f108813cea0 0x7f10881f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:58.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f108d000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f10881681d0 con 0x7f108813cea0 2024-09-21T06:11:58.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f108d000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1088168050 con 0x7f1088160050 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f108d000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1088168350 con 0x7f1088146230 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f1087e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f108813cea0 0x7f10881f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f1087e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f108813cea0 0x7f10881f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43088/0 (socket says 172.21.15.118:43088) 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.823+0000 7f1087e00640 1 -- 172.21.15.118:0/2018030028 learned_addr learned my addr 172.21.15.118:0/2018030028 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f107ea00640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1088160050 0x7f10881f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f1087400640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1088146230 0x7f10881f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f1087e00640 1 -- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1088146230 msgr2=0x7f10881f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f1087e00640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1088146230 0x7f10881f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f1087e00640 1 -- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1088160050 msgr2=0x7f10881f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f1087e00640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1088160050 0x7f10881f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f1087e00640 1 -- 172.21.15.118:0/2018030028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1088143b90 con 0x7f108813cea0 2024-09-21T06:11:58.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f1087e00640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f108813cea0 0x7f10881f6230 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f1080006010 tx=0x7f1080031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:58.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f107fe00640 1 -- 172.21.15.118:0/2018030028 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108003e070 con 0x7f108813cea0 2024-09-21T06:11:58.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.824+0000 7f107fe00640 1 -- 172.21.15.118:0/2018030028 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1080004540 con 0x7f108813cea0 2024-09-21T06:11:58.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.825+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1088143e70 con 0x7f108813cea0 2024-09-21T06:11:58.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.825+0000 7f107fe00640 1 -- 172.21.15.118:0/2018030028 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1080043460 con 0x7f108813cea0 2024-09-21T06:11:58.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.825+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1088144430 con 0x7f108813cea0 2024-09-21T06:11:58.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.826+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10880b5bb0 con 0x7f108813cea0 2024-09-21T06:11:58.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.827+0000 7f107fe00640 1 -- 172.21.15.118:0/2018030028 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1080043600 con 0x7f108813cea0 2024-09-21T06:11:58.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.828+0000 7f107fe00640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1064078b90 0x7f106407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:58.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.828+0000 7f107fe00640 1 -- 172.21.15.118:0/2018030028 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f10800bcb10 con 0x7f108813cea0 2024-09-21T06:11:58.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.828+0000 7f1087400640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1064078b90 0x7f106407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:58.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.829+0000 7f1087400640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1064078b90 0x7f106407b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1078000f60 tx=0x7f1078009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:58.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:58.832+0000 7f107fe00640 1 -- 172.21.15.118:0/2018030028 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1080084e70 con 0x7f108813cea0 2024-09-21T06:11:59.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.055+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1088143920 con 0x7f108813cea0 2024-09-21T06:11:59.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.056+0000 7f107fe00640 1 -- 172.21.15.118:0/2018030028 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) ==== 53+0+73 (secure 0 0 0) 0x7f1080084770 con 0x7f108813cea0 2024-09-21T06:11:59.058 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1064078b90 msgr2=0x7f106407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1064078b90 0x7f106407b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1078000f60 tx=0x7f1078009040 comp rx=0 tx=0).stop 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f108813cea0 msgr2=0x7f10881f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f108813cea0 0x7f10881f6230 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f1080006010 tx=0x7f1080031e20 comp rx=0 tx=0).stop 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 shutdown_connections 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f108813cea0 0x7f10881f6230 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1088160050 0x7f10881f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1064078b90 0x7f106407b0a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 --2- 172.21.15.118:0/2018030028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1088146230 0x7f10881f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 >> 172.21.15.118:0/2018030028 conn(0x7f108806d6e0 msgr2=0x7f10880b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:59.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.058+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 shutdown_connections 2024-09-21T06:11:59.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:11:59.059+0000 7f108d000640 1 -- 172.21.15.118:0/2018030028 wait complete. 2024-09-21T06:11:59.082 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:11:59.083 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:11:59.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:59.083 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:11:59.123 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:11:59.124 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42240sec preferred_lft 42240sec 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:11:59.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:59.126 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:11:59.220 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:11:59.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:59.224 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:11:59.260 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:11:59.260 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:11:59.260 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:11:59.261 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:11:59.261 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:11:59.261 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:11:59.261 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:11:59.261 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:11:59.261 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:11:59.261 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:11:59.261 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:11:59.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:11:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:11:59.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:11:59.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:59.461 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:11:59.496 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:11:59.496 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:11:59.496 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:11:59.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:59.497 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:11:59.592 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:11:59.592 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:11:59.627 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:11:59.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:11:59.627 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:11:59.702 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:11:59.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:59.703 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:11:59.897 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:11:59.898 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:11:59.932 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:11:59.932 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:11:59.932 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:11:59.932 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:11:59.932 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:11:59.934 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:11:59.934 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:11:59.934 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:11:59.934 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:11:59.934 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:11:59.937 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:11:59.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:11:59.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:11:59.993 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:12:00.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:12:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:12:00.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:12:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:12:00.084 INFO:teuthology.orchestra.run.smithi149.stdout:client6425 2024-09-21T06:12:00.084 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:12:00.084 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:12:00.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:12:00.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.344+0000 7f43c7600640 1 -- 172.21.15.118:0/3816338817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 msgr2=0x7f43c00d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.344+0000 7f43c7600640 1 --2- 172.21.15.118:0/3816338817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c00d13c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f43c0071c00 tx=0x7f43ac02a560 comp rx=0 tx=0).stop 2024-09-21T06:12:00.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.344+0000 7f43c7600640 1 -- 172.21.15.118:0/3816338817 shutdown_connections 2024-09-21T06:12:00.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.344+0000 7f43c7600640 1 --2- 172.21.15.118:0/3816338817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c00d13c0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.344+0000 7f43c7600640 1 --2- 172.21.15.118:0/3816338817 >> v2:172.21.15.149:3300/0 conn(0x7f43c013fae0 0x7f43c00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.344+0000 7f43c7600640 1 -- 172.21.15.118:0/3816338817 >> 172.21.15.118:0/3816338817 conn(0x7f43c006d110 msgr2=0x7f43c006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:00.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.345+0000 7f43c7600640 1 -- 172.21.15.118:0/3816338817 shutdown_connections 2024-09-21T06:12:00.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.345+0000 7f43c7600640 1 -- 172.21.15.118:0/3816338817 wait complete. 2024-09-21T06:12:00.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.347+0000 7f43c7600640 1 Processor -- start 2024-09-21T06:12:00.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.347+0000 7f43c7600640 1 -- start start 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.348+0000 7f43c7600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43c013fae0 0x7f43c0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.348+0000 7f43c7600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c014ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.348+0000 7f43c7600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c0142730 0x7f43c01f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.348+0000 7f43c7600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f43c00cfa70 con 0x7f43c013fef0 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.348+0000 7f43c7600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f43c00cf8f0 con 0x7f43c0142730 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.348+0000 7f43c7600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f43c00cfbf0 con 0x7f43c013fae0 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c014ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c014ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43112/0 (socket says 172.21.15.118:43112) 2024-09-21T06:12:00.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 -- 172.21.15.118:0/2390231780 learned_addr learned my addr 172.21.15.118:0/2390231780 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:12:00.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43c5600640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c0142730 0x7f43c01f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43c4c00640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43c013fae0 0x7f43c0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 -- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43c013fae0 msgr2=0x7f43c0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43c013fae0 0x7f43c0151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 -- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c0142730 msgr2=0x7f43c01f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c0142730 0x7f43c01f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 -- 172.21.15.118:0/2390231780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c01f5e80 con 0x7f43c013fef0 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.349+0000 7f43bfe00640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c014ff40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f43ac034040 tx=0x7f43ac003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.350+0000 7f43bcc00640 1 -- 172.21.15.118:0/2390231780 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac03e030 con 0x7f43c013fef0 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.350+0000 7f43bcc00640 1 -- 172.21.15.118:0/2390231780 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43ac003d10 con 0x7f43c013fef0 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.350+0000 7f43bcc00640 1 -- 172.21.15.118:0/2390231780 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac035040 con 0x7f43c013fef0 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.350+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c0152110 con 0x7f43c013fef0 2024-09-21T06:12:00.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.350+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c01526d0 con 0x7f43c013fef0 2024-09-21T06:12:00.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.351+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c00d0110 con 0x7f43c013fef0 2024-09-21T06:12:00.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.352+0000 7f43bcc00640 1 -- 172.21.15.118:0/2390231780 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43ac041030 con 0x7f43c013fef0 2024-09-21T06:12:00.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.353+0000 7f43bcc00640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43a0078b90 0x7f43a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.353+0000 7f43bcc00640 1 -- 172.21.15.118:0/2390231780 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f43ac0bb4f0 con 0x7f43c013fef0 2024-09-21T06:12:00.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.353+0000 7f43c4c00640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43a0078b90 0x7f43a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.354+0000 7f43c4c00640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43a0078b90 0x7f43a007b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009b30 tx=0x7f43b4005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:00.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.357+0000 7f43bcc00640 1 -- 172.21.15.118:0/2390231780 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f43ac083200 con 0x7f43c013fef0 2024-09-21T06:12:00.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.579+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43c0151ea0 con 0x7f43c013fef0 2024-09-21T06:12:00.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.580+0000 7f43bcc00640 1 -- 172.21.15.118:0/2390231780 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5237 (secure 0 0 0) 0x7f43ac087c30 con 0x7f43c013fef0 2024-09-21T06:12:00.583 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:12:00.583 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:11:34.994541+0000","modified":"2024-09-21T06:11:38.003984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1596006114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1596006114},{"type":"v1","addr":"172.21.15.118:6835","nonce":1596006114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7377,"qdb_cluster":[7377]},"id":9}]} 2024-09-21T06:12:00.583 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 77 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43a0078b90 msgr2=0x7f43a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43a0078b90 0x7f43a007b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009b30 tx=0x7f43b4005f90 comp rx=0 tx=0).stop 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 msgr2=0x7f43c014ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c014ff40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f43ac034040 tx=0x7f43ac003820 comp rx=0 tx=0).stop 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 shutdown_connections 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c0142730 0x7f43c01f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c013fef0 0x7f43c014ff40 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f43a0078b90 0x7f43a007b0a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 --2- 172.21.15.118:0/2390231780 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43c013fae0 0x7f43c0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 >> 172.21.15.118:0/2390231780 conn(0x7f43c006d110 msgr2=0x7f43c0142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 shutdown_connections 2024-09-21T06:12:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:00.583+0000 7f43c7600640 1 -- 172.21.15.118:0/2390231780 wait complete. 2024-09-21T06:12:00.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-21T06:12:00.855 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":7377,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":25.336006225999999,"mdsmap_epoch":77,"osdmap_epoch":149,"osdmap_epoch_barrier":147,"uptime":30.356803096} 2024-09-21T06:12:00.855 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 7377, "mdsmap_epoch": 77, "osdmap_epoch": 149, "osdmap_epoch_barrier": 147, "rank_uptime": 25.336006226, "state": "up:active", "uptime": 30.356803096, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:12:00.856 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-21T06:12:01.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 -- 172.21.15.118:0/3390485638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b2660 msgr2=0x7f9cb0161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:01.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3390485638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b2660 0x7f9cb0161500 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00692e0 tx=0x7f9c9802a4a0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 -- 172.21.15.118:0/3390485638 shutdown_connections 2024-09-21T06:12:01.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3390485638 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cb00b0c30 0x7f9cb00afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3390485638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b2660 0x7f9cb0161500 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 -- 172.21.15.118:0/3390485638 >> 172.21.15.118:0/3390485638 conn(0x7f9cb0074860 msgr2=0x7f9cb0074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:01.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 -- 172.21.15.118:0/3390485638 shutdown_connections 2024-09-21T06:12:01.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.077+0000 7f9cb6800640 1 -- 172.21.15.118:0/3390485638 wait complete. 2024-09-21T06:12:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.079+0000 7f9cb6800640 1 Processor -- start 2024-09-21T06:12:01.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.079+0000 7f9cb6800640 1 -- start start 2024-09-21T06:12:01.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.080+0000 7f9cb6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b0c30 0x7f9cb01458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.080+0000 7f9cb6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb01541a0 0x7f9cb01f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9cb6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cb01f5990 0x7f9cb0156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9cb6800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00b00f0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9cb6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00aff70 con 0x7f9cb01541a0 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9cb6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb00b0270 con 0x7f9cb01f5990 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b0c30 0x7f9cb01458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b0c30 0x7f9cb01458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43122/0 (socket says 172.21.15.118:43122) 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 -- 172.21.15.118:0/3407979777 learned_addr learned my addr 172.21.15.118:0/3407979777 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9ca6a00640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb01541a0 0x7f9cb01f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9cafe00640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cb01f5990 0x7f9cb0156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 -- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cb01f5990 msgr2=0x7f9cb0156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cb01f5990 0x7f9cb0156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 -- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb01541a0 msgr2=0x7f9cb01f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb01541a0 0x7f9cb01f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9caf400640 1 -- 172.21.15.118:0/3407979777 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb01fa500 con 0x7f9cb00b0c30 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9ca6a00640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb01541a0 0x7f9cb01f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.081+0000 7f9cafe00640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cb01f5990 0x7f9cb0156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.082+0000 7f9caf400640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b0c30 0x7f9cb01458d0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000b450 tx=0x7f9ca000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.082+0000 7f9ca7e00640 1 -- 172.21.15.118:0/3407979777 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0015020 con 0x7f9cb00b0c30 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.082+0000 7f9ca7e00640 1 -- 172.21.15.118:0/3407979777 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ca0011980 con 0x7f9cb00b0c30 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.082+0000 7f9ca7e00640 1 -- 172.21.15.118:0/3407979777 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0011dd0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.082+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb01462b0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.082+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb01f97c0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.083+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb01467d0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.084+0000 7f9ca7e00640 1 -- 172.21.15.118:0/3407979777 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ca0018020 con 0x7f9cb00b0c30 2024-09-21T06:12:01.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.085+0000 7f9ca7e00640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c8c078bc0 0x7f9c8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:01.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.085+0000 7f9ca7e00640 1 -- 172.21.15.118:0/3407979777 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f9ca009acf0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.086+0000 7f9ca6a00640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c8c078bc0 0x7f9c8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:01.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.087+0000 7f9ca6a00640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c8c078bc0 0x7f9c8c07b0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c98004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.090+0000 7f9ca7e00640 1 -- 172.21.15.118:0/3407979777 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9cb01467d0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.275+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f9cb00b07b0 con 0x7f9cb00b0c30 2024-09-21T06:12:01.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.853+0000 7f9ca7e00640 1 -- 172.21.15.118:0/3407979777 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v150) ==== 181+0+0 (secure 0 0 0) 0x7f9ca001f030 con 0x7f9cb00b0c30 2024-09-21T06:12:01.856 INFO:teuthology.orchestra.run.smithi118.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-21T06:12:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.856+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c8c078bc0 msgr2=0x7f9c8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.856+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c8c078bc0 0x7f9c8c07b0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c98004730 comp rx=0 tx=0).stop 2024-09-21T06:12:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.856+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b0c30 msgr2=0x7f9cb01458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.856+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b0c30 0x7f9cb01458d0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000b450 tx=0x7f9ca000b910 comp rx=0 tx=0).stop 2024-09-21T06:12:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 shutdown_connections 2024-09-21T06:12:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9c8c078bc0 0x7f9c8c07b0d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cb01f5990 0x7f9cb0156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb01541a0 0x7f9cb01f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 --2- 172.21.15.118:0/3407979777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cb00b0c30 0x7f9cb01458d0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 >> 172.21.15.118:0/3407979777 conn(0x7f9cb0074860 msgr2=0x7f9cb006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:01.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 shutdown_connections 2024-09-21T06:12:01.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:12:01.857+0000 7f9cb6800640 1 -- 172.21.15.118:0/3407979777 wait complete. 2024-09-21T06:12:01.886 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:12:02.123 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:12:02.123 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:12:02.123 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-21T06:12:02.350 INFO:teuthology.orchestra.run.smithi118.stdout:{"mon_tick_interval":"5"} 2024-09-21T06:12:02.351 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-21T06:12:02.351 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-21T06:12:02.351 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:12:02.351 DEBUG:teuthology.orchestra.run.smithi118:> import time 2024-09-21T06:12:02.351 DEBUG:teuthology.orchestra.run.smithi118:> import datetime 2024-09-21T06:12:02.351 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-09-21T06:12:02.351 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:12:02.351 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.351 DEBUG:teuthology.orchestra.run.smithi118:> # Write some buffered data through before going full, all should be well 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> print("writing some data through which we expect to succeed") 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> bytes = 0 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> # buffered IO, the error should always only appear from fsync and not 2024-09-21T06:12:02.352 DEBUG:teuthology.orchestra.run.smithi118:> # from write 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> full = False 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> for n in range(0, int(32 * 0.9)): 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> print("done writing {0} bytes".format(bytes)) 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> # OK, now we should sneak in under the full condition 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> # due to the time it takes the OSDs to report to the 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> # mons, and get a successful fsync on our full-making data 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> # buffered write, add more dirty data to the buffer 2024-09-21T06:12:02.353 DEBUG:teuthology.orchestra.run.smithi118:> print("starting buffered write") 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> for n in range(0, int(32 * 0.2)): 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> time.sleep(15.0) 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> except OSError: 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> pass; 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> # Wait long enough for a background flush that should fail 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> time.sleep(30) 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> if False: 2024-09-21T06:12:02.354 DEBUG:teuthology.orchestra.run.smithi118:> # ...and check that the failed background flush is reflected in fclose 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> os.close(f) 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> except OSError: 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> print("close() returned an error as expected") 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("close() failed to raise error") 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> # The kernel cephfs client does not raise errors on fclose 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> os.close(f) 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-21T06:12:02.355 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:12:20.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:12:20.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:12:50.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:12:50.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:13:20.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:13:20.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:13:50.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:13:50.373 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:writing some data through which we expect to succeed 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-21T06:14:05.712 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-21T06:14:05.713 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:done writing 29884416 bytes 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:successfully fsync'ed prior to getting full state reported 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:starting buffered write 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:14:05.714 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:14:05.715 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:14:05.715 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:14:05.715 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:14:05.715 INFO:teuthology.orchestra.run.smithi118.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-21T06:14:05.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:14:05.728 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:14:05.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:14:05.816 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:14:05.924 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:14:05.924 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:14:05.924 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:14:05.924 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:05.961 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:14:05.961 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:06.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:14:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 -- 172.21.15.118:0/697265506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c142e40 msgr2=0x7f059c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 --2- 172.21.15.118:0/697265506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c142e40 0x7f059c0d13c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0594005fd0 tx=0x7f059402aa10 comp rx=0 tx=0).stop 2024-09-21T06:14:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 -- 172.21.15.118:0/697265506 shutdown_connections 2024-09-21T06:14:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 --2- 172.21.15.118:0/697265506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c142e40 0x7f059c0d13c0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 --2- 172.21.15.118:0/697265506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f059c13fae0 0x7f059c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 -- 172.21.15.118:0/697265506 >> 172.21.15.118:0/697265506 conn(0x7f059c06d110 msgr2=0x7f059c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:06.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 -- 172.21.15.118:0/697265506 shutdown_connections 2024-09-21T06:14:06.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.296+0000 7f05a2400640 1 -- 172.21.15.118:0/697265506 wait complete. 2024-09-21T06:14:06.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.298+0000 7f05a2400640 1 Processor -- start 2024-09-21T06:14:06.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.299+0000 7f05a2400640 1 -- start start 2024-09-21T06:14:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f05a2400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f059c13fae0 0x7f059c13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f05a2400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c13fef0 0x7f059c138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f05a2400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f059c142e40 0x7f059c0b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f05a2400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f059c0cfac0 con 0x7f059c13fef0 2024-09-21T06:14:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f05a2400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f059c0cf940 con 0x7f059c13fae0 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f05a2400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f059c0cfc40 con 0x7f059c142e40 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f0592a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c13fef0 0x7f059c138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f0592a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c13fef0 0x7f059c138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55298/0 (socket says 172.21.15.118:55298) 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.300+0000 7f0592a00640 1 -- 172.21.15.118:0/1060306500 learned_addr learned my addr 172.21.15.118:0/1060306500 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f059be00640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f059c142e40 0x7f059c0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f059b400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f059c13fae0 0x7f059c13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0592a00640 1 -- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f059c142e40 msgr2=0x7f059c0b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0592a00640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f059c142e40 0x7f059c0b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0592a00640 1 -- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f059c13fae0 msgr2=0x7f059c13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0592a00640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f059c13fae0 0x7f059c13e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0592a00640 1 -- 172.21.15.118:0/1060306500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059c13ee00 con 0x7f059c13fef0 2024-09-21T06:14:06.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f059b400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f059c13fae0 0x7f059c13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:06.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f059be00640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f059c142e40 0x7f059c0b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:06.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0592a00640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c13fef0 0x7f059c138d30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f058400c430 tx=0x7f058400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584017070 con 0x7f059c13fef0 2024-09-21T06:14:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05840053c0 con 0x7f059c13fef0 2024-09-21T06:14:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059c13eb20 con 0x7f059c13fef0 2024-09-21T06:14:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.301+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584003850 con 0x7f059c13fef0 2024-09-21T06:14:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.302+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059c13d4e0 con 0x7f059c13fef0 2024-09-21T06:14:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.303+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059c0d00f0 con 0x7f059c13fef0 2024-09-21T06:14:06.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.304+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f058401a070 con 0x7f059c13fef0 2024-09-21T06:14:06.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.305+0000 7f0593e00640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0578078b90 0x7f057807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:06.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.305+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7f058409a170 con 0x7f059c13fef0 2024-09-21T06:14:06.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.306+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7f05780807d0 con 0x7f059c13fef0 2024-09-21T06:14:06.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.306+0000 7f059b400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0578078b90 0x7f057807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:06.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.307+0000 7f059b400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0578078b90 0x7f057807b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f058c005fd0 tx=0x7f058c00f360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:06.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.310+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f05840625e0 con 0x7f059c13fef0 2024-09-21T06:14:06.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.514+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f059c13e8b0 con 0x7f059c13fef0 2024-09-21T06:14:06.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.515+0000 7f0593e00640 1 -- 172.21.15.118:0/1060306500 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v151) ==== 80+0+0 (secure 0 0 0) 0x7f0584061ee0 con 0x7f059c13fef0 2024-09-21T06:14:06.517 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:14:06.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0578078b90 msgr2=0x7f057807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0578078b90 0x7f057807b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f058c005fd0 tx=0x7f058c00f360 comp rx=0 tx=0).stop 2024-09-21T06:14:06.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c13fef0 msgr2=0x7f059c138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c13fef0 0x7f059c138d30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f058400c430 tx=0x7f058400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 shutdown_connections 2024-09-21T06:14:06.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0578078b90 0x7f057807b0a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f059c142e40 0x7f059c0b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f059c13fef0 0x7f059c138d30 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 --2- 172.21.15.118:0/1060306500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f059c13fae0 0x7f059c13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 >> 172.21.15.118:0/1060306500 conn(0x7f059c06d110 msgr2=0x7f059c0d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 shutdown_connections 2024-09-21T06:14:06.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.517+0000 7f05a2400640 1 -- 172.21.15.118:0/1060306500 wait complete. 2024-09-21T06:14:06.542 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:14:06.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:06.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:14:06.606 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:14:06.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:06.607 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:14:06.649 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:14:06.649 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:14:06.649 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:06.689 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:14:06.690 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:06.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 -- 172.21.15.118:0/3367088136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00cfe30 msgr2=0x7fc7c00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/3367088136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00cfe30 0x7fc7c00d0240 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0160810 tx=0x7fc7a802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 -- 172.21.15.118:0/3367088136 shutdown_connections 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/3367088136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00cfe30 0x7fc7c00d0240 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/3367088136 >> v2:172.21.15.149:3300/0 conn(0x7fc7c00b5bb0 0x7fc7c00b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/3367088136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7c0073fa0 0x7fc7c00749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 -- 172.21.15.118:0/3367088136 >> 172.21.15.118:0/3367088136 conn(0x7fc7c006d6e0 msgr2=0x7fc7c00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 -- 172.21.15.118:0/3367088136 shutdown_connections 2024-09-21T06:14:06.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.988+0000 7fc7c5a00640 1 -- 172.21.15.118:0/3367088136 wait complete. 2024-09-21T06:14:06.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.990+0000 7fc7c5a00640 1 Processor -- start 2024-09-21T06:14:06.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.990+0000 7fc7c5a00640 1 -- start start 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7c0073fa0 0x7fc7c0145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00b5bb0 0x7fc7c013b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7c00cfe30 0x7fc7c00c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7c5a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c015d7b0 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7c5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c015d630 con 0x7fc7c00cfe30 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7c5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c015d930 con 0x7fc7c0073fa0 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7b7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00b5bb0 0x7fc7c013b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7b7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00b5bb0 0x7fc7c013b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55306/0 (socket says 172.21.15.118:55306) 2024-09-21T06:14:06.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7b7400640 1 -- 172.21.15.118:0/1592807121 learned_addr learned my addr 172.21.15.118:0/1592807121 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:06.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7bfe00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7c0073fa0 0x7fc7c0145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:06.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.992+0000 7fc7c5000640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7c00cfe30 0x7fc7c00c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:06.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7b7400640 1 -- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7c0073fa0 msgr2=0x7fc7c0145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7b7400640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7c0073fa0 0x7fc7c0145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7b7400640 1 -- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7c00cfe30 msgr2=0x7fc7c00c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7b7400640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7c00cfe30 0x7fc7c00c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7b7400640 1 -- 172.21.15.118:0/1592807121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c0145a40 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7b7400640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00b5bb0 0x7fc7c013b060 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8000c00 tx=0x7fc7a80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:06.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a803e030 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7a8003ca0 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c00ccdc0 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.993+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8035040 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.995+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c00cc000 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.995+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c00b5fc0 con 0x7fc7c00b5bb0 2024-09-21T06:14:06.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.996+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7a8041030 con 0x7fc7c00b5bb0 2024-09-21T06:14:07.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.997+0000 7fc7bcc00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc79c078b90 0x7fc79c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:07.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.997+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7fc7a80bb400 con 0x7fc7c00b5bb0 2024-09-21T06:14:07.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.998+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7fc79c0807d0 con 0x7fc7c00b5bb0 2024-09-21T06:14:07.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.998+0000 7fc7bfe00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc79c078b90 0x7fc79c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:07.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:06.998+0000 7fc7bfe00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc79c078b90 0x7fc79c07b0a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009ab0 tx=0x7fc7b0005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:07.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.002+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc7c0145a40 con 0x7fc7c00b5bb0 2024-09-21T06:14:07.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.197+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc7c01f9fd0 con 0x7fc7c00b5bb0 2024-09-21T06:14:07.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.198+0000 7fc7bcc00640 1 -- 172.21.15.118:0/1592807121 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v151) ==== 80+0+0 (secure 0 0 0) 0x7fc7c01f9fd0 con 0x7fc7c00b5bb0 2024-09-21T06:14:07.200 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:14:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc79c078b90 msgr2=0x7fc79c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc79c078b90 0x7fc79c07b0a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009ab0 tx=0x7fc7b0005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00b5bb0 msgr2=0x7fc7c013b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00b5bb0 0x7fc7c013b060 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8000c00 tx=0x7fc7a80038a0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 shutdown_connections 2024-09-21T06:14:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7c00cfe30 0x7fc7c00c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7c00b5bb0 0x7fc7c013b060 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc79c078b90 0x7fc79c07b0a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 --2- 172.21.15.118:0/1592807121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7c0073fa0 0x7fc7c0145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 >> 172.21.15.118:0/1592807121 conn(0x7fc7c006d6e0 msgr2=0x7fc7c00b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:07.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.200+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 shutdown_connections 2024-09-21T06:14:07.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.201+0000 7fc7c5a00640 1 -- 172.21.15.118:0/1592807121 wait complete. 2024-09-21T06:14:07.228 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:14:07.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:07.228 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:14:07.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:14:07.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:07.297 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:14:07.334 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:14:07.334 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:14:07.334 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:07.370 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:14:07.370 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:14:07.370 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:14:07.370 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:07.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:14:07.414 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:07.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.632+0000 7f554ac00640 1 -- 172.21.15.118:0/708795549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 msgr2=0x7f55440d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:07.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.632+0000 7f554ac00640 1 --2- 172.21.15.118:0/708795549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55440d0e80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5534005fd0 tx=0x7f553402a5f0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.633+0000 7f554ac00640 1 -- 172.21.15.118:0/708795549 shutdown_connections 2024-09-21T06:14:07.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.633+0000 7f554ac00640 1 --2- 172.21.15.118:0/708795549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55440d0e80 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.633+0000 7f554ac00640 1 -- 172.21.15.118:0/708795549 >> 172.21.15.118:0/708795549 conn(0x7f554406d110 msgr2=0x7f554406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:07.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.633+0000 7f554ac00640 1 -- 172.21.15.118:0/708795549 shutdown_connections 2024-09-21T06:14:07.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.633+0000 7f554ac00640 1 -- 172.21.15.118:0/708795549 wait complete. 2024-09-21T06:14:07.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.635+0000 7f554ac00640 1 Processor -- start 2024-09-21T06:14:07.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.635+0000 7f554ac00640 1 -- start start 2024-09-21T06:14:07.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.636+0000 7f554ac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55441532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:07.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.636+0000 7f554ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f554413fef0 0x7f55441f9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:07.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.636+0000 7f554ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5544142e40 0x7f55441f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.636+0000 7f554ac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f55440cfce0 con 0x7f554413fae0 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.636+0000 7f554ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f55440cfb60 con 0x7f5544142e40 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.636+0000 7f554ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f55440cfe60 con 0x7f554413fef0 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55441532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55441532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55320/0 (socket says 172.21.15.118:55320) 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 -- 172.21.15.118:0/1420216452 learned_addr learned my addr 172.21.15.118:0/1420216452 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5548c00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5544142e40 0x7f55441f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543400640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f554413fef0 0x7f55441f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 -- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f554413fef0 msgr2=0x7f55441f9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f554413fef0 0x7f55441f9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 -- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5544142e40 msgr2=0x7f55441f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:07.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5544142e40 0x7f55441f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543e00640 1 -- 172.21.15.118:0/1420216452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554413db00 con 0x7f554413fae0 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.637+0000 7f5543400640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f554413fef0 0x7f55441f9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.638+0000 7f5543e00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55441532f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5534034040 tx=0x7f55340039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.638+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553403e030 con 0x7f554413fae0 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.638+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55340047a0 con 0x7f554413fae0 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.638+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554413dde0 con 0x7f554413fae0 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.638+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534035040 con 0x7f554413fae0 2024-09-21T06:14:07.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.638+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5544140550 con 0x7f554413fae0 2024-09-21T06:14:07.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.639+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55441587d0 con 0x7f554413fae0 2024-09-21T06:14:07.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.640+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5534041030 con 0x7f554413fae0 2024-09-21T06:14:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.641+0000 7f553be00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5524078bc0 0x7f552407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.641+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7f55340bb4d0 con 0x7f554413fae0 2024-09-21T06:14:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.641+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7f5524080860 con 0x7f554413fae0 2024-09-21T06:14:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.642+0000 7f5543400640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5524078bc0 0x7f552407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:07.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.642+0000 7f5543400640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5524078bc0 0x7f552407b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5544073e30 tx=0x7f5530009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:07.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.646+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f55441587d0 con 0x7f554413fae0 2024-09-21T06:14:07.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.866+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55440d0310 con 0x7f554413fae0 2024-09-21T06:14:07.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.866+0000 7f553be00640 1 -- 172.21.15.118:0/1420216452 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5237 (secure 0 0 0) 0x7f5534083300 con 0x7f554413fae0 2024-09-21T06:14:07.869 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:07.869 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:11:34.994541+0000","modified":"2024-09-21T06:11:38.003984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1596006114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1596006114},{"type":"v1","addr":"172.21.15.118:6835","nonce":1596006114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7377,"qdb_cluster":[7377]},"id":9}]} 2024-09-21T06:14:07.869 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 77 2024-09-21T06:14:07.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.868+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5524078bc0 msgr2=0x7f552407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:07.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.868+0000 7f554ac00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5524078bc0 0x7f552407b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5544073e30 tx=0x7f5530009040 comp rx=0 tx=0).stop 2024-09-21T06:14:07.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.868+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 msgr2=0x7f55441532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:07.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.868+0000 7f554ac00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55441532f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5534034040 tx=0x7f55340039e0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 shutdown_connections 2024-09-21T06:14:07.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5544142e40 0x7f55441f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5524078bc0 0x7f552407b0d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f554413fef0 0x7f55441f9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 --2- 172.21.15.118:0/1420216452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554413fae0 0x7f55441532f0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:07.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 >> 172.21.15.118:0/1420216452 conn(0x7f554406d110 msgr2=0x7f5544153cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:07.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 shutdown_connections 2024-09-21T06:14:07.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:07.869+0000 7f554ac00640 1 -- 172.21.15.118:0/1420216452 wait complete. 2024-09-21T06:14:07.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:08.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.113+0000 7f9d5b600640 1 -- 172.21.15.118:0/3747774912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540ccf80 msgr2=0x7f9d54073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.113+0000 7f9d5b600640 1 --2- 172.21.15.118:0/3747774912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540ccf80 0x7f9d54073370 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c005fd0 tx=0x7f9d4c02aa10 comp rx=0 tx=0).stop 2024-09-21T06:14:08.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.114+0000 7f9d5b600640 1 -- 172.21.15.118:0/3747774912 shutdown_connections 2024-09-21T06:14:08.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.114+0000 7f9d5b600640 1 --2- 172.21.15.118:0/3747774912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540ccf80 0x7f9d54073370 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.114+0000 7f9d5b600640 1 --2- 172.21.15.118:0/3747774912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d540b3a60 0x7f9d540cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.114+0000 7f9d5b600640 1 -- 172.21.15.118:0/3747774912 >> 172.21.15.118:0/3747774912 conn(0x7f9d5406d110 msgr2=0x7f9d5406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:08.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.114+0000 7f9d5b600640 1 -- 172.21.15.118:0/3747774912 shutdown_connections 2024-09-21T06:14:08.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.114+0000 7f9d5b600640 1 -- 172.21.15.118:0/3747774912 wait complete. 2024-09-21T06:14:08.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.116+0000 7f9d5b600640 1 Processor -- start 2024-09-21T06:14:08.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.116+0000 7f9d5b600640 1 -- start start 2024-09-21T06:14:08.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.117+0000 7f9d5b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540b3a60 0x7f9d541593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.117+0000 7f9d5b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d540ccf80 0x7f9d541f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.117+0000 7f9d5b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d5415cfd0 0x7f9d54133b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.117+0000 7f9d5b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9d54073c40 con 0x7f9d540b3a60 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d5b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d54073ac0 con 0x7f9d540ccf80 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d5b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d54073dc0 con 0x7f9d5415cfd0 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540b3a60 0x7f9d541593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540b3a60 0x7f9d541593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55338/0 (socket says 172.21.15.118:55338) 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 -- 172.21.15.118:0/1303490462 learned_addr learned my addr 172.21.15.118:0/1303490462 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d4be00640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d540ccf80 0x7f9d541f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d59600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d5415cfd0 0x7f9d54133b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 -- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d5415cfd0 msgr2=0x7f9d54133b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d5415cfd0 0x7f9d54133b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 -- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d540ccf80 msgr2=0x7f9d541f9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d540ccf80 0x7f9d541f9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 -- 172.21.15.118:0/1303490462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d54159cc0 con 0x7f9d540b3a60 2024-09-21T06:14:08.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.118+0000 7f9d58c00640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540b3a60 0x7f9d541593c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c3c0 tx=0x7f9d4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:08.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.119+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44017070 con 0x7f9d540b3a60 2024-09-21T06:14:08.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.119+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d440035f0 con 0x7f9d540b3a60 2024-09-21T06:14:08.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.119+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44003a80 con 0x7f9d540b3a60 2024-09-21T06:14:08.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.119+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d54159fa0 con 0x7f9d540b3a60 2024-09-21T06:14:08.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.119+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5415a560 con 0x7f9d540b3a60 2024-09-21T06:14:08.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.120+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5415ad60 con 0x7f9d540b3a60 2024-09-21T06:14:08.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.121+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d4401a070 con 0x7f9d540b3a60 2024-09-21T06:14:08.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.122+0000 7f9d51600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d30078b90 0x7f9d3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.122+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7f9d4409a080 con 0x7f9d540b3a60 2024-09-21T06:14:08.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.122+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7f9d300807d0 con 0x7f9d540b3a60 2024-09-21T06:14:08.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.122+0000 7f9d4be00640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d30078b90 0x7f9d3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.123+0000 7f9d4be00640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d30078b90 0x7f9d3007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9d541f01e0 tx=0x7f9d3c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:08.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.127+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9d44061d90 con 0x7f9d540b3a60 2024-09-21T06:14:08.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.348+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d540cca40 con 0x7f9d540b3a60 2024-09-21T06:14:08.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.349+0000 7f9d51600640 1 -- 172.21.15.118:0/1303490462 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5237 (secure 0 0 0) 0x7f9d440667c0 con 0x7f9d540b3a60 2024-09-21T06:14:08.351 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:08.351 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:11:34.994541+0000","modified":"2024-09-21T06:11:38.003984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1596006114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1596006114},{"type":"v1","addr":"172.21.15.118:6835","nonce":1596006114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7377,"qdb_cluster":[7377]},"id":9}]} 2024-09-21T06:14:08.351 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 77 2024-09-21T06:14:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d30078b90 msgr2=0x7f9d3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d30078b90 0x7f9d3007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9d541f01e0 tx=0x7f9d3c005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540b3a60 msgr2=0x7f9d541593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540b3a60 0x7f9d541593c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c3c0 tx=0x7f9d4400c880 comp rx=0 tx=0).stop 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 shutdown_connections 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9d30078b90 0x7f9d3007b0a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d5415cfd0 0x7f9d54133b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d540ccf80 0x7f9d541f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 --2- 172.21.15.118:0/1303490462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d540b3a60 0x7f9d541593c0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 >> 172.21.15.118:0/1303490462 conn(0x7f9d5406d110 msgr2=0x7f9d541453e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 shutdown_connections 2024-09-21T06:14:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.351+0000 7f9d5b600640 1 -- 172.21.15.118:0/1303490462 wait complete. 2024-09-21T06:14:08.375 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:14:08.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 -- 172.21.15.118:0/1918613808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 msgr2=0x7fa8f406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/1918613808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f406ecd0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4072ad0 tx=0x7fa8e402a5f0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 -- 172.21.15.118:0/1918613808 shutdown_connections 2024-09-21T06:14:08.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/1918613808 >> v2:172.21.15.149:3300/0 conn(0x7fa8f4155e60 0x7fa8f40d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/1918613808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f406ecd0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 -- 172.21.15.118:0/1918613808 >> 172.21.15.118:0/1918613808 conn(0x7fa8f406d110 msgr2=0x7fa8f406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:08.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 -- 172.21.15.118:0/1918613808 shutdown_connections 2024-09-21T06:14:08.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.594+0000 7fa8f9c00640 1 -- 172.21.15.118:0/1918613808 wait complete. 2024-09-21T06:14:08.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.597+0000 7fa8f9c00640 1 Processor -- start 2024-09-21T06:14:08.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.597+0000 7fa8f9c00640 1 -- start start 2024-09-21T06:14:08.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f4155e60 0x7fa8f41466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f9c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f4156270 0x7fa8f415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f9c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f41431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f9c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40d1560 con 0x7fa8f4160240 2024-09-21T06:14:08.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40d13e0 con 0x7fa8f4155e60 2024-09-21T06:14:08.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f9c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f40d16e0 con 0x7fa8f4156270 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f41431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f41431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55358/0 (socket says 172.21.15.118:55358) 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.598+0000 7fa8f3400640 1 -- 172.21.15.118:0/536916178 learned_addr learned my addr 172.21.15.118:0/536916178 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f2a00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f4155e60 0x7fa8f41466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f2000640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f4156270 0x7fa8f415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f3400640 1 -- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f4156270 msgr2=0x7fa8f415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f3400640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f4156270 0x7fa8f415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f3400640 1 -- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f4155e60 msgr2=0x7fa8f41466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f3400640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f4155e60 0x7fa8f41466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f3400640 1 -- 172.21.15.118:0/536916178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f4143730 con 0x7fa8f4160240 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f2a00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f4155e60 0x7fa8f41466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f2000640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f4156270 0x7fa8f415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:08.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f3400640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f41431f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00c6b0 tx=0x7fa8ec00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:08.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec003b70 con 0x7fa8f4160240 2024-09-21T06:14:08.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8ec003d30 con 0x7fa8f4160240 2024-09-21T06:14:08.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f41fa330 con 0x7fa8f4160240 2024-09-21T06:14:08.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.599+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec005330 con 0x7fa8f4160240 2024-09-21T06:14:08.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.600+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f41f9850 con 0x7fa8f4160240 2024-09-21T06:14:08.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.600+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f40d0ea0 con 0x7fa8f4160240 2024-09-21T06:14:08.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.602+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8ec0054d0 con 0x7fa8f4160240 2024-09-21T06:14:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.603+0000 7fa8eaa00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa8d4078b90 0x7fa8d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.603+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7fa8ec09aa90 con 0x7fa8f4160240 2024-09-21T06:14:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.603+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7fa8d40807d0 con 0x7fa8f4160240 2024-09-21T06:14:08.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.603+0000 7fa8f2a00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa8d4078b90 0x7fa8d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:08.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.604+0000 7fa8f2a00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa8d4078b90 0x7fa8d407b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4033000 tx=0x7fa8e4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:08.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.607+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa8ec062f10 con 0x7fa8f4160240 2024-09-21T06:14:08.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.796+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8f4155130 con 0x7fa8f4160240 2024-09-21T06:14:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.797+0000 7fa8eaa00640 1 -- 172.21.15.118:0/536916178 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16936 (secure 0 0 0) 0x7fa8ec062810 con 0x7fa8f4160240 2024-09-21T06:14:08.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:08.800 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":151,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:13:30.387599+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:11:32.912143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T06:11:33.950347+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.21","mappings":[{"from":2,"to":0}]},{"pgid":"19.30","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa8d4078b90 msgr2=0x7fa8d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa8d4078b90 0x7fa8d407b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4033000 tx=0x7fa8e4004730 comp rx=0 tx=0).stop 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 msgr2=0x7fa8f41431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f41431f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00c6b0 tx=0x7fa8ec00cb70 comp rx=0 tx=0).stop 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 shutdown_connections 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8f4160240 0x7fa8f41431f0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa8d4078b90 0x7fa8d407b0a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f4156270 0x7fa8f415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 --2- 172.21.15.118:0/536916178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f4155e60 0x7fa8f41466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 >> 172.21.15.118:0/536916178 conn(0x7fa8f406d110 msgr2=0x7fa8f40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:08.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 shutdown_connections 2024-09-21T06:14:08.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:08.800+0000 7fa8f9c00640 1 -- 172.21.15.118:0/536916178 wait complete. 2024-09-21T06:14:08.825 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:14:08.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 -- 172.21.15.118:0/4129874706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 msgr2=0x7f7a9c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 --2- 172.21.15.118:0/4129874706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c0d13c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c15d7d0 tx=0x7f7a8402a540 comp rx=0 tx=0).stop 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 -- 172.21.15.118:0/4129874706 shutdown_connections 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 --2- 172.21.15.118:0/4129874706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c0d13c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 --2- 172.21.15.118:0/4129874706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a9c142730 0x7f7a9c142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 --2- 172.21.15.118:0/4129874706 >> v2:172.21.15.149:3300/0 conn(0x7f7a9c13fae0 0x7f7a9c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 -- 172.21.15.118:0/4129874706 >> 172.21.15.118:0/4129874706 conn(0x7f7a9c06d110 msgr2=0x7f7a9c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 -- 172.21.15.118:0/4129874706 shutdown_connections 2024-09-21T06:14:09.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.044+0000 7f7aa2400640 1 -- 172.21.15.118:0/4129874706 wait complete. 2024-09-21T06:14:09.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.046+0000 7f7aa2400640 1 Processor -- start 2024-09-21T06:14:09.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.046+0000 7f7aa2400640 1 -- start start 2024-09-21T06:14:09.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7aa2400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a9c13fae0 0x7f7a9c13e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7aa2400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7aa2400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a9c142730 0x7f7a9c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7aa2400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c06f300 con 0x7f7a9c13fef0 2024-09-21T06:14:09.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7aa2400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c06f180 con 0x7f7a9c13fae0 2024-09-21T06:14:09.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7aa2400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9c06f480 con 0x7f7a9c142730 2024-09-21T06:14:09.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7a92a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7a92a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55374/0 (socket says 172.21.15.118:55374) 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7a92a00640 1 -- 172.21.15.118:0/1637591514 learned_addr learned my addr 172.21.15.118:0/1637591514 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7a9be00640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a9c142730 0x7f7a9c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.048+0000 7f7a9b400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a9c13fae0 0x7f7a9c13e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a92a00640 1 -- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a9c142730 msgr2=0x7f7a9c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a92a00640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a9c142730 0x7f7a9c1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a92a00640 1 -- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a9c13fae0 msgr2=0x7f7a9c13e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a92a00640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a9c13fae0 0x7f7a9c13e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a92a00640 1 -- 172.21.15.118:0/1637591514 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c074320 con 0x7f7a9c13fef0 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a9b400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a9c13fae0 0x7f7a9c13e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:09.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a92a00640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c155360 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7a84000c00 tx=0x7f7a84003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:09.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8403e030 con 0x7f7a9c13fef0 2024-09-21T06:14:09.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a84003e00 con 0x7f7a9c13fef0 2024-09-21T06:14:09.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c074600 con 0x7f7a9c13fef0 2024-09-21T06:14:09.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84035040 con 0x7f7a9c13fef0 2024-09-21T06:14:09.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.049+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c156290 con 0x7f7a9c13fef0 2024-09-21T06:14:09.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.050+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c06f9a0 con 0x7f7a9c13fef0 2024-09-21T06:14:09.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.052+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a84041030 con 0x7f7a9c13fef0 2024-09-21T06:14:09.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.053+0000 7f7a93e00640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7a78078b90 0x7f7a7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.053+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7f7a840bb500 con 0x7f7a9c13fef0 2024-09-21T06:14:09.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.053+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7f7a78080830 con 0x7f7a9c13fef0 2024-09-21T06:14:09.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.053+0000 7f7a9b400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7a78078b90 0x7f7a7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.054+0000 7f7a9b400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7a78078b90 0x7f7a7807b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005fd0 tx=0x7f7a8c00f360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:09.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.057+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7a840832a0 con 0x7f7a9c13fef0 2024-09-21T06:14:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.275+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a9c0747d0 con 0x7f7a9c13fef0 2024-09-21T06:14:09.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.275+0000 7f7a93e00640 1 -- 172.21.15.118:0/1637591514 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5237 (secure 0 0 0) 0x7f7a84087cd0 con 0x7f7a9c13fef0 2024-09-21T06:14:09.278 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:09.278 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:11:34.994541+0000","modified":"2024-09-21T06:11:38.003984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1596006114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1596006114},{"type":"v1","addr":"172.21.15.118:6835","nonce":1596006114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7377,"qdb_cluster":[7377]},"id":9}]} 2024-09-21T06:14:09.278 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 77 2024-09-21T06:14:09.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7a78078b90 msgr2=0x7f7a7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7a78078b90 0x7f7a7807b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005fd0 tx=0x7f7a8c00f360 comp rx=0 tx=0).stop 2024-09-21T06:14:09.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 msgr2=0x7f7a9c155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c155360 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7a84000c00 tx=0x7f7a84003910 comp rx=0 tx=0).stop 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 shutdown_connections 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7a78078b90 0x7f7a7807b0a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a9c142730 0x7f7a9c1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a9c13fef0 0x7f7a9c155360 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 --2- 172.21.15.118:0/1637591514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a9c13fae0 0x7f7a9c13e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 >> 172.21.15.118:0/1637591514 conn(0x7f7a9c06d110 msgr2=0x7f7a9c0cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 shutdown_connections 2024-09-21T06:14:09.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.278+0000 7f7aa2400640 1 -- 172.21.15.118:0/1637591514 wait complete. 2024-09-21T06:14:09.303 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:09.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 -- 172.21.15.118:0/3696865746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac040d0e80 msgr2=0x7fac040d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 --2- 172.21.15.118:0/3696865746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac040d0e80 0x7fac040d1290 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fac04071c00 tx=0x7fabf002a560 comp rx=0 tx=0).stop 2024-09-21T06:14:09.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 -- 172.21.15.118:0/3696865746 shutdown_connections 2024-09-21T06:14:09.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 --2- 172.21.15.118:0/3696865746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac040d0e80 0x7fac040d1290 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 --2- 172.21.15.118:0/3696865746 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac0406ecd0 0x7fac0406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 --2- 172.21.15.118:0/3696865746 >> v2:172.21.15.149:3300/0 conn(0x7fac04073e30 0x7fac041635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 -- 172.21.15.118:0/3696865746 >> 172.21.15.118:0/3696865746 conn(0x7fac0406d110 msgr2=0x7fac0406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:09.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 -- 172.21.15.118:0/3696865746 shutdown_connections 2024-09-21T06:14:09.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.522+0000 7fac0ba00640 1 -- 172.21.15.118:0/3696865746 wait complete. 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.525+0000 7fac0ba00640 1 Processor -- start 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.525+0000 7fac0ba00640 1 -- start start 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac0ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac0406ecd0 0x7fac0414b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac0ba00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac04073e30 0x7fac0413e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac0ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac040d0e80 0x7fac0413e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac0ba00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fac0406f620 con 0x7fac04073e30 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac0ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac04156530 con 0x7fac040d0e80 2024-09-21T06:14:09.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac0ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac0406f7a0 con 0x7fac0406ecd0 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac04073e30 0x7fac0413e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac04073e30 0x7fac0413e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55386/0 (socket says 172.21.15.118:55386) 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.526+0000 7fac03e00640 1 -- 172.21.15.118:0/2208529557 learned_addr learned my addr 172.21.15.118:0/2208529557 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac09a00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac040d0e80 0x7fac0413e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac09000640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac0406ecd0 0x7fac0414b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac03e00640 1 -- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac0406ecd0 msgr2=0x7fac0414b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac03e00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac0406ecd0 0x7fac0414b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac03e00640 1 -- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac040d0e80 msgr2=0x7fac0413e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac03e00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac040d0e80 0x7fac0413e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac03e00640 1 -- 172.21.15.118:0/2208529557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac040b1260 con 0x7fac04073e30 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac03e00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac04073e30 0x7fac0413e1e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fabf0034040 tx=0x7fabf0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.527+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf003e030 con 0x7fac04073e30 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.528+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabf0003d10 con 0x7fac04073e30 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.528+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0035040 con 0x7fac04073e30 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.528+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac040b1540 con 0x7fac04073e30 2024-09-21T06:14:09.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.528+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac040b1b00 con 0x7fac04073e30 2024-09-21T06:14:09.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.529+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac041635c0 con 0x7fac04073e30 2024-09-21T06:14:09.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.530+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabf0041030 con 0x7fac04073e30 2024-09-21T06:14:09.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.531+0000 7fac00c00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:09.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.532+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7fabf00bb4d0 con 0x7fac04073e30 2024-09-21T06:14:09.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.532+0000 7fac09000640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:09.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.532+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7fabe4080800 con 0x7fac04073e30 2024-09-21T06:14:09.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.533+0000 7fac09000640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fabf80058c0 tx=0x7fabf8005850 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:09.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.536+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabf00838c0 con 0x7fac04073e30 2024-09-21T06:14:09.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.758+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac04160c10 con 0x7fac04073e30 2024-09-21T06:14:09.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.758+0000 7fac00c00640 1 -- 172.21.15.118:0/2208529557 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5237 (secure 0 0 0) 0x7fabf00831c0 con 0x7fac04073e30 2024-09-21T06:14:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:09.761 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":77,"btime":"2024-09-21T06:11:38:514902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:11:34.994541+0000","modified":"2024-09-21T06:11:38.003984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7377":{"gid":7377,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1596006114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1596006114},{"type":"v1","addr":"172.21.15.118:6835","nonce":1596006114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7377,"qdb_cluster":[7377]},"id":9}]} 2024-09-21T06:14:09.761 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 77 2024-09-21T06:14:09.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 msgr2=0x7fabe407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fabf80058c0 tx=0x7fabf8005850 comp rx=0 tx=0).stop 2024-09-21T06:14:09.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac04073e30 msgr2=0x7fac0413e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:09.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac04073e30 0x7fac0413e1e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fabf0034040 tx=0x7fabf0003820 comp rx=0 tx=0).stop 2024-09-21T06:14:09.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 shutdown_connections 2024-09-21T06:14:09.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac040d0e80 0x7fac0413e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac04073e30 0x7fac0413e1e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fabe4078bc0 0x7fabe407b0d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 --2- 172.21.15.118:0/2208529557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac0406ecd0 0x7fac0414b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:09.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 >> 172.21.15.118:0/2208529557 conn(0x7fac0406d110 msgr2=0x7fac040af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:09.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 shutdown_connections 2024-09-21T06:14:09.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:09.761+0000 7fac0ba00640 1 -- 172.21.15.118:0/2208529557 wait complete. 2024-09-21T06:14:09.785 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:14:10.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 -- 172.21.15.118:0/2688647743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec6006ecd0 msgr2=0x7fec6006f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 --2- 172.21.15.118:0/2688647743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec6006ecd0 0x7fec6006f0e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fec48009830 tx=0x7fec4802a480 comp rx=0 tx=0).stop 2024-09-21T06:14:10.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 -- 172.21.15.118:0/2688647743 shutdown_connections 2024-09-21T06:14:10.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 --2- 172.21.15.118:0/2688647743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec6006ecd0 0x7fec6006f0e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 --2- 172.21.15.118:0/2688647743 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec60156220 0x7fec600afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 -- 172.21.15.118:0/2688647743 >> 172.21.15.118:0/2688647743 conn(0x7fec6006d110 msgr2=0x7fec6006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:10.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 -- 172.21.15.118:0/2688647743 shutdown_connections 2024-09-21T06:14:10.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.005+0000 7fec66600640 1 -- 172.21.15.118:0/2688647743 wait complete. 2024-09-21T06:14:10.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.007+0000 7fec66600640 1 Processor -- start 2024-09-21T06:14:10.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.008+0000 7fec66600640 1 -- start start 2024-09-21T06:14:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec66600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec6006ecd0 0x7fec60145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec66600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec600d0de0 0x7fec60159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec66600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec60156220 0x7fec601619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec66600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fec60073270 con 0x7fec600d0de0 2024-09-21T06:14:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec66600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec600730f0 con 0x7fec60156220 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec66600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec600733f0 con 0x7fec6006ecd0 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec57e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec600d0de0 0x7fec60159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec57e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec600d0de0 0x7fec60159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55392/0 (socket says 172.21.15.118:55392) 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.009+0000 7fec57e00640 1 -- 172.21.15.118:0/1780750647 learned_addr learned my addr 172.21.15.118:0/1780750647 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec5f400640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec6006ecd0 0x7fec60145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec5fe00640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec60156220 0x7fec601619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec57e00640 1 -- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec6006ecd0 msgr2=0x7fec60145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec57e00640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec6006ecd0 0x7fec60145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec57e00640 1 -- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec60156220 msgr2=0x7fec601619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec57e00640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec60156220 0x7fec601619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec57e00640 1 -- 172.21.15.118:0/1780750647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec60145bc0 con 0x7fec600d0de0 2024-09-21T06:14:10.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec5fe00640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec60156220 0x7fec601619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:10.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec57e00640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec600d0de0 0x7fec60159d10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fec48000c00 tx=0x7fec48033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:10.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.010+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48005c90 con 0x7fec600d0de0 2024-09-21T06:14:10.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.011+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec48031e50 con 0x7fec600d0de0 2024-09-21T06:14:10.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.011+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec480332f0 con 0x7fec600d0de0 2024-09-21T06:14:10.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.011+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6015a9d0 con 0x7fec600d0de0 2024-09-21T06:14:10.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.011+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec601f73d0 con 0x7fec600d0de0 2024-09-21T06:14:10.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.012+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6015a740 con 0x7fec600d0de0 2024-09-21T06:14:10.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.013+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec48033490 con 0x7fec600d0de0 2024-09-21T06:14:10.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.014+0000 7fec57400640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec3c078b90 0x7fec3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.014+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7fec480bbfa0 con 0x7fec600d0de0 2024-09-21T06:14:10.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.014+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7fec3c080830 con 0x7fec600d0de0 2024-09-21T06:14:10.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.014+0000 7fec5f400640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec3c078b90 0x7fec3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.015+0000 7fec5f400640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec3c078b90 0x7fec3c07b0a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec500095f0 tx=0x7fec50005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:10.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.018+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fec4803f030 con 0x7fec600d0de0 2024-09-21T06:14:10.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.203+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec60076790 con 0x7fec600d0de0 2024-09-21T06:14:10.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.204+0000 7fec57400640 1 -- 172.21.15.118:0/1780750647 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16936 (secure 0 0 0) 0x7fec60076790 con 0x7fec600d0de0 2024-09-21T06:14:10.207 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:10.207 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":151,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:13:30.387599+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:11:32.912143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T06:11:33.950347+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.21","mappings":[{"from":2,"to":0}]},{"pgid":"19.30","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:14:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec3c078b90 msgr2=0x7fec3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec3c078b90 0x7fec3c07b0a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec500095f0 tx=0x7fec50005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec600d0de0 msgr2=0x7fec60159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec600d0de0 0x7fec60159d10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fec48000c00 tx=0x7fec48033c20 comp rx=0 tx=0).stop 2024-09-21T06:14:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 shutdown_connections 2024-09-21T06:14:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec60156220 0x7fec601619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec600d0de0 0x7fec60159d10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fec3c078b90 0x7fec3c07b0a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.206+0000 7fec66600640 1 --2- 172.21.15.118:0/1780750647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec6006ecd0 0x7fec60145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.207+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 >> 172.21.15.118:0/1780750647 conn(0x7fec6006d110 msgr2=0x7fec60155510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:10.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.207+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 shutdown_connections 2024-09-21T06:14:10.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.207+0000 7fec66600640 1 -- 172.21.15.118:0/1780750647 wait complete. 2024-09-21T06:14:10.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:14:10.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.451+0000 7fd5ed400640 1 -- 172.21.15.118:0/1178283407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 msgr2=0x7fd5cc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.451+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1178283407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5cc004c10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0006f90 tx=0x7fd5cc005830 comp rx=0 tx=0).stop 2024-09-21T06:14:10.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.452+0000 7fd5ed400640 1 -- 172.21.15.118:0/1178283407 shutdown_connections 2024-09-21T06:14:10.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.452+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1178283407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5cc004c10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.452+0000 7fd5ed400640 1 -- 172.21.15.118:0/1178283407 >> 172.21.15.118:0/1178283407 conn(0x7fd5e80d4bc0 msgr2=0x7fd5e80d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:10.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.452+0000 7fd5ed400640 1 -- 172.21.15.118:0/1178283407 shutdown_connections 2024-09-21T06:14:10.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.452+0000 7fd5ed400640 1 -- 172.21.15.118:0/1178283407 wait complete. 2024-09-21T06:14:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.454+0000 7fd5ed400640 1 Processor -- start 2024-09-21T06:14:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.454+0000 7fd5ed400640 1 -- start start 2024-09-21T06:14:10.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5e81eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5ed400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e81eb500 0x7fd5e809e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5ed400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e81e3930 0x7fd5e81f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5ed400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80d0790 con 0x7fd5cc004800 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5ed400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80d0610 con 0x7fd5e81e3930 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5ed400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e80d0910 con 0x7fd5e81eb500 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5e81eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5e81eab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55408/0 (socket says 172.21.15.118:55408) 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 -- 172.21.15.118:0/1347956485 learned_addr learned my addr 172.21.15.118:0/1347956485 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5df400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e81eb500 0x7fd5e809e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5eca00640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e81e3930 0x7fd5e81f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 -- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e81eb500 msgr2=0x7fd5e809e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e81eb500 0x7fd5e809e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 -- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e81e3930 msgr2=0x7fd5e81f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e81e3930 0x7fd5e81f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.456+0000 7fd5e7e00640 1 -- 172.21.15.118:0/1347956485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e81eba10 con 0x7fd5cc004800 2024-09-21T06:14:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.457+0000 7fd5e7e00640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5e81eab10 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8011ab0 tx=0x7fd5d8011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:10.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.457+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d801e070 con 0x7fd5cc004800 2024-09-21T06:14:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.457+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5d800fcd0 con 0x7fd5cc004800 2024-09-21T06:14:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.457+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800fea0 con 0x7fd5cc004800 2024-09-21T06:14:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.457+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e81e8220 con 0x7fd5cc004800 2024-09-21T06:14:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.457+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e81e87e0 con 0x7fd5cc004800 2024-09-21T06:14:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.458+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e81e8040 con 0x7fd5cc004800 2024-09-21T06:14:10.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.459+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd5d8021070 con 0x7fd5cc004800 2024-09-21T06:14:10.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.460+0000 7fd5e4c00640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd5c4078b90 0x7fd5c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:10.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.461+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5767+0+0 (secure 0 0 0) 0x7fd5d809b5a0 con 0x7fd5cc004800 2024-09-21T06:14:10.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.461+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=152}) -- 0x7fd5c40807d0 con 0x7fd5cc004800 2024-09-21T06:14:10.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.461+0000 7fd5df400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd5c4078b90 0x7fd5c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:10.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.462+0000 7fd5df400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd5c4078b90 0x7fd5c407b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0033000 tx=0x7fd5d003b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:10.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.465+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd5e81e8040 con 0x7fd5cc004800 2024-09-21T06:14:10.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.689+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd5e80d19d0 con 0x7fd5cc004800 2024-09-21T06:14:10.692 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:14:10.690+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:14:10.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.692+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) ==== 161+0+0 (secure 0 0 0) 0x7fd5d8063340 con 0x7fd5cc004800 2024-09-21T06:14:10.694 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:14:10.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.692+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(152..152 src has 1..152) ==== 374+0+0 (secure 0 0 0) 0x7fd5d80d22b0 con 0x7fd5cc004800 2024-09-21T06:14:10.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.692+0000 7fd5e4c00640 1 -- 172.21.15.118:0/1347956485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=153}) -- 0x7fd5c4081210 con 0x7fd5cc004800 2024-09-21T06:14:10.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd5c4078b90 msgr2=0x7fd5c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd5c4078b90 0x7fd5c407b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0033000 tx=0x7fd5d003b040 comp rx=0 tx=0).stop 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 msgr2=0x7fd5e81eab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5e81eab10 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8011ab0 tx=0x7fd5d8011f70 comp rx=0 tx=0).stop 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 shutdown_connections 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5e81e3930 0x7fd5e81f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd5c4078b90 0x7fd5c407b0a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5e81eb500 0x7fd5e809e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 --2- 172.21.15.118:0/1347956485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5cc004800 0x7fd5e81eab10 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 >> 172.21.15.118:0/1347956485 conn(0x7fd5e80d4bc0 msgr2=0x7fd5e80b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 shutdown_connections 2024-09-21T06:14:10.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.695+0000 7fd5ed400640 1 -- 172.21.15.118:0/1347956485 wait complete. 2024-09-21T06:14:10.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:14:10.838 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:14:10.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 -- 172.21.15.118:0/4005558012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe8142e40 msgr2=0x7effe80d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 --2- 172.21.15.118:0/4005558012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe8142e40 0x7effe80d13c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7effe0005fd0 tx=0x7effe002a830 comp rx=0 tx=0).stop 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 -- 172.21.15.118:0/4005558012 shutdown_connections 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 --2- 172.21.15.118:0/4005558012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe8142e40 0x7effe80d13c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 --2- 172.21.15.118:0/4005558012 >> v2:172.21.15.149:3300/0 conn(0x7effe813fae0 0x7effe80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 -- 172.21.15.118:0/4005558012 >> 172.21.15.118:0/4005558012 conn(0x7effe806d110 msgr2=0x7effe806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 -- 172.21.15.118:0/4005558012 shutdown_connections 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.954+0000 7effee400640 1 -- 172.21.15.118:0/4005558012 wait complete. 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.956+0000 7effee400640 1 Processor -- start 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.956+0000 7effee400640 1 -- start start 2024-09-21T06:14:11.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effee400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe813fae0 0x7effe813a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effee400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe813fef0 0x7effe81408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effee400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe8142e40 0x7effe813aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effee400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effe80cfa40 con 0x7effe813fae0 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effee400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7effe80cf8c0 con 0x7effe8142e40 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effee400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7effe80cfbc0 con 0x7effe813fef0 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe813fae0 0x7effe813a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe813fae0 0x7effe813a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55428/0 (socket says 172.21.15.118:55428) 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 -- 172.21.15.118:0/3542665690 learned_addr learned my addr 172.21.15.118:0/3542665690 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7e00640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe8142e40 0x7effe813aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effdea00640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe813fef0 0x7effe81408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 -- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe813fef0 msgr2=0x7effe81408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe813fef0 0x7effe81408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 -- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe8142e40 msgr2=0x7effe813aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:11.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe8142e40 0x7effe813aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.958+0000 7effe7400640 1 -- 172.21.15.118:0/3542665690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe8072d70 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.959+0000 7effe7400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe813fae0 0x7effe813a290 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7effd800e9f0 tx=0x7effd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.959+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd800cd80 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.959+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effd8004020 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.959+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe8072fe0 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.959+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8004470 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.959+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe80735a0 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.960+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe80d0120 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.961+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effd80035f0 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.963+0000 7effdfe00640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc4078b90 0x7effc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.963+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5853+0+0 (secure 0 0 0) 0x7effd809b730 con 0x7effe813fae0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.963+0000 7effdea00640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc4078b90 0x7effc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:11.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.963+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=153}) -- 0x7effc40808e0 con 0x7effe813fae0 2024-09-21T06:14:11.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.964+0000 7effdea00640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc4078b90 0x7effc407b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7effd0001eb0 tx=0x7effd0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:11.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:10.968+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7effd8063ae0 con 0x7effe813fae0 2024-09-21T06:14:11.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.188+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7effe813a800 con 0x7effe813fae0 2024-09-21T06:14:11.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.762+0000 7effdfe00640 1 -- 172.21.15.118:0/3542665690 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) ==== 104+0+0 (secure 0 0 0) 0x7effd80633e0 con 0x7effe813fae0 2024-09-21T06:14:11.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc4078b90 msgr2=0x7effc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc4078b90 0x7effc407b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7effd0001eb0 tx=0x7effd0009040 comp rx=0 tx=0).stop 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe813fae0 msgr2=0x7effe813a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe813fae0 0x7effe813a290 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7effd800e9f0 tx=0x7effd800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 shutdown_connections 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effe8142e40 0x7effe813aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7effc4078b90 0x7effc407b0a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effe813fef0 0x7effe81408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 --2- 172.21.15.118:0/3542665690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe813fae0 0x7effe813a290 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 >> 172.21.15.118:0/3542665690 conn(0x7effe806d110 msgr2=0x7effe815fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 shutdown_connections 2024-09-21T06:14:11.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:11.765+0000 7effee400640 1 -- 172.21.15.118:0/3542665690 wait complete. 2024-09-21T06:14:11.797 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:14:12.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 -- 172.21.15.118:0/2774672359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec0b3e00 msgr2=0x7f5dec0b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:12.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 --2- 172.21.15.118:0/2774672359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec0b3e00 0x7f5dec0b4210 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5de4005fd0 tx=0x7f5de402aa90 comp rx=0 tx=0).stop 2024-09-21T06:14:12.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 -- 172.21.15.118:0/2774672359 shutdown_connections 2024-09-21T06:14:12.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 --2- 172.21.15.118:0/2774672359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec0b3e00 0x7f5dec0b4210 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 --2- 172.21.15.118:0/2774672359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dec0701f0 0x7f5dec0ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 -- 172.21.15.118:0/2774672359 >> 172.21.15.118:0/2774672359 conn(0x7f5dec06cf30 msgr2=0x7f5dec06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:12.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 -- 172.21.15.118:0/2774672359 shutdown_connections 2024-09-21T06:14:12.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.023+0000 7f5df0a00640 1 -- 172.21.15.118:0/2774672359 wait complete. 2024-09-21T06:14:12.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.025+0000 7f5df0a00640 1 Processor -- start 2024-09-21T06:14:12.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.025+0000 7f5df0a00640 1 -- start start 2024-09-21T06:14:12.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5df0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dec0701f0 0x7f5dec142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:12.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5df0a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dec0b3e00 0x7f5dec1f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:12.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5df0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec160a50 0x7f5dec1f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:12.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5df0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0cf020 con 0x7f5dec160a50 2024-09-21T06:14:12.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5df0a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0ceea0 con 0x7f5dec0b3e00 2024-09-21T06:14:12.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5df0a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec0cf1a0 con 0x7f5dec0701f0 2024-09-21T06:14:12.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec160a50 0x7f5dec1f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:12.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec160a50 0x7f5dec1f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55440/0 (socket says 172.21.15.118:55440) 2024-09-21T06:14:12.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 -- 172.21.15.118:0/3213042183 learned_addr learned my addr 172.21.15.118:0/3213042183 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:12.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5de9e00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dec0701f0 0x7f5dec142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:12.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5de1400640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dec0b3e00 0x7f5dec1f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 -- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dec0701f0 msgr2=0x7f5dec142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dec0701f0 0x7f5dec142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 -- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dec0b3e00 msgr2=0x7f5dec1f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dec0b3e00 0x7f5dec1f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.027+0000 7f5dea800640 1 -- 172.21.15.118:0/3213042183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec1fa410 con 0x7f5dec160a50 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.028+0000 7f5de9e00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dec0701f0 0x7f5dec142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.028+0000 7f5dea800640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec160a50 0x7f5dec1f9850 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.028+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4044070 con 0x7f5dec160a50 2024-09-21T06:14:12.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.028+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5de4004040 con 0x7f5dec160a50 2024-09-21T06:14:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.028+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec1fa6f0 con 0x7f5dec160a50 2024-09-21T06:14:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.028+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4004430 con 0x7f5dec160a50 2024-09-21T06:14:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.028+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec1f6650 con 0x7f5dec160a50 2024-09-21T06:14:12.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.029+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec0cff30 con 0x7f5dec160a50 2024-09-21T06:14:12.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.031+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5de4047070 con 0x7f5dec160a50 2024-09-21T06:14:12.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.031+0000 7f5de2a00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:12.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.032+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5853+0+0 (secure 0 0 0) 0x7f5de40bbc70 con 0x7f5dec160a50 2024-09-21T06:14:12.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.032+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=153}) -- 0x7f5dc80808d0 con 0x7f5dec160a50 2024-09-21T06:14:12.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.032+0000 7f5de9e00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:12.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.033+0000 7f5de9e00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5dc8078b90 0x7f5dc807b0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009b80 tx=0x7f5ddc005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:12.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.036+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5dec0cff30 con 0x7f5dec160a50 2024-09-21T06:14:12.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.223+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5dec0cf6f0 con 0x7f5dec160a50 2024-09-21T06:14:12.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.777+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v153) ==== 181+0+0 (secure 0 0 0) 0x7f5de4032030 con 0x7f5dec160a50 2024-09-21T06:14:12.779 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:14:12.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.777+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(153..153 src has 1..153) ==== 296+0+0 (secure 0 0 0) 0x7f5de40ba180 con 0x7f5dec160a50 2024-09-21T06:14:12.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.777+0000 7f5de2a00640 1 -- 172.21.15.118:0/3213042183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=154}) -- 0x7f5dc807ed00 con 0x7f5dec160a50 2024-09-21T06:14:12.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.783+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5dc8078b90 msgr2=0x7f5dc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:12.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.783+0000 7f5df0a00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5dc8078b90 0x7f5dc807b0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009b80 tx=0x7f5ddc005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:12.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec160a50 msgr2=0x7f5dec1f9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:12.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec160a50 0x7f5dec1f9850 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de4003ce0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 shutdown_connections 2024-09-21T06:14:12.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dec160a50 0x7f5dec1f9850 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dec0b3e00 0x7f5dec1f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 --2- 172.21.15.118:0/3213042183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5dec0701f0 0x7f5dec142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:12.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 >> 172.21.15.118:0/3213042183 conn(0x7f5dec06cf30 msgr2=0x7f5dec06d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:12.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.784+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 shutdown_connections 2024-09-21T06:14:12.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:12.785+0000 7f5df0a00640 1 -- 172.21.15.118:0/3213042183 wait complete. 2024-09-21T06:14:12.814 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:14:13.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.038+0000 7f7e7d200640 1 -- 172.21.15.118:0/3364608273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 msgr2=0x7f7e5c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:13.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.038+0000 7f7e7d200640 1 --2- 172.21.15.118:0/3364608273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 0x7f7e5c005190 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7e7815afc0 tx=0x7f7e5c005830 comp rx=0 tx=0).stop 2024-09-21T06:14:13.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.038+0000 7f7e76800640 1 -- 172.21.15.118:0/3364608273 reap_dead start 2024-09-21T06:14:13.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.038+0000 7f7e7d200640 1 -- 172.21.15.118:0/3364608273 shutdown_connections 2024-09-21T06:14:13.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.038+0000 7f7e7d200640 1 -- 172.21.15.118:0/3364608273 >> 172.21.15.118:0/3364608273 conn(0x7f7e7806cf30 msgr2=0x7f7e7806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:13.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.038+0000 7f7e7d200640 1 -- 172.21.15.118:0/3364608273 shutdown_connections 2024-09-21T06:14:13.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.038+0000 7f7e7d200640 1 -- 172.21.15.118:0/3364608273 wait complete. 2024-09-21T06:14:13.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.040+0000 7f7e7d200640 1 Processor -- start 2024-09-21T06:14:13.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.040+0000 7f7e7d200640 1 -- start start 2024-09-21T06:14:13.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e7d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 0x7f7e781ea920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:13.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e7d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e781f6250 0x7f7e780b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e7d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e781f6660 0x7f7e780b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e7d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7e780cec90 con 0x7f7e5c004d40 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e7d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e780b4580 con 0x7f7e781f6250 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e7d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e780cee10 con 0x7f7e781f6660 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 0x7f7e781ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 0x7f7e781ea920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55454/0 (socket says 172.21.15.118:55454) 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 -- 172.21.15.118:0/3584211785 learned_addr learned my addr 172.21.15.118:0/3584211785 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e6fe00640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e781f6250 0x7f7e780b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e76800640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e781f6660 0x7f7e780b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 -- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e781f6660 msgr2=0x7f7e780b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e781f6660 0x7f7e780b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 -- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e781f6250 msgr2=0x7f7e780b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:13.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e781f6250 0x7f7e780b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:13.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.042+0000 7f7e75e00640 1 -- 172.21.15.118:0/3584211785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e781f6dc0 con 0x7f7e5c004d40 2024-09-21T06:14:13.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.043+0000 7f7e75e00640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 0x7f7e781ea920 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7e68003e00 tx=0x7f7e68001880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:13.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.043+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68015070 con 0x7f7e5c004d40 2024-09-21T06:14:13.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.043+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e68011900 con 0x7f7e5c004d40 2024-09-21T06:14:13.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.043+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011d50 con 0x7f7e5c004d40 2024-09-21T06:14:13.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.043+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e781f70a0 con 0x7f7e5c004d40 2024-09-21T06:14:13.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.043+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e781f7940 con 0x7f7e5c004d40 2024-09-21T06:14:13.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.044+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e78076b70 con 0x7f7e5c004d40 2024-09-21T06:14:13.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.045+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e68018070 con 0x7f7e5c004d40 2024-09-21T06:14:13.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.046+0000 7f7e6e000640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e54078b90 0x7f7e5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:13.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.046+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5415+0+0 (secure 0 0 0) 0x7f7e6809b5c0 con 0x7f7e5c004d40 2024-09-21T06:14:13.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.047+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=154}) -- 0x7f7e5407fad0 con 0x7f7e5c004d40 2024-09-21T06:14:13.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.047+0000 7f7e6fe00640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e54078b90 0x7f7e5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:13.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.048+0000 7f7e6fe00640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e54078b90 0x7f7e5407b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7e781f0900 tx=0x7f7e60001610 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:13.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.051+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7e78076b70 con 0x7f7e5c004d40 2024-09-21T06:14:13.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.236+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7e781f7450 con 0x7f7e5c004d40 2024-09-21T06:14:13.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.783+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v154) ==== 169+0+0 (secure 0 0 0) 0x7f7e780b4750 con 0x7f7e5c004d40 2024-09-21T06:14:13.786 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:14:13.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.784+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(154..154 src has 1..154) ==== 330+0+0 (secure 0 0 0) 0x7f7e680d22b0 con 0x7f7e5c004d40 2024-09-21T06:14:13.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.784+0000 7f7e6e000640 1 -- 172.21.15.118:0/3584211785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=155}) -- 0x7f7e5407e860 con 0x7f7e5c004d40 2024-09-21T06:14:13.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.787+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e54078b90 msgr2=0x7f7e5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:13.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.787+0000 7f7e7d200640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e54078b90 0x7f7e5407b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7e781f0900 tx=0x7f7e60001610 comp rx=0 tx=0).stop 2024-09-21T06:14:13.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.788+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 msgr2=0x7f7e781ea920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:13.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.788+0000 7f7e7d200640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 0x7f7e781ea920 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7e68003e00 tx=0x7f7e68001880 comp rx=0 tx=0).stop 2024-09-21T06:14:13.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.789+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 shutdown_connections 2024-09-21T06:14:13.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.789+0000 7f7e7d200640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7e54078b90 0x7f7e5407b0a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:13.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.789+0000 7f7e7d200640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e781f6660 0x7f7e780b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:13.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.789+0000 7f7e7d200640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e781f6250 0x7f7e780b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:13.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.789+0000 7f7e7d200640 1 --2- 172.21.15.118:0/3584211785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5c004d40 0x7f7e781ea920 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:13.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.789+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 >> 172.21.15.118:0/3584211785 conn(0x7f7e7806cf30 msgr2=0x7f7e7815fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:13.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.791+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 shutdown_connections 2024-09-21T06:14:13.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:13.791+0000 7f7e7d200640 1 -- 172.21.15.118:0/3584211785 wait complete. 2024-09-21T06:14:13.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:14:14.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 -- 172.21.15.118:0/3747160741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 msgr2=0x7f856c0b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 --2- 172.21.15.118:0/3747160741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 0x7f856c0b5fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8564005fd0 tx=0x7f856402a540 comp rx=0 tx=0).stop 2024-09-21T06:14:14.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 -- 172.21.15.118:0/3747160741 shutdown_connections 2024-09-21T06:14:14.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 --2- 172.21.15.118:0/3747160741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 0x7f856c0b5fc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 --2- 172.21.15.118:0/3747160741 >> v2:172.21.15.149:3300/0 conn(0x7f856c0cfe30 0x7f856c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 -- 172.21.15.118:0/3747160741 >> 172.21.15.118:0/3747160741 conn(0x7f856c06d6e0 msgr2=0x7f856c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:14.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 -- 172.21.15.118:0/3747160741 shutdown_connections 2024-09-21T06:14:14.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.039+0000 7f8570c00640 1 -- 172.21.15.118:0/3747160741 wait complete. 2024-09-21T06:14:14.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.041+0000 7f8570c00640 1 Processor -- start 2024-09-21T06:14:14.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.041+0000 7f8570c00640 1 -- start start 2024-09-21T06:14:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f8570c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f856c073fa0 0x7f856c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f8570c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 0x7f856c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f8570c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c0cfe30 0x7f856c1f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f8570c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f856c15d9c0 con 0x7f856c0cfe30 2024-09-21T06:14:14.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f8570c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f856c15d840 con 0x7f856c073fa0 2024-09-21T06:14:14.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f8570c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f856c15db40 con 0x7f856c0b5bb0 2024-09-21T06:14:14.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f856be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c0cfe30 0x7f856c1f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f856be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c0cfe30 0x7f856c1f9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55464/0 (socket says 172.21.15.118:55464) 2024-09-21T06:14:14.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f856be00640 1 -- 172.21.15.118:0/4193220784 learned_addr learned my addr 172.21.15.118:0/4193220784 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:14.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f856b400640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f856c073fa0 0x7f856c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.043+0000 7f8562a00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 0x7f856c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f856be00640 1 -- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 msgr2=0x7f856c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f856be00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 0x7f856c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f856be00640 1 -- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f856c073fa0 msgr2=0x7f856c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f856be00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f856c073fa0 0x7f856c0ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f856be00640 1 -- 172.21.15.118:0/4193220784 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c0cbfd0 con 0x7f856c0cfe30 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f8562a00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 0x7f856c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f856be00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c0cfe30 0x7f856c1f9310 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f8564006010 tx=0x7f8564003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f8563e00640 1 -- 172.21.15.118:0/4193220784 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856403e030 con 0x7f856c0cfe30 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f8563e00640 1 -- 172.21.15.118:0/4193220784 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8564003d10 con 0x7f856c0cfe30 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f8563e00640 1 -- 172.21.15.118:0/4193220784 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564035040 con 0x7f856c0cfe30 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c0cc2b0 con 0x7f856c0cfe30 2024-09-21T06:14:14.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.044+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c0cc870 con 0x7f856c0cfe30 2024-09-21T06:14:14.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.046+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856c15e060 con 0x7f856c0cfe30 2024-09-21T06:14:14.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.047+0000 7f8563e00640 1 -- 172.21.15.118:0/4193220784 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8564041030 con 0x7f856c0cfe30 2024-09-21T06:14:14.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.048+0000 7f8563e00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8548078b90 0x7f854807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.048+0000 7f8563e00640 1 -- 172.21.15.118:0/4193220784 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f85640bb0b0 con 0x7f856c0cfe30 2024-09-21T06:14:14.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.048+0000 7f856b400640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8548078b90 0x7f854807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.049+0000 7f856b400640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8548078b90 0x7f854807b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f855c001ce0 tx=0x7f855c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:14.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.052+0000 7f8563e00640 1 -- 172.21.15.118:0/4193220784 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8564083870 con 0x7f856c0cfe30 2024-09-21T06:14:14.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.237+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f856c0767a0 con 0x7f856c0cfe30 2024-09-21T06:14:14.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.242+0000 7f8563e00640 1 -- 172.21.15.118:0/4193220784 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f8564083170 con 0x7f856c0cfe30 2024-09-21T06:14:14.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8548078b90 msgr2=0x7f854807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8548078b90 0x7f854807b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f855c001ce0 tx=0x7f855c009040 comp rx=0 tx=0).stop 2024-09-21T06:14:14.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c0cfe30 msgr2=0x7f856c1f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c0cfe30 0x7f856c1f9310 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f8564006010 tx=0x7f8564003820 comp rx=0 tx=0).stop 2024-09-21T06:14:14.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 shutdown_connections 2024-09-21T06:14:14.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856c0cfe30 0x7f856c1f9310 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8548078b90 0x7f854807b0a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f856c0b5bb0 0x7f856c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 --2- 172.21.15.118:0/4193220784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f856c073fa0 0x7f856c0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.244+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 >> 172.21.15.118:0/4193220784 conn(0x7f856c06d6e0 msgr2=0x7f856c0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:14.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.245+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 shutdown_connections 2024-09-21T06:14:14.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.245+0000 7f8570c00640 1 -- 172.21.15.118:0/4193220784 wait complete. 2024-09-21T06:14:14.271 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-21T06:14:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 -- 172.21.15.118:0/3603869147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fae0 msgr2=0x7f5b1c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 --2- 172.21.15.118:0/3603869147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fae0 0x7f5b1c0d0e80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c005fd0 tx=0x7f5b0c02a540 comp rx=0 tx=0).stop 2024-09-21T06:14:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 -- 172.21.15.118:0/3603869147 shutdown_connections 2024-09-21T06:14:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 --2- 172.21.15.118:0/3603869147 >> v2:172.21.15.149:3300/0 conn(0x7f5b1c13fef0 0x7f5b1c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 --2- 172.21.15.118:0/3603869147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fae0 0x7f5b1c0d0e80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 -- 172.21.15.118:0/3603869147 >> 172.21.15.118:0/3603869147 conn(0x7f5b1c06d110 msgr2=0x7f5b1c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 -- 172.21.15.118:0/3603869147 shutdown_connections 2024-09-21T06:14:14.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.491+0000 7f5b23200640 1 -- 172.21.15.118:0/3603869147 wait complete. 2024-09-21T06:14:14.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.494+0000 7f5b23200640 1 Processor -- start 2024-09-21T06:14:14.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.494+0000 7f5b23200640 1 -- start start 2024-09-21T06:14:14.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b23200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1c13fae0 0x7f5b1c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b23200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fef0 0x7f5b1c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b23200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b1c142730 0x7f5b1c13dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b23200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c0cfac0 con 0x7f5b1c142730 2024-09-21T06:14:14.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b23200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c0cf940 con 0x7f5b1c13fae0 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b23200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c0cfc40 con 0x7f5b1c13fef0 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b21200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b1c142730 0x7f5b1c13dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b21200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b1c142730 0x7f5b1c13dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55474/0 (socket says 172.21.15.118:55474) 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.495+0000 7f5b21200640 1 -- 172.21.15.118:0/2983284413 learned_addr learned my addr 172.21.15.118:0/2983284413 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b1be00640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1c13fae0 0x7f5b1c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b1b400640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fef0 0x7f5b1c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b21200640 1 -- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fef0 msgr2=0x7f5b1c0b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b21200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fef0 0x7f5b1c0b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b21200640 1 -- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1c13fae0 msgr2=0x7f5b1c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b21200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1c13fae0 0x7f5b1c0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b21200640 1 -- 172.21.15.118:0/2983284413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c1f9750 con 0x7f5b1c142730 2024-09-21T06:14:14.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b21200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b1c142730 0x7f5b1c13dd30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c760 tx=0x7f5b1400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:14.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.496+0000 7f5b13e00640 1 -- 172.21.15.118:0/2983284413 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14003b70 con 0x7f5b1c142730 2024-09-21T06:14:14.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.497+0000 7f5b13e00640 1 -- 172.21.15.118:0/2983284413 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b14003d10 con 0x7f5b1c142730 2024-09-21T06:14:14.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.497+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c1f9a30 con 0x7f5b1c142730 2024-09-21T06:14:14.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.497+0000 7f5b13e00640 1 -- 172.21.15.118:0/2983284413 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14005330 con 0x7f5b1c142730 2024-09-21T06:14:14.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.497+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c1f9ff0 con 0x7f5b1c142730 2024-09-21T06:14:14.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.498+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1c0d00f0 con 0x7f5b1c142730 2024-09-21T06:14:14.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.499+0000 7f5b13e00640 1 -- 172.21.15.118:0/2983284413 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b140054d0 con 0x7f5b1c142730 2024-09-21T06:14:14.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.500+0000 7f5b13e00640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5afc078bc0 0x7f5afc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:14.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.500+0000 7f5b13e00640 1 -- 172.21.15.118:0/2983284413 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f5b1409a7c0 con 0x7f5b1c142730 2024-09-21T06:14:14.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.501+0000 7f5b1be00640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5afc078bc0 0x7f5afc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:14.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.501+0000 7f5b1be00640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5afc078bc0 0x7f5afc07b0d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c033000 tx=0x7f5b0c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:14.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.504+0000 7f5b13e00640 1 -- 172.21.15.118:0/2983284413 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5b14062e70 con 0x7f5b1c142730 2024-09-21T06:14:14.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.759+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7f5b1c15e960 con 0x7f5b1c142730 2024-09-21T06:14:14.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.780+0000 7f5b13e00640 1 -- 172.21.15.118:0/2983284413 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v493) ==== 132+0+0 (secure 0 0 0) 0x7f5b14062770 con 0x7f5b1c142730 2024-09-21T06:14:14.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5afc078bc0 msgr2=0x7f5afc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5afc078bc0 0x7f5afc07b0d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c033000 tx=0x7f5b0c004730 comp rx=0 tx=0).stop 2024-09-21T06:14:14.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b1c142730 msgr2=0x7f5b1c13dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:14.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b1c142730 0x7f5b1c13dd30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c760 tx=0x7f5b1400cb60 comp rx=0 tx=0).stop 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 shutdown_connections 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b1c142730 0x7f5b1c13dd30 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5afc078bc0 0x7f5afc07b0d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b1c13fef0 0x7f5b1c0b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 --2- 172.21.15.118:0/2983284413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b1c13fae0 0x7f5b1c0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 >> 172.21.15.118:0/2983284413 conn(0x7f5b1c06d110 msgr2=0x7f5b1c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 shutdown_connections 2024-09-21T06:14:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:14.783+0000 7f5b23200640 1 -- 172.21.15.118:0/2983284413 wait complete. 2024-09-21T06:14:14.807 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-21T06:14:14.807 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2024-09-21T06:14:14.807 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2024-09-21T06:14:14.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:14:15.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 -- 172.21.15.118:0/73512838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a50146230 msgr2=0x7f6a500b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 --2- 172.21.15.118:0/73512838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a50146230 0x7f6a500b5bb0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6a50071cd0 tx=0x7f6a4002aac0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 -- 172.21.15.118:0/73512838 shutdown_connections 2024-09-21T06:14:15.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 --2- 172.21.15.118:0/73512838 >> v2:172.21.15.149:3300/0 conn(0x7f6a500b60f0 0x7f6a5015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 --2- 172.21.15.118:0/73512838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a50146230 0x7f6a500b5bb0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 -- 172.21.15.118:0/73512838 >> 172.21.15.118:0/73512838 conn(0x7f6a5006d6e0 msgr2=0x7f6a500b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:15.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 -- 172.21.15.118:0/73512838 shutdown_connections 2024-09-21T06:14:15.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.028+0000 7f6a55800640 1 -- 172.21.15.118:0/73512838 wait complete. 2024-09-21T06:14:15.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.030+0000 7f6a55800640 1 Processor -- start 2024-09-21T06:14:15.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.030+0000 7f6a55800640 1 -- start start 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a55800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a500b60f0 0x7f6a50141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a55800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a50146230 0x7f6a501f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a55800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a5015d770 0x7f6a50155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a55800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50160e50 con 0x7f6a500b60f0 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a55800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50160260 con 0x7f6a50146230 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a55800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a50160fd0 con 0x7f6a5015d770 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a500b60f0 0x7f6a50141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a500b60f0 0x7f6a50141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55496/0 (socket says 172.21.15.118:55496) 2024-09-21T06:14:15.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 -- 172.21.15.118:0/1904508682 learned_addr learned my addr 172.21.15.118:0/1904508682 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a47400640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a50146230 0x7f6a501f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a54e00640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a5015d770 0x7f6a50155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 -- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a5015d770 msgr2=0x7f6a50155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a5015d770 0x7f6a50155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 -- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a50146230 msgr2=0x7f6a501f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a50146230 0x7f6a501f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.032+0000 7f6a4fe00640 1 -- 172.21.15.118:0/1904508682 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a501f65f0 con 0x7f6a500b60f0 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.033+0000 7f6a54e00640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a5015d770 0x7f6a50155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:15.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.033+0000 7f6a4fe00640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a500b60f0 0x7f6a50141c10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009d60 tx=0x7f6a40003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:15.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.033+0000 7f6a4cc00640 1 -- 172.21.15.118:0/1904508682 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40004250 con 0x7f6a500b60f0 2024-09-21T06:14:15.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.033+0000 7f6a4cc00640 1 -- 172.21.15.118:0/1904508682 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a400043f0 con 0x7f6a500b60f0 2024-09-21T06:14:15.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.033+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a501f6a70 con 0x7f6a500b60f0 2024-09-21T06:14:15.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.033+0000 7f6a4cc00640 1 -- 172.21.15.118:0/1904508682 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40004820 con 0x7f6a500b60f0 2024-09-21T06:14:15.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.033+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501e88d0 con 0x7f6a500b60f0 2024-09-21T06:14:15.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.034+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a501614f0 con 0x7f6a500b60f0 2024-09-21T06:14:15.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.036+0000 7f6a4cc00640 1 -- 172.21.15.118:0/1904508682 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a40036400 con 0x7f6a500b60f0 2024-09-21T06:14:15.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.037+0000 7f6a4cc00640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a2c078b90 0x7f6a2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.037+0000 7f6a4cc00640 1 -- 172.21.15.118:0/1904508682 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f6a400bb8d0 con 0x7f6a500b60f0 2024-09-21T06:14:15.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.037+0000 7f6a47400640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a2c078b90 0x7f6a2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.038+0000 7f6a47400640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a2c078b90 0x7f6a2c07b0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6a50143860 tx=0x7f6a3800b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:15.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.041+0000 7f6a4cc00640 1 -- 172.21.15.118:0/1904508682 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6a40032030 con 0x7f6a500b60f0 2024-09-21T06:14:15.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.226+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a500b33c0 con 0x7f6a500b60f0 2024-09-21T06:14:15.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.227+0000 7f6a4cc00640 1 -- 172.21.15.118:0/1904508682 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+13117 (secure 0 0 0) 0x7f6a40084010 con 0x7f6a500b60f0 2024-09-21T06:14:15.229 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:15.230 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":154,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:14:13.778935+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6835/1596006114":"2024-09-22T06:14:10.691692+0000","172.21.15.118:6833/1596006114":"2024-09-22T06:14:10.691692+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:14:15.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a2c078b90 msgr2=0x7f6a2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a2c078b90 0x7f6a2c07b0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6a50143860 tx=0x7f6a3800b2e0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a500b60f0 msgr2=0x7f6a50141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a500b60f0 0x7f6a50141c10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009d60 tx=0x7f6a40003f10 comp rx=0 tx=0).stop 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 shutdown_connections 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6a2c078b90 0x7f6a2c07b0a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a5015d770 0x7f6a50155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a50146230 0x7f6a501f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 --2- 172.21.15.118:0/1904508682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a500b60f0 0x7f6a50141c10 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 >> 172.21.15.118:0/1904508682 conn(0x7f6a5006d6e0 msgr2=0x7f6a5015efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 shutdown_connections 2024-09-21T06:14:15.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.230+0000 7f6a55800640 1 -- 172.21.15.118:0/1904508682 wait complete. 2024-09-21T06:14:15.259 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:14:15.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:14:15.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.481+0000 7fcc78800640 1 -- 172.21.15.118:0/3054128106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701465f0 msgr2=0x7fcc700b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.481+0000 7fcc78800640 1 --2- 172.21.15.118:0/3054128106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701465f0 0x7fcc700b5d90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fcc64005fd0 tx=0x7fcc6402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.481+0000 7fcc78800640 1 -- 172.21.15.118:0/3054128106 shutdown_connections 2024-09-21T06:14:15.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.481+0000 7fcc78800640 1 --2- 172.21.15.118:0/3054128106 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc7006d400 0x7fcc700d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.481+0000 7fcc78800640 1 --2- 172.21.15.118:0/3054128106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701465f0 0x7fcc700b5d90 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.481+0000 7fcc78800640 1 -- 172.21.15.118:0/3054128106 >> 172.21.15.118:0/3054128106 conn(0x7fcc700b3770 msgr2=0x7fcc700b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:15.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.482+0000 7fcc78800640 1 -- 172.21.15.118:0/3054128106 shutdown_connections 2024-09-21T06:14:15.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.482+0000 7fcc78800640 1 -- 172.21.15.118:0/3054128106 wait complete. 2024-09-21T06:14:15.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.484+0000 7fcc78800640 1 Processor -- start 2024-09-21T06:14:15.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.484+0000 7fcc78800640 1 -- start start 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.485+0000 7fcc78800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc701465f0 0x7fcc70152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.485+0000 7fcc78800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc7015d3b0 0x7fcc70152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.485+0000 7fcc78800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701f6660 0x7fcc70152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.485+0000 7fcc78800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcc700d1010 con 0x7fcc701f6660 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.485+0000 7fcc78800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7015dae0 con 0x7fcc701465f0 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.485+0000 7fcc78800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcc700d1190 con 0x7fcc7015d3b0 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701f6660 0x7fcc70152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701f6660 0x7fcc70152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55526/0 (socket says 172.21.15.118:55526) 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 -- 172.21.15.118:0/1122180830 learned_addr learned my addr 172.21.15.118:0/1122180830 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc75400640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc7015d3b0 0x7fcc70152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc75e00640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc701465f0 0x7fcc70152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 -- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc7015d3b0 msgr2=0x7fcc70152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc7015d3b0 0x7fcc70152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 -- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc701465f0 msgr2=0x7fcc70152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc701465f0 0x7fcc70152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 -- 172.21.15.118:0/1122180830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc701e8b50 con 0x7fcc701f6660 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.486+0000 7fcc76800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701f6660 0x7fcc70152ec0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00e990 tx=0x7fcc6c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.487+0000 7fcc6a000640 1 -- 172.21.15.118:0/1122180830 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c004d20 con 0x7fcc701f6660 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.487+0000 7fcc6a000640 1 -- 172.21.15.118:0/1122180830 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc6c00caa0 con 0x7fcc701f6660 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.487+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc701f6d40 con 0x7fcc701f6660 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.487+0000 7fcc6a000640 1 -- 172.21.15.118:0/1122180830 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c005020 con 0x7fcc701f6660 2024-09-21T06:14:15.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.487+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7015e9d0 con 0x7fcc701f6660 2024-09-21T06:14:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.488+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc700d1640 con 0x7fcc701f6660 2024-09-21T06:14:15.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.489+0000 7fcc6a000640 1 -- 172.21.15.118:0/1122180830 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc6c0051c0 con 0x7fcc701f6660 2024-09-21T06:14:15.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.490+0000 7fcc6a000640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.491+0000 7fcc6a000640 1 -- 172.21.15.118:0/1122180830 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7fcc6c09b2c0 con 0x7fcc701f6660 2024-09-21T06:14:15.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.491+0000 7fcc75e00640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.492+0000 7fcc75e00640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcc54078b90 0x7fcc5407b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcc64033000 tx=0x7fcc64004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:15.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.495+0000 7fcc6a000640 1 -- 172.21.15.118:0/1122180830 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc6c016030 con 0x7fcc701f6660 2024-09-21T06:14:15.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.680+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcc701f6a70 con 0x7fcc701f6660 2024-09-21T06:14:15.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.681+0000 7fcc6a000640 1 -- 172.21.15.118:0/1122180830 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) ==== 93+0+10 (secure 0 0 0) 0x7fcc6c0633a0 con 0x7fcc701f6660 2024-09-21T06:14:15.683 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:14:15.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.683+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcc54078b90 msgr2=0x7fcc5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.683+0000 7fcc78800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcc54078b90 0x7fcc5407b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcc64033000 tx=0x7fcc64004730 comp rx=0 tx=0).stop 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.683+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701f6660 msgr2=0x7fcc70152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.683+0000 7fcc78800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701f6660 0x7fcc70152ec0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00e990 tx=0x7fcc6c00ee50 comp rx=0 tx=0).stop 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 shutdown_connections 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc701f6660 0x7fcc70152ec0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc7015d3b0 0x7fcc70152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 --2- 172.21.15.118:0/1122180830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc701465f0 0x7fcc70152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 >> 172.21.15.118:0/1122180830 conn(0x7fcc700b3770 msgr2=0x7fcc700b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 shutdown_connections 2024-09-21T06:14:15.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.684+0000 7fcc78800640 1 -- 172.21.15.118:0/1122180830 wait complete. 2024-09-21T06:14:15.713 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-21T06:14:15.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 -- 172.21.15.118:0/2680813326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb013fd80 msgr2=0x7f9eb015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 --2- 172.21.15.118:0/2680813326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb013fd80 0x7f9eb015dc40 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f9eb015d530 tx=0x7f9ea402a560 comp rx=0 tx=0).stop 2024-09-21T06:14:15.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 -- 172.21.15.118:0/2680813326 shutdown_connections 2024-09-21T06:14:15.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 --2- 172.21.15.118:0/2680813326 >> v2:172.21.15.149:3300/0 conn(0x7f9eb00cf170 0x7f9eb00cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 --2- 172.21.15.118:0/2680813326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb013fd80 0x7f9eb015dc40 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 -- 172.21.15.118:0/2680813326 >> 172.21.15.118:0/2680813326 conn(0x7f9eb006d110 msgr2=0x7f9eb006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:15.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 -- 172.21.15.118:0/2680813326 shutdown_connections 2024-09-21T06:14:15.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.931+0000 7f9eb8600640 1 -- 172.21.15.118:0/2680813326 wait complete. 2024-09-21T06:14:15.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.933+0000 7f9eb8600640 1 Processor -- start 2024-09-21T06:14:15.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.933+0000 7f9eb8600640 1 -- start start 2024-09-21T06:14:15.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb8600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb00cf170 0x7f9eb01f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb8600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb00d0ea0 0x7f9eb0155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb8600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9eb013fd80 0x7f9eb01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb8600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb015d890 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb8600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb00cfac0 con 0x7f9eb00cf170 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb8600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb01f8500 con 0x7f9eb013fd80 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb00d0ea0 0x7f9eb0155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb00d0ea0 0x7f9eb0155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53538/0 (socket says 172.21.15.118:53538) 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 -- 172.21.15.118:0/914308361 learned_addr learned my addr 172.21.15.118:0/914308361 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5c00640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb00cf170 0x7f9eb01f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb6600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9eb013fd80 0x7f9eb01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 -- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9eb013fd80 msgr2=0x7f9eb01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9eb013fd80 0x7f9eb01564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 -- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb00cf170 msgr2=0x7f9eb01f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb00cf170 0x7f9eb01f99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb5200640 1 -- 172.21.15.118:0/914308361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb01f60b0 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.935+0000 7f9eb6600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9eb013fd80 0x7f9eb01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.936+0000 7f9eb5200640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb00d0ea0 0x7f9eb0155fa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c3a0 tx=0x7f9e9c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.936+0000 7f9ead600640 1 -- 172.21.15.118:0/914308361 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c017070 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.936+0000 7f9ead600640 1 -- 172.21.15.118:0/914308361 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e9c0035f0 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.936+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb01f6390 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.936+0000 7f9ead600640 1 -- 172.21.15.118:0/914308361 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c003a40 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.936+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb01f8240 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.937+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb01f68b0 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.938+0000 7f9ead600640 1 -- 172.21.15.118:0/914308361 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e9c01a070 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.939+0000 7f9ead600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e90078bc0 0x7f9e9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.939+0000 7f9ead600640 1 -- 172.21.15.118:0/914308361 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f9e9c099c50 con 0x7f9eb00d0ea0 2024-09-21T06:14:15.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.940+0000 7f9eb5c00640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e90078bc0 0x7f9e9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:15.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.941+0000 7f9eb5c00640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e90078bc0 0x7f9e9007b0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4033000 tx=0x7f9ea4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:15.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:15.944+0000 7f9ead600640 1 -- 172.21.15.118:0/914308361 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9eb01f68b0 con 0x7f9eb00d0ea0 2024-09-21T06:14:16.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.196+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7f9eb00cf580 con 0x7f9eb00d0ea0 2024-09-21T06:14:16.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.788+0000 7f9ead600640 1 -- 172.21.15.118:0/914308361 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v495) ==== 134+0+0 (secure 0 0 0) 0x7f9e9c061d30 con 0x7f9eb00d0ea0 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e90078bc0 msgr2=0x7f9e9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e90078bc0 0x7f9e9007b0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4033000 tx=0x7f9ea4004730 comp rx=0 tx=0).stop 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb00d0ea0 msgr2=0x7f9eb0155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb00d0ea0 0x7f9eb0155fa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c3a0 tx=0x7f9e9c00c860 comp rx=0 tx=0).stop 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 shutdown_connections 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e90078bc0 0x7f9e9007b0d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9eb013fd80 0x7f9eb01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb00d0ea0 0x7f9eb0155fa0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 --2- 172.21.15.118:0/914308361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9eb00cf170 0x7f9eb01f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 >> 172.21.15.118:0/914308361 conn(0x7f9eb006d110 msgr2=0x7f9eb015bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:16.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 shutdown_connections 2024-09-21T06:14:16.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:16.791+0000 7f9eb8600640 1 -- 172.21.15.118:0/914308361 wait complete. 2024-09-21T06:14:16.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:14:17.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.036+0000 7f60e7000640 1 -- 172.21.15.118:0/2346496168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 msgr2=0x7f60e00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.036+0000 7f60e7000640 1 --2- 172.21.15.118:0/2346496168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e00d0240 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f60cc005fd0 tx=0x7f60cc02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.036+0000 7f60e7000640 1 -- 172.21.15.118:0/2346496168 shutdown_connections 2024-09-21T06:14:17.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.036+0000 7f60e7000640 1 --2- 172.21.15.118:0/2346496168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e00d0240 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.036+0000 7f60e7000640 1 -- 172.21.15.118:0/2346496168 >> 172.21.15.118:0/2346496168 conn(0x7f60e006d6e0 msgr2=0x7f60e00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:17.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.036+0000 7f60e7000640 1 -- 172.21.15.118:0/2346496168 shutdown_connections 2024-09-21T06:14:17.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.036+0000 7f60e7000640 1 -- 172.21.15.118:0/2346496168 wait complete. 2024-09-21T06:14:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.039+0000 7f60e7000640 1 Processor -- start 2024-09-21T06:14:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.039+0000 7f60e7000640 1 -- start start 2024-09-21T06:14:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0073fa0 0x7f60e0135be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e00b5bb0 0x7f60e0138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e7000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e0138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e7000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f60e015db10 con 0x7f60e00cfe30 2024-09-21T06:14:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60e015d990 con 0x7f60e0073fa0 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60e015dc90 con 0x7f60e00b5bb0 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e6600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e0138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e6600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e0138e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53552/0 (socket says 172.21.15.118:53552) 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.040+0000 7f60e6600640 1 -- 172.21.15.118:0/3831615169 learned_addr learned my addr 172.21.15.118:0/3831615169 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e5200640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e00b5bb0 0x7f60e0138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e5c00640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0073fa0 0x7f60e0135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e6600640 1 -- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e00b5bb0 msgr2=0x7f60e0138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e6600640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e00b5bb0 0x7f60e0138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e6600640 1 -- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0073fa0 msgr2=0x7f60e0135be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e6600640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0073fa0 0x7f60e0135be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e6600640 1 -- 172.21.15.118:0/3831615169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e00c6810 con 0x7f60e00cfe30 2024-09-21T06:14:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e6600640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e0138e40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c3c0 tx=0x7f60d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:17.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60dd600640 1 -- 172.21.15.118:0/3831615169 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8017070 con 0x7f60e00cfe30 2024-09-21T06:14:17.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60dd600640 1 -- 172.21.15.118:0/3831615169 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60d80035f0 con 0x7f60e00cfe30 2024-09-21T06:14:17.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60dd600640 1 -- 172.21.15.118:0/3831615169 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8003a40 con 0x7f60e00cfe30 2024-09-21T06:14:17.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.041+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e00c6af0 con 0x7f60e00cfe30 2024-09-21T06:14:17.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.042+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e00c70b0 con 0x7f60e00cfe30 2024-09-21T06:14:17.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.043+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e0139440 con 0x7f60e00cfe30 2024-09-21T06:14:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.044+0000 7f60dd600640 1 -- 172.21.15.118:0/3831615169 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60d801a070 con 0x7f60e00cfe30 2024-09-21T06:14:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.045+0000 7f60dd600640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f60c0078b90 0x7f60c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.045+0000 7f60dd600640 1 -- 172.21.15.118:0/3831615169 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f60d8099c60 con 0x7f60e00cfe30 2024-09-21T06:14:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.045+0000 7f60e5c00640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f60c0078b90 0x7f60c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.046+0000 7f60e5c00640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f60c0078b90 0x7f60c007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60d4007fd0 tx=0x7f60d4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:17.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.049+0000 7f60dd600640 1 -- 172.21.15.118:0/3831615169 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f60d80623a0 con 0x7f60e00cfe30 2024-09-21T06:14:17.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.235+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f60e00ce010 con 0x7f60e00cfe30 2024-09-21T06:14:17.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.235+0000 7f60dd600640 1 -- 172.21.15.118:0/3831615169 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+1472 (secure 0 0 0) 0x7f60d8061ca0 con 0x7f60e00cfe30 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:14:17.238 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:14:17.239 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:14:17.240 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:14:17.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.237+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f60c0078b90 msgr2=0x7f60c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.237+0000 7f60e7000640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f60c0078b90 0x7f60c007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60d4007fd0 tx=0x7f60d4009040 comp rx=0 tx=0).stop 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.237+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 msgr2=0x7f60e0138e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.237+0000 7f60e7000640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e0138e40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c3c0 tx=0x7f60d800c880 comp rx=0 tx=0).stop 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 shutdown_connections 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60e00cfe30 0x7f60e0138e40 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f60c0078b90 0x7f60c007b0a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60e00b5bb0 0x7f60e0138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 --2- 172.21.15.118:0/3831615169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0073fa0 0x7f60e0135be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 >> 172.21.15.118:0/3831615169 conn(0x7f60e006d6e0 msgr2=0x7f60e0157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 shutdown_connections 2024-09-21T06:14:17.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.238+0000 7f60e7000640 1 -- 172.21.15.118:0/3831615169 wait complete. 2024-09-21T06:14:17.262 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:14:17.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 -- 172.21.15.118:0/3337401017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d880d1590 msgr2=0x7f7d88142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3337401017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d880d1590 0x7f7d88142730 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f7d74005fd0 tx=0x7f7d7402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 -- 172.21.15.118:0/3337401017 shutdown_connections 2024-09-21T06:14:17.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3337401017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d8813fef0 0x7f7d88142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3337401017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d880d1590 0x7f7d88142730 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 -- 172.21.15.118:0/3337401017 >> 172.21.15.118:0/3337401017 conn(0x7f7d8806d110 msgr2=0x7f7d8806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:17.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 -- 172.21.15.118:0/3337401017 shutdown_connections 2024-09-21T06:14:17.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.484+0000 7f7d8f000640 1 -- 172.21.15.118:0/3337401017 wait complete. 2024-09-21T06:14:17.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.487+0000 7f7d8f000640 1 Processor -- start 2024-09-21T06:14:17.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.487+0000 7f7d8f000640 1 -- start start 2024-09-21T06:14:17.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.488+0000 7f7d8f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d8813fae0 0x7f7d88139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.488+0000 7f7d8f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d8813fef0 0x7f7d8813ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.488+0000 7f7d8f000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d8815f190 0x7f7d881f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.488+0000 7f7d8f000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d880cfac0 con 0x7f7d8815f190 2024-09-21T06:14:17.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.488+0000 7f7d8f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d880cf940 con 0x7f7d8813fae0 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.488+0000 7f7d8f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d880cfc40 con 0x7f7d8813fef0 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.488+0000 7f7d8d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d8815f190 0x7f7d881f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d8815f190 0x7f7d881f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53568/0 (socket says 172.21.15.118:53568) 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 -- 172.21.15.118:0/3028460335 learned_addr learned my addr 172.21.15.118:0/3028460335 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d87e00640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d8813fae0 0x7f7d88139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d87400640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d8813fef0 0x7f7d8813ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 -- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d8813fef0 msgr2=0x7f7d8813ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d8813fef0 0x7f7d8813ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 -- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d8813fae0 msgr2=0x7f7d88139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d8813fae0 0x7f7d88139be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 -- 172.21.15.118:0/3028460335 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d881f5700 con 0x7f7d8815f190 2024-09-21T06:14:17.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d87400640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d8813fef0 0x7f7d8813ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:17.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.489+0000 7f7d8d000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d8815f190 0x7f7d881f5ed0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000d750 tx=0x7f7d8000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:17.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.490+0000 7f7d7fe00640 1 -- 172.21.15.118:0/3028460335 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80017070 con 0x7f7d8815f190 2024-09-21T06:14:17.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.490+0000 7f7d7fe00640 1 -- 172.21.15.118:0/3028460335 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d80009b20 con 0x7f7d8815f190 2024-09-21T06:14:17.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.490+0000 7f7d7fe00640 1 -- 172.21.15.118:0/3028460335 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80004020 con 0x7f7d8815f190 2024-09-21T06:14:17.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.490+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d88072f20 con 0x7f7d8815f190 2024-09-21T06:14:17.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.490+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d880734e0 con 0x7f7d8815f190 2024-09-21T06:14:17.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.491+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d880d00f0 con 0x7f7d8815f190 2024-09-21T06:14:17.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.492+0000 7f7d7fe00640 1 -- 172.21.15.118:0/3028460335 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d800041c0 con 0x7f7d8815f190 2024-09-21T06:14:17.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.493+0000 7f7d7fe00640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d68078b90 0x7f7d6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:17.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.493+0000 7f7d7fe00640 1 -- 172.21.15.118:0/3028460335 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f7d8009aad0 con 0x7f7d8815f190 2024-09-21T06:14:17.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.493+0000 7f7d87e00640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d68078b90 0x7f7d6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:17.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.494+0000 7f7d87e00640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d68078b90 0x7f7d6807b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7d780012e0 tx=0x7f7d78009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:17.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.497+0000 7f7d7fe00640 1 -- 172.21.15.118:0/3028460335 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d80020030 con 0x7f7d8815f190 2024-09-21T06:14:17.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.683+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7d8815e960 con 0x7f7d8815f190 2024-09-21T06:14:17.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.687+0000 7f7d7fe00640 1 -- 172.21.15.118:0/3028460335 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f7d800631f0 con 0x7f7d8815f190 2024-09-21T06:14:17.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d68078b90 msgr2=0x7f7d6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d68078b90 0x7f7d6807b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7d780012e0 tx=0x7f7d78009040 comp rx=0 tx=0).stop 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d8815f190 msgr2=0x7f7d881f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d8815f190 0x7f7d881f5ed0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000d750 tx=0x7f7d8000dc10 comp rx=0 tx=0).stop 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 shutdown_connections 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d8815f190 0x7f7d881f5ed0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d68078b90 0x7f7d6807b0a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d8813fef0 0x7f7d8813ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 --2- 172.21.15.118:0/3028460335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d8813fae0 0x7f7d88139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 >> 172.21.15.118:0/3028460335 conn(0x7f7d8806d110 msgr2=0x7f7d881391b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 shutdown_connections 2024-09-21T06:14:17.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:17.690+0000 7f7d8f000640 1 -- 172.21.15.118:0/3028460335 wait complete. 2024-09-21T06:14:17.719 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:14:17.719 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:14:17.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:14:17.899 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:14:17.899 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:14:17.899 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:17.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:14:17.935 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:14:17.935 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:17.971 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:14:17.971 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:14:17.971 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:18.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:14:18.010 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:14:18.010 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:18.047 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:14:18.047 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:14:18.047 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.270+0000 7f2044600640 1 -- 172.21.15.118:0/3315535705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 msgr2=0x7f203c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.270+0000 7f2044600640 1 --2- 172.21.15.118:0/3315535705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 0x7f203c0d0e80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2030009be0 tx=0x7f203002a890 comp rx=0 tx=0).stop 2024-09-21T06:14:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.270+0000 7f2044600640 1 -- 172.21.15.118:0/3315535705 shutdown_connections 2024-09-21T06:14:18.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.270+0000 7f2044600640 1 --2- 172.21.15.118:0/3315535705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 0x7f203c0d0e80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.270+0000 7f2044600640 1 -- 172.21.15.118:0/3315535705 >> 172.21.15.118:0/3315535705 conn(0x7f203c06d110 msgr2=0x7f203c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:18.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.271+0000 7f2044600640 1 -- 172.21.15.118:0/3315535705 shutdown_connections 2024-09-21T06:14:18.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.271+0000 7f2044600640 1 -- 172.21.15.118:0/3315535705 wait complete. 2024-09-21T06:14:18.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.273+0000 7f2044600640 1 Processor -- start 2024-09-21T06:14:18.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.273+0000 7f2044600640 1 -- start start 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.274+0000 7f2044600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 0x7f203c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.274+0000 7f2044600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f203c13fef0 0x7f203c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.274+0000 7f2044600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203c142e40 0x7f203c13b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.274+0000 7f2044600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f203c0cfd40 con 0x7f203c13fef0 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.274+0000 7f2044600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f203c0cfbc0 con 0x7f203c142e40 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.274+0000 7f2044600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f203c0cfec0 con 0x7f203c13fae0 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.274+0000 7f2041200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f203c13fef0 0x7f203c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f203c13fef0 0x7f203c073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53572/0 (socket says 172.21.15.118:53572) 2024-09-21T06:14:18.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 -- 172.21.15.118:0/1786966140 learned_addr learned my addr 172.21.15.118:0/1786966140 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:18.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041c00640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 0x7f203c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2042600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203c142e40 0x7f203c13b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 -- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 msgr2=0x7f203c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 0x7f203c1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 -- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203c142e40 msgr2=0x7f203c13b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203c142e40 0x7f203c13b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 -- 172.21.15.118:0/1786966140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c158a30 con 0x7f203c13fef0 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041c00640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 0x7f203c1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2042600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203c142e40 0x7f203c13b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:18.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2041200640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f203c13fef0 0x7f203c073f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f202800c460 tx=0x7f202800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:18.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.275+0000 7f2039600640 1 -- 172.21.15.118:0/1786966140 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028017070 con 0x7f203c13fef0 2024-09-21T06:14:18.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.276+0000 7f2039600640 1 -- 172.21.15.118:0/1786966140 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20280053e0 con 0x7f203c13fef0 2024-09-21T06:14:18.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.276+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203c159030 con 0x7f203c13fef0 2024-09-21T06:14:18.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.276+0000 7f2039600640 1 -- 172.21.15.118:0/1786966140 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028003850 con 0x7f203c13fef0 2024-09-21T06:14:18.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.276+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203c157cf0 con 0x7f203c13fef0 2024-09-21T06:14:18.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.277+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f203c157ae0 con 0x7f203c13fef0 2024-09-21T06:14:18.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.278+0000 7f2039600640 1 -- 172.21.15.118:0/1786966140 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f202801a070 con 0x7f203c13fef0 2024-09-21T06:14:18.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.279+0000 7f2039600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f201c078b90 0x7f201c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.279+0000 7f2039600640 1 -- 172.21.15.118:0/1786966140 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f2028099db0 con 0x7f203c13fef0 2024-09-21T06:14:18.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.279+0000 7f2041c00640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f201c078b90 0x7f201c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.280+0000 7f2041c00640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f201c078b90 0x7f201c07b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2030034000 tx=0x7f2030004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:18.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.283+0000 7f2039600640 1 -- 172.21.15.118:0/1786966140 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f202809e070 con 0x7f203c13fef0 2024-09-21T06:14:18.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.503+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f203c0d0370 con 0x7f203c13fef0 2024-09-21T06:14:18.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.504+0000 7f2039600640 1 -- 172.21.15.118:0/1786966140 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+3923 (secure 0 0 0) 0x7f2028062570 con 0x7f203c13fef0 2024-09-21T06:14:18.507 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:18.507 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":79,"btime":"2024-09-21T06:14:11:761767+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1323323845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1323323845},{"type":"v1","addr":"172.21.15.149:6837","nonce":1323323845}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2754971964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2754971964},{"type":"v1","addr":"172.21.15.149:6835","nonce":2754971964}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2334728375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2334728375},{"type":"v1","addr":"172.21.15.118:6834","nonce":2334728375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7701,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3683443740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3683443740},{"type":"v1","addr":"172.21.15.118:6835","nonce":3683443740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-09-21T06:14:18.507 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 79 2024-09-21T06:14:18.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f201c078b90 msgr2=0x7f201c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f201c078b90 0x7f201c07b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2030034000 tx=0x7f2030004ab0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f203c13fef0 msgr2=0x7f203c073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f203c13fef0 0x7f203c073f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f202800c460 tx=0x7f202800c920 comp rx=0 tx=0).stop 2024-09-21T06:14:18.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 shutdown_connections 2024-09-21T06:14:18.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203c142e40 0x7f203c13b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f203c13fef0 0x7f203c073f00 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f201c078b90 0x7f201c07b0a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 --2- 172.21.15.118:0/1786966140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203c13fae0 0x7f203c1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 >> 172.21.15.118:0/1786966140 conn(0x7f203c06d110 msgr2=0x7f203c160970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:18.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 shutdown_connections 2024-09-21T06:14:18.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.506+0000 7f2044600640 1 -- 172.21.15.118:0/1786966140 wait complete. 2024-09-21T06:14:18.533 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:14:18.533 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:14:18.534 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:14:18.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:14:18.534 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:14:18.534 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:14:18.534 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:14:18.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:14:18.535 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:14:18.535 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:14:18.535 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:14:18.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:14:18.535 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:14:18.535 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:14:18.535 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:14:18.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:14:18.558 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:14:18.558 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:14:18.559 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:14:18.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:14:18.564 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:14:18.564 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:14:18.568 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:14:18.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:14:18.603 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:14:18.603 DEBUG:teuthology.parallel:result is None 2024-09-21T06:14:18.605 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:14:18.605 DEBUG:teuthology.parallel:result is None 2024-09-21T06:14:18.612 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:14:18.613 DEBUG:teuthology.parallel:result is None 2024-09-21T06:14:18.616 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:14:18.616 DEBUG:teuthology.parallel:result is None 2024-09-21T06:14:18.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:14:18.799 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:14:18.800 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:14:18.812 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:14:18.812 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:14:18.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 -- 172.21.15.118:0/1221070161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0b3be0 msgr2=0x7f077c0ba170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 --2- 172.21.15.118:0/1221070161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0b3be0 0x7f077c0ba170 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0770009820 tx=0x7f077002a480 comp rx=0 tx=0).stop 2024-09-21T06:14:18.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 -- 172.21.15.118:0/1221070161 shutdown_connections 2024-09-21T06:14:18.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 --2- 172.21.15.118:0/1221070161 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f077c0d35d0 0x7f077c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 --2- 172.21.15.118:0/1221070161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0b3be0 0x7f077c0ba170 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 -- 172.21.15.118:0/1221070161 >> 172.21.15.118:0/1221070161 conn(0x7f077c0d4bd0 msgr2=0x7f077c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:18.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 -- 172.21.15.118:0/1221070161 shutdown_connections 2024-09-21T06:14:18.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.845+0000 7f0783200640 1 -- 172.21.15.118:0/1221070161 wait complete. 2024-09-21T06:14:18.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.847+0000 7f0783200640 1 Processor -- start 2024-09-21T06:14:18.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.847+0000 7f0783200640 1 -- start start 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0783200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f077c0b3be0 0x7f077c0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0783200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0d2ab0 0x7f077c0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0783200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f077c0d35d0 0x7f077c0b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0783200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f077c06e0f0 con 0x7f077c0b3be0 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0783200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f077c06df70 con 0x7f077c0d2ab0 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0783200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f077c06e270 con 0x7f077c0d35d0 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f077c0b3be0 0x7f077c0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f077c0b3be0 0x7f077c0c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53616/0 (socket says 172.21.15.118:53616) 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 -- 172.21.15.118:0/3186062095 learned_addr learned my addr 172.21.15.118:0/3186062095 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:18.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781400640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0d2ab0 0x7f077c0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0782800640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f077c0d35d0 0x7f077c0b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 -- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f077c0d35d0 msgr2=0x7f077c0b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f077c0d35d0 0x7f077c0b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 -- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0d2ab0 msgr2=0x7f077c0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0d2ab0 0x7f077c0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0781e00640 1 -- 172.21.15.118:0/3186062095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c0cb760 con 0x7f077c0b3be0 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.849+0000 7f0782800640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f077c0d35d0 0x7f077c0b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:18.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.850+0000 7f0781e00640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f077c0b3be0 0x7f077c0c8710 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f0770009910 tx=0x7f0770004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:18.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.850+0000 7f0776000640 1 -- 172.21.15.118:0/3186062095 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077003f070 con 0x7f077c0b3be0 2024-09-21T06:14:18.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.850+0000 7f0776000640 1 -- 172.21.15.118:0/3186062095 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0770004e50 con 0x7f077c0b3be0 2024-09-21T06:14:18.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.850+0000 7f0776000640 1 -- 172.21.15.118:0/3186062095 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770005c30 con 0x7f077c0b3be0 2024-09-21T06:14:18.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.850+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c0ca180 con 0x7f077c0b3be0 2024-09-21T06:14:18.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.850+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c0ca740 con 0x7f077c0b3be0 2024-09-21T06:14:18.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.851+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c06e790 con 0x7f077c0b3be0 2024-09-21T06:14:18.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.853+0000 7f0776000640 1 -- 172.21.15.118:0/3186062095 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0770042070 con 0x7f077c0b3be0 2024-09-21T06:14:18.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.853+0000 7f0776000640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0760078bc0 0x7f076007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:18.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.854+0000 7f0776000640 1 -- 172.21.15.118:0/3186062095 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4943+0+0 (secure 0 0 0) 0x7f07700bb860 con 0x7f077c0b3be0 2024-09-21T06:14:18.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.854+0000 7f0781400640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0760078bc0 0x7f076007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:18.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.854+0000 7f0781400640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0760078bc0 0x7f076007b0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f076c007fd0 tx=0x7f076c0013b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:18.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:18.858+0000 7f0776000640 1 -- 172.21.15.118:0/3186062095 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0770083940 con 0x7f077c0b3be0 2024-09-21T06:14:19.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.054+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f077c0d26e0 con 0x7f077c0b3be0 2024-09-21T06:14:19.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.811+0000 7f0776000640 1 -- 172.21.15.118:0/3186062095 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v156) ==== 97+0+0 (secure 0 0 0) 0x7f0770088370 con 0x7f077c0b3be0 2024-09-21T06:14:19.813 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:14:19.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0760078bc0 msgr2=0x7f076007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0760078bc0 0x7f076007b0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f076c007fd0 tx=0x7f076c0013b0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f077c0b3be0 msgr2=0x7f077c0c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f077c0b3be0 0x7f077c0c8710 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f0770009910 tx=0x7f0770004a50 comp rx=0 tx=0).stop 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 shutdown_connections 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0760078bc0 0x7f076007b0d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f077c0d35d0 0x7f077c0b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f077c0d2ab0 0x7f077c0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 --2- 172.21.15.118:0/3186062095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f077c0b3be0 0x7f077c0c8710 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 >> 172.21.15.118:0/3186062095 conn(0x7f077c0d4bd0 msgr2=0x7f077c15f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 shutdown_connections 2024-09-21T06:14:19.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:19.814+0000 7f0783200640 1 -- 172.21.15.118:0/3186062095 wait complete. 2024-09-21T06:14:19.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:14:20.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 -- 172.21.15.118:0/519517600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240b3a60 msgr2=0x7f2d240cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 --2- 172.21.15.118:0/519517600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240b3a60 0x7f2d240cca40 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005fd0 tx=0x7f2d0c02a540 comp rx=0 tx=0).stop 2024-09-21T06:14:20.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 -- 172.21.15.118:0/519517600 shutdown_connections 2024-09-21T06:14:20.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 --2- 172.21.15.118:0/519517600 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d240ccf80 0x7f2d24073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 --2- 172.21.15.118:0/519517600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240b3a60 0x7f2d240cca40 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 -- 172.21.15.118:0/519517600 >> 172.21.15.118:0/519517600 conn(0x7f2d2406d110 msgr2=0x7f2d2406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:20.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 -- 172.21.15.118:0/519517600 shutdown_connections 2024-09-21T06:14:20.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.065+0000 7f2d28e00640 1 -- 172.21.15.118:0/519517600 wait complete. 2024-09-21T06:14:20.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.067+0000 7f2d28e00640 1 Processor -- start 2024-09-21T06:14:20.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.068+0000 7f2d28e00640 1 -- start start 2024-09-21T06:14:20.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d28e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d240b3a60 0x7f2d240cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d28e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240ccf80 0x7f2d24136500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d28e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d2415cfd0 0x7f2d24136a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d28e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24073c40 con 0x7f2d240ccf80 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d28e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24073ac0 con 0x7f2d2415cfd0 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d28e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2d24073dc0 con 0x7f2d240b3a60 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d19400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240ccf80 0x7f2d24136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d19400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240ccf80 0x7f2d24136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53636/0 (socket says 172.21.15.118:53636) 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.069+0000 7f2d19400640 1 -- 172.21.15.118:0/429304662 learned_addr learned my addr 172.21.15.118:0/429304662 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d22800640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d2415cfd0 0x7f2d24136a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d21e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d240b3a60 0x7f2d240cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d19400640 1 -- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d240b3a60 msgr2=0x7f2d240cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d19400640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d240b3a60 0x7f2d240cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d19400640 1 -- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d2415cfd0 msgr2=0x7f2d24136a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d19400640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d2415cfd0 0x7f2d24136a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d19400640 1 -- 172.21.15.118:0/429304662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d240cb4c0 con 0x7f2d240ccf80 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d19400640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240ccf80 0x7f2d24136500 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c034040 tx=0x7f2d0c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d1aa00640 1 -- 172.21.15.118:0/429304662 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c03e030 con 0x7f2d240ccf80 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d1aa00640 1 -- 172.21.15.118:0/429304662 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d0c003d90 con 0x7f2d240ccf80 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d1aa00640 1 -- 172.21.15.118:0/429304662 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c035040 con 0x7f2d240ccf80 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d240cb7a0 con 0x7f2d240ccf80 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.070+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d24156130 con 0x7f2d240ccf80 2024-09-21T06:14:20.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.071+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d24137030 con 0x7f2d240ccf80 2024-09-21T06:14:20.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.073+0000 7f2d1aa00640 1 -- 172.21.15.118:0/429304662 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d0c041030 con 0x7f2d240ccf80 2024-09-21T06:14:20.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.074+0000 7f2d1aa00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2d00078b90 0x7f2d0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.074+0000 7f2d1aa00640 1 -- 172.21.15.118:0/429304662 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4857+0+0 (secure 0 0 0) 0x7f2d0c0bb270 con 0x7f2d240ccf80 2024-09-21T06:14:20.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.074+0000 7f2d21e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2d00078b90 0x7f2d0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.075+0000 7f2d21e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2d00078b90 0x7f2d0007b0a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2d140015e0 tx=0x7f2d14009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:20.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.078+0000 7f2d1aa00640 1 -- 172.21.15.118:0/429304662 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2d0c083970 con 0x7f2d240ccf80 2024-09-21T06:14:20.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.337+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2d240cca40 con 0x7f2d240ccf80 2024-09-21T06:14:20.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.338+0000 7f2d1aa00640 1 -- 172.21.15.118:0/429304662 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f2d0c083270 con 0x7f2d240ccf80 2024-09-21T06:14:20.340 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:20.340 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:14:20.340 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:14:20.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.341 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.342 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:14:20.343 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.344 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.345 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.347 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:14:20.348 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:14:20.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.350 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:14:20.351 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.352 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:14:20.353 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:14:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.340+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2d00078b90 msgr2=0x7f2d0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.340+0000 7f2d28e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2d00078b90 0x7f2d0007b0a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2d140015e0 tx=0x7f2d14009040 comp rx=0 tx=0).stop 2024-09-21T06:14:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.340+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240ccf80 msgr2=0x7f2d24136500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.340+0000 7f2d28e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240ccf80 0x7f2d24136500 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c034040 tx=0x7f2d0c0038a0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 shutdown_connections 2024-09-21T06:14:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d2415cfd0 0x7f2d24136a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d240ccf80 0x7f2d24136500 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2d00078b90 0x7f2d0007b0a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 --2- 172.21.15.118:0/429304662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d240b3a60 0x7f2d240cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 >> 172.21.15.118:0/429304662 conn(0x7f2d2406d110 msgr2=0x7f2d240d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 shutdown_connections 2024-09-21T06:14:20.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.341+0000 7f2d28e00640 1 -- 172.21.15.118:0/429304662 wait complete. 2024-09-21T06:14:20.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:14:20.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:14:20.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:14:20.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.589+0000 7f727f000640 1 -- 172.21.15.118:0/1396131662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fef0 msgr2=0x7f7278142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.589+0000 7f727f000640 1 --2- 172.21.15.118:0/1396131662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fef0 0x7f7278142e40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7270009830 tx=0x7f727002a4b0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.590+0000 7f727f000640 1 -- 172.21.15.118:0/1396131662 shutdown_connections 2024-09-21T06:14:20.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.590+0000 7f727f000640 1 --2- 172.21.15.118:0/1396131662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fef0 0x7f7278142e40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.590+0000 7f727f000640 1 -- 172.21.15.118:0/1396131662 >> 172.21.15.118:0/1396131662 conn(0x7f727806d110 msgr2=0x7f727806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:20.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.590+0000 7f727f000640 1 -- 172.21.15.118:0/1396131662 shutdown_connections 2024-09-21T06:14:20.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.590+0000 7f727f000640 1 -- 172.21.15.118:0/1396131662 wait complete. 2024-09-21T06:14:20.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.592+0000 7f727f000640 1 Processor -- start 2024-09-21T06:14:20.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.592+0000 7f727f000640 1 -- start start 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.593+0000 7f727f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fae0 0x7f7278138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.593+0000 7f727f000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727813fef0 0x7f727815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.593+0000 7f727f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727815b560 0x7f727815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.593+0000 7f727f000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7278168280 con 0x7f727813fef0 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.593+0000 7f727f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7278168100 con 0x7f727813fae0 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.593+0000 7f727f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7278168400 con 0x7f727815b560 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727813fef0 0x7f727815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727813fef0 0x7f727815b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53648/0 (socket says 172.21.15.118:53648) 2024-09-21T06:14:20.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 -- 172.21.15.118:0/1580857224 learned_addr learned my addr 172.21.15.118:0/1580857224 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:20.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f727d000640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727815b560 0x7f727815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277e00640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fae0 0x7f7278138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 -- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727815b560 msgr2=0x7f727815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727815b560 0x7f727815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 -- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fae0 msgr2=0x7f7278138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fae0 0x7f7278138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.594+0000 7f7277400640 1 -- 172.21.15.118:0/1580857224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727813d200 con 0x7f727813fef0 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.595+0000 7f7277400640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727813fef0 0x7f727815b020 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f726400c430 tx=0x7f726400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.595+0000 7f726fe00640 1 -- 172.21.15.118:0/1580857224 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264017070 con 0x7f727813fef0 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.595+0000 7f726fe00640 1 -- 172.21.15.118:0/1580857224 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72640053e0 con 0x7f727813fef0 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.595+0000 7f726fe00640 1 -- 172.21.15.118:0/1580857224 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264003850 con 0x7f727813fef0 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.595+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7278139400 con 0x7f727813fef0 2024-09-21T06:14:20.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.595+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727813d470 con 0x7f727813fef0 2024-09-21T06:14:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.596+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72780d0e80 con 0x7f727813fef0 2024-09-21T06:14:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.597+0000 7f726fe00640 1 -- 172.21.15.118:0/1580857224 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f726401a070 con 0x7f727813fef0 2024-09-21T06:14:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.598+0000 7f726fe00640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7258078b90 0x7f725807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.599+0000 7f726fe00640 1 -- 172.21.15.118:0/1580857224 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4857+0+0 (secure 0 0 0) 0x7f726409a230 con 0x7f727813fef0 2024-09-21T06:14:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.599+0000 7f7277e00640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7258078b90 0x7f725807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:20.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.600+0000 7f7277e00640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7258078b90 0x7f725807b0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7268001be0 tx=0x7f7268001a50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.602+0000 7f726fe00640 1 -- 172.21.15.118:0/1580857224 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7264021020 con 0x7f727813fef0 2024-09-21T06:14:20.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.788+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f72781662d0 con 0x7f727813fef0 2024-09-21T06:14:20.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.788+0000 7f726fe00640 1 -- 172.21.15.118:0/1580857224 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v158) ==== 84+0+65 (secure 0 0 0) 0x7f7264062350 con 0x7f727813fef0 2024-09-21T06:14:20.791 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:20.791 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:14:20.791 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:14:20.791 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:14:20.791 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:14:20.791 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:14:20.791 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:14:20.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7258078b90 msgr2=0x7f725807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7258078b90 0x7f725807b0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7268001be0 tx=0x7f7268001a50 comp rx=0 tx=0).stop 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727813fef0 msgr2=0x7f727815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727813fef0 0x7f727815b020 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f726400c430 tx=0x7f726400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 shutdown_connections 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7258078b90 0x7f725807b0a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727815b560 0x7f727815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727813fef0 0x7f727815b020 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 --2- 172.21.15.118:0/1580857224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727813fae0 0x7f7278138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 >> 172.21.15.118:0/1580857224 conn(0x7f727806d110 msgr2=0x7f7278142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 shutdown_connections 2024-09-21T06:14:20.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:20.791+0000 7f727f000640 1 -- 172.21.15.118:0/1580857224 wait complete. 2024-09-21T06:14:20.817 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:14:20.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 -- 172.21.15.118:0/2613052371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd00160a50 msgr2=0x7fcd0015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 --2- 172.21.15.118:0/2613052371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd00160a50 0x7fcd0015dcb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fcd000726f0 tx=0x7fcce802a5f0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 -- 172.21.15.118:0/2613052371 shutdown_connections 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 --2- 172.21.15.118:0/2613052371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd00160a50 0x7fcd0015dcb0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 --2- 172.21.15.118:0/2613052371 >> v2:172.21.15.149:3300/0 conn(0x7fcd000701f0 0x7fcd000ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 -- 172.21.15.118:0/2613052371 >> 172.21.15.118:0/2613052371 conn(0x7fcd0006cf30 msgr2=0x7fcd0006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 -- 172.21.15.118:0/2613052371 shutdown_connections 2024-09-21T06:14:21.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.082+0000 7fcd07c00640 1 -- 172.21.15.118:0/2613052371 wait complete. 2024-09-21T06:14:21.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.084+0000 7fcd07c00640 1 Processor -- start 2024-09-21T06:14:21.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.084+0000 7fcd07c00640 1 -- start start 2024-09-21T06:14:21.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd07c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000701f0 0x7fcd00144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd07c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000b3e00 0x7fcd00144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd07c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd00160a50 0x7fcd001f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd07c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcd000cf020 con 0x7fcd000b3e00 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd07c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd000ceea0 con 0x7fcd000701f0 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd07c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd000cf1a0 con 0x7fcd00160a50 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000b3e00 0x7fcd00144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000b3e00 0x7fcd00144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53676/0 (socket says 172.21.15.118:53676) 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 -- 172.21.15.118:0/3867433732 learned_addr learned my addr 172.21.15.118:0/3867433732 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd05200640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000701f0 0x7fcd00144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 -- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd00160a50 msgr2=0x7fcd001f9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd00160a50 0x7fcd001f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 -- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000701f0 msgr2=0x7fcd00144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000701f0 0x7fcd00144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fccf7e00640 1 -- 172.21.15.118:0/3867433732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd000c5a60 con 0x7fcd000b3e00 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.086+0000 7fcd05200640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000701f0 0x7fcd00144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.087+0000 7fccf7e00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000b3e00 0x7fcd00144a70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fcce8034040 tx=0x7fcce8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.087+0000 7fccfd600640 1 -- 172.21.15.118:0/3867433732 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce803e030 con 0x7fcd000b3e00 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.087+0000 7fccfd600640 1 -- 172.21.15.118:0/3867433732 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcce8003d10 con 0x7fcd000b3e00 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.087+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd001f6740 con 0x7fcd000b3e00 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.087+0000 7fccfd600640 1 -- 172.21.15.118:0/3867433732 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8035040 con 0x7fcd000b3e00 2024-09-21T06:14:21.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.087+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd001f6d00 con 0x7fcd000b3e00 2024-09-21T06:14:21.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.089+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd000cf660 con 0x7fcd000b3e00 2024-09-21T06:14:21.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.090+0000 7fccfd600640 1 -- 172.21.15.118:0/3867433732 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcce8041030 con 0x7fcd000b3e00 2024-09-21T06:14:21.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.091+0000 7fccfd600640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccdc078bc0 0x7fccdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.091+0000 7fccfd600640 1 -- 172.21.15.118:0/3867433732 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4857+0+0 (secure 0 0 0) 0x7fcce80bb600 con 0x7fcd000b3e00 2024-09-21T06:14:21.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.092+0000 7fcd05200640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccdc078bc0 0x7fccdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.093+0000 7fcd05200640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccdc078bc0 0x7fccdc07b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009ab0 tx=0x7fccf0005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.095+0000 7fccfd600640 1 -- 172.21.15.118:0/3867433732 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcce8083e00 con 0x7fcd000b3e00 2024-09-21T06:14:21.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.280+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcd0006a260 con 0x7fcd000b3e00 2024-09-21T06:14:21.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.826+0000 7fccfd600640 1 -- 172.21.15.118:0/3867433732 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v159) ==== 138+0+0 (secure 0 0 0) 0x7fcce8083700 con 0x7fcd000b3e00 2024-09-21T06:14:21.828 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:14:21.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccdc078bc0 msgr2=0x7fccdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccdc078bc0 0x7fccdc07b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009ab0 tx=0x7fccf0005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:21.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000b3e00 msgr2=0x7fcd00144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000b3e00 0x7fcd00144a70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fcce8034040 tx=0x7fcce8003820 comp rx=0 tx=0).stop 2024-09-21T06:14:21.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 shutdown_connections 2024-09-21T06:14:21.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fccdc078bc0 0x7fccdc07b0d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd00160a50 0x7fcd001f9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000b3e00 0x7fcd00144a70 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 --2- 172.21.15.118:0/3867433732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000701f0 0x7fcd00144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.830+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 >> 172.21.15.118:0/3867433732 conn(0x7fcd0006cf30 msgr2=0x7fcd00160280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.831+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 shutdown_connections 2024-09-21T06:14:21.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:21.831+0000 7fcd07c00640 1 -- 172.21.15.118:0/3867433732 wait complete. 2024-09-21T06:14:21.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:14:22.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.085+0000 7f9f41600640 1 -- 172.21.15.118:0/3103464510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 msgr2=0x7f9f20004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:22.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.085+0000 7f9f41600640 1 --2- 172.21.15.118:0/3103464510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 0x7f9f20004c10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009b20 tx=0x7f9f20005830 comp rx=0 tx=0).stop 2024-09-21T06:14:22.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.085+0000 7f9f3b400640 1 -- 172.21.15.118:0/3103464510 reap_dead start 2024-09-21T06:14:22.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.085+0000 7f9f41600640 1 -- 172.21.15.118:0/3103464510 shutdown_connections 2024-09-21T06:14:22.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.085+0000 7f9f41600640 1 -- 172.21.15.118:0/3103464510 >> 172.21.15.118:0/3103464510 conn(0x7f9f3c0b38e0 msgr2=0x7f9f3c0b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:22.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.085+0000 7f9f41600640 1 -- 172.21.15.118:0/3103464510 shutdown_connections 2024-09-21T06:14:22.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.085+0000 7f9f41600640 1 -- 172.21.15.118:0/3103464510 wait complete. 2024-09-21T06:14:22.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.088+0000 7f9f41600640 1 Processor -- start 2024-09-21T06:14:22.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.088+0000 7f9f41600640 1 -- start start 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f41600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 0x7f9f3c1f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f41600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f3c156730 0x7f9f3c1445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f41600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f3c156b40 0x7f9f3c144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f41600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c0b5370 con 0x7f9f20004800 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f41600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c06d0b0 con 0x7f9f3c156b40 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f41600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3c0b54f0 con 0x7f9f3c156730 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f3aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 0x7f9f3c1f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:22.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f3aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 0x7f9f3c1f9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53692/0 (socket says 172.21.15.118:53692) 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.089+0000 7f9f3aa00640 1 -- 172.21.15.118:0/3023448377 learned_addr learned my addr 172.21.15.118:0/3023448377 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f32000640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f3c156730 0x7f9f3c1445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f3b400640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f3c156b40 0x7f9f3c144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f3aa00640 1 -- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f3c156730 msgr2=0x7f9f3c1445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f3aa00640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f3c156730 0x7f9f3c1445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f3aa00640 1 -- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f3c156b40 msgr2=0x7f9f3c144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f3aa00640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f3c156b40 0x7f9f3c144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:22.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f3aa00640 1 -- 172.21.15.118:0/3023448377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c1f59e0 con 0x7f9f20004800 2024-09-21T06:14:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f3aa00640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 0x7f9f3c1f9830 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c001330 tx=0x7f9f2c006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f33400640 1 -- 172.21.15.118:0/3023448377 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00fcc0 con 0x7f9f20004800 2024-09-21T06:14:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f33400640 1 -- 172.21.15.118:0/3023448377 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f2c00fe80 con 0x7f9f20004800 2024-09-21T06:14:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c1375d0 con 0x7f9f20004800 2024-09-21T06:14:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.090+0000 7f9f33400640 1 -- 172.21.15.118:0/3023448377 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c011690 con 0x7f9f20004800 2024-09-21T06:14:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.091+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c137b90 con 0x7f9f20004800 2024-09-21T06:14:22.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.092+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c0b7cf0 con 0x7f9f20004800 2024-09-21T06:14:22.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.093+0000 7f9f33400640 1 -- 172.21.15.118:0/3023448377 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f2c018020 con 0x7f9f20004800 2024-09-21T06:14:22.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.094+0000 7f9f33400640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f18078bc0 0x7f9f1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:22.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.094+0000 7f9f33400640 1 -- 172.21.15.118:0/3023448377 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5227+0+0 (secure 0 0 0) 0x7f9f2c09b830 con 0x7f9f20004800 2024-09-21T06:14:22.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.094+0000 7f9f32000640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f18078bc0 0x7f9f1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:22.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.095+0000 7f9f32000640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f18078bc0 0x7f9f1807b0d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f24035000 tx=0x7f9f2402d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:22.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.099+0000 7f9f33400640 1 -- 172.21.15.118:0/3023448377 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9f3c0b7cf0 con 0x7f9f20004800 2024-09-21T06:14:22.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.290+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9f3c0b4be0 con 0x7f9f20004800 2024-09-21T06:14:22.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.834+0000 7f9f33400640 1 -- 172.21.15.118:0/3023448377 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v160) ==== 170+0+0 (secure 0 0 0) 0x7f9f3c1f59e0 con 0x7f9f20004800 2024-09-21T06:14:22.836 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:14:22.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f18078bc0 msgr2=0x7f9f1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:22.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f18078bc0 0x7f9f1807b0d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f24035000 tx=0x7f9f2402d040 comp rx=0 tx=0).stop 2024-09-21T06:14:22.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 msgr2=0x7f9f3c1f9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:22.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 0x7f9f3c1f9830 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c001330 tx=0x7f9f2c006720 comp rx=0 tx=0).stop 2024-09-21T06:14:22.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 shutdown_connections 2024-09-21T06:14:22.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f3c156b40 0x7f9f3c144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:22.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f18078bc0 0x7f9f1807b0d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:22.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f3c156730 0x7f9f3c1445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:22.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 --2- 172.21.15.118:0/3023448377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f20004800 0x7f9f3c1f9830 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:22.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.838+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 >> 172.21.15.118:0/3023448377 conn(0x7f9f3c0b38e0 msgr2=0x7f9f3c075fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:22.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.839+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 shutdown_connections 2024-09-21T06:14:22.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:22.840+0000 7f9f41600640 1 -- 172.21.15.118:0/3023448377 wait complete. 2024-09-21T06:14:22.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:14:23.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 -- 172.21.15.118:0/2297514126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215415d690 msgr2=0x7f215415efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:23.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 --2- 172.21.15.118:0/2297514126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215415d690 0x7f215415efb0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f2154072890 tx=0x7f214c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:14:23.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 -- 172.21.15.118:0/2297514126 shutdown_connections 2024-09-21T06:14:23.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 --2- 172.21.15.118:0/2297514126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f215415d690 0x7f215415efb0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 --2- 172.21.15.118:0/2297514126 >> v2:172.21.15.149:3300/0 conn(0x7f21540b62c0 0x7f215415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 -- 172.21.15.118:0/2297514126 >> 172.21.15.118:0/2297514126 conn(0x7f215406d6e0 msgr2=0x7f21540b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:23.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 -- 172.21.15.118:0/2297514126 shutdown_connections 2024-09-21T06:14:23.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.096+0000 7f2159200640 1 -- 172.21.15.118:0/2297514126 wait complete. 2024-09-21T06:14:23.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.099+0000 7f2159200640 1 Processor -- start 2024-09-21T06:14:23.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.099+0000 7f2159200640 1 -- start start 2024-09-21T06:14:23.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2159200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21541461d0 0x7f2154134930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:23.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2159200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215415d690 0x7f2154142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:23.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2159200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21541f7fe0 0x7f21541f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:23.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2159200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f215415fa20 con 0x7f21541f7fe0 2024-09-21T06:14:23.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2159200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f215415f8a0 con 0x7f215415d690 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2159200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f215415fba0 con 0x7f21541461d0 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2153e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21541f7fe0 0x7f21541f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2153e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21541f7fe0 0x7f21541f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53714/0 (socket says 172.21.15.118:53714) 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.100+0000 7f2153e00640 1 -- 172.21.15.118:0/2484754980 learned_addr learned my addr 172.21.15.118:0/2484754980 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.101+0000 7f214aa00640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215415d690 0x7f2154142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.101+0000 7f2153400640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21541461d0 0x7f2154134930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.101+0000 7f2153e00640 1 -- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21541461d0 msgr2=0x7f2154134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.101+0000 7f2153e00640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21541461d0 0x7f2154134930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.101+0000 7f2153e00640 1 -- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215415d690 msgr2=0x7f2154142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.101+0000 7f2153e00640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215415d690 0x7f2154142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.101+0000 7f2153e00640 1 -- 172.21.15.118:0/2484754980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215415cbe0 con 0x7f21541f7fe0 2024-09-21T06:14:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.102+0000 7f2153e00640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21541f7fe0 0x7f21541f7440 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f214c009d60 tx=0x7f214c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.102+0000 7f214be00640 1 -- 172.21.15.118:0/2484754980 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c033050 con 0x7f21541f7fe0 2024-09-21T06:14:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.102+0000 7f214be00640 1 -- 172.21.15.118:0/2484754980 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f214c004450 con 0x7f21541f7fe0 2024-09-21T06:14:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.102+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215415c650 con 0x7f21541f7fe0 2024-09-21T06:14:23.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.102+0000 7f214be00640 1 -- 172.21.15.118:0/2484754980 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c038450 con 0x7f21541f7fe0 2024-09-21T06:14:23.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.102+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2154159da0 con 0x7f21541f7fe0 2024-09-21T06:14:23.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.103+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2154160050 con 0x7f21541f7fe0 2024-09-21T06:14:23.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.105+0000 7f214be00640 1 -- 172.21.15.118:0/2484754980 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f214c036070 con 0x7f21541f7fe0 2024-09-21T06:14:23.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.106+0000 7f214be00640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2130078b90 0x7f213007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:23.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.106+0000 7f214be00640 1 -- 172.21.15.118:0/2484754980 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5609+0+0 (secure 0 0 0) 0x7f214c0bc150 con 0x7f21541f7fe0 2024-09-21T06:14:23.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.107+0000 7f2153400640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2130078b90 0x7f213007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:23.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.107+0000 7f2153400640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2130078b90 0x7f213007b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2144001720 tx=0x7f2144009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:23.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.111+0000 7f214be00640 1 -- 172.21.15.118:0/2484754980 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f214c0841a0 con 0x7f21541f7fe0 2024-09-21T06:14:23.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.333+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2154074fa0 con 0x7f21541f7fe0 2024-09-21T06:14:23.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.837+0000 7f214be00640 1 -- 172.21.15.118:0/2484754980 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v82) ==== 174+0+0 (secure 0 0 0) 0x7f214c088bd0 con 0x7f21541f7fe0 2024-09-21T06:14:23.838 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 20 and data pool 21 2024-09-21T06:14:23.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.841+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2130078b90 msgr2=0x7f213007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:23.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.841+0000 7f2159200640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2130078b90 0x7f213007b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2144001720 tx=0x7f2144009040 comp rx=0 tx=0).stop 2024-09-21T06:14:23.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.841+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21541f7fe0 msgr2=0x7f21541f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:23.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.841+0000 7f2159200640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21541f7fe0 0x7f21541f7440 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f214c009d60 tx=0x7f214c003f10 comp rx=0 tx=0).stop 2024-09-21T06:14:23.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.841+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 shutdown_connections 2024-09-21T06:14:23.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.841+0000 7f2159200640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21541f7fe0 0x7f21541f7440 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.841+0000 7f2159200640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215415d690 0x7f2154142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.842+0000 7f2159200640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2130078b90 0x7f213007b0a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.842+0000 7f2159200640 1 --2- 172.21.15.118:0/2484754980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21541461d0 0x7f2154134930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:23.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.842+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 >> 172.21.15.118:0/2484754980 conn(0x7f215406d6e0 msgr2=0x7f2154157810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:23.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.842+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 shutdown_connections 2024-09-21T06:14:23.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:23.842+0000 7f2159200640 1 -- 172.21.15.118:0/2484754980 wait complete. 2024-09-21T06:14:23.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:14:24.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.109+0000 7f59b4c00640 1 -- 172.21.15.118:0/3874910957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994003a00 msgr2=0x7f5994003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.109+0000 7f59b4c00640 1 --2- 172.21.15.118:0/3874910957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994003a00 0x7f5994003e70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009ed0 tx=0x7f5994005830 comp rx=0 tx=0).stop 2024-09-21T06:14:24.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.109+0000 7f59ae800640 1 -- 172.21.15.118:0/3874910957 reap_dead start 2024-09-21T06:14:24.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.109+0000 7f59b4c00640 1 -- 172.21.15.118:0/3874910957 shutdown_connections 2024-09-21T06:14:24.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.109+0000 7f59b4c00640 1 -- 172.21.15.118:0/3874910957 >> 172.21.15.118:0/3874910957 conn(0x7f59b006d110 msgr2=0x7f59b006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:24.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.109+0000 7f59b4c00640 1 -- 172.21.15.118:0/3874910957 shutdown_connections 2024-09-21T06:14:24.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.109+0000 7f59b4c00640 1 -- 172.21.15.118:0/3874910957 wait complete. 2024-09-21T06:14:24.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.111+0000 7f59b4c00640 1 Processor -- start 2024-09-21T06:14:24.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.112+0000 7f59b4c00640 1 -- start start 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59b4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5994003a00 0x7f59b0156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59b4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59b015c8e0 0x7f59b01e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59b4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b01e7fe0 0x7f59b0072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59b4c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00cf5d0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59b4c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00cf450 con 0x7f5994003a00 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59b4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f59b00cf750 con 0x7f59b015c8e0 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59ae800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b01e7fe0 0x7f59b0072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59ae800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b01e7fe0 0x7f59b0072cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53722/0 (socket says 172.21.15.118:53722) 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.113+0000 7f59ae800640 1 -- 172.21.15.118:0/206602887 learned_addr learned my addr 172.21.15.118:0/206602887 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:24.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ad400640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59b015c8e0 0x7f59b01e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ade00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5994003a00 0x7f59b0156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ae800640 1 -- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59b015c8e0 msgr2=0x7f59b01e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ae800640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59b015c8e0 0x7f59b01e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ae800640 1 -- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5994003a00 msgr2=0x7f59b0156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ae800640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5994003a00 0x7f59b0156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ae800640 1 -- 172.21.15.118:0/206602887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b013e2d0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ade00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5994003a00 0x7f59b0156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ad400640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59b015c8e0 0x7f59b01e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59ae800640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b01e7fe0 0x7f59b0072cd0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f59b0072ad0 tx=0x7f59a80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59a6000640 1 -- 172.21.15.118:0/206602887 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8011840 con 0x7f59b01e7fe0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59a6000640 1 -- 172.21.15.118:0/206602887 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59a8018070 con 0x7f59b01e7fe0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b013e5b0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59a6000640 1 -- 172.21.15.118:0/206602887 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8011c80 con 0x7f59b01e7fe0 2024-09-21T06:14:24.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.114+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b013dfa0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.115+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b00d12f0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.117+0000 7f59a6000640 1 -- 172.21.15.118:0/206602887 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59a801d460 con 0x7f59b01e7fe0 2024-09-21T06:14:24.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.118+0000 7f59a6000640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5990078b90 0x7f599007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.118+0000 7f59a6000640 1 -- 172.21.15.118:0/206602887 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5709+0+0 (secure 0 0 0) 0x7f59a809b5b0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.118+0000 7f59ade00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5990078b90 0x7f599007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.119+0000 7f59ade00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5990078b90 0x7f599007b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009ed0 tx=0x7f59a002d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:24.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.123+0000 7f59a6000640 1 -- 172.21.15.118:0/206602887 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f59a8011e20 con 0x7f59b01e7fe0 2024-09-21T06:14:24.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.309+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59b015f1e0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.310+0000 7f59a6000640 1 -- 172.21.15.118:0/206602887 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) ==== 74+0+16825 (secure 0 0 0) 0x7f59a80639e0 con 0x7f59b01e7fe0 2024-09-21T06:14:24.312 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:24.312 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":161,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:14:23.335843+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:14:21.294124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T06:14:22.303766+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5990078b90 msgr2=0x7f599007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5990078b90 0x7f599007b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009ed0 tx=0x7f59a002d040 comp rx=0 tx=0).stop 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b01e7fe0 msgr2=0x7f59b0072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b01e7fe0 0x7f59b0072cd0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f59b0072ad0 tx=0x7f59a80039c0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 shutdown_connections 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b01e7fe0 0x7f59b0072cd0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5990078b90 0x7f599007b0a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f59b015c8e0 0x7f59b01e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 --2- 172.21.15.118:0/206602887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5994003a00 0x7f59b0156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 >> 172.21.15.118:0/206602887 conn(0x7f59b006d110 msgr2=0x7f59b0153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 shutdown_connections 2024-09-21T06:14:24.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.313+0000 7f59b4c00640 1 -- 172.21.15.118:0/206602887 wait complete. 2024-09-21T06:14:24.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:14:24.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.559+0000 7ff17e400640 1 -- 172.21.15.118:0/1496490374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff17815f3e0 msgr2=0x7ff1780d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.559+0000 7ff17e400640 1 --2- 172.21.15.118:0/1496490374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff17815f3e0 0x7ff1780d1150 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7ff168005fd0 tx=0x7ff16802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.560+0000 7ff17e400640 1 -- 172.21.15.118:0/1496490374 shutdown_connections 2024-09-21T06:14:24.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.560+0000 7ff17e400640 1 --2- 172.21.15.118:0/1496490374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1780d08a0 0x7ff1780b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.560+0000 7ff17e400640 1 --2- 172.21.15.118:0/1496490374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff17815f3e0 0x7ff1780d1150 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.560+0000 7ff17e400640 1 -- 172.21.15.118:0/1496490374 >> 172.21.15.118:0/1496490374 conn(0x7ff1780748d0 msgr2=0x7ff178074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:24.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.560+0000 7ff17e400640 1 -- 172.21.15.118:0/1496490374 shutdown_connections 2024-09-21T06:14:24.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.560+0000 7ff17e400640 1 -- 172.21.15.118:0/1496490374 wait complete. 2024-09-21T06:14:24.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.562+0000 7ff17e400640 1 Processor -- start 2024-09-21T06:14:24.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.562+0000 7ff17e400640 1 -- start start 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.563+0000 7ff17e400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1780d08a0 0x7ff178156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.563+0000 7ff17e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1780d1690 0x7ff1781ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.563+0000 7ff17e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff17815f3e0 0x7ff1781ea830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.563+0000 7ff17e400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff1780b1560 con 0x7ff1780d08a0 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.563+0000 7ff17e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1780b13e0 con 0x7ff1780d1690 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.563+0000 7ff17e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff1780b16e0 con 0x7ff17815f3e0 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1780d08a0 0x7ff178156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1780d08a0 0x7ff178156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53746/0 (socket says 172.21.15.118:53746) 2024-09-21T06:14:24.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 -- 172.21.15.118:0/3654851388 learned_addr learned my addr 172.21.15.118:0/3654851388 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177e00640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff17815f3e0 0x7ff1781ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff16ea00640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1780d1690 0x7ff1781ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 -- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff17815f3e0 msgr2=0x7ff1781ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff17815f3e0 0x7ff1781ea830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 -- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1780d1690 msgr2=0x7ff1781ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1780d1690 0x7ff1781ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff177400640 1 -- 172.21.15.118:0/3654851388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1781e6e70 con 0x7ff1780d08a0 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.564+0000 7ff16ea00640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1780d1690 0x7ff1781ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:24.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.565+0000 7ff177400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1780d08a0 0x7ff178156810 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7ff168034040 tx=0x7ff1680038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:24.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.565+0000 7ff16fe00640 1 -- 172.21.15.118:0/3654851388 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16803e030 con 0x7ff1780d08a0 2024-09-21T06:14:24.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.565+0000 7ff16fe00640 1 -- 172.21.15.118:0/3654851388 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff168003ca0 con 0x7ff1780d08a0 2024-09-21T06:14:24.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.565+0000 7ff16fe00640 1 -- 172.21.15.118:0/3654851388 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168035040 con 0x7ff1780d08a0 2024-09-21T06:14:24.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.565+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1781e7150 con 0x7ff1780d08a0 2024-09-21T06:14:24.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.565+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1781e7710 con 0x7ff1780d08a0 2024-09-21T06:14:24.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.566+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1780b0c90 con 0x7ff1780d08a0 2024-09-21T06:14:24.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.567+0000 7ff16fe00640 1 -- 172.21.15.118:0/3654851388 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff168041030 con 0x7ff1780d08a0 2024-09-21T06:14:24.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.568+0000 7ff16fe00640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff154078bc0 0x7ff15407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:24.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.568+0000 7ff16fe00640 1 -- 172.21.15.118:0/3654851388 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5709+0+0 (secure 0 0 0) 0x7ff1680bb390 con 0x7ff1780d08a0 2024-09-21T06:14:24.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.569+0000 7ff16ea00640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff154078bc0 0x7ff15407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:24.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.569+0000 7ff16ea00640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff154078bc0 0x7ff15407b0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff1781ea070 tx=0x7ff160009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:24.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.573+0000 7ff16fe00640 1 -- 172.21.15.118:0/3654851388 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff1680830e0 con 0x7ff1780d08a0 2024-09-21T06:14:24.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.759+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff178070680 con 0x7ff1780d08a0 2024-09-21T06:14:24.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.760+0000 7ff16fe00640 1 -- 172.21.15.118:0/3654851388 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) ==== 74+0+16825 (secure 0 0 0) 0x7ff168087b10 con 0x7ff1780d08a0 2024-09-21T06:14:24.762 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:24.762 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":161,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:14:23.335843+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:14:21.294124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T06:14:22.303766+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:14:24.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff154078bc0 msgr2=0x7ff15407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff154078bc0 0x7ff15407b0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff1781ea070 tx=0x7ff160009040 comp rx=0 tx=0).stop 2024-09-21T06:14:24.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1780d08a0 msgr2=0x7ff178156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:24.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1780d08a0 0x7ff178156810 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7ff168034040 tx=0x7ff1680038a0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 shutdown_connections 2024-09-21T06:14:24.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff154078bc0 0x7ff15407b0d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff17815f3e0 0x7ff1781ea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1780d1690 0x7ff1781ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 --2- 172.21.15.118:0/3654851388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1780d08a0 0x7ff178156810 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:24.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 >> 172.21.15.118:0/3654851388 conn(0x7ff1780748d0 msgr2=0x7ff1780b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:24.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 shutdown_connections 2024-09-21T06:14:24.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:24.762+0000 7ff17e400640 1 -- 172.21.15.118:0/3654851388 wait complete. 2024-09-21T06:14:24.786 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 -- 172.21.15.118:0/2830548043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c075580 msgr2=0x7f839c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 --2- 172.21.15.118:0/2830548043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c075580 0x7f839c0cd8c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8388009830 tx=0x7f838802a490 comp rx=0 tx=0).stop 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 -- 172.21.15.118:0/2830548043 shutdown_connections 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 --2- 172.21.15.118:0/2830548043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c075580 0x7f839c0cd8c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 --2- 172.21.15.118:0/2830548043 >> v2:172.21.15.149:3300/0 conn(0x7f839c0b6950 0x7f839c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 -- 172.21.15.118:0/2830548043 >> 172.21.15.118:0/2830548043 conn(0x7f839c0748d0 msgr2=0x7f839c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 -- 172.21.15.118:0/2830548043 shutdown_connections 2024-09-21T06:14:25.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.012+0000 7f83a1800640 1 -- 172.21.15.118:0/2830548043 wait complete. 2024-09-21T06:14:25.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.014+0000 7f83a1800640 1 Processor -- start 2024-09-21T06:14:25.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.014+0000 7f83a1800640 1 -- start start 2024-09-21T06:14:25.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f83a1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c075580 0x7f839c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:25.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f83a1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c0b6950 0x7f839c1e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:25.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f83a1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c0cde00 0x7f839c1e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f83a1800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0cc060 con 0x7f839c075580 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f83a1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0ce4d0 con 0x7f839c0b6950 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f83a1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0cc1e0 con 0x7f839c0cde00 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f839aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c075580 0x7f839c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f839aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c075580 0x7f839c1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53760/0 (socket says 172.21.15.118:53760) 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f839aa00640 1 -- 172.21.15.118:0/1359851633 learned_addr learned my addr 172.21.15.118:0/1359851633 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f839a000640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c0b6950 0x7f839c1e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.016+0000 7f839b400640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c0cde00 0x7f839c1e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:25.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f839aa00640 1 -- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c0cde00 msgr2=0x7f839c1e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f839aa00640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c0cde00 0x7f839c1e62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f839aa00640 1 -- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c0b6950 msgr2=0x7f839c1e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f839aa00640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c0b6950 0x7f839c1e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f839aa00640 1 -- 172.21.15.118:0/1359851633 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c1f95d0 con 0x7f839c075580 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f839b400640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c0cde00 0x7f839c1e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f839aa00640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c075580 0x7f839c1593d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f838c00ea20 tx=0x7f838c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f8392a00640 1 -- 172.21.15.118:0/1359851633 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c00ce40 con 0x7f839c075580 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f8392a00640 1 -- 172.21.15.118:0/1359851633 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f838c004020 con 0x7f839c075580 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c159910 con 0x7f839c075580 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f8392a00640 1 -- 172.21.15.118:0/1359851633 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c004470 con 0x7f839c075580 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.017+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1f9db0 con 0x7f839c075580 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.018+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c0cc690 con 0x7f839c075580 2024-09-21T06:14:25.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.019+0000 7f8392a00640 1 -- 172.21.15.118:0/1359851633 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f838c0035f0 con 0x7f839c075580 2024-09-21T06:14:25.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.021+0000 7f8392a00640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f837c078bc0 0x7f837c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:25.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.021+0000 7f8392a00640 1 -- 172.21.15.118:0/1359851633 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f838c09b740 con 0x7f839c075580 2024-09-21T06:14:25.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.022+0000 7f839a000640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f837c078bc0 0x7f837c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:25.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.022+0000 7f839a000640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f837c078bc0 0x7f837c07b0d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8388034000 tx=0x7f8388004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:25.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.026+0000 7f8392a00640 1 -- 172.21.15.118:0/1359851633 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f838c063ae0 con 0x7f839c075580 2024-09-21T06:14:25.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.253+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f839c071380 con 0x7f839c075580 2024-09-21T06:14:25.819 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:14:25.818+0000 7f28cfe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:14:25.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.870+0000 7f8392a00640 1 -- 172.21.15.118:0/1359851633 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) ==== 118+0+0 (secure 0 0 0) 0x7f838c0633e0 con 0x7f839c075580 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f837c078bc0 msgr2=0x7f837c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f837c078bc0 0x7f837c07b0d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8388034000 tx=0x7f8388004730 comp rx=0 tx=0).stop 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c075580 msgr2=0x7f839c1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c075580 0x7f839c1593d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f838c00ea20 tx=0x7f838c00eee0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 shutdown_connections 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f837c078bc0 0x7f837c07b0d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f839c0cde00 0x7f839c1e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f839c0b6950 0x7f839c1e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 --2- 172.21.15.118:0/1359851633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f839c075580 0x7f839c1593d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:25.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.873+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 >> 172.21.15.118:0/1359851633 conn(0x7f839c0748d0 msgr2=0x7f839c070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:25.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.874+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 shutdown_connections 2024-09-21T06:14:25.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:25.874+0000 7f83a1800640 1 -- 172.21.15.118:0/1359851633 wait complete. 2024-09-21T06:14:25.900 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:14:25.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:14:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.126+0000 7f9fe4600640 1 -- 172.21.15.118:0/2429076213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 msgr2=0x7f9fc4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.126+0000 7f9fe4600640 1 --2- 172.21.15.118:0/2429076213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 0x7f9fc4003e70 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009ed0 tx=0x7f9fc4005830 comp rx=0 tx=0).stop 2024-09-21T06:14:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.126+0000 7f9fe2600640 1 -- 172.21.15.118:0/2429076213 reap_dead start 2024-09-21T06:14:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.126+0000 7f9fe4600640 1 -- 172.21.15.118:0/2429076213 shutdown_connections 2024-09-21T06:14:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.126+0000 7f9fe4600640 1 -- 172.21.15.118:0/2429076213 >> 172.21.15.118:0/2429076213 conn(0x7f9fdc06d110 msgr2=0x7f9fdc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.126+0000 7f9fe4600640 1 -- 172.21.15.118:0/2429076213 shutdown_connections 2024-09-21T06:14:26.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.126+0000 7f9fe4600640 1 -- 172.21.15.118:0/2429076213 wait complete. 2024-09-21T06:14:26.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.128+0000 7f9fe4600640 1 Processor -- start 2024-09-21T06:14:26.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.128+0000 7f9fe4600640 1 -- start start 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe4600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 0x7f9fdc156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe4600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fdc15c8e0 0x7f9fdc1e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe4600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fdc1e7fe0 0x7f9fdc072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe4600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0cf5d0 con 0x7f9fc4003a00 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe4600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0cf450 con 0x7f9fdc15c8e0 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe4600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc0cf750 con 0x7f9fdc1e7fe0 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe1c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 0x7f9fdc156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe1c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 0x7f9fdc156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42914/0 (socket says 172.21.15.118:42914) 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.130+0000 7f9fe1c00640 1 -- 172.21.15.118:0/2156294639 learned_addr learned my addr 172.21.15.118:0/2156294639 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1c00640 1 -- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fdc1e7fe0 msgr2=0x7f9fdc072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1200640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fdc15c8e0 0x7f9fdc1e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:26.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1c00640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fdc1e7fe0 0x7f9fdc072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1c00640 1 -- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fdc15c8e0 msgr2=0x7f9fdc1e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1c00640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fdc15c8e0 0x7f9fdc1e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1c00640 1 -- 172.21.15.118:0/2156294639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc13e2d0 con 0x7f9fc4003a00 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1200640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fdc15c8e0 0x7f9fdc1e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe1c00640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 0x7f9fdc156550 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0036040 tx=0x7f9fd0033c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fd9600640 1 -- 172.21.15.118:0/2156294639 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0043070 con 0x7f9fc4003a00 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fd9600640 1 -- 172.21.15.118:0/2156294639 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fd0033db0 con 0x7f9fc4003a00 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fd9600640 1 -- 172.21.15.118:0/2156294639 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0038040 con 0x7f9fc4003a00 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc13e5b0 con 0x7f9fc4003a00 2024-09-21T06:14:26.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.131+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc13dfa0 con 0x7f9fc4003a00 2024-09-21T06:14:26.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.132+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc0d12f0 con 0x7f9fc4003a00 2024-09-21T06:14:26.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.134+0000 7f9fd9600640 1 -- 172.21.15.118:0/2156294639 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9fd0046070 con 0x7f9fc4003a00 2024-09-21T06:14:26.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.135+0000 7f9fd9600640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9fbc078b90 0x7f9fbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.135+0000 7f9fd9600640 1 -- 172.21.15.118:0/2156294639 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd00bbc30 con 0x7f9fc4003a00 2024-09-21T06:14:26.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.135+0000 7f9fe1200640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9fbc078b90 0x7f9fbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:26.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.136+0000 7f9fe1200640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9fbc078b90 0x7f9fbc07b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc13f260 tx=0x7f9fc8005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:26.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.138+0000 7f9fd9600640 1 -- 172.21.15.118:0/2156294639 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9fd004d020 con 0x7f9fc4003a00 2024-09-21T06:14:26.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.363+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9fdc15f1e0 con 0x7f9fc4003a00 2024-09-21T06:14:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.878+0000 7f9fd9600640 1 -- 172.21.15.118:0/2156294639 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) ==== 122+0+0 (secure 0 0 0) 0x7f9fd0083a00 con 0x7f9fc4003a00 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9fbc078b90 msgr2=0x7f9fbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9fbc078b90 0x7f9fbc07b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc13f260 tx=0x7f9fc8005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 msgr2=0x7f9fdc156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 0x7f9fdc156550 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0036040 tx=0x7f9fd0033c40 comp rx=0 tx=0).stop 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 shutdown_connections 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9fbc078b90 0x7f9fbc07b0a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fdc1e7fe0 0x7f9fdc072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fdc15c8e0 0x7f9fdc1e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 --2- 172.21.15.118:0/2156294639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fc4003a00 0x7f9fdc156550 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 >> 172.21.15.118:0/2156294639 conn(0x7f9fdc06d110 msgr2=0x7f9fdc153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 shutdown_connections 2024-09-21T06:14:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:26.880+0000 7f9fe4600640 1 -- 172.21.15.118:0/2156294639 wait complete. 2024-09-21T06:14:26.904 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:14:26.904 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:27.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.126+0000 7f6747600640 1 -- 172.21.15.118:0/3978828856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728003a30 msgr2=0x7f6728003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.126+0000 7f6747600640 1 --2- 172.21.15.118:0/3978828856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6728003a30 0x7f6728003ea0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6734009b50 tx=0x7f6728005830 comp rx=0 tx=0).stop 2024-09-21T06:14:27.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.126+0000 7f6745600640 1 -- 172.21.15.118:0/3978828856 reap_dead start 2024-09-21T06:14:27.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.126+0000 7f6747600640 1 -- 172.21.15.118:0/3978828856 shutdown_connections 2024-09-21T06:14:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.126+0000 7f6747600640 1 -- 172.21.15.118:0/3978828856 >> 172.21.15.118:0/3978828856 conn(0x7f674006d110 msgr2=0x7f674006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.126+0000 7f6747600640 1 -- 172.21.15.118:0/3978828856 shutdown_connections 2024-09-21T06:14:27.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.126+0000 7f6747600640 1 -- 172.21.15.118:0/3978828856 wait complete. 2024-09-21T06:14:27.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.128+0000 7f6747600640 1 Processor -- start 2024-09-21T06:14:27.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.128+0000 7f6747600640 1 -- start start 2024-09-21T06:14:27.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.129+0000 7f6747600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6728003a30 0x7f6740159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.129+0000 7f6747600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6740151f10 0x7f67400b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.129+0000 7f6747600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6740152320 0x7f67400b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.129+0000 7f6747600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6740163950 con 0x7f6740151f10 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.129+0000 7f6747600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f67401637d0 con 0x7f6728003a30 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f6747600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6740156510 con 0x7f6740152320 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6740151f10 0x7f67400b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6740151f10 0x7f67400b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42928/0 (socket says 172.21.15.118:42928) 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 -- 172.21.15.118:0/2974515942 learned_addr learned my addr 172.21.15.118:0/2974515942 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f6744c00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6728003a30 0x7f6740159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 -- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6740152320 msgr2=0x7f67400b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f6745600640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6740152320 0x7f67400b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6740152320 0x7f67400b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 -- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6728003a30 msgr2=0x7f6740159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6728003a30 0x7f6740159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f673fe00640 1 -- 172.21.15.118:0/2974515942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67401f6110 con 0x7f6740151f10 2024-09-21T06:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.130+0000 7f6744c00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6728003a30 0x7f6740159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:27.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.131+0000 7f673fe00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6740151f10 0x7f67400b26e0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f672c003f80 tx=0x7f672c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:27.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.131+0000 7f673cc00640 1 -- 172.21.15.118:0/2974515942 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c015070 con 0x7f6740151f10 2024-09-21T06:14:27.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.131+0000 7f673cc00640 1 -- 172.21.15.118:0/2974515942 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f672c011900 con 0x7f6740151f10 2024-09-21T06:14:27.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.131+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67401f63f0 con 0x7f6740151f10 2024-09-21T06:14:27.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.131+0000 7f673cc00640 1 -- 172.21.15.118:0/2974515942 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c011d10 con 0x7f6740151f10 2024-09-21T06:14:27.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.131+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67401f69b0 con 0x7f6740151f10 2024-09-21T06:14:27.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.132+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67400af900 con 0x7f6740151f10 2024-09-21T06:14:27.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.133+0000 7f673cc00640 1 -- 172.21.15.118:0/2974515942 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f672c018070 con 0x7f6740151f10 2024-09-21T06:14:27.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.134+0000 7f673cc00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6720078b90 0x7f672007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.134+0000 7f673cc00640 1 -- 172.21.15.118:0/2974515942 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f672c09bb10 con 0x7f6740151f10 2024-09-21T06:14:27.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.135+0000 7f6744c00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6720078b90 0x7f672007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.136+0000 7f6744c00640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6720078b90 0x7f672007b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6734035000 tx=0x7f673402d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:27.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.139+0000 7f673cc00640 1 -- 172.21.15.118:0/2974515942 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f672c063eb0 con 0x7f6740151f10 2024-09-21T06:14:27.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.362+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67401f5ea0 con 0x7f6740151f10 2024-09-21T06:14:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.363+0000 7f673cc00640 1 -- 172.21.15.118:0/2974515942 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5239 (secure 0 0 0) 0x7f672c0637b0 con 0x7f6740151f10 2024-09-21T06:14:27.364 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:27.364 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"btime":"2024-09-21T06:14:26:871516+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:14:23.335795+0000","modified":"2024-09-21T06:14:26.364763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4151315485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4151315485},{"type":"v1","addr":"172.21.15.118:6835","nonce":4151315485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7806,"qdb_cluster":[7806]},"id":10}]} 2024-09-21T06:14:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 86 2024-09-21T06:14:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6720078b90 msgr2=0x7f672007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6720078b90 0x7f672007b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6734035000 tx=0x7f673402d040 comp rx=0 tx=0).stop 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6740151f10 msgr2=0x7f67400b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6740151f10 0x7f67400b26e0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f672c003f80 tx=0x7f672c0016f0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 shutdown_connections 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6720078b90 0x7f672007b0a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6740152320 0x7f67400b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6740151f10 0x7f67400b26e0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 --2- 172.21.15.118:0/2974515942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6728003a30 0x7f6740159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 >> 172.21.15.118:0/2974515942 conn(0x7f674006d110 msgr2=0x7f674006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 shutdown_connections 2024-09-21T06:14:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.365+0000 7f6747600640 1 -- 172.21.15.118:0/2974515942 wait complete. 2024-09-21T06:14:27.389 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:14:27.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.609+0000 7f5b37200640 1 -- 172.21.15.118:0/1414391283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b3013fae0 msgr2=0x7f5b300d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.609+0000 7f5b37200640 1 --2- 172.21.15.118:0/1414391283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b3013fae0 0x7f5b300d0e80 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f5b300ce7c0 tx=0x7f5b2002a560 comp rx=0 tx=0).stop 2024-09-21T06:14:27.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.609+0000 7f5b37200640 1 -- 172.21.15.118:0/1414391283 shutdown_connections 2024-09-21T06:14:27.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.609+0000 7f5b37200640 1 --2- 172.21.15.118:0/1414391283 >> v2:172.21.15.149:3300/0 conn(0x7f5b30142e40 0x7f5b300d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.609+0000 7f5b37200640 1 --2- 172.21.15.118:0/1414391283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b3013fae0 0x7f5b300d0e80 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.609+0000 7f5b37200640 1 -- 172.21.15.118:0/1414391283 >> 172.21.15.118:0/1414391283 conn(0x7f5b3006d110 msgr2=0x7f5b3006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:27.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.610+0000 7f5b37200640 1 -- 172.21.15.118:0/1414391283 shutdown_connections 2024-09-21T06:14:27.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.610+0000 7f5b37200640 1 -- 172.21.15.118:0/1414391283 wait complete. 2024-09-21T06:14:27.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.612+0000 7f5b37200640 1 Processor -- start 2024-09-21T06:14:27.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.612+0000 7f5b37200640 1 -- start start 2024-09-21T06:14:27.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.613+0000 7f5b37200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3013fae0 0x7f5b30141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.613+0000 7f5b37200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3013fef0 0x7f5b301f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.613+0000 7f5b37200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b30142e40 0x7f5b300b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.613+0000 7f5b37200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5b300cfa70 con 0x7f5b30142e40 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.613+0000 7f5b37200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b300cf8f0 con 0x7f5b3013fae0 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.613+0000 7f5b37200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b300cfbf0 con 0x7f5b3013fef0 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b30142e40 0x7f5b300b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b30142e40 0x7f5b300b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42948/0 (socket says 172.21.15.118:42948) 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 -- 172.21.15.118:0/1218545556 learned_addr learned my addr 172.21.15.118:0/1218545556 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b2f400640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3013fef0 0x7f5b301f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b2fe00640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3013fae0 0x7f5b30141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 -- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3013fef0 msgr2=0x7f5b301f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3013fef0 0x7f5b301f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 -- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3013fae0 msgr2=0x7f5b30141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3013fae0 0x7f5b30141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 -- 172.21.15.118:0/1218545556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b300b5a40 con 0x7f5b30142e40 2024-09-21T06:14:27.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.614+0000 7f5b35200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b30142e40 0x7f5b300b4ab0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800e960 tx=0x7f5b2800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:27.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.615+0000 7f5b27e00640 1 -- 172.21.15.118:0/1218545556 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28004d20 con 0x7f5b30142e40 2024-09-21T06:14:27.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.615+0000 7f5b27e00640 1 -- 172.21.15.118:0/1218545556 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b2800cb20 con 0x7f5b30142e40 2024-09-21T06:14:27.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.615+0000 7f5b27e00640 1 -- 172.21.15.118:0/1218545556 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28005020 con 0x7f5b30142e40 2024-09-21T06:14:27.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.615+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b301f4000 con 0x7f5b30142e40 2024-09-21T06:14:27.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.615+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b301f42c0 con 0x7f5b30142e40 2024-09-21T06:14:27.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.616+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b30155c60 con 0x7f5b30142e40 2024-09-21T06:14:27.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.617+0000 7f5b27e00640 1 -- 172.21.15.118:0/1218545556 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b280051c0 con 0x7f5b30142e40 2024-09-21T06:14:27.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.618+0000 7f5b27e00640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b10078bc0 0x7f5b1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:27.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.618+0000 7f5b27e00640 1 -- 172.21.15.118:0/1218545556 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f5b2809b510 con 0x7f5b30142e40 2024-09-21T06:14:27.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.619+0000 7f5b2fe00640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b10078bc0 0x7f5b1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:27.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.620+0000 7f5b2fe00640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b10078bc0 0x7f5b1007b0d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5b20033000 tx=0x7f5b20004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:27.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.623+0000 7f5b27e00640 1 -- 172.21.15.118:0/1218545556 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5b28016030 con 0x7f5b30142e40 2024-09-21T06:14:27.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.808+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b300d0110 con 0x7f5b30142e40 2024-09-21T06:14:27.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.809+0000 7f5b27e00640 1 -- 172.21.15.118:0/1218545556 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) ==== 74+0+16812 (secure 0 0 0) 0x7f5b28063a70 con 0x7f5b30142e40 2024-09-21T06:14:27.811 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:27.811 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":162,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:14:24.837675+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:14:21.294124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T06:14:22.303766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:14:27.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.811+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b10078bc0 msgr2=0x7f5b1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b10078bc0 0x7f5b1007b0d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5b20033000 tx=0x7f5b20004730 comp rx=0 tx=0).stop 2024-09-21T06:14:27.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b30142e40 msgr2=0x7f5b300b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:27.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b30142e40 0x7f5b300b4ab0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800e960 tx=0x7f5b2800ee20 comp rx=0 tx=0).stop 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 shutdown_connections 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b30142e40 0x7f5b300b4ab0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b10078bc0 0x7f5b1007b0d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3013fef0 0x7f5b301f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 --2- 172.21.15.118:0/1218545556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3013fae0 0x7f5b30141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 >> 172.21.15.118:0/1218545556 conn(0x7f5b3006d110 msgr2=0x7f5b301609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 shutdown_connections 2024-09-21T06:14:27.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:27.812+0000 7f5b37200640 1 -- 172.21.15.118:0/1218545556 wait complete. 2024-09-21T06:14:27.835 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:14:27.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:14:28.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.056+0000 7f6ed9c00640 1 -- 172.21.15.118:0/4037164179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6eb8004d90 msgr2=0x7f6eb8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.056+0000 7f6ed9c00640 1 --2- 172.21.15.118:0/4037164179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6eb8004d90 0x7f6eb8005220 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc005fd0 tx=0x7f6eb8005830 comp rx=0 tx=0).stop 2024-09-21T06:14:28.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.056+0000 7f6ed3400640 1 -- 172.21.15.118:0/4037164179 reap_dead start 2024-09-21T06:14:28.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.056+0000 7f6ed9c00640 1 -- 172.21.15.118:0/4037164179 shutdown_connections 2024-09-21T06:14:28.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.056+0000 7f6ed9c00640 1 -- 172.21.15.118:0/4037164179 >> 172.21.15.118:0/4037164179 conn(0x7f6ed406d110 msgr2=0x7f6ed406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:28.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.056+0000 7f6ed9c00640 1 -- 172.21.15.118:0/4037164179 shutdown_connections 2024-09-21T06:14:28.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.056+0000 7f6ed9c00640 1 -- 172.21.15.118:0/4037164179 wait complete. 2024-09-21T06:14:28.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.059+0000 7f6ed9c00640 1 Processor -- start 2024-09-21T06:14:28.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.059+0000 7f6ed9c00640 1 -- start start 2024-09-21T06:14:28.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6ed9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eb8004d90 0x7f6ed4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6ed9c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ed41f9e50 0x7f6ed413b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6ed9c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ed413e940 0x7f6ed413ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6ed9c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4165d00 con 0x7f6ed41f9e50 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6ed9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4165b80 con 0x7f6eb8004d90 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6ed9c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed4165e80 con 0x7f6ed413e940 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6eca000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ed41f9e50 0x7f6ed413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6eca000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ed41f9e50 0x7f6ed413b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42966/0 (socket says 172.21.15.118:42966) 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.060+0000 7f6ed2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eb8004d90 0x7f6ed4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6eca000640 1 -- 172.21.15.118:0/1785397673 learned_addr learned my addr 172.21.15.118:0/1785397673 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6ed3400640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ed413e940 0x7f6ed413ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6eca000640 1 -- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ed413e940 msgr2=0x7f6ed413ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6eca000640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ed413e940 0x7f6ed413ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6eca000640 1 -- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eb8004d90 msgr2=0x7f6ed4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6eca000640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eb8004d90 0x7f6ed4155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6eca000640 1 -- 172.21.15.118:0/1785397673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed4153fb0 con 0x7f6ed41f9e50 2024-09-21T06:14:28.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6ed2a00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eb8004d90 0x7f6ed4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:28.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.061+0000 7f6eca000640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ed41f9e50 0x7f6ed413b750 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc006630 tx=0x7f6ebc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:28.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.062+0000 7f6ecb400640 1 -- 172.21.15.118:0/1785397673 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc015070 con 0x7f6ed41f9e50 2024-09-21T06:14:28.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.062+0000 7f6ecb400640 1 -- 172.21.15.118:0/1785397673 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ebc011900 con 0x7f6ed41f9e50 2024-09-21T06:14:28.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.062+0000 7f6ecb400640 1 -- 172.21.15.118:0/1785397673 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc011d30 con 0x7f6ed41f9e50 2024-09-21T06:14:28.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.062+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed413c480 con 0x7f6ed41f9e50 2024-09-21T06:14:28.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.062+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed413e140 con 0x7f6ed41f9e50 2024-09-21T06:14:28.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.063+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed413c1f0 con 0x7f6ed41f9e50 2024-09-21T06:14:28.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.064+0000 7f6ecb400640 1 -- 172.21.15.118:0/1785397673 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ebc018070 con 0x7f6ed41f9e50 2024-09-21T06:14:28.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.065+0000 7f6ecb400640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6eb0078b90 0x7f6eb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.065+0000 7f6ecb400640 1 -- 172.21.15.118:0/1785397673 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f6ebc09ba90 con 0x7f6ed41f9e50 2024-09-21T06:14:28.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.066+0000 7f6ed2a00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6eb0078b90 0x7f6eb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.066+0000 7f6ed2a00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6eb0078b90 0x7f6eb007b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4006fd0 tx=0x7f6ec4006b10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:28.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.069+0000 7f6ecb400640 1 -- 172.21.15.118:0/1785397673 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6ebc0637f0 con 0x7f6ed41f9e50 2024-09-21T06:14:28.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.251+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ed4142730 con 0x7f6eb0078b90 2024-09-21T06:14:28.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.257+0000 7f6ecb400640 1 -- 172.21.15.118:0/1785397673 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247972 (secure 0 0 0) 0x7f6ed4142730 con 0x7f6eb0078b90 2024-09-21T06:14:28.261 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:28.262 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6eb0078b90 msgr2=0x7f6eb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6eb0078b90 0x7f6eb007b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4006fd0 tx=0x7f6ec4006b10 comp rx=0 tx=0).stop 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ed41f9e50 msgr2=0x7f6ed413b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ed41f9e50 0x7f6ed413b750 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc006630 tx=0x7f6ebc0039c0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 shutdown_connections 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6eb0078b90 0x7f6eb007b0a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ed413e940 0x7f6ed413ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ed41f9e50 0x7f6ed413b750 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 --2- 172.21.15.118:0/1785397673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6eb8004d90 0x7f6ed4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 >> 172.21.15.118:0/1785397673 conn(0x7f6ed406d110 msgr2=0x7f6ed415f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 shutdown_connections 2024-09-21T06:14:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.261+0000 7f6ed9c00640 1 -- 172.21.15.118:0/1785397673 wait complete. 2024-09-21T06:14:28.284 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-09-21T06:14:26.628468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554329,"statfs":{"total":1600000000,"available":1591633162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.799227"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857101+0000","last_change":"2024-09-21T06:14:23.855851+0000","last_active":"2024-09-21T06:14:23.857101+0000","last_peered":"2024-09-21T06:14:23.857101+0000","last_clean":"2024-09-21T06:14:23.857101+0000","last_became_active":"2024-09-21T06:14:23.855625+0000","last_became_peered":"2024-09-21T06:14:23.855625+0000","last_unstale":"2024-09-21T06:14:23.857101+0000","last_undegraded":"2024-09-21T06:14:23.857101+0000","last_fullsized":"2024-09-21T06:14:23.857101+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:32.861003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840631+0000","last_change":"2024-09-21T06:14:23.849725+0000","last_active":"2024-09-21T06:14:24.840631+0000","last_peered":"2024-09-21T06:14:24.840631+0000","last_clean":"2024-09-21T06:14:24.840631+0000","last_became_active":"2024-09-21T06:14:23.849428+0000","last_became_peered":"2024-09-21T06:14:23.849428+0000","last_unstale":"2024-09-21T06:14:24.840631+0000","last_undegraded":"2024-09-21T06:14:24.840631+0000","last_fullsized":"2024-09-21T06:14:24.840631+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:48.102912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.859175+0000","last_change":"2024-09-21T06:14:23.858737+0000","last_active":"2024-09-21T06:14:23.859175+0000","last_peered":"2024-09-21T06:14:23.859175+0000","last_clean":"2024-09-21T06:14:23.859175+0000","last_became_active":"2024-09-21T06:14:23.857894+0000","last_became_peered":"2024-09-21T06:14:23.857894+0000","last_unstale":"2024-09-21T06:14:23.859175+0000","last_undegraded":"2024-09-21T06:14:23.859175+0000","last_fullsized":"2024-09-21T06:14:23.859175+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:21.677546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.848744+0000","last_change":"2024-09-21T06:14:23.848398+0000","last_active":"2024-09-21T06:14:23.848744+0000","last_peered":"2024-09-21T06:14:23.848744+0000","last_clean":"2024-09-21T06:14:23.848744+0000","last_became_active":"2024-09-21T06:14:23.848003+0000","last_became_peered":"2024-09-21T06:14:23.848003+0000","last_unstale":"2024-09-21T06:14:23.848744+0000","last_undegraded":"2024-09-21T06:14:23.848744+0000","last_fullsized":"2024-09-21T06:14:23.848744+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:07.849129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854866+0000","last_change":"2024-09-21T06:14:23.852619+0000","last_active":"2024-09-21T06:14:23.854866+0000","last_peered":"2024-09-21T06:14:23.854866+0000","last_clean":"2024-09-21T06:14:23.854866+0000","last_became_active":"2024-09-21T06:14:23.852063+0000","last_became_peered":"2024-09-21T06:14:23.852063+0000","last_unstale":"2024-09-21T06:14:23.854866+0000","last_undegraded":"2024-09-21T06:14:23.854866+0000","last_fullsized":"2024-09-21T06:14:23.854866+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:06.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865575+0000","last_change":"2024-09-21T06:14:23.865048+0000","last_active":"2024-09-21T06:14:23.865575+0000","last_peered":"2024-09-21T06:14:23.865575+0000","last_clean":"2024-09-21T06:14:23.865575+0000","last_became_active":"2024-09-21T06:14:23.864076+0000","last_became_peered":"2024-09-21T06:14:23.864076+0000","last_unstale":"2024-09-21T06:14:23.865575+0000","last_undegraded":"2024-09-21T06:14:23.865575+0000","last_fullsized":"2024-09-21T06:14:23.865575+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:29.714800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863916+0000","last_change":"2024-09-21T06:14:23.861215+0000","last_active":"2024-09-21T06:14:23.863916+0000","last_peered":"2024-09-21T06:14:23.863916+0000","last_clean":"2024-09-21T06:14:23.863916+0000","last_became_active":"2024-09-21T06:14:23.860942+0000","last_became_peered":"2024-09-21T06:14:23.860942+0000","last_unstale":"2024-09-21T06:14:23.863916+0000","last_undegraded":"2024-09-21T06:14:23.863916+0000","last_fullsized":"2024-09-21T06:14:23.863916+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:43.436611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.855789+0000","last_change":"2024-09-21T06:14:23.855601+0000","last_active":"2024-09-21T06:14:23.855789+0000","last_peered":"2024-09-21T06:14:23.855789+0000","last_clean":"2024-09-21T06:14:23.855789+0000","last_became_active":"2024-09-21T06:14:23.855333+0000","last_became_peered":"2024-09-21T06:14:23.855333+0000","last_unstale":"2024-09-21T06:14:23.855789+0000","last_undegraded":"2024-09-21T06:14:23.855789+0000","last_fullsized":"2024-09-21T06:14:23.855789+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:22.140196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840625+0000","last_change":"2024-09-21T06:14:23.852442+0000","last_active":"2024-09-21T06:14:24.840625+0000","last_peered":"2024-09-21T06:14:24.840625+0000","last_clean":"2024-09-21T06:14:24.840625+0000","last_became_active":"2024-09-21T06:14:23.852188+0000","last_became_peered":"2024-09-21T06:14:23.852188+0000","last_unstale":"2024-09-21T06:14:24.840625+0000","last_undegraded":"2024-09-21T06:14:24.840625+0000","last_fullsized":"2024-09-21T06:14:24.840625+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:04.409806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.849966+0000","last_change":"2024-09-21T06:14:23.849668+0000","last_active":"2024-09-21T06:14:23.849966+0000","last_peered":"2024-09-21T06:14:23.849966+0000","last_clean":"2024-09-21T06:14:23.849966+0000","last_became_active":"2024-09-21T06:14:23.849295+0000","last_became_peered":"2024-09-21T06:14:23.849295+0000","last_unstale":"2024-09-21T06:14:23.849966+0000","last_undegraded":"2024-09-21T06:14:23.849966+0000","last_fullsized":"2024-09-21T06:14:23.849966+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:01.465969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.858742+0000","last_change":"2024-09-21T06:14:23.858423+0000","last_active":"2024-09-21T06:14:23.858742+0000","last_peered":"2024-09-21T06:14:23.858742+0000","last_clean":"2024-09-21T06:14:23.858742+0000","last_became_active":"2024-09-21T06:14:23.858180+0000","last_became_peered":"2024-09-21T06:14:23.858180+0000","last_unstale":"2024-09-21T06:14:23.858742+0000","last_undegraded":"2024-09-21T06:14:23.858742+0000","last_fullsized":"2024-09-21T06:14:23.858742+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:13.636158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857034+0000","last_change":"2024-09-21T06:14:23.855885+0000","last_active":"2024-09-21T06:14:23.857034+0000","last_peered":"2024-09-21T06:14:23.857034+0000","last_clean":"2024-09-21T06:14:23.857034+0000","last_became_active":"2024-09-21T06:14:23.855620+0000","last_became_peered":"2024-09-21T06:14:23.855620+0000","last_unstale":"2024-09-21T06:14:23.857034+0000","last_undegraded":"2024-09-21T06:14:23.857034+0000","last_fullsized":"2024-09-21T06:14:23.857034+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:40.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854962+0000","last_change":"2024-09-21T06:14:23.854529+0000","last_active":"2024-09-21T06:14:23.854962+0000","last_peered":"2024-09-21T06:14:23.854962+0000","last_clean":"2024-09-21T06:14:23.854962+0000","last_became_active":"2024-09-21T06:14:23.853231+0000","last_became_peered":"2024-09-21T06:14:23.853231+0000","last_unstale":"2024-09-21T06:14:23.854962+0000","last_undegraded":"2024-09-21T06:14:23.854962+0000","last_fullsized":"2024-09-21T06:14:23.854962+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:38.614363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847359+0000","last_change":"2024-09-21T06:14:23.846538+0000","last_active":"2024-09-21T06:14:23.847359+0000","last_peered":"2024-09-21T06:14:23.847359+0000","last_clean":"2024-09-21T06:14:23.847359+0000","last_became_active":"2024-09-21T06:14:23.846263+0000","last_became_peered":"2024-09-21T06:14:23.846263+0000","last_unstale":"2024-09-21T06:14:23.847359+0000","last_undegraded":"2024-09-21T06:14:23.847359+0000","last_fullsized":"2024-09-21T06:14:23.847359+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:17.580496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853704+0000","last_change":"2024-09-21T06:14:23.853041+0000","last_active":"2024-09-21T06:14:23.853704+0000","last_peered":"2024-09-21T06:14:23.853704+0000","last_clean":"2024-09-21T06:14:23.853704+0000","last_became_active":"2024-09-21T06:14:23.852206+0000","last_became_peered":"2024-09-21T06:14:23.852206+0000","last_unstale":"2024-09-21T06:14:23.853704+0000","last_undegraded":"2024-09-21T06:14:23.853704+0000","last_fullsized":"2024-09-21T06:14:23.853704+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:20.324412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861426+0000","last_change":"2024-09-21T06:14:23.861051+0000","last_active":"2024-09-21T06:14:23.861426+0000","last_peered":"2024-09-21T06:14:23.861426+0000","last_clean":"2024-09-21T06:14:23.861426+0000","last_became_active":"2024-09-21T06:14:23.860804+0000","last_became_peered":"2024-09-21T06:14:23.860804+0000","last_unstale":"2024-09-21T06:14:23.861426+0000","last_undegraded":"2024-09-21T06:14:23.861426+0000","last_fullsized":"2024-09-21T06:14:23.861426+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:40.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851166+0000","last_change":"2024-09-21T06:14:23.850519+0000","last_active":"2024-09-21T06:14:23.851166+0000","last_peered":"2024-09-21T06:14:23.851166+0000","last_clean":"2024-09-21T06:14:23.851166+0000","last_became_active":"2024-09-21T06:14:23.850182+0000","last_became_peered":"2024-09-21T06:14:23.850182+0000","last_unstale":"2024-09-21T06:14:23.851166+0000","last_undegraded":"2024-09-21T06:14:23.851166+0000","last_fullsized":"2024-09-21T06:14:23.851166+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:20.340562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.860268+0000","last_change":"2024-09-21T06:14:23.859089+0000","last_active":"2024-09-21T06:14:23.860268+0000","last_peered":"2024-09-21T06:14:23.860268+0000","last_clean":"2024-09-21T06:14:23.860268+0000","last_became_active":"2024-09-21T06:14:23.858475+0000","last_became_peered":"2024-09-21T06:14:23.858475+0000","last_unstale":"2024-09-21T06:14:23.860268+0000","last_undegraded":"2024-09-21T06:14:23.860268+0000","last_fullsized":"2024-09-21T06:14:23.860268+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:04.835607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857126+0000","last_change":"2024-09-21T06:14:23.856374+0000","last_active":"2024-09-21T06:14:23.857126+0000","last_peered":"2024-09-21T06:14:23.857126+0000","last_clean":"2024-09-21T06:14:23.857126+0000","last_became_active":"2024-09-21T06:14:23.853797+0000","last_became_peered":"2024-09-21T06:14:23.853797+0000","last_unstale":"2024-09-21T06:14:23.857126+0000","last_undegraded":"2024-09-21T06:14:23.857126+0000","last_fullsized":"2024-09-21T06:14:23.857126+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:28.333693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.852147+0000","last_change":"2024-09-21T06:14:23.851405+0000","last_active":"2024-09-21T06:14:23.852147+0000","last_peered":"2024-09-21T06:14:23.852147+0000","last_clean":"2024-09-21T06:14:23.852147+0000","last_became_active":"2024-09-21T06:14:23.850581+0000","last_became_peered":"2024-09-21T06:14:23.850581+0000","last_unstale":"2024-09-21T06:14:23.852147+0000","last_undegraded":"2024-09-21T06:14:23.852147+0000","last_fullsized":"2024-09-21T06:14:23.852147+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:18.614200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.849229+0000","last_change":"2024-09-21T06:14:23.849021+0000","last_active":"2024-09-21T06:14:23.849229+0000","last_peered":"2024-09-21T06:14:23.849229+0000","last_clean":"2024-09-21T06:14:23.849229+0000","last_became_active":"2024-09-21T06:14:23.848391+0000","last_became_peered":"2024-09-21T06:14:23.848391+0000","last_unstale":"2024-09-21T06:14:23.849229+0000","last_undegraded":"2024-09-21T06:14:23.849229+0000","last_fullsized":"2024-09-21T06:14:23.849229+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:13.337812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847318+0000","last_change":"2024-09-21T06:14:23.846102+0000","last_active":"2024-09-21T06:14:23.847318+0000","last_peered":"2024-09-21T06:14:23.847318+0000","last_clean":"2024-09-21T06:14:23.847318+0000","last_became_active":"2024-09-21T06:14:23.845844+0000","last_became_peered":"2024-09-21T06:14:23.845844+0000","last_unstale":"2024-09-21T06:14:23.847318+0000","last_undegraded":"2024-09-21T06:14:23.847318+0000","last_fullsized":"2024-09-21T06:14:23.847318+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:25.510672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851864+0000","last_change":"2024-09-21T06:14:23.851660+0000","last_active":"2024-09-21T06:14:23.851864+0000","last_peered":"2024-09-21T06:14:23.851864+0000","last_clean":"2024-09-21T06:14:23.851864+0000","last_became_active":"2024-09-21T06:14:23.851243+0000","last_became_peered":"2024-09-21T06:14:23.851243+0000","last_unstale":"2024-09-21T06:14:23.851864+0000","last_undegraded":"2024-09-21T06:14:23.851864+0000","last_fullsized":"2024-09-21T06:14:23.851864+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:34.742845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.849936+0000","last_change":"2024-09-21T06:14:23.849643+0000","last_active":"2024-09-21T06:14:23.849936+0000","last_peered":"2024-09-21T06:14:23.849936+0000","last_clean":"2024-09-21T06:14:23.849936+0000","last_became_active":"2024-09-21T06:14:23.847832+0000","last_became_peered":"2024-09-21T06:14:23.847832+0000","last_unstale":"2024-09-21T06:14:23.849936+0000","last_undegraded":"2024-09-21T06:14:23.849936+0000","last_fullsized":"2024-09-21T06:14:23.849936+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:31.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853818+0000","last_change":"2024-09-21T06:14:23.852951+0000","last_active":"2024-09-21T06:14:23.853818+0000","last_peered":"2024-09-21T06:14:23.853818+0000","last_clean":"2024-09-21T06:14:23.853818+0000","last_became_active":"2024-09-21T06:14:23.852615+0000","last_became_peered":"2024-09-21T06:14:23.852615+0000","last_unstale":"2024-09-21T06:14:23.853818+0000","last_undegraded":"2024-09-21T06:14:23.853818+0000","last_fullsized":"2024-09-21T06:14:23.853818+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:13.569019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866035+0000","last_change":"2024-09-21T06:14:23.865851+0000","last_active":"2024-09-21T06:14:23.866035+0000","last_peered":"2024-09-21T06:14:23.866035+0000","last_clean":"2024-09-21T06:14:23.866035+0000","last_became_active":"2024-09-21T06:14:23.864788+0000","last_became_peered":"2024-09-21T06:14:23.864788+0000","last_unstale":"2024-09-21T06:14:23.866035+0000","last_undegraded":"2024-09-21T06:14:23.866035+0000","last_fullsized":"2024-09-21T06:14:23.866035+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:36.612897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.869996+0000","last_change":"2024-09-21T06:14:23.868073+0000","last_active":"2024-09-21T06:14:23.869996+0000","last_peered":"2024-09-21T06:14:23.869996+0000","last_clean":"2024-09-21T06:14:23.869996+0000","last_became_active":"2024-09-21T06:14:23.867211+0000","last_became_peered":"2024-09-21T06:14:23.867211+0000","last_unstale":"2024-09-21T06:14:23.869996+0000","last_undegraded":"2024-09-21T06:14:23.869996+0000","last_fullsized":"2024-09-21T06:14:23.869996+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:07.133545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.867254+0000","last_change":"2024-09-21T06:14:23.865490+0000","last_active":"2024-09-21T06:14:23.867254+0000","last_peered":"2024-09-21T06:14:23.867254+0000","last_clean":"2024-09-21T06:14:23.867254+0000","last_became_active":"2024-09-21T06:14:23.865189+0000","last_became_peered":"2024-09-21T06:14:23.865189+0000","last_unstale":"2024-09-21T06:14:23.867254+0000","last_undegraded":"2024-09-21T06:14:23.867254+0000","last_fullsized":"2024-09-21T06:14:23.867254+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:40.291674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.859724+0000","last_change":"2024-09-21T06:14:23.859485+0000","last_active":"2024-09-21T06:14:23.859724+0000","last_peered":"2024-09-21T06:14:23.859724+0000","last_clean":"2024-09-21T06:14:23.859724+0000","last_became_active":"2024-09-21T06:14:23.859148+0000","last_became_peered":"2024-09-21T06:14:23.859148+0000","last_unstale":"2024-09-21T06:14:23.859724+0000","last_undegraded":"2024-09-21T06:14:23.859724+0000","last_fullsized":"2024-09-21T06:14:23.859724+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:47.649105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.858878+0000","last_change":"2024-09-21T06:14:23.853763+0000","last_active":"2024-09-21T06:14:23.858878+0000","last_peered":"2024-09-21T06:14:23.858878+0000","last_clean":"2024-09-21T06:14:23.858878+0000","last_became_active":"2024-09-21T06:14:23.853486+0000","last_became_peered":"2024-09-21T06:14:23.853486+0000","last_unstale":"2024-09-21T06:14:23.858878+0000","last_undegraded":"2024-09-21T06:14:23.858878+0000","last_fullsized":"2024-09-21T06:14:23.858878+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:52.129158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840905+0000","last_change":"2024-09-21T06:14:23.858927+0000","last_active":"2024-09-21T06:14:24.840905+0000","last_peered":"2024-09-21T06:14:24.840905+0000","last_clean":"2024-09-21T06:14:24.840905+0000","last_became_active":"2024-09-21T06:14:23.858633+0000","last_became_peered":"2024-09-21T06:14:23.858633+0000","last_unstale":"2024-09-21T06:14:24.840905+0000","last_undegraded":"2024-09-21T06:14:24.840905+0000","last_fullsized":"2024-09-21T06:14:24.840905+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:55.536246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864394+0000","last_change":"2024-09-21T06:14:23.862625+0000","last_active":"2024-09-21T06:14:23.864394+0000","last_peered":"2024-09-21T06:14:23.864394+0000","last_clean":"2024-09-21T06:14:23.864394+0000","last_became_active":"2024-09-21T06:14:23.861359+0000","last_became_peered":"2024-09-21T06:14:23.861359+0000","last_unstale":"2024-09-21T06:14:23.864394+0000","last_undegraded":"2024-09-21T06:14:23.864394+0000","last_fullsized":"2024-09-21T06:14:23.864394+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.578830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.860135+0000","last_change":"2024-09-21T06:14:23.858245+0000","last_active":"2024-09-21T06:14:23.860135+0000","last_peered":"2024-09-21T06:14:23.860135+0000","last_clean":"2024-09-21T06:14:23.860135+0000","last_became_active":"2024-09-21T06:14:23.857910+0000","last_became_peered":"2024-09-21T06:14:23.857910+0000","last_unstale":"2024-09-21T06:14:23.860135+0000","last_undegraded":"2024-09-21T06:14:23.860135+0000","last_fullsized":"2024-09-21T06:14:23.860135+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:54.148367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"161'4","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.867110+0000","last_change":"2024-09-21T06:14:22.854944+0000","last_active":"2024-09-21T06:14:23.867110+0000","last_peered":"2024-09-21T06:14:23.867110+0000","last_clean":"2024-09-21T06:14:23.867110+0000","last_became_active":"2024-09-21T06:14:22.854632+0000","last_became_peered":"2024-09-21T06:14:22.854632+0000","last_unstale":"2024-09-21T06:14:23.867110+0000","last_undegraded":"2024-09-21T06:14:23.867110+0000","last_fullsized":"2024-09-21T06:14:23.867110+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:44.233299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840918+0000","last_change":"2024-09-21T06:14:23.849751+0000","last_active":"2024-09-21T06:14:24.840918+0000","last_peered":"2024-09-21T06:14:24.840918+0000","last_clean":"2024-09-21T06:14:24.840918+0000","last_became_active":"2024-09-21T06:14:23.849489+0000","last_became_peered":"2024-09-21T06:14:23.849489+0000","last_unstale":"2024-09-21T06:14:24.840918+0000","last_undegraded":"2024-09-21T06:14:24.840918+0000","last_fullsized":"2024-09-21T06:14:24.840918+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:50.236326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840770+0000","last_change":"2024-09-21T06:14:22.844757+0000","last_active":"2024-09-21T06:14:24.840770+0000","last_peered":"2024-09-21T06:14:24.840770+0000","last_clean":"2024-09-21T06:14:24.840770+0000","last_became_active":"2024-09-21T06:14:22.843706+0000","last_became_peered":"2024-09-21T06:14:22.843706+0000","last_unstale":"2024-09-21T06:14:24.840770+0000","last_undegraded":"2024-09-21T06:14:24.840770+0000","last_fullsized":"2024-09-21T06:14:24.840770+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:06.239380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863627+0000","last_change":"2024-09-21T06:14:23.862876+0000","last_active":"2024-09-21T06:14:23.863627+0000","last_peered":"2024-09-21T06:14:23.863627+0000","last_clean":"2024-09-21T06:14:23.863627+0000","last_became_active":"2024-09-21T06:14:23.862438+0000","last_became_peered":"2024-09-21T06:14:23.862438+0000","last_unstale":"2024-09-21T06:14:23.863627+0000","last_undegraded":"2024-09-21T06:14:23.863627+0000","last_fullsized":"2024-09-21T06:14:23.863627+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:30.946761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866995+0000","last_change":"2024-09-21T06:14:22.846114+0000","last_active":"2024-09-21T06:14:23.866995+0000","last_peered":"2024-09-21T06:14:23.866995+0000","last_clean":"2024-09-21T06:14:23.866995+0000","last_became_active":"2024-09-21T06:14:22.845874+0000","last_became_peered":"2024-09-21T06:14:22.845874+0000","last_unstale":"2024-09-21T06:14:23.866995+0000","last_undegraded":"2024-09-21T06:14:23.866995+0000","last_fullsized":"2024-09-21T06:14:23.866995+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:18.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853730+0000","last_change":"2024-09-21T06:14:23.853385+0000","last_active":"2024-09-21T06:14:23.853730+0000","last_peered":"2024-09-21T06:14:23.853730+0000","last_clean":"2024-09-21T06:14:23.853730+0000","last_became_active":"2024-09-21T06:14:23.852686+0000","last_became_peered":"2024-09-21T06:14:23.852686+0000","last_unstale":"2024-09-21T06:14:23.853730+0000","last_undegraded":"2024-09-21T06:14:23.853730+0000","last_fullsized":"2024-09-21T06:14:23.853730+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:00.771191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864990+0000","last_change":"2024-09-21T06:14:22.854019+0000","last_active":"2024-09-21T06:14:23.864990+0000","last_peered":"2024-09-21T06:14:23.864990+0000","last_clean":"2024-09-21T06:14:23.864990+0000","last_became_active":"2024-09-21T06:14:22.853741+0000","last_became_peered":"2024-09-21T06:14:22.853741+0000","last_unstale":"2024-09-21T06:14:23.864990+0000","last_undegraded":"2024-09-21T06:14:23.864990+0000","last_fullsized":"2024-09-21T06:14:23.864990+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:35.887555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841132+0000","last_change":"2024-09-21T06:14:23.861165+0000","last_active":"2024-09-21T06:14:24.841132+0000","last_peered":"2024-09-21T06:14:24.841132+0000","last_clean":"2024-09-21T06:14:24.841132+0000","last_became_active":"2024-09-21T06:14:23.860756+0000","last_became_peered":"2024-09-21T06:14:23.860756+0000","last_unstale":"2024-09-21T06:14:24.841132+0000","last_undegraded":"2024-09-21T06:14:24.841132+0000","last_fullsized":"2024-09-21T06:14:24.841132+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:44.513084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864599+0000","last_change":"2024-09-21T06:14:22.857469+0000","last_active":"2024-09-21T06:14:23.864599+0000","last_peered":"2024-09-21T06:14:23.864599+0000","last_clean":"2024-09-21T06:14:23.864599+0000","last_became_active":"2024-09-21T06:14:22.854247+0000","last_became_peered":"2024-09-21T06:14:22.854247+0000","last_unstale":"2024-09-21T06:14:23.864599+0000","last_undegraded":"2024-09-21T06:14:23.864599+0000","last_fullsized":"2024-09-21T06:14:23.864599+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:45.568710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865674+0000","last_change":"2024-09-21T06:14:23.864401+0000","last_active":"2024-09-21T06:14:23.865674+0000","last_peered":"2024-09-21T06:14:23.865674+0000","last_clean":"2024-09-21T06:14:23.865674+0000","last_became_active":"2024-09-21T06:14:23.863711+0000","last_became_peered":"2024-09-21T06:14:23.863711+0000","last_unstale":"2024-09-21T06:14:23.865674+0000","last_undegraded":"2024-09-21T06:14:23.865674+0000","last_fullsized":"2024-09-21T06:14:23.865674+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:47.047336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861691+0000","last_change":"2024-09-21T06:14:22.851738+0000","last_active":"2024-09-21T06:14:23.861691+0000","last_peered":"2024-09-21T06:14:23.861691+0000","last_clean":"2024-09-21T06:14:23.861691+0000","last_became_active":"2024-09-21T06:14:22.851294+0000","last_became_peered":"2024-09-21T06:14:22.851294+0000","last_unstale":"2024-09-21T06:14:23.861691+0000","last_undegraded":"2024-09-21T06:14:23.861691+0000","last_fullsized":"2024-09-21T06:14:23.861691+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:14.728100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841224+0000","last_change":"2024-09-21T06:14:23.854564+0000","last_active":"2024-09-21T06:14:24.841224+0000","last_peered":"2024-09-21T06:14:24.841224+0000","last_clean":"2024-09-21T06:14:24.841224+0000","last_became_active":"2024-09-21T06:14:23.854272+0000","last_became_peered":"2024-09-21T06:14:23.854272+0000","last_unstale":"2024-09-21T06:14:24.841224+0000","last_undegraded":"2024-09-21T06:14:24.841224+0000","last_fullsized":"2024-09-21T06:14:24.841224+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:14.190315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.850319+0000","last_change":"2024-09-21T06:14:22.855158+0000","last_active":"2024-09-21T06:14:23.850319+0000","last_peered":"2024-09-21T06:14:23.850319+0000","last_clean":"2024-09-21T06:14:23.850319+0000","last_became_active":"2024-09-21T06:14:22.854886+0000","last_became_peered":"2024-09-21T06:14:22.854886+0000","last_unstale":"2024-09-21T06:14:23.850319+0000","last_undegraded":"2024-09-21T06:14:23.850319+0000","last_fullsized":"2024-09-21T06:14:23.850319+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:19.924600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854984+0000","last_change":"2024-09-21T06:14:23.854713+0000","last_active":"2024-09-21T06:14:23.854984+0000","last_peered":"2024-09-21T06:14:23.854984+0000","last_clean":"2024-09-21T06:14:23.854984+0000","last_became_active":"2024-09-21T06:14:23.854447+0000","last_became_peered":"2024-09-21T06:14:23.854447+0000","last_unstale":"2024-09-21T06:14:23.854984+0000","last_undegraded":"2024-09-21T06:14:23.854984+0000","last_fullsized":"2024-09-21T06:14:23.854984+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:13.496799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.845129+0000","last_change":"2024-09-21T06:14:22.845441+0000","last_active":"2024-09-21T06:14:23.845129+0000","last_peered":"2024-09-21T06:14:23.845129+0000","last_clean":"2024-09-21T06:14:23.845129+0000","last_became_active":"2024-09-21T06:14:22.845117+0000","last_became_peered":"2024-09-21T06:14:22.845117+0000","last_unstale":"2024-09-21T06:14:23.845129+0000","last_undegraded":"2024-09-21T06:14:23.845129+0000","last_fullsized":"2024-09-21T06:14:23.845129+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:14.774565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861248+0000","last_change":"2024-09-21T06:14:23.861040+0000","last_active":"2024-09-21T06:14:23.861248+0000","last_peered":"2024-09-21T06:14:23.861248+0000","last_clean":"2024-09-21T06:14:23.861248+0000","last_became_active":"2024-09-21T06:14:23.860736+0000","last_became_peered":"2024-09-21T06:14:23.860736+0000","last_unstale":"2024-09-21T06:14:23.861248+0000","last_undegraded":"2024-09-21T06:14:23.861248+0000","last_fullsized":"2024-09-21T06:14:23.861248+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:43.647841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841012+0000","last_change":"2024-09-21T06:14:22.854714+0000","last_active":"2024-09-21T06:14:24.841012+0000","last_peered":"2024-09-21T06:14:24.841012+0000","last_clean":"2024-09-21T06:14:24.841012+0000","last_became_active":"2024-09-21T06:14:22.854392+0000","last_became_peered":"2024-09-21T06:14:22.854392+0000","last_unstale":"2024-09-21T06:14:24.841012+0000","last_undegraded":"2024-09-21T06:14:24.841012+0000","last_fullsized":"2024-09-21T06:14:24.841012+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:52.946335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851196+0000","last_change":"2024-09-21T06:14:23.849308+0000","last_active":"2024-09-21T06:14:23.851196+0000","last_peered":"2024-09-21T06:14:23.851196+0000","last_clean":"2024-09-21T06:14:23.851196+0000","last_became_active":"2024-09-21T06:14:23.848763+0000","last_became_peered":"2024-09-21T06:14:23.848763+0000","last_unstale":"2024-09-21T06:14:23.851196+0000","last_undegraded":"2024-09-21T06:14:23.851196+0000","last_fullsized":"2024-09-21T06:14:23.851196+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:25.449761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.844234+0000","last_change":"2024-09-21T06:14:22.845704+0000","last_active":"2024-09-21T06:14:23.844234+0000","last_peered":"2024-09-21T06:14:23.844234+0000","last_clean":"2024-09-21T06:14:23.844234+0000","last_became_active":"2024-09-21T06:14:22.845452+0000","last_became_peered":"2024-09-21T06:14:22.845452+0000","last_unstale":"2024-09-21T06:14:23.844234+0000","last_undegraded":"2024-09-21T06:14:23.844234+0000","last_fullsized":"2024-09-21T06:14:23.844234+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.597631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.855704+0000","last_change":"2024-09-21T06:14:23.855307+0000","last_active":"2024-09-21T06:14:23.855704+0000","last_peered":"2024-09-21T06:14:23.855704+0000","last_clean":"2024-09-21T06:14:23.855704+0000","last_became_active":"2024-09-21T06:14:23.853884+0000","last_became_peered":"2024-09-21T06:14:23.853884+0000","last_unstale":"2024-09-21T06:14:23.855704+0000","last_undegraded":"2024-09-21T06:14:23.855704+0000","last_fullsized":"2024-09-21T06:14:23.855704+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:26.123818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"161'6","reported_seq":19,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.872160+0000","last_change":"2024-09-21T06:14:22.856701+0000","last_active":"2024-09-21T06:14:23.872160+0000","last_peered":"2024-09-21T06:14:23.872160+0000","last_clean":"2024-09-21T06:14:23.872160+0000","last_became_active":"2024-09-21T06:14:22.856419+0000","last_became_peered":"2024-09-21T06:14:22.856419+0000","last_unstale":"2024-09-21T06:14:23.872160+0000","last_undegraded":"2024-09-21T06:14:23.872160+0000","last_fullsized":"2024-09-21T06:14:23.872160+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:47.776163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865150+0000","last_change":"2024-09-21T06:14:23.864507+0000","last_active":"2024-09-21T06:14:23.865150+0000","last_peered":"2024-09-21T06:14:23.865150+0000","last_clean":"2024-09-21T06:14:23.865150+0000","last_became_active":"2024-09-21T06:14:23.864164+0000","last_became_peered":"2024-09-21T06:14:23.864164+0000","last_unstale":"2024-09-21T06:14:23.865150+0000","last_undegraded":"2024-09-21T06:14:23.865150+0000","last_fullsized":"2024-09-21T06:14:23.865150+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:51.620509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866471+0000","last_change":"2024-09-21T06:14:22.853865+0000","last_active":"2024-09-21T06:14:23.866471+0000","last_peered":"2024-09-21T06:14:23.866471+0000","last_clean":"2024-09-21T06:14:23.866471+0000","last_became_active":"2024-09-21T06:14:22.853444+0000","last_became_peered":"2024-09-21T06:14:22.853444+0000","last_unstale":"2024-09-21T06:14:23.866471+0000","last_undegraded":"2024-09-21T06:14:23.866471+0000","last_fullsized":"2024-09-21T06:14:23.866471+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:34.085863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840774+0000","last_change":"2024-09-21T06:14:23.849801+0000","last_active":"2024-09-21T06:14:24.840774+0000","last_peered":"2024-09-21T06:14:24.840774+0000","last_clean":"2024-09-21T06:14:24.840774+0000","last_became_active":"2024-09-21T06:14:23.849448+0000","last_became_peered":"2024-09-21T06:14:23.849448+0000","last_unstale":"2024-09-21T06:14:24.840774+0000","last_undegraded":"2024-09-21T06:14:24.840774+0000","last_fullsized":"2024-09-21T06:14:24.840774+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.223821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.856118+0000","last_change":"2024-09-21T06:14:22.852790+0000","last_active":"2024-09-21T06:14:23.856118+0000","last_peered":"2024-09-21T06:14:23.856118+0000","last_clean":"2024-09-21T06:14:23.856118+0000","last_became_active":"2024-09-21T06:14:22.851734+0000","last_became_peered":"2024-09-21T06:14:22.851734+0000","last_unstale":"2024-09-21T06:14:23.856118+0000","last_undegraded":"2024-09-21T06:14:23.856118+0000","last_fullsized":"2024-09-21T06:14:23.856118+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:42.579148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854938+0000","last_change":"2024-09-21T06:14:23.854216+0000","last_active":"2024-09-21T06:14:23.854938+0000","last_peered":"2024-09-21T06:14:23.854938+0000","last_clean":"2024-09-21T06:14:23.854938+0000","last_became_active":"2024-09-21T06:14:23.852896+0000","last_became_peered":"2024-09-21T06:14:23.852896+0000","last_unstale":"2024-09-21T06:14:23.854938+0000","last_undegraded":"2024-09-21T06:14:23.854938+0000","last_fullsized":"2024-09-21T06:14:23.854938+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:15.031680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851114+0000","last_change":"2024-09-21T06:14:22.853230+0000","last_active":"2024-09-21T06:14:23.851114+0000","last_peered":"2024-09-21T06:14:23.851114+0000","last_clean":"2024-09-21T06:14:23.851114+0000","last_became_active":"2024-09-21T06:14:22.852766+0000","last_became_peered":"2024-09-21T06:14:22.852766+0000","last_unstale":"2024-09-21T06:14:23.851114+0000","last_undegraded":"2024-09-21T06:14:23.851114+0000","last_fullsized":"2024-09-21T06:14:23.851114+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:47.513051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864829+0000","last_change":"2024-09-21T06:14:23.863883+0000","last_active":"2024-09-21T06:14:23.864829+0000","last_peered":"2024-09-21T06:14:23.864829+0000","last_clean":"2024-09-21T06:14:23.864829+0000","last_became_active":"2024-09-21T06:14:23.863554+0000","last_became_peered":"2024-09-21T06:14:23.863554+0000","last_unstale":"2024-09-21T06:14:23.864829+0000","last_undegraded":"2024-09-21T06:14:23.864829+0000","last_fullsized":"2024-09-21T06:14:23.864829+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:20.136755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"161'8","reported_seq":21,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.870919+0000","last_change":"2024-09-21T06:14:22.852460+0000","last_active":"2024-09-21T06:14:23.870919+0000","last_peered":"2024-09-21T06:14:23.870919+0000","last_clean":"2024-09-21T06:14:23.870919+0000","last_became_active":"2024-09-21T06:14:22.852201+0000","last_became_peered":"2024-09-21T06:14:22.852201+0000","last_unstale":"2024-09-21T06:14:23.870919+0000","last_undegraded":"2024-09-21T06:14:23.870919+0000","last_fullsized":"2024-09-21T06:14:23.870919+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:19.474286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854832+0000","last_change":"2024-09-21T06:14:23.854635+0000","last_active":"2024-09-21T06:14:23.854832+0000","last_peered":"2024-09-21T06:14:23.854832+0000","last_clean":"2024-09-21T06:14:23.854832+0000","last_became_active":"2024-09-21T06:14:23.854274+0000","last_became_peered":"2024-09-21T06:14:23.854274+0000","last_unstale":"2024-09-21T06:14:23.854832+0000","last_undegraded":"2024-09-21T06:14:23.854832+0000","last_fullsized":"2024-09-21T06:14:23.854832+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:57.506797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.862937+0000","last_change":"2024-09-21T06:14:22.850153+0000","last_active":"2024-09-21T06:14:23.862937+0000","last_peered":"2024-09-21T06:14:23.862937+0000","last_clean":"2024-09-21T06:14:23.862937+0000","last_became_active":"2024-09-21T06:14:22.849173+0000","last_became_peered":"2024-09-21T06:14:22.849173+0000","last_unstale":"2024-09-21T06:14:23.862937+0000","last_undegraded":"2024-09-21T06:14:23.862937+0000","last_fullsized":"2024-09-21T06:14:23.862937+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:13.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857462+0000","last_change":"2024-09-21T06:14:23.857268+0000","last_active":"2024-09-21T06:14:23.857462+0000","last_peered":"2024-09-21T06:14:23.857462+0000","last_clean":"2024-09-21T06:14:23.857462+0000","last_became_active":"2024-09-21T06:14:23.857033+0000","last_became_peered":"2024-09-21T06:14:23.857033+0000","last_unstale":"2024-09-21T06:14:23.857462+0000","last_undegraded":"2024-09-21T06:14:23.857462+0000","last_fullsized":"2024-09-21T06:14:23.857462+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:08.810473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841285+0000","last_change":"2024-09-21T06:14:22.850445+0000","last_active":"2024-09-21T06:14:24.841285+0000","last_peered":"2024-09-21T06:14:24.841285+0000","last_clean":"2024-09-21T06:14:24.841285+0000","last_became_active":"2024-09-21T06:14:22.850096+0000","last_became_peered":"2024-09-21T06:14:22.850096+0000","last_unstale":"2024-09-21T06:14:24.841285+0000","last_undegraded":"2024-09-21T06:14:24.841285+0000","last_fullsized":"2024-09-21T06:14:24.841285+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.489566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865800+0000","last_change":"2024-09-21T06:14:23.865145+0000","last_active":"2024-09-21T06:14:23.865800+0000","last_peered":"2024-09-21T06:14:23.865800+0000","last_clean":"2024-09-21T06:14:23.865800+0000","last_became_active":"2024-09-21T06:14:23.864621+0000","last_became_peered":"2024-09-21T06:14:23.864621+0000","last_unstale":"2024-09-21T06:14:23.865800+0000","last_undegraded":"2024-09-21T06:14:23.865800+0000","last_fullsized":"2024-09-21T06:14:23.865800+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:19.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866171+0000","last_change":"2024-09-21T06:14:22.853846+0000","last_active":"2024-09-21T06:14:23.866171+0000","last_peered":"2024-09-21T06:14:23.866171+0000","last_clean":"2024-09-21T06:14:23.866171+0000","last_became_active":"2024-09-21T06:14:22.853304+0000","last_became_peered":"2024-09-21T06:14:22.853304+0000","last_unstale":"2024-09-21T06:14:23.866171+0000","last_undegraded":"2024-09-21T06:14:23.866171+0000","last_fullsized":"2024-09-21T06:14:23.866171+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:42.315700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865736+0000","last_change":"2024-09-21T06:14:23.865321+0000","last_active":"2024-09-21T06:14:23.865736+0000","last_peered":"2024-09-21T06:14:23.865736+0000","last_clean":"2024-09-21T06:14:23.865736+0000","last_became_active":"2024-09-21T06:14:23.864413+0000","last_became_peered":"2024-09-21T06:14:23.864413+0000","last_unstale":"2024-09-21T06:14:23.865736+0000","last_undegraded":"2024-09-21T06:14:23.865736+0000","last_fullsized":"2024-09-21T06:14:23.865736+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:09.446816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840858+0000","last_change":"2024-09-21T06:14:22.857020+0000","last_active":"2024-09-21T06:14:24.840858+0000","last_peered":"2024-09-21T06:14:24.840858+0000","last_clean":"2024-09-21T06:14:24.840858+0000","last_became_active":"2024-09-21T06:14:22.856757+0000","last_became_peered":"2024-09-21T06:14:22.856757+0000","last_unstale":"2024-09-21T06:14:24.840858+0000","last_undegraded":"2024-09-21T06:14:24.840858+0000","last_fullsized":"2024-09-21T06:14:24.840858+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:09.018864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.858907+0000","last_change":"2024-09-21T06:14:23.853749+0000","last_active":"2024-09-21T06:14:23.858907+0000","last_peered":"2024-09-21T06:14:23.858907+0000","last_clean":"2024-09-21T06:14:23.858907+0000","last_became_active":"2024-09-21T06:14:23.853471+0000","last_became_peered":"2024-09-21T06:14:23.853471+0000","last_unstale":"2024-09-21T06:14:23.858907+0000","last_undegraded":"2024-09-21T06:14:23.858907+0000","last_fullsized":"2024-09-21T06:14:23.858907+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:26.514643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.868995+0000","last_change":"2024-09-21T06:14:22.853419+0000","last_active":"2024-09-21T06:14:23.868995+0000","last_peered":"2024-09-21T06:14:23.868995+0000","last_clean":"2024-09-21T06:14:23.868995+0000","last_became_active":"2024-09-21T06:14:22.853075+0000","last_became_peered":"2024-09-21T06:14:22.853075+0000","last_unstale":"2024-09-21T06:14:23.868995+0000","last_undegraded":"2024-09-21T06:14:23.868995+0000","last_fullsized":"2024-09-21T06:14:23.868995+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:13.545425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864072+0000","last_change":"2024-09-21T06:14:23.858868+0000","last_active":"2024-09-21T06:14:23.864072+0000","last_peered":"2024-09-21T06:14:23.864072+0000","last_clean":"2024-09-21T06:14:23.864072+0000","last_became_active":"2024-09-21T06:14:23.858488+0000","last_became_peered":"2024-09-21T06:14:23.858488+0000","last_unstale":"2024-09-21T06:14:23.864072+0000","last_undegraded":"2024-09-21T06:14:23.864072+0000","last_fullsized":"2024-09-21T06:14:23.864072+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:24.880613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.841884+0000","last_change":"2024-09-21T06:14:22.854824+0000","last_active":"2024-09-21T06:14:23.841884+0000","last_peered":"2024-09-21T06:14:23.841884+0000","last_clean":"2024-09-21T06:14:23.841884+0000","last_became_active":"2024-09-21T06:14:22.854557+0000","last_became_peered":"2024-09-21T06:14:22.854557+0000","last_unstale":"2024-09-21T06:14:23.841884+0000","last_undegraded":"2024-09-21T06:14:23.841884+0000","last_fullsized":"2024-09-21T06:14:23.841884+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.686727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.850687+0000","last_change":"2024-09-21T06:14:23.850363+0000","last_active":"2024-09-21T06:14:23.850687+0000","last_peered":"2024-09-21T06:14:23.850687+0000","last_clean":"2024-09-21T06:14:23.850687+0000","last_became_active":"2024-09-21T06:14:23.850073+0000","last_became_peered":"2024-09-21T06:14:23.850073+0000","last_unstale":"2024-09-21T06:14:23.850687+0000","last_undegraded":"2024-09-21T06:14:23.850687+0000","last_fullsized":"2024-09-21T06:14:23.850687+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:26.031772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.842681+0000","last_change":"2024-09-21T06:14:22.842633+0000","last_active":"2024-09-21T06:14:23.842681+0000","last_peered":"2024-09-21T06:14:23.842681+0000","last_clean":"2024-09-21T06:14:23.842681+0000","last_became_active":"2024-09-21T06:14:22.841825+0000","last_became_peered":"2024-09-21T06:14:22.841825+0000","last_unstale":"2024-09-21T06:14:23.842681+0000","last_undegraded":"2024-09-21T06:14:23.842681+0000","last_fullsized":"2024-09-21T06:14:23.842681+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:59.679932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863741+0000","last_change":"2024-09-21T06:14:23.857656+0000","last_active":"2024-09-21T06:14:23.863741+0000","last_peered":"2024-09-21T06:14:23.863741+0000","last_clean":"2024-09-21T06:14:23.863741+0000","last_became_active":"2024-09-21T06:14:23.857351+0000","last_became_peered":"2024-09-21T06:14:23.857351+0000","last_unstale":"2024-09-21T06:14:23.863741+0000","last_undegraded":"2024-09-21T06:14:23.863741+0000","last_fullsized":"2024-09-21T06:14:23.863741+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:09.928668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.856357+0000","last_change":"2024-09-21T06:14:22.852365+0000","last_active":"2024-09-21T06:14:23.856357+0000","last_peered":"2024-09-21T06:14:23.856357+0000","last_clean":"2024-09-21T06:14:23.856357+0000","last_became_active":"2024-09-21T06:14:22.851414+0000","last_became_peered":"2024-09-21T06:14:22.851414+0000","last_unstale":"2024-09-21T06:14:23.856357+0000","last_undegraded":"2024-09-21T06:14:23.856357+0000","last_fullsized":"2024-09-21T06:14:23.856357+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:08.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854917+0000","last_change":"2024-09-21T06:14:23.853887+0000","last_active":"2024-09-21T06:14:23.854917+0000","last_peered":"2024-09-21T06:14:23.854917+0000","last_clean":"2024-09-21T06:14:23.854917+0000","last_became_active":"2024-09-21T06:14:23.852510+0000","last_became_peered":"2024-09-21T06:14:23.852510+0000","last_unstale":"2024-09-21T06:14:23.854917+0000","last_undegraded":"2024-09-21T06:14:23.854917+0000","last_fullsized":"2024-09-21T06:14:23.854917+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:54.688247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866903+0000","last_change":"2024-09-21T06:14:22.851799+0000","last_active":"2024-09-21T06:14:23.866903+0000","last_peered":"2024-09-21T06:14:23.866903+0000","last_clean":"2024-09-21T06:14:23.866903+0000","last_became_active":"2024-09-21T06:14:22.850937+0000","last_became_peered":"2024-09-21T06:14:22.850937+0000","last_unstale":"2024-09-21T06:14:23.866903+0000","last_undegraded":"2024-09-21T06:14:23.866903+0000","last_fullsized":"2024-09-21T06:14:23.866903+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:01.814832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865179+0000","last_change":"2024-09-21T06:14:23.864871+0000","last_active":"2024-09-21T06:14:23.865179+0000","last_peered":"2024-09-21T06:14:23.865179+0000","last_clean":"2024-09-21T06:14:23.865179+0000","last_became_active":"2024-09-21T06:14:23.864254+0000","last_became_peered":"2024-09-21T06:14:23.864254+0000","last_unstale":"2024-09-21T06:14:23.865179+0000","last_undegraded":"2024-09-21T06:14:23.865179+0000","last_fullsized":"2024-09-21T06:14:23.865179+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:57.909242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.846417+0000","last_change":"2024-09-21T06:14:22.856163+0000","last_active":"2024-09-21T06:14:23.846417+0000","last_peered":"2024-09-21T06:14:23.846417+0000","last_clean":"2024-09-21T06:14:23.846417+0000","last_became_active":"2024-09-21T06:14:22.855546+0000","last_became_peered":"2024-09-21T06:14:22.855546+0000","last_unstale":"2024-09-21T06:14:23.846417+0000","last_undegraded":"2024-09-21T06:14:23.846417+0000","last_fullsized":"2024-09-21T06:14:23.846417+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:56.860600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840996+0000","last_change":"2024-09-21T06:14:23.850953+0000","last_active":"2024-09-21T06:14:24.840996+0000","last_peered":"2024-09-21T06:14:24.840996+0000","last_clean":"2024-09-21T06:14:24.840996+0000","last_became_active":"2024-09-21T06:14:23.850704+0000","last_became_peered":"2024-09-21T06:14:23.850704+0000","last_unstale":"2024-09-21T06:14:24.840996+0000","last_undegraded":"2024-09-21T06:14:24.840996+0000","last_fullsized":"2024-09-21T06:14:24.840996+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:37.429765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847304+0000","last_change":"2024-09-21T06:14:22.857916+0000","last_active":"2024-09-21T06:14:23.847304+0000","last_peered":"2024-09-21T06:14:23.847304+0000","last_clean":"2024-09-21T06:14:23.847304+0000","last_became_active":"2024-09-21T06:14:22.857303+0000","last_became_peered":"2024-09-21T06:14:22.857303+0000","last_unstale":"2024-09-21T06:14:23.847304+0000","last_undegraded":"2024-09-21T06:14:23.847304+0000","last_fullsized":"2024-09-21T06:14:23.847304+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:46.784501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857170+0000","last_change":"2024-09-21T06:14:23.856783+0000","last_active":"2024-09-21T06:14:23.857170+0000","last_peered":"2024-09-21T06:14:23.857170+0000","last_clean":"2024-09-21T06:14:23.857170+0000","last_became_active":"2024-09-21T06:14:23.855854+0000","last_became_peered":"2024-09-21T06:14:23.855854+0000","last_unstale":"2024-09-21T06:14:23.857170+0000","last_undegraded":"2024-09-21T06:14:23.857170+0000","last_fullsized":"2024-09-21T06:14:23.857170+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:33.083280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.850566+0000","last_change":"2024-09-21T06:14:22.853999+0000","last_active":"2024-09-21T06:14:23.850566+0000","last_peered":"2024-09-21T06:14:23.850566+0000","last_clean":"2024-09-21T06:14:23.850566+0000","last_became_active":"2024-09-21T06:14:22.853740+0000","last_became_peered":"2024-09-21T06:14:22.853740+0000","last_unstale":"2024-09-21T06:14:23.850566+0000","last_undegraded":"2024-09-21T06:14:23.850566+0000","last_fullsized":"2024-09-21T06:14:23.850566+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:24.973588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.869971+0000","last_change":"2024-09-21T06:14:23.867699+0000","last_active":"2024-09-21T06:14:23.869971+0000","last_peered":"2024-09-21T06:14:23.869971+0000","last_clean":"2024-09-21T06:14:23.869971+0000","last_became_active":"2024-09-21T06:14:23.866794+0000","last_became_peered":"2024-09-21T06:14:23.866794+0000","last_unstale":"2024-09-21T06:14:23.869971+0000","last_undegraded":"2024-09-21T06:14:23.869971+0000","last_fullsized":"2024-09-21T06:14:23.869971+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:46.465490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847245+0000","last_change":"2024-09-21T06:14:22.847976+0000","last_active":"2024-09-21T06:14:23.847245+0000","last_peered":"2024-09-21T06:14:23.847245+0000","last_clean":"2024-09-21T06:14:23.847245+0000","last_became_active":"2024-09-21T06:14:22.846528+0000","last_became_peered":"2024-09-21T06:14:22.846528+0000","last_unstale":"2024-09-21T06:14:23.847245+0000","last_undegraded":"2024-09-21T06:14:23.847245+0000","last_fullsized":"2024-09-21T06:14:23.847245+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:59.392559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861827+0000","last_change":"2024-09-21T06:14:23.861590+0000","last_active":"2024-09-21T06:14:23.861827+0000","last_peered":"2024-09-21T06:14:23.861827+0000","last_clean":"2024-09-21T06:14:23.861827+0000","last_became_active":"2024-09-21T06:14:23.861157+0000","last_became_peered":"2024-09-21T06:14:23.861157+0000","last_unstale":"2024-09-21T06:14:23.861827+0000","last_undegraded":"2024-09-21T06:14:23.861827+0000","last_fullsized":"2024-09-21T06:14:23.861827+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:13.362825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.845394+0000","last_change":"2024-09-21T06:14:22.851331+0000","last_active":"2024-09-21T06:14:23.845394+0000","last_peered":"2024-09-21T06:14:23.845394+0000","last_clean":"2024-09-21T06:14:23.845394+0000","last_became_active":"2024-09-21T06:14:22.850586+0000","last_became_peered":"2024-09-21T06:14:22.850586+0000","last_unstale":"2024-09-21T06:14:23.845394+0000","last_undegraded":"2024-09-21T06:14:23.845394+0000","last_fullsized":"2024-09-21T06:14:23.845394+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:30.274352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853672+0000","last_change":"2024-09-21T06:14:23.852277+0000","last_active":"2024-09-21T06:14:23.853672+0000","last_peered":"2024-09-21T06:14:23.853672+0000","last_clean":"2024-09-21T06:14:23.853672+0000","last_became_active":"2024-09-21T06:14:23.852000+0000","last_became_peered":"2024-09-21T06:14:23.852000+0000","last_unstale":"2024-09-21T06:14:23.853672+0000","last_undegraded":"2024-09-21T06:14:23.853672+0000","last_fullsized":"2024-09-21T06:14:23.853672+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:53.004336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853079+0000","last_change":"2024-09-21T06:14:22.853566+0000","last_active":"2024-09-21T06:14:23.853079+0000","last_peered":"2024-09-21T06:14:23.853079+0000","last_clean":"2024-09-21T06:14:23.853079+0000","last_became_active":"2024-09-21T06:14:22.853244+0000","last_became_peered":"2024-09-21T06:14:22.853244+0000","last_unstale":"2024-09-21T06:14:23.853079+0000","last_undegraded":"2024-09-21T06:14:23.853079+0000","last_fullsized":"2024-09-21T06:14:23.853079+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:26.044174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854895+0000","last_change":"2024-09-21T06:14:23.853589+0000","last_active":"2024-09-21T06:14:23.854895+0000","last_peered":"2024-09-21T06:14:23.854895+0000","last_clean":"2024-09-21T06:14:23.854895+0000","last_became_active":"2024-09-21T06:14:23.852092+0000","last_became_peered":"2024-09-21T06:14:23.852092+0000","last_unstale":"2024-09-21T06:14:23.854895+0000","last_undegraded":"2024-09-21T06:14:23.854895+0000","last_fullsized":"2024-09-21T06:14:23.854895+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:07.582085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840899+0000","last_change":"2024-09-21T06:14:22.845054+0000","last_active":"2024-09-21T06:14:24.840899+0000","last_peered":"2024-09-21T06:14:24.840899+0000","last_clean":"2024-09-21T06:14:24.840899+0000","last_became_active":"2024-09-21T06:14:22.844087+0000","last_became_peered":"2024-09-21T06:14:22.844087+0000","last_unstale":"2024-09-21T06:14:24.840899+0000","last_undegraded":"2024-09-21T06:14:24.840899+0000","last_fullsized":"2024-09-21T06:14:24.840899+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:09.961286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863941+0000","last_change":"2024-09-21T06:14:23.857968+0000","last_active":"2024-09-21T06:14:23.863941+0000","last_peered":"2024-09-21T06:14:23.863941+0000","last_clean":"2024-09-21T06:14:23.863941+0000","last_became_active":"2024-09-21T06:14:23.857712+0000","last_became_peered":"2024-09-21T06:14:23.857712+0000","last_unstale":"2024-09-21T06:14:23.863941+0000","last_undegraded":"2024-09-21T06:14:23.863941+0000","last_fullsized":"2024-09-21T06:14:23.863941+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:36.340639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"161'3","reported_seq":16,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866945+0000","last_change":"2024-09-21T06:14:22.850485+0000","last_active":"2024-09-21T06:14:23.866945+0000","last_peered":"2024-09-21T06:14:23.866945+0000","last_clean":"2024-09-21T06:14:23.866945+0000","last_became_active":"2024-09-21T06:14:22.850068+0000","last_became_peered":"2024-09-21T06:14:22.850068+0000","last_unstale":"2024-09-21T06:14:23.866945+0000","last_undegraded":"2024-09-21T06:14:23.866945+0000","last_fullsized":"2024-09-21T06:14:23.866945+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:14.624706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":401,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.841965+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:14:23.841965+0000","last_peered":"2024-09-21T06:14:23.841965+0000","last_clean":"2024-09-21T06:14:23.841965+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:14:23.841965+0000","last_undegraded":"2024-09-21T06:14:23.841965+0000","last_fullsized":"2024-09-21T06:14:23.841965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194430,"statfs":{"total":200000000,"available":199096783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193852,"statfs":{"total":200000000,"available":198504859,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193860,"statfs":{"total":200000000,"available":198513280,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:14:28.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2293703390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc070630 msgr2=0x7f9cdc070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2293703390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc070630 0x7f9cdc070a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8005fd0 tx=0x7f9cc802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2293703390 shutdown_connections 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2293703390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc070630 0x7f9cdc070a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2293703390 >> v2:172.21.15.149:3300/0 conn(0x7f9cdc068f10 0x7f9cdc15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2293703390 >> 172.21.15.118:0/2293703390 conn(0x7f9cdc0d0f80 msgr2=0x7f9cdc0d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2293703390 shutdown_connections 2024-09-21T06:14:28.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.543+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2293703390 wait complete. 2024-09-21T06:14:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.545+0000 7f9ce2c00640 1 Processor -- start 2024-09-21T06:14:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.546+0000 7f9ce2c00640 1 -- start start 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce2c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc068f10 0x7f9cdc14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce2c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cdc070630 0x7f9cdc15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc1607b0 0x7f9cdc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce2c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc0744e0 con 0x7f9cdc070630 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce2c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc074360 con 0x7f9cdc068f10 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc074660 con 0x7f9cdc1607b0 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce0e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cdc070630 0x7f9cdc15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce0e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cdc070630 0x7f9cdc15fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42978/0 (socket says 172.21.15.118:42978) 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce0e00640 1 -- 172.21.15.118:0/2870378065 learned_addr learned my addr 172.21.15.118:0/2870378065 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.547+0000 7f9ce2200640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc1607b0 0x7f9cdc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9ce1800640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc068f10 0x7f9cdc14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9ce0e00640 1 -- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc1607b0 msgr2=0x7f9cdc14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9ce0e00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc1607b0 0x7f9cdc14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9ce0e00640 1 -- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc068f10 msgr2=0x7f9cdc14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9ce0e00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc068f10 0x7f9cdc14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9ce0e00640 1 -- 172.21.15.118:0/2870378065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc160300 con 0x7f9cdc070630 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9ce0e00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cdc070630 0x7f9cdc15fdc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8034040 tx=0x7f9cc80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.548+0000 7f9cd9600640 1 -- 172.21.15.118:0/2870378065 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc803e030 con 0x7f9cdc070630 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.549+0000 7f9cd9600640 1 -- 172.21.15.118:0/2870378065 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cc8003ae0 con 0x7f9cdc070630 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.549+0000 7f9cd9600640 1 -- 172.21.15.118:0/2870378065 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8035040 con 0x7f9cdc070630 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.549+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cdc153a10 con 0x7f9cdc070630 2024-09-21T06:14:28.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.549+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cdc153fd0 con 0x7f9cdc070630 2024-09-21T06:14:28.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.550+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cdc161570 con 0x7f9cdc070630 2024-09-21T06:14:28.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.551+0000 7f9cd9600640 1 -- 172.21.15.118:0/2870378065 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9cc8041030 con 0x7f9cdc070630 2024-09-21T06:14:28.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.552+0000 7f9cd9600640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cbc078bc0 0x7f9cbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:28.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.552+0000 7f9cd9600640 1 -- 172.21.15.118:0/2870378065 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc80bb1f0 con 0x7f9cdc070630 2024-09-21T06:14:28.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.553+0000 7f9ce1800640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cbc078bc0 0x7f9cbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:28.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.553+0000 7f9ce1800640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cbc078bc0 0x7f9cbc07b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009bb0 tx=0x7f9cd0005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:28.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.557+0000 7f9cd9600640 1 -- 172.21.15.118:0/2870378065 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9cc8082f50 con 0x7f9cdc070630 2024-09-21T06:14:28.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.738+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9cdc1537c0 con 0x7f9cbc078bc0 2024-09-21T06:14:28.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.743+0000 7f9cd9600640 1 -- 172.21.15.118:0/2870378065 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247972 (secure 0 0 0) 0x7f9cdc1537c0 con 0x7f9cbc078bc0 2024-09-21T06:14:28.747 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:28.749 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cbc078bc0 msgr2=0x7f9cbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cbc078bc0 0x7f9cbc07b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009bb0 tx=0x7f9cd0005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cdc070630 msgr2=0x7f9cdc15fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cdc070630 0x7f9cdc15fdc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8034040 tx=0x7f9cc80035f0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 shutdown_connections 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cbc078bc0 0x7f9cbc07b0d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cdc1607b0 0x7f9cdc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cdc070630 0x7f9cdc15fdc0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 --2- 172.21.15.118:0/2870378065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc068f10 0x7f9cdc14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 >> 172.21.15.118:0/2870378065 conn(0x7f9cdc0d0f80 msgr2=0x7f9cdc0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 shutdown_connections 2024-09-21T06:14:28.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:28.747+0000 7f9ce2c00640 1 -- 172.21.15.118:0/2870378065 wait complete. 2024-09-21T06:14:28.770 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":479,"stamp":"2024-09-21T06:14:28.628987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554329,"statfs":{"total":1600000000,"available":1591633162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001581"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857101+0000","last_change":"2024-09-21T06:14:23.855851+0000","last_active":"2024-09-21T06:14:23.857101+0000","last_peered":"2024-09-21T06:14:23.857101+0000","last_clean":"2024-09-21T06:14:23.857101+0000","last_became_active":"2024-09-21T06:14:23.855625+0000","last_became_peered":"2024-09-21T06:14:23.855625+0000","last_unstale":"2024-09-21T06:14:23.857101+0000","last_undegraded":"2024-09-21T06:14:23.857101+0000","last_fullsized":"2024-09-21T06:14:23.857101+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:32.861003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840631+0000","last_change":"2024-09-21T06:14:23.849725+0000","last_active":"2024-09-21T06:14:24.840631+0000","last_peered":"2024-09-21T06:14:24.840631+0000","last_clean":"2024-09-21T06:14:24.840631+0000","last_became_active":"2024-09-21T06:14:23.849428+0000","last_became_peered":"2024-09-21T06:14:23.849428+0000","last_unstale":"2024-09-21T06:14:24.840631+0000","last_undegraded":"2024-09-21T06:14:24.840631+0000","last_fullsized":"2024-09-21T06:14:24.840631+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:48.102912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.859175+0000","last_change":"2024-09-21T06:14:23.858737+0000","last_active":"2024-09-21T06:14:23.859175+0000","last_peered":"2024-09-21T06:14:23.859175+0000","last_clean":"2024-09-21T06:14:23.859175+0000","last_became_active":"2024-09-21T06:14:23.857894+0000","last_became_peered":"2024-09-21T06:14:23.857894+0000","last_unstale":"2024-09-21T06:14:23.859175+0000","last_undegraded":"2024-09-21T06:14:23.859175+0000","last_fullsized":"2024-09-21T06:14:23.859175+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:21.677546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.848744+0000","last_change":"2024-09-21T06:14:23.848398+0000","last_active":"2024-09-21T06:14:23.848744+0000","last_peered":"2024-09-21T06:14:23.848744+0000","last_clean":"2024-09-21T06:14:23.848744+0000","last_became_active":"2024-09-21T06:14:23.848003+0000","last_became_peered":"2024-09-21T06:14:23.848003+0000","last_unstale":"2024-09-21T06:14:23.848744+0000","last_undegraded":"2024-09-21T06:14:23.848744+0000","last_fullsized":"2024-09-21T06:14:23.848744+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:07.849129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854866+0000","last_change":"2024-09-21T06:14:23.852619+0000","last_active":"2024-09-21T06:14:23.854866+0000","last_peered":"2024-09-21T06:14:23.854866+0000","last_clean":"2024-09-21T06:14:23.854866+0000","last_became_active":"2024-09-21T06:14:23.852063+0000","last_became_peered":"2024-09-21T06:14:23.852063+0000","last_unstale":"2024-09-21T06:14:23.854866+0000","last_undegraded":"2024-09-21T06:14:23.854866+0000","last_fullsized":"2024-09-21T06:14:23.854866+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:06.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865575+0000","last_change":"2024-09-21T06:14:23.865048+0000","last_active":"2024-09-21T06:14:23.865575+0000","last_peered":"2024-09-21T06:14:23.865575+0000","last_clean":"2024-09-21T06:14:23.865575+0000","last_became_active":"2024-09-21T06:14:23.864076+0000","last_became_peered":"2024-09-21T06:14:23.864076+0000","last_unstale":"2024-09-21T06:14:23.865575+0000","last_undegraded":"2024-09-21T06:14:23.865575+0000","last_fullsized":"2024-09-21T06:14:23.865575+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:29.714800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863916+0000","last_change":"2024-09-21T06:14:23.861215+0000","last_active":"2024-09-21T06:14:23.863916+0000","last_peered":"2024-09-21T06:14:23.863916+0000","last_clean":"2024-09-21T06:14:23.863916+0000","last_became_active":"2024-09-21T06:14:23.860942+0000","last_became_peered":"2024-09-21T06:14:23.860942+0000","last_unstale":"2024-09-21T06:14:23.863916+0000","last_undegraded":"2024-09-21T06:14:23.863916+0000","last_fullsized":"2024-09-21T06:14:23.863916+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:43.436611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.855789+0000","last_change":"2024-09-21T06:14:23.855601+0000","last_active":"2024-09-21T06:14:23.855789+0000","last_peered":"2024-09-21T06:14:23.855789+0000","last_clean":"2024-09-21T06:14:23.855789+0000","last_became_active":"2024-09-21T06:14:23.855333+0000","last_became_peered":"2024-09-21T06:14:23.855333+0000","last_unstale":"2024-09-21T06:14:23.855789+0000","last_undegraded":"2024-09-21T06:14:23.855789+0000","last_fullsized":"2024-09-21T06:14:23.855789+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:22.140196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840625+0000","last_change":"2024-09-21T06:14:23.852442+0000","last_active":"2024-09-21T06:14:24.840625+0000","last_peered":"2024-09-21T06:14:24.840625+0000","last_clean":"2024-09-21T06:14:24.840625+0000","last_became_active":"2024-09-21T06:14:23.852188+0000","last_became_peered":"2024-09-21T06:14:23.852188+0000","last_unstale":"2024-09-21T06:14:24.840625+0000","last_undegraded":"2024-09-21T06:14:24.840625+0000","last_fullsized":"2024-09-21T06:14:24.840625+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:04.409806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.849966+0000","last_change":"2024-09-21T06:14:23.849668+0000","last_active":"2024-09-21T06:14:23.849966+0000","last_peered":"2024-09-21T06:14:23.849966+0000","last_clean":"2024-09-21T06:14:23.849966+0000","last_became_active":"2024-09-21T06:14:23.849295+0000","last_became_peered":"2024-09-21T06:14:23.849295+0000","last_unstale":"2024-09-21T06:14:23.849966+0000","last_undegraded":"2024-09-21T06:14:23.849966+0000","last_fullsized":"2024-09-21T06:14:23.849966+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:01.465969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.858742+0000","last_change":"2024-09-21T06:14:23.858423+0000","last_active":"2024-09-21T06:14:23.858742+0000","last_peered":"2024-09-21T06:14:23.858742+0000","last_clean":"2024-09-21T06:14:23.858742+0000","last_became_active":"2024-09-21T06:14:23.858180+0000","last_became_peered":"2024-09-21T06:14:23.858180+0000","last_unstale":"2024-09-21T06:14:23.858742+0000","last_undegraded":"2024-09-21T06:14:23.858742+0000","last_fullsized":"2024-09-21T06:14:23.858742+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:13.636158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857034+0000","last_change":"2024-09-21T06:14:23.855885+0000","last_active":"2024-09-21T06:14:23.857034+0000","last_peered":"2024-09-21T06:14:23.857034+0000","last_clean":"2024-09-21T06:14:23.857034+0000","last_became_active":"2024-09-21T06:14:23.855620+0000","last_became_peered":"2024-09-21T06:14:23.855620+0000","last_unstale":"2024-09-21T06:14:23.857034+0000","last_undegraded":"2024-09-21T06:14:23.857034+0000","last_fullsized":"2024-09-21T06:14:23.857034+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:40.409724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854962+0000","last_change":"2024-09-21T06:14:23.854529+0000","last_active":"2024-09-21T06:14:23.854962+0000","last_peered":"2024-09-21T06:14:23.854962+0000","last_clean":"2024-09-21T06:14:23.854962+0000","last_became_active":"2024-09-21T06:14:23.853231+0000","last_became_peered":"2024-09-21T06:14:23.853231+0000","last_unstale":"2024-09-21T06:14:23.854962+0000","last_undegraded":"2024-09-21T06:14:23.854962+0000","last_fullsized":"2024-09-21T06:14:23.854962+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:38.614363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847359+0000","last_change":"2024-09-21T06:14:23.846538+0000","last_active":"2024-09-21T06:14:23.847359+0000","last_peered":"2024-09-21T06:14:23.847359+0000","last_clean":"2024-09-21T06:14:23.847359+0000","last_became_active":"2024-09-21T06:14:23.846263+0000","last_became_peered":"2024-09-21T06:14:23.846263+0000","last_unstale":"2024-09-21T06:14:23.847359+0000","last_undegraded":"2024-09-21T06:14:23.847359+0000","last_fullsized":"2024-09-21T06:14:23.847359+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:17.580496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853704+0000","last_change":"2024-09-21T06:14:23.853041+0000","last_active":"2024-09-21T06:14:23.853704+0000","last_peered":"2024-09-21T06:14:23.853704+0000","last_clean":"2024-09-21T06:14:23.853704+0000","last_became_active":"2024-09-21T06:14:23.852206+0000","last_became_peered":"2024-09-21T06:14:23.852206+0000","last_unstale":"2024-09-21T06:14:23.853704+0000","last_undegraded":"2024-09-21T06:14:23.853704+0000","last_fullsized":"2024-09-21T06:14:23.853704+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:20.324412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861426+0000","last_change":"2024-09-21T06:14:23.861051+0000","last_active":"2024-09-21T06:14:23.861426+0000","last_peered":"2024-09-21T06:14:23.861426+0000","last_clean":"2024-09-21T06:14:23.861426+0000","last_became_active":"2024-09-21T06:14:23.860804+0000","last_became_peered":"2024-09-21T06:14:23.860804+0000","last_unstale":"2024-09-21T06:14:23.861426+0000","last_undegraded":"2024-09-21T06:14:23.861426+0000","last_fullsized":"2024-09-21T06:14:23.861426+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:40.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851166+0000","last_change":"2024-09-21T06:14:23.850519+0000","last_active":"2024-09-21T06:14:23.851166+0000","last_peered":"2024-09-21T06:14:23.851166+0000","last_clean":"2024-09-21T06:14:23.851166+0000","last_became_active":"2024-09-21T06:14:23.850182+0000","last_became_peered":"2024-09-21T06:14:23.850182+0000","last_unstale":"2024-09-21T06:14:23.851166+0000","last_undegraded":"2024-09-21T06:14:23.851166+0000","last_fullsized":"2024-09-21T06:14:23.851166+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:20.340562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.860268+0000","last_change":"2024-09-21T06:14:23.859089+0000","last_active":"2024-09-21T06:14:23.860268+0000","last_peered":"2024-09-21T06:14:23.860268+0000","last_clean":"2024-09-21T06:14:23.860268+0000","last_became_active":"2024-09-21T06:14:23.858475+0000","last_became_peered":"2024-09-21T06:14:23.858475+0000","last_unstale":"2024-09-21T06:14:23.860268+0000","last_undegraded":"2024-09-21T06:14:23.860268+0000","last_fullsized":"2024-09-21T06:14:23.860268+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:04.835607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857126+0000","last_change":"2024-09-21T06:14:23.856374+0000","last_active":"2024-09-21T06:14:23.857126+0000","last_peered":"2024-09-21T06:14:23.857126+0000","last_clean":"2024-09-21T06:14:23.857126+0000","last_became_active":"2024-09-21T06:14:23.853797+0000","last_became_peered":"2024-09-21T06:14:23.853797+0000","last_unstale":"2024-09-21T06:14:23.857126+0000","last_undegraded":"2024-09-21T06:14:23.857126+0000","last_fullsized":"2024-09-21T06:14:23.857126+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:28.333693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.852147+0000","last_change":"2024-09-21T06:14:23.851405+0000","last_active":"2024-09-21T06:14:23.852147+0000","last_peered":"2024-09-21T06:14:23.852147+0000","last_clean":"2024-09-21T06:14:23.852147+0000","last_became_active":"2024-09-21T06:14:23.850581+0000","last_became_peered":"2024-09-21T06:14:23.850581+0000","last_unstale":"2024-09-21T06:14:23.852147+0000","last_undegraded":"2024-09-21T06:14:23.852147+0000","last_fullsized":"2024-09-21T06:14:23.852147+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:18.614200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.849229+0000","last_change":"2024-09-21T06:14:23.849021+0000","last_active":"2024-09-21T06:14:23.849229+0000","last_peered":"2024-09-21T06:14:23.849229+0000","last_clean":"2024-09-21T06:14:23.849229+0000","last_became_active":"2024-09-21T06:14:23.848391+0000","last_became_peered":"2024-09-21T06:14:23.848391+0000","last_unstale":"2024-09-21T06:14:23.849229+0000","last_undegraded":"2024-09-21T06:14:23.849229+0000","last_fullsized":"2024-09-21T06:14:23.849229+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:13.337812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847318+0000","last_change":"2024-09-21T06:14:23.846102+0000","last_active":"2024-09-21T06:14:23.847318+0000","last_peered":"2024-09-21T06:14:23.847318+0000","last_clean":"2024-09-21T06:14:23.847318+0000","last_became_active":"2024-09-21T06:14:23.845844+0000","last_became_peered":"2024-09-21T06:14:23.845844+0000","last_unstale":"2024-09-21T06:14:23.847318+0000","last_undegraded":"2024-09-21T06:14:23.847318+0000","last_fullsized":"2024-09-21T06:14:23.847318+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:25.510672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851864+0000","last_change":"2024-09-21T06:14:23.851660+0000","last_active":"2024-09-21T06:14:23.851864+0000","last_peered":"2024-09-21T06:14:23.851864+0000","last_clean":"2024-09-21T06:14:23.851864+0000","last_became_active":"2024-09-21T06:14:23.851243+0000","last_became_peered":"2024-09-21T06:14:23.851243+0000","last_unstale":"2024-09-21T06:14:23.851864+0000","last_undegraded":"2024-09-21T06:14:23.851864+0000","last_fullsized":"2024-09-21T06:14:23.851864+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:34.742845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.849936+0000","last_change":"2024-09-21T06:14:23.849643+0000","last_active":"2024-09-21T06:14:23.849936+0000","last_peered":"2024-09-21T06:14:23.849936+0000","last_clean":"2024-09-21T06:14:23.849936+0000","last_became_active":"2024-09-21T06:14:23.847832+0000","last_became_peered":"2024-09-21T06:14:23.847832+0000","last_unstale":"2024-09-21T06:14:23.849936+0000","last_undegraded":"2024-09-21T06:14:23.849936+0000","last_fullsized":"2024-09-21T06:14:23.849936+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:31.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853818+0000","last_change":"2024-09-21T06:14:23.852951+0000","last_active":"2024-09-21T06:14:23.853818+0000","last_peered":"2024-09-21T06:14:23.853818+0000","last_clean":"2024-09-21T06:14:23.853818+0000","last_became_active":"2024-09-21T06:14:23.852615+0000","last_became_peered":"2024-09-21T06:14:23.852615+0000","last_unstale":"2024-09-21T06:14:23.853818+0000","last_undegraded":"2024-09-21T06:14:23.853818+0000","last_fullsized":"2024-09-21T06:14:23.853818+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:13.569019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866035+0000","last_change":"2024-09-21T06:14:23.865851+0000","last_active":"2024-09-21T06:14:23.866035+0000","last_peered":"2024-09-21T06:14:23.866035+0000","last_clean":"2024-09-21T06:14:23.866035+0000","last_became_active":"2024-09-21T06:14:23.864788+0000","last_became_peered":"2024-09-21T06:14:23.864788+0000","last_unstale":"2024-09-21T06:14:23.866035+0000","last_undegraded":"2024-09-21T06:14:23.866035+0000","last_fullsized":"2024-09-21T06:14:23.866035+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:36.612897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.869996+0000","last_change":"2024-09-21T06:14:23.868073+0000","last_active":"2024-09-21T06:14:23.869996+0000","last_peered":"2024-09-21T06:14:23.869996+0000","last_clean":"2024-09-21T06:14:23.869996+0000","last_became_active":"2024-09-21T06:14:23.867211+0000","last_became_peered":"2024-09-21T06:14:23.867211+0000","last_unstale":"2024-09-21T06:14:23.869996+0000","last_undegraded":"2024-09-21T06:14:23.869996+0000","last_fullsized":"2024-09-21T06:14:23.869996+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:07.133545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.867254+0000","last_change":"2024-09-21T06:14:23.865490+0000","last_active":"2024-09-21T06:14:23.867254+0000","last_peered":"2024-09-21T06:14:23.867254+0000","last_clean":"2024-09-21T06:14:23.867254+0000","last_became_active":"2024-09-21T06:14:23.865189+0000","last_became_peered":"2024-09-21T06:14:23.865189+0000","last_unstale":"2024-09-21T06:14:23.867254+0000","last_undegraded":"2024-09-21T06:14:23.867254+0000","last_fullsized":"2024-09-21T06:14:23.867254+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:40.291674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.859724+0000","last_change":"2024-09-21T06:14:23.859485+0000","last_active":"2024-09-21T06:14:23.859724+0000","last_peered":"2024-09-21T06:14:23.859724+0000","last_clean":"2024-09-21T06:14:23.859724+0000","last_became_active":"2024-09-21T06:14:23.859148+0000","last_became_peered":"2024-09-21T06:14:23.859148+0000","last_unstale":"2024-09-21T06:14:23.859724+0000","last_undegraded":"2024-09-21T06:14:23.859724+0000","last_fullsized":"2024-09-21T06:14:23.859724+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:47.649105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.858878+0000","last_change":"2024-09-21T06:14:23.853763+0000","last_active":"2024-09-21T06:14:23.858878+0000","last_peered":"2024-09-21T06:14:23.858878+0000","last_clean":"2024-09-21T06:14:23.858878+0000","last_became_active":"2024-09-21T06:14:23.853486+0000","last_became_peered":"2024-09-21T06:14:23.853486+0000","last_unstale":"2024-09-21T06:14:23.858878+0000","last_undegraded":"2024-09-21T06:14:23.858878+0000","last_fullsized":"2024-09-21T06:14:23.858878+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:52.129158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840905+0000","last_change":"2024-09-21T06:14:23.858927+0000","last_active":"2024-09-21T06:14:24.840905+0000","last_peered":"2024-09-21T06:14:24.840905+0000","last_clean":"2024-09-21T06:14:24.840905+0000","last_became_active":"2024-09-21T06:14:23.858633+0000","last_became_peered":"2024-09-21T06:14:23.858633+0000","last_unstale":"2024-09-21T06:14:24.840905+0000","last_undegraded":"2024-09-21T06:14:24.840905+0000","last_fullsized":"2024-09-21T06:14:24.840905+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:55.536246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864394+0000","last_change":"2024-09-21T06:14:23.862625+0000","last_active":"2024-09-21T06:14:23.864394+0000","last_peered":"2024-09-21T06:14:23.864394+0000","last_clean":"2024-09-21T06:14:23.864394+0000","last_became_active":"2024-09-21T06:14:23.861359+0000","last_became_peered":"2024-09-21T06:14:23.861359+0000","last_unstale":"2024-09-21T06:14:23.864394+0000","last_undegraded":"2024-09-21T06:14:23.864394+0000","last_fullsized":"2024-09-21T06:14:23.864394+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.578830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.860135+0000","last_change":"2024-09-21T06:14:23.858245+0000","last_active":"2024-09-21T06:14:23.860135+0000","last_peered":"2024-09-21T06:14:23.860135+0000","last_clean":"2024-09-21T06:14:23.860135+0000","last_became_active":"2024-09-21T06:14:23.857910+0000","last_became_peered":"2024-09-21T06:14:23.857910+0000","last_unstale":"2024-09-21T06:14:23.860135+0000","last_undegraded":"2024-09-21T06:14:23.860135+0000","last_fullsized":"2024-09-21T06:14:23.860135+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:54.148367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"161'4","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.867110+0000","last_change":"2024-09-21T06:14:22.854944+0000","last_active":"2024-09-21T06:14:23.867110+0000","last_peered":"2024-09-21T06:14:23.867110+0000","last_clean":"2024-09-21T06:14:23.867110+0000","last_became_active":"2024-09-21T06:14:22.854632+0000","last_became_peered":"2024-09-21T06:14:22.854632+0000","last_unstale":"2024-09-21T06:14:23.867110+0000","last_undegraded":"2024-09-21T06:14:23.867110+0000","last_fullsized":"2024-09-21T06:14:23.867110+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:44.233299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840918+0000","last_change":"2024-09-21T06:14:23.849751+0000","last_active":"2024-09-21T06:14:24.840918+0000","last_peered":"2024-09-21T06:14:24.840918+0000","last_clean":"2024-09-21T06:14:24.840918+0000","last_became_active":"2024-09-21T06:14:23.849489+0000","last_became_peered":"2024-09-21T06:14:23.849489+0000","last_unstale":"2024-09-21T06:14:24.840918+0000","last_undegraded":"2024-09-21T06:14:24.840918+0000","last_fullsized":"2024-09-21T06:14:24.840918+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:50.236326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840770+0000","last_change":"2024-09-21T06:14:22.844757+0000","last_active":"2024-09-21T06:14:24.840770+0000","last_peered":"2024-09-21T06:14:24.840770+0000","last_clean":"2024-09-21T06:14:24.840770+0000","last_became_active":"2024-09-21T06:14:22.843706+0000","last_became_peered":"2024-09-21T06:14:22.843706+0000","last_unstale":"2024-09-21T06:14:24.840770+0000","last_undegraded":"2024-09-21T06:14:24.840770+0000","last_fullsized":"2024-09-21T06:14:24.840770+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:06.239380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863627+0000","last_change":"2024-09-21T06:14:23.862876+0000","last_active":"2024-09-21T06:14:23.863627+0000","last_peered":"2024-09-21T06:14:23.863627+0000","last_clean":"2024-09-21T06:14:23.863627+0000","last_became_active":"2024-09-21T06:14:23.862438+0000","last_became_peered":"2024-09-21T06:14:23.862438+0000","last_unstale":"2024-09-21T06:14:23.863627+0000","last_undegraded":"2024-09-21T06:14:23.863627+0000","last_fullsized":"2024-09-21T06:14:23.863627+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:30.946761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866995+0000","last_change":"2024-09-21T06:14:22.846114+0000","last_active":"2024-09-21T06:14:23.866995+0000","last_peered":"2024-09-21T06:14:23.866995+0000","last_clean":"2024-09-21T06:14:23.866995+0000","last_became_active":"2024-09-21T06:14:22.845874+0000","last_became_peered":"2024-09-21T06:14:22.845874+0000","last_unstale":"2024-09-21T06:14:23.866995+0000","last_undegraded":"2024-09-21T06:14:23.866995+0000","last_fullsized":"2024-09-21T06:14:23.866995+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:18.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853730+0000","last_change":"2024-09-21T06:14:23.853385+0000","last_active":"2024-09-21T06:14:23.853730+0000","last_peered":"2024-09-21T06:14:23.853730+0000","last_clean":"2024-09-21T06:14:23.853730+0000","last_became_active":"2024-09-21T06:14:23.852686+0000","last_became_peered":"2024-09-21T06:14:23.852686+0000","last_unstale":"2024-09-21T06:14:23.853730+0000","last_undegraded":"2024-09-21T06:14:23.853730+0000","last_fullsized":"2024-09-21T06:14:23.853730+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:00.771191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864990+0000","last_change":"2024-09-21T06:14:22.854019+0000","last_active":"2024-09-21T06:14:23.864990+0000","last_peered":"2024-09-21T06:14:23.864990+0000","last_clean":"2024-09-21T06:14:23.864990+0000","last_became_active":"2024-09-21T06:14:22.853741+0000","last_became_peered":"2024-09-21T06:14:22.853741+0000","last_unstale":"2024-09-21T06:14:23.864990+0000","last_undegraded":"2024-09-21T06:14:23.864990+0000","last_fullsized":"2024-09-21T06:14:23.864990+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:35.887555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841132+0000","last_change":"2024-09-21T06:14:23.861165+0000","last_active":"2024-09-21T06:14:24.841132+0000","last_peered":"2024-09-21T06:14:24.841132+0000","last_clean":"2024-09-21T06:14:24.841132+0000","last_became_active":"2024-09-21T06:14:23.860756+0000","last_became_peered":"2024-09-21T06:14:23.860756+0000","last_unstale":"2024-09-21T06:14:24.841132+0000","last_undegraded":"2024-09-21T06:14:24.841132+0000","last_fullsized":"2024-09-21T06:14:24.841132+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:44.513084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864599+0000","last_change":"2024-09-21T06:14:22.857469+0000","last_active":"2024-09-21T06:14:23.864599+0000","last_peered":"2024-09-21T06:14:23.864599+0000","last_clean":"2024-09-21T06:14:23.864599+0000","last_became_active":"2024-09-21T06:14:22.854247+0000","last_became_peered":"2024-09-21T06:14:22.854247+0000","last_unstale":"2024-09-21T06:14:23.864599+0000","last_undegraded":"2024-09-21T06:14:23.864599+0000","last_fullsized":"2024-09-21T06:14:23.864599+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:45.568710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865674+0000","last_change":"2024-09-21T06:14:23.864401+0000","last_active":"2024-09-21T06:14:23.865674+0000","last_peered":"2024-09-21T06:14:23.865674+0000","last_clean":"2024-09-21T06:14:23.865674+0000","last_became_active":"2024-09-21T06:14:23.863711+0000","last_became_peered":"2024-09-21T06:14:23.863711+0000","last_unstale":"2024-09-21T06:14:23.865674+0000","last_undegraded":"2024-09-21T06:14:23.865674+0000","last_fullsized":"2024-09-21T06:14:23.865674+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:47.047336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861691+0000","last_change":"2024-09-21T06:14:22.851738+0000","last_active":"2024-09-21T06:14:23.861691+0000","last_peered":"2024-09-21T06:14:23.861691+0000","last_clean":"2024-09-21T06:14:23.861691+0000","last_became_active":"2024-09-21T06:14:22.851294+0000","last_became_peered":"2024-09-21T06:14:22.851294+0000","last_unstale":"2024-09-21T06:14:23.861691+0000","last_undegraded":"2024-09-21T06:14:23.861691+0000","last_fullsized":"2024-09-21T06:14:23.861691+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:14.728100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841224+0000","last_change":"2024-09-21T06:14:23.854564+0000","last_active":"2024-09-21T06:14:24.841224+0000","last_peered":"2024-09-21T06:14:24.841224+0000","last_clean":"2024-09-21T06:14:24.841224+0000","last_became_active":"2024-09-21T06:14:23.854272+0000","last_became_peered":"2024-09-21T06:14:23.854272+0000","last_unstale":"2024-09-21T06:14:24.841224+0000","last_undegraded":"2024-09-21T06:14:24.841224+0000","last_fullsized":"2024-09-21T06:14:24.841224+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:14.190315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.850319+0000","last_change":"2024-09-21T06:14:22.855158+0000","last_active":"2024-09-21T06:14:23.850319+0000","last_peered":"2024-09-21T06:14:23.850319+0000","last_clean":"2024-09-21T06:14:23.850319+0000","last_became_active":"2024-09-21T06:14:22.854886+0000","last_became_peered":"2024-09-21T06:14:22.854886+0000","last_unstale":"2024-09-21T06:14:23.850319+0000","last_undegraded":"2024-09-21T06:14:23.850319+0000","last_fullsized":"2024-09-21T06:14:23.850319+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:19.924600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854984+0000","last_change":"2024-09-21T06:14:23.854713+0000","last_active":"2024-09-21T06:14:23.854984+0000","last_peered":"2024-09-21T06:14:23.854984+0000","last_clean":"2024-09-21T06:14:23.854984+0000","last_became_active":"2024-09-21T06:14:23.854447+0000","last_became_peered":"2024-09-21T06:14:23.854447+0000","last_unstale":"2024-09-21T06:14:23.854984+0000","last_undegraded":"2024-09-21T06:14:23.854984+0000","last_fullsized":"2024-09-21T06:14:23.854984+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:13.496799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.845129+0000","last_change":"2024-09-21T06:14:22.845441+0000","last_active":"2024-09-21T06:14:23.845129+0000","last_peered":"2024-09-21T06:14:23.845129+0000","last_clean":"2024-09-21T06:14:23.845129+0000","last_became_active":"2024-09-21T06:14:22.845117+0000","last_became_peered":"2024-09-21T06:14:22.845117+0000","last_unstale":"2024-09-21T06:14:23.845129+0000","last_undegraded":"2024-09-21T06:14:23.845129+0000","last_fullsized":"2024-09-21T06:14:23.845129+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:14.774565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861248+0000","last_change":"2024-09-21T06:14:23.861040+0000","last_active":"2024-09-21T06:14:23.861248+0000","last_peered":"2024-09-21T06:14:23.861248+0000","last_clean":"2024-09-21T06:14:23.861248+0000","last_became_active":"2024-09-21T06:14:23.860736+0000","last_became_peered":"2024-09-21T06:14:23.860736+0000","last_unstale":"2024-09-21T06:14:23.861248+0000","last_undegraded":"2024-09-21T06:14:23.861248+0000","last_fullsized":"2024-09-21T06:14:23.861248+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:43.647841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841012+0000","last_change":"2024-09-21T06:14:22.854714+0000","last_active":"2024-09-21T06:14:24.841012+0000","last_peered":"2024-09-21T06:14:24.841012+0000","last_clean":"2024-09-21T06:14:24.841012+0000","last_became_active":"2024-09-21T06:14:22.854392+0000","last_became_peered":"2024-09-21T06:14:22.854392+0000","last_unstale":"2024-09-21T06:14:24.841012+0000","last_undegraded":"2024-09-21T06:14:24.841012+0000","last_fullsized":"2024-09-21T06:14:24.841012+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:52.946335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851196+0000","last_change":"2024-09-21T06:14:23.849308+0000","last_active":"2024-09-21T06:14:23.851196+0000","last_peered":"2024-09-21T06:14:23.851196+0000","last_clean":"2024-09-21T06:14:23.851196+0000","last_became_active":"2024-09-21T06:14:23.848763+0000","last_became_peered":"2024-09-21T06:14:23.848763+0000","last_unstale":"2024-09-21T06:14:23.851196+0000","last_undegraded":"2024-09-21T06:14:23.851196+0000","last_fullsized":"2024-09-21T06:14:23.851196+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:25.449761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.844234+0000","last_change":"2024-09-21T06:14:22.845704+0000","last_active":"2024-09-21T06:14:23.844234+0000","last_peered":"2024-09-21T06:14:23.844234+0000","last_clean":"2024-09-21T06:14:23.844234+0000","last_became_active":"2024-09-21T06:14:22.845452+0000","last_became_peered":"2024-09-21T06:14:22.845452+0000","last_unstale":"2024-09-21T06:14:23.844234+0000","last_undegraded":"2024-09-21T06:14:23.844234+0000","last_fullsized":"2024-09-21T06:14:23.844234+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.597631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.855704+0000","last_change":"2024-09-21T06:14:23.855307+0000","last_active":"2024-09-21T06:14:23.855704+0000","last_peered":"2024-09-21T06:14:23.855704+0000","last_clean":"2024-09-21T06:14:23.855704+0000","last_became_active":"2024-09-21T06:14:23.853884+0000","last_became_peered":"2024-09-21T06:14:23.853884+0000","last_unstale":"2024-09-21T06:14:23.855704+0000","last_undegraded":"2024-09-21T06:14:23.855704+0000","last_fullsized":"2024-09-21T06:14:23.855704+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:26.123818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"161'6","reported_seq":19,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.872160+0000","last_change":"2024-09-21T06:14:22.856701+0000","last_active":"2024-09-21T06:14:23.872160+0000","last_peered":"2024-09-21T06:14:23.872160+0000","last_clean":"2024-09-21T06:14:23.872160+0000","last_became_active":"2024-09-21T06:14:22.856419+0000","last_became_peered":"2024-09-21T06:14:22.856419+0000","last_unstale":"2024-09-21T06:14:23.872160+0000","last_undegraded":"2024-09-21T06:14:23.872160+0000","last_fullsized":"2024-09-21T06:14:23.872160+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:47.776163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865150+0000","last_change":"2024-09-21T06:14:23.864507+0000","last_active":"2024-09-21T06:14:23.865150+0000","last_peered":"2024-09-21T06:14:23.865150+0000","last_clean":"2024-09-21T06:14:23.865150+0000","last_became_active":"2024-09-21T06:14:23.864164+0000","last_became_peered":"2024-09-21T06:14:23.864164+0000","last_unstale":"2024-09-21T06:14:23.865150+0000","last_undegraded":"2024-09-21T06:14:23.865150+0000","last_fullsized":"2024-09-21T06:14:23.865150+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:51.620509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866471+0000","last_change":"2024-09-21T06:14:22.853865+0000","last_active":"2024-09-21T06:14:23.866471+0000","last_peered":"2024-09-21T06:14:23.866471+0000","last_clean":"2024-09-21T06:14:23.866471+0000","last_became_active":"2024-09-21T06:14:22.853444+0000","last_became_peered":"2024-09-21T06:14:22.853444+0000","last_unstale":"2024-09-21T06:14:23.866471+0000","last_undegraded":"2024-09-21T06:14:23.866471+0000","last_fullsized":"2024-09-21T06:14:23.866471+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:34.085863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840774+0000","last_change":"2024-09-21T06:14:23.849801+0000","last_active":"2024-09-21T06:14:24.840774+0000","last_peered":"2024-09-21T06:14:24.840774+0000","last_clean":"2024-09-21T06:14:24.840774+0000","last_became_active":"2024-09-21T06:14:23.849448+0000","last_became_peered":"2024-09-21T06:14:23.849448+0000","last_unstale":"2024-09-21T06:14:24.840774+0000","last_undegraded":"2024-09-21T06:14:24.840774+0000","last_fullsized":"2024-09-21T06:14:24.840774+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.223821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.856118+0000","last_change":"2024-09-21T06:14:22.852790+0000","last_active":"2024-09-21T06:14:23.856118+0000","last_peered":"2024-09-21T06:14:23.856118+0000","last_clean":"2024-09-21T06:14:23.856118+0000","last_became_active":"2024-09-21T06:14:22.851734+0000","last_became_peered":"2024-09-21T06:14:22.851734+0000","last_unstale":"2024-09-21T06:14:23.856118+0000","last_undegraded":"2024-09-21T06:14:23.856118+0000","last_fullsized":"2024-09-21T06:14:23.856118+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:42.579148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854938+0000","last_change":"2024-09-21T06:14:23.854216+0000","last_active":"2024-09-21T06:14:23.854938+0000","last_peered":"2024-09-21T06:14:23.854938+0000","last_clean":"2024-09-21T06:14:23.854938+0000","last_became_active":"2024-09-21T06:14:23.852896+0000","last_became_peered":"2024-09-21T06:14:23.852896+0000","last_unstale":"2024-09-21T06:14:23.854938+0000","last_undegraded":"2024-09-21T06:14:23.854938+0000","last_fullsized":"2024-09-21T06:14:23.854938+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:15.031680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.851114+0000","last_change":"2024-09-21T06:14:22.853230+0000","last_active":"2024-09-21T06:14:23.851114+0000","last_peered":"2024-09-21T06:14:23.851114+0000","last_clean":"2024-09-21T06:14:23.851114+0000","last_became_active":"2024-09-21T06:14:22.852766+0000","last_became_peered":"2024-09-21T06:14:22.852766+0000","last_unstale":"2024-09-21T06:14:23.851114+0000","last_undegraded":"2024-09-21T06:14:23.851114+0000","last_fullsized":"2024-09-21T06:14:23.851114+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:47.513051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864829+0000","last_change":"2024-09-21T06:14:23.863883+0000","last_active":"2024-09-21T06:14:23.864829+0000","last_peered":"2024-09-21T06:14:23.864829+0000","last_clean":"2024-09-21T06:14:23.864829+0000","last_became_active":"2024-09-21T06:14:23.863554+0000","last_became_peered":"2024-09-21T06:14:23.863554+0000","last_unstale":"2024-09-21T06:14:23.864829+0000","last_undegraded":"2024-09-21T06:14:23.864829+0000","last_fullsized":"2024-09-21T06:14:23.864829+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:20.136755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"161'8","reported_seq":21,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.870919+0000","last_change":"2024-09-21T06:14:22.852460+0000","last_active":"2024-09-21T06:14:23.870919+0000","last_peered":"2024-09-21T06:14:23.870919+0000","last_clean":"2024-09-21T06:14:23.870919+0000","last_became_active":"2024-09-21T06:14:22.852201+0000","last_became_peered":"2024-09-21T06:14:22.852201+0000","last_unstale":"2024-09-21T06:14:23.870919+0000","last_undegraded":"2024-09-21T06:14:23.870919+0000","last_fullsized":"2024-09-21T06:14:23.870919+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:19.474286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854832+0000","last_change":"2024-09-21T06:14:23.854635+0000","last_active":"2024-09-21T06:14:23.854832+0000","last_peered":"2024-09-21T06:14:23.854832+0000","last_clean":"2024-09-21T06:14:23.854832+0000","last_became_active":"2024-09-21T06:14:23.854274+0000","last_became_peered":"2024-09-21T06:14:23.854274+0000","last_unstale":"2024-09-21T06:14:23.854832+0000","last_undegraded":"2024-09-21T06:14:23.854832+0000","last_fullsized":"2024-09-21T06:14:23.854832+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:57.506797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.862937+0000","last_change":"2024-09-21T06:14:22.850153+0000","last_active":"2024-09-21T06:14:23.862937+0000","last_peered":"2024-09-21T06:14:23.862937+0000","last_clean":"2024-09-21T06:14:23.862937+0000","last_became_active":"2024-09-21T06:14:22.849173+0000","last_became_peered":"2024-09-21T06:14:22.849173+0000","last_unstale":"2024-09-21T06:14:23.862937+0000","last_undegraded":"2024-09-21T06:14:23.862937+0000","last_fullsized":"2024-09-21T06:14:23.862937+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:13.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857462+0000","last_change":"2024-09-21T06:14:23.857268+0000","last_active":"2024-09-21T06:14:23.857462+0000","last_peered":"2024-09-21T06:14:23.857462+0000","last_clean":"2024-09-21T06:14:23.857462+0000","last_became_active":"2024-09-21T06:14:23.857033+0000","last_became_peered":"2024-09-21T06:14:23.857033+0000","last_unstale":"2024-09-21T06:14:23.857462+0000","last_undegraded":"2024-09-21T06:14:23.857462+0000","last_fullsized":"2024-09-21T06:14:23.857462+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:08.810473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.841285+0000","last_change":"2024-09-21T06:14:22.850445+0000","last_active":"2024-09-21T06:14:24.841285+0000","last_peered":"2024-09-21T06:14:24.841285+0000","last_clean":"2024-09-21T06:14:24.841285+0000","last_became_active":"2024-09-21T06:14:22.850096+0000","last_became_peered":"2024-09-21T06:14:22.850096+0000","last_unstale":"2024-09-21T06:14:24.841285+0000","last_undegraded":"2024-09-21T06:14:24.841285+0000","last_fullsized":"2024-09-21T06:14:24.841285+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.489566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865800+0000","last_change":"2024-09-21T06:14:23.865145+0000","last_active":"2024-09-21T06:14:23.865800+0000","last_peered":"2024-09-21T06:14:23.865800+0000","last_clean":"2024-09-21T06:14:23.865800+0000","last_became_active":"2024-09-21T06:14:23.864621+0000","last_became_peered":"2024-09-21T06:14:23.864621+0000","last_unstale":"2024-09-21T06:14:23.865800+0000","last_undegraded":"2024-09-21T06:14:23.865800+0000","last_fullsized":"2024-09-21T06:14:23.865800+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:19.567629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"161'1","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866171+0000","last_change":"2024-09-21T06:14:22.853846+0000","last_active":"2024-09-21T06:14:23.866171+0000","last_peered":"2024-09-21T06:14:23.866171+0000","last_clean":"2024-09-21T06:14:23.866171+0000","last_became_active":"2024-09-21T06:14:22.853304+0000","last_became_peered":"2024-09-21T06:14:22.853304+0000","last_unstale":"2024-09-21T06:14:23.866171+0000","last_undegraded":"2024-09-21T06:14:23.866171+0000","last_fullsized":"2024-09-21T06:14:23.866171+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:42.315700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865736+0000","last_change":"2024-09-21T06:14:23.865321+0000","last_active":"2024-09-21T06:14:23.865736+0000","last_peered":"2024-09-21T06:14:23.865736+0000","last_clean":"2024-09-21T06:14:23.865736+0000","last_became_active":"2024-09-21T06:14:23.864413+0000","last_became_peered":"2024-09-21T06:14:23.864413+0000","last_unstale":"2024-09-21T06:14:23.865736+0000","last_undegraded":"2024-09-21T06:14:23.865736+0000","last_fullsized":"2024-09-21T06:14:23.865736+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:09.446816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840858+0000","last_change":"2024-09-21T06:14:22.857020+0000","last_active":"2024-09-21T06:14:24.840858+0000","last_peered":"2024-09-21T06:14:24.840858+0000","last_clean":"2024-09-21T06:14:24.840858+0000","last_became_active":"2024-09-21T06:14:22.856757+0000","last_became_peered":"2024-09-21T06:14:22.856757+0000","last_unstale":"2024-09-21T06:14:24.840858+0000","last_undegraded":"2024-09-21T06:14:24.840858+0000","last_fullsized":"2024-09-21T06:14:24.840858+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:09.018864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.858907+0000","last_change":"2024-09-21T06:14:23.853749+0000","last_active":"2024-09-21T06:14:23.858907+0000","last_peered":"2024-09-21T06:14:23.858907+0000","last_clean":"2024-09-21T06:14:23.858907+0000","last_became_active":"2024-09-21T06:14:23.853471+0000","last_became_peered":"2024-09-21T06:14:23.853471+0000","last_unstale":"2024-09-21T06:14:23.858907+0000","last_undegraded":"2024-09-21T06:14:23.858907+0000","last_fullsized":"2024-09-21T06:14:23.858907+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:26.514643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.868995+0000","last_change":"2024-09-21T06:14:22.853419+0000","last_active":"2024-09-21T06:14:23.868995+0000","last_peered":"2024-09-21T06:14:23.868995+0000","last_clean":"2024-09-21T06:14:23.868995+0000","last_became_active":"2024-09-21T06:14:22.853075+0000","last_became_peered":"2024-09-21T06:14:22.853075+0000","last_unstale":"2024-09-21T06:14:23.868995+0000","last_undegraded":"2024-09-21T06:14:23.868995+0000","last_fullsized":"2024-09-21T06:14:23.868995+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:13.545425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.864072+0000","last_change":"2024-09-21T06:14:23.858868+0000","last_active":"2024-09-21T06:14:23.864072+0000","last_peered":"2024-09-21T06:14:23.864072+0000","last_clean":"2024-09-21T06:14:23.864072+0000","last_became_active":"2024-09-21T06:14:23.858488+0000","last_became_peered":"2024-09-21T06:14:23.858488+0000","last_unstale":"2024-09-21T06:14:23.864072+0000","last_undegraded":"2024-09-21T06:14:23.864072+0000","last_fullsized":"2024-09-21T06:14:23.864072+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:24.880613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.841884+0000","last_change":"2024-09-21T06:14:22.854824+0000","last_active":"2024-09-21T06:14:23.841884+0000","last_peered":"2024-09-21T06:14:23.841884+0000","last_clean":"2024-09-21T06:14:23.841884+0000","last_became_active":"2024-09-21T06:14:22.854557+0000","last_became_peered":"2024-09-21T06:14:22.854557+0000","last_unstale":"2024-09-21T06:14:23.841884+0000","last_undegraded":"2024-09-21T06:14:23.841884+0000","last_fullsized":"2024-09-21T06:14:23.841884+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:24.686727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.850687+0000","last_change":"2024-09-21T06:14:23.850363+0000","last_active":"2024-09-21T06:14:23.850687+0000","last_peered":"2024-09-21T06:14:23.850687+0000","last_clean":"2024-09-21T06:14:23.850687+0000","last_became_active":"2024-09-21T06:14:23.850073+0000","last_became_peered":"2024-09-21T06:14:23.850073+0000","last_unstale":"2024-09-21T06:14:23.850687+0000","last_undegraded":"2024-09-21T06:14:23.850687+0000","last_fullsized":"2024-09-21T06:14:23.850687+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:26.031772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.842681+0000","last_change":"2024-09-21T06:14:22.842633+0000","last_active":"2024-09-21T06:14:23.842681+0000","last_peered":"2024-09-21T06:14:23.842681+0000","last_clean":"2024-09-21T06:14:23.842681+0000","last_became_active":"2024-09-21T06:14:22.841825+0000","last_became_peered":"2024-09-21T06:14:22.841825+0000","last_unstale":"2024-09-21T06:14:23.842681+0000","last_undegraded":"2024-09-21T06:14:23.842681+0000","last_fullsized":"2024-09-21T06:14:23.842681+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:59.679932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863741+0000","last_change":"2024-09-21T06:14:23.857656+0000","last_active":"2024-09-21T06:14:23.863741+0000","last_peered":"2024-09-21T06:14:23.863741+0000","last_clean":"2024-09-21T06:14:23.863741+0000","last_became_active":"2024-09-21T06:14:23.857351+0000","last_became_peered":"2024-09-21T06:14:23.857351+0000","last_unstale":"2024-09-21T06:14:23.863741+0000","last_undegraded":"2024-09-21T06:14:23.863741+0000","last_fullsized":"2024-09-21T06:14:23.863741+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:09.928668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.856357+0000","last_change":"2024-09-21T06:14:22.852365+0000","last_active":"2024-09-21T06:14:23.856357+0000","last_peered":"2024-09-21T06:14:23.856357+0000","last_clean":"2024-09-21T06:14:23.856357+0000","last_became_active":"2024-09-21T06:14:22.851414+0000","last_became_peered":"2024-09-21T06:14:22.851414+0000","last_unstale":"2024-09-21T06:14:23.856357+0000","last_undegraded":"2024-09-21T06:14:23.856357+0000","last_fullsized":"2024-09-21T06:14:23.856357+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:08.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854917+0000","last_change":"2024-09-21T06:14:23.853887+0000","last_active":"2024-09-21T06:14:23.854917+0000","last_peered":"2024-09-21T06:14:23.854917+0000","last_clean":"2024-09-21T06:14:23.854917+0000","last_became_active":"2024-09-21T06:14:23.852510+0000","last_became_peered":"2024-09-21T06:14:23.852510+0000","last_unstale":"2024-09-21T06:14:23.854917+0000","last_undegraded":"2024-09-21T06:14:23.854917+0000","last_fullsized":"2024-09-21T06:14:23.854917+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:54.688247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"161'2","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866903+0000","last_change":"2024-09-21T06:14:22.851799+0000","last_active":"2024-09-21T06:14:23.866903+0000","last_peered":"2024-09-21T06:14:23.866903+0000","last_clean":"2024-09-21T06:14:23.866903+0000","last_became_active":"2024-09-21T06:14:22.850937+0000","last_became_peered":"2024-09-21T06:14:22.850937+0000","last_unstale":"2024-09-21T06:14:23.866903+0000","last_undegraded":"2024-09-21T06:14:23.866903+0000","last_fullsized":"2024-09-21T06:14:23.866903+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:01.814832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.865179+0000","last_change":"2024-09-21T06:14:23.864871+0000","last_active":"2024-09-21T06:14:23.865179+0000","last_peered":"2024-09-21T06:14:23.865179+0000","last_clean":"2024-09-21T06:14:23.865179+0000","last_became_active":"2024-09-21T06:14:23.864254+0000","last_became_peered":"2024-09-21T06:14:23.864254+0000","last_unstale":"2024-09-21T06:14:23.865179+0000","last_undegraded":"2024-09-21T06:14:23.865179+0000","last_fullsized":"2024-09-21T06:14:23.865179+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:57.909242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.846417+0000","last_change":"2024-09-21T06:14:22.856163+0000","last_active":"2024-09-21T06:14:23.846417+0000","last_peered":"2024-09-21T06:14:23.846417+0000","last_clean":"2024-09-21T06:14:23.846417+0000","last_became_active":"2024-09-21T06:14:22.855546+0000","last_became_peered":"2024-09-21T06:14:22.855546+0000","last_unstale":"2024-09-21T06:14:23.846417+0000","last_undegraded":"2024-09-21T06:14:23.846417+0000","last_fullsized":"2024-09-21T06:14:23.846417+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:56.860600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840996+0000","last_change":"2024-09-21T06:14:23.850953+0000","last_active":"2024-09-21T06:14:24.840996+0000","last_peered":"2024-09-21T06:14:24.840996+0000","last_clean":"2024-09-21T06:14:24.840996+0000","last_became_active":"2024-09-21T06:14:23.850704+0000","last_became_peered":"2024-09-21T06:14:23.850704+0000","last_unstale":"2024-09-21T06:14:24.840996+0000","last_undegraded":"2024-09-21T06:14:24.840996+0000","last_fullsized":"2024-09-21T06:14:24.840996+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:37.429765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847304+0000","last_change":"2024-09-21T06:14:22.857916+0000","last_active":"2024-09-21T06:14:23.847304+0000","last_peered":"2024-09-21T06:14:23.847304+0000","last_clean":"2024-09-21T06:14:23.847304+0000","last_became_active":"2024-09-21T06:14:22.857303+0000","last_became_peered":"2024-09-21T06:14:22.857303+0000","last_unstale":"2024-09-21T06:14:23.847304+0000","last_undegraded":"2024-09-21T06:14:23.847304+0000","last_fullsized":"2024-09-21T06:14:23.847304+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:46.784501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.857170+0000","last_change":"2024-09-21T06:14:23.856783+0000","last_active":"2024-09-21T06:14:23.857170+0000","last_peered":"2024-09-21T06:14:23.857170+0000","last_clean":"2024-09-21T06:14:23.857170+0000","last_became_active":"2024-09-21T06:14:23.855854+0000","last_became_peered":"2024-09-21T06:14:23.855854+0000","last_unstale":"2024-09-21T06:14:23.857170+0000","last_undegraded":"2024-09-21T06:14:23.857170+0000","last_fullsized":"2024-09-21T06:14:23.857170+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:33.083280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.850566+0000","last_change":"2024-09-21T06:14:22.853999+0000","last_active":"2024-09-21T06:14:23.850566+0000","last_peered":"2024-09-21T06:14:23.850566+0000","last_clean":"2024-09-21T06:14:23.850566+0000","last_became_active":"2024-09-21T06:14:22.853740+0000","last_became_peered":"2024-09-21T06:14:22.853740+0000","last_unstale":"2024-09-21T06:14:23.850566+0000","last_undegraded":"2024-09-21T06:14:23.850566+0000","last_fullsized":"2024-09-21T06:14:23.850566+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:24.973588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.869971+0000","last_change":"2024-09-21T06:14:23.867699+0000","last_active":"2024-09-21T06:14:23.869971+0000","last_peered":"2024-09-21T06:14:23.869971+0000","last_clean":"2024-09-21T06:14:23.869971+0000","last_became_active":"2024-09-21T06:14:23.866794+0000","last_became_peered":"2024-09-21T06:14:23.866794+0000","last_unstale":"2024-09-21T06:14:23.869971+0000","last_undegraded":"2024-09-21T06:14:23.869971+0000","last_fullsized":"2024-09-21T06:14:23.869971+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:46.465490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.847245+0000","last_change":"2024-09-21T06:14:22.847976+0000","last_active":"2024-09-21T06:14:23.847245+0000","last_peered":"2024-09-21T06:14:23.847245+0000","last_clean":"2024-09-21T06:14:23.847245+0000","last_became_active":"2024-09-21T06:14:22.846528+0000","last_became_peered":"2024-09-21T06:14:22.846528+0000","last_unstale":"2024-09-21T06:14:23.847245+0000","last_undegraded":"2024-09-21T06:14:23.847245+0000","last_fullsized":"2024-09-21T06:14:23.847245+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:59.392559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.861827+0000","last_change":"2024-09-21T06:14:23.861590+0000","last_active":"2024-09-21T06:14:23.861827+0000","last_peered":"2024-09-21T06:14:23.861827+0000","last_clean":"2024-09-21T06:14:23.861827+0000","last_became_active":"2024-09-21T06:14:23.861157+0000","last_became_peered":"2024-09-21T06:14:23.861157+0000","last_unstale":"2024-09-21T06:14:23.861827+0000","last_undegraded":"2024-09-21T06:14:23.861827+0000","last_fullsized":"2024-09-21T06:14:23.861827+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:13.362825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.845394+0000","last_change":"2024-09-21T06:14:22.851331+0000","last_active":"2024-09-21T06:14:23.845394+0000","last_peered":"2024-09-21T06:14:23.845394+0000","last_clean":"2024-09-21T06:14:23.845394+0000","last_became_active":"2024-09-21T06:14:22.850586+0000","last_became_peered":"2024-09-21T06:14:22.850586+0000","last_unstale":"2024-09-21T06:14:23.845394+0000","last_undegraded":"2024-09-21T06:14:23.845394+0000","last_fullsized":"2024-09-21T06:14:23.845394+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:30.274352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853672+0000","last_change":"2024-09-21T06:14:23.852277+0000","last_active":"2024-09-21T06:14:23.853672+0000","last_peered":"2024-09-21T06:14:23.853672+0000","last_clean":"2024-09-21T06:14:23.853672+0000","last_became_active":"2024-09-21T06:14:23.852000+0000","last_became_peered":"2024-09-21T06:14:23.852000+0000","last_unstale":"2024-09-21T06:14:23.853672+0000","last_undegraded":"2024-09-21T06:14:23.853672+0000","last_fullsized":"2024-09-21T06:14:23.853672+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:53.004336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.853079+0000","last_change":"2024-09-21T06:14:22.853566+0000","last_active":"2024-09-21T06:14:23.853079+0000","last_peered":"2024-09-21T06:14:23.853079+0000","last_clean":"2024-09-21T06:14:23.853079+0000","last_became_active":"2024-09-21T06:14:22.853244+0000","last_became_peered":"2024-09-21T06:14:22.853244+0000","last_unstale":"2024-09-21T06:14:23.853079+0000","last_undegraded":"2024-09-21T06:14:23.853079+0000","last_fullsized":"2024-09-21T06:14:23.853079+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:26.044174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.854895+0000","last_change":"2024-09-21T06:14:23.853589+0000","last_active":"2024-09-21T06:14:23.854895+0000","last_peered":"2024-09-21T06:14:23.854895+0000","last_clean":"2024-09-21T06:14:23.854895+0000","last_became_active":"2024-09-21T06:14:23.852092+0000","last_became_peered":"2024-09-21T06:14:23.852092+0000","last_unstale":"2024-09-21T06:14:23.854895+0000","last_undegraded":"2024-09-21T06:14:23.854895+0000","last_fullsized":"2024-09-21T06:14:23.854895+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:07.582085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-21T06:14:24.840899+0000","last_change":"2024-09-21T06:14:22.845054+0000","last_active":"2024-09-21T06:14:24.840899+0000","last_peered":"2024-09-21T06:14:24.840899+0000","last_clean":"2024-09-21T06:14:24.840899+0000","last_became_active":"2024-09-21T06:14:22.844087+0000","last_became_peered":"2024-09-21T06:14:22.844087+0000","last_unstale":"2024-09-21T06:14:24.840899+0000","last_undegraded":"2024-09-21T06:14:24.840899+0000","last_fullsized":"2024-09-21T06:14:24.840899+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:09.961286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.863941+0000","last_change":"2024-09-21T06:14:23.857968+0000","last_active":"2024-09-21T06:14:23.863941+0000","last_peered":"2024-09-21T06:14:23.863941+0000","last_clean":"2024-09-21T06:14:23.863941+0000","last_became_active":"2024-09-21T06:14:23.857712+0000","last_became_peered":"2024-09-21T06:14:23.857712+0000","last_unstale":"2024-09-21T06:14:23.863941+0000","last_undegraded":"2024-09-21T06:14:23.863941+0000","last_fullsized":"2024-09-21T06:14:23.863941+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:22.828189+0000","last_clean_scrub_stamp":"2024-09-21T06:14:22.828189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:36.340639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"161'3","reported_seq":16,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.866945+0000","last_change":"2024-09-21T06:14:22.850485+0000","last_active":"2024-09-21T06:14:23.866945+0000","last_peered":"2024-09-21T06:14:23.866945+0000","last_clean":"2024-09-21T06:14:23.866945+0000","last_became_active":"2024-09-21T06:14:22.850068+0000","last_became_peered":"2024-09-21T06:14:22.850068+0000","last_unstale":"2024-09-21T06:14:23.866945+0000","last_undegraded":"2024-09-21T06:14:23.866945+0000","last_fullsized":"2024-09-21T06:14:23.866945+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:14:21.825425+0000","last_clean_scrub_stamp":"2024-09-21T06:14:21.825425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:14.624706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":401,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-21T06:14:23.841965+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:14:23.841965+0000","last_peered":"2024-09-21T06:14:23.841965+0000","last_clean":"2024-09-21T06:14:23.841965+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:14:23.841965+0000","last_undegraded":"2024-09-21T06:14:23.841965+0000","last_fullsized":"2024-09-21T06:14:23.841965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194430,"statfs":{"total":200000000,"available":199096783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193852,"statfs":{"total":200000000,"available":198504859,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193860,"statfs":{"total":200000000,"available":198513280,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":875,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194437,"statfs":{"total":200000000,"available":199103648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:14:28.773 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:14:28.773 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:14:29.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.042+0000 7fa111c00640 1 -- 172.21.15.118:0/2996878119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c0d0160 msgr2=0x7fa10c0d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.042+0000 7fa111c00640 1 --2- 172.21.15.118:0/2996878119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c0d0160 0x7fa10c0d0570 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa10c1607e0 tx=0x7fa0f402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.042+0000 7fa111c00640 1 -- 172.21.15.118:0/2996878119 shutdown_connections 2024-09-21T06:14:29.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.042+0000 7fa111c00640 1 --2- 172.21.15.118:0/2996878119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c0d0160 0x7fa10c0d0570 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.042+0000 7fa111c00640 1 --2- 172.21.15.118:0/2996878119 >> v2:172.21.15.149:3300/0 conn(0x7fa10c070730 0x7fa10c070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.042+0000 7fa111c00640 1 --2- 172.21.15.118:0/2996878119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa10c15e470 0x7fa10c15e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.042+0000 7fa111c00640 1 -- 172.21.15.118:0/2996878119 >> 172.21.15.118:0/2996878119 conn(0x7fa10c0d1620 msgr2=0x7fa10c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:29.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.043+0000 7fa111c00640 1 -- 172.21.15.118:0/2996878119 shutdown_connections 2024-09-21T06:14:29.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.043+0000 7fa111c00640 1 -- 172.21.15.118:0/2996878119 wait complete. 2024-09-21T06:14:29.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.045+0000 7fa111c00640 1 Processor -- start 2024-09-21T06:14:29.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.045+0000 7fa111c00640 1 -- start start 2024-09-21T06:14:29.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.046+0000 7fa111c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c070730 0x7fa10c13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.046+0000 7fa111c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa10c0d0160 0x7fa10c1e7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.046+0000 7fa111c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa10c15e470 0x7fa10c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.046+0000 7fa111c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c15d8b0 con 0x7fa10c070730 2024-09-21T06:14:29.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.046+0000 7fa111c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c15d730 con 0x7fa10c15e470 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.046+0000 7fa111c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa10c15da30 con 0x7fa10c0d0160 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c070730 0x7fa10c13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c070730 0x7fa10c13f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43006/0 (socket says 172.21.15.118:43006) 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 -- 172.21.15.118:0/804407831 learned_addr learned my addr 172.21.15.118:0/804407831 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa103400640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa10c0d0160 0x7fa10c1e7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 -- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa10c0d0160 msgr2=0x7fa10c1e7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa10c0d0160 0x7fa10c1e7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa111200640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa10c15e470 0x7fa10c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 -- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa10c15e470 msgr2=0x7fa10c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa10c15e470 0x7fa10c141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 -- 172.21.15.118:0/804407831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c13fd90 con 0x7fa10c070730 2024-09-21T06:14:29.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa111200640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa10c15e470 0x7fa10c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:29.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.047+0000 7fa10be00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c070730 0x7fa10c13f300 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00eb00 tx=0x7fa0fc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:29.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.048+0000 7fa108c00640 1 -- 172.21.15.118:0/804407831 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc004b20 con 0x7fa10c070730 2024-09-21T06:14:29.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.048+0000 7fa108c00640 1 -- 172.21.15.118:0/804407831 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0fc004ce0 con 0x7fa10c070730 2024-09-21T06:14:29.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.048+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c140070 con 0x7fa10c070730 2024-09-21T06:14:29.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.048+0000 7fa108c00640 1 -- 172.21.15.118:0/804407831 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc005280 con 0x7fa10c070730 2024-09-21T06:14:29.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.048+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c140630 con 0x7fa10c070730 2024-09-21T06:14:29.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.049+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c15dff0 con 0x7fa10c070730 2024-09-21T06:14:29.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.050+0000 7fa108c00640 1 -- 172.21.15.118:0/804407831 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0fc005420 con 0x7fa10c070730 2024-09-21T06:14:29.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.051+0000 7fa108c00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0e8078b90 0x7fa0e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.051+0000 7fa108c00640 1 -- 172.21.15.118:0/804407831 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7fa0fc09baa0 con 0x7fa10c070730 2024-09-21T06:14:29.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.052+0000 7fa103400640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0e8078b90 0x7fa0e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.052+0000 7fa103400640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0e8078b90 0x7fa0e807b0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4033000 tx=0x7fa0f4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:29.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.056+0000 7fa108c00640 1 -- 172.21.15.118:0/804407831 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa0fc063f70 con 0x7fa10c070730 2024-09-21T06:14:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.312+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa10c06e330 con 0x7fa10c070730 2024-09-21T06:14:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.316+0000 7fa108c00640 1 -- 172.21.15.118:0/804407831 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fa0fc063870 con 0x7fa10c070730 2024-09-21T06:14:29.317 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:14:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:14:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:14:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:14:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:14:29.318 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0e8078b90 msgr2=0x7fa0e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0e8078b90 0x7fa0e807b0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4033000 tx=0x7fa0f4004730 comp rx=0 tx=0).stop 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c070730 msgr2=0x7fa10c13f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c070730 0x7fa10c13f300 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00eb00 tx=0x7fa0fc00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 shutdown_connections 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa10c15e470 0x7fa10c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa0e8078b90 0x7fa0e807b0a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa10c0d0160 0x7fa10c1e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 --2- 172.21.15.118:0/804407831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa10c070730 0x7fa10c13f300 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.318+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 >> 172.21.15.118:0/804407831 conn(0x7fa10c0d1620 msgr2=0x7fa10c074160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.319+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 shutdown_connections 2024-09-21T06:14:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.319+0000 7fa111c00640 1 -- 172.21.15.118:0/804407831 wait complete. 2024-09-21T06:14:29.344 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 -- 172.21.15.118:0/3811800430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c8413fae0 msgr2=0x7f6c840d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 --2- 172.21.15.118:0/3811800430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c8413fae0 0x7f6c840d0e80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f6c840cedb0 tx=0x7f6c7802a560 comp rx=0 tx=0).stop 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 -- 172.21.15.118:0/3811800430 shutdown_connections 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 --2- 172.21.15.118:0/3811800430 >> v2:172.21.15.149:3300/0 conn(0x7f6c8413fef0 0x7f6c840d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 --2- 172.21.15.118:0/3811800430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c8413fae0 0x7f6c840d0e80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 -- 172.21.15.118:0/3811800430 >> 172.21.15.118:0/3811800430 conn(0x7f6c8406d110 msgr2=0x7f6c8406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 -- 172.21.15.118:0/3811800430 shutdown_connections 2024-09-21T06:14:29.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.561+0000 7f6c8c200640 1 -- 172.21.15.118:0/3811800430 wait complete. 2024-09-21T06:14:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.563+0000 7f6c8c200640 1 Processor -- start 2024-09-21T06:14:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.564+0000 7f6c8c200640 1 -- start start 2024-09-21T06:14:29.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8413fae0 0x7f6c84154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c8413fef0 0x7f6c841f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8c200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84142730 0x7f6c840b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8c200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6c840cfa70 con 0x7f6c84142730 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c840cf8f0 con 0x7f6c8413fae0 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6c840cfbf0 con 0x7f6c8413fef0 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8a200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84142730 0x7f6c840b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8a200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84142730 0x7f6c840b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43014/0 (socket says 172.21.15.118:43014) 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.565+0000 7f6c8a200640 1 -- 172.21.15.118:0/4216865572 learned_addr learned my addr 172.21.15.118:0/4216865572 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c89800640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8413fae0 0x7f6c84154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c88e00640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c8413fef0 0x7f6c841f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c8a200640 1 -- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c8413fef0 msgr2=0x7f6c841f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c8a200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c8413fef0 0x7f6c841f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c8a200640 1 -- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8413fae0 msgr2=0x7f6c84154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c8a200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8413fae0 0x7f6c84154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c8a200640 1 -- 172.21.15.118:0/4216865572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c841f6e90 con 0x7f6c84142730 2024-09-21T06:14:29.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c8a200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84142730 0x7f6c840b4ab0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c6e0 tx=0x7f6c7c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:29.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c81600640 1 -- 172.21.15.118:0/4216865572 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c003b70 con 0x7f6c84142730 2024-09-21T06:14:29.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.566+0000 7f6c81600640 1 -- 172.21.15.118:0/4216865572 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c7c003d30 con 0x7f6c84142730 2024-09-21T06:14:29.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.567+0000 7f6c81600640 1 -- 172.21.15.118:0/4216865572 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c005330 con 0x7f6c84142730 2024-09-21T06:14:29.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.567+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c840b5620 con 0x7f6c84142730 2024-09-21T06:14:29.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.567+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8413d530 con 0x7f6c84142730 2024-09-21T06:14:29.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.568+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c840b5390 con 0x7f6c84142730 2024-09-21T06:14:29.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.569+0000 7f6c81600640 1 -- 172.21.15.118:0/4216865572 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c7c0054d0 con 0x7f6c84142730 2024-09-21T06:14:29.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.570+0000 7f6c81600640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6c64078b90 0x7f6c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:29.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.570+0000 7f6c81600640 1 -- 172.21.15.118:0/4216865572 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f6c7c09aa10 con 0x7f6c84142730 2024-09-21T06:14:29.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.571+0000 7f6c89800640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6c64078b90 0x7f6c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:29.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.571+0000 7f6c89800640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6c64078b90 0x7f6c6407b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6c78033000 tx=0x7f6c78004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:29.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.575+0000 7f6c81600640 1 -- 172.21.15.118:0/4216865572 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6c841f6e90 con 0x7f6c84142730 2024-09-21T06:14:29.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.797+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c841424d0 con 0x7f6c84142730 2024-09-21T06:14:29.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.798+0000 7f6c81600640 1 -- 172.21.15.118:0/4216865572 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5239 (secure 0 0 0) 0x7f6c841424d0 con 0x7f6c84142730 2024-09-21T06:14:29.799 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:29.799 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"btime":"2024-09-21T06:14:26:871516+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:14:23.335795+0000","modified":"2024-09-21T06:14:26.364763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4151315485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4151315485},{"type":"v1","addr":"172.21.15.118:6835","nonce":4151315485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7806,"qdb_cluster":[7806]},"id":10}]} 2024-09-21T06:14:29.800 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 86 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6c64078b90 msgr2=0x7f6c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6c64078b90 0x7f6c6407b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6c78033000 tx=0x7f6c78004730 comp rx=0 tx=0).stop 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84142730 msgr2=0x7f6c840b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84142730 0x7f6c840b4ab0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c6e0 tx=0x7f6c7c00cba0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 shutdown_connections 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84142730 0x7f6c840b4ab0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6c64078b90 0x7f6c6407b0a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c8413fef0 0x7f6c841f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 --2- 172.21.15.118:0/4216865572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c8413fae0 0x7f6c84154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:29.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 >> 172.21.15.118:0/4216865572 conn(0x7f6c8406d110 msgr2=0x7f6c841609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:29.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 shutdown_connections 2024-09-21T06:14:29.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:29.800+0000 7f6c8c200640 1 -- 172.21.15.118:0/4216865572 wait complete. 2024-09-21T06:14:30.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:14:23.335795+0000', 'modified': '2024-09-21T06:14:26.364763+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7806}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7806': {'gid': 7806, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/4151315485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 4151315485}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 4151315485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7806, 'qdb_cluster': [7806]} 2024-09-21T06:14:30.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:14:30.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 -- 172.21.15.118:0/754361269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440d0de0 msgr2=0x7f34440d11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 --2- 172.21.15.118:0/754361269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440d0de0 0x7f34440d11f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3430005fd0 tx=0x7f343002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 -- 172.21.15.118:0/754361269 shutdown_connections 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 --2- 172.21.15.118:0/754361269 >> v2:172.21.15.149:3300/0 conn(0x7f34440cf1e0 0x7f34440cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 --2- 172.21.15.118:0/754361269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440d0de0 0x7f34440d11f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 -- 172.21.15.118:0/754361269 >> 172.21.15.118:0/754361269 conn(0x7f344406d110 msgr2=0x7f344406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 -- 172.21.15.118:0/754361269 shutdown_connections 2024-09-21T06:14:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.449+0000 7f344a800640 1 -- 172.21.15.118:0/754361269 wait complete. 2024-09-21T06:14:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.451+0000 7f344a800640 1 Processor -- start 2024-09-21T06:14:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.451+0000 7f344a800640 1 -- start start 2024-09-21T06:14:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f344a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440cf1e0 0x7f344415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f344a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34440d0de0 0x7f3444145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f344a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f344413fc50 0x7f344415f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f344a800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f34440cfec0 con 0x7f344413fc50 2024-09-21T06:14:30.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f344a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34440cfd40 con 0x7f34440d0de0 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f344a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34440d0040 con 0x7f34440cf1e0 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f344413fc50 0x7f344415f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f344413fc50 0x7f344415f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43028/0 (socket says 172.21.15.118:43028) 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 -- 172.21.15.118:0/562179663 learned_addr learned my addr 172.21.15.118:0/562179663 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3442a00640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34440d0de0 0x7f3444145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443400640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440cf1e0 0x7f344415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 -- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440cf1e0 msgr2=0x7f344415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440cf1e0 0x7f344415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 -- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34440d0de0 msgr2=0x7f3444145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34440d0de0 0x7f3444145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443e00640 1 -- 172.21.15.118:0/562179663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3444143af0 con 0x7f344413fc50 2024-09-21T06:14:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.453+0000 7f3443400640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440cf1e0 0x7f344415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:30.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.454+0000 7f3443e00640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f344413fc50 0x7f344415f580 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f343c00ea70 tx=0x7f343c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.454+0000 7f343b400640 1 -- 172.21.15.118:0/562179663 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c00ce40 con 0x7f344413fc50 2024-09-21T06:14:30.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.454+0000 7f343b400640 1 -- 172.21.15.118:0/562179663 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f343c004c10 con 0x7f344413fc50 2024-09-21T06:14:30.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.454+0000 7f343b400640 1 -- 172.21.15.118:0/562179663 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c005020 con 0x7f344413fc50 2024-09-21T06:14:30.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.454+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3444143dd0 con 0x7f344413fc50 2024-09-21T06:14:30.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.454+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3444144390 con 0x7f344413fc50 2024-09-21T06:14:30.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.458+0000 7f343b400640 1 -- 172.21.15.118:0/562179663 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f343c0051c0 con 0x7f344413fc50 2024-09-21T06:14:30.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.459+0000 7f3451809740 1 Processor -- start 2024-09-21T06:14:30.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.459+0000 7f3451809740 1 -- start start 2024-09-21T06:14:30.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.459+0000 7f343b400640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3424078b90 0x7f342407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.459+0000 7f343b400640 1 -- 172.21.15.118:0/562179663 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f343c09bb20 con 0x7f344413fc50 2024-09-21T06:14:30.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.459+0000 7f3442a00640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3424078b90 0x7f342407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3442a00640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3424078b90 0x7f342407b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3430033000 tx=0x7f3430004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fd8270 0x5578a93c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3451809740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8faf3b0 0x5578a9378f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fb7590 0x5578a93794a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3451809740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5578a9302430 con 0x5578a8faf3b0 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5578a92f25d0 con 0x5578a8fb7590 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5578a92e1a00 con 0x5578a8fd8270 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3442a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8faf3b0 0x5578a9378f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3442a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8faf3b0 0x5578a9378f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43036/0 (socket says 172.21.15.118:43036) 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3442a00640 1 -- 172.21.15.118:0/3702662606 learned_addr learned my addr 172.21.15.118:0/3702662606 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3443400640 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fd8270 0x5578a93c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.460+0000 7f3443e00640 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fb7590 0x5578a93794a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f3442a00640 1 -- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fd8270 msgr2=0x5578a93c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f3442a00640 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fd8270 0x5578a93c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f3442a00640 1 -- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fb7590 msgr2=0x5578a93794a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f3442a00640 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fb7590 0x5578a93794a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f3442a00640 1 -- 172.21.15.118:0/3702662606 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a92aa520 con 0x5578a8faf3b0 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f3443e00640 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fb7590 0x5578a93794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f3442a00640 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8faf3b0 0x5578a9378f60 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f343002abc0 tx=0x7f343003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1428a1389fc942 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f342fe00640 1 -- 172.21.15.118:0/3702662606 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430035040 con 0x5578a8faf3b0 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f342fe00640 1 -- 172.21.15.118:0/3702662606 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f343004c070 con 0x5578a8faf3b0 2024-09-21T06:14:30.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.461+0000 7f342fe00640 1 -- 172.21.15.118:0/3702662606 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430003ae0 con 0x5578a8faf3b0 2024-09-21T06:14:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 -- 172.21.15.118:0/3702662606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8faf3b0 msgr2=0x5578a9378f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8faf3b0 0x5578a9378f60 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f343002abc0 tx=0x7f343003c000 comp rx=0 tx=0).stop 2024-09-21T06:14:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 -- 172.21.15.118:0/3702662606 shutdown_connections 2024-09-21T06:14:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fb7590 0x5578a93794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8faf3b0 0x5578a9378f60 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 --2- 172.21.15.118:0/3702662606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fd8270 0x5578a93c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 -- 172.21.15.118:0/3702662606 >> 172.21.15.118:0/3702662606 conn(0x5578a8fcc3c0 msgr2=0x5578a937e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 -- 172.21.15.118:0/3702662606 shutdown_connections 2024-09-21T06:14:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.462+0000 7f3451809740 1 -- 172.21.15.118:0/3702662606 wait complete. 2024-09-21T06:14:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.463+0000 7f3451809740 1 -- start start 2024-09-21T06:14:30.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.463+0000 7f3451809740 1 Processor -- start 2024-09-21T06:14:30.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93d8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3451809740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a9392730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fd8270 0x5578a93d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3451809740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5578a9288330 con 0x5578a8fb7590 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5578a92e5810 con 0x5578a8fd8270 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5578a9052620 con 0x5578a8faf3b0 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3451809740 10 client.0 _ll_register_callbacks cb 0x5578a928d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3442a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a9392730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3442a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a9392730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43044/0 (socket says 172.21.15.118:43044) 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3442a00640 1 -- 172.21.15.118:0/1734143666 learned_addr learned my addr 172.21.15.118:0/1734143666 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3443400640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93d8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3442a00640 1 -- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 msgr2=0x5578a93d8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.465+0000 7f3443e00640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fd8270 0x5578a93d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3442a00640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93d8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3442a00640 1 -- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fd8270 msgr2=0x5578a93d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3442a00640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fd8270 0x5578a93d7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3442a00640 1 -- 172.21.15.118:0/1734143666 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a9043850 con 0x5578a8fb7590 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3443400640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93d8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3443e00640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fd8270 0x5578a93d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3442a00640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a9392730 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f34300057c0 tx=0x7f3430003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c915fa705f97069 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f342cc00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f342cc00640 1 -- 172.21.15.118:0/1734143666 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34300047a0 con 0x5578a8fb7590 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f342cc00640 1 -- 172.21.15.118:0/1734143666 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f3430004940 con 0x5578a8fb7590 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f343004c070 con 0x5578a8fb7590 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f342cc00640 1 -- 172.21.15.118:0/1734143666 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f3430004b40 con 0x5578a8fb7590 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3451809740 10 client.7911 fetch_fsmap learned FSMap version 86 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.466+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x5578a90ba6b0 con 0x5578a8fb7590 2024-09-21T06:14:30.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f342cc00640 1 -- 172.21.15.118:0/1734143666 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f343004c070 con 0x5578a8fb7590 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f342cc00640 1 -- 172.21.15.118:0/1734143666 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f343003a040 con 0x5578a8fb7590 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f3451809740 10 client.7911 fetch_fsmap finished waiting for FSMap version 86 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f3451809740 10 client.7911 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f3451809740 20 client.7911 populate_metadata read hostname 'smithi118' 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f3451809740 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f96e40 0x5578a93c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f3451809740 4 client.7911 mds_command: new command op to 7806 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 --> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578a92f4520 con 0x5578a8f96e40 2024-09-21T06:14:30.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.467+0000 7f3443400640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f96e40 0x5578a93c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.468+0000 7f3443400640 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f96e40 0x5578a93c5830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429c653bc904009f server_cookie=d32df1178daa2066 in_seq=0 out_seq=0 2024-09-21T06:14:30.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.468+0000 7f342cc00640 10 client.7911 ms_handle_connect on v2:172.21.15.118:6833/4151315485 2024-09-21T06:14:30.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.468+0000 7f342cc00640 1 -- 172.21.15.118:0/1734143666 <== mds.0 v2:172.21.15.118:6833/4151315485 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578a92f4520 con 0x5578a8f96e40 2024-09-21T06:14:30.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.468+0000 7f342cc00640 10 client.7911 handle_command_reply: tid=0 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.468+0000 7f3451809740 1 client.7911 shutdown 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 msgr2=0x5578a9392730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a9392730 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f34300057c0 tx=0x7f3430003d00 comp rx=0 tx=0).stop 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 shutdown_connections 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f96e40 0x5578a93c5830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fd8270 0x5578a93d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a9392730 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f342cc00640 0 client.7911 ms_handle_reset on v2:172.21.15.118:6833/4151315485 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 --2- 172.21.15.118:0/1734143666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93d8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 >> 172.21.15.118:0/1734143666 conn(0x5578a8fcc3c0 msgr2=0x5578a937e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 shutdown_connections 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 1 -- 172.21.15.118:0/1734143666 wait complete. 2024-09-21T06:14:30.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.469+0000 7f3451809740 20 client.7911 trim_cache size 0 max 16384 2024-09-21T06:14:30.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.488+0000 7f3451809740 1 Processor -- start 2024-09-21T06:14:30.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.488+0000 7f3451809740 1 -- start start 2024-09-21T06:14:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.489+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fcc3c0 0x5578a943edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.489+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.489+0000 7f3451809740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a93c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.489+0000 7f3451809740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3444074ca0 con 0x5578a8fb7590 2024-09-21T06:14:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.489+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3444074000 con 0x5578a8fcc3c0 2024-09-21T06:14:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.489+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3444074650 con 0x5578a8faf3b0 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a93c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a93c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43050/0 (socket says 172.21.15.118:43050) 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 -- 172.21.15.118:0/2606164950 learned_addr learned my addr 172.21.15.118:0/2606164950 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3442a00640 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443400640 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fcc3c0 0x5578a943edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 -- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 msgr2=0x5578a93c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 -- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fcc3c0 msgr2=0x5578a943edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fcc3c0 0x5578a943edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 -- 172.21.15.118:0/2606164950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a943f300 con 0x5578a8fb7590 2024-09-21T06:14:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443400640 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fcc3c0 0x5578a943edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.490+0000 7f3443e00640 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a93c6220 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f343c00ea40 tx=0x7f343c0634c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedd460966d0f2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f342f400640 1 -- 172.21.15.118:0/2606164950 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c0683d0 con 0x5578a8fb7590 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f342f400640 1 -- 172.21.15.118:0/2606164950 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f343c06d280 con 0x5578a8fb7590 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f342f400640 1 -- 172.21.15.118:0/2606164950 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c06cdf0 con 0x5578a8fb7590 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 -- 172.21.15.118:0/2606164950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 msgr2=0x5578a93c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a93c6220 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f343c00ea40 tx=0x7f343c0634c0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 -- 172.21.15.118:0/2606164950 shutdown_connections 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fb7590 0x5578a93c6220 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8faf3b0 0x5578a93c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 --2- 172.21.15.118:0/2606164950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8fcc3c0 0x5578a943edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 -- 172.21.15.118:0/2606164950 >> 172.21.15.118:0/2606164950 conn(0x5578a93c31a0 msgr2=0x5578a93c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 -- 172.21.15.118:0/2606164950 shutdown_connections 2024-09-21T06:14:30.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.491+0000 7f3451809740 1 -- 172.21.15.118:0/2606164950 wait complete. 2024-09-21T06:14:30.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.492+0000 7f3451809740 1 -- start start 2024-09-21T06:14:30.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.493+0000 7f3451809740 1 Processor -- start 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8faf3b0 0x5578a93df210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3451809740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fb7590 0x5578a943cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3451809740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fcc3c0 0x5578a939e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3451809740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x5578a93c69b0 con 0x5578a8fcc3c0 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5578a93c6c10 con 0x5578a8faf3b0 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3451809740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5578a93d7ef0 con 0x5578a8fb7590 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3451809740 10 client.0 _ll_register_callbacks cb 0x7f3434007c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3443e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fcc3c0 0x5578a939e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3443e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fcc3c0 0x5578a939e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43052/0 (socket says 172.21.15.118:43052) 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3443e00640 1 -- 172.21.15.118:0/915889142 learned_addr learned my addr 172.21.15.118:0/915889142 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3442a00640 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fb7590 0x5578a943cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.494+0000 7f3443400640 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8faf3b0 0x5578a93df210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3443e00640 1 -- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fb7590 msgr2=0x5578a943cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3443e00640 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fb7590 0x5578a943cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3443e00640 1 -- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8faf3b0 msgr2=0x5578a93df210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3443e00640 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8faf3b0 0x5578a93df210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3443e00640 1 -- 172.21.15.118:0/915889142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a937ee50 con 0x5578a8fcc3c0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3443e00640 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fcc3c0 0x5578a939e360 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f343c05f900 tx=0x7f343c0632d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf8f096cf181dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f342cc00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f342cc00640 1 -- 172.21.15.118:0/915889142 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c01d040 con 0x5578a8fcc3c0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f342cc00640 1 -- 172.21.15.118:0/915889142 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f343c062b50 con 0x5578a8fcc3c0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f343c06d280 con 0x5578a8fcc3c0 2024-09-21T06:14:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f342cc00640 1 -- 172.21.15.118:0/915889142 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f343c0683d0 con 0x5578a8fcc3c0 2024-09-21T06:14:30.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3451809740 10 client.7917 fetch_fsmap learned FSMap version 86 2024-09-21T06:14:30.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.495+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x5578a943d3e0 con 0x5578a8fcc3c0 2024-09-21T06:14:30.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f342cc00640 1 -- 172.21.15.118:0/915889142 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f343c06d280 con 0x5578a8fcc3c0 2024-09-21T06:14:30.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f342cc00640 1 -- 172.21.15.118:0/915889142 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f343c05f240 con 0x5578a8fcc3c0 2024-09-21T06:14:30.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f3451809740 10 client.7917 fetch_fsmap finished waiting for FSMap version 86 2024-09-21T06:14:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f3451809740 10 client.7917 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:14:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f3451809740 20 client.7917 populate_metadata read hostname 'smithi118' 2024-09-21T06:14:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f3451809740 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f6c280 0x5578a939e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f3451809740 4 client.7917 mds_command: new command op to 7806 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 --> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] -- command(tid 0: {"prefix": "status"}) -- 0x5578a92effd0 con 0x5578a8f6c280 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.496+0000 7f3443400640 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f6c280 0x5578a939e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3443400640 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f6c280 0x5578a939e8a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcf76185366c501d server_cookie=cae184d30c2bbe96 in_seq=0 out_seq=0 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f342cc00640 10 client.7917 ms_handle_connect on v2:172.21.15.118:6833/4151315485 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f342cc00640 1 -- 172.21.15.118:0/915889142 <== mds.0 v2:172.21.15.118:6833/4151315485 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5578a92effd0 con 0x5578a8f6c280 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f342cc00640 10 client.7917 handle_command_reply: tid=0 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 client.7917 shutdown 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fcc3c0 msgr2=0x5578a939e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fcc3c0 0x5578a939e360 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f343c05f900 tx=0x7f343c0632d0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 shutdown_connections 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:6833/4151315485,v1:172.21.15.118:6835/4151315485] conn(0x5578a8f6c280 0x5578a939e8a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5578a8fcc3c0 0x5578a939e360 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f342cc00640 0 client.7917 ms_handle_reset on v2:172.21.15.118:6833/4151315485 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5578a8fb7590 0x5578a943cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 --2- 172.21.15.118:0/915889142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5578a8faf3b0 0x5578a93df210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.497+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 >> 172.21.15.118:0/915889142 conn(0x5578a93c31a0 msgr2=0x5578a937e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 shutdown_connections 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f3451809740 1 -- 172.21.15.118:0/915889142 wait complete. 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f3451809740 20 client.7917 trim_cache size 0 max 16384 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 7806, 2024-09-21T06:14:30.502 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 6.6594239440000003, 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 86, 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 162, 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 162, 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.682083013 2024-09-21T06:14:30.503 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3424078b90 msgr2=0x7f342407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3424078b90 0x7f342407b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3430033000 tx=0x7f3430004730 comp rx=0 tx=0).stop 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f344413fc50 msgr2=0x7f344415f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f344413fc50 0x7f344415f580 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f343c00ea70 tx=0x7f343c00ef30 comp rx=0 tx=0).stop 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 shutdown_connections 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f344413fc50 0x7f344415f580 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34440d0de0 0x7f3444145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3424078b90 0x7f342407b0a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 --2- 172.21.15.118:0/562179663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34440cf1e0 0x7f344415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.498+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 >> 172.21.15.118:0/562179663 conn(0x7f344406d110 msgr2=0x7f34440b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.499+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 shutdown_connections 2024-09-21T06:14:30.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.499+0000 7f344a800640 1 -- 172.21.15.118:0/562179663 wait complete. 2024-09-21T06:14:30.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:14:30.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 -- 172.21.15.118:0/3466931496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6260 msgr2=0x7f4e3c0b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 --2- 172.21.15.118:0/3466931496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6260 0x7f4e3c0b6670 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0b5f50 tx=0x7f4e2402a5b0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 -- 172.21.15.118:0/3466931496 shutdown_connections 2024-09-21T06:14:30.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 --2- 172.21.15.118:0/3466931496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6260 0x7f4e3c0b6670 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 --2- 172.21.15.118:0/3466931496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e3c0b7bd0 0x7f4e3c0d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 -- 172.21.15.118:0/3466931496 >> 172.21.15.118:0/3466931496 conn(0x7f4e3c0d2900 msgr2=0x7f4e3c0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 -- 172.21.15.118:0/3466931496 shutdown_connections 2024-09-21T06:14:30.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.740+0000 7f4e3b200640 1 -- 172.21.15.118:0/3466931496 wait complete. 2024-09-21T06:14:30.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.742+0000 7f4e3b200640 1 Processor -- start 2024-09-21T06:14:30.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.742+0000 7f4e3b200640 1 -- start start 2024-09-21T06:14:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e3c0b6260 0x7f4e3c147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6bb0 0x7f4e3c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e3c0b7bd0 0x7f4e3c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0b3470 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0b32f0 con 0x7f4e3c0b6260 2024-09-21T06:14:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c0b35f0 con 0x7f4e3c0b7bd0 2024-09-21T06:14:30.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6bb0 0x7f4e3c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6bb0 0x7f4e3c158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43068/0 (socket says 172.21.15.118:43068) 2024-09-21T06:14:30.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 -- 172.21.15.118:0/4286215622 learned_addr learned my addr 172.21.15.118:0/4286215622 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e39e00640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e3c0b6260 0x7f4e3c147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 -- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e3c0b7bd0 msgr2=0x7f4e3c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3a800640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e3c0b7bd0 0x7f4e3c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e3c0b7bd0 0x7f4e3c0b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 -- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e3c0b6260 msgr2=0x7f4e3c147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e3c0b6260 0x7f4e3c147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e31400640 1 -- 172.21.15.118:0/4286215622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c15dd40 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e39e00640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e3c0b6260 0x7f4e3c147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.744+0000 7f4e3a800640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e3c0b7bd0 0x7f4e3c0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:30.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.745+0000 7f4e31400640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6bb0 0x7f4e3c158e40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4e24000c00 tx=0x7f4e24003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.745+0000 7f4e32a00640 1 -- 172.21.15.118:0/4286215622 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2403e030 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.745+0000 7f4e32a00640 1 -- 172.21.15.118:0/4286215622 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e24003e00 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.745+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3c15cca0 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.745+0000 7f4e32a00640 1 -- 172.21.15.118:0/4286215622 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24035040 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.745+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3c15d260 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.746+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e3c0b3aa0 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.747+0000 7f4e32a00640 1 -- 172.21.15.118:0/4286215622 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e24041030 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.748+0000 7f4e32a00640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e18078bc0 0x7f4e1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.749+0000 7f4e32a00640 1 -- 172.21.15.118:0/4286215622 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f4e240bb530 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.749+0000 7f4e39e00640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e18078bc0 0x7f4e1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:30.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.750+0000 7f4e39e00640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e18078bc0 0x7f4e1807b0d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c005fd0 tx=0x7f4e2c005d20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:30.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.753+0000 7f4e32a00640 1 -- 172.21.15.118:0/4286215622 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4e240838d0 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.981+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e3c147930 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.981+0000 7f4e32a00640 1 -- 172.21.15.118:0/4286215622 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) ==== 53+0+73 (secure 0 0 0) 0x7f4e240831d0 con 0x7f4e3c0b6bb0 2024-09-21T06:14:30.983 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e18078bc0 msgr2=0x7f4e1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e18078bc0 0x7f4e1807b0d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c005fd0 tx=0x7f4e2c005d20 comp rx=0 tx=0).stop 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6bb0 msgr2=0x7f4e3c158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6bb0 0x7f4e3c158e40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4e24000c00 tx=0x7f4e24003910 comp rx=0 tx=0).stop 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 shutdown_connections 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4e18078bc0 0x7f4e1807b0d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e3c0b7bd0 0x7f4e3c0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e3c0b6bb0 0x7f4e3c158e40 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 --2- 172.21.15.118:0/4286215622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e3c0b6260 0x7f4e3c147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:30.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.983+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 >> 172.21.15.118:0/4286215622 conn(0x7f4e3c0d2900 msgr2=0x7f4e3c1e9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:30.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.984+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 shutdown_connections 2024-09-21T06:14:30.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:30.984+0000 7f4e3b200640 1 -- 172.21.15.118:0/4286215622 wait complete. 2024-09-21T06:14:31.008 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:14:31.009 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:14:31.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:31.010 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:14:31.046 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:14:31.046 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:14:31.046 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:14:31.046 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:31.046 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42114sec preferred_lft 42114sec 2024-09-21T06:14:31.047 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:14:31.048 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:31.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:31.049 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:14:31.140 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:14:31.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:31.143 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:14:31.179 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:14:31.180 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:14:31.180 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:14:31.180 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:14:31.180 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:14:31.180 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:14:31.180 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:14:31.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:14:31.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:14:31.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:14:31.180 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:14:31.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:14:31.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:14:31.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:31.375 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:14:31.411 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:14:31.411 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:14:31.411 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:14:31.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:31.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:14:31.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:14:31.507 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:14:31.543 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:14:31.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:14:31.543 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:14:31.617 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:14:31.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:31.617 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:14:31.812 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:14:31.812 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:14:31.845 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:14:31.845 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:14:31.846 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:14:31.846 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:14:31.846 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:14:31.847 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:14:31.847 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:14:31.847 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:14:31.847 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:14:31.847 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:14:31.851 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:14:31.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:31.851 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:14:31.909 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:14:31.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:14:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:14:32.006 INFO:teuthology.orchestra.run.smithi118.stdout:client7537 2024-09-21T06:14:32.006 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:14:32.006 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:32.041 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:14:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.301+0000 7fa936600640 1 -- 172.21.15.118:0/4204324706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 msgr2=0x7fa918003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.301+0000 7fa936600640 1 --2- 172.21.15.118:0/4204324706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 0x7fa918003e70 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fa92400c290 tx=0x7fa918005830 comp rx=0 tx=0).stop 2024-09-21T06:14:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.301+0000 7fa935c00640 1 -- 172.21.15.118:0/4204324706 reap_dead start 2024-09-21T06:14:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.301+0000 7fa936600640 1 -- 172.21.15.118:0/4204324706 shutdown_connections 2024-09-21T06:14:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.301+0000 7fa936600640 1 -- 172.21.15.118:0/4204324706 >> 172.21.15.118:0/4204324706 conn(0x7fa93006d6e0 msgr2=0x7fa9300b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.301+0000 7fa936600640 1 -- 172.21.15.118:0/4204324706 shutdown_connections 2024-09-21T06:14:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.301+0000 7fa936600640 1 -- 172.21.15.118:0/4204324706 wait complete. 2024-09-21T06:14:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.303+0000 7fa936600640 1 Processor -- start 2024-09-21T06:14:32.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.304+0000 7fa936600640 1 -- start start 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa936600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 0x7fa93015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa936600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9301e55e0 0x7fa93015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa936600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa93015dcc0 0x7fa93015e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa936600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa9300b4680 con 0x7fa918003a00 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa936600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9300cf780 con 0x7fa9301e55e0 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa936600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa9300b4800 con 0x7fa93015dcc0 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa935200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 0x7fa93015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa935200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 0x7fa93015c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43084/0 (socket says 172.21.15.118:43084) 2024-09-21T06:14:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa935200640 1 -- 172.21.15.118:0/2243746258 learned_addr learned my addr 172.21.15.118:0/2243746258 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa92fe00640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9301e55e0 0x7fa93015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.305+0000 7fa935c00640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa93015dcc0 0x7fa93015e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa935200640 1 -- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa93015dcc0 msgr2=0x7fa93015e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa935200640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa93015dcc0 0x7fa93015e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa935200640 1 -- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9301e55e0 msgr2=0x7fa93015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa935200640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9301e55e0 0x7fa93015b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa935200640 1 -- 172.21.15.118:0/2243746258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93015ca20 con 0x7fa918003a00 2024-09-21T06:14:32.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa935200640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 0x7fa93015c1d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fa92400c290 tx=0x7fa924006d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:32.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa92cc00640 1 -- 172.21.15.118:0/2243746258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa924031040 con 0x7fa918003a00 2024-09-21T06:14:32.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa92cc00640 1 -- 172.21.15.118:0/2243746258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9240035f0 con 0x7fa918003a00 2024-09-21T06:14:32.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa93015cd00 con 0x7fa918003a00 2024-09-21T06:14:32.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa92cc00640 1 -- 172.21.15.118:0/2243746258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa924003a00 con 0x7fa918003a00 2024-09-21T06:14:32.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.306+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9301e59f0 con 0x7fa918003a00 2024-09-21T06:14:32.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.307+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9301e5c50 con 0x7fa918003a00 2024-09-21T06:14:32.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.309+0000 7fa92cc00640 1 -- 172.21.15.118:0/2243746258 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa924034070 con 0x7fa918003a00 2024-09-21T06:14:32.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.310+0000 7fa92cc00640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa910078b90 0x7fa91007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:32.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.310+0000 7fa92cc00640 1 -- 172.21.15.118:0/2243746258 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7fa9240badd0 con 0x7fa918003a00 2024-09-21T06:14:32.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.310+0000 7fa92fe00640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa910078b90 0x7fa91007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:32.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.311+0000 7fa92fe00640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa910078b90 0x7fa91007b0a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa93015f1c0 tx=0x7fa91c005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.314+0000 7fa92cc00640 1 -- 172.21.15.118:0/2243746258 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa924083170 con 0x7fa918003a00 2024-09-21T06:14:32.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.533+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa9300b4140 con 0x7fa918003a00 2024-09-21T06:14:32.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.533+0000 7fa92cc00640 1 -- 172.21.15.118:0/2243746258 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) ==== 53+0+73 (secure 0 0 0) 0x7fa924082a70 con 0x7fa918003a00 2024-09-21T06:14:32.535 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:14:32.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa910078b90 msgr2=0x7fa91007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:32.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa910078b90 0x7fa91007b0a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa93015f1c0 tx=0x7fa91c005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 msgr2=0x7fa93015c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 0x7fa93015c1d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fa92400c290 tx=0x7fa924006d70 comp rx=0 tx=0).stop 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 shutdown_connections 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa910078b90 0x7fa91007b0a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa93015dcc0 0x7fa93015e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9301e55e0 0x7fa93015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 --2- 172.21.15.118:0/2243746258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa918003a00 0x7fa93015c1d0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 >> 172.21.15.118:0/2243746258 conn(0x7fa93006d6e0 msgr2=0x7fa930072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 shutdown_connections 2024-09-21T06:14:32.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:32.536+0000 7fa936600640 1 -- 172.21.15.118:0/2243746258 wait complete. 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:14:32.559 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:14:32.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:32.561 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:14:32.601 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:14:32.601 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:14:32.601 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:14:32.601 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:14:32.602 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42087sec preferred_lft 42087sec 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:14:32.603 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:14:32.604 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:32.604 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:14:32.604 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:14:32.604 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:14:32.604 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:14:32.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:32.605 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:14:32.702 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:14:32.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:32.705 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:14:32.741 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:14:32.742 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:14:32.742 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:14:32.742 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:14:32.742 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:14:32.742 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:14:32.742 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:14:32.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:14:32.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:14:32.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:14:32.743 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:14:32.859 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:14:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:14:32.932 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:14:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:14:32.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:32.941 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:14:32.976 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:14:32.977 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:14:32.977 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:14:32.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:32.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:14:33.073 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:14:33.073 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:14:33.107 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:14:33.108 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:14:33.108 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:14:33.182 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:14:33.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:33.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:14:33.376 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:14:33.376 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:14:33.409 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:14:33.409 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:14:33.409 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:14:33.410 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:14:33.410 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:14:33.410 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:14:33.411 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:14:33.411 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:14:33.411 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:14:33.411 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:14:33.414 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:14:33.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:14:33.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:14:33.469 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:14:33.547 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:14:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:14:33.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:14:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:14:33.558 INFO:teuthology.orchestra.run.smithi149.stdout:client7932 2024-09-21T06:14:33.559 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:14:33.559 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:14:33.594 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:14:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.823+0000 7f488ae00640 1 -- 172.21.15.118:0/2997138781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48840cfe30 msgr2=0x7f486c0039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.823+0000 7f488ae00640 1 --2- 172.21.15.118:0/2997138781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48840cfe30 0x7f486c0039e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f487800c560 tx=0x7f486c005830 comp rx=0 tx=0).stop 2024-09-21T06:14:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.823+0000 7f488a400640 1 -- 172.21.15.118:0/2997138781 reap_dead start 2024-09-21T06:14:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.824+0000 7f488ae00640 1 -- 172.21.15.118:0/2997138781 shutdown_connections 2024-09-21T06:14:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.824+0000 7f488ae00640 1 -- 172.21.15.118:0/2997138781 >> 172.21.15.118:0/2997138781 conn(0x7f488406d6e0 msgr2=0x7f48840b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.824+0000 7f488ae00640 1 -- 172.21.15.118:0/2997138781 shutdown_connections 2024-09-21T06:14:33.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.824+0000 7f488ae00640 1 -- 172.21.15.118:0/2997138781 wait complete. 2024-09-21T06:14:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.826+0000 7f488ae00640 1 Processor -- start 2024-09-21T06:14:33.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.826+0000 7f488ae00640 1 -- start start 2024-09-21T06:14:33.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.827+0000 7f488ae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48840cfe30 0x7f48841f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:33.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.827+0000 7f488ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4884146130 0x7f48841f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:33.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.827+0000 7f488ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48841579a0 0x7f4884157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:33.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.827+0000 7f488ae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f488415d630 con 0x7f48840cfe30 2024-09-21T06:14:33.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.827+0000 7f488ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f48840d05c0 con 0x7f4884146130 2024-09-21T06:14:33.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.827+0000 7f488ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f488415d7b0 con 0x7f48841579a0 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48840cfe30 0x7f48841f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48840cfe30 0x7f48841f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43092/0 (socket says 172.21.15.118:43092) 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 -- 172.21.15.118:0/4228557626 learned_addr learned my addr 172.21.15.118:0/4228557626 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889000640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4884146130 0x7f48841f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f488a400640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48841579a0 0x7f4884157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 -- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48841579a0 msgr2=0x7f4884157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48841579a0 0x7f4884157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 -- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4884146130 msgr2=0x7f48841f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4884146130 0x7f48841f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 -- 172.21.15.118:0/4228557626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48841f98d0 con 0x7f48840cfe30 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889000640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4884146130 0x7f48841f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f488a400640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48841579a0 0x7f4884157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.828+0000 7f4889a00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48840cfe30 0x7f48841f62f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f487800c560 tx=0x7f4878001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:33.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.829+0000 7f4881600640 1 -- 172.21.15.118:0/4228557626 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878042070 con 0x7f48840cfe30 2024-09-21T06:14:33.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.829+0000 7f4881600640 1 -- 172.21.15.118:0/4228557626 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f487803a070 con 0x7f48840cfe30 2024-09-21T06:14:33.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.829+0000 7f4881600640 1 -- 172.21.15.118:0/4228557626 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487802bbb0 con 0x7f48840cfe30 2024-09-21T06:14:33.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.829+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48841f9bb0 con 0x7f48840cfe30 2024-09-21T06:14:33.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.829+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48841f5af0 con 0x7f48840cfe30 2024-09-21T06:14:33.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.830+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48840749f0 con 0x7f48840cfe30 2024-09-21T06:14:33.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.831+0000 7f4881600640 1 -- 172.21.15.118:0/4228557626 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f487803c070 con 0x7f48840cfe30 2024-09-21T06:14:33.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.832+0000 7f4881600640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4864078b90 0x7f486407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:33.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.832+0000 7f4881600640 1 -- 172.21.15.118:0/4228557626 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7f48780ba3c0 con 0x7f48840cfe30 2024-09-21T06:14:33.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.833+0000 7f4889000640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4864078b90 0x7f486407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:33.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.833+0000 7f4889000640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4864078b90 0x7f486407b0a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f48840b1fd0 tx=0x7f4870005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:33.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:33.836+0000 7f4881600640 1 -- 172.21.15.118:0/4228557626 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4878082260 con 0x7f48840cfe30 2024-09-21T06:14:34.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.060+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48840764e0 con 0x7f48840cfe30 2024-09-21T06:14:34.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.060+0000 7f4881600640 1 -- 172.21.15.118:0/4228557626 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5239 (secure 0 0 0) 0x7f4878087e20 con 0x7f48840cfe30 2024-09-21T06:14:34.062 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:14:34.062 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"btime":"2024-09-21T06:14:26:871516+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:14:23.335795+0000","modified":"2024-09-21T06:14:26.364763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4151315485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4151315485},{"type":"v1","addr":"172.21.15.118:6835","nonce":4151315485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7806,"qdb_cluster":[7806]},"id":10}]} 2024-09-21T06:14:34.062 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 86 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4864078b90 msgr2=0x7f486407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4864078b90 0x7f486407b0a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f48840b1fd0 tx=0x7f4870005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48840cfe30 msgr2=0x7f48841f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48840cfe30 0x7f48841f62f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f487800c560 tx=0x7f4878001b20 comp rx=0 tx=0).stop 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 shutdown_connections 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4864078b90 0x7f486407b0a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48841579a0 0x7f4884157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4884146130 0x7f48841f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 --2- 172.21.15.118:0/4228557626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48840cfe30 0x7f48841f62f0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 >> 172.21.15.118:0/4228557626 conn(0x7f488406d6e0 msgr2=0x7f48840cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 shutdown_connections 2024-09-21T06:14:34.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.063+0000 7f488ae00640 1 -- 172.21.15.118:0/4228557626 wait complete. 2024-09-21T06:14:34.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:14:34.328 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":7806,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.470594440999999,"mdsmap_epoch":86,"osdmap_epoch":162,"osdmap_epoch_barrier":162,"uptime":15.493259297} 2024-09-21T06:14:34.328 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 7806, "mdsmap_epoch": 86, "osdmap_epoch": 162, "osdmap_epoch_barrier": 162, "rank_uptime": 10.470594441, "state": "up:active", "uptime": 15.493259297, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:14:34.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-21T06:14:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.550+0000 7fc62be00640 1 -- 172.21.15.118:0/2846612897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0cf9c0 msgr2=0x7fc62c0b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.550+0000 7fc62be00640 1 --2- 172.21.15.118:0/2846612897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0cf9c0 0x7fc62c0b7ca0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc614005fd0 tx=0x7fc61402a540 comp rx=0 tx=0).stop 2024-09-21T06:14:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.550+0000 7fc62be00640 1 -- 172.21.15.118:0/2846612897 shutdown_connections 2024-09-21T06:14:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.550+0000 7fc62be00640 1 --2- 172.21.15.118:0/2846612897 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc62c0b2810 0x7fc62c0b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.550+0000 7fc62be00640 1 --2- 172.21.15.118:0/2846612897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0cf9c0 0x7fc62c0b7ca0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.550+0000 7fc62be00640 1 -- 172.21.15.118:0/2846612897 >> 172.21.15.118:0/2846612897 conn(0x7fc62c0d28e0 msgr2=0x7fc62c0d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.551+0000 7fc62be00640 1 -- 172.21.15.118:0/2846612897 shutdown_connections 2024-09-21T06:14:34.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.551+0000 7fc62be00640 1 -- 172.21.15.118:0/2846612897 wait complete. 2024-09-21T06:14:34.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.553+0000 7fc62be00640 1 Processor -- start 2024-09-21T06:14:34.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.553+0000 7fc62be00640 1 -- start start 2024-09-21T06:14:34.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.554+0000 7fc62be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc62c0b2810 0x7fc62c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.554+0000 7fc62be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0d3400 0x7fc62c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.554+0000 7fc62be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc62c154020 0x7fc62c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.554+0000 7fc62be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0b32e0 con 0x7fc62c0d3400 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.554+0000 7fc62be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0b3160 con 0x7fc62c0b2810 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.554+0000 7fc62be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc62c0b3460 con 0x7fc62c154020 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0d3400 0x7fc62c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0d3400 0x7fc62c150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43114/0 (socket says 172.21.15.118:43114) 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 -- 172.21.15.118:0/1912470330 learned_addr learned my addr 172.21.15.118:0/1912470330 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc62b400640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc62c154020 0x7fc62c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc62aa00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc62c0b2810 0x7fc62c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 -- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc62c154020 msgr2=0x7fc62c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:34.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc62c154020 0x7fc62c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 -- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc62c0b2810 msgr2=0x7fc62c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:34.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc62c0b2810 0x7fc62c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.555+0000 7fc623e00640 1 -- 172.21.15.118:0/1912470330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c1f8d20 con 0x7fc62c0d3400 2024-09-21T06:14:34.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.556+0000 7fc623e00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0d3400 0x7fc62c150cd0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fc614034040 tx=0x7fc6140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.556+0000 7fc622a00640 1 -- 172.21.15.118:0/1912470330 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61403e030 con 0x7fc62c0d3400 2024-09-21T06:14:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.556+0000 7fc622a00640 1 -- 172.21.15.118:0/1912470330 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc614003d90 con 0x7fc62c0d3400 2024-09-21T06:14:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.556+0000 7fc622a00640 1 -- 172.21.15.118:0/1912470330 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614035040 con 0x7fc62c0d3400 2024-09-21T06:14:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.556+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c1f9000 con 0x7fc62c0d3400 2024-09-21T06:14:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.556+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c1f95c0 con 0x7fc62c0d3400 2024-09-21T06:14:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.557+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62c0b4a90 con 0x7fc62c0d3400 2024-09-21T06:14:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.558+0000 7fc622a00640 1 -- 172.21.15.118:0/1912470330 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc614041030 con 0x7fc62c0d3400 2024-09-21T06:14:34.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.560+0000 7fc622a00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc608078bc0 0x7fc60807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:34.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.560+0000 7fc622a00640 1 -- 172.21.15.118:0/1912470330 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5709+0+0 (secure 0 0 0) 0x7fc6140bb7e0 con 0x7fc62c0d3400 2024-09-21T06:14:34.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.560+0000 7fc62aa00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc608078bc0 0x7fc60807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:34.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.561+0000 7fc62aa00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc608078bc0 0x7fc60807b0d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc61c007fd0 tx=0x7fc61c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:34.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.564+0000 7fc622a00640 1 -- 172.21.15.118:0/1912470330 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6140835d0 con 0x7fc62c0d3400 2024-09-21T06:14:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.751+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7fc62c0b0c70 con 0x7fc62c0d3400 2024-09-21T06:14:34.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.907+0000 7fc622a00640 1 -- 172.21.15.118:0/1912470330 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v163) ==== 181+0+0 (secure 0 0 0) 0x7fc614088000 con 0x7fc62c0d3400 2024-09-21T06:14:34.908 INFO:teuthology.orchestra.run.smithi118.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-21T06:14:34.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc608078bc0 msgr2=0x7fc60807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:34.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc608078bc0 0x7fc60807b0d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc61c007fd0 tx=0x7fc61c009040 comp rx=0 tx=0).stop 2024-09-21T06:14:34.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0d3400 msgr2=0x7fc62c150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:34.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0d3400 0x7fc62c150cd0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fc614034040 tx=0x7fc6140038a0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 shutdown_connections 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc608078bc0 0x7fc60807b0d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc62c154020 0x7fc62c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c0d3400 0x7fc62c150cd0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 --2- 172.21.15.118:0/1912470330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc62c0b2810 0x7fc62c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 >> 172.21.15.118:0/1912470330 conn(0x7fc62c0d28e0 msgr2=0x7fc62c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 shutdown_connections 2024-09-21T06:14:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:14:34.911+0000 7fc62be00640 1 -- 172.21.15.118:0/1912470330 wait complete. 2024-09-21T06:14:34.939 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:14:35.176 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:14:35.176 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:14:35.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-21T06:14:35.402 INFO:teuthology.orchestra.run.smithi118.stdout:{"mon_tick_interval":"5"} 2024-09-21T06:14:35.402 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-21T06:14:35.403 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> stdin-killer -- python3 -c ' 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> import time 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> import datetime 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> # Write some buffered data through before going full, all should be well 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> print("writing some data through which we expect to succeed") 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> bytes = 0 2024-09-21T06:14:35.403 DEBUG:teuthology.orchestra.run.smithi118:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> # buffered IO, the error should always only appear from fsync and not 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> # from write 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> full = False 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> for n in range(0, int(32 * 1.1)): 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> except OSError as e: 2024-09-21T06:14:35.404 DEBUG:teuthology.orchestra.run.smithi118:> if False: 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> raise 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> full = True 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> break 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> try: 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> os.fsync(f) 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> print("fsync'"'"'ed successfully") 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> except OSError as e: 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> full = True 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> break 2024-09-21T06:14:35.405 DEBUG:teuthology.orchestra.run.smithi118:> else: 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> if n > 32 * 0.9: 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> # Be cautious in the last region where we expect to hit 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> time.sleep(15.0) 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> if not full: 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> # close() should not raise an error because we already caught it in 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> # since then because all IOs got cancelled on the full flag. 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> print("calling close") 2024-09-21T06:14:35.406 DEBUG:teuthology.orchestra.run.smithi118:> os.close(f) 2024-09-21T06:14:35.407 DEBUG:teuthology.orchestra.run.smithi118:> print("close() did not raise error") 2024-09-21T06:14:35.407 DEBUG:teuthology.orchestra.run.smithi118:> 2024-09-21T06:14:35.407 DEBUG:teuthology.orchestra.run.smithi118:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-21T06:14:35.407 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-09-21T06:14:50.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:14:50.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:15:20.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:15:20.673 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:15:39.150 INFO:teuthology.orchestra.run.smithi118.stdout:writing some data through which we expect to succeed 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 1.00 MB 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 2.00 MB 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.151 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 3.00 MB 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 4.00 MB 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 5.00 MB 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 6.00 MB 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 7.00 MB 2024-09-21T06:15:39.152 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 8.00 MB 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 9.00 MB 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 10.00 MB 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 11.00 MB 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.153 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 12.00 MB 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 13.00 MB 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 14.00 MB 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 15.00 MB 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.154 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 16.00 MB 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 17.00 MB 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 18.00 MB 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 19.00 MB 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 20.00 MB 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.155 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 21.00 MB 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 22.00 MB 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 23.00 MB 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 24.00 MB 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 25.00 MB 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 26.00 MB 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 27.00 MB 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 28.00 MB 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 29.00 MB 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 30.00 MB 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:15:39.157 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 31.00 MB 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 32.00 MB 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:fsync'ed successfully 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:Not full yet after 33.00 MB 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:Reached fullness after 33.00 MB 2024-09-21T06:15:39.158 INFO:teuthology.orchestra.run.smithi118.stdout:calling close 2024-09-21T06:15:39.159 INFO:teuthology.orchestra.run.smithi118.stdout:close() did not raise error 2024-09-21T06:15:39.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:15:39.168 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:15:39.168 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:15:39.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:15:39.355 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:15:39.355 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:15:39.355 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:15:39.355 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:39.392 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:15:39.392 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:39.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:15:39.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.727+0000 7f4f54600640 1 -- 172.21.15.118:0/1896186472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f34004d40 msgr2=0x7f4f34005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:39.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.727+0000 7f4f54600640 1 --2- 172.21.15.118:0/1896186472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f34004d40 0x7f4f34005150 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4f44005fd0 tx=0x7f4f34005830 comp rx=0 tx=0).stop 2024-09-21T06:15:39.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.727+0000 7f4f52600640 1 -- 172.21.15.118:0/1896186472 reap_dead start 2024-09-21T06:15:39.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.727+0000 7f4f54600640 1 -- 172.21.15.118:0/1896186472 shutdown_connections 2024-09-21T06:15:39.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.727+0000 7f4f54600640 1 -- 172.21.15.118:0/1896186472 >> 172.21.15.118:0/1896186472 conn(0x7f4f4c06d110 msgr2=0x7f4f4c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:39.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.727+0000 7f4f54600640 1 -- 172.21.15.118:0/1896186472 shutdown_connections 2024-09-21T06:15:39.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.727+0000 7f4f54600640 1 -- 172.21.15.118:0/1896186472 wait complete. 2024-09-21T06:15:39.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.730+0000 7f4f54600640 1 Processor -- start 2024-09-21T06:15:39.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.730+0000 7f4f54600640 1 -- start start 2024-09-21T06:15:39.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f54600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f34004d40 0x7f4f4c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:39.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f54600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f4c155950 0x7f4f4c15c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:39.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f54600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f4c1f96d0 0x7f4f4c1f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:39.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f54600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c0cf5d0 con 0x7f4f4c155950 2024-09-21T06:15:39.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f54600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c0cf450 con 0x7f4f4c1f96d0 2024-09-21T06:15:39.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f54600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4c0cf750 con 0x7f4f34004d40 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f51200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f4c155950 0x7f4f4c15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f51200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f4c155950 0x7f4f4c15c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42510/0 (socket says 172.21.15.118:42510) 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.731+0000 7f4f51200640 1 -- 172.21.15.118:0/1778516112 learned_addr learned my addr 172.21.15.118:0/1778516112 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f51c00640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f34004d40 0x7f4f4c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f52600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f4c1f96d0 0x7f4f4c1f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f51200640 1 -- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f34004d40 msgr2=0x7f4f4c1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f51200640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f34004d40 0x7f4f4c1f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f51200640 1 -- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f4c1f96d0 msgr2=0x7f4f4c1f9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f51200640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f4c1f96d0 0x7f4f4c1f9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f51200640 1 -- 172.21.15.118:0/1778516112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c1e7d40 con 0x7f4f4c155950 2024-09-21T06:15:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f51200640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f4c155950 0x7f4f4c15c170 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f4f380066b0 tx=0x7f4f380039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38015070 con 0x7f4f4c155950 2024-09-21T06:15:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f38011920 con 0x7f4f4c155950 2024-09-21T06:15:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.732+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38011d70 con 0x7f4f4c155950 2024-09-21T06:15:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.733+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c1e8020 con 0x7f4f4c155950 2024-09-21T06:15:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.733+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c1f60d0 con 0x7f4f4c155950 2024-09-21T06:15:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.734+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4c0d1290 con 0x7f4f4c155950 2024-09-21T06:15:39.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.735+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f38018070 con 0x7f4f4c155950 2024-09-21T06:15:39.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.736+0000 7f4f49600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4f2c078bc0 0x7f4f2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:39.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.736+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7f4f3809b6f0 con 0x7f4f4c155950 2024-09-21T06:15:39.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.736+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7f4f2c0807a0 con 0x7f4f4c155950 2024-09-21T06:15:39.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.736+0000 7f4f51c00640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4f2c078bc0 0x7f4f2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:39.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.737+0000 7f4f51c00640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4f2c078bc0 0x7f4f2c07b0d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009c50 tx=0x7f4f40005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:39.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.741+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4f380634c0 con 0x7f4f4c155950 2024-09-21T06:15:39.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.938+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4f4c1e7a90 con 0x7f4f4c155950 2024-09-21T06:15:39.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.939+0000 7f4f49600640 1 -- 172.21.15.118:0/1778516112 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v166) ==== 80+0+0 (secure 0 0 0) 0x7f4f38067ef0 con 0x7f4f4c155950 2024-09-21T06:15:39.941 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4f2c078bc0 msgr2=0x7f4f2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4f2c078bc0 0x7f4f2c07b0d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009c50 tx=0x7f4f40005f90 comp rx=0 tx=0).stop 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f4c155950 msgr2=0x7f4f4c15c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f4c155950 0x7f4f4c15c170 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f4f380066b0 tx=0x7f4f380039c0 comp rx=0 tx=0).stop 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 shutdown_connections 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f4c1f96d0 0x7f4f4c1f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f4c155950 0x7f4f4c15c170 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:39.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4f2c078bc0 0x7f4f2c07b0d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:39.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 --2- 172.21.15.118:0/1778516112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f34004d40 0x7f4f4c1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:39.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 >> 172.21.15.118:0/1778516112 conn(0x7f4f4c06d110 msgr2=0x7f4f4c141890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:39.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.941+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 shutdown_connections 2024-09-21T06:15:39.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:39.942+0000 7f4f54600640 1 -- 172.21.15.118:0/1778516112 wait complete. 2024-09-21T06:15:39.969 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:15:39.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:15:39.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:15:40.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:15:40.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:15:40.033 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:15:40.068 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:15:40.069 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:15:40.069 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:40.109 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:15:40.109 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:40.187 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:15:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.404+0000 7f6095800640 1 -- 172.21.15.118:0/1331162836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609015d080 msgr2=0x7f6090146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.404+0000 7f6095800640 1 --2- 172.21.15.118:0/1331162836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609015d080 0x7f6090146080 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6080009830 tx=0x7f608002a530 comp rx=0 tx=0).stop 2024-09-21T06:15:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.404+0000 7f6095800640 1 -- 172.21.15.118:0/1331162836 shutdown_connections 2024-09-21T06:15:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.404+0000 7f6095800640 1 --2- 172.21.15.118:0/1331162836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609015d080 0x7f6090146080 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.404+0000 7f6095800640 1 -- 172.21.15.118:0/1331162836 >> 172.21.15.118:0/1331162836 conn(0x7f609006d6e0 msgr2=0x7f60900b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.404+0000 7f6095800640 1 -- 172.21.15.118:0/1331162836 shutdown_connections 2024-09-21T06:15:40.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.404+0000 7f6095800640 1 -- 172.21.15.118:0/1331162836 wait complete. 2024-09-21T06:15:40.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.406+0000 7f6095800640 1 Processor -- start 2024-09-21T06:15:40.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.407+0000 7f6095800640 1 -- start start 2024-09-21T06:15:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f6095800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60900cfe70 0x7f609015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f6095800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609015d080 0x7f609013bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f6095800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60901e77e0 0x7f60901e7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f6095800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6090073bd0 con 0x7f60900cfe70 2024-09-21T06:15:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f6095800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6090073a50 con 0x7f60901e77e0 2024-09-21T06:15:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f6095800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6090073d50 con 0x7f609015d080 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f608fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60900cfe70 0x7f609015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f608fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60900cfe70 0x7f609015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42518/0 (socket says 172.21.15.118:42518) 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.408+0000 7f608fe00640 1 -- 172.21.15.118:0/2326082929 learned_addr learned my addr 172.21.15.118:0/2326082929 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f6094e00640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60901e77e0 0x7f60901e7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f6087400640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609015d080 0x7f609013bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608fe00640 1 -- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609015d080 msgr2=0x7f609013bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608fe00640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609015d080 0x7f609013bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608fe00640 1 -- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60901e77e0 msgr2=0x7f60901e7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608fe00640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60901e77e0 0x7f60901e7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608fe00640 1 -- 172.21.15.118:0/2326082929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60901e8130 con 0x7f60900cfe70 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f6094e00640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60901e77e0 0x7f60901e7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608fe00640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60900cfe70 0x7f609015b5c0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f608002ab20 tx=0x7f6080033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080031b50 con 0x7f60900cfe70 2024-09-21T06:15:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6080031de0 con 0x7f60900cfe70 2024-09-21T06:15:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080005280 con 0x7f60900cfe70 2024-09-21T06:15:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.409+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60901f6f00 con 0x7f60900cfe70 2024-09-21T06:15:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.410+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60901f76f0 con 0x7f60900cfe70 2024-09-21T06:15:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.411+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6090146080 con 0x7f60900cfe70 2024-09-21T06:15:40.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.412+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6080005420 con 0x7f60900cfe70 2024-09-21T06:15:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.413+0000 7f608cc00640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f606c078bc0 0x7f606c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.413+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7f60800bbea0 con 0x7f60900cfe70 2024-09-21T06:15:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.413+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7f606c0807a0 con 0x7f60900cfe70 2024-09-21T06:15:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.413+0000 7f6087400640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f606c078bc0 0x7f606c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.414+0000 7f6087400640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f606c078bc0 0x7f606c07b0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f609015b550 tx=0x7f6078009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.417+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f60901e8130 con 0x7f60900cfe70 2024-09-21T06:15:40.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.613+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f609015ff50 con 0x7f60900cfe70 2024-09-21T06:15:40.615 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.613+0000 7f608cc00640 1 -- 172.21.15.118:0/2326082929 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v166) ==== 80+0+0 (secure 0 0 0) 0x7f608003f030 con 0x7f60900cfe70 2024-09-21T06:15:40.616 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:15:40.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f606c078bc0 msgr2=0x7f606c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:40.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f606c078bc0 0x7f606c07b0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f609015b550 tx=0x7f6078009040 comp rx=0 tx=0).stop 2024-09-21T06:15:40.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60900cfe70 msgr2=0x7f609015b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:40.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60900cfe70 0x7f609015b5c0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f608002ab20 tx=0x7f6080033ba0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 shutdown_connections 2024-09-21T06:15:40.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60901e77e0 0x7f60901e7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f606c078bc0 0x7f606c07b0d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609015d080 0x7f609013bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.615+0000 7f6095800640 1 --2- 172.21.15.118:0/2326082929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60900cfe70 0x7f609015b5c0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:40.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.616+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 >> 172.21.15.118:0/2326082929 conn(0x7f609006d6e0 msgr2=0x7f6090075fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:40.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.616+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 shutdown_connections 2024-09-21T06:15:40.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:40.616+0000 7f6095800640 1 -- 172.21.15.118:0/2326082929 wait complete. 2024-09-21T06:15:40.640 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:15:40.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:15:40.640 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:15:40.708 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:15:40.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:15:40.708 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:15:40.745 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:15:40.746 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:15:40.746 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:40.781 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:15:40.781 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:15:40.781 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:15:40.781 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:40.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:15:40.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 -- 172.21.15.118:0/2743763912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6d80 msgr2=0x7f6ad80b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 --2- 172.21.15.118:0/2743763912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6d80 0x7f6ad80b7190 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80b5f50 tx=0x7f6ad002a870 comp rx=0 tx=0).stop 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 -- 172.21.15.118:0/2743763912 shutdown_connections 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 --2- 172.21.15.118:0/2743763912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6d80 0x7f6ad80b7190 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 --2- 172.21.15.118:0/2743763912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80b7bd0 0x7f6ad80d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 -- 172.21.15.118:0/2743763912 >> 172.21.15.118:0/2743763912 conn(0x7f6ad80d2900 msgr2=0x7f6ad80d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 -- 172.21.15.118:0/2743763912 shutdown_connections 2024-09-21T06:15:41.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.045+0000 7f6ad7200640 1 -- 172.21.15.118:0/2743763912 wait complete. 2024-09-21T06:15:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.048+0000 7f6ad7200640 1 Processor -- start 2024-09-21T06:15:41.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.048+0000 7f6ad7200640 1 -- start start 2024-09-21T06:15:41.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.049+0000 7f6ad7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6260 0x7f6ad815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.049+0000 7f6ad7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80b6d80 0x7f6ad81f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.049+0000 7f6ad7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80b7bd0 0x7f6ad80b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.049+0000 7f6ad7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad80b3470 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.049+0000 7f6ad7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad80b32f0 con 0x7f6ad80b6260 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.049+0000 7f6ad7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad80b35f0 con 0x7f6ad80b6d80 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80b7bd0 0x7f6ad80b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6260 0x7f6ad815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80b7bd0 0x7f6ad80b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42534/0 (socket says 172.21.15.118:42534) 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6acd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80b6d80 0x7f6ad81f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 -- 172.21.15.118:0/3048964990 learned_addr learned my addr 172.21.15.118:0/3048964990 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 -- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80b6d80 msgr2=0x7f6ad81f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80b6d80 0x7f6ad81f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 -- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6260 msgr2=0x7f6ad815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6260 0x7f6ad815ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 -- 172.21.15.118:0/3048964990 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad80b2b00 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad5e00640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6260 0x7f6ad815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:41.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.050+0000 7f6ad6800640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80b7bd0 0x7f6ad80b25c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009ca0 tx=0x7f6ad0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:41.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.051+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0031d60 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.051+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ad0003e10 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.051+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad80cc4c0 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.051+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0033330 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.051+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad80cca80 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.052+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad80cc230 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.053+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ad0030070 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.054+0000 7f6acea00640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ab4078b90 0x7f6ab407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.054+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7f6ad00bbea0 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.054+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7f6ab40807d0 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.055+0000 7f6ad5e00640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ab4078b90 0x7f6ab407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.055+0000 7f6ad5e00640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ab4078b90 0x7f6ab407b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80097a0 tx=0x7f6ac8009260 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:41.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.059+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6ad003f030 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.275+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ad80b3aa0 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.276+0000 7f6acea00640 1 -- 172.21.15.118:0/3048964990 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5239 (secure 0 0 0) 0x7f6ad0083c60 con 0x7f6ad80b7bd0 2024-09-21T06:15:41.278 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:41.278 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"btime":"2024-09-21T06:14:26:871516+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:14:23.335795+0000","modified":"2024-09-21T06:14:26.364763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4151315485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4151315485},{"type":"v1","addr":"172.21.15.118:6835","nonce":4151315485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7806,"qdb_cluster":[7806]},"id":10}]} 2024-09-21T06:15:41.279 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 86 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ab4078b90 msgr2=0x7f6ab407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ab4078b90 0x7f6ab407b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80097a0 tx=0x7f6ac8009260 comp rx=0 tx=0).stop 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80b7bd0 msgr2=0x7f6ad80b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80b7bd0 0x7f6ad80b25c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009ca0 tx=0x7f6ad0003c20 comp rx=0 tx=0).stop 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 shutdown_connections 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ad80b7bd0 0x7f6ad80b25c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ab4078b90 0x7f6ab407b0a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80b6d80 0x7f6ad81f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 --2- 172.21.15.118:0/3048964990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad80b6260 0x7f6ad815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 >> 172.21.15.118:0/3048964990 conn(0x7f6ad80d2900 msgr2=0x7f6ad80713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:41.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.278+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 shutdown_connections 2024-09-21T06:15:41.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.279+0000 7f6ad7200640 1 -- 172.21.15.118:0/3048964990 wait complete. 2024-09-21T06:15:41.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:15:41.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.527+0000 7fd753200640 1 -- 172.21.15.118:0/1258773429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0b62c0 msgr2=0x7fd74c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.527+0000 7fd753200640 1 --2- 172.21.15.118:0/1258773429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0b62c0 0x7fd74c0d0240 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fd74c072570 tx=0x7fd74802aa30 comp rx=0 tx=0).stop 2024-09-21T06:15:41.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.528+0000 7fd753200640 1 -- 172.21.15.118:0/1258773429 shutdown_connections 2024-09-21T06:15:41.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.528+0000 7fd753200640 1 --2- 172.21.15.118:0/1258773429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0b62c0 0x7fd74c0d0240 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.528+0000 7fd753200640 1 --2- 172.21.15.118:0/1258773429 >> v2:172.21.15.149:3300/0 conn(0x7fd74c073fa0 0x7fd74c0749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.528+0000 7fd753200640 1 -- 172.21.15.118:0/1258773429 >> 172.21.15.118:0/1258773429 conn(0x7fd74c06d6e0 msgr2=0x7fd74c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:41.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.528+0000 7fd753200640 1 -- 172.21.15.118:0/1258773429 shutdown_connections 2024-09-21T06:15:41.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.528+0000 7fd753200640 1 -- 172.21.15.118:0/1258773429 wait complete. 2024-09-21T06:15:41.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.530+0000 7fd753200640 1 Processor -- start 2024-09-21T06:15:41.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.530+0000 7fd753200640 1 -- start start 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.531+0000 7fd753200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74c073fa0 0x7fd74c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.531+0000 7fd753200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0cfe30 0x7fd74c0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.531+0000 7fd753200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd74c1f9b60 0x7fd74c0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.531+0000 7fd753200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c15da00 con 0x7fd74c0cfe30 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.531+0000 7fd753200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c15d880 con 0x7fd74c073fa0 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.531+0000 7fd753200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c15db80 con 0x7fd74c1f9b60 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0cfe30 0x7fd74c0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0cfe30 0x7fd74c0cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42558/0 (socket says 172.21.15.118:42558) 2024-09-21T06:15:41.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 -- 172.21.15.118:0/2942480485 learned_addr learned my addr 172.21.15.118:0/2942480485 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:41.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd752800640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd74c1f9b60 0x7fd74c0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751e00640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74c073fa0 0x7fd74c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 -- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd74c1f9b60 msgr2=0x7fd74c0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd74c1f9b60 0x7fd74c0cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 -- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74c073fa0 msgr2=0x7fd74c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74c073fa0 0x7fd74c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.532+0000 7fd751400640 1 -- 172.21.15.118:0/2942480485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c0aa540 con 0x7fd74c0cfe30 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.533+0000 7fd751400640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0cfe30 0x7fd74c0cbdf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c3d0 tx=0x7fd73c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.533+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c017070 con 0x7fd74c0cfe30 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.533+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd73c0053c0 con 0x7fd74c0cfe30 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.533+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c0aa820 con 0x7fd74c0cfe30 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.533+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c003850 con 0x7fd74c0cfe30 2024-09-21T06:15:41.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.533+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c0cce70 con 0x7fd74c0cfe30 2024-09-21T06:15:41.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.534+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c0cf450 con 0x7fd74c0cfe30 2024-09-21T06:15:41.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.535+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd73c01a070 con 0x7fd74c0cfe30 2024-09-21T06:15:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.536+0000 7fd746000640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd730078bc0 0x7fd73007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.537+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7fd73c09a030 con 0x7fd74c0cfe30 2024-09-21T06:15:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.537+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7fd7300807a0 con 0x7fd74c0cfe30 2024-09-21T06:15:41.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.537+0000 7fd751e00640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd730078bc0 0x7fd73007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:41.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.538+0000 7fd751e00640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd730078bc0 0x7fd73007b0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd740004630 tx=0x7fd74000b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:41.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.540+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd74c0cf450 con 0x7fd74c0cfe30 2024-09-21T06:15:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.759+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd74c1fa0b0 con 0x7fd74c0cfe30 2024-09-21T06:15:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.760+0000 7fd746000640 1 -- 172.21.15.118:0/2942480485 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5239 (secure 0 0 0) 0x7fd73c061e00 con 0x7fd74c0cfe30 2024-09-21T06:15:41.763 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:41.763 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"btime":"2024-09-21T06:14:26:871516+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:14:23.335795+0000","modified":"2024-09-21T06:14:26.364763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4151315485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4151315485},{"type":"v1","addr":"172.21.15.118:6835","nonce":4151315485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7806,"qdb_cluster":[7806]},"id":10}]} 2024-09-21T06:15:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 86 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd730078bc0 msgr2=0x7fd73007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd730078bc0 0x7fd73007b0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd740004630 tx=0x7fd74000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0cfe30 msgr2=0x7fd74c0cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0cfe30 0x7fd74c0cbdf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c3d0 tx=0x7fd73c00c890 comp rx=0 tx=0).stop 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 shutdown_connections 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd730078bc0 0x7fd73007b0d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd74c1f9b60 0x7fd74c0cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd74c0cfe30 0x7fd74c0cbdf0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 --2- 172.21.15.118:0/2942480485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74c073fa0 0x7fd74c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 >> 172.21.15.118:0/2942480485 conn(0x7fd74c06d6e0 msgr2=0x7fd74c076240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:41.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 shutdown_connections 2024-09-21T06:15:41.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:41.763+0000 7fd753200640 1 -- 172.21.15.118:0/2942480485 wait complete. 2024-09-21T06:15:41.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 -- 172.21.15.118:0/3530084776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40b3a60 msgr2=0x7f41d40cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 --2- 172.21.15.118:0/3530084776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40b3a60 0x7f41d40cca40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f41d40b5db0 tx=0x7f41bc02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 -- 172.21.15.118:0/3530084776 shutdown_connections 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 --2- 172.21.15.118:0/3530084776 >> v2:172.21.15.149:3300/0 conn(0x7f41d40ccf80 0x7f41d4073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 --2- 172.21.15.118:0/3530084776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40b3a60 0x7f41d40cca40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 -- 172.21.15.118:0/3530084776 >> 172.21.15.118:0/3530084776 conn(0x7f41d406d110 msgr2=0x7f41d406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 -- 172.21.15.118:0/3530084776 shutdown_connections 2024-09-21T06:15:42.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.007+0000 7f41d9600640 1 -- 172.21.15.118:0/3530084776 wait complete. 2024-09-21T06:15:42.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.009+0000 7f41d9600640 1 Processor -- start 2024-09-21T06:15:42.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.009+0000 7f41d9600640 1 -- start start 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41d40b3a60 0x7f41d41435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40ccf80 0x7f41d40d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d415cfd0 0x7f41d40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d9600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4073c40 con 0x7f41d40ccf80 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d9600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4073ac0 con 0x7f41d415cfd0 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f41d4073dc0 con 0x7f41d40b3a60 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41ca000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40ccf80 0x7f41d40d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41ca000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40ccf80 0x7f41d40d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42582/0 (socket says 172.21.15.118:42582) 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41ca000640 1 -- 172.21.15.118:0/2600993264 learned_addr learned my addr 172.21.15.118:0/2600993264 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:42.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d2a00640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41d40b3a60 0x7f41d41435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.011+0000 7f41d3400640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d415cfd0 0x7f41d40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41ca000640 1 -- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41d40b3a60 msgr2=0x7f41d41435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41ca000640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41d40b3a60 0x7f41d41435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41ca000640 1 -- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d415cfd0 msgr2=0x7f41d40d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41ca000640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d415cfd0 0x7f41d40d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41ca000640 1 -- 172.21.15.118:0/2600993264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d41fa4d0 con 0x7f41d40ccf80 2024-09-21T06:15:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41ca000640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40ccf80 0x7f41d40d0db0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f41bc034040 tx=0x7f41bc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc03e030 con 0x7f41d40ccf80 2024-09-21T06:15:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41bc003d10 con 0x7f41d40ccf80 2024-09-21T06:15:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc035040 con 0x7f41d40ccf80 2024-09-21T06:15:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d41e7970 con 0x7f41d40ccf80 2024-09-21T06:15:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.012+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d41f9750 con 0x7f41d40ccf80 2024-09-21T06:15:42.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.013+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d40cca40 con 0x7f41d40ccf80 2024-09-21T06:15:42.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.015+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41bc041030 con 0x7f41d40ccf80 2024-09-21T06:15:42.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.016+0000 7f41cb400640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f41b0078b90 0x7f41b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.016+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7f41bc0bb410 con 0x7f41d40ccf80 2024-09-21T06:15:42.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.016+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7f41b0080770 con 0x7f41d40ccf80 2024-09-21T06:15:42.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.016+0000 7f41d2a00640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f41b0078b90 0x7f41b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.017+0000 7f41d2a00640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f41b0078b90 0x7f41b007b0a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f41c4001720 tx=0x7f41c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.020+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f41bc083250 con 0x7f41d40ccf80 2024-09-21T06:15:42.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.205+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41d40cf2b0 con 0x7f41d40ccf80 2024-09-21T06:15:42.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.206+0000 7f41cb400640 1 -- 172.21.15.118:0/2600993264 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16887 (secure 0 0 0) 0x7f41bc087c80 con 0x7f41d40ccf80 2024-09-21T06:15:42.209 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:42.209 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":166,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:15:15.410555+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:14:21.294124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T06:14:22.303766+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f41b0078b90 msgr2=0x7f41b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f41b0078b90 0x7f41b007b0a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f41c4001720 tx=0x7f41c4009040 comp rx=0 tx=0).stop 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40ccf80 msgr2=0x7f41d40d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40ccf80 0x7f41d40d0db0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f41bc034040 tx=0x7f41bc003820 comp rx=0 tx=0).stop 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 shutdown_connections 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41d415cfd0 0x7f41d40d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41d40ccf80 0x7f41d40d0db0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f41b0078b90 0x7f41b007b0a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 --2- 172.21.15.118:0/2600993264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f41d40b3a60 0x7f41d41435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 >> 172.21.15.118:0/2600993264 conn(0x7f41d406d110 msgr2=0x7f41d415e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:42.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 shutdown_connections 2024-09-21T06:15:42.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.208+0000 7f41d9600640 1 -- 172.21.15.118:0/2600993264 wait complete. 2024-09-21T06:15:42.233 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:15:42.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:15:42.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.451+0000 7fb0b2200640 1 -- 172.21.15.118:0/2276040279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 msgr2=0x7fb0ac15cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.451+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2276040279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 0x7fb0ac15cc40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009860 tx=0x7fb09c02a5c0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.451+0000 7fb0b2200640 1 -- 172.21.15.118:0/2276040279 shutdown_connections 2024-09-21T06:15:42.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.451+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2276040279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 0x7fb0ac15cc40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.451+0000 7fb0b2200640 1 -- 172.21.15.118:0/2276040279 >> 172.21.15.118:0/2276040279 conn(0x7fb0ac0d0f80 msgr2=0x7fb0ac0d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:42.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.452+0000 7fb0b2200640 1 -- 172.21.15.118:0/2276040279 shutdown_connections 2024-09-21T06:15:42.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.452+0000 7fb0b2200640 1 -- 172.21.15.118:0/2276040279 wait complete. 2024-09-21T06:15:42.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.454+0000 7fb0b2200640 1 Processor -- start 2024-09-21T06:15:42.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.454+0000 7fb0b2200640 1 -- start start 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.455+0000 7fb0b2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 0x7fb0ac15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.455+0000 7fb0b2200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0ac070630 0x7fb0ac1f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.455+0000 7fb0b2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0ac073350 0x7fb0ac13cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.455+0000 7fb0b2200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac074200 con 0x7fb0ac070630 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.455+0000 7fb0b2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac074080 con 0x7fb0ac073350 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.455+0000 7fb0b2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ac074380 con 0x7fb0ac068f10 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.455+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0ac070630 0x7fb0ac1f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0ac070630 0x7fb0ac1f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42584/0 (socket says 172.21.15.118:42584) 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 -- 172.21.15.118:0/2165927282 learned_addr learned my addr 172.21.15.118:0/2165927282 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0b0e00640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 0x7fb0ac15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0b1800640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0ac073350 0x7fb0ac13cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 -- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 msgr2=0x7fb0ac15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 0x7fb0ac15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 -- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0ac073350 msgr2=0x7fb0ac13cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0ac073350 0x7fb0ac13cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 -- 172.21.15.118:0/2165927282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac1f71d0 con 0x7fb0ac070630 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.456+0000 7fb0a3e00640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0ac070630 0x7fb0ac1f6c90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c390 tx=0x7fb09400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.457+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094011790 con 0x7fb0ac070630 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.457+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb094017070 con 0x7fb0ac070630 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.457+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094011ce0 con 0x7fb0ac070630 2024-09-21T06:15:42.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.457+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac1fa5c0 con 0x7fb0ac070630 2024-09-21T06:15:42.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.457+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac15afc0 con 0x7fb0ac070630 2024-09-21T06:15:42.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.458+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ac15aa50 con 0x7fb0ac070630 2024-09-21T06:15:42.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.459+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb09401c460 con 0x7fb0ac070630 2024-09-21T06:15:42.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.460+0000 7fb0a9600640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb088078bc0 0x7fb08807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.460+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7fb09409a9c0 con 0x7fb0ac070630 2024-09-21T06:15:42.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.460+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7fb0880807a0 con 0x7fb0ac070630 2024-09-21T06:15:42.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.461+0000 7fb0b0e00640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb088078bc0 0x7fb08807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.461+0000 7fb0b0e00640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb088078bc0 0x7fb08807b0d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb09c034000 tx=0x7fb09c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.464+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb0ac1f71d0 con 0x7fb0ac070630 2024-09-21T06:15:42.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.688+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0ac0b6040 con 0x7fb0ac070630 2024-09-21T06:15:42.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.689+0000 7fb0a9600640 1 -- 172.21.15.118:0/2165927282 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5239 (secure 0 0 0) 0x7fb0ac0b6040 con 0x7fb0ac070630 2024-09-21T06:15:42.691 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:42.692 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"btime":"2024-09-21T06:14:26:871516+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:14:23.335795+0000","modified":"2024-09-21T06:14:26.364763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4151315485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4151315485},{"type":"v1","addr":"172.21.15.118:6835","nonce":4151315485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7806,"qdb_cluster":[7806]},"id":10}]} 2024-09-21T06:15:42.692 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 86 2024-09-21T06:15:42.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb088078bc0 msgr2=0x7fb08807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb088078bc0 0x7fb08807b0d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb09c034000 tx=0x7fb09c004730 comp rx=0 tx=0).stop 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0ac070630 msgr2=0x7fb0ac1f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0ac070630 0x7fb0ac1f6c90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c390 tx=0x7fb09400c850 comp rx=0 tx=0).stop 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 shutdown_connections 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0ac073350 0x7fb0ac13cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0ac070630 0x7fb0ac1f6c90 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb088078bc0 0x7fb08807b0d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 --2- 172.21.15.118:0/2165927282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0ac068f10 0x7fb0ac15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 >> 172.21.15.118:0/2165927282 conn(0x7fb0ac0d0f80 msgr2=0x7fb0ac157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 shutdown_connections 2024-09-21T06:15:42.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.692+0000 7fb0b2200640 1 -- 172.21.15.118:0/2165927282 wait complete. 2024-09-21T06:15:42.720 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:15:42.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 -- 172.21.15.118:0/1373257687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd37013fd80 msgr2=0x7fd37015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 --2- 172.21.15.118:0/1373257687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd37013fd80 0x7fd37015dc40 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fd370072aa0 tx=0x7fd36402a980 comp rx=0 tx=0).stop 2024-09-21T06:15:42.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 -- 172.21.15.118:0/1373257687 shutdown_connections 2024-09-21T06:15:42.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 --2- 172.21.15.118:0/1373257687 >> v2:172.21.15.149:3300/0 conn(0x7fd370160b20 0x7fd370160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 --2- 172.21.15.118:0/1373257687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3700d0ea0 0x7fd3700d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 --2- 172.21.15.118:0/1373257687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd37013fd80 0x7fd37015dc40 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 -- 172.21.15.118:0/1373257687 >> 172.21.15.118:0/1373257687 conn(0x7fd37006d110 msgr2=0x7fd37006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:42.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 -- 172.21.15.118:0/1373257687 shutdown_connections 2024-09-21T06:15:42.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.941+0000 7fd378200640 1 -- 172.21.15.118:0/1373257687 wait complete. 2024-09-21T06:15:42.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.943+0000 7fd378200640 1 Processor -- start 2024-09-21T06:15:42.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.943+0000 7fd378200640 1 -- start start 2024-09-21T06:15:42.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd378200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3700d0ea0 0x7fd3701f9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd378200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd37013fd80 0x7fd37015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd378200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd370160b20 0x7fd37015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd378200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd37015d800 con 0x7fd370160b20 2024-09-21T06:15:42.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd378200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd37015d680 con 0x7fd3700d0ea0 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd378200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd370161470 con 0x7fd37013fd80 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd370160b20 0x7fd37015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd370160b20 0x7fd37015c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42594/0 (socket says 172.21.15.118:42594) 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 -- 172.21.15.118:0/1665642276 learned_addr learned my addr 172.21.15.118:0/1665642276 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd375800640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3700d0ea0 0x7fd3701f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd374e00640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd37013fd80 0x7fd37015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 -- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd37013fd80 msgr2=0x7fd37015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd37013fd80 0x7fd37015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 -- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3700d0ea0 msgr2=0x7fd3701f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3700d0ea0 0x7fd3701f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd376200640 1 -- 172.21.15.118:0/1665642276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd370141a00 con 0x7fd370160b20 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.945+0000 7fd374e00640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd37013fd80 0x7fd37015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.946+0000 7fd376200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd370160b20 0x7fd37015c4b0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd368005d00 tx=0x7fd36800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.946+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368017070 con 0x7fd370160b20 2024-09-21T06:15:42.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.946+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd368005330 con 0x7fd370160b20 2024-09-21T06:15:42.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.946+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd370141ce0 con 0x7fd370160b20 2024-09-21T06:15:42.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.946+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3680047a0 con 0x7fd370160b20 2024-09-21T06:15:42.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.946+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3701422a0 con 0x7fd370160b20 2024-09-21T06:15:42.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.947+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd370161920 con 0x7fd370160b20 2024-09-21T06:15:42.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.948+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd368004940 con 0x7fd370160b20 2024-09-21T06:15:42.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.950+0000 7fd36d600640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd350078b90 0x7fd35007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.950+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7fd36809ae00 con 0x7fd370160b20 2024-09-21T06:15:42.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.950+0000 7fd375800640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd350078b90 0x7fd35007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.950+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7fd350080770 con 0x7fd370160b20 2024-09-21T06:15:42.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.951+0000 7fd375800640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd350078b90 0x7fd35007b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd364035000 tx=0x7fd364004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:42.954+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd368062b30 con 0x7fd370160b20 2024-09-21T06:15:43.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.173+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3701fa5b0 con 0x7fd370160b20 2024-09-21T06:15:43.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.173+0000 7fd36d600640 1 -- 172.21.15.118:0/1665642276 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5239 (secure 0 0 0) 0x7fd368067560 con 0x7fd370160b20 2024-09-21T06:15:43.176 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:43.176 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":86,"btime":"2024-09-21T06:14:26:871516+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:14:23.335795+0000","modified":"2024-09-21T06:14:26.364763+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7806":{"gid":7806,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/4151315485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":4151315485},{"type":"v1","addr":"172.21.15.118:6835","nonce":4151315485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7806,"qdb_cluster":[7806]},"id":10}]} 2024-09-21T06:15:43.176 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 86 2024-09-21T06:15:43.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.175+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd350078b90 msgr2=0x7fd35007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.175+0000 7fd378200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd350078b90 0x7fd35007b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd364035000 tx=0x7fd364004ab0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd370160b20 msgr2=0x7fd37015c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd370160b20 0x7fd37015c4b0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd368005d00 tx=0x7fd36800dae0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 shutdown_connections 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd370160b20 0x7fd37015c4b0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd350078b90 0x7fd35007b0a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd37013fd80 0x7fd37015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 --2- 172.21.15.118:0/1665642276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3700d0ea0 0x7fd3701f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 >> 172.21.15.118:0/1665642276 conn(0x7fd37006d110 msgr2=0x7fd37015cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 shutdown_connections 2024-09-21T06:15:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.176+0000 7fd378200640 1 -- 172.21.15.118:0/1665642276 wait complete. 2024-09-21T06:15:43.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:15:43.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 -- 172.21.15.118:0/3441988986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240cf850 msgr2=0x7f21240ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 --2- 172.21.15.118:0/3441988986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240cf850 0x7f21240ce420 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f2124069d90 tx=0x7f210c02a560 comp rx=0 tx=0).stop 2024-09-21T06:15:43.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 -- 172.21.15.118:0/3441988986 shutdown_connections 2024-09-21T06:15:43.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 --2- 172.21.15.118:0/3441988986 >> v2:172.21.15.149:3300/0 conn(0x7f21240d1330 0x7f21240b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 --2- 172.21.15.118:0/3441988986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240cf850 0x7f21240ce420 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 -- 172.21.15.118:0/3441988986 >> 172.21.15.118:0/3441988986 conn(0x7f21240d2900 msgr2=0x7f21240d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:43.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 -- 172.21.15.118:0/3441988986 shutdown_connections 2024-09-21T06:15:43.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.419+0000 7f2123200640 1 -- 172.21.15.118:0/3441988986 wait complete. 2024-09-21T06:15:43.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.421+0000 7f2123200640 1 Processor -- start 2024-09-21T06:15:43.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.421+0000 7f2123200640 1 -- start start 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2123200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240b7b90 0x7f21241d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2123200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21240d1330 0x7f21241e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2123200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21241e4060 0x7f21241e7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2123200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f21240b2900 con 0x7f21240b7b90 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2123200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f21240b2780 con 0x7f21240d1330 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2123200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f21240b2a80 con 0x7f21241e4060 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2121e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240b7b90 0x7f21241d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2121e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240b7b90 0x7f21241d1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42600/0 (socket says 172.21.15.118:42600) 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2121e00640 1 -- 172.21.15.118:0/1483958118 learned_addr learned my addr 172.21.15.118:0/1483958118 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2122800640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21241e4060 0x7f21241e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.423+0000 7f2119400640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21240d1330 0x7f21241e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2121e00640 1 -- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21241e4060 msgr2=0x7f21241e7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2121e00640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21241e4060 0x7f21241e7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2121e00640 1 -- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21240d1330 msgr2=0x7f21241e6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2121e00640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21240d1330 0x7f21241e6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2121e00640 1 -- 172.21.15.118:0/1483958118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21241e4900 con 0x7f21240b7b90 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2121e00640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240b7b90 0x7f21241d1820 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f211400c3c0 tx=0x7f211400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114017070 con 0x7f21240b7b90 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21140035f0 con 0x7f21240b7b90 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212409d1c0 con 0x7f21240b7b90 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114003a20 con 0x7f21240b7b90 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.424+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21241d21c0 con 0x7f21240b7b90 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.425+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21240b3ba0 con 0x7f21240b7b90 2024-09-21T06:15:43.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.426+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f211401a070 con 0x7f21240b7b90 2024-09-21T06:15:43.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.427+0000 7f211aa00640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2100078b90 0x7f210007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.428+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7f2114099f20 con 0x7f21240b7b90 2024-09-21T06:15:43.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.428+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7f2100080770 con 0x7f21240b7b90 2024-09-21T06:15:43.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.428+0000 7f2119400640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2100078b90 0x7f210007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.429+0000 7f2119400640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2100078b90 0x7f210007b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f210c033000 tx=0x7f210c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:43.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.432+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21240b3ba0 con 0x7f21240b7b90 2024-09-21T06:15:43.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.619+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21240b2030 con 0x7f21240b7b90 2024-09-21T06:15:43.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.620+0000 7f211aa00640 1 -- 172.21.15.118:0/1483958118 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16887 (secure 0 0 0) 0x7f21241e4900 con 0x7f21240b7b90 2024-09-21T06:15:43.627 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:43.627 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":166,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:15:15.410555+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:14:21.294124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T06:14:22.303766+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:15:43.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2100078b90 msgr2=0x7f210007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2100078b90 0x7f210007b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f210c033000 tx=0x7f210c004730 comp rx=0 tx=0).stop 2024-09-21T06:15:43.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240b7b90 msgr2=0x7f21241d1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240b7b90 0x7f21241d1820 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f211400c3c0 tx=0x7f211400c880 comp rx=0 tx=0).stop 2024-09-21T06:15:43.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 shutdown_connections 2024-09-21T06:15:43.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2100078b90 0x7f210007b0a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21241e4060 0x7f21241e7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21240d1330 0x7f21241e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 --2- 172.21.15.118:0/1483958118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21240b7b90 0x7f21241d1820 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 >> 172.21.15.118:0/1483958118 conn(0x7f21240d2900 msgr2=0x7f21241e4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:43.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 shutdown_connections 2024-09-21T06:15:43.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.622+0000 7f2123200640 1 -- 172.21.15.118:0/1483958118 wait complete. 2024-09-21T06:15:43.648 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2212242484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 msgr2=0x7fa1e80d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2212242484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80d2ec0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80d06e0 tx=0x7fa1d402a4b0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2212242484 shutdown_connections 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2212242484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80d2ec0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2212242484 >> v2:172.21.15.149:3300/0 conn(0x7fa1e80d3400 0x7fa1e80b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2212242484 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e80b3be0 0x7fa1e80ba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2212242484 >> 172.21.15.118:0/2212242484 conn(0x7fa1e80d4bd0 msgr2=0x7fa1e80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:43.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2212242484 shutdown_connections 2024-09-21T06:15:43.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.868+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2212242484 wait complete. 2024-09-21T06:15:43.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.870+0000 7fa1e7e00640 1 Processor -- start 2024-09-21T06:15:43.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.870+0000 7fa1e7e00640 1 -- start start 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e80b3be0 0x7fa1e81f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e80d3400 0x7fa1e80cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e7e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80b6f20 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80b6da0 con 0x7fa1e80d3400 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80b70a0 con 0x7fa1e80b3be0 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42610/0 (socket says 172.21.15.118:42610) 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e6000640 1 -- 172.21.15.118:0/2830138912 learned_addr learned my addr 172.21.15.118:0/2830138912 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:43.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e6a00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e80b3be0 0x7fa1e81f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.872+0000 7fa1e7400640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e80d3400 0x7fa1e80cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e6000640 1 -- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e80b3be0 msgr2=0x7fa1e81f9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e6000640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e80b3be0 0x7fa1e81f9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e6000640 1 -- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e80d3400 msgr2=0x7fa1e80cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:43.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e6000640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e80d3400 0x7fa1e80cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:43.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e6000640 1 -- 172.21.15.118:0/2830138912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e81fa090 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e7400640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e80d3400 0x7fa1e80cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:43.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e6000640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80cd310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4005fd0 tx=0x7fa1d40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:43.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d403e030 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1d4003ca0 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4035040 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e8161fe0 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.873+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e81f5990 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.874+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e80d2ec0 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.876+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1d4041030 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.877+0000 7fa1dea00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa1c8078b90 0x7fa1c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:43.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.877+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5738+0+0 (secure 0 0 0) 0x7fa1d40bb410 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.877+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=167}) -- 0x7fa1c8080770 con 0x7fa1e80d2ab0 2024-09-21T06:15:43.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.877+0000 7fa1e6a00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa1c8078b90 0x7fa1c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:43.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.878+0000 7fa1e6a00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa1c8078b90 0x7fa1c807b0a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa1e806fae0 tx=0x7fa1d8005f30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:43.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:43.881+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa1e81fa090 con 0x7fa1e80d2ab0 2024-09-21T06:15:44.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.103+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa1e80ba310 con 0x7fa1e80d2ab0 2024-09-21T06:15:44.106 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:15:44.104+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:15:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.106+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) ==== 161+0+0 (secure 0 0 0) 0x7fa1d4083140 con 0x7fa1e80d2ab0 2024-09-21T06:15:44.108 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:15:44.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.107+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(167..167 src has 1..167) ==== 374+0+0 (secure 0 0 0) 0x7fa1d40f22b0 con 0x7fa1e80d2ab0 2024-09-21T06:15:44.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.107+0000 7fa1dea00640 1 -- 172.21.15.118:0/2830138912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=168}) -- 0x7fa1c80811b0 con 0x7fa1e80d2ab0 2024-09-21T06:15:44.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa1c8078b90 msgr2=0x7fa1c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa1c8078b90 0x7fa1c807b0a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa1e806fae0 tx=0x7fa1d8005f30 comp rx=0 tx=0).stop 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 msgr2=0x7fa1e80cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80cd310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4005fd0 tx=0x7fa1d40038a0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 shutdown_connections 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1e80d3400 0x7fa1e80cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1e80d2ab0 0x7fa1e80cd310 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa1c8078b90 0x7fa1c807b0a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 --2- 172.21.15.118:0/2830138912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1e80b3be0 0x7fa1e81f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 >> 172.21.15.118:0/2830138912 conn(0x7fa1e80d4bd0 msgr2=0x7fa1e80b83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 shutdown_connections 2024-09-21T06:15:44.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.111+0000 7fa1e7e00640 1 -- 172.21.15.118:0/2830138912 wait complete. 2024-09-21T06:15:44.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:15:44.252 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:15:44.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.364+0000 7f843be00640 1 -- 172.21.15.118:0/1556005983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 msgr2=0x7f843c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:44.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.364+0000 7f843be00640 1 --2- 172.21.15.118:0/1556005983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0d0240 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f8428005fd0 tx=0x7f842802a5f0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.364+0000 7f843be00640 1 -- 172.21.15.118:0/1556005983 shutdown_connections 2024-09-21T06:15:44.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.364+0000 7f843be00640 1 --2- 172.21.15.118:0/1556005983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0d0240 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.364+0000 7f843be00640 1 -- 172.21.15.118:0/1556005983 >> 172.21.15.118:0/1556005983 conn(0x7f843c06d6e0 msgr2=0x7f843c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:44.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.364+0000 7f843be00640 1 -- 172.21.15.118:0/1556005983 shutdown_connections 2024-09-21T06:15:44.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.364+0000 7f843be00640 1 -- 172.21.15.118:0/1556005983 wait complete. 2024-09-21T06:15:44.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.366+0000 7f843be00640 1 Processor -- start 2024-09-21T06:15:44.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.367+0000 7f843be00640 1 -- start start 2024-09-21T06:15:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f843c073fa0 0x7f843c1f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f843c0b5bb0 0x7f843c1f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f843c15db10 con 0x7f843c0cfe30 2024-09-21T06:15:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f843c15d990 con 0x7f843c073fa0 2024-09-21T06:15:44.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f843c15dc90 con 0x7f843c0b5bb0 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42652/0 (socket says 172.21.15.118:42652) 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.368+0000 7f843b400640 1 -- 172.21.15.118:0/1692291341 learned_addr learned my addr 172.21.15.118:0/1692291341 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843a000640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f843c0b5bb0 0x7f843c1f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843aa00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f843c073fa0 0x7f843c1f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843b400640 1 -- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f843c0b5bb0 msgr2=0x7f843c1f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843b400640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f843c0b5bb0 0x7f843c1f61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843b400640 1 -- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f843c073fa0 msgr2=0x7f843c1f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843b400640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f843c073fa0 0x7f843c1f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843b400640 1 -- 172.21.15.118:0/1692291341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c1f9720 con 0x7f843c0cfe30 2024-09-21T06:15:44.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843b400640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0b2450 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f843400c700 tx=0x7f843400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:44.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8434003b70 con 0x7f843c0cfe30 2024-09-21T06:15:44.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8434003d10 con 0x7f843c0cfe30 2024-09-21T06:15:44.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843400aab0 con 0x7f843c0cfe30 2024-09-21T06:15:44.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.369+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843c1f9a00 con 0x7f843c0cfe30 2024-09-21T06:15:44.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.370+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843c1f5cb0 con 0x7f843c0cfe30 2024-09-21T06:15:44.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.371+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843c1f9490 con 0x7f843c0cfe30 2024-09-21T06:15:44.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.372+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f843400ac50 con 0x7f843c0cfe30 2024-09-21T06:15:44.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.374+0000 7f8432a00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f841c078b90 0x7f841c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:44.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.374+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5824+0+0 (secure 0 0 0) 0x7f843409aab0 con 0x7f843c0cfe30 2024-09-21T06:15:44.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.374+0000 7f843aa00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f841c078b90 0x7f841c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:44.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.374+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=168}) -- 0x7f841c080880 con 0x7f843c0cfe30 2024-09-21T06:15:44.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.375+0000 7f843aa00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f841c078b90 0x7f841c07b0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f842c000f60 tx=0x7f842c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:44.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.378+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8434062840 con 0x7f843c0cfe30 2024-09-21T06:15:44.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:44.603+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f843c15f2c0 con 0x7f843c0cfe30 2024-09-21T06:15:45.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.108+0000 7f8432a00640 1 -- 172.21.15.118:0/1692291341 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) ==== 104+0+0 (secure 0 0 0) 0x7f8434067270 con 0x7f843c0cfe30 2024-09-21T06:15:45.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f841c078b90 msgr2=0x7f841c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:45.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f841c078b90 0x7f841c07b0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f842c000f60 tx=0x7f842c009040 comp rx=0 tx=0).stop 2024-09-21T06:15:45.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 msgr2=0x7f843c0b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:45.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0b2450 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f843400c700 tx=0x7f843400cbc0 comp rx=0 tx=0).stop 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 shutdown_connections 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c0cfe30 0x7f843c0b2450 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f841c078b90 0x7f841c07b0a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f843c0b5bb0 0x7f843c1f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 --2- 172.21.15.118:0/1692291341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f843c073fa0 0x7f843c1f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 >> 172.21.15.118:0/1692291341 conn(0x7f843c06d6e0 msgr2=0x7f843c146150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 shutdown_connections 2024-09-21T06:15:45.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.111+0000 7f843be00640 1 -- 172.21.15.118:0/1692291341 wait complete. 2024-09-21T06:15:45.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:15:45.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.363+0000 7f67cd400640 1 -- 172.21.15.118:0/2496141822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67ac003fd0 msgr2=0x7f67ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:45.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.363+0000 7f67cd400640 1 --2- 172.21.15.118:0/2496141822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67ac003fd0 0x7f67ac004800 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f67b000c470 tx=0x7f67ac005830 comp rx=0 tx=0).stop 2024-09-21T06:15:45.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.363+0000 7f67cca00640 1 -- 172.21.15.118:0/2496141822 reap_dead start 2024-09-21T06:15:45.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.363+0000 7f67cd400640 1 -- 172.21.15.118:0/2496141822 shutdown_connections 2024-09-21T06:15:45.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.363+0000 7f67cd400640 1 -- 172.21.15.118:0/2496141822 >> 172.21.15.118:0/2496141822 conn(0x7f67c806d420 msgr2=0x7f67c80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:45.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.363+0000 7f67cd400640 1 -- 172.21.15.118:0/2496141822 shutdown_connections 2024-09-21T06:15:45.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.363+0000 7f67cd400640 1 -- 172.21.15.118:0/2496141822 wait complete. 2024-09-21T06:15:45.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.366+0000 7f67cd400640 1 Processor -- start 2024-09-21T06:15:45.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.366+0000 7f67cd400640 1 -- start start 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67cd400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67c81f6000 0x7f67c81f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67cd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67c80ce730 0x7f67c80ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67cd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67c815ce90 0x7f67c815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67cd400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f67c806fef0 con 0x7f67c81f6000 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67cd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f67c806fd70 con 0x7f67c815ce90 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67cd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f67c8070070 con 0x7f67c80ce730 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67c81f6000 0x7f67c81f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67c81f6000 0x7f67c81f7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42678/0 (socket says 172.21.15.118:42678) 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.367+0000 7f67c7e00640 1 -- 172.21.15.118:0/2888684927 learned_addr learned my addr 172.21.15.118:0/2888684927 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:45.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67cca00640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67c815ce90 0x7f67c815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67bf400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67c80ce730 0x7f67c80ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c7e00640 1 -- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67c80ce730 msgr2=0x7f67c80ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c7e00640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67c80ce730 0x7f67c80ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c7e00640 1 -- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67c815ce90 msgr2=0x7f67c815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c7e00640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67c815ce90 0x7f67c815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c7e00640 1 -- 172.21.15.118:0/2888684927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c81f6410 con 0x7f67c81f6000 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67cca00640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67c815ce90 0x7f67c815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c7e00640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67c81f6000 0x7f67c81f7090 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f67b8011b10 tx=0x7f67b8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b800fce0 con 0x7f67c81f6000 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67b800fe80 con 0x7f67c81f6000 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b8004280 con 0x7f67c81f6000 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.368+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c80cf080 con 0x7f67c81f6000 2024-09-21T06:15:45.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.369+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c815da90 con 0x7f67c81f6000 2024-09-21T06:15:45.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.370+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c80b5b90 con 0x7f67c81f6000 2024-09-21T06:15:45.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.371+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67b80035f0 con 0x7f67c81f6000 2024-09-21T06:15:45.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.373+0000 7f67c4c00640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f67a4078b90 0x7f67a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:45.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.373+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5824+0+0 (secure 0 0 0) 0x7f67b809c1c0 con 0x7f67c81f6000 2024-09-21T06:15:45.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.373+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=168}) -- 0x7f67a4080870 con 0x7f67c81f6000 2024-09-21T06:15:45.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.373+0000 7f67bf400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f67a4078b90 0x7f67a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:45.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.374+0000 7f67bf400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f67a4078b90 0x7f67a407b0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f67b0033000 tx=0x7f67b002d070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:45.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.376+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f67c80b5b90 con 0x7f67c81f6000 2024-09-21T06:15:45.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:45.563+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67c80b3af0 con 0x7f67c81f6000 2024-09-21T06:15:46.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.451+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v168) ==== 181+0+0 (secure 0 0 0) 0x7f67c80b3af0 con 0x7f67c81f6000 2024-09-21T06:15:46.454 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:15:46.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.451+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(168..168 src has 1..168) ==== 296+0+0 (secure 0 0 0) 0x7f67b8004420 con 0x7f67c81f6000 2024-09-21T06:15:46.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.452+0000 7f67c4c00640 1 -- 172.21.15.118:0/2888684927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=169}) -- 0x7f67a407eca0 con 0x7f67c81f6000 2024-09-21T06:15:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.457+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f67a4078b90 msgr2=0x7f67a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.457+0000 7f67cd400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f67a4078b90 0x7f67a407b0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f67b0033000 tx=0x7f67b002d070 comp rx=0 tx=0).stop 2024-09-21T06:15:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.457+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67c81f6000 msgr2=0x7f67c81f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:46.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.457+0000 7f67cd400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67c81f6000 0x7f67c81f7090 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f67b8011b10 tx=0x7f67b8009f10 comp rx=0 tx=0).stop 2024-09-21T06:15:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.458+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 shutdown_connections 2024-09-21T06:15:46.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.458+0000 7f67cd400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67c815ce90 0x7f67c815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.458+0000 7f67cd400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f67a4078b90 0x7f67a407b0a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.458+0000 7f67cd400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67c80ce730 0x7f67c80ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.458+0000 7f67cd400640 1 --2- 172.21.15.118:0/2888684927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67c81f6000 0x7f67c81f7090 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.458+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 >> 172.21.15.118:0/2888684927 conn(0x7f67c806d420 msgr2=0x7f67c80ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:46.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.460+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 shutdown_connections 2024-09-21T06:15:46.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.460+0000 7f67cd400640 1 -- 172.21.15.118:0/2888684927 wait complete. 2024-09-21T06:15:46.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 -- 172.21.15.118:0/1472872665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61700cf790 msgr2=0x7f61700cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 --2- 172.21.15.118:0/1472872665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61700cf790 0x7f61700cd380 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f6170072460 tx=0x7f616002a4a0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 -- 172.21.15.118:0/1472872665 shutdown_connections 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 --2- 172.21.15.118:0/1472872665 >> v2:172.21.15.149:3300/0 conn(0x7f6170156ef0 0x7f61701606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 --2- 172.21.15.118:0/1472872665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61700cf790 0x7f61700cd380 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 -- 172.21.15.118:0/1472872665 >> 172.21.15.118:0/1472872665 conn(0x7f617006d420 msgr2=0x7f61700b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 -- 172.21.15.118:0/1472872665 shutdown_connections 2024-09-21T06:15:46.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.718+0000 7f6174a00640 1 -- 172.21.15.118:0/1472872665 wait complete. 2024-09-21T06:15:46.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.720+0000 7f6174a00640 1 Processor -- start 2024-09-21T06:15:46.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.721+0000 7f6174a00640 1 -- start start 2024-09-21T06:15:46.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6174a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61700cf790 0x7f61701f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:46.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6174a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6170156ef0 0x7f61701f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:46.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6174a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61701f75f0 0x7f61701f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6174a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f617015d800 con 0x7f6170156ef0 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6174a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6170160fd0 con 0x7f61700cf790 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6174a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f617015d980 con 0x7f61701f75f0 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6165e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6170156ef0 0x7f61701f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6165e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6170156ef0 0x7f61701f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33214/0 (socket says 172.21.15.118:33214) 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f6165e00640 1 -- 172.21.15.118:0/2219486678 learned_addr learned my addr 172.21.15.118:0/2219486678 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.722+0000 7f616e800640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61700cf790 0x7f61701f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f616f200640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61701f75f0 0x7f61701f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6165e00640 1 -- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61701f75f0 msgr2=0x7f61701f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6165e00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61701f75f0 0x7f61701f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6165e00640 1 -- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61700cf790 msgr2=0x7f61701f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:46.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6165e00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61700cf790 0x7f61701f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6165e00640 1 -- 172.21.15.118:0/2219486678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6170135fd0 con 0x7f6170156ef0 2024-09-21T06:15:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6165e00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6170156ef0 0x7f61701f70b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f615800c970 tx=0x7f615800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6158007bb0 con 0x7f6170156ef0 2024-09-21T06:15:46.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6158007e40 con 0x7f6170156ef0 2024-09-21T06:15:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.723+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615800f6b0 con 0x7f6170156ef0 2024-09-21T06:15:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.724+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61701f4a40 con 0x7f6170156ef0 2024-09-21T06:15:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.724+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6170158480 con 0x7f6170156ef0 2024-09-21T06:15:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.725+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6170050f60 con 0x7f6170156ef0 2024-09-21T06:15:46.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.726+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f615800f850 con 0x7f6170156ef0 2024-09-21T06:15:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.727+0000 7f6167400640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f614c078b90 0x7f614c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.727+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5386+0+0 (secure 0 0 0) 0x7f615809b2e0 con 0x7f6170156ef0 2024-09-21T06:15:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.727+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=169}) -- 0x7f614c07fa10 con 0x7f6170156ef0 2024-09-21T06:15:46.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.727+0000 7f616e800640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f614c078b90 0x7f614c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:46.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.728+0000 7f616e800640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f614c078b90 0x7f614c07b0a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6160033000 tx=0x7f6160004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:46.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.731+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6170050f60 con 0x7f6170156ef0 2024-09-21T06:15:46.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:46.919+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f61700af000 con 0x7f6170156ef0 2024-09-21T06:15:47.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.468+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v169) ==== 169+0+0 (secure 0 0 0) 0x7f6158014030 con 0x7f6170156ef0 2024-09-21T06:15:47.471 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:15:47.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.469+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(169..169 src has 1..169) ==== 313+0+0 (secure 0 0 0) 0x7f61580d22b0 con 0x7f6170156ef0 2024-09-21T06:15:47.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.469+0000 7f6167400640 1 -- 172.21.15.118:0/2219486678 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=170}) -- 0x7f614c07e7a0 con 0x7f6170156ef0 2024-09-21T06:15:47.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.476+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f614c078b90 msgr2=0x7f614c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:47.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.476+0000 7f6174a00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f614c078b90 0x7f614c07b0a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6160033000 tx=0x7f6160004730 comp rx=0 tx=0).stop 2024-09-21T06:15:47.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.476+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6170156ef0 msgr2=0x7f61701f70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:47.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.476+0000 7f6174a00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6170156ef0 0x7f61701f70b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f615800c970 tx=0x7f615800ce30 comp rx=0 tx=0).stop 2024-09-21T06:15:47.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.478+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 shutdown_connections 2024-09-21T06:15:47.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.478+0000 7f6174a00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f614c078b90 0x7f614c07b0a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.478+0000 7f6174a00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61701f75f0 0x7f61701f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.478+0000 7f6174a00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6170156ef0 0x7f61701f70b0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.478+0000 7f6174a00640 1 --2- 172.21.15.118:0/2219486678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61700cf790 0x7f61701f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.478+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 >> 172.21.15.118:0/2219486678 conn(0x7f617006d420 msgr2=0x7f61700b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:47.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.479+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 shutdown_connections 2024-09-21T06:15:47.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.479+0000 7f6174a00640 1 -- 172.21.15.118:0/2219486678 wait complete. 2024-09-21T06:15:47.510 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 -- 172.21.15.118:0/3250335007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c13fae0 msgr2=0x7fef5c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 --2- 172.21.15.118:0/3250335007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c13fae0 0x7fef5c0d0e80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fef50005fd0 tx=0x7fef5002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 -- 172.21.15.118:0/3250335007 shutdown_connections 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 --2- 172.21.15.118:0/3250335007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef5c142e40 0x7fef5c0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 --2- 172.21.15.118:0/3250335007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c13fae0 0x7fef5c0d0e80 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 -- 172.21.15.118:0/3250335007 >> 172.21.15.118:0/3250335007 conn(0x7fef5c06d110 msgr2=0x7fef5c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 -- 172.21.15.118:0/3250335007 shutdown_connections 2024-09-21T06:15:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.730+0000 7fef63e00640 1 -- 172.21.15.118:0/3250335007 wait complete. 2024-09-21T06:15:47.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.733+0000 7fef63e00640 1 Processor -- start 2024-09-21T06:15:47.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.733+0000 7fef63e00640 1 -- start start 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.734+0000 7fef63e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5c13fae0 0x7fef5c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.734+0000 7fef63e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef5c13fef0 0x7fef5c132380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.734+0000 7fef63e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c142e40 0x7fef5c15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.734+0000 7fef63e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c0cfa90 con 0x7fef5c142e40 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.734+0000 7fef63e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c0cf910 con 0x7fef5c13fae0 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.734+0000 7fef63e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c0cfc10 con 0x7fef5c13fef0 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.734+0000 7fef61e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c142e40 0x7fef5c15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c142e40 0x7fef5c15bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33230/0 (socket says 172.21.15.118:33230) 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 -- 172.21.15.118:0/394297956 learned_addr learned my addr 172.21.15.118:0/394297956 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef60a00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef5c13fef0 0x7fef5c132380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61400640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5c13fae0 0x7fef5c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 -- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef5c13fef0 msgr2=0x7fef5c132380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef5c13fef0 0x7fef5c132380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 -- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5c13fae0 msgr2=0x7fef5c154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5c13fae0 0x7fef5c154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 -- 172.21.15.118:0/394297956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c154ba0 con 0x7fef5c142e40 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef60a00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef5c13fef0 0x7fef5c132380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef61e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c142e40 0x7fef5c15bf90 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9c0 tx=0x7fef5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.735+0000 7fef59600640 1 -- 172.21.15.118:0/394297956 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54004d20 con 0x7fef5c142e40 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.736+0000 7fef59600640 1 -- 172.21.15.118:0/394297956 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef5400cb20 con 0x7fef5c142e40 2024-09-21T06:15:47.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.736+0000 7fef59600640 1 -- 172.21.15.118:0/394297956 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54005020 con 0x7fef5c142e40 2024-09-21T06:15:47.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.736+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5c158550 con 0x7fef5c142e40 2024-09-21T06:15:47.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.736+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef5c158b10 con 0x7fef5c142e40 2024-09-21T06:15:47.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.737+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5c0d0130 con 0x7fef5c142e40 2024-09-21T06:15:47.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.738+0000 7fef59600640 1 -- 172.21.15.118:0/394297956 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef540051c0 con 0x7fef5c142e40 2024-09-21T06:15:47.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.739+0000 7fef59600640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef3c078b90 0x7fef3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:47.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.739+0000 7fef59600640 1 -- 172.21.15.118:0/394297956 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fef5409b350 con 0x7fef5c142e40 2024-09-21T06:15:47.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.740+0000 7fef61400640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef3c078b90 0x7fef3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:47.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.740+0000 7fef61400640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef3c078b90 0x7fef3c07b0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fef50033000 tx=0x7fef50004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:47.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.743+0000 7fef59600640 1 -- 172.21.15.118:0/394297956 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fef54016030 con 0x7fef5c142e40 2024-09-21T06:15:47.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.931+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fef5c15ba70 con 0x7fef5c142e40 2024-09-21T06:15:47.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.936+0000 7fef59600640 1 -- 172.21.15.118:0/394297956 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7fef540633a0 con 0x7fef5c142e40 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef3c078b90 msgr2=0x7fef3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef3c078b90 0x7fef3c07b0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fef50033000 tx=0x7fef50004730 comp rx=0 tx=0).stop 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c142e40 msgr2=0x7fef5c15bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c142e40 0x7fef5c15bf90 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9c0 tx=0x7fef5400ee80 comp rx=0 tx=0).stop 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 shutdown_connections 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5c142e40 0x7fef5c15bf90 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fef3c078b90 0x7fef3c07b0a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef5c13fef0 0x7fef5c132380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 --2- 172.21.15.118:0/394297956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef5c13fae0 0x7fef5c154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:47.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 >> 172.21.15.118:0/394297956 conn(0x7fef5c06d110 msgr2=0x7fef5c142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:47.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 shutdown_connections 2024-09-21T06:15:47.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:47.938+0000 7fef63e00640 1 -- 172.21.15.118:0/394297956 wait complete. 2024-09-21T06:15:47.964 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-21T06:15:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.183+0000 7fe857200640 1 -- 172.21.15.118:0/2899506648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fae0 msgr2=0x7fe8500d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.183+0000 7fe857200640 1 --2- 172.21.15.118:0/2899506648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fae0 0x7fe8500d0e80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe840009860 tx=0x7fe84002a510 comp rx=0 tx=0).stop 2024-09-21T06:15:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.183+0000 7fe857200640 1 -- 172.21.15.118:0/2899506648 shutdown_connections 2024-09-21T06:15:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.183+0000 7fe857200640 1 --2- 172.21.15.118:0/2899506648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fae0 0x7fe8500d0e80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.183+0000 7fe857200640 1 -- 172.21.15.118:0/2899506648 >> 172.21.15.118:0/2899506648 conn(0x7fe85006d110 msgr2=0x7fe85006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.183+0000 7fe857200640 1 -- 172.21.15.118:0/2899506648 shutdown_connections 2024-09-21T06:15:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.183+0000 7fe857200640 1 -- 172.21.15.118:0/2899506648 wait complete. 2024-09-21T06:15:48.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.185+0000 7fe857200640 1 Processor -- start 2024-09-21T06:15:48.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.185+0000 7fe857200640 1 -- start start 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.186+0000 7fe857200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe85013fae0 0x7fe850156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.186+0000 7fe857200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fef0 0x7fe8501e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.186+0000 7fe857200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850142e40 0x7fe8501e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.186+0000 7fe857200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe8500cfd40 con 0x7fe850142e40 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.186+0000 7fe857200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8500cfbc0 con 0x7fe85013fae0 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.186+0000 7fe857200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe8500cfec0 con 0x7fe85013fef0 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe855200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850142e40 0x7fe8501e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe84fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe85013fae0 0x7fe850156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe855200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850142e40 0x7fe8501e6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33244/0 (socket says 172.21.15.118:33244) 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe855200640 1 -- 172.21.15.118:0/886110971 learned_addr learned my addr 172.21.15.118:0/886110971 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe847400640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fef0 0x7fe8501e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe84fe00640 1 -- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fef0 msgr2=0x7fe8501e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe84fe00640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fef0 0x7fe8501e69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe84fe00640 1 -- 172.21.15.118:0/886110971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850142e40 msgr2=0x7fe8501e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe84fe00640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850142e40 0x7fe8501e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe84fe00640 1 -- 172.21.15.118:0/886110971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8501fa700 con 0x7fe85013fae0 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.187+0000 7fe855200640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850142e40 0x7fe8501e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:48.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.188+0000 7fe84fe00640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe85013fae0 0x7fe850156490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe850075180 tx=0x7fe840033c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:48.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.188+0000 7fe84cc00640 1 -- 172.21.15.118:0/886110971 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840005c90 con 0x7fe85013fae0 2024-09-21T06:15:48.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.188+0000 7fe84cc00640 1 -- 172.21.15.118:0/886110971 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe840031e50 con 0x7fe85013fae0 2024-09-21T06:15:48.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.188+0000 7fe84cc00640 1 -- 172.21.15.118:0/886110971 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840005260 con 0x7fe85013fae0 2024-09-21T06:15:48.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.188+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8501569d0 con 0x7fe85013fae0 2024-09-21T06:15:48.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.188+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8501f9e60 con 0x7fe85013fae0 2024-09-21T06:15:48.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.189+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8500d0370 con 0x7fe85013fae0 2024-09-21T06:15:48.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.190+0000 7fe84cc00640 1 -- 172.21.15.118:0/886110971 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe840005400 con 0x7fe85013fae0 2024-09-21T06:15:48.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.191+0000 7fe84cc00640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe82c078b90 0x7fe82c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.191+0000 7fe84cc00640 1 -- 172.21.15.118:0/886110971 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fe8400bb9e0 con 0x7fe85013fae0 2024-09-21T06:15:48.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.192+0000 7fe847400640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe82c078b90 0x7fe82c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.193+0000 7fe847400640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe82c078b90 0x7fe82c07b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe8501eaf90 tx=0x7fe838009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:48.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.196+0000 7fe84cc00640 1 -- 172.21.15.118:0/886110971 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe84003f030 con 0x7fe85013fae0 2024-09-21T06:15:48.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.448+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7fe8501eb900 con 0x7fe85013fae0 2024-09-21T06:15:48.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.475+0000 7fe84cc00640 1 -- 172.21.15.118:0/886110971 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v554) ==== 131+0+0 (secure 0 0 0) 0x7fe840083bf0 con 0x7fe85013fae0 2024-09-21T06:15:48.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe82c078b90 msgr2=0x7fe82c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe82c078b90 0x7fe82c07b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe8501eaf90 tx=0x7fe838009040 comp rx=0 tx=0).stop 2024-09-21T06:15:48.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe85013fae0 msgr2=0x7fe850156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe85013fae0 0x7fe850156490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe850075180 tx=0x7fe840033c20 comp rx=0 tx=0).stop 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 shutdown_connections 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe850142e40 0x7fe8501e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe82c078b90 0x7fe82c07b0a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe85013fef0 0x7fe8501e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 --2- 172.21.15.118:0/886110971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe85013fae0 0x7fe850156490 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 >> 172.21.15.118:0/886110971 conn(0x7fe85006d110 msgr2=0x7fe8500cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 shutdown_connections 2024-09-21T06:15:48.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.478+0000 7fe857200640 1 -- 172.21.15.118:0/886110971 wait complete. 2024-09-21T06:15:48.502 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-21T06:15:48.503 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-21T06:15:48.503 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:15:48.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 -- 172.21.15.118:0/1597575962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 msgr2=0x7f906c0cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 --2- 172.21.15.118:0/1597575962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c0cf1c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9054005fd0 tx=0x7f905402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 -- 172.21.15.118:0/1597575962 shutdown_connections 2024-09-21T06:15:48.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 --2- 172.21.15.118:0/1597575962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c0cf1c0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 --2- 172.21.15.118:0/1597575962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f906c144ea0 0x7f906c144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 -- 172.21.15.118:0/1597575962 >> 172.21.15.118:0/1597575962 conn(0x7f906c06d6e0 msgr2=0x7f906c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:48.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 -- 172.21.15.118:0/1597575962 shutdown_connections 2024-09-21T06:15:48.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.722+0000 7f9071800640 1 -- 172.21.15.118:0/1597575962 wait complete. 2024-09-21T06:15:48.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.724+0000 7f9071800640 1 Processor -- start 2024-09-21T06:15:48.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.724+0000 7f9071800640 1 -- start start 2024-09-21T06:15:48.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9071800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9071800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906c0cf700 0x7f906c0ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9071800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f906c144ea0 0x7f906c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9071800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f906c15fe40 con 0x7f906c0cedb0 2024-09-21T06:15:48.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9071800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f906c0b5360 con 0x7f906c0cf700 2024-09-21T06:15:48.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9071800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f906c15ffc0 con 0x7f906c144ea0 2024-09-21T06:15:48.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33260/0 (socket says 172.21.15.118:33260) 2024-09-21T06:15:48.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 -- 172.21.15.118:0/2547756599 learned_addr learned my addr 172.21.15.118:0/2547756599 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:48.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9070e00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f906c144ea0 0x7f906c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f9063e00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906c0cf700 0x7f906c0ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 -- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f906c144ea0 msgr2=0x7f906c15a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f906c144ea0 0x7f906c15a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 -- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906c0cf700 msgr2=0x7f906c0ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906c0cf700 0x7f906c0ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.726+0000 7f906be00640 1 -- 172.21.15.118:0/2547756599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c13d590 con 0x7f906c0cedb0 2024-09-21T06:15:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.727+0000 7f906be00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c159270 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f905c00d6d0 tx=0x7f905c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:48.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.727+0000 7f9068c00640 1 -- 172.21.15.118:0/2547756599 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c017070 con 0x7f906c0cedb0 2024-09-21T06:15:48.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.727+0000 7f9068c00640 1 -- 172.21.15.118:0/2547756599 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f905c005330 con 0x7f906c0cedb0 2024-09-21T06:15:48.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.727+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906c13d870 con 0x7f906c0cedb0 2024-09-21T06:15:48.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.727+0000 7f9068c00640 1 -- 172.21.15.118:0/2547756599 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c009820 con 0x7f906c0cedb0 2024-09-21T06:15:48.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.727+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906c13de30 con 0x7f906c0cedb0 2024-09-21T06:15:48.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.728+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906c160470 con 0x7f906c0cedb0 2024-09-21T06:15:48.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.730+0000 7f9068c00640 1 -- 172.21.15.118:0/2547756599 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f905c009bd0 con 0x7f906c0cedb0 2024-09-21T06:15:48.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.731+0000 7f9068c00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9048078bc0 0x7f904807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:48.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.731+0000 7f9068c00640 1 -- 172.21.15.118:0/2547756599 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f905c09ad30 con 0x7f906c0cedb0 2024-09-21T06:15:48.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.732+0000 7f9063e00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9048078bc0 0x7f904807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:48.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.732+0000 7f9063e00640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9048078bc0 0x7f904807b0d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9054033000 tx=0x7f9054004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.736+0000 7f9068c00640 1 -- 172.21.15.118:0/2547756599 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f905c062d80 con 0x7f906c0cedb0 2024-09-21T06:15:48.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.919+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f906c077520 con 0x7f906c0cedb0 2024-09-21T06:15:48.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.920+0000 7f9068c00640 1 -- 172.21.15.118:0/2547756599 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+13117 (secure 0 0 0) 0x7f905c0677b0 con 0x7f906c0cedb0 2024-09-21T06:15:48.922 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:48.923 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":169,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:15:47.464208+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6835/4151315485":"2024-09-22T06:15:44.105367+0000","172.21.15.118:6833/4151315485":"2024-09-22T06:15:44.105367+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:15:48.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9048078bc0 msgr2=0x7f904807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9048078bc0 0x7f904807b0d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9054033000 tx=0x7f9054004730 comp rx=0 tx=0).stop 2024-09-21T06:15:48.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 msgr2=0x7f906c159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:48.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c159270 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f905c00d6d0 tx=0x7f905c00db90 comp rx=0 tx=0).stop 2024-09-21T06:15:48.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 shutdown_connections 2024-09-21T06:15:48.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9048078bc0 0x7f904807b0d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f906c144ea0 0x7f906c15a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906c0cf700 0x7f906c0ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 --2- 172.21.15.118:0/2547756599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f906c0cedb0 0x7f906c159270 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:48.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 >> 172.21.15.118:0/2547756599 conn(0x7f906c06d6e0 msgr2=0x7f906c0b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:48.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 shutdown_connections 2024-09-21T06:15:48.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:48.922+0000 7f9071800640 1 -- 172.21.15.118:0/2547756599 wait complete. 2024-09-21T06:15:48.950 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:03:44.483842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:15:48.950 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 -- 172.21.15.118:0/2341082565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2300cf720 msgr2=0x7ff2300cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 --2- 172.21.15.118:0/2341082565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2300cf720 0x7ff2300cd360 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff224009830 tx=0x7ff22402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 -- 172.21.15.118:0/2341082565 shutdown_connections 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 --2- 172.21.15.118:0/2341082565 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2301610f0 0x7ff23006f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 --2- 172.21.15.118:0/2341082565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2300cf720 0x7ff2300cd360 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 -- 172.21.15.118:0/2341082565 >> 172.21.15.118:0/2341082565 conn(0x7ff2300b2860 msgr2=0x7ff2300b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 -- 172.21.15.118:0/2341082565 shutdown_connections 2024-09-21T06:15:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.170+0000 7ff237a00640 1 -- 172.21.15.118:0/2341082565 wait complete. 2024-09-21T06:15:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.172+0000 7ff237a00640 1 Processor -- start 2024-09-21T06:15:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.173+0000 7ff237a00640 1 -- start start 2024-09-21T06:15:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff237a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2300cd8a0 0x7ff2301f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff237a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cf720 0x7ff2301584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff237a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff23013c420 0x7ff230159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff237a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff230070070 con 0x7ff2300cd8a0 2024-09-21T06:15:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff237a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff23006fef0 con 0x7ff23013c420 2024-09-21T06:15:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff237a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff2300701f0 con 0x7ff2300cf720 2024-09-21T06:15:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff235000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2300cd8a0 0x7ff2301f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff235000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2300cd8a0 0x7ff2301f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33276/0 (socket says 172.21.15.118:33276) 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.174+0000 7ff235000640 1 -- 172.21.15.118:0/3318257064 learned_addr learned my addr 172.21.15.118:0/3318257064 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff22fe00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cf720 0x7ff2301584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff235a00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff23013c420 0x7ff230159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff235000640 1 -- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cf720 msgr2=0x7ff2301584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff235000640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cf720 0x7ff2301584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff235000640 1 -- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff23013c420 msgr2=0x7ff230159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff235000640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff23013c420 0x7ff230159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff235000640 1 -- 172.21.15.118:0/3318257064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2300b0870 con 0x7ff2300cd8a0 2024-09-21T06:15:49.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff235000640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2300cd8a0 0x7ff2301f5d20 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff224009950 tx=0x7ff224003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff22cc00640 1 -- 172.21.15.118:0/3318257064 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224005c90 con 0x7ff2300cd8a0 2024-09-21T06:15:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff22cc00640 1 -- 172.21.15.118:0/3318257064 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff224005020 con 0x7ff2300cd8a0 2024-09-21T06:15:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2300b0b50 con 0x7ff2300cd8a0 2024-09-21T06:15:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.175+0000 7ff22cc00640 1 -- 172.21.15.118:0/3318257064 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224005450 con 0x7ff2300cd8a0 2024-09-21T06:15:49.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.176+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2300b1110 con 0x7ff2300cd8a0 2024-09-21T06:15:49.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.177+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2300ce610 con 0x7ff2300cd8a0 2024-09-21T06:15:49.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.178+0000 7ff22cc00640 1 -- 172.21.15.118:0/3318257064 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2240317c0 con 0x7ff2300cd8a0 2024-09-21T06:15:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.179+0000 7ff22cc00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078bc0 0x7ff21007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.180+0000 7ff22cc00640 1 -- 172.21.15.118:0/3318257064 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7ff2240bb9e0 con 0x7ff2300cd8a0 2024-09-21T06:15:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.180+0000 7ff22fe00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078bc0 0x7ff21007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.180+0000 7ff22fe00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078bc0 0x7ff21007b0d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff2301464c0 tx=0x7ff21c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:49.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.184+0000 7ff22cc00640 1 -- 172.21.15.118:0/3318257064 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff2300ce610 con 0x7ff2300cd8a0 2024-09-21T06:15:49.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.368+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2300707a0 con 0x7ff2300cd8a0 2024-09-21T06:15:49.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.369+0000 7ff22cc00640 1 -- 172.21.15.118:0/3318257064 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v169) ==== 93+0+10 (secure 0 0 0) 0x7ff22403f030 con 0x7ff2300cd8a0 2024-09-21T06:15:49.371 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078bc0 msgr2=0x7ff21007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078bc0 0x7ff21007b0d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff2301464c0 tx=0x7ff21c009040 comp rx=0 tx=0).stop 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2300cd8a0 msgr2=0x7ff2301f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2300cd8a0 0x7ff2301f5d20 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff224009950 tx=0x7ff224003c10 comp rx=0 tx=0).stop 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 shutdown_connections 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff23013c420 0x7ff230159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff210078bc0 0x7ff21007b0d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2300cf720 0x7ff2301584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 --2- 172.21.15.118:0/3318257064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2300cd8a0 0x7ff2301f5d20 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 >> 172.21.15.118:0/3318257064 conn(0x7ff2300b2860 msgr2=0x7ff23015b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:49.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 shutdown_connections 2024-09-21T06:15:49.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.371+0000 7ff237a00640 1 -- 172.21.15.118:0/3318257064 wait complete. 2024-09-21T06:15:49.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-21T06:15:49.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.617+0000 7ff6ad200640 1 -- 172.21.15.118:0/3596642195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff68c003a30 msgr2=0x7ff68c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.617+0000 7ff6ad200640 1 --2- 172.21.15.118:0/3596642195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff68c003a30 0x7ff68c003e60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7ff6980017b0 tx=0x7ff68c005830 comp rx=0 tx=0).stop 2024-09-21T06:15:49.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.617+0000 7ff6a6800640 1 -- 172.21.15.118:0/3596642195 reap_dead start 2024-09-21T06:15:49.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.617+0000 7ff6ad200640 1 -- 172.21.15.118:0/3596642195 shutdown_connections 2024-09-21T06:15:49.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.617+0000 7ff6ad200640 1 -- 172.21.15.118:0/3596642195 >> 172.21.15.118:0/3596642195 conn(0x7ff6a80b2860 msgr2=0x7ff6a80b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:49.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.617+0000 7ff6ad200640 1 -- 172.21.15.118:0/3596642195 shutdown_connections 2024-09-21T06:15:49.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.617+0000 7ff6ad200640 1 -- 172.21.15.118:0/3596642195 wait complete. 2024-09-21T06:15:49.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.620+0000 7ff6ad200640 1 Processor -- start 2024-09-21T06:15:49.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.620+0000 7ff6ad200640 1 -- start start 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff6ad200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff68c003a30 0x7ff6a81f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff6ad200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6a8159990 0x7ff6a8163280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff6ad200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a8159fa0 0x7ff6a81f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff6ad200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8165ee0 con 0x7ff6a8159990 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff6ad200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8165d60 con 0x7ff6a8159fa0 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff6ad200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a8166060 con 0x7ff68c003a30 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff69fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6a8159990 0x7ff6a8163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff69fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6a8159990 0x7ff6a8163280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33296/0 (socket says 172.21.15.118:33296) 2024-09-21T06:15:49.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.621+0000 7ff69fe00640 1 -- 172.21.15.118:0/4283697340 learned_addr learned my addr 172.21.15.118:0/4283697340 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff6a5e00640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff68c003a30 0x7ff6a81f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff6a6800640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a8159fa0 0x7ff6a81f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69fe00640 1 -- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff68c003a30 msgr2=0x7ff6a81f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69fe00640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff68c003a30 0x7ff6a81f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69fe00640 1 -- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a8159fa0 msgr2=0x7ff6a81f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69fe00640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a8159fa0 0x7ff6a81f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69fe00640 1 -- 172.21.15.118:0/4283697340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a81650d0 con 0x7ff6a8159990 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff6a6800640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a8159fa0 0x7ff6a81f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69fe00640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6a8159990 0x7ff6a8163280 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7ff6900064a0 tx=0x7ff6900039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69e000640 1 -- 172.21.15.118:0/4283697340 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690015070 con 0x7ff6a8159990 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69e000640 1 -- 172.21.15.118:0/4283697340 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff690011900 con 0x7ff6a8159990 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff69e000640 1 -- 172.21.15.118:0/4283697340 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690011d50 con 0x7ff6a8159990 2024-09-21T06:15:49.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.622+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a81653b0 con 0x7ff6a8159990 2024-09-21T06:15:49.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.623+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a81f3a80 con 0x7ff6a8159990 2024-09-21T06:15:49.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.624+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a81f3880 con 0x7ff6a8159990 2024-09-21T06:15:49.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.625+0000 7ff69e000640 1 -- 172.21.15.118:0/4283697340 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff690018070 con 0x7ff6a8159990 2024-09-21T06:15:49.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.626+0000 7ff69e000640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff684078b90 0x7ff68407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:49.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.626+0000 7ff69e000640 1 -- 172.21.15.118:0/4283697340 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7ff69009b7e0 con 0x7ff6a8159990 2024-09-21T06:15:49.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.626+0000 7ff6a5e00640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff684078b90 0x7ff68407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:49.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.627+0000 7ff6a5e00640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff684078b90 0x7ff68407b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff6980017b0 tx=0x7ff698034040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:49.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.630+0000 7ff69e000640 1 -- 172.21.15.118:0/4283697340 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff690063f20 con 0x7ff6a8159990 2024-09-21T06:15:49.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:49.885+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7ff6a81637c0 con 0x7ff6a8159990 2024-09-21T06:15:50.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.478+0000 7ff69e000640 1 -- 172.21.15.118:0/4283697340 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v556) ==== 138+0+0 (secure 0 0 0) 0x7ff690063820 con 0x7ff6a8159990 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff684078b90 msgr2=0x7ff68407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff684078b90 0x7ff68407b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff6980017b0 tx=0x7ff698034040 comp rx=0 tx=0).stop 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6a8159990 msgr2=0x7ff6a8163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6a8159990 0x7ff6a8163280 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7ff6900064a0 tx=0x7ff6900039c0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 shutdown_connections 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a8159fa0 0x7ff6a81f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6a8159990 0x7ff6a8163280 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff684078b90 0x7ff68407b0a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 --2- 172.21.15.118:0/4283697340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff68c003a30 0x7ff6a81f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 >> 172.21.15.118:0/4283697340 conn(0x7ff6a80b2860 msgr2=0x7ff6a815f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 shutdown_connections 2024-09-21T06:15:50.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.481+0000 7ff6ad200640 1 -- 172.21.15.118:0/4283697340 wait complete. 2024-09-21T06:15:50.507 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:15:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.726+0000 7ffba8c00640 1 -- 172.21.15.118:0/3513221437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 msgr2=0x7ffba40d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.726+0000 7ffba8c00640 1 --2- 172.21.15.118:0/3513221437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba40d13c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ffba4071c00 tx=0x7ffb9c02a820 comp rx=0 tx=0).stop 2024-09-21T06:15:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.726+0000 7ffba8c00640 1 -- 172.21.15.118:0/3513221437 shutdown_connections 2024-09-21T06:15:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.726+0000 7ffba8c00640 1 --2- 172.21.15.118:0/3513221437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba40d13c0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.726+0000 7ffba8c00640 1 --2- 172.21.15.118:0/3513221437 >> v2:172.21.15.149:3300/0 conn(0x7ffba413fae0 0x7ffba40d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.726+0000 7ffba8c00640 1 -- 172.21.15.118:0/3513221437 >> 172.21.15.118:0/3513221437 conn(0x7ffba406d110 msgr2=0x7ffba406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:50.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.726+0000 7ffba8c00640 1 -- 172.21.15.118:0/3513221437 shutdown_connections 2024-09-21T06:15:50.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.727+0000 7ffba8c00640 1 -- 172.21.15.118:0/3513221437 wait complete. 2024-09-21T06:15:50.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.729+0000 7ffba8c00640 1 Processor -- start 2024-09-21T06:15:50.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.729+0000 7ffba8c00640 1 -- start start 2024-09-21T06:15:50.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.730+0000 7ffba8c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba413fae0 0x7ffba41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:50.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.730+0000 7ffba8c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba413fef0 0x7ffba413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:50.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.730+0000 7ffba8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.730+0000 7ffba8c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffba40cfac0 con 0x7ffba4142e40 2024-09-21T06:15:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.730+0000 7ffba8c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffba40cf940 con 0x7ffba413fef0 2024-09-21T06:15:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.730+0000 7ffba8c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffba40cfc40 con 0x7ffba413fae0 2024-09-21T06:15:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.730+0000 7ffba2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba413d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33310/0 (socket says 172.21.15.118:33310) 2024-09-21T06:15:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 -- 172.21.15.118:0/1101235625 learned_addr learned my addr 172.21.15.118:0/1101235625 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba1e00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba413fae0 0x7ffba41530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffb99400640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba413fef0 0x7ffba413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 -- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba413fae0 msgr2=0x7ffba41530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba413fae0 0x7ffba41530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 -- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba413fef0 msgr2=0x7ffba413d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba413fef0 0x7ffba413d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 -- 172.21.15.118:0/1101235625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba4153620 con 0x7ffba4142e40 2024-09-21T06:15:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba1e00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba413fae0 0x7ffba41530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.731+0000 7ffba2800640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba413d6a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009b30 tx=0x7ffb9c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.732+0000 7ffb9aa00640 1 -- 172.21.15.118:0/1101235625 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c037040 con 0x7ffba4142e40 2024-09-21T06:15:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.732+0000 7ffb9aa00640 1 -- 172.21.15.118:0/1101235625 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb9c042070 con 0x7ffba4142e40 2024-09-21T06:15:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.732+0000 7ffb9aa00640 1 -- 172.21.15.118:0/1101235625 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0042a0 con 0x7ffba4142e40 2024-09-21T06:15:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.732+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba41f9190 con 0x7ffba4142e40 2024-09-21T06:15:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.732+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba41f9750 con 0x7ffba4142e40 2024-09-21T06:15:50.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.733+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba40d0160 con 0x7ffba4142e40 2024-09-21T06:15:50.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.735+0000 7ffb9aa00640 1 -- 172.21.15.118:0/1101235625 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb9c004440 con 0x7ffba4142e40 2024-09-21T06:15:50.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.736+0000 7ffb9aa00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffb80078bc0 0x7ffb8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:50.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.736+0000 7ffb9aa00640 1 -- 172.21.15.118:0/1101235625 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7ffb9c0bc400 con 0x7ffba4142e40 2024-09-21T06:15:50.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.737+0000 7ffba1e00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffb80078bc0 0x7ffb8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:50.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.737+0000 7ffba1e00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffb80078bc0 0x7ffb8007b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009b80 tx=0x7ffb94005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:50.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.740+0000 7ffb9aa00640 1 -- 172.21.15.118:0/1101235625 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffb9c084b30 con 0x7ffba4142e40 2024-09-21T06:15:50.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:15:50.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:15:50.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.932+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ffba415bad0 con 0x7ffba4142e40 2024-09-21T06:15:50.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.933+0000 7ffb9aa00640 1 -- 172.21.15.118:0/1101235625 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+1472 (secure 0 0 0) 0x7ffb9c084430 con 0x7ffba4142e40 2024-09-21T06:15:50.935 INFO:teuthology.orchestra.run.smithi118.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:15:50.935 INFO:teuthology.orchestra.run.smithi118.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:15:50.935 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_client 20/20 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds 20/20 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced debug_ms 2/2 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_frag true 2024-09-21T06:15:50.936 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:15:50.937 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:15:50.937 INFO:teuthology.orchestra.run.smithi118.stdout:mds dev mds_verify_scatter true 2024-09-21T06:15:50.937 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:15:50.937 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:15:50.937 INFO:teuthology.orchestra.run.smithi118.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:15:50.937 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced client_mount_timeout 600 2024-09-21T06:15:50.938 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_client 20/20 2024-09-21T06:15:50.938 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced debug_ms 1/1 2024-09-21T06:15:50.938 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:15:50.938 INFO:teuthology.orchestra.run.smithi118.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:15:50.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffb80078bc0 msgr2=0x7ffb8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:50.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffb80078bc0 0x7ffb8007b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009b80 tx=0x7ffb94005f90 comp rx=0 tx=0).stop 2024-09-21T06:15:50.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 msgr2=0x7ffba413d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba413d6a0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009b30 tx=0x7ffb9c032c90 comp rx=0 tx=0).stop 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 shutdown_connections 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffba4142e40 0x7ffba413d6a0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffba413fef0 0x7ffba413d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ffb80078bc0 0x7ffb8007b0d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 --2- 172.21.15.118:0/1101235625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffba413fae0 0x7ffba41530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 >> 172.21.15.118:0/1101235625 conn(0x7ffba406d110 msgr2=0x7ffba4161010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 shutdown_connections 2024-09-21T06:15:50.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:50.935+0000 7ffba8c00640 1 -- 172.21.15.118:0/1101235625 wait complete. 2024-09-21T06:15:50.959 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:15:51.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 -- 172.21.15.118:0/1452171498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 msgr2=0x7f34e00d3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 --2- 172.21.15.118:0/1452171498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e00d3420 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f34e0070700 tx=0x7f34d402a9b0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 -- 172.21.15.118:0/1452171498 shutdown_connections 2024-09-21T06:15:51.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 --2- 172.21.15.118:0/1452171498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34e00b6d80 0x7f34e00b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 --2- 172.21.15.118:0/1452171498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e00d3420 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 -- 172.21.15.118:0/1452171498 >> 172.21.15.118:0/1452171498 conn(0x7f34e00d2900 msgr2=0x7f34e00d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:51.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 -- 172.21.15.118:0/1452171498 shutdown_connections 2024-09-21T06:15:51.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.180+0000 7f34e6c00640 1 -- 172.21.15.118:0/1452171498 wait complete. 2024-09-21T06:15:51.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.182+0000 7f34e6c00640 1 Processor -- start 2024-09-21T06:15:51.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.182+0000 7f34e6c00640 1 -- start start 2024-09-21T06:15:51.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34e00b6260 0x7f34e006f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e00b6d80 0x7f34e00cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e01e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f34e00b3470 con 0x7f34e00b7bd0 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34e00b32f0 con 0x7f34e00b6d80 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f34e00b35f0 con 0x7f34e00b6260 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e01e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e01e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33336/0 (socket says 172.21.15.118:33336) 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e6200640 1 -- 172.21.15.118:0/107931539 learned_addr learned my addr 172.21.15.118:0/107931539 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e5800640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34e00b6260 0x7f34e006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.184+0000 7f34e4e00640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e00b6d80 0x7f34e00cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6200640 1 -- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34e00b6260 msgr2=0x7f34e006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6200640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34e00b6260 0x7f34e006f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6200640 1 -- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e00b6d80 msgr2=0x7f34e00cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6200640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e00b6d80 0x7f34e00cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6200640 1 -- 172.21.15.118:0/107931539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e00cc7d0 con 0x7f34e00b7bd0 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6200640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e01e7be0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c940 tx=0x7f34d800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34dd600640 1 -- 172.21.15.118:0/107931539 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8004460 con 0x7f34e00b7bd0 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34dd600640 1 -- 172.21.15.118:0/107931539 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34d8007740 con 0x7f34e00b7bd0 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e01f98c0 con 0x7f34e00b7bd0 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34dd600640 1 -- 172.21.15.118:0/107931539 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8007b70 con 0x7f34e00b7bd0 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.185+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e01f9e80 con 0x7f34e00b7bd0 2024-09-21T06:15:51.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.187+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e00b3b00 con 0x7f34e00b7bd0 2024-09-21T06:15:51.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.188+0000 7f34dd600640 1 -- 172.21.15.118:0/107931539 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34d8007d10 con 0x7f34e00b7bd0 2024-09-21T06:15:51.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.189+0000 7f34dd600640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34c0078bf0 0x7f34c007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.189+0000 7f34dd600640 1 -- 172.21.15.118:0/107931539 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f34d809afb0 con 0x7f34e00b7bd0 2024-09-21T06:15:51.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.189+0000 7f34e5800640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34c0078bf0 0x7f34c007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.190+0000 7f34e5800640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34c0078bf0 0x7f34c007b100 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f34d4035000 tx=0x7f34d403a040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:51.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.193+0000 7f34dd600640 1 -- 172.21.15.118:0/107931539 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f34d8013030 con 0x7f34e00b7bd0 2024-09-21T06:15:51.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.374+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f34e00d0720 con 0x7f34e00b7bd0 2024-09-21T06:15:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.379+0000 7f34dd600640 1 -- 172.21.15.118:0/107931539 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f34d8063090 con 0x7f34e00b7bd0 2024-09-21T06:15:51.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.381+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34c0078bf0 msgr2=0x7f34c007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.381+0000 7f34e6c00640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34c0078bf0 0x7f34c007b100 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f34d4035000 tx=0x7f34d403a040 comp rx=0 tx=0).stop 2024-09-21T06:15:51.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.381+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 msgr2=0x7f34e01e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.381+0000 7f34e6c00640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e01e7be0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c940 tx=0x7f34d800ce00 comp rx=0 tx=0).stop 2024-09-21T06:15:51.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 shutdown_connections 2024-09-21T06:15:51.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e00b7bd0 0x7f34e01e7be0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e00b6d80 0x7f34e00cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f34c0078bf0 0x7f34c007b100 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 --2- 172.21.15.118:0/107931539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34e00b6260 0x7f34e006f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 >> 172.21.15.118:0/107931539 conn(0x7f34e00d2900 msgr2=0x7f34e00b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 shutdown_connections 2024-09-21T06:15:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.382+0000 7f34e6c00640 1 -- 172.21.15.118:0/107931539 wait complete. 2024-09-21T06:15:51.406 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:15:51.406 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:15:51.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:15:51.585 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:15:51.585 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:15:51.585 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:51.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:15:51.621 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:15:51.621 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:51.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:15:51.658 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:15:51.659 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:51.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:15:51.696 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:15:51.696 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:15:51.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:15:51.735 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:15:51.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:15:51.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.951+0000 7f9051a00640 1 -- 172.21.15.118:0/3010414538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c13fef0 msgr2=0x7f904c142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.951+0000 7f9051a00640 1 --2- 172.21.15.118:0/3010414538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c13fef0 0x7f904c142e40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f9044005fd0 tx=0x7f904402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.951+0000 7f9051a00640 1 -- 172.21.15.118:0/3010414538 shutdown_connections 2024-09-21T06:15:51.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.951+0000 7f9051a00640 1 --2- 172.21.15.118:0/3010414538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c13fef0 0x7f904c142e40 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.951+0000 7f9051a00640 1 -- 172.21.15.118:0/3010414538 >> 172.21.15.118:0/3010414538 conn(0x7f904c06d110 msgr2=0x7f904c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:51.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.951+0000 7f9051a00640 1 -- 172.21.15.118:0/3010414538 shutdown_connections 2024-09-21T06:15:51.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.952+0000 7f9051a00640 1 -- 172.21.15.118:0/3010414538 wait complete. 2024-09-21T06:15:51.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.954+0000 7f9051a00640 1 Processor -- start 2024-09-21T06:15:51.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.954+0000 7f9051a00640 1 -- start start 2024-09-21T06:15:51.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.955+0000 7f9051a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f904c13fae0 0x7f904c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.955+0000 7f9051a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904c13fef0 0x7f904c1f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.955+0000 7f9051a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c1fa020 0x7f904c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.955+0000 7f9051a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f904c168280 con 0x7f904c1fa020 2024-09-21T06:15:51.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.955+0000 7f9051a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f904c168100 con 0x7f904c13fef0 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.955+0000 7f9051a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f904c168400 con 0x7f904c13fae0 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.955+0000 7f904b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c1fa020 0x7f904c14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c1fa020 0x7f904c14a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33348/0 (socket says 172.21.15.118:33348) 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 -- 172.21.15.118:0/1892490424 learned_addr learned my addr 172.21.15.118:0/1892490424 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904aa00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f904c13fae0 0x7f904c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f9042000640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904c13fef0 0x7f904c1f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 -- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f904c13fae0 msgr2=0x7f904c0745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f904c13fae0 0x7f904c0745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 -- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904c13fef0 msgr2=0x7f904c1f9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904c13fef0 0x7f904c1f9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:51.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 -- 172.21.15.118:0/1892490424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c141960 con 0x7f904c1fa020 2024-09-21T06:15:51.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.956+0000 7f904b400640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c1fa020 0x7f904c14a890 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f9044006010 tx=0x7f9044003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:51.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.957+0000 7f9043400640 1 -- 172.21.15.118:0/1892490424 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044031b90 con 0x7f904c1fa020 2024-09-21T06:15:51.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.957+0000 7f9043400640 1 -- 172.21.15.118:0/1892490424 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9044031e20 con 0x7f904c1fa020 2024-09-21T06:15:51.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.957+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c073af0 con 0x7f904c1fa020 2024-09-21T06:15:51.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.957+0000 7f9043400640 1 -- 172.21.15.118:0/1892490424 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90440332f0 con 0x7f904c1fa020 2024-09-21T06:15:51.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.957+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c0740b0 con 0x7f904c1fa020 2024-09-21T06:15:51.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.958+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c1416d0 con 0x7f904c1fa020 2024-09-21T06:15:51.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.959+0000 7f9043400640 1 -- 172.21.15.118:0/1892490424 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9044031660 con 0x7f904c1fa020 2024-09-21T06:15:51.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.960+0000 7f9043400640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9028078b90 0x7f902807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:51.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.961+0000 7f9043400640 1 -- 172.21.15.118:0/1892490424 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f90440bc080 con 0x7f904c1fa020 2024-09-21T06:15:51.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.961+0000 7f904aa00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9028078b90 0x7f902807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:51.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.961+0000 7f904aa00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9028078b90 0x7f902807b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f903c0046b0 tx=0x7f903c007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:51.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:51.965+0000 7f9043400640 1 -- 172.21.15.118:0/1892490424 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f904403f030 con 0x7f904c1fa020 2024-09-21T06:15:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.184+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f904c0d0e80 con 0x7f904c1fa020 2024-09-21T06:15:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.184+0000 7f9043400640 1 -- 172.21.15.118:0/1892490424 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+3923 (secure 0 0 0) 0x7f90440840d0 con 0x7f904c1fa020 2024-09-21T06:15:52.187 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:52.187 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":88,"btime":"2024-09-21T06:15:45:107981+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6530,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3736642515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3736642515},{"type":"v1","addr":"172.21.15.149:6836","nonce":3736642515}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6533,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1748040850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1748040850},{"type":"v1","addr":"172.21.15.149:6837","nonce":1748040850}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1192571872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1192571872},{"type":"v1","addr":"172.21.15.118:6834","nonce":1192571872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":8004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3366139006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3366139006},{"type":"v1","addr":"172.21.15.118:6835","nonce":3366139006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[]} 2024-09-21T06:15:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 88 2024-09-21T06:15:52.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.186+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9028078b90 msgr2=0x7f902807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:52.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.186+0000 7f9051a00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9028078b90 0x7f902807b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f903c0046b0 tx=0x7f903c007e90 comp rx=0 tx=0).stop 2024-09-21T06:15:52.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.186+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c1fa020 msgr2=0x7f904c14a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:52.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.186+0000 7f9051a00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c1fa020 0x7f904c14a890 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f9044006010 tx=0x7f9044003ba0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 shutdown_connections 2024-09-21T06:15:52.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f904c1fa020 0x7f904c14a890 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904c13fef0 0x7f904c1f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9028078b90 0x7f902807b0a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 --2- 172.21.15.118:0/1892490424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f904c13fae0 0x7f904c0745d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 >> 172.21.15.118:0/1892490424 conn(0x7f904c06d110 msgr2=0x7f904c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 shutdown_connections 2024-09-21T06:15:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.187+0000 7f9051a00640 1 -- 172.21.15.118:0/1892490424 wait complete. 2024-09-21T06:15:52.212 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:15:52.212 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:15:52.212 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:15:52.212 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:15:52.212 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:15:52.212 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:15:52.213 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:15:52.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:15:52.213 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:15:52.213 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:15:52.213 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:15:52.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:15:52.213 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:15:52.213 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:15:52.214 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:15:52.214 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:15:52.235 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:15:52.235 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:15:52.237 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:15:52.237 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:15:52.238 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:15:52.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:15:52.239 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:15:52.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:15:52.283 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:15:52.283 DEBUG:teuthology.parallel:result is None 2024-09-21T06:15:52.285 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:15:52.285 DEBUG:teuthology.parallel:result is None 2024-09-21T06:15:52.285 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:15:52.285 DEBUG:teuthology.parallel:result is None 2024-09-21T06:15:52.287 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:15:52.288 DEBUG:teuthology.parallel:result is None 2024-09-21T06:15:52.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:15:52.480 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-21T06:15:52.480 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-21T06:15:52.481 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-09-21T06:15:52.481 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:15:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.514+0000 7f2bc9400640 1 -- 172.21.15.118:0/1252269884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415bd00 msgr2=0x7f2bc415c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.514+0000 7f2bc9400640 1 --2- 172.21.15.118:0/1252269884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415bd00 0x7f2bc415c110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc005fd0 tx=0x7f2bbc02a8a0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.515+0000 7f2bc9400640 1 -- 172.21.15.118:0/1252269884 shutdown_connections 2024-09-21T06:15:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.515+0000 7f2bc9400640 1 --2- 172.21.15.118:0/1252269884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415bd00 0x7f2bc415c110 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.515+0000 7f2bc9400640 1 -- 172.21.15.118:0/1252269884 >> 172.21.15.118:0/1252269884 conn(0x7f2bc406d110 msgr2=0x7f2bc406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.515+0000 7f2bc9400640 1 -- 172.21.15.118:0/1252269884 shutdown_connections 2024-09-21T06:15:52.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.515+0000 7f2bc9400640 1 -- 172.21.15.118:0/1252269884 wait complete. 2024-09-21T06:15:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.517+0000 7f2bc9400640 1 Processor -- start 2024-09-21T06:15:52.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.517+0000 7f2bc9400640 1 -- start start 2024-09-21T06:15:52.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.518+0000 7f2bc9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bc40b44c0 0x7f2bc41407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:52.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.518+0000 7f2bc9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc415bd00 0x7f2bc4154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:52.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.518+0000 7f2bc9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415f660 0x7f2bc4149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:52.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.518+0000 7f2bc9400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc40cfe80 con 0x7f2bc40b44c0 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.518+0000 7f2bc9400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc4070fd0 con 0x7f2bc415f660 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.518+0000 7f2bc9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc40d0000 con 0x7f2bc415bd00 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bc40b44c0 0x7f2bc41407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bc40b44c0 0x7f2bc41407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33374/0 (socket says 172.21.15.118:33374) 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 -- 172.21.15.118:0/3572867852 learned_addr learned my addr 172.21.15.118:0/3572867852 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc3200640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415f660 0x7f2bc4149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc1e00640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc415bd00 0x7f2bc4154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 -- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc415bd00 msgr2=0x7f2bc4154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc415bd00 0x7f2bc4154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 -- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415f660 msgr2=0x7f2bc4149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415f660 0x7f2bc4149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:52.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 -- 172.21.15.118:0/3572867852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc4153680 con 0x7f2bc40b44c0 2024-09-21T06:15:52.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc1e00640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc415bd00 0x7f2bc4154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:52.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.519+0000 7f2bc2800640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bc40b44c0 0x7f2bc41407a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c400 tx=0x7f2bb400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:52.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.520+0000 7f2bbaa00640 1 -- 172.21.15.118:0/3572867852 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4017070 con 0x7f2bc40b44c0 2024-09-21T06:15:52.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.520+0000 7f2bbaa00640 1 -- 172.21.15.118:0/3572867852 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bb40053c0 con 0x7f2bc40b44c0 2024-09-21T06:15:52.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.520+0000 7f2bbaa00640 1 -- 172.21.15.118:0/3572867852 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4003850 con 0x7f2bc40b44c0 2024-09-21T06:15:52.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.520+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc4153960 con 0x7f2bc40b44c0 2024-09-21T06:15:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.520+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc4153f20 con 0x7f2bc40b44c0 2024-09-21T06:15:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.521+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc40d0520 con 0x7f2bc40b44c0 2024-09-21T06:15:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.522+0000 7f2bbaa00640 1 -- 172.21.15.118:0/3572867852 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2bb401a070 con 0x7f2bc40b44c0 2024-09-21T06:15:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.523+0000 7f2bbaa00640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ba4078b90 0x7f2ba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.523+0000 7f2bbaa00640 1 -- 172.21.15.118:0/3572867852 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f2bb4099eb0 con 0x7f2bc40b44c0 2024-09-21T06:15:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.523+0000 7f2bc1e00640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ba4078b90 0x7f2ba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.524+0000 7f2bc1e00640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ba4078b90 0x7f2ba407b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00046b0 tx=0x7f2bb0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.528+0000 7f2bbaa00640 1 -- 172.21.15.118:0/3572867852 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2bb4061e80 con 0x7f2bc40b44c0 2024-09-21T06:15:52.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:52.725+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2bc4074f10 con 0x7f2bc40b44c0 2024-09-21T06:15:53.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.499+0000 7f2bbaa00640 1 -- 172.21.15.118:0/3572867852 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v171) ==== 97+0+0 (secure 0 0 0) 0x7f2bb40668b0 con 0x7f2bc40b44c0 2024-09-21T06:15:53.502 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ba4078b90 msgr2=0x7f2ba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ba4078b90 0x7f2ba407b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00046b0 tx=0x7f2bb0009040 comp rx=0 tx=0).stop 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bc40b44c0 msgr2=0x7f2bc41407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bc40b44c0 0x7f2bc41407a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c400 tx=0x7f2bb400c8c0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 shutdown_connections 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc415f660 0x7f2bc4149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f2ba4078b90 0x7f2ba407b0a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc415bd00 0x7f2bc4154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 --2- 172.21.15.118:0/3572867852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bc40b44c0 0x7f2bc41407a0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 >> 172.21.15.118:0/3572867852 conn(0x7f2bc406d110 msgr2=0x7f2bc415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 shutdown_connections 2024-09-21T06:15:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.503+0000 7f2bc9400640 1 -- 172.21.15.118:0/3572867852 wait complete. 2024-09-21T06:15:53.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:15:53.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.757+0000 7fcbcb200640 1 -- 172.21.15.118:0/249920945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0b62c0 msgr2=0x7fcbcc0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.757+0000 7fcbcb200640 1 --2- 172.21.15.118:0/249920945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0b62c0 0x7fcbcc0d0240 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005fd0 tx=0x7fcbc402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.757+0000 7fcbcb200640 1 -- 172.21.15.118:0/249920945 shutdown_connections 2024-09-21T06:15:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.757+0000 7fcbcb200640 1 --2- 172.21.15.118:0/249920945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0b62c0 0x7fcbcc0d0240 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.757+0000 7fcbcb200640 1 -- 172.21.15.118:0/249920945 >> 172.21.15.118:0/249920945 conn(0x7fcbcc06d6e0 msgr2=0x7fcbcc0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.757+0000 7fcbcb200640 1 -- 172.21.15.118:0/249920945 shutdown_connections 2024-09-21T06:15:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.757+0000 7fcbcb200640 1 -- 172.21.15.118:0/249920945 wait complete. 2024-09-21T06:15:53.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.759+0000 7fcbcb200640 1 Processor -- start 2024-09-21T06:15:53.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.759+0000 7fcbcb200640 1 -- start start 2024-09-21T06:15:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbcb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbcc073fa0 0x7fcbcc1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbcb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0cfe30 0x7fcbcc13f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbcb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbcc1f3a50 0x7fcbcc140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbcb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc15dad0 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbcb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc15d950 con 0x7fcbcc1f3a50 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbcb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcbcc15dc50 con 0x7fcbcc073fa0 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbc1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0cfe30 0x7fcbcc13f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbc1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0cfe30 0x7fcbcc13f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33378/0 (socket says 172.21.15.118:33378) 2024-09-21T06:15:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbc1400640 1 -- 172.21.15.118:0/1270317478 learned_addr learned my addr 172.21.15.118:0/1270317478 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbc9e00640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbcc073fa0 0x7fcbcc1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.761+0000 7fcbca800640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbcc1f3a50 0x7fcbcc140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc1400640 1 -- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbcc073fa0 msgr2=0x7fcbcc1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc1400640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbcc073fa0 0x7fcbcc1404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc1400640 1 -- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbcc1f3a50 msgr2=0x7fcbcc140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc1400640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbcc1f3a50 0x7fcbcc140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc1400640 1 -- 172.21.15.118:0/1270317478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc1f4910 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc1400640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0cfe30 0x7fcbcc13f0c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400c370 tx=0x7fcbb400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc2a00640 1 -- 172.21.15.118:0/1270317478 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4017070 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc2a00640 1 -- 172.21.15.118:0/1270317478 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbb40035f0 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbc2a00640 1 -- 172.21.15.118:0/1270317478 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4003a40 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbcc140a30 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.762+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbcc13fa10 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.763+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbcc15e8c0 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.765+0000 7fcbc2a00640 1 -- 172.21.15.118:0/1270317478 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcbb401a070 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.765+0000 7fcbc2a00640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcba8078bc0 0x7fcba807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.766+0000 7fcbc2a00640 1 -- 172.21.15.118:0/1270317478 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4857+0+0 (secure 0 0 0) 0x7fcbb4099c80 con 0x7fcbcc0cfe30 2024-09-21T06:15:53.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.766+0000 7fcbc9e00640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcba8078bc0 0x7fcba807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.767+0000 7fcbc9e00640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcba8078bc0 0x7fcba807b0d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc000f60 tx=0x7fcbbc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:53.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:53.770+0000 7fcbc2a00640 1 -- 172.21.15.118:0/1270317478 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcbb4061db0 con 0x7fcbcc0cfe30 2024-09-21T06:15:54.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.021+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcbcc1f43c0 con 0x7fcbcc0cfe30 2024-09-21T06:15:54.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.022+0000 7fcbc2a00640 1 -- 172.21.15.118:0/1270317478 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7fcbb40667e0 con 0x7fcbcc0cfe30 2024-09-21T06:15:54.023 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:54.023 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:15:54.023 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-09-21T06:15:54.023 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mtQR4AhAAiVqTgPToQVDQbXaNwe5bnw==", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5m2ZcDHhAANtvrLIWzjW1EnMzaCT3Hgg==", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.024 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mSP9BEBAAvPfATiTGbdtg7kepfqaEPg==", 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:15:54.025 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.d", 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mjHzVKxAAHvm6hI9dISdXtG5SPBRJGQ==", 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.026 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCsYe5mDBDfMBAAKseOvv9bMR8GIQIqpFO0hA==", 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m7C4rAxAAKc4XHNSFNYhZib0CWS+R+Q==", 2024-09-21T06:15:54.027 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5mJoIUERAAuONkfchHaicIYTdkOq5oBQ==", 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCtYe5m53fsHhAA53ZH85ixJ+FLhVUlSdCd1Q==", 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5mXrMUIhAAA3m1B4lDBz1gNCZaFfukbQ==", 2024-09-21T06:15:54.029 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCwYe5m+fzcMRAA06AqdSFhqORTqC14ZiggTw==", 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.030 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mACBIBBAAEx+xH9tf7VMHN2Dz7QKfyA==", 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCxYe5mvJ6REhAAsc0+oP6Tx5HRIMHlJXKUsA==", 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.031 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ==", 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow r", 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.1", 2024-09-21T06:15:54.032 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5ma23tERAAiOwl8X7zr1qsw/isRWFdyQ==", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.2", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mAKFGBxAA40aXZj+Vcy1NNaT9rLakQg==", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:15:54.033 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.3", 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCrYe5mSAKPHBAAK9WakBSuz3zTK1xW+THDOA==", 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-09-21T06:15:54.034 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5m5DeZAhAARuIWqXKNF0ThErZSMdZ4Vg==", 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-09-21T06:15:54.035 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5myYtBMxAAvTc8Apgdp0ynlYoQT/yAzw==", 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQCpYe5mx81KKBAArmw5sLXe7xRV3rXwvwXJCg==", 2024-09-21T06:15:54.036 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-09-21T06:15:54.037 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-09-21T06:15:54.037 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-09-21T06:15:54.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-09-21T06:15:54.037 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.037 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.037 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:15:54.037 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:15:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcba8078bc0 msgr2=0x7fcba807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcba8078bc0 0x7fcba807b0d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc000f60 tx=0x7fcbbc009040 comp rx=0 tx=0).stop 2024-09-21T06:15:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0cfe30 msgr2=0x7fcbcc13f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0cfe30 0x7fcbcc13f0c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400c370 tx=0x7fcbb400c830 comp rx=0 tx=0).stop 2024-09-21T06:15:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 shutdown_connections 2024-09-21T06:15:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbcc1f3a50 0x7fcbcc140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbcc0cfe30 0x7fcbcc13f0c0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcba8078bc0 0x7fcba807b0d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 --2- 172.21.15.118:0/1270317478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbcc073fa0 0x7fcbcc1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 >> 172.21.15.118:0/1270317478 conn(0x7fcbcc06d6e0 msgr2=0x7fcbcc15f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 shutdown_connections 2024-09-21T06:15:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.024+0000 7fcbcb200640 1 -- 172.21.15.118:0/1270317478 wait complete. 2024-09-21T06:15:54.050 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:15:54.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.268+0000 7fd093e00640 1 -- 172.21.15.118:0/1047568502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd078004800 msgr2=0x7fd078004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.268+0000 7fd093e00640 1 --2- 172.21.15.118:0/1047568502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd078004800 0x7fd078004c10 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd080009b50 tx=0x7fd078005830 comp rx=0 tx=0).stop 2024-09-21T06:15:54.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.268+0000 7fd093400640 1 -- 172.21.15.118:0/1047568502 reap_dead start 2024-09-21T06:15:54.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.268+0000 7fd093e00640 1 -- 172.21.15.118:0/1047568502 shutdown_connections 2024-09-21T06:15:54.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.268+0000 7fd093e00640 1 -- 172.21.15.118:0/1047568502 >> 172.21.15.118:0/1047568502 conn(0x7fd0940d0f80 msgr2=0x7fd0940d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:54.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.268+0000 7fd093e00640 1 -- 172.21.15.118:0/1047568502 shutdown_connections 2024-09-21T06:15:54.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.268+0000 7fd093e00640 1 -- 172.21.15.118:0/1047568502 wait complete. 2024-09-21T06:15:54.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.270+0000 7fd093e00640 1 Processor -- start 2024-09-21T06:15:54.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.270+0000 7fd093e00640 1 -- start start 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd093e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd078004800 0x7fd094147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd093e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0940d0050 0x7fd094150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd093e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd094148710 0x7fd094151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd093e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd09415fc10 con 0x7fd0940d0050 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd093e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd09415fa90 con 0x7fd078004800 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd093e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd09415fd90 con 0x7fd094148710 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0940d0050 0x7fd094150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0940d0050 0x7fd094150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33386/0 (socket says 172.21.15.118:33386) 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 -- 172.21.15.118:0/1831173152 learned_addr learned my addr 172.21.15.118:0/1831173152 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092a00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd078004800 0x7fd094147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 -- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd094148710 msgr2=0x7fd094151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd094148710 0x7fd094151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 -- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd078004800 msgr2=0x7fd094147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd078004800 0x7fd094147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092000640 1 -- 172.21.15.118:0/1831173152 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd094148510 con 0x7fd0940d0050 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.272+0000 7fd092a00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd078004800 0x7fd094147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.273+0000 7fd092000640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0940d0050 0x7fd094150be0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fd080009a70 tx=0x7fd080033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.273+0000 7fd08aa00640 1 -- 172.21.15.118:0/1831173152 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080038040 con 0x7fd0940d0050 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.273+0000 7fd08aa00640 1 -- 172.21.15.118:0/1831173152 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd080033870 con 0x7fd0940d0050 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.273+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09414e5a0 con 0x7fd0940d0050 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.273+0000 7fd08aa00640 1 -- 172.21.15.118:0/1831173152 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080033cc0 con 0x7fd0940d0050 2024-09-21T06:15:54.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.273+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09414eb60 con 0x7fd0940d0050 2024-09-21T06:15:54.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.274+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09415dd90 con 0x7fd0940d0050 2024-09-21T06:15:54.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.275+0000 7fd08aa00640 1 -- 172.21.15.118:0/1831173152 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd080043020 con 0x7fd0940d0050 2024-09-21T06:15:54.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.276+0000 7fd08aa00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.276+0000 7fd08aa00640 1 -- 172.21.15.118:0/1831173152 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4857+0+0 (secure 0 0 0) 0x7fd0800baab0 con 0x7fd0940d0050 2024-09-21T06:15:54.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.277+0000 7fd092a00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:54.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.277+0000 7fd092a00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd084004840 tx=0x7fd084001520 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:54.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.281+0000 7fd08aa00640 1 -- 172.21.15.118:0/1831173152 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd09415dd90 con 0x7fd0940d0050 2024-09-21T06:15:54.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.465+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd0940d0530 con 0x7fd0940d0050 2024-09-21T06:15:54.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.466+0000 7fd08aa00640 1 -- 172.21.15.118:0/1831173152 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v173) ==== 84+0+65 (secure 0 0 0) 0x7fd08004a020 con 0x7fd0940d0050 2024-09-21T06:15:54.467 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:54.467 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-09-21T06:15:54.467 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:15:54.468 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-09-21T06:15:54.468 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-09-21T06:15:54.468 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:15:54.468 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-09-21T06:15:54.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 msgr2=0x7fd07407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd084004840 tx=0x7fd084001520 comp rx=0 tx=0).stop 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0940d0050 msgr2=0x7fd094150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0940d0050 0x7fd094150be0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fd080009a70 tx=0x7fd080033670 comp rx=0 tx=0).stop 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 shutdown_connections 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd074078b90 0x7fd07407b0a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd094148710 0x7fd094151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0940d0050 0x7fd094150be0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 --2- 172.21.15.118:0/1831173152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd078004800 0x7fd094147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 >> 172.21.15.118:0/1831173152 conn(0x7fd0940d0f80 msgr2=0x7fd0940b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 shutdown_connections 2024-09-21T06:15:54.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.468+0000 7fd093e00640 1 -- 172.21.15.118:0/1831173152 wait complete. 2024-09-21T06:15:54.491 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:15:54.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:15:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.715+0000 7f95f5200640 1 -- 172.21.15.118:0/600603349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00701f0 msgr2=0x7f95f00ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.715+0000 7f95f5200640 1 --2- 172.21.15.118:0/600603349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00701f0 0x7f95f00ce1e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009830 tx=0x7f95e002a490 comp rx=0 tx=0).stop 2024-09-21T06:15:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.715+0000 7f95f5200640 1 -- 172.21.15.118:0/600603349 shutdown_connections 2024-09-21T06:15:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.715+0000 7f95f5200640 1 --2- 172.21.15.118:0/600603349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95f00b3e00 0x7f95f00b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.715+0000 7f95f5200640 1 --2- 172.21.15.118:0/600603349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00701f0 0x7f95f00ce1e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.715+0000 7f95f5200640 1 -- 172.21.15.118:0/600603349 >> 172.21.15.118:0/600603349 conn(0x7f95f006cf30 msgr2=0x7f95f006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.715+0000 7f95f5200640 1 -- 172.21.15.118:0/600603349 shutdown_connections 2024-09-21T06:15:54.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.716+0000 7f95f5200640 1 -- 172.21.15.118:0/600603349 wait complete. 2024-09-21T06:15:54.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.718+0000 7f95f5200640 1 Processor -- start 2024-09-21T06:15:54.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.718+0000 7f95f5200640 1 -- start start 2024-09-21T06:15:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.719+0000 7f95f5200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95f00701f0 0x7f95f015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.719+0000 7f95f5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00b3e00 0x7f95f0134280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.719+0000 7f95f5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95f0160a50 0x7f95f01347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.719+0000 7f95f5200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f95f00cf020 con 0x7f95f00701f0 2024-09-21T06:15:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.719+0000 7f95f5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95f00ceea0 con 0x7f95f00b3e00 2024-09-21T06:15:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.719+0000 7f95f5200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95f00cf1a0 con 0x7f95f0160a50 2024-09-21T06:15:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95f00701f0 0x7f95f015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95f00701f0 0x7f95f015a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33396/0 (socket says 172.21.15.118:33396) 2024-09-21T06:15:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 -- 172.21.15.118:0/1023292637 learned_addr learned my addr 172.21.15.118:0/1023292637 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ed400640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00b3e00 0x7f95f0134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ee800640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95f0160a50 0x7f95f01347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:54.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 -- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95f0160a50 msgr2=0x7f95f01347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95f0160a50 0x7f95f01347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 -- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00b3e00 msgr2=0x7f95f0134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00b3e00 0x7f95f0134280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ede00640 1 -- 172.21.15.118:0/1023292637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f01e7370 con 0x7f95f00701f0 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ee800640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95f0160a50 0x7f95f01347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.720+0000 7f95ed400640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00b3e00 0x7f95f0134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.721+0000 7f95ede00640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95f00701f0 0x7f95f015a710 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009950 tx=0x7f95e00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.721+0000 7f95e6000640 1 -- 172.21.15.118:0/1023292637 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e00319e0 con 0x7f95f00701f0 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.721+0000 7f95e6000640 1 -- 172.21.15.118:0/1023292637 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95e0031c70 con 0x7f95f00701f0 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.721+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f00b3420 con 0x7f95f00701f0 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.721+0000 7f95e6000640 1 -- 172.21.15.118:0/1023292637 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0031e60 con 0x7f95f00701f0 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.721+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f0132600 con 0x7f95f00701f0 2024-09-21T06:15:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.722+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f01e7540 con 0x7f95f00701f0 2024-09-21T06:15:54.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.723+0000 7f95e6000640 1 -- 172.21.15.118:0/1023292637 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95e0005280 con 0x7f95f00701f0 2024-09-21T06:15:54.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.724+0000 7f95e6000640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95d0078bc0 0x7f95d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:54.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.724+0000 7f95e6000640 1 -- 172.21.15.118:0/1023292637 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 4857+0+0 (secure 0 0 0) 0x7f95e00bbc50 con 0x7f95f00701f0 2024-09-21T06:15:54.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.725+0000 7f95ed400640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95d0078bc0 0x7f95d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:54.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.725+0000 7f95ed400640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95d0078bc0 0x7f95d007b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f95dc001eb0 tx=0x7f95dc001e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:54.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.729+0000 7f95e6000640 1 -- 172.21.15.118:0/1023292637 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f95e003f030 con 0x7f95f00701f0 2024-09-21T06:15:54.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:54.914+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f95f00cf700 con 0x7f95f00701f0 2024-09-21T06:15:55.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.509+0000 7f95e6000640 1 -- 172.21.15.118:0/1023292637 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v174) ==== 138+0+0 (secure 0 0 0) 0x7f95e0083e10 con 0x7f95f00701f0 2024-09-21T06:15:55.511 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-09-21T06:15:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.512+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95d0078bc0 msgr2=0x7f95d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.512+0000 7f95f5200640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95d0078bc0 0x7f95d007b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f95dc001eb0 tx=0x7f95dc001e20 comp rx=0 tx=0).stop 2024-09-21T06:15:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.512+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95f00701f0 msgr2=0x7f95f015a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.512+0000 7f95f5200640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95f00701f0 0x7f95f015a710 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009950 tx=0x7f95e00040c0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 shutdown_connections 2024-09-21T06:15:55.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f95d0078bc0 0x7f95d007b0d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95f0160a50 0x7f95f01347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95f00b3e00 0x7f95f0134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 --2- 172.21.15.118:0/1023292637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95f00701f0 0x7f95f015a710 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 >> 172.21.15.118:0/1023292637 conn(0x7f95f006cf30 msgr2=0x7f95f015fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 shutdown_connections 2024-09-21T06:15:55.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.513+0000 7f95f5200640 1 -- 172.21.15.118:0/1023292637 wait complete. 2024-09-21T06:15:55.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:15:55.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.770+0000 7faf0a400640 1 -- 172.21.15.118:0/1836296346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf04146650 msgr2=0x7faf040d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.770+0000 7faf0a400640 1 --2- 172.21.15.118:0/1836296346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf04146650 0x7faf040d23d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7faef4009830 tx=0x7faef402a5c0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.770+0000 7faf0a400640 1 -- 172.21.15.118:0/1836296346 shutdown_connections 2024-09-21T06:15:55.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.770+0000 7faf0a400640 1 --2- 172.21.15.118:0/1836296346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf04146650 0x7faf040d23d0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.770+0000 7faf0a400640 1 -- 172.21.15.118:0/1836296346 >> 172.21.15.118:0/1836296346 conn(0x7faf04071070 msgr2=0x7faf04071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.770+0000 7faf0a400640 1 -- 172.21.15.118:0/1836296346 shutdown_connections 2024-09-21T06:15:55.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.770+0000 7faf0a400640 1 -- 172.21.15.118:0/1836296346 wait complete. 2024-09-21T06:15:55.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.772+0000 7faf0a400640 1 Processor -- start 2024-09-21T06:15:55.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.772+0000 7faf0a400640 1 -- start start 2024-09-21T06:15:55.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf0a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf040ceb40 0x7faf041f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf0a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf04146650 0x7faf0413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf0a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf040b7d20 0x7faf04144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf0a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faf040cf2e0 con 0x7faf040ceb40 2024-09-21T06:15:55.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf0a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf040cf160 con 0x7faf04146650 2024-09-21T06:15:55.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf0a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf040d18f0 con 0x7faf040b7d20 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf040ceb40 0x7faf041f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf040ceb40 0x7faf041f77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33428/0 (socket says 172.21.15.118:33428) 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 -- 172.21.15.118:0/3551254145 learned_addr learned my addr 172.21.15.118:0/3551254145 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf02a00640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf04146650 0x7faf0413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03e00640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf040b7d20 0x7faf04144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 -- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf040b7d20 msgr2=0x7faf04144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf040b7d20 0x7faf04144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 -- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf04146650 msgr2=0x7faf0413fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf04146650 0x7faf0413fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf03400640 1 -- 172.21.15.118:0/3551254145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf041f3760 con 0x7faf040ceb40 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.774+0000 7faf02a00640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf04146650 0x7faf0413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.775+0000 7faf03400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf040ceb40 0x7faf041f77e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7faef4000c00 tx=0x7faef4033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.775+0000 7faefb400640 1 -- 172.21.15.118:0/3551254145 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4031d60 con 0x7faf040ceb40 2024-09-21T06:15:55.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.775+0000 7faefb400640 1 -- 172.21.15.118:0/3551254145 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faef40330d0 con 0x7faf040ceb40 2024-09-21T06:15:55.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.775+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf041f39d0 con 0x7faf040ceb40 2024-09-21T06:15:55.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.775+0000 7faefb400640 1 -- 172.21.15.118:0/3551254145 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4033520 con 0x7faf040ceb40 2024-09-21T06:15:55.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.775+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf041f3f90 con 0x7faf040ceb40 2024-09-21T06:15:55.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.776+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf040d23d0 con 0x7faf040ceb40 2024-09-21T06:15:55.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.778+0000 7faefb400640 1 -- 172.21.15.118:0/3551254145 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faef40035f0 con 0x7faf040ceb40 2024-09-21T06:15:55.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.778+0000 7faefb400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7faee4078b90 0x7faee407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.779+0000 7faefb400640 1 -- 172.21.15.118:0/3551254145 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5227+0+0 (secure 0 0 0) 0x7faef40bc5a0 con 0x7faf040ceb40 2024-09-21T06:15:55.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.779+0000 7faf02a00640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7faee4078b90 0x7faee407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.780+0000 7faf02a00640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7faee4078b90 0x7faee407b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faf040b70d0 tx=0x7faef0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.784 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.783+0000 7faefb400640 1 -- 172.21.15.118:0/3551254145 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faef4052080 con 0x7faf040ceb40 2024-09-21T06:15:55.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:55.970+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7faf04071890 con 0x7faf040ceb40 2024-09-21T06:15:56.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.513+0000 7faefb400640 1 -- 172.21.15.118:0/3551254145 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v175) ==== 170+0+0 (secure 0 0 0) 0x7faef408b070 con 0x7faf040ceb40 2024-09-21T06:15:56.514 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-09-21T06:15:56.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7faee4078b90 msgr2=0x7faee407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:56.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7faee4078b90 0x7faee407b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faf040b70d0 tx=0x7faef0009040 comp rx=0 tx=0).stop 2024-09-21T06:15:56.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf040ceb40 msgr2=0x7faf041f77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:56.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf040ceb40 0x7faf041f77e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7faef4000c00 tx=0x7faef4033d60 comp rx=0 tx=0).stop 2024-09-21T06:15:56.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 shutdown_connections 2024-09-21T06:15:56.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7faee4078b90 0x7faee407b0a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf040b7d20 0x7faf04144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf04146650 0x7faf0413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 --2- 172.21.15.118:0/3551254145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf040ceb40 0x7faf041f77e0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.517+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 >> 172.21.15.118:0/3551254145 conn(0x7faf04071070 msgr2=0x7faf040b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:56.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.518+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 shutdown_connections 2024-09-21T06:15:56.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.519+0000 7faf0a400640 1 -- 172.21.15.118:0/3551254145 wait complete. 2024-09-21T06:15:56.555 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:15:56.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 -- 172.21.15.118:0/209662224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c813fef0 msgr2=0x7f39c80d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 --2- 172.21.15.118:0/209662224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c813fef0 0x7f39c80d13c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f39b0005fd0 tx=0x7f39b002a4a0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 -- 172.21.15.118:0/209662224 shutdown_connections 2024-09-21T06:15:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 --2- 172.21.15.118:0/209662224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c813fef0 0x7f39c80d13c0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 --2- 172.21.15.118:0/209662224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39c813fae0 0x7f39c80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 -- 172.21.15.118:0/209662224 >> 172.21.15.118:0/209662224 conn(0x7f39c806d110 msgr2=0x7f39c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 -- 172.21.15.118:0/209662224 shutdown_connections 2024-09-21T06:15:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.780+0000 7f39cea00640 1 -- 172.21.15.118:0/209662224 wait complete. 2024-09-21T06:15:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.782+0000 7f39cea00640 1 Processor -- start 2024-09-21T06:15:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.782+0000 7f39cea00640 1 -- start start 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39c813fae0 0x7f39c81ea990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39c813fef0 0x7f39c813e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c8142730 0x7f39c8139050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80cfac0 con 0x7f39c8142730 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80cf940 con 0x7f39c813fae0 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f39c80cfc40 con 0x7f39c813fef0 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c8142730 0x7f39c8139050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c8142730 0x7f39c8139050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50726/0 (socket says 172.21.15.118:50726) 2024-09-21T06:15:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 -- 172.21.15.118:0/1206975804 learned_addr learned my addr 172.21.15.118:0/1206975804 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39c7e00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39c813fae0 0x7f39c81ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39bf400640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39c813fef0 0x7f39c813e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 -- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39c813fef0 msgr2=0x7f39c813e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39c813fef0 0x7f39c813e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 -- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39c813fae0 msgr2=0x7f39c81ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39c813fae0 0x7f39c81ea990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.784+0000 7f39cca00640 1 -- 172.21.15.118:0/1206975804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c813eec0 con 0x7f39c8142730 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.785+0000 7f39c7e00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39c813fae0 0x7f39c81ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.785+0000 7f39cca00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c8142730 0x7f39c8139050 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c780 tx=0x7f39c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:56.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.785+0000 7f39c4c00640 1 -- 172.21.15.118:0/1206975804 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0016020 con 0x7f39c8142730 2024-09-21T06:15:56.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.785+0000 7f39c4c00640 1 -- 172.21.15.118:0/1206975804 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39c000a930 con 0x7f39c8142730 2024-09-21T06:15:56.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.785+0000 7f39c4c00640 1 -- 172.21.15.118:0/1206975804 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c000ad80 con 0x7f39c8142730 2024-09-21T06:15:56.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.785+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c813f390 con 0x7f39c8142730 2024-09-21T06:15:56.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.785+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c80b4720 con 0x7f39c8142730 2024-09-21T06:15:56.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.786+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c813f100 con 0x7f39c8142730 2024-09-21T06:15:56.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.788+0000 7f39c4c00640 1 -- 172.21.15.118:0/1206975804 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39c0019020 con 0x7f39c8142730 2024-09-21T06:15:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.789+0000 7f39c4c00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f39a4078b90 0x7f39a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.789+0000 7f39c4c00640 1 -- 172.21.15.118:0/1206975804 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5609+0+0 (secure 0 0 0) 0x7f39c009af60 con 0x7f39c8142730 2024-09-21T06:15:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.789+0000 7f39c7e00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f39a4078b90 0x7f39a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:56.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.790+0000 7f39c7e00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f39a4078b90 0x7f39a407b0a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f39b8005fd0 tx=0x7f39b800f360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:56.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:56.793+0000 7f39c4c00640 1 -- 172.21.15.118:0/1206975804 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f39c0020020 con 0x7f39c8142730 2024-09-21T06:15:57.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.015+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f39c815e550 con 0x7f39c8142730 2024-09-21T06:15:57.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.542+0000 7f39c4c00640 1 -- 172.21.15.118:0/1206975804 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v91) ==== 174+0+0 (secure 0 0 0) 0x7f39c0063360 con 0x7f39c8142730 2024-09-21T06:15:57.548 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 22 and data pool 23 2024-09-21T06:15:57.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.550+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f39a4078b90 msgr2=0x7f39a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:57.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.550+0000 7f39cea00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f39a4078b90 0x7f39a407b0a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f39b8005fd0 tx=0x7f39b800f360 comp rx=0 tx=0).stop 2024-09-21T06:15:57.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.550+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c8142730 msgr2=0x7f39c8139050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:57.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.550+0000 7f39cea00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c8142730 0x7f39c8139050 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c780 tx=0x7f39c000cc40 comp rx=0 tx=0).stop 2024-09-21T06:15:57.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.551+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 shutdown_connections 2024-09-21T06:15:57.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.551+0000 7f39cea00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39c8142730 0x7f39c8139050 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.551+0000 7f39cea00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f39a4078b90 0x7f39a407b0a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.551+0000 7f39cea00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39c813fef0 0x7f39c813e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.551+0000 7f39cea00640 1 --2- 172.21.15.118:0/1206975804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39c813fae0 0x7f39c81ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.551+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 >> 172.21.15.118:0/1206975804 conn(0x7f39c806d110 msgr2=0x7f39c8142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:57.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.554+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 shutdown_connections 2024-09-21T06:15:57.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.554+0000 7f39cea00640 1 -- 172.21.15.118:0/1206975804 wait complete. 2024-09-21T06:15:57.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:15:57.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.803+0000 7f3200200640 1 -- 172.21.15.118:0/1528549971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f8156220 msgr2=0x7f31f80afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:57.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.803+0000 7f3200200640 1 --2- 172.21.15.118:0/1528549971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f8156220 0x7f31f80afa50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f31ec005fd0 tx=0x7f31ec02a540 comp rx=0 tx=0).stop 2024-09-21T06:15:57.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.803+0000 7f3200200640 1 -- 172.21.15.118:0/1528549971 shutdown_connections 2024-09-21T06:15:57.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.803+0000 7f3200200640 1 --2- 172.21.15.118:0/1528549971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31f806ecd0 0x7f31f806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.804+0000 7f3200200640 1 --2- 172.21.15.118:0/1528549971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f8156220 0x7f31f80afa50 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.804+0000 7f3200200640 1 -- 172.21.15.118:0/1528549971 >> 172.21.15.118:0/1528549971 conn(0x7f31f806d110 msgr2=0x7f31f806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:57.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.804+0000 7f3200200640 1 -- 172.21.15.118:0/1528549971 shutdown_connections 2024-09-21T06:15:57.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.804+0000 7f3200200640 1 -- 172.21.15.118:0/1528549971 wait complete. 2024-09-21T06:15:57.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.806+0000 7f3200200640 1 Processor -- start 2024-09-21T06:15:57.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.806+0000 7f3200200640 1 -- start start 2024-09-21T06:15:57.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.807+0000 7f3200200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31f806ecd0 0x7f31f8140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:57.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.807+0000 7f3200200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f80d0de0 0x7f31f8141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:57.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.807+0000 7f3200200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31f8156220 0x7f31f8141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.807+0000 7f3200200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f31f8073270 con 0x7f31f80d0de0 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.807+0000 7f3200200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f31f80730f0 con 0x7f31f806ecd0 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.807+0000 7f3200200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f31f80733f0 con 0x7f31f8156220 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f80d0de0 0x7f31f8141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31f806ecd0 0x7f31f8140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f80d0de0 0x7f31f8141710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50744/0 (socket says 172.21.15.118:50744) 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 -- 172.21.15.118:0/1611019017 learned_addr learned my addr 172.21.15.118:0/1611019017 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fe200640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31f8156220 0x7f31f8141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 -- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31f8156220 msgr2=0x7f31f8141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31f8156220 0x7f31f8141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 -- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31f806ecd0 msgr2=0x7f31f8140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31f806ecd0 0x7f31f8140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:57.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.808+0000 7f31fce00640 1 -- 172.21.15.118:0/1611019017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f81446b0 con 0x7f31f80d0de0 2024-09-21T06:15:57.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.809+0000 7f31fce00640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f80d0de0 0x7f31f8141710 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f31e400d740 tx=0x7f31e400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:57.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.809+0000 7f31f5600640 1 -- 172.21.15.118:0/1611019017 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4017070 con 0x7f31f80d0de0 2024-09-21T06:15:57.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.809+0000 7f31f5600640 1 -- 172.21.15.118:0/1611019017 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31e4009d20 con 0x7f31f80d0de0 2024-09-21T06:15:57.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.809+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f81582d0 con 0x7f31f80d0de0 2024-09-21T06:15:57.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.809+0000 7f31f5600640 1 -- 172.21.15.118:0/1611019017 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40106c0 con 0x7f31f80d0de0 2024-09-21T06:15:57.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.809+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f8153110 con 0x7f31f80d0de0 2024-09-21T06:15:57.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.810+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f806f0e0 con 0x7f31f80d0de0 2024-09-21T06:15:57.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.811+0000 7f31f5600640 1 -- 172.21.15.118:0/1611019017 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31e401a070 con 0x7f31f80d0de0 2024-09-21T06:15:57.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.812+0000 7f31f5600640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f31d8078b90 0x7f31d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:57.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.812+0000 7f31f5600640 1 -- 172.21.15.118:0/1611019017 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f31e409ae50 con 0x7f31f80d0de0 2024-09-21T06:15:57.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.813+0000 7f31fd800640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f31d8078b90 0x7f31d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:57.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.814+0000 7f31fd800640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f31d8078b90 0x7f31d807b0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f31ec033000 tx=0x7f31ec004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:57.817+0000 7f31f5600640 1 -- 172.21.15.118:0/1611019017 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f31e4062c40 con 0x7f31f80d0de0 2024-09-21T06:15:58.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.002+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31f8152ea0 con 0x7f31f80d0de0 2024-09-21T06:15:58.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.004+0000 7f31f5600640 1 -- 172.21.15.118:0/1611019017 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16817 (secure 0 0 0) 0x7f31e4067670 con 0x7f31f80d0de0 2024-09-21T06:15:58.005 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:58.005 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":176,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:15:57.016885+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:15:54.926853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T06:15:55.983460+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f31d8078b90 msgr2=0x7f31d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f31d8078b90 0x7f31d807b0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f31ec033000 tx=0x7f31ec004730 comp rx=0 tx=0).stop 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f80d0de0 msgr2=0x7f31f8141710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f80d0de0 0x7f31f8141710 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f31e400d740 tx=0x7f31e400dc00 comp rx=0 tx=0).stop 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 shutdown_connections 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f31d8078b90 0x7f31d807b0a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31f8156220 0x7f31f8141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f80d0de0 0x7f31f8141710 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 --2- 172.21.15.118:0/1611019017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31f806ecd0 0x7f31f8140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 >> 172.21.15.118:0/1611019017 conn(0x7f31f806d110 msgr2=0x7f31f8153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 shutdown_connections 2024-09-21T06:15:58.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.006+0000 7f3200200640 1 -- 172.21.15.118:0/1611019017 wait complete. 2024-09-21T06:15:58.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.250+0000 7f6922600640 1 -- 172.21.15.118:0/2993901136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c070dc0 msgr2=0x7f691c0b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.250+0000 7f6922600640 1 --2- 172.21.15.118:0/2993901136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c070dc0 0x7f691c0b44c0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f690c005fd0 tx=0x7f690c02a5a0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.250+0000 7f6922600640 1 -- 172.21.15.118:0/2993901136 shutdown_connections 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.250+0000 7f6922600640 1 --2- 172.21.15.118:0/2993901136 >> v2:172.21.15.149:3300/0 conn(0x7f691c15f660 0x7f691c152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.250+0000 7f6922600640 1 --2- 172.21.15.118:0/2993901136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c070dc0 0x7f691c0b44c0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.250+0000 7f6922600640 1 -- 172.21.15.118:0/2993901136 >> 172.21.15.118:0/2993901136 conn(0x7f691c06d110 msgr2=0x7f691c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.250+0000 7f6922600640 1 -- 172.21.15.118:0/2993901136 shutdown_connections 2024-09-21T06:15:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.251+0000 7f6922600640 1 -- 172.21.15.118:0/2993901136 wait complete. 2024-09-21T06:15:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.253+0000 7f6922600640 1 Processor -- start 2024-09-21T06:15:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.253+0000 7f6922600640 1 -- start start 2024-09-21T06:15:58.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.254+0000 7f6922600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c06ecd0 0x7f691c1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.254+0000 7f6922600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c070dc0 0x7f691c157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.254+0000 7f6922600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f691c15f660 0x7f691c1432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.254+0000 7f6922600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f691c06f470 con 0x7f691c06ecd0 2024-09-21T06:15:58.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.254+0000 7f6922600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f691c06f2f0 con 0x7f691c070dc0 2024-09-21T06:15:58.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.254+0000 7f6922600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f691c15c600 con 0x7f691c15f660 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c06ecd0 0x7f691c1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c06ecd0 0x7f691c1401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50752/0 (socket says 172.21.15.118:50752) 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 -- 172.21.15.118:0/529012537 learned_addr learned my addr 172.21.15.118:0/529012537 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691aa00640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c070dc0 0x7f691c157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691be00640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f691c15f660 0x7f691c1432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 -- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f691c15f660 msgr2=0x7f691c1432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f691c15f660 0x7f691c1432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 -- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c070dc0 msgr2=0x7f691c157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c070dc0 0x7f691c157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 -- 172.21.15.118:0/529012537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c140880 con 0x7f691c06ecd0 2024-09-21T06:15:58.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.255+0000 7f691b400640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c06ecd0 0x7f691c1401c0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f690c034040 tx=0x7f690c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:58.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.256+0000 7f6913400640 1 -- 172.21.15.118:0/529012537 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c03e030 con 0x7f691c06ecd0 2024-09-21T06:15:58.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.256+0000 7f6913400640 1 -- 172.21.15.118:0/529012537 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f690c003d90 con 0x7f691c06ecd0 2024-09-21T06:15:58.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.256+0000 7f6913400640 1 -- 172.21.15.118:0/529012537 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c035040 con 0x7f691c06ecd0 2024-09-21T06:15:58.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.256+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c143810 con 0x7f691c06ecd0 2024-09-21T06:15:58.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.256+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c141090 con 0x7f691c06ecd0 2024-09-21T06:15:58.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.257+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691c0b5450 con 0x7f691c06ecd0 2024-09-21T06:15:58.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.258+0000 7f6913400640 1 -- 172.21.15.118:0/529012537 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f690c041030 con 0x7f691c06ecd0 2024-09-21T06:15:58.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.259+0000 7f6913400640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68fc078b90 0x7f68fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.259+0000 7f6913400640 1 -- 172.21.15.118:0/529012537 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f690c0bb2f0 con 0x7f691c06ecd0 2024-09-21T06:15:58.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.259+0000 7f691aa00640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68fc078b90 0x7f68fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.260+0000 7f691aa00640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68fc078b90 0x7f68fc07b0a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f691c1f72c0 tx=0x7f6908005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:58.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.263+0000 7f6913400640 1 -- 172.21.15.118:0/529012537 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f691c0b5450 con 0x7f691c06ecd0 2024-09-21T06:15:58.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.451+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f691c0b44c0 con 0x7f691c06ecd0 2024-09-21T06:15:58.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.452+0000 7f6913400640 1 -- 172.21.15.118:0/529012537 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16817 (secure 0 0 0) 0x7f690c083170 con 0x7f691c06ecd0 2024-09-21T06:15:58.454 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:15:58.454 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":176,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:15:57.016885+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:15:54.926853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T06:15:55.983460+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:15:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68fc078b90 msgr2=0x7f68fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68fc078b90 0x7f68fc07b0a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f691c1f72c0 tx=0x7f6908005f90 comp rx=0 tx=0).stop 2024-09-21T06:15:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c06ecd0 msgr2=0x7f691c1401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c06ecd0 0x7f691c1401c0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f690c034040 tx=0x7f690c0038a0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 shutdown_connections 2024-09-21T06:15:58.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f68fc078b90 0x7f68fc07b0a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f691c15f660 0x7f691c1432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f691c070dc0 0x7f691c157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 --2- 172.21.15.118:0/529012537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f691c06ecd0 0x7f691c1401c0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 >> 172.21.15.118:0/529012537 conn(0x7f691c06d110 msgr2=0x7f691c151760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 shutdown_connections 2024-09-21T06:15:58.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.455+0000 7f6922600640 1 -- 172.21.15.118:0/529012537 wait complete. 2024-09-21T06:15:58.479 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:15:58.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.702+0000 7f4fd1600640 1 -- 172.21.15.118:0/2915942664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 msgr2=0x7f4fcc0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.702+0000 7f4fd1600640 1 --2- 172.21.15.118:0/2915942664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 0x7f4fcc0d13c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4005fd0 tx=0x7f4fc402aa10 comp rx=0 tx=0).stop 2024-09-21T06:15:58.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.703+0000 7f4fd1600640 1 -- 172.21.15.118:0/2915942664 shutdown_connections 2024-09-21T06:15:58.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.703+0000 7f4fd1600640 1 --2- 172.21.15.118:0/2915942664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 0x7f4fcc0d13c0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.703+0000 7f4fd1600640 1 --2- 172.21.15.118:0/2915942664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 0x7f4fcc0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.703+0000 7f4fd1600640 1 -- 172.21.15.118:0/2915942664 >> 172.21.15.118:0/2915942664 conn(0x7f4fcc06d110 msgr2=0x7f4fcc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:58.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.703+0000 7f4fd1600640 1 -- 172.21.15.118:0/2915942664 shutdown_connections 2024-09-21T06:15:58.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.703+0000 7f4fd1600640 1 -- 172.21.15.118:0/2915942664 wait complete. 2024-09-21T06:15:58.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.705+0000 7f4fd1600640 1 Processor -- start 2024-09-21T06:15:58.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.705+0000 7f4fd1600640 1 -- start start 2024-09-21T06:15:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.706+0000 7f4fd1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 0x7f4fcc13e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.706+0000 7f4fd1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fcc13fef0 0x7f4fcc13b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fd1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 0x7f4fcc0742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fd1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0cfac0 con 0x7f4fcc142e40 2024-09-21T06:15:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fd1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0cf940 con 0x7f4fcc13fef0 2024-09-21T06:15:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fd1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc0cfc40 con 0x7f4fcc13fae0 2024-09-21T06:15:58.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 0x7f4fcc13e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 0x7f4fcc0742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 0x7f4fcc13e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.118:54006/0 (socket says 172.21.15.118:54006) 2024-09-21T06:15:58.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fca000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fcc13fef0 0x7f4fcc13b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 -- 172.21.15.118:0/239535115 learned_addr learned my addr 172.21.15.118:0/239535115 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 -- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fcc13fef0 msgr2=0x7f4fcc13b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fcc13fef0 0x7f4fcc13b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 -- 172.21.15.118:0/239535115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 msgr2=0x7f4fcc0742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 0x7f4fcc0742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcaa00640 1 -- 172.21.15.118:0/239535115 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc13d5f0 con 0x7f4fcc13fae0 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.707+0000 7f4fcb400640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 0x7f4fcc0742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.708+0000 7f4fcaa00640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 0x7f4fcc13e690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00e790 tx=0x7f4fbc00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:58.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.708+0000 7f4fc2a00640 1 -- 172.21.15.118:0/239535115 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00eea0 con 0x7f4fcc13fae0 2024-09-21T06:15:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.708+0000 7f4fc2a00640 1 -- 172.21.15.118:0/239535115 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fbc00cdb0 con 0x7f4fcc13fae0 2024-09-21T06:15:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.708+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fcc13d8d0 con 0x7f4fcc13fae0 2024-09-21T06:15:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.708+0000 7f4fc2a00640 1 -- 172.21.15.118:0/239535115 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc010690 con 0x7f4fcc13fae0 2024-09-21T06:15:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.708+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fcc13de90 con 0x7f4fcc13fae0 2024-09-21T06:15:58.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.709+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fcc0d00f0 con 0x7f4fcc13fae0 2024-09-21T06:15:58.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.711+0000 7f4fc2a00640 1 -- 172.21.15.118:0/239535115 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fbc010830 con 0x7f4fcc13fae0 2024-09-21T06:15:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.712+0000 7f4fc2a00640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4fac078b90 0x7f4fac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.712+0000 7f4fc2a00640 1 -- 172.21.15.118:0/239535115 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f4fbc09bf80 con 0x7f4fcc13fae0 2024-09-21T06:15:58.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.712+0000 7f4fca000640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4fac078b90 0x7f4fac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:58.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.713+0000 7f4fca000640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4fac078b90 0x7f4fac07b0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0cdb20 tx=0x7f4fb8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:58.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.716+0000 7f4fc2a00640 1 -- 172.21.15.118:0/239535115 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4fbc063d50 con 0x7f4fcc13fae0 2024-09-21T06:15:58.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:58.938+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4fcc157670 con 0x7f4fcc13fae0 2024-09-21T06:15:59.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.557+0000 7f4fc2a00640 1 -- 172.21.15.118:0/239535115 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v94) ==== 118+0+0 (secure 0 0 0) 0x7f4fbc068780 con 0x7f4fcc13fae0 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4fac078b90 msgr2=0x7f4fac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4fac078b90 0x7f4fac07b0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0cdb20 tx=0x7f4fb8009040 comp rx=0 tx=0).stop 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 msgr2=0x7f4fcc13e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 0x7f4fcc13e690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00e790 tx=0x7f4fbc00ec50 comp rx=0 tx=0).stop 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 shutdown_connections 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fcc142e40 0x7f4fcc0742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fcc13fef0 0x7f4fcc13b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:59.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f4fac078b90 0x7f4fac07b0a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 --2- 172.21.15.118:0/239535115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4fcc13fae0 0x7f4fcc13e690 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.560+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 >> 172.21.15.118:0/239535115 conn(0x7f4fcc06d110 msgr2=0x7f4fcc15c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.561+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 shutdown_connections 2024-09-21T06:15:59.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.561+0000 7f4fd1600640 1 -- 172.21.15.118:0/239535115 wait complete. 2024-09-21T06:15:59.585 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:15:59.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:15:59.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.810+0000 7f9d16e00640 1 -- 172.21.15.118:0/151388510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100b73c0 msgr2=0x7f9d10162c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:59.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.810+0000 7f9d16e00640 1 --2- 172.21.15.118:0/151388510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100b73c0 0x7f9d10162c50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009830 tx=0x7f9cfc02a480 comp rx=0 tx=0).stop 2024-09-21T06:15:59.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.810+0000 7f9d16e00640 1 -- 172.21.15.118:0/151388510 shutdown_connections 2024-09-21T06:15:59.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.810+0000 7f9d16e00640 1 --2- 172.21.15.118:0/151388510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100b73c0 0x7f9d10162c50 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:59.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.810+0000 7f9d16e00640 1 -- 172.21.15.118:0/151388510 >> 172.21.15.118:0/151388510 conn(0x7f9d100b38e0 msgr2=0x7f9d100b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:59.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.810+0000 7f9d16e00640 1 -- 172.21.15.118:0/151388510 shutdown_connections 2024-09-21T06:15:59.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.810+0000 7f9d16e00640 1 -- 172.21.15.118:0/151388510 wait complete. 2024-09-21T06:15:59.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.812+0000 7f9d16e00640 1 Processor -- start 2024-09-21T06:15:59.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.812+0000 7f9d16e00640 1 -- start start 2024-09-21T06:15:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d16e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d1006fe70 0x7f9d101f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d16e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100aede0 0x7f9d100b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d16e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d100b73c0 0x7f9d1014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d16e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10160630 con 0x7f9d1006fe70 2024-09-21T06:15:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d16e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1006d610 con 0x7f9d100aede0 2024-09-21T06:15:59.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d16e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d100af1f0 con 0x7f9d100b73c0 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d1006fe70 0x7f9d101f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d1006fe70 0x7f9d101f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50808/0 (socket says 172.21.15.118:50808) 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 -- 172.21.15.118:0/2880943973 learned_addr learned my addr 172.21.15.118:0/2880943973 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0f400640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100aede0 0x7f9d100b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d14e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d100b73c0 0x7f9d1014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 -- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d100b73c0 msgr2=0x7f9d1014a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d100b73c0 0x7f9d1014a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 -- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100aede0 msgr2=0x7f9d100b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100aede0 0x7f9d100b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.814+0000 7f9d0fe00640 1 -- 172.21.15.118:0/2880943973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d101f6840 con 0x7f9d1006fe70 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.815+0000 7f9d0fe00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d1006fe70 0x7f9d101f6300 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000ba50 tx=0x7f9d0000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.815+0000 7f9d07e00640 1 -- 172.21.15.118:0/2880943973 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00019070 con 0x7f9d1006fe70 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.815+0000 7f9d07e00640 1 -- 172.21.15.118:0/2880943973 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d0000cd10 con 0x7f9d1006fe70 2024-09-21T06:15:59.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.815+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d101f9ca0 con 0x7f9d1006fe70 2024-09-21T06:15:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.815+0000 7f9d07e00640 1 -- 172.21.15.118:0/2880943973 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d000146a0 con 0x7f9d1006fe70 2024-09-21T06:15:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.815+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d100b1e50 con 0x7f9d1006fe70 2024-09-21T06:15:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.816+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d100af5e0 con 0x7f9d1006fe70 2024-09-21T06:15:59.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.817+0000 7f9d07e00640 1 -- 172.21.15.118:0/2880943973 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d0001c070 con 0x7f9d1006fe70 2024-09-21T06:15:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.818+0000 7f9d07e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cf0078b90 0x7f9cf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.818+0000 7f9d07e00640 1 -- 172.21.15.118:0/2880943973 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f9d0009aa50 con 0x7f9d1006fe70 2024-09-21T06:15:59.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.819+0000 7f9d0f400640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cf0078b90 0x7f9cf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:59.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.819+0000 7f9d0f400640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cf0078b90 0x7f9cf007b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc034000 tx=0x7f9cfc004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:59.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:15:59.822+0000 7f9d07e00640 1 -- 172.21.15.118:0/2880943973 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9d101f6840 con 0x7f9d1006fe70 2024-09-21T06:16:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.047+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9d1006ee10 con 0x7f9d1006fe70 2024-09-21T06:16:00.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.555+0000 7f9d07e00640 1 -- 172.21.15.118:0/2880943973 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v95) ==== 122+0+0 (secure 0 0 0) 0x7f9d00062830 con 0x7f9d1006fe70 2024-09-21T06:16:00.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cf0078b90 msgr2=0x7f9cf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:00.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cf0078b90 0x7f9cf007b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc034000 tx=0x7f9cfc004730 comp rx=0 tx=0).stop 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d1006fe70 msgr2=0x7f9d101f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d1006fe70 0x7f9d101f6300 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000ba50 tx=0x7f9d0000bf10 comp rx=0 tx=0).stop 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 shutdown_connections 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9cf0078b90 0x7f9cf007b0a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d100b73c0 0x7f9d1014a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100aede0 0x7f9d100b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 --2- 172.21.15.118:0/2880943973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d1006fe70 0x7f9d101f6300 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 >> 172.21.15.118:0/2880943973 conn(0x7f9d100b38e0 msgr2=0x7f9d1006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 shutdown_connections 2024-09-21T06:16:00.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.558+0000 7f9d16e00640 1 -- 172.21.15.118:0/2880943973 wait complete. 2024-09-21T06:16:00.586 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:16:00.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:00.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.805+0000 7fe173e00640 1 -- 172.21.15.118:0/513671638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 msgr2=0x7fe16c0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:00.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.805+0000 7fe173e00640 1 --2- 172.21.15.118:0/513671638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c0afa50 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe16c06fe00 tx=0x7fe16002a510 comp rx=0 tx=0).stop 2024-09-21T06:16:00.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.805+0000 7fe173e00640 1 -- 172.21.15.118:0/513671638 shutdown_connections 2024-09-21T06:16:00.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.805+0000 7fe173e00640 1 --2- 172.21.15.118:0/513671638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c0afa50 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:00.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.805+0000 7fe173e00640 1 -- 172.21.15.118:0/513671638 >> 172.21.15.118:0/513671638 conn(0x7fe16c06d110 msgr2=0x7fe16c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:00.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.805+0000 7fe173e00640 1 -- 172.21.15.118:0/513671638 shutdown_connections 2024-09-21T06:16:00.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.805+0000 7fe173e00640 1 -- 172.21.15.118:0/513671638 wait complete. 2024-09-21T06:16:00.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.808+0000 7fe173e00640 1 Processor -- start 2024-09-21T06:16:00.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.808+0000 7fe173e00640 1 -- start start 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe173e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c06ecd0 0x7fe16c1f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe173e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c1f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe173e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c154ee0 0x7fe16c0b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe173e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0b0180 con 0x7fe16c156220 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe173e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c073800 con 0x7fe16c154ee0 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe173e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c06f0e0 con 0x7fe16c06ecd0 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe170a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c1f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe170a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c1f9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50830/0 (socket says 172.21.15.118:50830) 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.809+0000 7fe170a00640 1 -- 172.21.15.118:0/4246406801 learned_addr learned my addr 172.21.15.118:0/4246406801 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe171e00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c154ee0 0x7fe16c0b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe171400640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c06ecd0 0x7fe16c1f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe170a00640 1 -- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c06ecd0 msgr2=0x7fe16c1f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:00.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe170a00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c06ecd0 0x7fe16c1f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe170a00640 1 -- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c154ee0 msgr2=0x7fe16c0b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe170a00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c154ee0 0x7fe16c0b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe170a00640 1 -- 172.21.15.118:0/4246406801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c1e8350 con 0x7fe16c156220 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe171400640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c06ecd0 0x7fe16c1f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe170a00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c1f9e10 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c370 tx=0x7fe15800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe169600640 1 -- 172.21.15.118:0/4246406801 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158017070 con 0x7fe16c156220 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe169600640 1 -- 172.21.15.118:0/4246406801 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1580035f0 con 0x7fe16c156220 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c1e8630 con 0x7fe16c156220 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.810+0000 7fe169600640 1 -- 172.21.15.118:0/4246406801 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158003a40 con 0x7fe16c156220 2024-09-21T06:16:00.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.811+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c1f6810 con 0x7fe16c156220 2024-09-21T06:16:00.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.812+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c0afa50 con 0x7fe16c156220 2024-09-21T06:16:00.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.813+0000 7fe169600640 1 -- 172.21.15.118:0/4246406801 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe15801a070 con 0x7fe16c156220 2024-09-21T06:16:00.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.814+0000 7fe169600640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe14c078b90 0x7fe14c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:00.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.814+0000 7fe169600640 1 -- 172.21.15.118:0/4246406801 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fe158099f90 con 0x7fe16c156220 2024-09-21T06:16:00.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.814+0000 7fe171400640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe14c078b90 0x7fe14c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:00.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.815+0000 7fe171400640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe14c078b90 0x7fe14c07b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe160034000 tx=0x7fe160004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:00.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:00.819+0000 7fe169600640 1 -- 172.21.15.118:0/4246406801 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe158061d70 con 0x7fe16c156220 2024-09-21T06:16:01.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.038+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe16c14aa20 con 0x7fe16c156220 2024-09-21T06:16:01.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.039+0000 7fe169600640 1 -- 172.21.15.118:0/4246406801 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7fe1580667a0 con 0x7fe16c156220 2024-09-21T06:16:01.040 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:01.040 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:01.040 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:01.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe14c078b90 msgr2=0x7fe14c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe14c078b90 0x7fe14c07b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe160034000 tx=0x7fe160004730 comp rx=0 tx=0).stop 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 msgr2=0x7fe16c1f9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c1f9e10 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c370 tx=0x7fe15800c830 comp rx=0 tx=0).stop 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 shutdown_connections 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c154ee0 0x7fe16c0b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe16c156220 0x7fe16c1f9e10 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe14c078b90 0x7fe14c07b0a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 --2- 172.21.15.118:0/4246406801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c06ecd0 0x7fe16c1f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 >> 172.21.15.118:0/4246406801 conn(0x7fe16c06d110 msgr2=0x7fe16c072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 shutdown_connections 2024-09-21T06:16:01.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.041+0000 7fe173e00640 1 -- 172.21.15.118:0/4246406801 wait complete. 2024-09-21T06:16:01.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:16:01.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 -- 172.21.15.118:0/60077377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5040 msgr2=0x7f7d900cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 --2- 172.21.15.118:0/60077377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5040 0x7f7d900cca40 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7d900b3800 tx=0x7f7d7c02a4d0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 -- 172.21.15.118:0/60077377 shutdown_connections 2024-09-21T06:16:01.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 --2- 172.21.15.118:0/60077377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5040 0x7f7d900cca40 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 --2- 172.21.15.118:0/60077377 >> v2:172.21.15.149:3300/0 conn(0x7f7d9015cfd0 0x7f7d900b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 -- 172.21.15.118:0/60077377 >> 172.21.15.118:0/60077377 conn(0x7f7d9006d110 msgr2=0x7f7d9006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 -- 172.21.15.118:0/60077377 shutdown_connections 2024-09-21T06:16:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.287+0000 7f7d97e00640 1 -- 172.21.15.118:0/60077377 wait complete. 2024-09-21T06:16:01.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.289+0000 7f7d97e00640 1 Processor -- start 2024-09-21T06:16:01.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.290+0000 7f7d97e00640 1 -- start start 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d97e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d900b5040 0x7f7d900aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d97e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5450 0x7f7d900ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d97e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9015cfd0 0x7f7d901f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d97e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90073c60 con 0x7f7d900b5450 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d97e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90073ae0 con 0x7f7d9015cfd0 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d97e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d90073de0 con 0x7f7d900b5040 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d94a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5450 0x7f7d900ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d94a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5450 0x7f7d900ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50852/0 (socket says 172.21.15.118:50852) 2024-09-21T06:16:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d94a00640 1 -- 172.21.15.118:0/2252951210 learned_addr learned my addr 172.21.15.118:0/2252951210 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.291+0000 7f7d95e00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9015cfd0 0x7f7d901f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d95400640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d900b5040 0x7f7d900aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d94a00640 1 -- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d900b5040 msgr2=0x7f7d900aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d94a00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d900b5040 0x7f7d900aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d94a00640 1 -- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9015cfd0 msgr2=0x7f7d901f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d94a00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9015cfd0 0x7f7d901f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d94a00640 1 -- 172.21.15.118:0/2252951210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d900cd220 con 0x7f7d900b5450 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d94a00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5450 0x7f7d900ccce0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0099c0 tx=0x7f7d7c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d8d600640 1 -- 172.21.15.118:0/2252951210 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c03e030 con 0x7f7d900b5450 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d8d600640 1 -- 172.21.15.118:0/2252951210 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d7c0047a0 con 0x7f7d900b5450 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d8d600640 1 -- 172.21.15.118:0/2252951210 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c035040 con 0x7f7d900b5450 2024-09-21T06:16:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.292+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d900c9100 con 0x7f7d900b5450 2024-09-21T06:16:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.293+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d900c96c0 con 0x7f7d900b5450 2024-09-21T06:16:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.294+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d900b3a60 con 0x7f7d900b5450 2024-09-21T06:16:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.295+0000 7f7d8d600640 1 -- 172.21.15.118:0/2252951210 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d7c041030 con 0x7f7d900b5450 2024-09-21T06:16:01.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.296+0000 7f7d8d600640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d70078b90 0x7f7d7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.297+0000 7f7d8d600640 1 -- 172.21.15.118:0/2252951210 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f7d7c0bb3b0 con 0x7f7d900b5450 2024-09-21T06:16:01.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.297+0000 7f7d95400640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d70078b90 0x7f7d7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.298+0000 7f7d95400640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d70078b90 0x7f7d7007b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400bb50 tx=0x7f7d8400b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:01.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.301+0000 7f7d8d600640 1 -- 172.21.15.118:0/2252951210 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d7c0832c0 con 0x7f7d900b5450 2024-09-21T06:16:01.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.489+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d9015c090 con 0x7f7d900b5450 2024-09-21T06:16:01.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.490+0000 7f7d8d600640 1 -- 172.21.15.118:0/2252951210 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16804 (secure 0 0 0) 0x7f7d7c087cf0 con 0x7f7d900b5450 2024-09-21T06:16:01.492 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:01.492 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":177,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:15:58.530249+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:15:54.926853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T06:15:55.983460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:16:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.492+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d70078b90 msgr2=0x7f7d7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.492+0000 7f7d97e00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d70078b90 0x7f7d7007b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400bb50 tx=0x7f7d8400b2e0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.492+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5450 msgr2=0x7f7d900ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.492+0000 7f7d97e00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5450 0x7f7d900ccce0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0099c0 tx=0x7f7d7c0039e0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.492+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 shutdown_connections 2024-09-21T06:16:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.492+0000 7f7d97e00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9015cfd0 0x7f7d901f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.493+0000 7f7d97e00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d900b5450 0x7f7d900ccce0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.493+0000 7f7d97e00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7d70078b90 0x7f7d7007b0a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.493+0000 7f7d97e00640 1 --2- 172.21.15.118:0/2252951210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d900b5040 0x7f7d900aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.493+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 >> 172.21.15.118:0/2252951210 conn(0x7f7d9006d110 msgr2=0x7f7d90157f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.493+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 shutdown_connections 2024-09-21T06:16:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.493+0000 7f7d97e00640 1 -- 172.21.15.118:0/2252951210 wait complete. 2024-09-21T06:16:01.516 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:16:01.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:16:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.735+0000 7fee2e400640 1 -- 172.21.15.118:0/2454799921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5040 msgr2=0x7fee280cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.735+0000 7fee2e400640 1 --2- 172.21.15.118:0/2454799921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5040 0x7fee280cca40 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fee280b3800 tx=0x7fee1402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.735+0000 7fee2e400640 1 -- 172.21.15.118:0/2454799921 shutdown_connections 2024-09-21T06:16:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.735+0000 7fee2e400640 1 --2- 172.21.15.118:0/2454799921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5040 0x7fee280cca40 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.735+0000 7fee2e400640 1 --2- 172.21.15.118:0/2454799921 >> v2:172.21.15.149:3300/0 conn(0x7fee2815cfd0 0x7fee280b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.735+0000 7fee2e400640 1 -- 172.21.15.118:0/2454799921 >> 172.21.15.118:0/2454799921 conn(0x7fee2806d110 msgr2=0x7fee2806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:01.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.736+0000 7fee2e400640 1 -- 172.21.15.118:0/2454799921 shutdown_connections 2024-09-21T06:16:01.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.736+0000 7fee2e400640 1 -- 172.21.15.118:0/2454799921 wait complete. 2024-09-21T06:16:01.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.738+0000 7fee2e400640 1 Processor -- start 2024-09-21T06:16:01.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.738+0000 7fee2e400640 1 -- start start 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.739+0000 7fee2e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee280b5040 0x7fee280ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.739+0000 7fee2e400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5450 0x7fee280aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee2e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2815cfd0 0x7fee280abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee2e400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fee28073c60 con 0x7fee280b5450 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee2e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee28073ae0 con 0x7fee2815cfd0 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee2e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee28073de0 con 0x7fee280b5040 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5450 0x7fee280aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5450 0x7fee280aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50862/0 (socket says 172.21.15.118:50862) 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 -- 172.21.15.118:0/4074779969 learned_addr learned my addr 172.21.15.118:0/4074779969 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee27400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee280b5040 0x7fee280ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee27e00640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2815cfd0 0x7fee280abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 -- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee280b5040 msgr2=0x7fee280ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee280b5040 0x7fee280ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 -- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2815cfd0 msgr2=0x7fee280abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2815cfd0 0x7fee280abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee26a00640 1 -- 172.21.15.118:0/4074779969 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee280ab140 con 0x7fee280b5450 2024-09-21T06:16:01.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.740+0000 7fee27400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee280b5040 0x7fee280ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:01.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.741+0000 7fee26a00640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5450 0x7fee280aa4a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fee14034040 tx=0x7fee140039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:01.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.741+0000 7fee1f400640 1 -- 172.21.15.118:0/4074779969 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1403e030 con 0x7fee280b5450 2024-09-21T06:16:01.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.741+0000 7fee1f400640 1 -- 172.21.15.118:0/4074779969 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee140047a0 con 0x7fee280b5450 2024-09-21T06:16:01.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.741+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee280ab420 con 0x7fee280b5450 2024-09-21T06:16:01.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.741+0000 7fee1f400640 1 -- 172.21.15.118:0/4074779969 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14035040 con 0x7fee280b5450 2024-09-21T06:16:01.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.741+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee280ab9e0 con 0x7fee280b5450 2024-09-21T06:16:01.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.742+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee28155e60 con 0x7fee280b5450 2024-09-21T06:16:01.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.743+0000 7fee1f400640 1 -- 172.21.15.118:0/4074779969 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee14041030 con 0x7fee280b5450 2024-09-21T06:16:01.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.745+0000 7fee1f400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee08078b90 0x7fee0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:01.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.745+0000 7fee1f400640 1 -- 172.21.15.118:0/4074779969 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fee140bb3e0 con 0x7fee280b5450 2024-09-21T06:16:01.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.745+0000 7fee27400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee08078b90 0x7fee0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:01.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.746+0000 7fee27400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee08078b90 0x7fee0807b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fee18005fd0 tx=0x7fee1800f360 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:01.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.749+0000 7fee1f400640 1 -- 172.21.15.118:0/4074779969 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee28155e60 con 0x7fee280b5450 2024-09-21T06:16:01.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.930+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee280c9de0 con 0x7fee08078b90 2024-09-21T06:16:01.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.935+0000 7fee1f400640 1 -- 172.21.15.118:0/4074779969 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247977 (secure 0 0 0) 0x7fee280c9de0 con 0x7fee08078b90 2024-09-21T06:16:01.939 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:01.940 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:16:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee08078b90 msgr2=0x7fee0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee08078b90 0x7fee0807b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fee18005fd0 tx=0x7fee1800f360 comp rx=0 tx=0).stop 2024-09-21T06:16:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5450 msgr2=0x7fee280aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5450 0x7fee280aa4a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fee14034040 tx=0x7fee140039e0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 shutdown_connections 2024-09-21T06:16:01.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee2815cfd0 0x7fee280abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee280b5450 0x7fee280aa4a0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fee08078b90 0x7fee0807b0a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 --2- 172.21.15.118:0/4074779969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee280b5040 0x7fee280ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 >> 172.21.15.118:0/4074779969 conn(0x7fee2806d110 msgr2=0x7fee2815ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 shutdown_connections 2024-09-21T06:16:01.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:01.939+0000 7fee2e400640 1 -- 172.21.15.118:0/4074779969 wait complete. 2024-09-21T06:16:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2024-09-21T06:16:00.656161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8917,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553582,"statfs":{"total":1600000000,"available":1590867992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.144319"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541430+0000","last_change":"2024-09-21T06:15:57.553114+0000","last_active":"2024-09-21T06:15:58.541430+0000","last_peered":"2024-09-21T06:15:58.541430+0000","last_clean":"2024-09-21T06:15:58.541430+0000","last_became_active":"2024-09-21T06:15:57.550765+0000","last_became_peered":"2024-09-21T06:15:57.550765+0000","last_unstale":"2024-09-21T06:15:58.541430+0000","last_undegraded":"2024-09-21T06:15:58.541430+0000","last_fullsized":"2024-09-21T06:15:58.541430+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:28.404748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541503+0000","last_change":"2024-09-21T06:15:57.548219+0000","last_active":"2024-09-21T06:15:58.541503+0000","last_peered":"2024-09-21T06:15:58.541503+0000","last_clean":"2024-09-21T06:15:58.541503+0000","last_became_active":"2024-09-21T06:15:57.547328+0000","last_became_peered":"2024-09-21T06:15:57.547328+0000","last_unstale":"2024-09-21T06:15:58.541503+0000","last_undegraded":"2024-09-21T06:15:58.541503+0000","last_fullsized":"2024-09-21T06:15:58.541503+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:06.744107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554882+0000","last_change":"2024-09-21T06:15:57.549040+0000","last_active":"2024-09-21T06:15:58.554882+0000","last_peered":"2024-09-21T06:15:58.554882+0000","last_clean":"2024-09-21T06:15:58.554882+0000","last_became_active":"2024-09-21T06:15:57.548760+0000","last_became_peered":"2024-09-21T06:15:57.548760+0000","last_unstale":"2024-09-21T06:15:58.554882+0000","last_undegraded":"2024-09-21T06:15:58.554882+0000","last_fullsized":"2024-09-21T06:15:58.554882+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:53.747442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.537551+0000","last_change":"2024-09-21T06:15:57.537323+0000","last_active":"2024-09-21T06:15:57.537551+0000","last_peered":"2024-09-21T06:15:57.537551+0000","last_clean":"2024-09-21T06:15:57.537551+0000","last_became_active":"2024-09-21T06:15:57.536879+0000","last_became_peered":"2024-09-21T06:15:57.536879+0000","last_unstale":"2024-09-21T06:15:57.537551+0000","last_undegraded":"2024-09-21T06:15:57.537551+0000","last_fullsized":"2024-09-21T06:15:57.537551+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:13.488875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.542004+0000","last_change":"2024-09-21T06:15:57.546845+0000","last_active":"2024-09-21T06:15:58.542004+0000","last_peered":"2024-09-21T06:15:58.542004+0000","last_clean":"2024-09-21T06:15:58.542004+0000","last_became_active":"2024-09-21T06:15:57.545124+0000","last_became_peered":"2024-09-21T06:15:57.545124+0000","last_unstale":"2024-09-21T06:15:58.542004+0000","last_undegraded":"2024-09-21T06:15:58.542004+0000","last_fullsized":"2024-09-21T06:15:58.542004+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:14.362816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542410+0000","last_change":"2024-09-21T06:15:57.541849+0000","last_active":"2024-09-21T06:15:57.542410+0000","last_peered":"2024-09-21T06:15:57.542410+0000","last_clean":"2024-09-21T06:15:57.542410+0000","last_became_active":"2024-09-21T06:15:57.541006+0000","last_became_peered":"2024-09-21T06:15:57.541006+0000","last_unstale":"2024-09-21T06:15:57.542410+0000","last_undegraded":"2024-09-21T06:15:57.542410+0000","last_fullsized":"2024-09-21T06:15:57.542410+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:22.178672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540326+0000","last_change":"2024-09-21T06:15:57.547576+0000","last_active":"2024-09-21T06:15:58.540326+0000","last_peered":"2024-09-21T06:15:58.540326+0000","last_clean":"2024-09-21T06:15:58.540326+0000","last_became_active":"2024-09-21T06:15:57.547143+0000","last_became_peered":"2024-09-21T06:15:57.547143+0000","last_unstale":"2024-09-21T06:15:58.540326+0000","last_undegraded":"2024-09-21T06:15:58.540326+0000","last_fullsized":"2024-09-21T06:15:58.540326+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:27.040084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540602+0000","last_change":"2024-09-21T06:15:57.550146+0000","last_active":"2024-09-21T06:15:58.540602+0000","last_peered":"2024-09-21T06:15:58.540602+0000","last_clean":"2024-09-21T06:15:58.540602+0000","last_became_active":"2024-09-21T06:15:57.549882+0000","last_became_peered":"2024-09-21T06:15:57.549882+0000","last_unstale":"2024-09-21T06:15:58.540602+0000","last_undegraded":"2024-09-21T06:15:58.540602+0000","last_fullsized":"2024-09-21T06:15:58.540602+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:10.467673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541013+0000","last_change":"2024-09-21T06:15:57.545517+0000","last_active":"2024-09-21T06:15:58.541013+0000","last_peered":"2024-09-21T06:15:58.541013+0000","last_clean":"2024-09-21T06:15:58.541013+0000","last_became_active":"2024-09-21T06:15:57.545217+0000","last_became_peered":"2024-09-21T06:15:57.545217+0000","last_unstale":"2024-09-21T06:15:58.541013+0000","last_undegraded":"2024-09-21T06:15:58.541013+0000","last_fullsized":"2024-09-21T06:15:58.541013+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:14.765993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.542211+0000","last_change":"2024-09-21T06:15:57.535594+0000","last_active":"2024-09-21T06:15:58.542211+0000","last_peered":"2024-09-21T06:15:58.542211+0000","last_clean":"2024-09-21T06:15:58.542211+0000","last_became_active":"2024-09-21T06:15:57.535385+0000","last_became_peered":"2024-09-21T06:15:57.535385+0000","last_unstale":"2024-09-21T06:15:58.542211+0000","last_undegraded":"2024-09-21T06:15:58.542211+0000","last_fullsized":"2024-09-21T06:15:58.542211+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:10.450919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541575+0000","last_change":"2024-09-21T06:15:57.550900+0000","last_active":"2024-09-21T06:15:58.541575+0000","last_peered":"2024-09-21T06:15:58.541575+0000","last_clean":"2024-09-21T06:15:58.541575+0000","last_became_active":"2024-09-21T06:15:57.548105+0000","last_became_peered":"2024-09-21T06:15:57.548105+0000","last_unstale":"2024-09-21T06:15:58.541575+0000","last_undegraded":"2024-09-21T06:15:58.541575+0000","last_fullsized":"2024-09-21T06:15:58.541575+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:53.415825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541749+0000","last_change":"2024-09-21T06:15:57.547948+0000","last_active":"2024-09-21T06:15:58.541749+0000","last_peered":"2024-09-21T06:15:58.541749+0000","last_clean":"2024-09-21T06:15:58.541749+0000","last_became_active":"2024-09-21T06:15:57.547011+0000","last_became_peered":"2024-09-21T06:15:57.547011+0000","last_unstale":"2024-09-21T06:15:58.541749+0000","last_undegraded":"2024-09-21T06:15:58.541749+0000","last_fullsized":"2024-09-21T06:15:58.541749+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:40.364420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554304+0000","last_change":"2024-09-21T06:15:57.544433+0000","last_active":"2024-09-21T06:15:58.554304+0000","last_peered":"2024-09-21T06:15:58.554304+0000","last_clean":"2024-09-21T06:15:58.554304+0000","last_became_active":"2024-09-21T06:15:57.544155+0000","last_became_peered":"2024-09-21T06:15:57.544155+0000","last_unstale":"2024-09-21T06:15:58.554304+0000","last_undegraded":"2024-09-21T06:15:58.554304+0000","last_fullsized":"2024-09-21T06:15:58.554304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:04.158560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554224+0000","last_change":"2024-09-21T06:15:57.547230+0000","last_active":"2024-09-21T06:15:58.554224+0000","last_peered":"2024-09-21T06:15:58.554224+0000","last_clean":"2024-09-21T06:15:58.554224+0000","last_became_active":"2024-09-21T06:15:57.546939+0000","last_became_peered":"2024-09-21T06:15:57.546939+0000","last_unstale":"2024-09-21T06:15:58.554224+0000","last_undegraded":"2024-09-21T06:15:58.554224+0000","last_fullsized":"2024-09-21T06:15:58.554224+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:52:58.470007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541606+0000","last_change":"2024-09-21T06:15:57.550130+0000","last_active":"2024-09-21T06:15:58.541606+0000","last_peered":"2024-09-21T06:15:58.541606+0000","last_clean":"2024-09-21T06:15:58.541606+0000","last_became_active":"2024-09-21T06:15:57.544776+0000","last_became_peered":"2024-09-21T06:15:57.544776+0000","last_unstale":"2024-09-21T06:15:58.541606+0000","last_undegraded":"2024-09-21T06:15:58.541606+0000","last_fullsized":"2024-09-21T06:15:58.541606+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:33.467399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540422+0000","last_change":"2024-09-21T06:15:57.553682+0000","last_active":"2024-09-21T06:15:58.540422+0000","last_peered":"2024-09-21T06:15:58.540422+0000","last_clean":"2024-09-21T06:15:58.540422+0000","last_became_active":"2024-09-21T06:15:57.553425+0000","last_became_peered":"2024-09-21T06:15:57.553425+0000","last_unstale":"2024-09-21T06:15:58.540422+0000","last_undegraded":"2024-09-21T06:15:58.540422+0000","last_fullsized":"2024-09-21T06:15:58.540422+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:17.144984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.552169+0000","last_change":"2024-09-21T06:15:57.551846+0000","last_active":"2024-09-21T06:15:57.552169+0000","last_peered":"2024-09-21T06:15:57.552169+0000","last_clean":"2024-09-21T06:15:57.552169+0000","last_became_active":"2024-09-21T06:15:57.551589+0000","last_became_peered":"2024-09-21T06:15:57.551589+0000","last_unstale":"2024-09-21T06:15:57.552169+0000","last_undegraded":"2024-09-21T06:15:57.552169+0000","last_fullsized":"2024-09-21T06:15:57.552169+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:25.681982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538338+0000","last_change":"2024-09-21T06:15:57.543554+0000","last_active":"2024-09-21T06:15:58.538338+0000","last_peered":"2024-09-21T06:15:58.538338+0000","last_clean":"2024-09-21T06:15:58.538338+0000","last_became_active":"2024-09-21T06:15:57.543262+0000","last_became_peered":"2024-09-21T06:15:57.543262+0000","last_unstale":"2024-09-21T06:15:58.538338+0000","last_undegraded":"2024-09-21T06:15:58.538338+0000","last_fullsized":"2024-09-21T06:15:58.538338+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:44.972096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.553931+0000","last_change":"2024-09-21T06:15:57.553618+0000","last_active":"2024-09-21T06:15:57.553931+0000","last_peered":"2024-09-21T06:15:57.553931+0000","last_clean":"2024-09-21T06:15:57.553931+0000","last_became_active":"2024-09-21T06:15:57.553327+0000","last_became_peered":"2024-09-21T06:15:57.553327+0000","last_unstale":"2024-09-21T06:15:57.553931+0000","last_undegraded":"2024-09-21T06:15:57.553931+0000","last_fullsized":"2024-09-21T06:15:57.553931+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:10.917958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554331+0000","last_change":"2024-09-21T06:15:57.554717+0000","last_active":"2024-09-21T06:15:58.554331+0000","last_peered":"2024-09-21T06:15:58.554331+0000","last_clean":"2024-09-21T06:15:58.554331+0000","last_became_active":"2024-09-21T06:15:57.551773+0000","last_became_peered":"2024-09-21T06:15:57.551773+0000","last_unstale":"2024-09-21T06:15:58.554331+0000","last_undegraded":"2024-09-21T06:15:58.554331+0000","last_fullsized":"2024-09-21T06:15:58.554331+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:18.186133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.553190+0000","last_change":"2024-09-21T06:15:57.552402+0000","last_active":"2024-09-21T06:15:57.553190+0000","last_peered":"2024-09-21T06:15:57.553190+0000","last_clean":"2024-09-21T06:15:57.553190+0000","last_became_active":"2024-09-21T06:15:57.551913+0000","last_became_peered":"2024-09-21T06:15:57.551913+0000","last_unstale":"2024-09-21T06:15:57.553190+0000","last_undegraded":"2024-09-21T06:15:57.553190+0000","last_fullsized":"2024-09-21T06:15:57.553190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:25.140031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541966+0000","last_change":"2024-09-21T06:15:57.547666+0000","last_active":"2024-09-21T06:15:58.541966+0000","last_peered":"2024-09-21T06:15:58.541966+0000","last_clean":"2024-09-21T06:15:58.541966+0000","last_became_active":"2024-09-21T06:15:57.546648+0000","last_became_peered":"2024-09-21T06:15:57.546648+0000","last_unstale":"2024-09-21T06:15:58.541966+0000","last_undegraded":"2024-09-21T06:15:58.541966+0000","last_fullsized":"2024-09-21T06:15:58.541966+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:25.592496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542380+0000","last_change":"2024-09-21T06:15:57.541704+0000","last_active":"2024-09-21T06:15:57.542380+0000","last_peered":"2024-09-21T06:15:57.542380+0000","last_clean":"2024-09-21T06:15:57.542380+0000","last_became_active":"2024-09-21T06:15:57.541046+0000","last_became_peered":"2024-09-21T06:15:57.541046+0000","last_unstale":"2024-09-21T06:15:57.542380+0000","last_undegraded":"2024-09-21T06:15:57.542380+0000","last_fullsized":"2024-09-21T06:15:57.542380+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:44.134998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540641+0000","last_change":"2024-09-21T06:15:57.541675+0000","last_active":"2024-09-21T06:15:58.540641+0000","last_peered":"2024-09-21T06:15:58.540641+0000","last_clean":"2024-09-21T06:15:58.540641+0000","last_became_active":"2024-09-21T06:15:57.541317+0000","last_became_peered":"2024-09-21T06:15:57.541317+0000","last_unstale":"2024-09-21T06:15:58.540641+0000","last_undegraded":"2024-09-21T06:15:58.540641+0000","last_fullsized":"2024-09-21T06:15:58.540641+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.509354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554590+0000","last_change":"2024-09-21T06:15:57.545462+0000","last_active":"2024-09-21T06:15:58.554590+0000","last_peered":"2024-09-21T06:15:58.554590+0000","last_clean":"2024-09-21T06:15:58.554590+0000","last_became_active":"2024-09-21T06:15:57.545176+0000","last_became_peered":"2024-09-21T06:15:57.545176+0000","last_unstale":"2024-09-21T06:15:58.554590+0000","last_undegraded":"2024-09-21T06:15:58.554590+0000","last_fullsized":"2024-09-21T06:15:58.554590+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:10.644762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540299+0000","last_change":"2024-09-21T06:15:57.549882+0000","last_active":"2024-09-21T06:15:58.540299+0000","last_peered":"2024-09-21T06:15:58.540299+0000","last_clean":"2024-09-21T06:15:58.540299+0000","last_became_active":"2024-09-21T06:15:57.549614+0000","last_became_peered":"2024-09-21T06:15:57.549614+0000","last_unstale":"2024-09-21T06:15:58.540299+0000","last_undegraded":"2024-09-21T06:15:58.540299+0000","last_fullsized":"2024-09-21T06:15:58.540299+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:37.321346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554271+0000","last_change":"2024-09-21T06:15:57.550219+0000","last_active":"2024-09-21T06:15:58.554271+0000","last_peered":"2024-09-21T06:15:58.554271+0000","last_clean":"2024-09-21T06:15:58.554271+0000","last_became_active":"2024-09-21T06:15:57.549838+0000","last_became_peered":"2024-09-21T06:15:57.549838+0000","last_unstale":"2024-09-21T06:15:58.554271+0000","last_undegraded":"2024-09-21T06:15:58.554271+0000","last_fullsized":"2024-09-21T06:15:58.554271+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:02.168113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.553838+0000","last_change":"2024-09-21T06:15:57.553145+0000","last_active":"2024-09-21T06:15:57.553838+0000","last_peered":"2024-09-21T06:15:57.553838+0000","last_clean":"2024-09-21T06:15:57.553838+0000","last_became_active":"2024-09-21T06:15:57.552894+0000","last_became_peered":"2024-09-21T06:15:57.552894+0000","last_unstale":"2024-09-21T06:15:57.553838+0000","last_undegraded":"2024-09-21T06:15:57.553838+0000","last_fullsized":"2024-09-21T06:15:57.553838+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:07.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554508+0000","last_change":"2024-09-21T06:15:57.550594+0000","last_active":"2024-09-21T06:15:58.554508+0000","last_peered":"2024-09-21T06:15:58.554508+0000","last_clean":"2024-09-21T06:15:58.554508+0000","last_became_active":"2024-09-21T06:15:57.549762+0000","last_became_peered":"2024-09-21T06:15:57.549762+0000","last_unstale":"2024-09-21T06:15:58.554508+0000","last_undegraded":"2024-09-21T06:15:58.554508+0000","last_fullsized":"2024-09-21T06:15:58.554508+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:57.174298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539916+0000","last_change":"2024-09-21T06:15:57.556211+0000","last_active":"2024-09-21T06:15:58.539916+0000","last_peered":"2024-09-21T06:15:58.539916+0000","last_clean":"2024-09-21T06:15:58.539916+0000","last_became_active":"2024-09-21T06:15:57.555265+0000","last_became_peered":"2024-09-21T06:15:57.555265+0000","last_unstale":"2024-09-21T06:15:58.539916+0000","last_undegraded":"2024-09-21T06:15:58.539916+0000","last_fullsized":"2024-09-21T06:15:58.539916+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:15.955556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539817+0000","last_change":"2024-09-21T06:15:57.551706+0000","last_active":"2024-09-21T06:15:58.539817+0000","last_peered":"2024-09-21T06:15:58.539817+0000","last_clean":"2024-09-21T06:15:58.539817+0000","last_became_active":"2024-09-21T06:15:57.551299+0000","last_became_peered":"2024-09-21T06:15:57.551299+0000","last_unstale":"2024-09-21T06:15:58.539817+0000","last_undegraded":"2024-09-21T06:15:58.539817+0000","last_fullsized":"2024-09-21T06:15:58.539817+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:35.252569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538056+0000","last_change":"2024-09-21T06:15:57.547382+0000","last_active":"2024-09-21T06:15:58.538056+0000","last_peered":"2024-09-21T06:15:58.538056+0000","last_clean":"2024-09-21T06:15:58.538056+0000","last_became_active":"2024-09-21T06:15:57.545022+0000","last_became_peered":"2024-09-21T06:15:57.545022+0000","last_unstale":"2024-09-21T06:15:58.538056+0000","last_undegraded":"2024-09-21T06:15:58.538056+0000","last_fullsized":"2024-09-21T06:15:58.538056+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.269295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539654+0000","last_change":"2024-09-21T06:15:57.548463+0000","last_active":"2024-09-21T06:15:58.539654+0000","last_peered":"2024-09-21T06:15:58.539654+0000","last_clean":"2024-09-21T06:15:58.539654+0000","last_became_active":"2024-09-21T06:15:57.548087+0000","last_became_peered":"2024-09-21T06:15:57.548087+0000","last_unstale":"2024-09-21T06:15:58.539654+0000","last_undegraded":"2024-09-21T06:15:58.539654+0000","last_fullsized":"2024-09-21T06:15:58.539654+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:05.005275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"176'4","reported_seq":19,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540790+0000","last_change":"2024-09-21T06:15:56.530174+0000","last_active":"2024-09-21T06:15:58.540790+0000","last_peered":"2024-09-21T06:15:58.540790+0000","last_clean":"2024-09-21T06:15:58.540790+0000","last_became_active":"2024-09-21T06:15:56.529406+0000","last_became_peered":"2024-09-21T06:15:56.529406+0000","last_unstale":"2024-09-21T06:15:58.540790+0000","last_undegraded":"2024-09-21T06:15:58.540790+0000","last_fullsized":"2024-09-21T06:15:58.540790+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:03.724641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539506+0000","last_change":"2024-09-21T06:15:57.552480+0000","last_active":"2024-09-21T06:15:58.539506+0000","last_peered":"2024-09-21T06:15:58.539506+0000","last_clean":"2024-09-21T06:15:58.539506+0000","last_became_active":"2024-09-21T06:15:57.552212+0000","last_became_peered":"2024-09-21T06:15:57.552212+0000","last_unstale":"2024-09-21T06:15:58.539506+0000","last_undegraded":"2024-09-21T06:15:58.539506+0000","last_fullsized":"2024-09-21T06:15:58.539506+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.706183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539179+0000","last_change":"2024-09-21T06:15:56.534933+0000","last_active":"2024-09-21T06:15:58.539179+0000","last_peered":"2024-09-21T06:15:58.539179+0000","last_clean":"2024-09-21T06:15:58.539179+0000","last_became_active":"2024-09-21T06:15:56.534661+0000","last_became_peered":"2024-09-21T06:15:56.534661+0000","last_unstale":"2024-09-21T06:15:58.539179+0000","last_undegraded":"2024-09-21T06:15:58.539179+0000","last_fullsized":"2024-09-21T06:15:58.539179+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:11.987634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.551583+0000","last_change":"2024-09-21T06:15:57.551248+0000","last_active":"2024-09-21T06:15:57.551583+0000","last_peered":"2024-09-21T06:15:57.551583+0000","last_clean":"2024-09-21T06:15:57.551583+0000","last_became_active":"2024-09-21T06:15:57.550985+0000","last_became_peered":"2024-09-21T06:15:57.550985+0000","last_unstale":"2024-09-21T06:15:57.551583+0000","last_undegraded":"2024-09-21T06:15:57.551583+0000","last_fullsized":"2024-09-21T06:15:57.551583+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:43.099341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.561034+0000","last_change":"2024-09-21T06:15:56.534033+0000","last_active":"2024-09-21T06:15:57.561034+0000","last_peered":"2024-09-21T06:15:57.561034+0000","last_clean":"2024-09-21T06:15:57.561034+0000","last_became_active":"2024-09-21T06:15:56.533782+0000","last_became_peered":"2024-09-21T06:15:56.533782+0000","last_unstale":"2024-09-21T06:15:57.561034+0000","last_undegraded":"2024-09-21T06:15:57.561034+0000","last_fullsized":"2024-09-21T06:15:57.561034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:49.992850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554809+0000","last_change":"2024-09-21T06:15:57.552074+0000","last_active":"2024-09-21T06:15:58.554809+0000","last_peered":"2024-09-21T06:15:58.554809+0000","last_clean":"2024-09-21T06:15:58.554809+0000","last_became_active":"2024-09-21T06:15:57.551346+0000","last_became_peered":"2024-09-21T06:15:57.551346+0000","last_unstale":"2024-09-21T06:15:58.554809+0000","last_undegraded":"2024-09-21T06:15:58.554809+0000","last_fullsized":"2024-09-21T06:15:58.554809+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:50.048208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560313+0000","last_change":"2024-09-21T06:15:56.522271+0000","last_active":"2024-09-21T06:15:57.560313+0000","last_peered":"2024-09-21T06:15:57.560313+0000","last_clean":"2024-09-21T06:15:57.560313+0000","last_became_active":"2024-09-21T06:15:56.521982+0000","last_became_peered":"2024-09-21T06:15:56.521982+0000","last_unstale":"2024-09-21T06:15:57.560313+0000","last_undegraded":"2024-09-21T06:15:57.560313+0000","last_fullsized":"2024-09-21T06:15:57.560313+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:38.809148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539764+0000","last_change":"2024-09-21T06:15:57.545193+0000","last_active":"2024-09-21T06:15:58.539764+0000","last_peered":"2024-09-21T06:15:58.539764+0000","last_clean":"2024-09-21T06:15:58.539764+0000","last_became_active":"2024-09-21T06:15:57.544957+0000","last_became_peered":"2024-09-21T06:15:57.544957+0000","last_unstale":"2024-09-21T06:15:58.539764+0000","last_undegraded":"2024-09-21T06:15:58.539764+0000","last_fullsized":"2024-09-21T06:15:58.539764+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:53.673472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554741+0000","last_change":"2024-09-21T06:15:56.530309+0000","last_active":"2024-09-21T06:15:58.554741+0000","last_peered":"2024-09-21T06:15:58.554741+0000","last_clean":"2024-09-21T06:15:58.554741+0000","last_became_active":"2024-09-21T06:15:56.529915+0000","last_became_peered":"2024-09-21T06:15:56.529915+0000","last_unstale":"2024-09-21T06:15:58.554741+0000","last_undegraded":"2024-09-21T06:15:58.554741+0000","last_fullsized":"2024-09-21T06:15:58.554741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:09.354400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.548649+0000","last_change":"2024-09-21T06:15:57.548451+0000","last_active":"2024-09-21T06:15:57.548649+0000","last_peered":"2024-09-21T06:15:57.548649+0000","last_clean":"2024-09-21T06:15:57.548649+0000","last_became_active":"2024-09-21T06:15:57.547901+0000","last_became_peered":"2024-09-21T06:15:57.547901+0000","last_unstale":"2024-09-21T06:15:57.548649+0000","last_undegraded":"2024-09-21T06:15:57.548649+0000","last_fullsized":"2024-09-21T06:15:57.548649+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:17.990689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560722+0000","last_change":"2024-09-21T06:15:56.525638+0000","last_active":"2024-09-21T06:15:57.560722+0000","last_peered":"2024-09-21T06:15:57.560722+0000","last_clean":"2024-09-21T06:15:57.560722+0000","last_became_active":"2024-09-21T06:15:56.525352+0000","last_became_peered":"2024-09-21T06:15:56.525352+0000","last_unstale":"2024-09-21T06:15:57.560722+0000","last_undegraded":"2024-09-21T06:15:57.560722+0000","last_fullsized":"2024-09-21T06:15:57.560722+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:05.738652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.545630+0000","last_change":"2024-09-21T06:15:57.543427+0000","last_active":"2024-09-21T06:15:57.545630+0000","last_peered":"2024-09-21T06:15:57.545630+0000","last_clean":"2024-09-21T06:15:57.545630+0000","last_became_active":"2024-09-21T06:15:57.542402+0000","last_became_peered":"2024-09-21T06:15:57.542402+0000","last_unstale":"2024-09-21T06:15:57.545630+0000","last_undegraded":"2024-09-21T06:15:57.545630+0000","last_fullsized":"2024-09-21T06:15:57.545630+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:23.694382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540778+0000","last_change":"2024-09-21T06:15:56.534310+0000","last_active":"2024-09-21T06:15:58.540778+0000","last_peered":"2024-09-21T06:15:58.540778+0000","last_clean":"2024-09-21T06:15:58.540778+0000","last_became_active":"2024-09-21T06:15:56.533559+0000","last_became_peered":"2024-09-21T06:15:56.533559+0000","last_unstale":"2024-09-21T06:15:58.540778+0000","last_undegraded":"2024-09-21T06:15:58.540778+0000","last_fullsized":"2024-09-21T06:15:58.540778+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:24.812783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542451+0000","last_change":"2024-09-21T06:15:57.542258+0000","last_active":"2024-09-21T06:15:57.542451+0000","last_peered":"2024-09-21T06:15:57.542451+0000","last_clean":"2024-09-21T06:15:57.542451+0000","last_became_active":"2024-09-21T06:15:57.541932+0000","last_became_peered":"2024-09-21T06:15:57.541932+0000","last_unstale":"2024-09-21T06:15:57.542451+0000","last_undegraded":"2024-09-21T06:15:57.542451+0000","last_fullsized":"2024-09-21T06:15:57.542451+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:45.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540331+0000","last_change":"2024-09-21T06:15:56.527196+0000","last_active":"2024-09-21T06:15:58.540331+0000","last_peered":"2024-09-21T06:15:58.540331+0000","last_clean":"2024-09-21T06:15:58.540331+0000","last_became_active":"2024-09-21T06:15:56.526923+0000","last_became_peered":"2024-09-21T06:15:56.526923+0000","last_unstale":"2024-09-21T06:15:58.540331+0000","last_undegraded":"2024-09-21T06:15:58.540331+0000","last_fullsized":"2024-09-21T06:15:58.540331+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:01.533862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538341+0000","last_change":"2024-09-21T06:15:57.536897+0000","last_active":"2024-09-21T06:15:58.538341+0000","last_peered":"2024-09-21T06:15:58.538341+0000","last_clean":"2024-09-21T06:15:58.538341+0000","last_became_active":"2024-09-21T06:15:57.536234+0000","last_became_peered":"2024-09-21T06:15:57.536234+0000","last_unstale":"2024-09-21T06:15:58.538341+0000","last_undegraded":"2024-09-21T06:15:58.538341+0000","last_fullsized":"2024-09-21T06:15:58.538341+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:47.782508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542764+0000","last_change":"2024-09-21T06:15:56.527194+0000","last_active":"2024-09-21T06:15:57.542764+0000","last_peered":"2024-09-21T06:15:57.542764+0000","last_clean":"2024-09-21T06:15:57.542764+0000","last_became_active":"2024-09-21T06:15:56.526934+0000","last_became_peered":"2024-09-21T06:15:56.526934+0000","last_unstale":"2024-09-21T06:15:57.542764+0000","last_undegraded":"2024-09-21T06:15:57.542764+0000","last_fullsized":"2024-09-21T06:15:57.542764+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:26.868839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538736+0000","last_change":"2024-09-21T06:15:57.536488+0000","last_active":"2024-09-21T06:15:58.538736+0000","last_peered":"2024-09-21T06:15:58.538736+0000","last_clean":"2024-09-21T06:15:58.538736+0000","last_became_active":"2024-09-21T06:15:57.536121+0000","last_became_peered":"2024-09-21T06:15:57.536121+0000","last_unstale":"2024-09-21T06:15:58.538736+0000","last_undegraded":"2024-09-21T06:15:58.538736+0000","last_fullsized":"2024-09-21T06:15:58.538736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:30.840827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"176'3","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560062+0000","last_change":"2024-09-21T06:15:56.529494+0000","last_active":"2024-09-21T06:15:57.560062+0000","last_peered":"2024-09-21T06:15:57.560062+0000","last_clean":"2024-09-21T06:15:57.560062+0000","last_became_active":"2024-09-21T06:15:56.529129+0000","last_became_peered":"2024-09-21T06:15:56.529129+0000","last_unstale":"2024-09-21T06:15:57.560062+0000","last_undegraded":"2024-09-21T06:15:57.560062+0000","last_fullsized":"2024-09-21T06:15:57.560062+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:55.070444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539762+0000","last_change":"2024-09-21T06:15:57.549040+0000","last_active":"2024-09-21T06:15:58.539762+0000","last_peered":"2024-09-21T06:15:58.539762+0000","last_clean":"2024-09-21T06:15:58.539762+0000","last_became_active":"2024-09-21T06:15:57.548777+0000","last_became_peered":"2024-09-21T06:15:57.548777+0000","last_unstale":"2024-09-21T06:15:58.539762+0000","last_undegraded":"2024-09-21T06:15:58.539762+0000","last_fullsized":"2024-09-21T06:15:58.539762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:14.881846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"176'6","reported_seq":21,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539306+0000","last_change":"2024-09-21T06:15:56.529141+0000","last_active":"2024-09-21T06:15:58.539306+0000","last_peered":"2024-09-21T06:15:58.539306+0000","last_clean":"2024-09-21T06:15:58.539306+0000","last_became_active":"2024-09-21T06:15:56.528849+0000","last_became_peered":"2024-09-21T06:15:56.528849+0000","last_unstale":"2024-09-21T06:15:58.539306+0000","last_undegraded":"2024-09-21T06:15:58.539306+0000","last_fullsized":"2024-09-21T06:15:58.539306+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:13.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538575+0000","last_change":"2024-09-21T06:15:57.536568+0000","last_active":"2024-09-21T06:15:58.538575+0000","last_peered":"2024-09-21T06:15:58.538575+0000","last_clean":"2024-09-21T06:15:58.538575+0000","last_became_active":"2024-09-21T06:15:57.535142+0000","last_became_peered":"2024-09-21T06:15:57.535142+0000","last_unstale":"2024-09-21T06:15:58.538575+0000","last_undegraded":"2024-09-21T06:15:58.538575+0000","last_fullsized":"2024-09-21T06:15:58.538575+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:07.658486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560901+0000","last_change":"2024-09-21T06:15:56.524862+0000","last_active":"2024-09-21T06:15:57.560901+0000","last_peered":"2024-09-21T06:15:57.560901+0000","last_clean":"2024-09-21T06:15:57.560901+0000","last_became_active":"2024-09-21T06:15:56.524338+0000","last_became_peered":"2024-09-21T06:15:56.524338+0000","last_unstale":"2024-09-21T06:15:57.560901+0000","last_undegraded":"2024-09-21T06:15:57.560901+0000","last_fullsized":"2024-09-21T06:15:57.560901+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:43.979524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540252+0000","last_change":"2024-09-21T06:15:57.547337+0000","last_active":"2024-09-21T06:15:58.540252+0000","last_peered":"2024-09-21T06:15:58.540252+0000","last_clean":"2024-09-21T06:15:58.540252+0000","last_became_active":"2024-09-21T06:15:57.547079+0000","last_became_peered":"2024-09-21T06:15:57.547079+0000","last_unstale":"2024-09-21T06:15:58.540252+0000","last_undegraded":"2024-09-21T06:15:58.540252+0000","last_fullsized":"2024-09-21T06:15:58.540252+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:13.098584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538743+0000","last_change":"2024-09-21T06:15:56.530924+0000","last_active":"2024-09-21T06:15:58.538743+0000","last_peered":"2024-09-21T06:15:58.538743+0000","last_clean":"2024-09-21T06:15:58.538743+0000","last_became_active":"2024-09-21T06:15:56.530356+0000","last_became_peered":"2024-09-21T06:15:56.530356+0000","last_unstale":"2024-09-21T06:15:58.538743+0000","last_undegraded":"2024-09-21T06:15:58.538743+0000","last_fullsized":"2024-09-21T06:15:58.538743+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:43.207159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.550272+0000","last_change":"2024-09-21T06:15:57.549941+0000","last_active":"2024-09-21T06:15:57.550272+0000","last_peered":"2024-09-21T06:15:57.550272+0000","last_clean":"2024-09-21T06:15:57.550272+0000","last_became_active":"2024-09-21T06:15:57.549693+0000","last_became_peered":"2024-09-21T06:15:57.549693+0000","last_unstale":"2024-09-21T06:15:57.550272+0000","last_undegraded":"2024-09-21T06:15:57.550272+0000","last_fullsized":"2024-09-21T06:15:57.550272+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:07.532608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.533947+0000","last_change":"2024-09-21T06:15:56.533889+0000","last_active":"2024-09-21T06:15:57.533947+0000","last_peered":"2024-09-21T06:15:57.533947+0000","last_clean":"2024-09-21T06:15:57.533947+0000","last_became_active":"2024-09-21T06:15:56.533609+0000","last_became_peered":"2024-09-21T06:15:56.533609+0000","last_unstale":"2024-09-21T06:15:57.533947+0000","last_undegraded":"2024-09-21T06:15:57.533947+0000","last_fullsized":"2024-09-21T06:15:57.533947+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:31.055780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554548+0000","last_change":"2024-09-21T06:15:57.548801+0000","last_active":"2024-09-21T06:15:58.554548+0000","last_peered":"2024-09-21T06:15:58.554548+0000","last_clean":"2024-09-21T06:15:58.554548+0000","last_became_active":"2024-09-21T06:15:57.548511+0000","last_became_peered":"2024-09-21T06:15:57.548511+0000","last_unstale":"2024-09-21T06:15:58.554548+0000","last_undegraded":"2024-09-21T06:15:58.554548+0000","last_fullsized":"2024-09-21T06:15:58.554548+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:38.134114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"176'8","reported_seq":23,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539913+0000","last_change":"2024-09-21T06:15:56.526976+0000","last_active":"2024-09-21T06:15:58.539913+0000","last_peered":"2024-09-21T06:15:58.539913+0000","last_clean":"2024-09-21T06:15:58.539913+0000","last_became_active":"2024-09-21T06:15:56.526679+0000","last_became_peered":"2024-09-21T06:15:56.526679+0000","last_unstale":"2024-09-21T06:15:58.539913+0000","last_undegraded":"2024-09-21T06:15:58.539913+0000","last_fullsized":"2024-09-21T06:15:58.539913+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:56.460623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.546592+0000","last_change":"2024-09-21T06:15:57.546323+0000","last_active":"2024-09-21T06:15:57.546592+0000","last_peered":"2024-09-21T06:15:57.546592+0000","last_clean":"2024-09-21T06:15:57.546592+0000","last_became_active":"2024-09-21T06:15:57.545954+0000","last_became_peered":"2024-09-21T06:15:57.545954+0000","last_unstale":"2024-09-21T06:15:57.546592+0000","last_undegraded":"2024-09-21T06:15:57.546592+0000","last_fullsized":"2024-09-21T06:15:57.546592+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:08.057702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554848+0000","last_change":"2024-09-21T06:15:56.535169+0000","last_active":"2024-09-21T06:15:58.554848+0000","last_peered":"2024-09-21T06:15:58.554848+0000","last_clean":"2024-09-21T06:15:58.554848+0000","last_became_active":"2024-09-21T06:15:56.534279+0000","last_became_peered":"2024-09-21T06:15:56.534279+0000","last_unstale":"2024-09-21T06:15:58.554848+0000","last_undegraded":"2024-09-21T06:15:58.554848+0000","last_fullsized":"2024-09-21T06:15:58.554848+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:33.627654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538097+0000","last_change":"2024-09-21T06:15:57.554073+0000","last_active":"2024-09-21T06:15:58.538097+0000","last_peered":"2024-09-21T06:15:58.538097+0000","last_clean":"2024-09-21T06:15:58.538097+0000","last_became_active":"2024-09-21T06:15:57.552959+0000","last_became_peered":"2024-09-21T06:15:57.552959+0000","last_unstale":"2024-09-21T06:15:58.538097+0000","last_undegraded":"2024-09-21T06:15:58.538097+0000","last_fullsized":"2024-09-21T06:15:58.538097+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:46.915215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"176'2","reported_seq":17,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554962+0000","last_change":"2024-09-21T06:15:56.525976+0000","last_active":"2024-09-21T06:15:58.554962+0000","last_peered":"2024-09-21T06:15:58.554962+0000","last_clean":"2024-09-21T06:15:58.554962+0000","last_became_active":"2024-09-21T06:15:56.524934+0000","last_became_peered":"2024-09-21T06:15:56.524934+0000","last_unstale":"2024-09-21T06:15:58.554962+0000","last_undegraded":"2024-09-21T06:15:58.554962+0000","last_fullsized":"2024-09-21T06:15:58.554962+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:46.402176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.548499+0000","last_change":"2024-09-21T06:15:57.548151+0000","last_active":"2024-09-21T06:15:57.548499+0000","last_peered":"2024-09-21T06:15:57.548499+0000","last_clean":"2024-09-21T06:15:57.548499+0000","last_became_active":"2024-09-21T06:15:57.547569+0000","last_became_peered":"2024-09-21T06:15:57.547569+0000","last_unstale":"2024-09-21T06:15:57.548499+0000","last_undegraded":"2024-09-21T06:15:57.548499+0000","last_fullsized":"2024-09-21T06:15:57.548499+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:55.621795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541552+0000","last_change":"2024-09-21T06:15:56.531546+0000","last_active":"2024-09-21T06:15:58.541552+0000","last_peered":"2024-09-21T06:15:58.541552+0000","last_clean":"2024-09-21T06:15:58.541552+0000","last_became_active":"2024-09-21T06:15:56.530496+0000","last_became_peered":"2024-09-21T06:15:56.530496+0000","last_unstale":"2024-09-21T06:15:58.541552+0000","last_undegraded":"2024-09-21T06:15:58.541552+0000","last_fullsized":"2024-09-21T06:15:58.541552+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:26.415192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540560+0000","last_change":"2024-09-21T06:15:57.548927+0000","last_active":"2024-09-21T06:15:58.540560+0000","last_peered":"2024-09-21T06:15:58.540560+0000","last_clean":"2024-09-21T06:15:58.540560+0000","last_became_active":"2024-09-21T06:15:57.548452+0000","last_became_peered":"2024-09-21T06:15:57.548452+0000","last_unstale":"2024-09-21T06:15:58.540560+0000","last_undegraded":"2024-09-21T06:15:58.540560+0000","last_fullsized":"2024-09-21T06:15:58.540560+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.723454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541079+0000","last_change":"2024-09-21T06:15:56.518595+0000","last_active":"2024-09-21T06:15:58.541079+0000","last_peered":"2024-09-21T06:15:58.541079+0000","last_clean":"2024-09-21T06:15:58.541079+0000","last_became_active":"2024-09-21T06:15:56.518301+0000","last_became_peered":"2024-09-21T06:15:56.518301+0000","last_unstale":"2024-09-21T06:15:58.541079+0000","last_undegraded":"2024-09-21T06:15:58.541079+0000","last_fullsized":"2024-09-21T06:15:58.541079+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:07.300576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554729+0000","last_change":"2024-09-21T06:15:57.543069+0000","last_active":"2024-09-21T06:15:58.554729+0000","last_peered":"2024-09-21T06:15:58.554729+0000","last_clean":"2024-09-21T06:15:58.554729+0000","last_became_active":"2024-09-21T06:15:57.542777+0000","last_became_peered":"2024-09-21T06:15:57.542777+0000","last_unstale":"2024-09-21T06:15:58.554729+0000","last_undegraded":"2024-09-21T06:15:58.554729+0000","last_fullsized":"2024-09-21T06:15:58.554729+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:43.034252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560972+0000","last_change":"2024-09-21T06:15:56.534081+0000","last_active":"2024-09-21T06:15:57.560972+0000","last_peered":"2024-09-21T06:15:57.560972+0000","last_clean":"2024-09-21T06:15:57.560972+0000","last_became_active":"2024-09-21T06:15:56.533823+0000","last_became_peered":"2024-09-21T06:15:56.533823+0000","last_unstale":"2024-09-21T06:15:57.560972+0000","last_undegraded":"2024-09-21T06:15:57.560972+0000","last_fullsized":"2024-09-21T06:15:57.560972+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:49.134311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540008+0000","last_change":"2024-09-21T06:15:57.554540+0000","last_active":"2024-09-21T06:15:58.540008+0000","last_peered":"2024-09-21T06:15:58.540008+0000","last_clean":"2024-09-21T06:15:58.540008+0000","last_became_active":"2024-09-21T06:15:57.553073+0000","last_became_peered":"2024-09-21T06:15:57.553073+0000","last_unstale":"2024-09-21T06:15:58.540008+0000","last_undegraded":"2024-09-21T06:15:58.540008+0000","last_fullsized":"2024-09-21T06:15:58.540008+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:42.679434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540910+0000","last_change":"2024-09-21T06:15:56.528725+0000","last_active":"2024-09-21T06:15:58.540910+0000","last_peered":"2024-09-21T06:15:58.540910+0000","last_clean":"2024-09-21T06:15:58.540910+0000","last_became_active":"2024-09-21T06:15:56.528461+0000","last_became_peered":"2024-09-21T06:15:56.528461+0000","last_unstale":"2024-09-21T06:15:58.540910+0000","last_undegraded":"2024-09-21T06:15:58.540910+0000","last_fullsized":"2024-09-21T06:15:58.540910+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:45.788330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541192+0000","last_change":"2024-09-21T06:15:57.554948+0000","last_active":"2024-09-21T06:15:58.541192+0000","last_peered":"2024-09-21T06:15:58.541192+0000","last_clean":"2024-09-21T06:15:58.541192+0000","last_became_active":"2024-09-21T06:15:57.551122+0000","last_became_peered":"2024-09-21T06:15:57.551122+0000","last_unstale":"2024-09-21T06:15:58.541192+0000","last_undegraded":"2024-09-21T06:15:58.541192+0000","last_fullsized":"2024-09-21T06:15:58.541192+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:45.768673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.534093+0000","last_change":"2024-09-21T06:15:56.527122+0000","last_active":"2024-09-21T06:15:57.534093+0000","last_peered":"2024-09-21T06:15:57.534093+0000","last_clean":"2024-09-21T06:15:57.534093+0000","last_became_active":"2024-09-21T06:15:56.526869+0000","last_became_peered":"2024-09-21T06:15:56.526869+0000","last_unstale":"2024-09-21T06:15:57.534093+0000","last_undegraded":"2024-09-21T06:15:57.534093+0000","last_fullsized":"2024-09-21T06:15:57.534093+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.349318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.544739+0000","last_change":"2024-09-21T06:15:57.543676+0000","last_active":"2024-09-21T06:15:57.544739+0000","last_peered":"2024-09-21T06:15:57.544739+0000","last_clean":"2024-09-21T06:15:57.544739+0000","last_became_active":"2024-09-21T06:15:57.542976+0000","last_became_peered":"2024-09-21T06:15:57.542976+0000","last_unstale":"2024-09-21T06:15:57.544739+0000","last_undegraded":"2024-09-21T06:15:57.544739+0000","last_fullsized":"2024-09-21T06:15:57.544739+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:51.967829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541680+0000","last_change":"2024-09-21T06:15:56.531848+0000","last_active":"2024-09-21T06:15:58.541680+0000","last_peered":"2024-09-21T06:15:58.541680+0000","last_clean":"2024-09-21T06:15:58.541680+0000","last_became_active":"2024-09-21T06:15:56.531276+0000","last_became_peered":"2024-09-21T06:15:56.531276+0000","last_unstale":"2024-09-21T06:15:58.541680+0000","last_undegraded":"2024-09-21T06:15:58.541680+0000","last_fullsized":"2024-09-21T06:15:58.541680+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:11.744885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539330+0000","last_change":"2024-09-21T06:15:57.535685+0000","last_active":"2024-09-21T06:15:58.539330+0000","last_peered":"2024-09-21T06:15:58.539330+0000","last_clean":"2024-09-21T06:15:58.539330+0000","last_became_active":"2024-09-21T06:15:57.535372+0000","last_became_peered":"2024-09-21T06:15:57.535372+0000","last_unstale":"2024-09-21T06:15:58.539330+0000","last_undegraded":"2024-09-21T06:15:58.539330+0000","last_fullsized":"2024-09-21T06:15:58.539330+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:03.271128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"176'2","reported_seq":17,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539103+0000","last_change":"2024-09-21T06:15:56.533727+0000","last_active":"2024-09-21T06:15:58.539103+0000","last_peered":"2024-09-21T06:15:58.539103+0000","last_clean":"2024-09-21T06:15:58.539103+0000","last_became_active":"2024-09-21T06:15:56.533455+0000","last_became_peered":"2024-09-21T06:15:56.533455+0000","last_unstale":"2024-09-21T06:15:58.539103+0000","last_undegraded":"2024-09-21T06:15:58.539103+0000","last_fullsized":"2024-09-21T06:15:58.539103+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:23.490701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540573+0000","last_change":"2024-09-21T06:15:57.550012+0000","last_active":"2024-09-21T06:15:58.540573+0000","last_peered":"2024-09-21T06:15:58.540573+0000","last_clean":"2024-09-21T06:15:58.540573+0000","last_became_active":"2024-09-21T06:15:57.548727+0000","last_became_peered":"2024-09-21T06:15:57.548727+0000","last_unstale":"2024-09-21T06:15:58.540573+0000","last_undegraded":"2024-09-21T06:15:58.540573+0000","last_fullsized":"2024-09-21T06:15:58.540573+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:14.929359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"177'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.555802+0000","last_change":"2024-09-21T06:15:56.529389+0000","last_active":"2024-09-21T06:15:58.555802+0000","last_peered":"2024-09-21T06:15:58.555802+0000","last_clean":"2024-09-21T06:15:58.555802+0000","last_became_active":"2024-09-21T06:15:56.528986+0000","last_became_peered":"2024-09-21T06:15:56.528986+0000","last_unstale":"2024-09-21T06:15:58.555802+0000","last_undegraded":"2024-09-21T06:15:58.555802+0000","last_fullsized":"2024-09-21T06:15:58.555802+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:56.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.544298+0000","last_change":"2024-09-21T06:15:57.543358+0000","last_active":"2024-09-21T06:15:57.544298+0000","last_peered":"2024-09-21T06:15:57.544298+0000","last_clean":"2024-09-21T06:15:57.544298+0000","last_became_active":"2024-09-21T06:15:57.542619+0000","last_became_peered":"2024-09-21T06:15:57.542619+0000","last_unstale":"2024-09-21T06:15:57.544298+0000","last_undegraded":"2024-09-21T06:15:57.544298+0000","last_fullsized":"2024-09-21T06:15:57.544298+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:34.063119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541147+0000","last_change":"2024-09-21T06:15:56.533977+0000","last_active":"2024-09-21T06:15:58.541147+0000","last_peered":"2024-09-21T06:15:58.541147+0000","last_clean":"2024-09-21T06:15:58.541147+0000","last_became_active":"2024-09-21T06:15:56.533200+0000","last_became_peered":"2024-09-21T06:15:56.533200+0000","last_unstale":"2024-09-21T06:15:58.541147+0000","last_undegraded":"2024-09-21T06:15:58.541147+0000","last_fullsized":"2024-09-21T06:15:58.541147+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:49.469027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538306+0000","last_change":"2024-09-21T06:15:57.542961+0000","last_active":"2024-09-21T06:15:58.538306+0000","last_peered":"2024-09-21T06:15:58.538306+0000","last_clean":"2024-09-21T06:15:58.538306+0000","last_became_active":"2024-09-21T06:15:57.542681+0000","last_became_peered":"2024-09-21T06:15:57.542681+0000","last_unstale":"2024-09-21T06:15:58.538306+0000","last_undegraded":"2024-09-21T06:15:58.538306+0000","last_fullsized":"2024-09-21T06:15:58.538306+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:57.268817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538126+0000","last_change":"2024-09-21T06:15:56.529389+0000","last_active":"2024-09-21T06:15:58.538126+0000","last_peered":"2024-09-21T06:15:58.538126+0000","last_clean":"2024-09-21T06:15:58.538126+0000","last_became_active":"2024-09-21T06:15:56.529093+0000","last_became_peered":"2024-09-21T06:15:56.529093+0000","last_unstale":"2024-09-21T06:15:58.538126+0000","last_undegraded":"2024-09-21T06:15:58.538126+0000","last_fullsized":"2024-09-21T06:15:58.538126+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:47.321083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538902+0000","last_change":"2024-09-21T06:15:57.545265+0000","last_active":"2024-09-21T06:15:58.538902+0000","last_peered":"2024-09-21T06:15:58.538902+0000","last_clean":"2024-09-21T06:15:58.538902+0000","last_became_active":"2024-09-21T06:15:57.544702+0000","last_became_peered":"2024-09-21T06:15:57.544702+0000","last_unstale":"2024-09-21T06:15:58.538902+0000","last_undegraded":"2024-09-21T06:15:58.538902+0000","last_fullsized":"2024-09-21T06:15:58.538902+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:43.020151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540535+0000","last_change":"2024-09-21T06:15:56.532500+0000","last_active":"2024-09-21T06:15:58.540535+0000","last_peered":"2024-09-21T06:15:58.540535+0000","last_clean":"2024-09-21T06:15:58.540535+0000","last_became_active":"2024-09-21T06:15:56.531809+0000","last_became_peered":"2024-09-21T06:15:56.531809+0000","last_unstale":"2024-09-21T06:15:58.540535+0000","last_undegraded":"2024-09-21T06:15:58.540535+0000","last_fullsized":"2024-09-21T06:15:58.540535+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:39.772271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540049+0000","last_change":"2024-09-21T06:15:57.550600+0000","last_active":"2024-09-21T06:15:58.540049+0000","last_peered":"2024-09-21T06:15:58.540049+0000","last_clean":"2024-09-21T06:15:58.540049+0000","last_became_active":"2024-09-21T06:15:57.550329+0000","last_became_peered":"2024-09-21T06:15:57.550329+0000","last_unstale":"2024-09-21T06:15:58.540049+0000","last_undegraded":"2024-09-21T06:15:58.540049+0000","last_fullsized":"2024-09-21T06:15:58.540049+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:23.322202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.534182+0000","last_change":"2024-09-21T06:15:56.530858+0000","last_active":"2024-09-21T06:15:57.534182+0000","last_peered":"2024-09-21T06:15:57.534182+0000","last_clean":"2024-09-21T06:15:57.534182+0000","last_became_active":"2024-09-21T06:15:56.528654+0000","last_became_peered":"2024-09-21T06:15:56.528654+0000","last_unstale":"2024-09-21T06:15:57.534182+0000","last_undegraded":"2024-09-21T06:15:57.534182+0000","last_fullsized":"2024-09-21T06:15:57.534182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:42.089873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539835+0000","last_change":"2024-09-21T06:15:57.554146+0000","last_active":"2024-09-21T06:15:58.539835+0000","last_peered":"2024-09-21T06:15:58.539835+0000","last_clean":"2024-09-21T06:15:58.539835+0000","last_became_active":"2024-09-21T06:15:57.553897+0000","last_became_peered":"2024-09-21T06:15:57.553897+0000","last_unstale":"2024-09-21T06:15:58.539835+0000","last_undegraded":"2024-09-21T06:15:58.539835+0000","last_fullsized":"2024-09-21T06:15:58.539835+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:12.188805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541988+0000","last_change":"2024-09-21T06:15:56.532709+0000","last_active":"2024-09-21T06:15:58.541988+0000","last_peered":"2024-09-21T06:15:58.541988+0000","last_clean":"2024-09-21T06:15:58.541988+0000","last_became_active":"2024-09-21T06:15:56.532323+0000","last_became_peered":"2024-09-21T06:15:56.532323+0000","last_unstale":"2024-09-21T06:15:58.541988+0000","last_undegraded":"2024-09-21T06:15:58.541988+0000","last_fullsized":"2024-09-21T06:15:58.541988+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:24.670355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554568+0000","last_change":"2024-09-21T06:15:57.553277+0000","last_active":"2024-09-21T06:15:58.554568+0000","last_peered":"2024-09-21T06:15:58.554568+0000","last_clean":"2024-09-21T06:15:58.554568+0000","last_became_active":"2024-09-21T06:15:57.552830+0000","last_became_peered":"2024-09-21T06:15:57.552830+0000","last_unstale":"2024-09-21T06:15:58.554568+0000","last_undegraded":"2024-09-21T06:15:58.554568+0000","last_fullsized":"2024-09-21T06:15:58.554568+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:54.988226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539449+0000","last_change":"2024-09-21T06:15:56.527376+0000","last_active":"2024-09-21T06:15:58.539449+0000","last_peered":"2024-09-21T06:15:58.539449+0000","last_clean":"2024-09-21T06:15:58.539449+0000","last_became_active":"2024-09-21T06:15:56.527103+0000","last_became_peered":"2024-09-21T06:15:56.527103+0000","last_unstale":"2024-09-21T06:15:58.539449+0000","last_undegraded":"2024-09-21T06:15:58.539449+0000","last_fullsized":"2024-09-21T06:15:58.539449+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:13.793375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538639+0000","last_change":"2024-09-21T06:15:57.535350+0000","last_active":"2024-09-21T06:15:58.538639+0000","last_peered":"2024-09-21T06:15:58.538639+0000","last_clean":"2024-09-21T06:15:58.538639+0000","last_became_active":"2024-09-21T06:15:57.535118+0000","last_became_peered":"2024-09-21T06:15:57.535118+0000","last_unstale":"2024-09-21T06:15:58.538639+0000","last_undegraded":"2024-09-21T06:15:58.538639+0000","last_fullsized":"2024-09-21T06:15:58.538639+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:57.588962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540319+0000","last_change":"2024-09-21T06:15:56.533065+0000","last_active":"2024-09-21T06:15:58.540319+0000","last_peered":"2024-09-21T06:15:58.540319+0000","last_clean":"2024-09-21T06:15:58.540319+0000","last_became_active":"2024-09-21T06:15:56.532146+0000","last_became_peered":"2024-09-21T06:15:56.532146+0000","last_unstale":"2024-09-21T06:15:58.540319+0000","last_undegraded":"2024-09-21T06:15:58.540319+0000","last_fullsized":"2024-09-21T06:15:58.540319+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.776388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":434,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540986+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:15:58.540986+0000","last_peered":"2024-09-21T06:15:58.540986+0000","last_clean":"2024-09-21T06:15:58.540986+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:15:58.540986+0000","last_undegraded":"2024-09-21T06:15:58.540986+0000","last_fullsized":"2024-09-21T06:15:58.540986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574997,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":973,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194338,"statfs":{"total":200000000,"available":199002722,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574997,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193762,"statfs":{"total":200000000,"available":198412388,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193759,"statfs":{"total":200000000,"available":198410034,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199009034,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574997,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":969,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194343,"statfs":{"total":200000000,"available":199007374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199009022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:16:01.966 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 -- 172.21.15.118:0/1669225751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fae0 msgr2=0x7f6ae40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 --2- 172.21.15.118:0/1669225751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fae0 0x7f6ae40d0e80 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40ce7c0 tx=0x7f6ad402a820 comp rx=0 tx=0).stop 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 -- 172.21.15.118:0/1669225751 shutdown_connections 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 --2- 172.21.15.118:0/1669225751 >> v2:172.21.15.149:3300/0 conn(0x7f6ae4142e40 0x7f6ae40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 --2- 172.21.15.118:0/1669225751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fae0 0x7f6ae40d0e80 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 -- 172.21.15.118:0/1669225751 >> 172.21.15.118:0/1669225751 conn(0x7f6ae406d110 msgr2=0x7f6ae406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 -- 172.21.15.118:0/1669225751 shutdown_connections 2024-09-21T06:16:02.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.223+0000 7f6ae9400640 1 -- 172.21.15.118:0/1669225751 wait complete. 2024-09-21T06:16:02.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.225+0000 7f6ae9400640 1 Processor -- start 2024-09-21T06:16:02.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.226+0000 7f6ae9400640 1 -- start start 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ae413fae0 0x7f6ae4141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fef0 0x7f6ae41f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ae4142e40 0x7f6ae413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae9400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40cfa20 con 0x7f6ae413fef0 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae9400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40cf8a0 con 0x7f6ae413fae0 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae40cfba0 con 0x7f6ae4142e40 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fef0 0x7f6ae41f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fef0 0x7f6ae41f2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50878/0 (socket says 172.21.15.118:50878) 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.227+0000 7f6ae1e00640 1 -- 172.21.15.118:0/3261559813 learned_addr learned my addr 172.21.15.118:0/3261559813 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:02.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae3200640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ae4142e40 0x7f6ae413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae2800640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ae413fae0 0x7f6ae4141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae1e00640 1 -- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ae4142e40 msgr2=0x7f6ae413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae1e00640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ae4142e40 0x7f6ae413e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae1e00640 1 -- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ae413fae0 msgr2=0x7f6ae4141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae1e00640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ae413fae0 0x7f6ae4141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae1e00640 1 -- 172.21.15.118:0/3261559813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae41f7050 con 0x7f6ae413fef0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae2800640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ae413fae0 0x7f6ae4141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae1e00640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fef0 0x7f6ae41f2db0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c3f0 tx=0x7f6ad000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6adaa00640 1 -- 172.21.15.118:0/3261559813 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0017070 con 0x7f6ae413fef0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6adaa00640 1 -- 172.21.15.118:0/3261559813 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ad00035f0 con 0x7f6ae413fef0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae41f7330 con 0x7f6ae413fef0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.228+0000 7f6adaa00640 1 -- 172.21.15.118:0/3261559813 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0003a40 con 0x7f6ae413fef0 2024-09-21T06:16:02.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.229+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae41f78f0 con 0x7f6ae413fef0 2024-09-21T06:16:02.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.230+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae40d00c0 con 0x7f6ae413fef0 2024-09-21T06:16:02.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.231+0000 7f6adaa00640 1 -- 172.21.15.118:0/3261559813 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ad001a070 con 0x7f6ae413fef0 2024-09-21T06:16:02.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.232+0000 7f6adaa00640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ac4078bc0 0x7f6ac407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.232+0000 7f6adaa00640 1 -- 172.21.15.118:0/3261559813 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f6ad009a0c0 con 0x7f6ae413fef0 2024-09-21T06:16:02.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.232+0000 7f6ae2800640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ac4078bc0 0x7f6ac407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.233+0000 7f6ae2800640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ac4078bc0 0x7f6ac407b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4034000 tx=0x7f6ad4004ab0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:02.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.236+0000 7f6adaa00640 1 -- 172.21.15.118:0/3261559813 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6ad0062500 con 0x7f6ae413fef0 2024-09-21T06:16:02.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.417+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ae406dd00 con 0x7f6ac4078bc0 2024-09-21T06:16:02.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.421+0000 7f6adaa00640 1 -- 172.21.15.118:0/3261559813 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247977 (secure 0 0 0) 0x7f6ae406dd00 con 0x7f6ac4078bc0 2024-09-21T06:16:02.425 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:02.427 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:16:02.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.425+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ac4078bc0 msgr2=0x7f6ac407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.425+0000 7f6ae9400640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ac4078bc0 0x7f6ac407b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4034000 tx=0x7f6ad4004ab0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.425+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fef0 msgr2=0x7f6ae41f2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.425+0000 7f6ae9400640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fef0 0x7f6ae41f2db0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c3f0 tx=0x7f6ad000c8b0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 shutdown_connections 2024-09-21T06:16:02.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6ac4078bc0 0x7f6ac407b0d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ae4142e40 0x7f6ae413e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ae413fef0 0x7f6ae41f2db0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 --2- 172.21.15.118:0/3261559813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ae413fae0 0x7f6ae4141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 >> 172.21.15.118:0/3261559813 conn(0x7f6ae406d110 msgr2=0x7f6ae4142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:02.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 shutdown_connections 2024-09-21T06:16:02.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.426+0000 7f6ae9400640 1 -- 172.21.15.118:0/3261559813 wait complete. 2024-09-21T06:16:02.450 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2024-09-21T06:16:00.656161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8917,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553582,"statfs":{"total":1600000000,"available":1590867992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.144319"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541430+0000","last_change":"2024-09-21T06:15:57.553114+0000","last_active":"2024-09-21T06:15:58.541430+0000","last_peered":"2024-09-21T06:15:58.541430+0000","last_clean":"2024-09-21T06:15:58.541430+0000","last_became_active":"2024-09-21T06:15:57.550765+0000","last_became_peered":"2024-09-21T06:15:57.550765+0000","last_unstale":"2024-09-21T06:15:58.541430+0000","last_undegraded":"2024-09-21T06:15:58.541430+0000","last_fullsized":"2024-09-21T06:15:58.541430+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:28.404748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541503+0000","last_change":"2024-09-21T06:15:57.548219+0000","last_active":"2024-09-21T06:15:58.541503+0000","last_peered":"2024-09-21T06:15:58.541503+0000","last_clean":"2024-09-21T06:15:58.541503+0000","last_became_active":"2024-09-21T06:15:57.547328+0000","last_became_peered":"2024-09-21T06:15:57.547328+0000","last_unstale":"2024-09-21T06:15:58.541503+0000","last_undegraded":"2024-09-21T06:15:58.541503+0000","last_fullsized":"2024-09-21T06:15:58.541503+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:06.744107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554882+0000","last_change":"2024-09-21T06:15:57.549040+0000","last_active":"2024-09-21T06:15:58.554882+0000","last_peered":"2024-09-21T06:15:58.554882+0000","last_clean":"2024-09-21T06:15:58.554882+0000","last_became_active":"2024-09-21T06:15:57.548760+0000","last_became_peered":"2024-09-21T06:15:57.548760+0000","last_unstale":"2024-09-21T06:15:58.554882+0000","last_undegraded":"2024-09-21T06:15:58.554882+0000","last_fullsized":"2024-09-21T06:15:58.554882+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:53.747442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.537551+0000","last_change":"2024-09-21T06:15:57.537323+0000","last_active":"2024-09-21T06:15:57.537551+0000","last_peered":"2024-09-21T06:15:57.537551+0000","last_clean":"2024-09-21T06:15:57.537551+0000","last_became_active":"2024-09-21T06:15:57.536879+0000","last_became_peered":"2024-09-21T06:15:57.536879+0000","last_unstale":"2024-09-21T06:15:57.537551+0000","last_undegraded":"2024-09-21T06:15:57.537551+0000","last_fullsized":"2024-09-21T06:15:57.537551+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:13.488875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.542004+0000","last_change":"2024-09-21T06:15:57.546845+0000","last_active":"2024-09-21T06:15:58.542004+0000","last_peered":"2024-09-21T06:15:58.542004+0000","last_clean":"2024-09-21T06:15:58.542004+0000","last_became_active":"2024-09-21T06:15:57.545124+0000","last_became_peered":"2024-09-21T06:15:57.545124+0000","last_unstale":"2024-09-21T06:15:58.542004+0000","last_undegraded":"2024-09-21T06:15:58.542004+0000","last_fullsized":"2024-09-21T06:15:58.542004+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:14.362816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542410+0000","last_change":"2024-09-21T06:15:57.541849+0000","last_active":"2024-09-21T06:15:57.542410+0000","last_peered":"2024-09-21T06:15:57.542410+0000","last_clean":"2024-09-21T06:15:57.542410+0000","last_became_active":"2024-09-21T06:15:57.541006+0000","last_became_peered":"2024-09-21T06:15:57.541006+0000","last_unstale":"2024-09-21T06:15:57.542410+0000","last_undegraded":"2024-09-21T06:15:57.542410+0000","last_fullsized":"2024-09-21T06:15:57.542410+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:22.178672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540326+0000","last_change":"2024-09-21T06:15:57.547576+0000","last_active":"2024-09-21T06:15:58.540326+0000","last_peered":"2024-09-21T06:15:58.540326+0000","last_clean":"2024-09-21T06:15:58.540326+0000","last_became_active":"2024-09-21T06:15:57.547143+0000","last_became_peered":"2024-09-21T06:15:57.547143+0000","last_unstale":"2024-09-21T06:15:58.540326+0000","last_undegraded":"2024-09-21T06:15:58.540326+0000","last_fullsized":"2024-09-21T06:15:58.540326+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:27.040084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540602+0000","last_change":"2024-09-21T06:15:57.550146+0000","last_active":"2024-09-21T06:15:58.540602+0000","last_peered":"2024-09-21T06:15:58.540602+0000","last_clean":"2024-09-21T06:15:58.540602+0000","last_became_active":"2024-09-21T06:15:57.549882+0000","last_became_peered":"2024-09-21T06:15:57.549882+0000","last_unstale":"2024-09-21T06:15:58.540602+0000","last_undegraded":"2024-09-21T06:15:58.540602+0000","last_fullsized":"2024-09-21T06:15:58.540602+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:10.467673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541013+0000","last_change":"2024-09-21T06:15:57.545517+0000","last_active":"2024-09-21T06:15:58.541013+0000","last_peered":"2024-09-21T06:15:58.541013+0000","last_clean":"2024-09-21T06:15:58.541013+0000","last_became_active":"2024-09-21T06:15:57.545217+0000","last_became_peered":"2024-09-21T06:15:57.545217+0000","last_unstale":"2024-09-21T06:15:58.541013+0000","last_undegraded":"2024-09-21T06:15:58.541013+0000","last_fullsized":"2024-09-21T06:15:58.541013+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:14.765993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.542211+0000","last_change":"2024-09-21T06:15:57.535594+0000","last_active":"2024-09-21T06:15:58.542211+0000","last_peered":"2024-09-21T06:15:58.542211+0000","last_clean":"2024-09-21T06:15:58.542211+0000","last_became_active":"2024-09-21T06:15:57.535385+0000","last_became_peered":"2024-09-21T06:15:57.535385+0000","last_unstale":"2024-09-21T06:15:58.542211+0000","last_undegraded":"2024-09-21T06:15:58.542211+0000","last_fullsized":"2024-09-21T06:15:58.542211+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:10.450919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541575+0000","last_change":"2024-09-21T06:15:57.550900+0000","last_active":"2024-09-21T06:15:58.541575+0000","last_peered":"2024-09-21T06:15:58.541575+0000","last_clean":"2024-09-21T06:15:58.541575+0000","last_became_active":"2024-09-21T06:15:57.548105+0000","last_became_peered":"2024-09-21T06:15:57.548105+0000","last_unstale":"2024-09-21T06:15:58.541575+0000","last_undegraded":"2024-09-21T06:15:58.541575+0000","last_fullsized":"2024-09-21T06:15:58.541575+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:53.415825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541749+0000","last_change":"2024-09-21T06:15:57.547948+0000","last_active":"2024-09-21T06:15:58.541749+0000","last_peered":"2024-09-21T06:15:58.541749+0000","last_clean":"2024-09-21T06:15:58.541749+0000","last_became_active":"2024-09-21T06:15:57.547011+0000","last_became_peered":"2024-09-21T06:15:57.547011+0000","last_unstale":"2024-09-21T06:15:58.541749+0000","last_undegraded":"2024-09-21T06:15:58.541749+0000","last_fullsized":"2024-09-21T06:15:58.541749+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:52:40.364420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554304+0000","last_change":"2024-09-21T06:15:57.544433+0000","last_active":"2024-09-21T06:15:58.554304+0000","last_peered":"2024-09-21T06:15:58.554304+0000","last_clean":"2024-09-21T06:15:58.554304+0000","last_became_active":"2024-09-21T06:15:57.544155+0000","last_became_peered":"2024-09-21T06:15:57.544155+0000","last_unstale":"2024-09-21T06:15:58.554304+0000","last_undegraded":"2024-09-21T06:15:58.554304+0000","last_fullsized":"2024-09-21T06:15:58.554304+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:04.158560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554224+0000","last_change":"2024-09-21T06:15:57.547230+0000","last_active":"2024-09-21T06:15:58.554224+0000","last_peered":"2024-09-21T06:15:58.554224+0000","last_clean":"2024-09-21T06:15:58.554224+0000","last_became_active":"2024-09-21T06:15:57.546939+0000","last_became_peered":"2024-09-21T06:15:57.546939+0000","last_unstale":"2024-09-21T06:15:58.554224+0000","last_undegraded":"2024-09-21T06:15:58.554224+0000","last_fullsized":"2024-09-21T06:15:58.554224+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:52:58.470007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541606+0000","last_change":"2024-09-21T06:15:57.550130+0000","last_active":"2024-09-21T06:15:58.541606+0000","last_peered":"2024-09-21T06:15:58.541606+0000","last_clean":"2024-09-21T06:15:58.541606+0000","last_became_active":"2024-09-21T06:15:57.544776+0000","last_became_peered":"2024-09-21T06:15:57.544776+0000","last_unstale":"2024-09-21T06:15:58.541606+0000","last_undegraded":"2024-09-21T06:15:58.541606+0000","last_fullsized":"2024-09-21T06:15:58.541606+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:33.467399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540422+0000","last_change":"2024-09-21T06:15:57.553682+0000","last_active":"2024-09-21T06:15:58.540422+0000","last_peered":"2024-09-21T06:15:58.540422+0000","last_clean":"2024-09-21T06:15:58.540422+0000","last_became_active":"2024-09-21T06:15:57.553425+0000","last_became_peered":"2024-09-21T06:15:57.553425+0000","last_unstale":"2024-09-21T06:15:58.540422+0000","last_undegraded":"2024-09-21T06:15:58.540422+0000","last_fullsized":"2024-09-21T06:15:58.540422+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:17.144984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.552169+0000","last_change":"2024-09-21T06:15:57.551846+0000","last_active":"2024-09-21T06:15:57.552169+0000","last_peered":"2024-09-21T06:15:57.552169+0000","last_clean":"2024-09-21T06:15:57.552169+0000","last_became_active":"2024-09-21T06:15:57.551589+0000","last_became_peered":"2024-09-21T06:15:57.551589+0000","last_unstale":"2024-09-21T06:15:57.552169+0000","last_undegraded":"2024-09-21T06:15:57.552169+0000","last_fullsized":"2024-09-21T06:15:57.552169+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:25.681982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538338+0000","last_change":"2024-09-21T06:15:57.543554+0000","last_active":"2024-09-21T06:15:58.538338+0000","last_peered":"2024-09-21T06:15:58.538338+0000","last_clean":"2024-09-21T06:15:58.538338+0000","last_became_active":"2024-09-21T06:15:57.543262+0000","last_became_peered":"2024-09-21T06:15:57.543262+0000","last_unstale":"2024-09-21T06:15:58.538338+0000","last_undegraded":"2024-09-21T06:15:58.538338+0000","last_fullsized":"2024-09-21T06:15:58.538338+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:44.972096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.553931+0000","last_change":"2024-09-21T06:15:57.553618+0000","last_active":"2024-09-21T06:15:57.553931+0000","last_peered":"2024-09-21T06:15:57.553931+0000","last_clean":"2024-09-21T06:15:57.553931+0000","last_became_active":"2024-09-21T06:15:57.553327+0000","last_became_peered":"2024-09-21T06:15:57.553327+0000","last_unstale":"2024-09-21T06:15:57.553931+0000","last_undegraded":"2024-09-21T06:15:57.553931+0000","last_fullsized":"2024-09-21T06:15:57.553931+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:10.917958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554331+0000","last_change":"2024-09-21T06:15:57.554717+0000","last_active":"2024-09-21T06:15:58.554331+0000","last_peered":"2024-09-21T06:15:58.554331+0000","last_clean":"2024-09-21T06:15:58.554331+0000","last_became_active":"2024-09-21T06:15:57.551773+0000","last_became_peered":"2024-09-21T06:15:57.551773+0000","last_unstale":"2024-09-21T06:15:58.554331+0000","last_undegraded":"2024-09-21T06:15:58.554331+0000","last_fullsized":"2024-09-21T06:15:58.554331+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:18.186133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.553190+0000","last_change":"2024-09-21T06:15:57.552402+0000","last_active":"2024-09-21T06:15:57.553190+0000","last_peered":"2024-09-21T06:15:57.553190+0000","last_clean":"2024-09-21T06:15:57.553190+0000","last_became_active":"2024-09-21T06:15:57.551913+0000","last_became_peered":"2024-09-21T06:15:57.551913+0000","last_unstale":"2024-09-21T06:15:57.553190+0000","last_undegraded":"2024-09-21T06:15:57.553190+0000","last_fullsized":"2024-09-21T06:15:57.553190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:25.140031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541966+0000","last_change":"2024-09-21T06:15:57.547666+0000","last_active":"2024-09-21T06:15:58.541966+0000","last_peered":"2024-09-21T06:15:58.541966+0000","last_clean":"2024-09-21T06:15:58.541966+0000","last_became_active":"2024-09-21T06:15:57.546648+0000","last_became_peered":"2024-09-21T06:15:57.546648+0000","last_unstale":"2024-09-21T06:15:58.541966+0000","last_undegraded":"2024-09-21T06:15:58.541966+0000","last_fullsized":"2024-09-21T06:15:58.541966+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:25.592496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542380+0000","last_change":"2024-09-21T06:15:57.541704+0000","last_active":"2024-09-21T06:15:57.542380+0000","last_peered":"2024-09-21T06:15:57.542380+0000","last_clean":"2024-09-21T06:15:57.542380+0000","last_became_active":"2024-09-21T06:15:57.541046+0000","last_became_peered":"2024-09-21T06:15:57.541046+0000","last_unstale":"2024-09-21T06:15:57.542380+0000","last_undegraded":"2024-09-21T06:15:57.542380+0000","last_fullsized":"2024-09-21T06:15:57.542380+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:44.134998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540641+0000","last_change":"2024-09-21T06:15:57.541675+0000","last_active":"2024-09-21T06:15:58.540641+0000","last_peered":"2024-09-21T06:15:58.540641+0000","last_clean":"2024-09-21T06:15:58.540641+0000","last_became_active":"2024-09-21T06:15:57.541317+0000","last_became_peered":"2024-09-21T06:15:57.541317+0000","last_unstale":"2024-09-21T06:15:58.540641+0000","last_undegraded":"2024-09-21T06:15:58.540641+0000","last_fullsized":"2024-09-21T06:15:58.540641+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.509354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554590+0000","last_change":"2024-09-21T06:15:57.545462+0000","last_active":"2024-09-21T06:15:58.554590+0000","last_peered":"2024-09-21T06:15:58.554590+0000","last_clean":"2024-09-21T06:15:58.554590+0000","last_became_active":"2024-09-21T06:15:57.545176+0000","last_became_peered":"2024-09-21T06:15:57.545176+0000","last_unstale":"2024-09-21T06:15:58.554590+0000","last_undegraded":"2024-09-21T06:15:58.554590+0000","last_fullsized":"2024-09-21T06:15:58.554590+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:10.644762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540299+0000","last_change":"2024-09-21T06:15:57.549882+0000","last_active":"2024-09-21T06:15:58.540299+0000","last_peered":"2024-09-21T06:15:58.540299+0000","last_clean":"2024-09-21T06:15:58.540299+0000","last_became_active":"2024-09-21T06:15:57.549614+0000","last_became_peered":"2024-09-21T06:15:57.549614+0000","last_unstale":"2024-09-21T06:15:58.540299+0000","last_undegraded":"2024-09-21T06:15:58.540299+0000","last_fullsized":"2024-09-21T06:15:58.540299+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:37.321346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554271+0000","last_change":"2024-09-21T06:15:57.550219+0000","last_active":"2024-09-21T06:15:58.554271+0000","last_peered":"2024-09-21T06:15:58.554271+0000","last_clean":"2024-09-21T06:15:58.554271+0000","last_became_active":"2024-09-21T06:15:57.549838+0000","last_became_peered":"2024-09-21T06:15:57.549838+0000","last_unstale":"2024-09-21T06:15:58.554271+0000","last_undegraded":"2024-09-21T06:15:58.554271+0000","last_fullsized":"2024-09-21T06:15:58.554271+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:02.168113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.553838+0000","last_change":"2024-09-21T06:15:57.553145+0000","last_active":"2024-09-21T06:15:57.553838+0000","last_peered":"2024-09-21T06:15:57.553838+0000","last_clean":"2024-09-21T06:15:57.553838+0000","last_became_active":"2024-09-21T06:15:57.552894+0000","last_became_peered":"2024-09-21T06:15:57.552894+0000","last_unstale":"2024-09-21T06:15:57.553838+0000","last_undegraded":"2024-09-21T06:15:57.553838+0000","last_fullsized":"2024-09-21T06:15:57.553838+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:07.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554508+0000","last_change":"2024-09-21T06:15:57.550594+0000","last_active":"2024-09-21T06:15:58.554508+0000","last_peered":"2024-09-21T06:15:58.554508+0000","last_clean":"2024-09-21T06:15:58.554508+0000","last_became_active":"2024-09-21T06:15:57.549762+0000","last_became_peered":"2024-09-21T06:15:57.549762+0000","last_unstale":"2024-09-21T06:15:58.554508+0000","last_undegraded":"2024-09-21T06:15:58.554508+0000","last_fullsized":"2024-09-21T06:15:58.554508+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:57.174298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539916+0000","last_change":"2024-09-21T06:15:57.556211+0000","last_active":"2024-09-21T06:15:58.539916+0000","last_peered":"2024-09-21T06:15:58.539916+0000","last_clean":"2024-09-21T06:15:58.539916+0000","last_became_active":"2024-09-21T06:15:57.555265+0000","last_became_peered":"2024-09-21T06:15:57.555265+0000","last_unstale":"2024-09-21T06:15:58.539916+0000","last_undegraded":"2024-09-21T06:15:58.539916+0000","last_fullsized":"2024-09-21T06:15:58.539916+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:15.955556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539817+0000","last_change":"2024-09-21T06:15:57.551706+0000","last_active":"2024-09-21T06:15:58.539817+0000","last_peered":"2024-09-21T06:15:58.539817+0000","last_clean":"2024-09-21T06:15:58.539817+0000","last_became_active":"2024-09-21T06:15:57.551299+0000","last_became_peered":"2024-09-21T06:15:57.551299+0000","last_unstale":"2024-09-21T06:15:58.539817+0000","last_undegraded":"2024-09-21T06:15:58.539817+0000","last_fullsized":"2024-09-21T06:15:58.539817+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:35.252569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538056+0000","last_change":"2024-09-21T06:15:57.547382+0000","last_active":"2024-09-21T06:15:58.538056+0000","last_peered":"2024-09-21T06:15:58.538056+0000","last_clean":"2024-09-21T06:15:58.538056+0000","last_became_active":"2024-09-21T06:15:57.545022+0000","last_became_peered":"2024-09-21T06:15:57.545022+0000","last_unstale":"2024-09-21T06:15:58.538056+0000","last_undegraded":"2024-09-21T06:15:58.538056+0000","last_fullsized":"2024-09-21T06:15:58.538056+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:03.269295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539654+0000","last_change":"2024-09-21T06:15:57.548463+0000","last_active":"2024-09-21T06:15:58.539654+0000","last_peered":"2024-09-21T06:15:58.539654+0000","last_clean":"2024-09-21T06:15:58.539654+0000","last_became_active":"2024-09-21T06:15:57.548087+0000","last_became_peered":"2024-09-21T06:15:57.548087+0000","last_unstale":"2024-09-21T06:15:58.539654+0000","last_undegraded":"2024-09-21T06:15:58.539654+0000","last_fullsized":"2024-09-21T06:15:58.539654+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:05.005275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"176'4","reported_seq":19,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540790+0000","last_change":"2024-09-21T06:15:56.530174+0000","last_active":"2024-09-21T06:15:58.540790+0000","last_peered":"2024-09-21T06:15:58.540790+0000","last_clean":"2024-09-21T06:15:58.540790+0000","last_became_active":"2024-09-21T06:15:56.529406+0000","last_became_peered":"2024-09-21T06:15:56.529406+0000","last_unstale":"2024-09-21T06:15:58.540790+0000","last_undegraded":"2024-09-21T06:15:58.540790+0000","last_fullsized":"2024-09-21T06:15:58.540790+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:03.724641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539506+0000","last_change":"2024-09-21T06:15:57.552480+0000","last_active":"2024-09-21T06:15:58.539506+0000","last_peered":"2024-09-21T06:15:58.539506+0000","last_clean":"2024-09-21T06:15:58.539506+0000","last_became_active":"2024-09-21T06:15:57.552212+0000","last_became_peered":"2024-09-21T06:15:57.552212+0000","last_unstale":"2024-09-21T06:15:58.539506+0000","last_undegraded":"2024-09-21T06:15:58.539506+0000","last_fullsized":"2024-09-21T06:15:58.539506+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.706183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539179+0000","last_change":"2024-09-21T06:15:56.534933+0000","last_active":"2024-09-21T06:15:58.539179+0000","last_peered":"2024-09-21T06:15:58.539179+0000","last_clean":"2024-09-21T06:15:58.539179+0000","last_became_active":"2024-09-21T06:15:56.534661+0000","last_became_peered":"2024-09-21T06:15:56.534661+0000","last_unstale":"2024-09-21T06:15:58.539179+0000","last_undegraded":"2024-09-21T06:15:58.539179+0000","last_fullsized":"2024-09-21T06:15:58.539179+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:11.987634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.551583+0000","last_change":"2024-09-21T06:15:57.551248+0000","last_active":"2024-09-21T06:15:57.551583+0000","last_peered":"2024-09-21T06:15:57.551583+0000","last_clean":"2024-09-21T06:15:57.551583+0000","last_became_active":"2024-09-21T06:15:57.550985+0000","last_became_peered":"2024-09-21T06:15:57.550985+0000","last_unstale":"2024-09-21T06:15:57.551583+0000","last_undegraded":"2024-09-21T06:15:57.551583+0000","last_fullsized":"2024-09-21T06:15:57.551583+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:43.099341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.561034+0000","last_change":"2024-09-21T06:15:56.534033+0000","last_active":"2024-09-21T06:15:57.561034+0000","last_peered":"2024-09-21T06:15:57.561034+0000","last_clean":"2024-09-21T06:15:57.561034+0000","last_became_active":"2024-09-21T06:15:56.533782+0000","last_became_peered":"2024-09-21T06:15:56.533782+0000","last_unstale":"2024-09-21T06:15:57.561034+0000","last_undegraded":"2024-09-21T06:15:57.561034+0000","last_fullsized":"2024-09-21T06:15:57.561034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:49.992850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554809+0000","last_change":"2024-09-21T06:15:57.552074+0000","last_active":"2024-09-21T06:15:58.554809+0000","last_peered":"2024-09-21T06:15:58.554809+0000","last_clean":"2024-09-21T06:15:58.554809+0000","last_became_active":"2024-09-21T06:15:57.551346+0000","last_became_peered":"2024-09-21T06:15:57.551346+0000","last_unstale":"2024-09-21T06:15:58.554809+0000","last_undegraded":"2024-09-21T06:15:58.554809+0000","last_fullsized":"2024-09-21T06:15:58.554809+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:50.048208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560313+0000","last_change":"2024-09-21T06:15:56.522271+0000","last_active":"2024-09-21T06:15:57.560313+0000","last_peered":"2024-09-21T06:15:57.560313+0000","last_clean":"2024-09-21T06:15:57.560313+0000","last_became_active":"2024-09-21T06:15:56.521982+0000","last_became_peered":"2024-09-21T06:15:56.521982+0000","last_unstale":"2024-09-21T06:15:57.560313+0000","last_undegraded":"2024-09-21T06:15:57.560313+0000","last_fullsized":"2024-09-21T06:15:57.560313+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:38.809148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539764+0000","last_change":"2024-09-21T06:15:57.545193+0000","last_active":"2024-09-21T06:15:58.539764+0000","last_peered":"2024-09-21T06:15:58.539764+0000","last_clean":"2024-09-21T06:15:58.539764+0000","last_became_active":"2024-09-21T06:15:57.544957+0000","last_became_peered":"2024-09-21T06:15:57.544957+0000","last_unstale":"2024-09-21T06:15:58.539764+0000","last_undegraded":"2024-09-21T06:15:58.539764+0000","last_fullsized":"2024-09-21T06:15:58.539764+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:53.673472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554741+0000","last_change":"2024-09-21T06:15:56.530309+0000","last_active":"2024-09-21T06:15:58.554741+0000","last_peered":"2024-09-21T06:15:58.554741+0000","last_clean":"2024-09-21T06:15:58.554741+0000","last_became_active":"2024-09-21T06:15:56.529915+0000","last_became_peered":"2024-09-21T06:15:56.529915+0000","last_unstale":"2024-09-21T06:15:58.554741+0000","last_undegraded":"2024-09-21T06:15:58.554741+0000","last_fullsized":"2024-09-21T06:15:58.554741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:09.354400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.548649+0000","last_change":"2024-09-21T06:15:57.548451+0000","last_active":"2024-09-21T06:15:57.548649+0000","last_peered":"2024-09-21T06:15:57.548649+0000","last_clean":"2024-09-21T06:15:57.548649+0000","last_became_active":"2024-09-21T06:15:57.547901+0000","last_became_peered":"2024-09-21T06:15:57.547901+0000","last_unstale":"2024-09-21T06:15:57.548649+0000","last_undegraded":"2024-09-21T06:15:57.548649+0000","last_fullsized":"2024-09-21T06:15:57.548649+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:17.990689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560722+0000","last_change":"2024-09-21T06:15:56.525638+0000","last_active":"2024-09-21T06:15:57.560722+0000","last_peered":"2024-09-21T06:15:57.560722+0000","last_clean":"2024-09-21T06:15:57.560722+0000","last_became_active":"2024-09-21T06:15:56.525352+0000","last_became_peered":"2024-09-21T06:15:56.525352+0000","last_unstale":"2024-09-21T06:15:57.560722+0000","last_undegraded":"2024-09-21T06:15:57.560722+0000","last_fullsized":"2024-09-21T06:15:57.560722+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:05.738652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.545630+0000","last_change":"2024-09-21T06:15:57.543427+0000","last_active":"2024-09-21T06:15:57.545630+0000","last_peered":"2024-09-21T06:15:57.545630+0000","last_clean":"2024-09-21T06:15:57.545630+0000","last_became_active":"2024-09-21T06:15:57.542402+0000","last_became_peered":"2024-09-21T06:15:57.542402+0000","last_unstale":"2024-09-21T06:15:57.545630+0000","last_undegraded":"2024-09-21T06:15:57.545630+0000","last_fullsized":"2024-09-21T06:15:57.545630+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:23.694382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540778+0000","last_change":"2024-09-21T06:15:56.534310+0000","last_active":"2024-09-21T06:15:58.540778+0000","last_peered":"2024-09-21T06:15:58.540778+0000","last_clean":"2024-09-21T06:15:58.540778+0000","last_became_active":"2024-09-21T06:15:56.533559+0000","last_became_peered":"2024-09-21T06:15:56.533559+0000","last_unstale":"2024-09-21T06:15:58.540778+0000","last_undegraded":"2024-09-21T06:15:58.540778+0000","last_fullsized":"2024-09-21T06:15:58.540778+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:24.812783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542451+0000","last_change":"2024-09-21T06:15:57.542258+0000","last_active":"2024-09-21T06:15:57.542451+0000","last_peered":"2024-09-21T06:15:57.542451+0000","last_clean":"2024-09-21T06:15:57.542451+0000","last_became_active":"2024-09-21T06:15:57.541932+0000","last_became_peered":"2024-09-21T06:15:57.541932+0000","last_unstale":"2024-09-21T06:15:57.542451+0000","last_undegraded":"2024-09-21T06:15:57.542451+0000","last_fullsized":"2024-09-21T06:15:57.542451+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:45.985529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540331+0000","last_change":"2024-09-21T06:15:56.527196+0000","last_active":"2024-09-21T06:15:58.540331+0000","last_peered":"2024-09-21T06:15:58.540331+0000","last_clean":"2024-09-21T06:15:58.540331+0000","last_became_active":"2024-09-21T06:15:56.526923+0000","last_became_peered":"2024-09-21T06:15:56.526923+0000","last_unstale":"2024-09-21T06:15:58.540331+0000","last_undegraded":"2024-09-21T06:15:58.540331+0000","last_fullsized":"2024-09-21T06:15:58.540331+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:01.533862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538341+0000","last_change":"2024-09-21T06:15:57.536897+0000","last_active":"2024-09-21T06:15:58.538341+0000","last_peered":"2024-09-21T06:15:58.538341+0000","last_clean":"2024-09-21T06:15:58.538341+0000","last_became_active":"2024-09-21T06:15:57.536234+0000","last_became_peered":"2024-09-21T06:15:57.536234+0000","last_unstale":"2024-09-21T06:15:58.538341+0000","last_undegraded":"2024-09-21T06:15:58.538341+0000","last_fullsized":"2024-09-21T06:15:58.538341+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:47.782508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.542764+0000","last_change":"2024-09-21T06:15:56.527194+0000","last_active":"2024-09-21T06:15:57.542764+0000","last_peered":"2024-09-21T06:15:57.542764+0000","last_clean":"2024-09-21T06:15:57.542764+0000","last_became_active":"2024-09-21T06:15:56.526934+0000","last_became_peered":"2024-09-21T06:15:56.526934+0000","last_unstale":"2024-09-21T06:15:57.542764+0000","last_undegraded":"2024-09-21T06:15:57.542764+0000","last_fullsized":"2024-09-21T06:15:57.542764+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:26.868839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538736+0000","last_change":"2024-09-21T06:15:57.536488+0000","last_active":"2024-09-21T06:15:58.538736+0000","last_peered":"2024-09-21T06:15:58.538736+0000","last_clean":"2024-09-21T06:15:58.538736+0000","last_became_active":"2024-09-21T06:15:57.536121+0000","last_became_peered":"2024-09-21T06:15:57.536121+0000","last_unstale":"2024-09-21T06:15:58.538736+0000","last_undegraded":"2024-09-21T06:15:58.538736+0000","last_fullsized":"2024-09-21T06:15:58.538736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:30.840827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"176'3","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560062+0000","last_change":"2024-09-21T06:15:56.529494+0000","last_active":"2024-09-21T06:15:57.560062+0000","last_peered":"2024-09-21T06:15:57.560062+0000","last_clean":"2024-09-21T06:15:57.560062+0000","last_became_active":"2024-09-21T06:15:56.529129+0000","last_became_peered":"2024-09-21T06:15:56.529129+0000","last_unstale":"2024-09-21T06:15:57.560062+0000","last_undegraded":"2024-09-21T06:15:57.560062+0000","last_fullsized":"2024-09-21T06:15:57.560062+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:55.070444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539762+0000","last_change":"2024-09-21T06:15:57.549040+0000","last_active":"2024-09-21T06:15:58.539762+0000","last_peered":"2024-09-21T06:15:58.539762+0000","last_clean":"2024-09-21T06:15:58.539762+0000","last_became_active":"2024-09-21T06:15:57.548777+0000","last_became_peered":"2024-09-21T06:15:57.548777+0000","last_unstale":"2024-09-21T06:15:58.539762+0000","last_undegraded":"2024-09-21T06:15:58.539762+0000","last_fullsized":"2024-09-21T06:15:58.539762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:14.881846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"176'6","reported_seq":21,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539306+0000","last_change":"2024-09-21T06:15:56.529141+0000","last_active":"2024-09-21T06:15:58.539306+0000","last_peered":"2024-09-21T06:15:58.539306+0000","last_clean":"2024-09-21T06:15:58.539306+0000","last_became_active":"2024-09-21T06:15:56.528849+0000","last_became_peered":"2024-09-21T06:15:56.528849+0000","last_unstale":"2024-09-21T06:15:58.539306+0000","last_undegraded":"2024-09-21T06:15:58.539306+0000","last_fullsized":"2024-09-21T06:15:58.539306+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:13.005328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538575+0000","last_change":"2024-09-21T06:15:57.536568+0000","last_active":"2024-09-21T06:15:58.538575+0000","last_peered":"2024-09-21T06:15:58.538575+0000","last_clean":"2024-09-21T06:15:58.538575+0000","last_became_active":"2024-09-21T06:15:57.535142+0000","last_became_peered":"2024-09-21T06:15:57.535142+0000","last_unstale":"2024-09-21T06:15:58.538575+0000","last_undegraded":"2024-09-21T06:15:58.538575+0000","last_fullsized":"2024-09-21T06:15:58.538575+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:07.658486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560901+0000","last_change":"2024-09-21T06:15:56.524862+0000","last_active":"2024-09-21T06:15:57.560901+0000","last_peered":"2024-09-21T06:15:57.560901+0000","last_clean":"2024-09-21T06:15:57.560901+0000","last_became_active":"2024-09-21T06:15:56.524338+0000","last_became_peered":"2024-09-21T06:15:56.524338+0000","last_unstale":"2024-09-21T06:15:57.560901+0000","last_undegraded":"2024-09-21T06:15:57.560901+0000","last_fullsized":"2024-09-21T06:15:57.560901+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:43.979524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540252+0000","last_change":"2024-09-21T06:15:57.547337+0000","last_active":"2024-09-21T06:15:58.540252+0000","last_peered":"2024-09-21T06:15:58.540252+0000","last_clean":"2024-09-21T06:15:58.540252+0000","last_became_active":"2024-09-21T06:15:57.547079+0000","last_became_peered":"2024-09-21T06:15:57.547079+0000","last_unstale":"2024-09-21T06:15:58.540252+0000","last_undegraded":"2024-09-21T06:15:58.540252+0000","last_fullsized":"2024-09-21T06:15:58.540252+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:13.098584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538743+0000","last_change":"2024-09-21T06:15:56.530924+0000","last_active":"2024-09-21T06:15:58.538743+0000","last_peered":"2024-09-21T06:15:58.538743+0000","last_clean":"2024-09-21T06:15:58.538743+0000","last_became_active":"2024-09-21T06:15:56.530356+0000","last_became_peered":"2024-09-21T06:15:56.530356+0000","last_unstale":"2024-09-21T06:15:58.538743+0000","last_undegraded":"2024-09-21T06:15:58.538743+0000","last_fullsized":"2024-09-21T06:15:58.538743+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:43.207159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.550272+0000","last_change":"2024-09-21T06:15:57.549941+0000","last_active":"2024-09-21T06:15:57.550272+0000","last_peered":"2024-09-21T06:15:57.550272+0000","last_clean":"2024-09-21T06:15:57.550272+0000","last_became_active":"2024-09-21T06:15:57.549693+0000","last_became_peered":"2024-09-21T06:15:57.549693+0000","last_unstale":"2024-09-21T06:15:57.550272+0000","last_undegraded":"2024-09-21T06:15:57.550272+0000","last_fullsized":"2024-09-21T06:15:57.550272+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:07.532608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.533947+0000","last_change":"2024-09-21T06:15:56.533889+0000","last_active":"2024-09-21T06:15:57.533947+0000","last_peered":"2024-09-21T06:15:57.533947+0000","last_clean":"2024-09-21T06:15:57.533947+0000","last_became_active":"2024-09-21T06:15:56.533609+0000","last_became_peered":"2024-09-21T06:15:56.533609+0000","last_unstale":"2024-09-21T06:15:57.533947+0000","last_undegraded":"2024-09-21T06:15:57.533947+0000","last_fullsized":"2024-09-21T06:15:57.533947+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:31.055780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554548+0000","last_change":"2024-09-21T06:15:57.548801+0000","last_active":"2024-09-21T06:15:58.554548+0000","last_peered":"2024-09-21T06:15:58.554548+0000","last_clean":"2024-09-21T06:15:58.554548+0000","last_became_active":"2024-09-21T06:15:57.548511+0000","last_became_peered":"2024-09-21T06:15:57.548511+0000","last_unstale":"2024-09-21T06:15:58.554548+0000","last_undegraded":"2024-09-21T06:15:58.554548+0000","last_fullsized":"2024-09-21T06:15:58.554548+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:38.134114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"176'8","reported_seq":23,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539913+0000","last_change":"2024-09-21T06:15:56.526976+0000","last_active":"2024-09-21T06:15:58.539913+0000","last_peered":"2024-09-21T06:15:58.539913+0000","last_clean":"2024-09-21T06:15:58.539913+0000","last_became_active":"2024-09-21T06:15:56.526679+0000","last_became_peered":"2024-09-21T06:15:56.526679+0000","last_unstale":"2024-09-21T06:15:58.539913+0000","last_undegraded":"2024-09-21T06:15:58.539913+0000","last_fullsized":"2024-09-21T06:15:58.539913+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:56.460623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.546592+0000","last_change":"2024-09-21T06:15:57.546323+0000","last_active":"2024-09-21T06:15:57.546592+0000","last_peered":"2024-09-21T06:15:57.546592+0000","last_clean":"2024-09-21T06:15:57.546592+0000","last_became_active":"2024-09-21T06:15:57.545954+0000","last_became_peered":"2024-09-21T06:15:57.545954+0000","last_unstale":"2024-09-21T06:15:57.546592+0000","last_undegraded":"2024-09-21T06:15:57.546592+0000","last_fullsized":"2024-09-21T06:15:57.546592+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:08.057702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554848+0000","last_change":"2024-09-21T06:15:56.535169+0000","last_active":"2024-09-21T06:15:58.554848+0000","last_peered":"2024-09-21T06:15:58.554848+0000","last_clean":"2024-09-21T06:15:58.554848+0000","last_became_active":"2024-09-21T06:15:56.534279+0000","last_became_peered":"2024-09-21T06:15:56.534279+0000","last_unstale":"2024-09-21T06:15:58.554848+0000","last_undegraded":"2024-09-21T06:15:58.554848+0000","last_fullsized":"2024-09-21T06:15:58.554848+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:33.627654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538097+0000","last_change":"2024-09-21T06:15:57.554073+0000","last_active":"2024-09-21T06:15:58.538097+0000","last_peered":"2024-09-21T06:15:58.538097+0000","last_clean":"2024-09-21T06:15:58.538097+0000","last_became_active":"2024-09-21T06:15:57.552959+0000","last_became_peered":"2024-09-21T06:15:57.552959+0000","last_unstale":"2024-09-21T06:15:58.538097+0000","last_undegraded":"2024-09-21T06:15:58.538097+0000","last_fullsized":"2024-09-21T06:15:58.538097+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:07:46.915215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"176'2","reported_seq":17,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554962+0000","last_change":"2024-09-21T06:15:56.525976+0000","last_active":"2024-09-21T06:15:58.554962+0000","last_peered":"2024-09-21T06:15:58.554962+0000","last_clean":"2024-09-21T06:15:58.554962+0000","last_became_active":"2024-09-21T06:15:56.524934+0000","last_became_peered":"2024-09-21T06:15:56.524934+0000","last_unstale":"2024-09-21T06:15:58.554962+0000","last_undegraded":"2024-09-21T06:15:58.554962+0000","last_fullsized":"2024-09-21T06:15:58.554962+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:46.402176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.548499+0000","last_change":"2024-09-21T06:15:57.548151+0000","last_active":"2024-09-21T06:15:57.548499+0000","last_peered":"2024-09-21T06:15:57.548499+0000","last_clean":"2024-09-21T06:15:57.548499+0000","last_became_active":"2024-09-21T06:15:57.547569+0000","last_became_peered":"2024-09-21T06:15:57.547569+0000","last_unstale":"2024-09-21T06:15:57.548499+0000","last_undegraded":"2024-09-21T06:15:57.548499+0000","last_fullsized":"2024-09-21T06:15:57.548499+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:55.621795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541552+0000","last_change":"2024-09-21T06:15:56.531546+0000","last_active":"2024-09-21T06:15:58.541552+0000","last_peered":"2024-09-21T06:15:58.541552+0000","last_clean":"2024-09-21T06:15:58.541552+0000","last_became_active":"2024-09-21T06:15:56.530496+0000","last_became_peered":"2024-09-21T06:15:56.530496+0000","last_unstale":"2024-09-21T06:15:58.541552+0000","last_undegraded":"2024-09-21T06:15:58.541552+0000","last_fullsized":"2024-09-21T06:15:58.541552+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:26.415192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540560+0000","last_change":"2024-09-21T06:15:57.548927+0000","last_active":"2024-09-21T06:15:58.540560+0000","last_peered":"2024-09-21T06:15:58.540560+0000","last_clean":"2024-09-21T06:15:58.540560+0000","last_became_active":"2024-09-21T06:15:57.548452+0000","last_became_peered":"2024-09-21T06:15:57.548452+0000","last_unstale":"2024-09-21T06:15:58.540560+0000","last_undegraded":"2024-09-21T06:15:58.540560+0000","last_fullsized":"2024-09-21T06:15:58.540560+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.723454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541079+0000","last_change":"2024-09-21T06:15:56.518595+0000","last_active":"2024-09-21T06:15:58.541079+0000","last_peered":"2024-09-21T06:15:58.541079+0000","last_clean":"2024-09-21T06:15:58.541079+0000","last_became_active":"2024-09-21T06:15:56.518301+0000","last_became_peered":"2024-09-21T06:15:56.518301+0000","last_unstale":"2024-09-21T06:15:58.541079+0000","last_undegraded":"2024-09-21T06:15:58.541079+0000","last_fullsized":"2024-09-21T06:15:58.541079+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:07.300576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554729+0000","last_change":"2024-09-21T06:15:57.543069+0000","last_active":"2024-09-21T06:15:58.554729+0000","last_peered":"2024-09-21T06:15:58.554729+0000","last_clean":"2024-09-21T06:15:58.554729+0000","last_became_active":"2024-09-21T06:15:57.542777+0000","last_became_peered":"2024-09-21T06:15:57.542777+0000","last_unstale":"2024-09-21T06:15:58.554729+0000","last_undegraded":"2024-09-21T06:15:58.554729+0000","last_fullsized":"2024-09-21T06:15:58.554729+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:43.034252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.560972+0000","last_change":"2024-09-21T06:15:56.534081+0000","last_active":"2024-09-21T06:15:57.560972+0000","last_peered":"2024-09-21T06:15:57.560972+0000","last_clean":"2024-09-21T06:15:57.560972+0000","last_became_active":"2024-09-21T06:15:56.533823+0000","last_became_peered":"2024-09-21T06:15:56.533823+0000","last_unstale":"2024-09-21T06:15:57.560972+0000","last_undegraded":"2024-09-21T06:15:57.560972+0000","last_fullsized":"2024-09-21T06:15:57.560972+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:49.134311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540008+0000","last_change":"2024-09-21T06:15:57.554540+0000","last_active":"2024-09-21T06:15:58.540008+0000","last_peered":"2024-09-21T06:15:58.540008+0000","last_clean":"2024-09-21T06:15:58.540008+0000","last_became_active":"2024-09-21T06:15:57.553073+0000","last_became_peered":"2024-09-21T06:15:57.553073+0000","last_unstale":"2024-09-21T06:15:58.540008+0000","last_undegraded":"2024-09-21T06:15:58.540008+0000","last_fullsized":"2024-09-21T06:15:58.540008+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:42.679434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540910+0000","last_change":"2024-09-21T06:15:56.528725+0000","last_active":"2024-09-21T06:15:58.540910+0000","last_peered":"2024-09-21T06:15:58.540910+0000","last_clean":"2024-09-21T06:15:58.540910+0000","last_became_active":"2024-09-21T06:15:56.528461+0000","last_became_peered":"2024-09-21T06:15:56.528461+0000","last_unstale":"2024-09-21T06:15:58.540910+0000","last_undegraded":"2024-09-21T06:15:58.540910+0000","last_fullsized":"2024-09-21T06:15:58.540910+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:45.788330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541192+0000","last_change":"2024-09-21T06:15:57.554948+0000","last_active":"2024-09-21T06:15:58.541192+0000","last_peered":"2024-09-21T06:15:58.541192+0000","last_clean":"2024-09-21T06:15:58.541192+0000","last_became_active":"2024-09-21T06:15:57.551122+0000","last_became_peered":"2024-09-21T06:15:57.551122+0000","last_unstale":"2024-09-21T06:15:58.541192+0000","last_undegraded":"2024-09-21T06:15:58.541192+0000","last_fullsized":"2024-09-21T06:15:58.541192+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:45.768673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.534093+0000","last_change":"2024-09-21T06:15:56.527122+0000","last_active":"2024-09-21T06:15:57.534093+0000","last_peered":"2024-09-21T06:15:57.534093+0000","last_clean":"2024-09-21T06:15:57.534093+0000","last_became_active":"2024-09-21T06:15:56.526869+0000","last_became_peered":"2024-09-21T06:15:56.526869+0000","last_unstale":"2024-09-21T06:15:57.534093+0000","last_undegraded":"2024-09-21T06:15:57.534093+0000","last_fullsized":"2024-09-21T06:15:57.534093+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.349318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.544739+0000","last_change":"2024-09-21T06:15:57.543676+0000","last_active":"2024-09-21T06:15:57.544739+0000","last_peered":"2024-09-21T06:15:57.544739+0000","last_clean":"2024-09-21T06:15:57.544739+0000","last_became_active":"2024-09-21T06:15:57.542976+0000","last_became_peered":"2024-09-21T06:15:57.542976+0000","last_unstale":"2024-09-21T06:15:57.544739+0000","last_undegraded":"2024-09-21T06:15:57.544739+0000","last_fullsized":"2024-09-21T06:15:57.544739+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:51.967829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541680+0000","last_change":"2024-09-21T06:15:56.531848+0000","last_active":"2024-09-21T06:15:58.541680+0000","last_peered":"2024-09-21T06:15:58.541680+0000","last_clean":"2024-09-21T06:15:58.541680+0000","last_became_active":"2024-09-21T06:15:56.531276+0000","last_became_peered":"2024-09-21T06:15:56.531276+0000","last_unstale":"2024-09-21T06:15:58.541680+0000","last_undegraded":"2024-09-21T06:15:58.541680+0000","last_fullsized":"2024-09-21T06:15:58.541680+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:11.744885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539330+0000","last_change":"2024-09-21T06:15:57.535685+0000","last_active":"2024-09-21T06:15:58.539330+0000","last_peered":"2024-09-21T06:15:58.539330+0000","last_clean":"2024-09-21T06:15:58.539330+0000","last_became_active":"2024-09-21T06:15:57.535372+0000","last_became_peered":"2024-09-21T06:15:57.535372+0000","last_unstale":"2024-09-21T06:15:58.539330+0000","last_undegraded":"2024-09-21T06:15:58.539330+0000","last_fullsized":"2024-09-21T06:15:58.539330+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:03.271128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"176'2","reported_seq":17,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539103+0000","last_change":"2024-09-21T06:15:56.533727+0000","last_active":"2024-09-21T06:15:58.539103+0000","last_peered":"2024-09-21T06:15:58.539103+0000","last_clean":"2024-09-21T06:15:58.539103+0000","last_became_active":"2024-09-21T06:15:56.533455+0000","last_became_peered":"2024-09-21T06:15:56.533455+0000","last_unstale":"2024-09-21T06:15:58.539103+0000","last_undegraded":"2024-09-21T06:15:58.539103+0000","last_fullsized":"2024-09-21T06:15:58.539103+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:23.490701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540573+0000","last_change":"2024-09-21T06:15:57.550012+0000","last_active":"2024-09-21T06:15:58.540573+0000","last_peered":"2024-09-21T06:15:58.540573+0000","last_clean":"2024-09-21T06:15:58.540573+0000","last_became_active":"2024-09-21T06:15:57.548727+0000","last_became_peered":"2024-09-21T06:15:57.548727+0000","last_unstale":"2024-09-21T06:15:58.540573+0000","last_undegraded":"2024-09-21T06:15:58.540573+0000","last_fullsized":"2024-09-21T06:15:58.540573+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:14.929359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"177'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.555802+0000","last_change":"2024-09-21T06:15:56.529389+0000","last_active":"2024-09-21T06:15:58.555802+0000","last_peered":"2024-09-21T06:15:58.555802+0000","last_clean":"2024-09-21T06:15:58.555802+0000","last_became_active":"2024-09-21T06:15:56.528986+0000","last_became_peered":"2024-09-21T06:15:56.528986+0000","last_unstale":"2024-09-21T06:15:58.555802+0000","last_undegraded":"2024-09-21T06:15:58.555802+0000","last_fullsized":"2024-09-21T06:15:58.555802+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:56.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.544298+0000","last_change":"2024-09-21T06:15:57.543358+0000","last_active":"2024-09-21T06:15:57.544298+0000","last_peered":"2024-09-21T06:15:57.544298+0000","last_clean":"2024-09-21T06:15:57.544298+0000","last_became_active":"2024-09-21T06:15:57.542619+0000","last_became_peered":"2024-09-21T06:15:57.542619+0000","last_unstale":"2024-09-21T06:15:57.544298+0000","last_undegraded":"2024-09-21T06:15:57.544298+0000","last_fullsized":"2024-09-21T06:15:57.544298+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:34.063119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541147+0000","last_change":"2024-09-21T06:15:56.533977+0000","last_active":"2024-09-21T06:15:58.541147+0000","last_peered":"2024-09-21T06:15:58.541147+0000","last_clean":"2024-09-21T06:15:58.541147+0000","last_became_active":"2024-09-21T06:15:56.533200+0000","last_became_peered":"2024-09-21T06:15:56.533200+0000","last_unstale":"2024-09-21T06:15:58.541147+0000","last_undegraded":"2024-09-21T06:15:58.541147+0000","last_fullsized":"2024-09-21T06:15:58.541147+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:49.469027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538306+0000","last_change":"2024-09-21T06:15:57.542961+0000","last_active":"2024-09-21T06:15:58.538306+0000","last_peered":"2024-09-21T06:15:58.538306+0000","last_clean":"2024-09-21T06:15:58.538306+0000","last_became_active":"2024-09-21T06:15:57.542681+0000","last_became_peered":"2024-09-21T06:15:57.542681+0000","last_unstale":"2024-09-21T06:15:58.538306+0000","last_undegraded":"2024-09-21T06:15:58.538306+0000","last_fullsized":"2024-09-21T06:15:58.538306+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:57.268817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538126+0000","last_change":"2024-09-21T06:15:56.529389+0000","last_active":"2024-09-21T06:15:58.538126+0000","last_peered":"2024-09-21T06:15:58.538126+0000","last_clean":"2024-09-21T06:15:58.538126+0000","last_became_active":"2024-09-21T06:15:56.529093+0000","last_became_peered":"2024-09-21T06:15:56.529093+0000","last_unstale":"2024-09-21T06:15:58.538126+0000","last_undegraded":"2024-09-21T06:15:58.538126+0000","last_fullsized":"2024-09-21T06:15:58.538126+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:47.321083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538902+0000","last_change":"2024-09-21T06:15:57.545265+0000","last_active":"2024-09-21T06:15:58.538902+0000","last_peered":"2024-09-21T06:15:58.538902+0000","last_clean":"2024-09-21T06:15:58.538902+0000","last_became_active":"2024-09-21T06:15:57.544702+0000","last_became_peered":"2024-09-21T06:15:57.544702+0000","last_unstale":"2024-09-21T06:15:58.538902+0000","last_undegraded":"2024-09-21T06:15:58.538902+0000","last_fullsized":"2024-09-21T06:15:58.538902+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:43.020151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540535+0000","last_change":"2024-09-21T06:15:56.532500+0000","last_active":"2024-09-21T06:15:58.540535+0000","last_peered":"2024-09-21T06:15:58.540535+0000","last_clean":"2024-09-21T06:15:58.540535+0000","last_became_active":"2024-09-21T06:15:56.531809+0000","last_became_peered":"2024-09-21T06:15:56.531809+0000","last_unstale":"2024-09-21T06:15:58.540535+0000","last_undegraded":"2024-09-21T06:15:58.540535+0000","last_fullsized":"2024-09-21T06:15:58.540535+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:39.772271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540049+0000","last_change":"2024-09-21T06:15:57.550600+0000","last_active":"2024-09-21T06:15:58.540049+0000","last_peered":"2024-09-21T06:15:58.540049+0000","last_clean":"2024-09-21T06:15:58.540049+0000","last_became_active":"2024-09-21T06:15:57.550329+0000","last_became_peered":"2024-09-21T06:15:57.550329+0000","last_unstale":"2024-09-21T06:15:58.540049+0000","last_undegraded":"2024-09-21T06:15:58.540049+0000","last_fullsized":"2024-09-21T06:15:58.540049+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:23.322202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-21T06:15:57.534182+0000","last_change":"2024-09-21T06:15:56.530858+0000","last_active":"2024-09-21T06:15:57.534182+0000","last_peered":"2024-09-21T06:15:57.534182+0000","last_clean":"2024-09-21T06:15:57.534182+0000","last_became_active":"2024-09-21T06:15:56.528654+0000","last_became_peered":"2024-09-21T06:15:56.528654+0000","last_unstale":"2024-09-21T06:15:57.534182+0000","last_undegraded":"2024-09-21T06:15:57.534182+0000","last_fullsized":"2024-09-21T06:15:57.534182+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:42.089873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539835+0000","last_change":"2024-09-21T06:15:57.554146+0000","last_active":"2024-09-21T06:15:58.539835+0000","last_peered":"2024-09-21T06:15:58.539835+0000","last_clean":"2024-09-21T06:15:58.539835+0000","last_became_active":"2024-09-21T06:15:57.553897+0000","last_became_peered":"2024-09-21T06:15:57.553897+0000","last_unstale":"2024-09-21T06:15:58.539835+0000","last_undegraded":"2024-09-21T06:15:58.539835+0000","last_fullsized":"2024-09-21T06:15:58.539835+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:12.188805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.541988+0000","last_change":"2024-09-21T06:15:56.532709+0000","last_active":"2024-09-21T06:15:58.541988+0000","last_peered":"2024-09-21T06:15:58.541988+0000","last_clean":"2024-09-21T06:15:58.541988+0000","last_became_active":"2024-09-21T06:15:56.532323+0000","last_became_peered":"2024-09-21T06:15:56.532323+0000","last_unstale":"2024-09-21T06:15:58.541988+0000","last_undegraded":"2024-09-21T06:15:58.541988+0000","last_fullsized":"2024-09-21T06:15:58.541988+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:24.670355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.554568+0000","last_change":"2024-09-21T06:15:57.553277+0000","last_active":"2024-09-21T06:15:58.554568+0000","last_peered":"2024-09-21T06:15:58.554568+0000","last_clean":"2024-09-21T06:15:58.554568+0000","last_became_active":"2024-09-21T06:15:57.552830+0000","last_became_peered":"2024-09-21T06:15:57.552830+0000","last_unstale":"2024-09-21T06:15:58.554568+0000","last_undegraded":"2024-09-21T06:15:58.554568+0000","last_fullsized":"2024-09-21T06:15:58.554568+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:54.988226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.539449+0000","last_change":"2024-09-21T06:15:56.527376+0000","last_active":"2024-09-21T06:15:58.539449+0000","last_peered":"2024-09-21T06:15:58.539449+0000","last_clean":"2024-09-21T06:15:58.539449+0000","last_became_active":"2024-09-21T06:15:56.527103+0000","last_became_peered":"2024-09-21T06:15:56.527103+0000","last_unstale":"2024-09-21T06:15:58.539449+0000","last_undegraded":"2024-09-21T06:15:58.539449+0000","last_fullsized":"2024-09-21T06:15:58.539449+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:13.793375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.538639+0000","last_change":"2024-09-21T06:15:57.535350+0000","last_active":"2024-09-21T06:15:58.538639+0000","last_peered":"2024-09-21T06:15:58.538639+0000","last_clean":"2024-09-21T06:15:58.538639+0000","last_became_active":"2024-09-21T06:15:57.535118+0000","last_became_peered":"2024-09-21T06:15:57.535118+0000","last_unstale":"2024-09-21T06:15:58.538639+0000","last_undegraded":"2024-09-21T06:15:58.538639+0000","last_fullsized":"2024-09-21T06:15:58.538639+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:56.510286+0000","last_clean_scrub_stamp":"2024-09-21T06:15:56.510286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:57.588962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540319+0000","last_change":"2024-09-21T06:15:56.533065+0000","last_active":"2024-09-21T06:15:58.540319+0000","last_peered":"2024-09-21T06:15:58.540319+0000","last_clean":"2024-09-21T06:15:58.540319+0000","last_became_active":"2024-09-21T06:15:56.532146+0000","last_became_peered":"2024-09-21T06:15:56.532146+0000","last_unstale":"2024-09-21T06:15:58.540319+0000","last_undegraded":"2024-09-21T06:15:58.540319+0000","last_fullsized":"2024-09-21T06:15:58.540319+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:15:55.503860+0000","last_clean_scrub_stamp":"2024-09-21T06:15:55.503860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:28.776388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":434,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-21T06:15:58.540986+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:15:58.540986+0000","last_peered":"2024-09-21T06:15:58.540986+0000","last_clean":"2024-09-21T06:15:58.540986+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:15:58.540986+0000","last_undegraded":"2024-09-21T06:15:58.540986+0000","last_fullsized":"2024-09-21T06:15:58.540986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574997,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":973,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194338,"statfs":{"total":200000000,"available":199002722,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574997,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1550,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193762,"statfs":{"total":200000000,"available":198412388,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193759,"statfs":{"total":200000000,"available":198410034,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199009034,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":968,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574997,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":969,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194343,"statfs":{"total":200000000,"available":199007374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199008966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194344,"statfs":{"total":200000000,"available":199009022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:16:02.453 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:16:02.453 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:16:02.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 -- 172.21.15.118:0/3884092006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 msgr2=0x7f81c80d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 --2- 172.21.15.118:0/3884092006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c80d12d0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005fd0 tx=0x7f81b402a4f0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 -- 172.21.15.118:0/3884092006 shutdown_connections 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 --2- 172.21.15.118:0/3884092006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c80d12d0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 --2- 172.21.15.118:0/3884092006 >> v2:172.21.15.149:3300/0 conn(0x7f81c815fa00 0x7f81c815fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 --2- 172.21.15.118:0/3884092006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81c80ce0c0 0x7f81c81448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 -- 172.21.15.118:0/3884092006 >> 172.21.15.118:0/3884092006 conn(0x7f81c806d110 msgr2=0x7f81c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 -- 172.21.15.118:0/3884092006 shutdown_connections 2024-09-21T06:16:02.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.717+0000 7f81cec00640 1 -- 172.21.15.118:0/3884092006 wait complete. 2024-09-21T06:16:02.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.719+0000 7f81cec00640 1 Processor -- start 2024-09-21T06:16:02.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.719+0000 7f81cec00640 1 -- start start 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81cec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81c80ce0c0 0x7f81c8168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81cec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81cec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81c815fa00 0x7f81c8164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81cec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80b3df0 con 0x7f81c80d0ec0 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81cec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80b3c70 con 0x7f81c80ce0c0 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81cec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f81c80b3f70 con 0x7f81c815fa00 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81c7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81c7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50904/0 (socket says 172.21.15.118:50904) 2024-09-21T06:16:02.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81c7400640 1 -- 172.21.15.118:0/204335216 learned_addr learned my addr 172.21.15.118:0/204335216 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81c7e00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81c80ce0c0 0x7f81c8168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.721+0000 7f81ccc00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81c815fa00 0x7f81c8164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81c7400640 1 -- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81c815fa00 msgr2=0x7f81c8164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81c7400640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81c815fa00 0x7f81c8164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81c7400640 1 -- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81c80ce0c0 msgr2=0x7f81c8168680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81c7400640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81c80ce0c0 0x7f81c8168680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81c7400640 1 -- 172.21.15.118:0/204335216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c81f6fe0 con 0x7f81c80d0ec0 2024-09-21T06:16:02.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81c7400640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c815a2a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f81b4034040 tx=0x7f81b40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81bfe00640 1 -- 172.21.15.118:0/204335216 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b403e030 con 0x7f81c80d0ec0 2024-09-21T06:16:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81bfe00640 1 -- 172.21.15.118:0/204335216 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81b4003d90 con 0x7f81c80d0ec0 2024-09-21T06:16:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81bfe00640 1 -- 172.21.15.118:0/204335216 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4035040 con 0x7f81c80d0ec0 2024-09-21T06:16:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c815a7e0 con 0x7f81c80d0ec0 2024-09-21T06:16:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.722+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c81f6740 con 0x7f81c80d0ec0 2024-09-21T06:16:02.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.723+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c80d12d0 con 0x7f81c80d0ec0 2024-09-21T06:16:02.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.725+0000 7f81bfe00640 1 -- 172.21.15.118:0/204335216 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f81b4041030 con 0x7f81c80d0ec0 2024-09-21T06:16:02.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.726+0000 7f81bfe00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f81a8078b90 0x7f81a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:02.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.726+0000 7f81bfe00640 1 -- 172.21.15.118:0/204335216 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f81b40bb9e0 con 0x7f81c80d0ec0 2024-09-21T06:16:02.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.726+0000 7f81c7e00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f81a8078b90 0x7f81a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:02.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.727+0000 7f81c7e00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f81a8078b90 0x7f81a807b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005fd0 tx=0x7f81b800b260 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:02.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.729+0000 7f81bfe00640 1 -- 172.21.15.118:0/204335216 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f81b4083840 con 0x7f81c80d0ec0 2024-09-21T06:16:02.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.986+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f81c80748f0 con 0x7f81c80d0ec0 2024-09-21T06:16:02.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.990+0000 7f81bfe00640 1 -- 172.21.15.118:0/204335216 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f81b4088270 con 0x7f81c80d0ec0 2024-09-21T06:16:02.991 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-09-21T06:16:02.991 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCqYe5mzsmBOBAAZOzbXUIW8VD2yRlxA4juxQ== 2024-09-21T06:16:02.991 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-09-21T06:16:02.991 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-09-21T06:16:02.992 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:16:02.992 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-09-21T06:16:02.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f81a8078b90 msgr2=0x7f81a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f81a8078b90 0x7f81a807b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005fd0 tx=0x7f81b800b260 comp rx=0 tx=0).stop 2024-09-21T06:16:02.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 msgr2=0x7f81c815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:02.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c815a2a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f81b4034040 tx=0x7f81b40038a0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 shutdown_connections 2024-09-21T06:16:02.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f81a8078b90 0x7f81a807b0a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81c815fa00 0x7f81c8164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81c80d0ec0 0x7f81c815a2a0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 --2- 172.21.15.118:0/204335216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81c80ce0c0 0x7f81c8168680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:02.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.992+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 >> 172.21.15.118:0/204335216 conn(0x7f81c806d110 msgr2=0x7f81c815c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:02.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.993+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 shutdown_connections 2024-09-21T06:16:02.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:02.993+0000 7f81cec00640 1 -- 172.21.15.118:0/204335216 wait complete. 2024-09-21T06:16:03.017 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 -- 172.21.15.118:0/1912793634 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000d1590 msgr2=0x7fce00142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 --2- 172.21.15.118:0/1912793634 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000d1590 0x7fce00142730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcde8005fd0 tx=0x7fcde802a540 comp rx=0 tx=0).stop 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 -- 172.21.15.118:0/1912793634 shutdown_connections 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 --2- 172.21.15.118:0/1912793634 >> v2:172.21.15.149:3300/0 conn(0x7fce0013fef0 0x7fce00142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 --2- 172.21.15.118:0/1912793634 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce000d1590 0x7fce00142730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 -- 172.21.15.118:0/1912793634 >> 172.21.15.118:0/1912793634 conn(0x7fce0006d110 msgr2=0x7fce0006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 -- 172.21.15.118:0/1912793634 shutdown_connections 2024-09-21T06:16:03.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.237+0000 7fce05c00640 1 -- 172.21.15.118:0/1912793634 wait complete. 2024-09-21T06:16:03.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.239+0000 7fce05c00640 1 Processor -- start 2024-09-21T06:16:03.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.240+0000 7fce05c00640 1 -- start start 2024-09-21T06:16:03.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fce05c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0013fae0 0x7fce0013c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fce05c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce0013fef0 0x7fce001f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fce05c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce00158ad0 0x7fce001f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fce05c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce000cfb10 con 0x7fce00158ad0 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fce05c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce000cf990 con 0x7fce0013fae0 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fce05c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce000cfc90 con 0x7fce0013fef0 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fcdff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce00158ad0 0x7fce001f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fcdff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce00158ad0 0x7fce001f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50918/0 (socket says 172.21.15.118:50918) 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fcdff400640 1 -- 172.21.15.118:0/3861372191 learned_addr learned my addr 172.21.15.118:0/3861372191 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fcdf6000640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce0013fef0 0x7fce001f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:03.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.241+0000 7fcdfea00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0013fae0 0x7fce0013c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:03.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdff400640 1 -- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce0013fef0 msgr2=0x7fce001f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:03.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdff400640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce0013fef0 0x7fce001f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdff400640 1 -- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0013fae0 msgr2=0x7fce0013c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdff400640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0013fae0 0x7fce0013c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdff400640 1 -- 172.21.15.118:0/3861372191 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0013a400 con 0x7fce00158ad0 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdff400640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce00158ad0 0x7fce001f0e20 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800ea80 tx=0x7fcdf800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdf7400640 1 -- 172.21.15.118:0/3861372191 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8004b20 con 0x7fce00158ad0 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdf7400640 1 -- 172.21.15.118:0/3861372191 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdf8004ce0 con 0x7fce00158ad0 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fcdf7400640 1 -- 172.21.15.118:0/3861372191 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8005280 con 0x7fce00158ad0 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0013a6e0 con 0x7fce00158ad0 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.242+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0013aca0 con 0x7fce00158ad0 2024-09-21T06:16:03.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.243+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce000b5a70 con 0x7fce00158ad0 2024-09-21T06:16:03.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.245+0000 7fcdf7400640 1 -- 172.21.15.118:0/3861372191 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcdf8005420 con 0x7fce00158ad0 2024-09-21T06:16:03.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.246+0000 7fcdf7400640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcddc078b90 0x7fcddc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:03.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.246+0000 7fcdf7400640 1 -- 172.21.15.118:0/3861372191 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fcdf809b9c0 con 0x7fce00158ad0 2024-09-21T06:16:03.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.246+0000 7fcdfea00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcddc078b90 0x7fcddc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:03.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.247+0000 7fcdfea00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcddc078b90 0x7fcddc07b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0001720 tx=0x7fcdf0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:03.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.250+0000 7fcdf7400640 1 -- 172.21.15.118:0/3861372191 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fce000b5a70 con 0x7fce00158ad0 2024-09-21T06:16:03.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.472+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce0013cde0 con 0x7fce00158ad0 2024-09-21T06:16:03.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.473+0000 7fcdf7400640 1 -- 172.21.15.118:0/3861372191 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7fcdf809de20 con 0x7fce00158ad0 2024-09-21T06:16:03.474 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:03.474 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:03.475 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.475+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcddc078b90 msgr2=0x7fcddc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.475+0000 7fce05c00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcddc078b90 0x7fcddc07b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0001720 tx=0x7fcdf0009040 comp rx=0 tx=0).stop 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.475+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce00158ad0 msgr2=0x7fce001f0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.475+0000 7fce05c00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce00158ad0 0x7fce001f0e20 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800ea80 tx=0x7fcdf800ef40 comp rx=0 tx=0).stop 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 shutdown_connections 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce00158ad0 0x7fce001f0e20 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fcddc078b90 0x7fcddc07b0a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce0013fef0 0x7fce001f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 --2- 172.21.15.118:0/3861372191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce0013fae0 0x7fce0013c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 >> 172.21.15.118:0/3861372191 conn(0x7fce0006d110 msgr2=0x7fce000d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:03.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 shutdown_connections 2024-09-21T06:16:03.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:03.476+0000 7fce05c00640 1 -- 172.21.15.118:0/3861372191 wait complete. 2024-09-21T06:16:03.507 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-09-21T06:16:03.506+0000 7fdaf4000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:16:03.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:15:57.016837+0000', 'modified': '2024-09-21T06:16:00.048612+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8094}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8094': {'gid': 8094, 'name': 'c', 'rank': 0, 'incarnation': 91, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/1906430452', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 1906430452}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1906430452}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8094, 'qdb_cluster': [8094]} 2024-09-21T06:16:03.903 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:16:03.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:16:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.125+0000 7fe03e400640 1 -- 172.21.15.118:0/611448960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0380d1590 msgr2=0x7fe038142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.125+0000 7fe03e400640 1 --2- 172.21.15.118:0/611448960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0380d1590 0x7fe038142730 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe03815d420 tx=0x7fe02402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.125+0000 7fe03e400640 1 -- 172.21.15.118:0/611448960 shutdown_connections 2024-09-21T06:16:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.125+0000 7fe03e400640 1 --2- 172.21.15.118:0/611448960 >> v2:172.21.15.149:3300/0 conn(0x7fe03813fef0 0x7fe038142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.125+0000 7fe03e400640 1 --2- 172.21.15.118:0/611448960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0380d1590 0x7fe038142730 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.125+0000 7fe03e400640 1 -- 172.21.15.118:0/611448960 >> 172.21.15.118:0/611448960 conn(0x7fe03806d110 msgr2=0x7fe03806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.126+0000 7fe03e400640 1 -- 172.21.15.118:0/611448960 shutdown_connections 2024-09-21T06:16:04.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.126+0000 7fe03e400640 1 -- 172.21.15.118:0/611448960 wait complete. 2024-09-21T06:16:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.128+0000 7fe03e400640 1 Processor -- start 2024-09-21T06:16:04.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.128+0000 7fe03e400640 1 -- start start 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.129+0000 7fe03e400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03813fae0 0x7fe0381f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.129+0000 7fe03e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe03813fef0 0x7fe0380b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.129+0000 7fe03e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe03813e6e0 0x7fe0380b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.129+0000 7fe03e400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0380cfa70 con 0x7fe03813fae0 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.129+0000 7fe03e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0380cf8f0 con 0x7fe03813e6e0 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.129+0000 7fe03e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0380cfbf0 con 0x7fe03813fef0 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.129+0000 7fe037400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03813fae0 0x7fe0381f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03813fae0 0x7fe0381f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50940/0 (socket says 172.21.15.118:50940) 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 -- 172.21.15.118:0/1965822295 learned_addr learned my addr 172.21.15.118:0/1965822295 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037e00640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe03813e6e0 0x7fe0380b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe036a00640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe03813fef0 0x7fe0380b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 -- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe03813fef0 msgr2=0x7fe0380b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe03813fef0 0x7fe0380b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 -- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe03813e6e0 msgr2=0x7fe0380b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe03813e6e0 0x7fe0380b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 -- 172.21.15.118:0/1965822295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03813dae0 con 0x7fe03813fae0 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe037400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03813fae0 0x7fe0381f3290 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c460 tx=0x7fe02800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe02f400640 1 -- 172.21.15.118:0/1965822295 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028016020 con 0x7fe03813fae0 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe02f400640 1 -- 172.21.15.118:0/1965822295 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe028012940 con 0x7fe03813fae0 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.130+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03813ddc0 con 0x7fe03813fae0 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.131+0000 7fe02f400640 1 -- 172.21.15.118:0/1965822295 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028012d90 con 0x7fe03813fae0 2024-09-21T06:16:04.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.131+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03813e380 con 0x7fe03813fae0 2024-09-21T06:16:04.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.133+0000 7fe02f400640 1 -- 172.21.15.118:0/1965822295 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe028019020 con 0x7fe03813fae0 2024-09-21T06:16:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.134+0000 7fe02f400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe018078bc0 0x7fe01807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.134+0000 7fe02f400640 1 -- 172.21.15.118:0/1965822295 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fe02809ac70 con 0x7fe03813fae0 2024-09-21T06:16:04.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.134+0000 7fe036a00640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe018078bc0 0x7fe01807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.135+0000 7fe045634740 1 Processor -- start 2024-09-21T06:16:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.135+0000 7fe045634740 1 -- start start 2024-09-21T06:16:04.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.135+0000 7fe036a00640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe018078bc0 0x7fe01807b0d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe024034000 tx=0x7fe024004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b213970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b213eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe045634740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b1e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe045634740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ae9b16d430 con 0x55ae9ae22590 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ae9b15d5d0 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ae9b14ca00 con 0x55ae9ae43270 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe037e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b1e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe037e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b1e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50944/0 (socket says 172.21.15.118:50944) 2024-09-21T06:16:04.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.136+0000 7fe037e00640 1 -- 172.21.15.118:0/4285577036 learned_addr learned my addr 172.21.15.118:0/4285577036 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe036a00640 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b213eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe037400640 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b213970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe037e00640 1 -- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 msgr2=0x55ae9b213970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe037e00640 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b213970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe037e00640 1 -- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 msgr2=0x55ae9b213eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe037e00640 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b213eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe037e00640 1 -- 172.21.15.118:0/4285577036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9b115520 con 0x55ae9ae22590 2024-09-21T06:16:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe037e00640 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b1e3f60 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe030009d80 tx=0x7fe030010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f6c718753ae711 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe023e00640 1 -- 172.21.15.118:0/4285577036 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030016070 con 0x55ae9ae22590 2024-09-21T06:16:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe023e00640 1 -- 172.21.15.118:0/4285577036 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe030004e10 con 0x55ae9ae22590 2024-09-21T06:16:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.137+0000 7fe023e00640 1 -- 172.21.15.118:0/4285577036 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030005260 con 0x55ae9ae22590 2024-09-21T06:16:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 -- 172.21.15.118:0/4285577036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 msgr2=0x55ae9b1e3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b1e3f60 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe030009d80 tx=0x7fe030010740 comp rx=0 tx=0).stop 2024-09-21T06:16:04.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 -- 172.21.15.118:0/4285577036 shutdown_connections 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b1e3f60 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b213eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 --2- 172.21.15.118:0/4285577036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b213970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 -- 172.21.15.118:0/4285577036 >> 172.21.15.118:0/4285577036 conn(0x55ae9ae373c0 msgr2=0x55ae9b1e9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 -- 172.21.15.118:0/4285577036 shutdown_connections 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.138+0000 7fe045634740 1 -- 172.21.15.118:0/4285577036 wait complete. 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.139+0000 7fe045634740 1 -- start start 2024-09-21T06:16:04.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.139+0000 7fe045634740 1 Processor -- start 2024-09-21T06:16:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe045634740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b2096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae22590 0x55ae9b2296f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b229c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe045634740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ae9b0f3330 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ae9b150810 con 0x55ae9ae22590 2024-09-21T06:16:04.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ae9aebd620 con 0x55ae9ae43270 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe045634740 10 client.0 _ll_register_callbacks cb 0x55ae9b0f8420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe037400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b2096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe037400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b2096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50958/0 (socket says 172.21.15.118:50958) 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.141+0000 7fe037400640 1 -- 172.21.15.118:0/1646598052 learned_addr learned my addr 172.21.15.118:0/1646598052 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe037e00640 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b229c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe036a00640 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae22590 0x55ae9b2296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe037400640 1 -- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 msgr2=0x55ae9b229c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe037400640 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b229c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe037400640 1 -- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae22590 msgr2=0x55ae9b2296f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe037400640 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae22590 0x55ae9b2296f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe037400640 1 -- 172.21.15.118:0/1646598052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9aeae850 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe037400640 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b2096a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe02805fc20 tx=0x7fe028062250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e5cb0e6956d189 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe020c00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:16:04.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe020c00640 1 -- 172.21.15.118:0/1646598052 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028078d60 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe020c00640 1 -- 172.21.15.118:0/1646598052 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fe028061c10 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe030004e10 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe020c00640 1 -- 172.21.15.118:0/1646598052 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe028067490 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe045634740 10 client.8220 fetch_fsmap learned FSMap version 95 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.142+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x55ae9af256b0 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe020c00640 1 -- 172.21.15.118:0/1646598052 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe030004e10 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe020c00640 1 -- 172.21.15.118:0/1646598052 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fe028063ce0 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe045634740 10 client.8220 fetch_fsmap finished waiting for FSMap version 95 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe045634740 10 client.8220 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe045634740 20 client.8220 populate_metadata read hostname 'smithi118' 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe045634740 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9ae01e40 0x55ae9b23e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe045634740 4 client.8220 mds_command: new command op to 8094 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:16:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 --> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae9b15f520 con 0x55ae9ae01e40 2024-09-21T06:16:04.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.143+0000 7fe036a00640 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9ae01e40 0x55ae9b23e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.144+0000 7fe020c00640 10 client.8220 ms_handle_connect on v2:172.21.15.118:6833/1906430452 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.144+0000 7fe036a00640 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9ae01e40 0x55ae9b23e110 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252837e6523b83e5 server_cookie=b25e4113ca8ecfef in_seq=0 out_seq=0 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe020c00640 1 -- 172.21.15.118:0/1646598052 <== mds.0 v2:172.21.15.118:6833/1906430452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae9b15f520 con 0x55ae9ae01e40 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe020c00640 10 client.8220 handle_command_reply: tid=0 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 client.8220 shutdown 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 msgr2=0x55ae9b2096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b2096a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe02805fc20 tx=0x7fe028062250 comp rx=0 tx=0).stop 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 shutdown_connections 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b229c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9ae01e40 0x55ae9b23e110 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae22590 0x55ae9b2296f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 --2- 172.21.15.118:0/1646598052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b2096a0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 >> 172.21.15.118:0/1646598052 conn(0x55ae9ae373c0 msgr2=0x55ae9b1e52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe020c00640 0 client.8220 ms_handle_reset on v2:172.21.15.118:6833/1906430452 2024-09-21T06:16:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 shutdown_connections 2024-09-21T06:16:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 1 -- 172.21.15.118:0/1646598052 wait complete. 2024-09-21T06:16:04.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.145+0000 7fe045634740 20 client.8220 trim_cache size 0 max 16384 2024-09-21T06:16:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.164+0000 7fe045634740 1 Processor -- start 2024-09-21T06:16:04.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.164+0000 7fe045634740 1 -- start start 2024-09-21T06:16:04.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.165+0000 7fe045634740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b23d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae22590 0x55ae9b20b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae43270 0x55ae9b20ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe045634740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0381ff660 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe038141480 con 0x55ae9ae43270 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0381ff1c0 con 0x55ae9ae22590 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b23d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b23d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50964/0 (socket says 172.21.15.118:50964) 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 -- 172.21.15.118:0/730913483 learned_addr learned my addr 172.21.15.118:0/730913483 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037e00640 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae43270 0x55ae9b20ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe036a00640 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae22590 0x55ae9b20b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 -- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae22590 msgr2=0x55ae9b20b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae22590 0x55ae9b20b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 -- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae43270 msgr2=0x55ae9b20ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae43270 0x55ae9b20ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 -- 172.21.15.118:0/730913483 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9b22efd0 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe036a00640 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae22590 0x55ae9b20b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:16:04.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.166+0000 7fe037400640 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b23d4f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe028062940 tx=0x7fe028062850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d101bfd65228c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe023400640 1 -- 172.21.15.118:0/730913483 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028061c10 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe023400640 1 -- 172.21.15.118:0/730913483 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe028078b60 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe023400640 1 -- 172.21.15.118:0/730913483 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02805e560 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe045634740 1 -- 172.21.15.118:0/730913483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 msgr2=0x55ae9b23d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe045634740 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b23d4f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe028062940 tx=0x7fe028062850 comp rx=0 tx=0).stop 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe045634740 1 -- 172.21.15.118:0/730913483 shutdown_connections 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe045634740 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae43270 0x55ae9b20ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe045634740 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae22590 0x55ae9b20b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe045634740 1 --2- 172.21.15.118:0/730913483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b23d4f0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.167+0000 7fe045634740 1 -- 172.21.15.118:0/730913483 >> 172.21.15.118:0/730913483 conn(0x55ae9ae373c0 msgr2=0x55ae9b20e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.168+0000 7fe045634740 1 -- 172.21.15.118:0/730913483 shutdown_connections 2024-09-21T06:16:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.168+0000 7fe045634740 1 -- 172.21.15.118:0/730913483 wait complete. 2024-09-21T06:16:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.168+0000 7fe045634740 1 -- start start 2024-09-21T06:16:04.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.169+0000 7fe045634740 1 Processor -- start 2024-09-21T06:16:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b251260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe045634740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b26f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe045634740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b2aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe045634740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55ae9b20d0b0 con 0x55ae9ae22590 2024-09-21T06:16:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ae9b0f3330 con 0x55ae9ae1a3b0 2024-09-21T06:16:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe045634740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ae9b210140 con 0x55ae9ae43270 2024-09-21T06:16:04.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe045634740 10 client.0 _ll_register_callbacks cb 0x7fe0280623b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe036a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b26f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe036a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b26f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50968/0 (socket says 172.21.15.118:50968) 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe036a00640 1 -- 172.21.15.118:0/39644798 learned_addr learned my addr 172.21.15.118:0/39644798 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe037400640 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b251260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.170+0000 7fe037e00640 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b2aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe036a00640 1 -- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 msgr2=0x55ae9b2aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe036a00640 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b2aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe036a00640 1 -- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 msgr2=0x55ae9b251260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe036a00640 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b251260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe036a00640 1 -- 172.21.15.118:0/39644798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9b1ea230 con 0x55ae9ae22590 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe036a00640 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b26f3e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe024000c00 tx=0x7fe024005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22932c16ce1ae8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe020c00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe020c00640 1 -- 172.21.15.118:0/39644798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024057060 con 0x55ae9ae22590 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe020c00640 1 -- 172.21.15.118:0/39644798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fe024003dd0 con 0x55ae9ae22590 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.171+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe028078b60 con 0x55ae9ae22590 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe020c00640 1 -- 172.21.15.118:0/39644798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe02405d050 con 0x55ae9ae22590 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 10 client.8226 fetch_fsmap learned FSMap version 95 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x55ae9b1e5500 con 0x55ae9ae22590 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe020c00640 1 -- 172.21.15.118:0/39644798 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe028078b60 con 0x55ae9ae22590 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe020c00640 1 -- 172.21.15.118:0/39644798 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fe024060020 con 0x55ae9ae22590 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 10 client.8226 fetch_fsmap finished waiting for FSMap version 95 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 10 client.8226 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 20 client.8226 populate_metadata read hostname 'smithi118' 2024-09-21T06:16:04.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9b241a50 0x55ae9b20d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 4 client.8226 mds_command: new command op to 8094 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 --> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] -- command(tid 0: {"prefix": "status"}) -- 0x55ae9b15afd0 con 0x55ae9b241a50 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.172+0000 7fe037400640 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9b241a50 0x55ae9b20d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe037400640 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9b241a50 0x55ae9b20d960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=649cb5654620cda4 server_cookie=148ff1c89a55d433 in_seq=0 out_seq=0 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe020c00640 10 client.8226 ms_handle_connect on v2:172.21.15.118:6833/1906430452 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe020c00640 1 -- 172.21.15.118:0/39644798 <== mds.0 v2:172.21.15.118:6833/1906430452 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55ae9b15afd0 con 0x55ae9b241a50 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe020c00640 10 client.8226 handle_command_reply: tid=0 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 client.8226 shutdown 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 msgr2=0x55ae9b26f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b26f3e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe024000c00 tx=0x7fe024005f90 comp rx=0 tx=0).stop 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 shutdown_connections 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ae9ae43270 0x55ae9b2aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae9ae22590 0x55ae9b26f3e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.118:6833/1906430452,v1:172.21.15.118:6835/1906430452] conn(0x55ae9b241a50 0x55ae9b20d960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 --2- 172.21.15.118:0/39644798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ae9ae1a3b0 0x55ae9b251260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 >> 172.21.15.118:0/39644798 conn(0x55ae9ae373c0 msgr2=0x55ae9b250b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.173+0000 7fe020c00640 0 client.8226 ms_handle_reset on v2:172.21.15.118:6833/1906430452 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 shutdown_connections 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe045634740 1 -- 172.21.15.118:0/39644798 wait complete. 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe045634740 20 client.8226 trim_cache size 0 max 16384 2024-09-21T06:16:04.178 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 8094, 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 6.6294726859999997, 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 95, 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 177, 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 177, 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.689416851000001 2024-09-21T06:16:04.179 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe018078bc0 msgr2=0x7fe01807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe018078bc0 0x7fe01807b0d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe024034000 tx=0x7fe024004730 comp rx=0 tx=0).stop 2024-09-21T06:16:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03813fae0 msgr2=0x7fe0381f3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03813fae0 0x7fe0381f3290 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c460 tx=0x7fe02800c920 comp rx=0 tx=0).stop 2024-09-21T06:16:04.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 shutdown_connections 2024-09-21T06:16:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe03813e6e0 0x7fe0380b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe018078bc0 0x7fe01807b0d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe03813fef0 0x7fe0380b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 --2- 172.21.15.118:0/1965822295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03813fae0 0x7fe0381f3290 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.174+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 >> 172.21.15.118:0/1965822295 conn(0x7fe03806d110 msgr2=0x7fe03815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.175+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 shutdown_connections 2024-09-21T06:16:04.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.175+0000 7fe03e400640 1 -- 172.21.15.118:0/1965822295 wait complete. 2024-09-21T06:16:04.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:16:04.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.418+0000 7fb94a600640 1 -- 172.21.15.118:0/4158034085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440b3be0 msgr2=0x7fb9440ba170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.418+0000 7fb94a600640 1 --2- 172.21.15.118:0/4158034085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440b3be0 0x7fb9440ba170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb934009820 tx=0x7fb93402a510 comp rx=0 tx=0).stop 2024-09-21T06:16:04.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.418+0000 7fb94a600640 1 -- 172.21.15.118:0/4158034085 shutdown_connections 2024-09-21T06:16:04.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.418+0000 7fb94a600640 1 --2- 172.21.15.118:0/4158034085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440b3be0 0x7fb9440ba170 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.418+0000 7fb94a600640 1 -- 172.21.15.118:0/4158034085 >> 172.21.15.118:0/4158034085 conn(0x7fb9440d4bd0 msgr2=0x7fb9440d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.418+0000 7fb94a600640 1 -- 172.21.15.118:0/4158034085 shutdown_connections 2024-09-21T06:16:04.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.418+0000 7fb94a600640 1 -- 172.21.15.118:0/4158034085 wait complete. 2024-09-21T06:16:04.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.420+0000 7fb94a600640 1 Processor -- start 2024-09-21T06:16:04.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.421+0000 7fb94a600640 1 -- start start 2024-09-21T06:16:04.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb94a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9440b3be0 0x7fb9441f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb94a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440d2ab0 0x7fb944151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb94a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9440d35d0 0x7fb944151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb94a600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb94406e2c0 con 0x7fb9440d35d0 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb94a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb94406e140 con 0x7fb9440d2ab0 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb94a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb94406e440 con 0x7fb9440b3be0 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb949c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9440d35d0 0x7fb944151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb949c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9440d35d0 0x7fb944151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50976/0 (socket says 172.21.15.118:50976) 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.422+0000 7fb949c00640 1 -- 172.21.15.118:0/3016505906 learned_addr learned my addr 172.21.15.118:0/3016505906 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb949200640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9440b3be0 0x7fb9441f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb93be00640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440d2ab0 0x7fb944151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb949c00640 1 -- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9440b3be0 msgr2=0x7fb9441f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb949c00640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9440b3be0 0x7fb9441f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb949c00640 1 -- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440d2ab0 msgr2=0x7fb944151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb949c00640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440d2ab0 0x7fb944151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb949c00640 1 -- 172.21.15.118:0/3016505906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9441f6f50 con 0x7fb9440d35d0 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb949c00640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9440d35d0 0x7fb944151650 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00c700 tx=0x7fb93c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb941600640 1 -- 172.21.15.118:0/3016505906 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c003b70 con 0x7fb9440d35d0 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb941600640 1 -- 172.21.15.118:0/3016505906 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb93c003d10 con 0x7fb9440d35d0 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.423+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94415dbd0 con 0x7fb9440d35d0 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.424+0000 7fb941600640 1 -- 172.21.15.118:0/3016505906 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00aab0 con 0x7fb9440d35d0 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.424+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94415f8b0 con 0x7fb9440d35d0 2024-09-21T06:16:04.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.425+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9440cec70 con 0x7fb9440d35d0 2024-09-21T06:16:04.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.426+0000 7fb941600640 1 -- 172.21.15.118:0/3016505906 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb93c00ac50 con 0x7fb9440d35d0 2024-09-21T06:16:04.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.427+0000 7fb941600640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb920078bc0 0x7fb92007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:04.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.428+0000 7fb941600640 1 -- 172.21.15.118:0/3016505906 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7fb93c09a980 con 0x7fb9440d35d0 2024-09-21T06:16:04.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.428+0000 7fb949200640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb920078bc0 0x7fb92007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:04.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.429+0000 7fb949200640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb920078bc0 0x7fb92007b0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb934034000 tx=0x7fb934004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:04.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.432+0000 7fb941600640 1 -- 172.21.15.118:0/3016505906 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb9441f6f50 con 0x7fb9440d35d0 2024-09-21T06:16:04.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.659+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb94406e980 con 0x7fb9440d35d0 2024-09-21T06:16:04.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.660+0000 7fb941600640 1 -- 172.21.15.118:0/3016505906 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) ==== 53+0+73 (secure 0 0 0) 0x7fb93c062770 con 0x7fb9440d35d0 2024-09-21T06:16:04.661 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:16:04.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb920078bc0 msgr2=0x7fb92007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb920078bc0 0x7fb92007b0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb934034000 tx=0x7fb934004730 comp rx=0 tx=0).stop 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9440d35d0 msgr2=0x7fb944151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9440d35d0 0x7fb944151650 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00c700 tx=0x7fb93c00cbc0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 shutdown_connections 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9440d35d0 0x7fb944151650 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9440d2ab0 0x7fb944151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb920078bc0 0x7fb92007b0d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 --2- 172.21.15.118:0/3016505906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb9440b3be0 0x7fb9441f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:04.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 >> 172.21.15.118:0/3016505906 conn(0x7fb9440d4bd0 msgr2=0x7fb9440b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:04.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 shutdown_connections 2024-09-21T06:16:04.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04.662+0000 7fb94a600640 1 -- 172.21.15.118:0/3016505906 wait complete. 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:16:04.689 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:16:04.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:04.690 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:16:04.726 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42020sec preferred_lft 42020sec 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link noprefixroute 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::bc10:ebff:fe5f:4630/64 scope link 2024-09-21T06:16:04.727 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 4a:d5:e4:72:85:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::48d5:e4ff:fe72:8576/64 scope link 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether a6:bd:08:80:11:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::a4bd:8ff:fe80:1146/64 scope link 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:04.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:04.728 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:16:04.819 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-09-21T06:16:04.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:04.823 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-09-21T06:16:04.859 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-09-21T06:16:04.859 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:16:04.859 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:16:04.859 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:16:04.859 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:16:04.859 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:16:04.859 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-09-21T06:16:04.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:16:04.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:16:04.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:16:04.860 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-09-21T06:16:04.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:16:05.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:16:05.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:05.055 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:16:05.090 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:16:05.090 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:16:05.091 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:16:05.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:05.091 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-09-21T06:16:05.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:16:05.188 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:16:05.222 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:16:05.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:16:05.223 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:16:05.298 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:16:05.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:05.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:16:05.495 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:16:05.495 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:16:05.528 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:16:05.528 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:16:05.528 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:16:05.528 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 0@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:16:05.528 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:16:05.530 INFO:teuthology.orchestra.run.smithi118.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:16:05.530 INFO:teuthology.orchestra.run.smithi118.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:16:05.530 INFO:teuthology.orchestra.run.smithi118.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:16:05.530 INFO:teuthology.orchestra.run.smithi118.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:16:05.530 INFO:teuthology.orchestra.run.smithi118.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:16:05.533 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:16:05.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:05.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:16:05.592 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:16:05.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:16:05.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:16:05.690 INFO:teuthology.orchestra.run.smithi118.stdout:client8235 2024-09-21T06:16:05.690 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:05.690 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:05.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:16:05.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 -- 172.21.15.118:0/1137754083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c0cfa00 msgr2=0x7f740c0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:05.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 --2- 172.21.15.118:0/1137754083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c0cfa00 0x7f740c0b4140 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f740c0afd60 tx=0x7f740402a980 comp rx=0 tx=0).stop 2024-09-21T06:16:05.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 -- 172.21.15.118:0/1137754083 shutdown_connections 2024-09-21T06:16:05.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 --2- 172.21.15.118:0/1137754083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c0cfa00 0x7f740c0b4140 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:05.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 --2- 172.21.15.118:0/1137754083 >> v2:172.21.15.149:3300/0 conn(0x7f740c144760 0x7f740c0cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:05.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 -- 172.21.15.118:0/1137754083 >> 172.21.15.118:0/1137754083 conn(0x7f740c06d6e0 msgr2=0x7f740c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:05.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 -- 172.21.15.118:0/1137754083 shutdown_connections 2024-09-21T06:16:05.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.986+0000 7f7412e00640 1 -- 172.21.15.118:0/1137754083 wait complete. 2024-09-21T06:16:05.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.988+0000 7f7412e00640 1 Processor -- start 2024-09-21T06:16:05.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.988+0000 7f7412e00640 1 -- start start 2024-09-21T06:16:05.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7412e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f740c0cfa00 0x7f740c1e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:05.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7412e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c144760 0x7f740c0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7412e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740c144ea0 0x7f740c1f9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7412e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f740c0b4a90 con 0x7f740c144760 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7412e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f740c0b4910 con 0x7f740c144ea0 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7412e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f740c0b4c10 con 0x7f740c0cfa00 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7411000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c144760 0x7f740c0b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7411000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c144760 0x7f740c0b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47776/0 (socket says 172.21.15.118:47776) 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7411000640 1 -- 172.21.15.118:0/3572299709 learned_addr learned my addr 172.21.15.118:0/3572299709 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7411a00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f740c0cfa00 0x7f740c1e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:05.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.990+0000 7f7412400640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740c144ea0 0x7f740c1f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7411000640 1 -- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f740c0cfa00 msgr2=0x7f740c1e86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7411000640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f740c0cfa00 0x7f740c1e86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7411000640 1 -- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740c144ea0 msgr2=0x7f740c1f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7411000640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740c144ea0 0x7f740c1f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7411000640 1 -- 172.21.15.118:0/3572299709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c0b16c0 con 0x7f740c144760 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7411000640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c144760 0x7f740c0b0f20 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f73f800c970 tx=0x7f73f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7409600640 1 -- 172.21.15.118:0/3572299709 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8007bb0 con 0x7f740c144760 2024-09-21T06:16:05.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7409600640 1 -- 172.21.15.118:0/3572299709 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73f8007e40 con 0x7f740c144760 2024-09-21T06:16:05.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7409600640 1 -- 172.21.15.118:0/3572299709 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f800f690 con 0x7f740c144760 2024-09-21T06:16:05.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.991+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740c0b19a0 con 0x7f740c144760 2024-09-21T06:16:05.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.992+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f740c0b1f60 con 0x7f740c144760 2024-09-21T06:16:05.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.993+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740c0b4140 con 0x7f740c144760 2024-09-21T06:16:05.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.994+0000 7f7409600640 1 -- 172.21.15.118:0/3572299709 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73f800f830 con 0x7f740c144760 2024-09-21T06:16:05.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.995+0000 7f7409600640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f73ec078b90 0x7f73ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:05.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.995+0000 7f7409600640 1 -- 172.21.15.118:0/3572299709 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f73f809b450 con 0x7f740c144760 2024-09-21T06:16:05.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.995+0000 7f7411a00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f73ec078b90 0x7f73ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:05.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.996+0000 7f7411a00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f73ec078b90 0x7f73ec07b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7400006fd0 tx=0x7f7400009060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:06.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:05.999+0000 7f7409600640 1 -- 172.21.15.118:0/3572299709 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73f8014030 con 0x7f740c144760 2024-09-21T06:16:06.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.219+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f740c142a40 con 0x7f740c144760 2024-09-21T06:16:06.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.219+0000 7f7409600640 1 -- 172.21.15.118:0/3572299709 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) ==== 53+0+73 (secure 0 0 0) 0x7f73f8063230 con 0x7f740c144760 2024-09-21T06:16:06.221 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:16:06.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f73ec078b90 msgr2=0x7f73ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:06.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f73ec078b90 0x7f73ec07b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7400006fd0 tx=0x7f7400009060 comp rx=0 tx=0).stop 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c144760 msgr2=0x7f740c0b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c144760 0x7f740c0b0f20 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f73f800c970 tx=0x7f73f800ce30 comp rx=0 tx=0).stop 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 shutdown_connections 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f740c144ea0 0x7f740c1f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f740c144760 0x7f740c0b0f20 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f73ec078b90 0x7f73ec07b0a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 --2- 172.21.15.118:0/3572299709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f740c0cfa00 0x7f740c1e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 >> 172.21.15.118:0/3572299709 conn(0x7f740c06d6e0 msgr2=0x7f740c0b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 shutdown_connections 2024-09-21T06:16:06.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:06.222+0000 7f7412e00640 1 -- 172.21.15.118:0/3572299709 wait complete. 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:16:06.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:16:06.246 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:16:06.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:06.246 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:16:06.287 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 41993sec preferred_lft 41993sec 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:16:06.288 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::fc9e:ff:fe73:b95d/64 scope link 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether b6:f3:96:3f:be:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b4f3:96ff:fe3f:be7c/64 scope link 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:16:06.289 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 26:fa:e6:5f:66:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:16:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::24fa:e6ff:fe5f:664f/64 scope link 2024-09-21T06:16:06.290 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:16:06.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:06.290 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:16:06.384 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-21T06:16:06.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:06.388 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-21T06:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-21T06:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:16:06.425 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:16:06.426 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:16:06.426 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:16:06.426 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-21T06:16:06.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:16:06.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:16:06.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:16:06.427 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-21T06:16:06.545 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:16:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:16:06.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:16:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:16:06.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:06.623 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:16:06.658 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:16:06.658 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:16:06.659 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:16:06.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:06.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-21T06:16:06.757 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:16:06.757 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:16:06.792 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:16:06.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:16:06.792 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:16:06.866 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:16:06.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:06.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:16:07.060 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:16:07.060 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:16:07.093 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:16:07.093 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:16:07.093 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-21T06:16:07.093 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e.cephfs=/ 2024-09-21T06:16:07.093 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2024-09-21T06:16:07.094 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:16:07.095 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:16:07.095 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:16:07.095 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:16:07.095 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:16:07.097 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:16:07.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:07.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:16:07.153 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:16:07.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:16:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:16:07.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-21T06:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:16:07.241 INFO:teuthology.orchestra.run.smithi149.stdout:client8244 2024-09-21T06:16:07.241 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:16:07.241 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:07.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 -- 172.21.15.118:0/3584014445 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c240d1590 msgr2=0x7f7c24142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 --2- 172.21.15.118:0/3584014445 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c240d1590 0x7f7c24142730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009830 tx=0x7f7c0c02a490 comp rx=0 tx=0).stop 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 -- 172.21.15.118:0/3584014445 shutdown_connections 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 --2- 172.21.15.118:0/3584014445 >> v2:172.21.15.149:3300/0 conn(0x7f7c2413fef0 0x7f7c24142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 --2- 172.21.15.118:0/3584014445 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c240d1590 0x7f7c24142730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 -- 172.21.15.118:0/3584014445 >> 172.21.15.118:0/3584014445 conn(0x7f7c2406d110 msgr2=0x7f7c2406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 -- 172.21.15.118:0/3584014445 shutdown_connections 2024-09-21T06:16:07.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.504+0000 7f7c2a800640 1 -- 172.21.15.118:0/3584014445 wait complete. 2024-09-21T06:16:07.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.506+0000 7f7c2a800640 1 Processor -- start 2024-09-21T06:16:07.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.507+0000 7f7c2a800640 1 -- start start 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c2a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c2413fae0 0x7f7c241f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c2a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c2413fef0 0x7f7c2413ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c2a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c24140370 0x7f7c2413b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c2a800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7c240cfb10 con 0x7f7c24140370 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c2a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c240cf990 con 0x7f7c2413fae0 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c2a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7c240cfc90 con 0x7f7c2413fef0 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c24140370 0x7f7c2413b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c24140370 0x7f7c2413b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47778/0 (socket says 172.21.15.118:47778) 2024-09-21T06:16:07.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c23e00640 1 -- 172.21.15.118:0/2382970687 learned_addr learned my addr 172.21.15.118:0/2382970687 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:07.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c23400640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c2413fae0 0x7f7c241f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.508+0000 7f7c1aa00640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c2413fef0 0x7f7c2413ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c23e00640 1 -- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c2413fef0 msgr2=0x7f7c2413ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c23e00640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c2413fef0 0x7f7c2413ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c23e00640 1 -- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c2413fae0 msgr2=0x7f7c241f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c23e00640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c2413fae0 0x7f7c241f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c23e00640 1 -- 172.21.15.118:0/2382970687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c241f7eb0 con 0x7f7c24140370 2024-09-21T06:16:07.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c23e00640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c24140370 0x7f7c2413b2a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00ea80 tx=0x7f7c1c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:07.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c1be00640 1 -- 172.21.15.118:0/2382970687 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004b20 con 0x7f7c24140370 2024-09-21T06:16:07.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c1be00640 1 -- 172.21.15.118:0/2382970687 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c1c004ce0 con 0x7f7c24140370 2024-09-21T06:16:07.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c24141e60 con 0x7f7c24140370 2024-09-21T06:16:07.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c1be00640 1 -- 172.21.15.118:0/2382970687 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c005280 con 0x7f7c24140370 2024-09-21T06:16:07.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.509+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241407e0 con 0x7f7c24140370 2024-09-21T06:16:07.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.510+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c241f7c20 con 0x7f7c24140370 2024-09-21T06:16:07.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.512+0000 7f7c1be00640 1 -- 172.21.15.118:0/2382970687 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c1c005420 con 0x7f7c24140370 2024-09-21T06:16:07.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.513+0000 7f7c1be00640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c00078bc0 0x7f7c0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.513+0000 7f7c1be00640 1 -- 172.21.15.118:0/2382970687 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f7c1c09b950 con 0x7f7c24140370 2024-09-21T06:16:07.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.513+0000 7f7c23400640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c00078bc0 0x7f7c0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.514+0000 7f7c23400640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c00078bc0 0x7f7c0007b0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7c14007fd0 tx=0x7f7c14001370 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:07.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.517+0000 7f7c1be00640 1 -- 172.21.15.118:0/2382970687 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7c1c0636a0 con 0x7f7c24140370 2024-09-21T06:16:07.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.737+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c240d0140 con 0x7f7c24140370 2024-09-21T06:16:07.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.737+0000 7f7c1be00640 1 -- 172.21.15.118:0/2382970687 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7f7c1c0680d0 con 0x7f7c24140370 2024-09-21T06:16:07.739 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:07.739 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:07.739 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:07.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c00078bc0 msgr2=0x7f7c0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c00078bc0 0x7f7c0007b0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7c14007fd0 tx=0x7f7c14001370 comp rx=0 tx=0).stop 2024-09-21T06:16:07.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c24140370 msgr2=0x7f7c2413b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c24140370 0x7f7c2413b2a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00ea80 tx=0x7f7c1c00ef40 comp rx=0 tx=0).stop 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 shutdown_connections 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c24140370 0x7f7c2413b2a0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c00078bc0 0x7f7c0007b0d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c2413fef0 0x7f7c2413ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 --2- 172.21.15.118:0/2382970687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c2413fae0 0x7f7c241f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 >> 172.21.15.118:0/2382970687 conn(0x7f7c2406d110 msgr2=0x7f7c24161380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 shutdown_connections 2024-09-21T06:16:07.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:07.740+0000 7f7c2a800640 1 -- 172.21.15.118:0/2382970687 wait complete. 2024-09-21T06:16:07.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:16:08.003 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":8094,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.439886175,"mdsmap_epoch":95,"osdmap_epoch":177,"osdmap_epoch_barrier":177,"uptime":15.499834496} 2024-09-21T06:16:08.004 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 8094, "mdsmap_epoch": 95, "osdmap_epoch": 177, "osdmap_epoch_barrier": 177, "rank_uptime": 10.439886175, "state": "up:active", "uptime": 15.499834496, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:16:08.004 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.227+0000 7f8afa600640 1 -- 172.21.15.118:0/992346912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 msgr2=0x7f8af40cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.227+0000 7f8afa600640 1 --2- 172.21.15.118:0/992346912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 0x7f8af40cd890 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009830 tx=0x7f8adc02a470 comp rx=0 tx=0).stop 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.227+0000 7f8afa600640 1 -- 172.21.15.118:0/992346912 shutdown_connections 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.227+0000 7f8afa600640 1 --2- 172.21.15.118:0/992346912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8af40cddd0 0x7f8af40cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.227+0000 7f8afa600640 1 --2- 172.21.15.118:0/992346912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 0x7f8af40cd890 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.227+0000 7f8afa600640 1 -- 172.21.15.118:0/992346912 >> 172.21.15.118:0/992346912 conn(0x7f8af406cf30 msgr2=0x7f8af406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.227+0000 7f8afa600640 1 -- 172.21.15.118:0/992346912 shutdown_connections 2024-09-21T06:16:08.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.228+0000 7f8afa600640 1 -- 172.21.15.118:0/992346912 wait complete. 2024-09-21T06:16:08.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.230+0000 7f8afa600640 1 Processor -- start 2024-09-21T06:16:08.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.230+0000 7f8afa600640 1 -- start start 2024-09-21T06:16:08.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.231+0000 7f8afa600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b3e90 0x7f8af4143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.231+0000 7f8afa600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8af40cddd0 0x7f8af41f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.231+0000 7f8afa600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 0x7f8af4153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.231+0000 7f8afa600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8af40cf6e0 con 0x7f8af40b3e90 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.231+0000 7f8afa600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8af40cf560 con 0x7f8af415e090 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.231+0000 7f8afa600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8af40cf860 con 0x7f8af40cddd0 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b3e90 0x7f8af4143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b3e90 0x7f8af4143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47780/0 (socket says 172.21.15.118:47780) 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 -- 172.21.15.118:0/335489084 learned_addr learned my addr 172.21.15.118:0/335489084 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3e00640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 0x7f8af4153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8aeaa00640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8af40cddd0 0x7f8af41f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 -- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8af40cddd0 msgr2=0x7f8af41f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8af40cddd0 0x7f8af41f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 -- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 msgr2=0x7f8af4153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:08.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 0x7f8af4153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 -- 172.21.15.118:0/335489084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af41f6190 con 0x7f8af40b3e90 2024-09-21T06:16:08.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.232+0000 7f8af3400640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b3e90 0x7f8af4143120 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c400 tx=0x7f8ae400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:08.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.233+0000 7f8aebe00640 1 -- 172.21.15.118:0/335489084 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011790 con 0x7f8af40b3e90 2024-09-21T06:16:08.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.233+0000 7f8aebe00640 1 -- 172.21.15.118:0/335489084 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ae4017070 con 0x7f8af40b3e90 2024-09-21T06:16:08.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.233+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af41fa2c0 con 0x7f8af40b3e90 2024-09-21T06:16:08.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.233+0000 7f8aebe00640 1 -- 172.21.15.118:0/335489084 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011cc0 con 0x7f8af40b3e90 2024-09-21T06:16:08.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.233+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af41f6730 con 0x7f8af40b3e90 2024-09-21T06:16:08.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.234+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af41f5fa0 con 0x7f8af40b3e90 2024-09-21T06:16:08.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.235+0000 7f8aebe00640 1 -- 172.21.15.118:0/335489084 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ae401c460 con 0x7f8af40b3e90 2024-09-21T06:16:08.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.236+0000 7f8aebe00640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ad0078bc0 0x7f8ad007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:08.237 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.236+0000 7f8aebe00640 1 -- 172.21.15.118:0/335489084 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5709+0+0 (secure 0 0 0) 0x7f8ae409a940 con 0x7f8af40b3e90 2024-09-21T06:16:08.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.237+0000 7f8aeaa00640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ad0078bc0 0x7f8ad007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:08.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.237+0000 7f8aeaa00640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ad0078bc0 0x7f8ad007b0d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8adc034000 tx=0x7f8adc004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:08.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.241+0000 7f8aebe00640 1 -- 172.21.15.118:0/335489084 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ae40627f0 con 0x7f8af40b3e90 2024-09-21T06:16:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.428+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f8af406a260 con 0x7f8af40b3e90 2024-09-21T06:16:08.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.730+0000 7f8aebe00640 1 -- 172.21.15.118:0/335489084 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v178) ==== 181+0+0 (secure 0 0 0) 0x7f8ae4067220 con 0x7f8af40b3e90 2024-09-21T06:16:08.731 INFO:teuthology.orchestra.run.smithi118.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-21T06:16:08.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ad0078bc0 msgr2=0x7f8ad007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ad0078bc0 0x7f8ad007b0d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8adc034000 tx=0x7f8adc004730 comp rx=0 tx=0).stop 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b3e90 msgr2=0x7f8af4143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b3e90 0x7f8af4143120 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c400 tx=0x7f8ae400c8c0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 shutdown_connections 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8af415e090 0x7f8af4153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8ad0078bc0 0x7f8ad007b0d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8af40cddd0 0x7f8af41f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 --2- 172.21.15.118:0/335489084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8af40b3e90 0x7f8af4143120 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 >> 172.21.15.118:0/335489084 conn(0x7f8af406cf30 msgr2=0x7f8af40737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:08.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.733+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 shutdown_connections 2024-09-21T06:16:08.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:08.734+0000 7f8afa600640 1 -- 172.21.15.118:0/335489084 wait complete. 2024-09-21T06:16:08.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-21T06:16:08.998 INFO:teuthology.orchestra.run.smithi118.stdout:{"osd_mon_report_interval":"5"} 2024-09-21T06:16:08.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-21T06:16:08.998 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-21T06:16:08.999 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:08.999 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:09.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:09.034 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-21T06:16:09.251 INFO:teuthology.orchestra.run.smithi118.stderr:16+0 records in 2024-09-21T06:16:09.266 INFO:teuthology.orchestra.run.smithi118.stderr:16+0 records out 2024-09-21T06:16:09.266 INFO:teuthology.orchestra.run.smithi118.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.136235 s, 123 MB/s 2024-09-21T06:16:09.267 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:09.267 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:09.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:09.304 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-21T06:16:09.515 INFO:teuthology.orchestra.run.smithi118.stderr:17+0 records in 2024-09-21T06:16:09.515 INFO:teuthology.orchestra.run.smithi118.stderr:17+0 records out 2024-09-21T06:16:09.515 INFO:teuthology.orchestra.run.smithi118.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.133038 s, 134 MB/s 2024-09-21T06:16:09.516 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-21T06:16:09.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 -- 172.21.15.118:0/2032163144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c0d1590 msgr2=0x7efd8c142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 --2- 172.21.15.118:0/2032163144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c0d1590 0x7efd8c142730 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7efd8c15d420 tx=0x7efd7c02a560 comp rx=0 tx=0).stop 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 -- 172.21.15.118:0/2032163144 shutdown_connections 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 --2- 172.21.15.118:0/2032163144 >> v2:172.21.15.149:3300/0 conn(0x7efd8c13fef0 0x7efd8c142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 --2- 172.21.15.118:0/2032163144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c0d1590 0x7efd8c142730 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 -- 172.21.15.118:0/2032163144 >> 172.21.15.118:0/2032163144 conn(0x7efd8c06d110 msgr2=0x7efd8c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 -- 172.21.15.118:0/2032163144 shutdown_connections 2024-09-21T06:16:09.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.735+0000 7efd94800640 1 -- 172.21.15.118:0/2032163144 wait complete. 2024-09-21T06:16:09.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.738+0000 7efd94800640 1 Processor -- start 2024-09-21T06:16:09.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.738+0000 7efd94800640 1 -- start start 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd94800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c13fae0 0x7efd8c13aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd94800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd8c13fef0 0x7efd8c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd94800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd8c1f7670 0x7efd8c1f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd94800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c0cfa70 con 0x7efd8c13fae0 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd94800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c0cf8f0 con 0x7efd8c13fef0 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd94800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c0cfbf0 con 0x7efd8c1f7670 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd91e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c13fae0 0x7efd8c13aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd91e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c13fae0 0x7efd8c13aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47784/0 (socket says 172.21.15.118:47784) 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd91e00640 1 -- 172.21.15.118:0/4097776204 learned_addr learned my addr 172.21.15.118:0/4097776204 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:09.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.739+0000 7efd91400640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd8c13fef0 0x7efd8c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd92800640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd8c1f7670 0x7efd8c1f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd91e00640 1 -- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd8c1f7670 msgr2=0x7efd8c1f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd91e00640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd8c1f7670 0x7efd8c1f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd91e00640 1 -- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd8c13fef0 msgr2=0x7efd8c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd91e00640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd8c13fef0 0x7efd8c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd91e00640 1 -- 172.21.15.118:0/4097776204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c15a140 con 0x7efd8c13fae0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd91e00640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c13fae0 0x7efd8c13aed0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c3a0 tx=0x7efd8000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd86000640 1 -- 172.21.15.118:0/4097776204 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80017070 con 0x7efd8c13fae0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd86000640 1 -- 172.21.15.118:0/4097776204 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd800053c0 con 0x7efd8c13fae0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c15a420 con 0x7efd8c13fae0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.740+0000 7efd86000640 1 -- 172.21.15.118:0/4097776204 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80003850 con 0x7efd8c13fae0 2024-09-21T06:16:09.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.741+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c15a9e0 con 0x7efd8c13fae0 2024-09-21T06:16:09.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.742+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8c0d0110 con 0x7efd8c13fae0 2024-09-21T06:16:09.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.743+0000 7efd86000640 1 -- 172.21.15.118:0/4097776204 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd8001a070 con 0x7efd8c13fae0 2024-09-21T06:16:09.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.744+0000 7efd86000640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd70078b90 0x7efd7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:09.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.744+0000 7efd86000640 1 -- 172.21.15.118:0/4097776204 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7efd8009a060 con 0x7efd8c13fae0 2024-09-21T06:16:09.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.744+0000 7efd91400640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd70078b90 0x7efd7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:09.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.745+0000 7efd91400640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd70078b90 0x7efd7007b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7efd7c033000 tx=0x7efd7c004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:09.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.749+0000 7efd86000640 1 -- 172.21.15.118:0/4097776204 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efd80061e40 con 0x7efd8c13fae0 2024-09-21T06:16:09.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.936+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7efd8c15c5f0 con 0x7efd8c13fae0 2024-09-21T06:16:09.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.937+0000 7efd86000640 1 -- 172.21.15.118:0/4097776204 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v178) ==== 81+0+34342 (secure 0 0 0) 0x7efd80066870 con 0x7efd8c13fae0 2024-09-21T06:16:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:09.939 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 178, 2024-09-21T06:16:09.939 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:16:08.724666+0000", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:09.940 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 23, 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.941 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:09.942 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.943 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:09.944 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:09.945 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.946 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.947 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 22, 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:54.926853+0000", 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:09.948 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:09.949 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "176", 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:09.950 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:09.951 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:09.952 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:09.953 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 23, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:55.983460+0000", 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:09.954 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:09.955 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "178", 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:09.956 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:09.957 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:09.958 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:16:09.959 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.960 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.962 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:16:09.964 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.965 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.966 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.967 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.968 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:16:09.969 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:09.970 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.971 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.972 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.973 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.974 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.975 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.977 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.978 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:16:09.979 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:09.981 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.982 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.983 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.984 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.985 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:16:09.986 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.987 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.988 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.990 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.991 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.992 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.993 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:16:09.994 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.995 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.996 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:09.997 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:09.998 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:10.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:10.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:10.002 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:10.003 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:16:10.004 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.005 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.006 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.007 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:10.008 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:16:10.009 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:16:10.010 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:16:10.011 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:16:10.011 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:16:10.011 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:10.011 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:10.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd70078b90 msgr2=0x7efd7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:10.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd70078b90 0x7efd7007b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7efd7c033000 tx=0x7efd7c004730 comp rx=0 tx=0).stop 2024-09-21T06:16:10.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c13fae0 msgr2=0x7efd8c13aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:10.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c13fae0 0x7efd8c13aed0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c3a0 tx=0x7efd8000c860 comp rx=0 tx=0).stop 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 shutdown_connections 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd70078b90 0x7efd7007b0a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd8c1f7670 0x7efd8c1f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd8c13fef0 0x7efd8c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 --2- 172.21.15.118:0/4097776204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd8c13fae0 0x7efd8c13aed0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 >> 172.21.15.118:0/4097776204 conn(0x7efd8c06d110 msgr2=0x7efd8c15fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 shutdown_connections 2024-09-21T06:16:10.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:09.940+0000 7efd94800640 1 -- 172.21.15.118:0/4097776204 wait complete. 2024-09-21T06:16:10.014 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:16:15.015 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:16:15.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 -- 172.21.15.118:0/2058525738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa85413fae0 msgr2=0x7fa8540d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:15.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 --2- 172.21.15.118:0/2058525738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa85413fae0 0x7fa8540d0e80 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa8540ce7c0 tx=0x7fa84402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 -- 172.21.15.118:0/2058525738 shutdown_connections 2024-09-21T06:16:15.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 --2- 172.21.15.118:0/2058525738 >> v2:172.21.15.149:3300/0 conn(0x7fa854142e40 0x7fa8540d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 --2- 172.21.15.118:0/2058525738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa85413fae0 0x7fa8540d0e80 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 -- 172.21.15.118:0/2058525738 >> 172.21.15.118:0/2058525738 conn(0x7fa85406d110 msgr2=0x7fa85406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:15.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 -- 172.21.15.118:0/2058525738 shutdown_connections 2024-09-21T06:16:15.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.243+0000 7fa85b600640 1 -- 172.21.15.118:0/2058525738 wait complete. 2024-09-21T06:16:15.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.246+0000 7fa85b600640 1 Processor -- start 2024-09-21T06:16:15.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.246+0000 7fa85b600640 1 -- start start 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa85b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85413fae0 0x7fa854154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa85b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa85413fef0 0x7fa8541f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa85b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa854142e40 0x7fa8541f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa85b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa8540cfa70 con 0x7fa854142e40 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa85b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8540cf8f0 con 0x7fa85413fae0 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa85b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8540cfbf0 con 0x7fa85413fef0 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa859600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa854142e40 0x7fa8541f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:15.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa859600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa854142e40 0x7fa8541f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47802/0 (socket says 172.21.15.118:47802) 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.247+0000 7fa859600640 1 -- 172.21.15.118:0/2665977665 learned_addr learned my addr 172.21.15.118:0/2665977665 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa858c00640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85413fae0 0x7fa854154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa853e00640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa85413fef0 0x7fa8541f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa859600640 1 -- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa85413fef0 msgr2=0x7fa8541f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa859600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa85413fef0 0x7fa8541f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa859600640 1 -- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85413fae0 msgr2=0x7fa854154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa859600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85413fae0 0x7fa854154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa859600640 1 -- 172.21.15.118:0/2665977665 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85413b260 con 0x7fa854142e40 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa858c00640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85413fae0 0x7fa854154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa859600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa854142e40 0x7fa8541f3ef0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ea80 tx=0x7fa84c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.248+0000 7fa850c00640 1 -- 172.21.15.118:0/2665977665 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00ce40 con 0x7fa854142e40 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.249+0000 7fa850c00640 1 -- 172.21.15.118:0/2665977665 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa84c004b20 con 0x7fa854142e40 2024-09-21T06:16:15.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.249+0000 7fa850c00640 1 -- 172.21.15.118:0/2665977665 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c005020 con 0x7fa854142e40 2024-09-21T06:16:15.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.249+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8541f8190 con 0x7fa854142e40 2024-09-21T06:16:15.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.249+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa854156310 con 0x7fa854142e40 2024-09-21T06:16:15.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.250+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8540d0110 con 0x7fa854142e40 2024-09-21T06:16:15.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.251+0000 7fa850c00640 1 -- 172.21.15.118:0/2665977665 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa84c0051c0 con 0x7fa854142e40 2024-09-21T06:16:15.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.252+0000 7fa850c00640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa834078b90 0x7fa83407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:15.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.252+0000 7fa850c00640 1 -- 172.21.15.118:0/2665977665 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5709+0+0 (secure 0 0 0) 0x7fa84c09b9a0 con 0x7fa854142e40 2024-09-21T06:16:15.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.253+0000 7fa858c00640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa834078b90 0x7fa83407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:15.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.253+0000 7fa858c00640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa834078b90 0x7fa83407b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa844034000 tx=0x7fa844004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:15.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.256+0000 7fa850c00640 1 -- 172.21.15.118:0/2665977665 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa84c063dd0 con 0x7fa854142e40 2024-09-21T06:16:15.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.446+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa8541f8360 con 0x7fa854142e40 2024-09-21T06:16:15.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.448+0000 7fa850c00640 1 -- 172.21.15.118:0/2665977665 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v179) ==== 81+0+34361 (secure 0 0 0) 0x7fa84c0636d0 con 0x7fa854142e40 2024-09-21T06:16:15.450 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:15.450 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 179, 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:16:15.426758+0000", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:16:15.451 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 23, 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:16:15.452 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:15.453 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:15.454 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:15.455 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:15.456 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:15.457 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:16:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 22, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:54.926853+0000", 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:15.459 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:16:15.460 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "176", 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:15.461 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:15.462 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:15.463 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:16:15.464 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:15.465 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 23, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:55.983460+0000", 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:15.466 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:15.467 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "179", 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:15.468 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:15.469 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:15.470 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:15.471 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:15.472 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.473 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.474 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.475 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.476 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.478 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:16:15.479 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.480 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.481 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.482 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:16:15.483 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.484 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:16:15.485 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:16:15.486 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:16:15.487 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:16:15.488 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:15.489 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.490 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:16:15.491 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.492 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.493 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.494 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.495 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.496 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.497 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.498 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.499 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.500 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.501 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.502 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.503 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.504 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.505 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.506 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.507 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.508 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.509 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.510 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.512 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.513 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.514 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.515 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:15.516 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.517 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.518 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.519 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.520 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:16:15.522 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:16:15.523 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:15.524 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:15.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa834078b90 msgr2=0x7fa83407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa834078b90 0x7fa83407b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa844034000 tx=0x7fa844004730 comp rx=0 tx=0).stop 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa854142e40 msgr2=0x7fa8541f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa854142e40 0x7fa8541f3ef0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ea80 tx=0x7fa84c00ef40 comp rx=0 tx=0).stop 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 shutdown_connections 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa854142e40 0x7fa8541f3ef0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa834078b90 0x7fa83407b0a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa85413fef0 0x7fa8541f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 --2- 172.21.15.118:0/2665977665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85413fae0 0x7fa854154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 >> 172.21.15.118:0/2665977665 conn(0x7fa85406d110 msgr2=0x7fa85415ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 shutdown_connections 2024-09-21T06:16:15.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:15.450+0000 7fa85b600640 1 -- 172.21.15.118:0/2665977665 wait complete. 2024-09-21T06:16:15.527 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T06:16:15.527 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:15.527 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:15.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:15.563 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-21T06:16:15.981 INFO:teuthology.orchestra.run.smithi118.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-21T06:16:15.981 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:16:15.982 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:16:15.982 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.337503 s, 155 MB/s 2024-09-21T06:16:15.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:16:15.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:16:16.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 -- 172.21.15.118:0/159531825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0b5bb0 msgr2=0x7fc9ec0b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/159531825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0b5bb0 0x7fc9ec0b5fc0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4005fd0 tx=0x7fc9e402aa10 comp rx=0 tx=0).stop 2024-09-21T06:16:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 -- 172.21.15.118:0/159531825 shutdown_connections 2024-09-21T06:16:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/159531825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0b5bb0 0x7fc9ec0b5fc0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/159531825 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9ec0cfe30 0x7fc9ec0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 -- 172.21.15.118:0/159531825 >> 172.21.15.118:0/159531825 conn(0x7fc9ec06d6e0 msgr2=0x7fc9ec0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 -- 172.21.15.118:0/159531825 shutdown_connections 2024-09-21T06:16:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.200+0000 7fc9f0a00640 1 -- 172.21.15.118:0/159531825 wait complete. 2024-09-21T06:16:16.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.202+0000 7fc9f0a00640 1 Processor -- start 2024-09-21T06:16:16.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.202+0000 7fc9f0a00640 1 -- start start 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9f0a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9ec073fa0 0x7fc9ec1f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9f0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9ec0b5bb0 0x7fc9ec13f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9f0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9f0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec15d9c0 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9f0a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec15d840 con 0x7fc9ec073fa0 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9f0a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ec15db40 con 0x7fc9ec0b5bb0 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9ebe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9ebe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec15a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33418/0 (socket says 172.21.15.118:33418) 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9ebe00640 1 -- 172.21.15.118:0/3164174213 learned_addr learned my addr 172.21.15.118:0/3164174213 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9eb400640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9ec073fa0 0x7fc9ec1f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9e2a00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9ec0b5bb0 0x7fc9ec13f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9ebe00640 1 -- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9ec0b5bb0 msgr2=0x7fc9ec13f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9ebe00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9ec0b5bb0 0x7fc9ec13f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9ebe00640 1 -- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9ec073fa0 msgr2=0x7fc9ec1f9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.204+0000 7fc9ebe00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9ec073fa0 0x7fc9ec1f9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.205+0000 7fc9ebe00640 1 -- 172.21.15.118:0/3164174213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec1f9860 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.205+0000 7fc9ebe00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec15a2b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4006010 tx=0x7fc9e4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.205+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4046070 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.205+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9e4004540 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.205+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec1f9d70 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.205+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4033070 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.205+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec0c9da0 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.206+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec1f9ae0 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.207+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9e4049070 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.208+0000 7fc9e3e00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc9c8078b90 0x7fc9c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.209+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5709+0+0 (secure 0 0 0) 0x7fc9e40bbe70 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.209+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=180}) -- 0x7fc9c8080710 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.209+0000 7fc9eb400640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc9c8078b90 0x7fc9c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.209+0000 7fc9eb400640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc9c8078b90 0x7fc9c807b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc001720 tx=0x7fc9dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:16.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.213+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc9e403e070 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.398+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fc9ec15f1e0 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.399+0000 7fc9e3e00640 1 -- 172.21.15.118:0/3164174213 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v179) ==== 81+0+34361 (secure 0 0 0) 0x7fc9e4083c50 con 0x7fc9ec0cfe30 2024-09-21T06:16:16.402 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:16.402 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:16.402 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 179, 2024-09-21T06:16:16.402 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:16:15.426758+0000", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:16.403 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 23, 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.404 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:16.405 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:16.406 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:16.407 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:16.408 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:16.410 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 22, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:54.926853+0000", 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:16.411 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:16:16.412 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "176", 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:16.413 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:16.414 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:16.415 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.416 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:16.417 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 23, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:55.983460+0000", 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:16.418 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:16.419 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "179", 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:16.420 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:16.421 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:16.422 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:16:16.423 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.424 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:16:16.425 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.427 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.428 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.429 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.430 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:16:16.431 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.432 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.433 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:16.434 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.436 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.437 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.438 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.439 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:16:16.440 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.441 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.442 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.443 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.444 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.445 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.446 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.447 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.448 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.449 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.450 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:16:16.451 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.452 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.453 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.454 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.455 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.456 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.457 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.458 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.459 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.460 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.461 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:16:16.462 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:16.463 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.464 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:16:16.465 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.466 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:16.467 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:16.468 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:16:16.469 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.470 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.471 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:16.472 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.473 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:16.474 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:16:16.475 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:16.476 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc9c8078b90 msgr2=0x7fc9c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc9c8078b90 0x7fc9c807b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc001720 tx=0x7fc9dc009040 comp rx=0 tx=0).stop 2024-09-21T06:16:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0cfe30 msgr2=0x7fc9ec15a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec15a2b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4006010 tx=0x7fc9e4003f10 comp rx=0 tx=0).stop 2024-09-21T06:16:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 shutdown_connections 2024-09-21T06:16:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9ec0cfe30 0x7fc9ec15a2b0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc9c8078b90 0x7fc9c807b0a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9ec0b5bb0 0x7fc9ec13f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 --2- 172.21.15.118:0/3164174213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9ec073fa0 0x7fc9ec1f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 >> 172.21.15.118:0/3164174213 conn(0x7fc9ec06d6e0 msgr2=0x7fc9ec156410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 shutdown_connections 2024-09-21T06:16:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.402+0000 7fc9f0a00640 1 -- 172.21.15.118:0/3164174213 wait complete. 2024-09-21T06:16:16.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 -- 172.21.15.118:0/1761835919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c13fef0 msgr2=0x7f0b7c142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1761835919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c13fef0 0x7f0b7c142c70 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0ceaa0 tx=0x7f0b7402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 -- 172.21.15.118:0/1761835919 shutdown_connections 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1761835919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c13fef0 0x7f0b7c142c70 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1761835919 >> v2:172.21.15.149:3300/0 conn(0x7f0b7c0d1590 0x7f0b7c142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 -- 172.21.15.118:0/1761835919 >> 172.21.15.118:0/1761835919 conn(0x7f0b7c06d110 msgr2=0x7f0b7c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 -- 172.21.15.118:0/1761835919 shutdown_connections 2024-09-21T06:16:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.698+0000 7f0b81a00640 1 -- 172.21.15.118:0/1761835919 wait complete. 2024-09-21T06:16:16.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.700+0000 7f0b81a00640 1 Processor -- start 2024-09-21T06:16:16.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.700+0000 7f0b81a00640 1 -- start start 2024-09-21T06:16:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b81a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c13fae0 0x7f0b7c1f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b81a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b7c13fef0 0x7f0b7c138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b81a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c073bf0 0x7f0b7c1389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b81a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c0cfa70 con 0x7f0b7c073bf0 2024-09-21T06:16:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b81a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c0cf8f0 con 0x7f0b7c13fae0 2024-09-21T06:16:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b81a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c0cfbf0 con 0x7f0b7c13fef0 2024-09-21T06:16:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b7b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c073bf0 0x7f0b7c1389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b7b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c073bf0 0x7f0b7c1389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33438/0 (socket says 172.21.15.118:33438) 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b7b400640 1 -- 172.21.15.118:0/1400809934 learned_addr learned my addr 172.21.15.118:0/1400809934 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b7aa00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c13fae0 0x7f0b7c1f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.702+0000 7f0b7a000640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b7c13fef0 0x7f0b7c138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7b400640 1 -- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b7c13fef0 msgr2=0x7f0b7c138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7b400640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b7c13fef0 0x7f0b7c138470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7b400640 1 -- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c13fae0 msgr2=0x7f0b7c1f9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7b400640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c13fae0 0x7f0b7c1f9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7b400640 1 -- 172.21.15.118:0/1400809934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c139e30 con 0x7f0b7c073bf0 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7aa00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c13fae0 0x7f0b7c1f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7a000640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b7c13fef0 0x7f0b7c138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b7b400640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c073bf0 0x7f0b7c1389b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0b7402aa90 tx=0x7f0b74033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:16.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74031d60 con 0x7f0b7c073bf0 2024-09-21T06:16:16.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b74033e10 con 0x7f0b7c073bf0 2024-09-21T06:16:16.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74005280 con 0x7f0b7c073bf0 2024-09-21T06:16:16.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c13a110 con 0x7f0b7c073bf0 2024-09-21T06:16:16.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.703+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c13a6d0 con 0x7f0b7c073bf0 2024-09-21T06:16:16.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.705+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c0d0110 con 0x7f0b7c073bf0 2024-09-21T06:16:16.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.706+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b74005420 con 0x7f0b7c073bf0 2024-09-21T06:16:16.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.707+0000 7f0b72a00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b5c078bc0 0x7f0b5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:16.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.707+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5709+0+0 (secure 0 0 0) 0x7f0b740bbea0 con 0x7f0b7c073bf0 2024-09-21T06:16:16.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.707+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=180}) -- 0x7f0b5c0807a0 con 0x7f0b7c073bf0 2024-09-21T06:16:16.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.707+0000 7f0b7aa00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b5c078bc0 0x7f0b5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:16.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.708+0000 7f0b7aa00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b5c078bc0 0x7f0b5c07b0d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007fd0 tx=0x7f0b6c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:16.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.711+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b7403f030 con 0x7f0b7c073bf0 2024-09-21T06:16:16.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.933+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b7c139bc0 con 0x7f0b7c073bf0 2024-09-21T06:16:16.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.933+0000 7f0b72a00640 1 -- 172.21.15.118:0/1400809934 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7f0b740842e0 con 0x7f0b7c073bf0 2024-09-21T06:16:16.936 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:16.936 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:16.936 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:16.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b5c078bc0 msgr2=0x7f0b5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b5c078bc0 0x7f0b5c07b0d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007fd0 tx=0x7f0b6c009040 comp rx=0 tx=0).stop 2024-09-21T06:16:16.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c073bf0 msgr2=0x7f0b7c1389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:16.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c073bf0 0x7f0b7c1389b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0b7402aa90 tx=0x7f0b74033c20 comp rx=0 tx=0).stop 2024-09-21T06:16:16.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 shutdown_connections 2024-09-21T06:16:16.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b7c073bf0 0x7f0b7c1389b0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0b5c078bc0 0x7f0b5c07b0d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b7c13fef0 0x7f0b7c138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 --2- 172.21.15.118:0/1400809934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b7c13fae0 0x7f0b7c1f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:16.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.935+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 >> 172.21.15.118:0/1400809934 conn(0x7f0b7c06d110 msgr2=0x7f0b7c15fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:16.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.936+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 shutdown_connections 2024-09-21T06:16:16.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:16.936+0000 7f0b81a00640 1 -- 172.21.15.118:0/1400809934 wait complete. 2024-09-21T06:16:16.963 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:16:17.203 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":8094,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":19.639718512000002,"mdsmap_epoch":95,"osdmap_epoch":179,"osdmap_epoch_barrier":179,"uptime":24.699666744999998} 2024-09-21T06:16:17.203 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 8094, "mdsmap_epoch": 95, "osdmap_epoch": 179, "osdmap_epoch_barrier": 179, "rank_uptime": 19.639718512, "state": "up:active", "uptime": 24.699666745, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:16:17.203 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:16:17.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:17.204 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-21T06:16:17.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:17.241 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-21T06:16:17.332 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 -- 172.21.15.118:0/3805170560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44073fa0 msgr2=0x7efd440749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 --2- 172.21.15.118:0/3805170560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44073fa0 0x7efd440749f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7efd38005fd0 tx=0x7efd3802a540 comp rx=0 tx=0).stop 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 -- 172.21.15.118:0/3805170560 shutdown_connections 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 --2- 172.21.15.118:0/3805170560 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd440b62c0 0x7efd440d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 --2- 172.21.15.118:0/3805170560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44073fa0 0x7efd440749f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 -- 172.21.15.118:0/3805170560 >> 172.21.15.118:0/3805170560 conn(0x7efd4406d6e0 msgr2=0x7efd440b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 -- 172.21.15.118:0/3805170560 shutdown_connections 2024-09-21T06:16:17.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.551+0000 7efd4a600640 1 -- 172.21.15.118:0/3805170560 wait complete. 2024-09-21T06:16:17.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.553+0000 7efd4a600640 1 Processor -- start 2024-09-21T06:16:17.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.554+0000 7efd4a600640 1 -- start start 2024-09-21T06:16:17.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd4a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd44073fa0 0x7efd44159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd4a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd440cfe30 0x7efd44134fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd4a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44145010 0x7efd441354f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd4a600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efd4415da00 con 0x7efd44145010 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd4a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd4415d880 con 0x7efd440cfe30 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd4a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd4415db80 con 0x7efd44073fa0 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd49200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd44073fa0 0x7efd44159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd49c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44145010 0x7efd441354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd49c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44145010 0x7efd441354f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33452/0 (socket says 172.21.15.118:33452) 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd49c00640 1 -- 172.21.15.118:0/1517450093 learned_addr learned my addr 172.21.15.118:0/1517450093 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:17.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.555+0000 7efd43e00640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd440cfe30 0x7efd44134fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:17.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd49c00640 1 -- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd44073fa0 msgr2=0x7efd44159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:17.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd49c00640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd44073fa0 0x7efd44159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd49c00640 1 -- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd440cfe30 msgr2=0x7efd44134fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:17.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd49c00640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd440cfe30 0x7efd44134fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd49c00640 1 -- 172.21.15.118:0/1517450093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4415a350 con 0x7efd44145010 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd49c00640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44145010 0x7efd441354f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e990 tx=0x7efd3c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c004d20 con 0x7efd44145010 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd3c00caa0 con 0x7efd44145010 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c005020 con 0x7efd44145010 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.556+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd44135d30 con 0x7efd44145010 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.557+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd440ca6e0 con 0x7efd44145010 2024-09-21T06:16:17.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.558+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd440ca1f0 con 0x7efd44145010 2024-09-21T06:16:17.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.559+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd3c0051c0 con 0x7efd44145010 2024-09-21T06:16:17.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.560+0000 7efd40c00640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd24078bc0 0x7efd2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:17.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.560+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5709+0+0 (secure 0 0 0) 0x7efd3c09b590 con 0x7efd44145010 2024-09-21T06:16:17.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.560+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=180}) -- 0x7efd24080740 con 0x7efd44145010 2024-09-21T06:16:17.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.560+0000 7efd49200640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd24078bc0 0x7efd2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:17.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.561+0000 7efd49200640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd24078bc0 0x7efd2407b0d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efd38033000 tx=0x7efd38004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:17.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.564+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efd4415a350 con 0x7efd44145010 2024-09-21T06:16:17.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.754+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7efd44132f20 con 0x7efd44145010 2024-09-21T06:16:17.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.755+0000 7efd40c00640 1 -- 172.21.15.118:0/1517450093 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v179) ==== 81+0+34361 (secure 0 0 0) 0x7efd3c016030 con 0x7efd44145010 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 179, 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:16:15.426758+0000", 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:16:17.758 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:16:17.759 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 23, 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:16:17.761 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:17.762 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:17.763 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:17.764 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.765 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 22, 2024-09-21T06:16:17.766 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:54.926853+0000", 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:17.767 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "176", 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:17.768 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:17.769 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:17.770 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.771 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 23, 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:16:17.772 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:55.983460+0000", 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:16:17.773 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "179", 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:17.774 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:17.775 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:17.776 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:16:17.777 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.778 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.779 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.780 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.781 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.782 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:16:17.783 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.784 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.785 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.786 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.788 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.789 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.790 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.791 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:16:17.792 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:17.794 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.795 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:16:17.796 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.797 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.798 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:16:17.799 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.800 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.801 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.802 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.803 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:16:17.804 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.805 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.806 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.807 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.808 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:16:17.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.810 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.815 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:17.816 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.817 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.818 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:17.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:17.820 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.822 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.823 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.824 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:16:17.825 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:17.826 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:17.827 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:17.828 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd24078bc0 msgr2=0x7efd2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd24078bc0 0x7efd2407b0d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efd38033000 tx=0x7efd38004730 comp rx=0 tx=0).stop 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44145010 msgr2=0x7efd441354f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44145010 0x7efd441354f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e990 tx=0x7efd3c00ee50 comp rx=0 tx=0).stop 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 shutdown_connections 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd44145010 0x7efd441354f0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd440cfe30 0x7efd44134fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efd24078bc0 0x7efd2407b0d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 --2- 172.21.15.118:0/1517450093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd44073fa0 0x7efd44159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:17.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 >> 172.21.15.118:0/1517450093 conn(0x7efd4406d6e0 msgr2=0x7efd4415f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:17.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 shutdown_connections 2024-09-21T06:16:17.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:17.758+0000 7efd4a600640 1 -- 172.21.15.118:0/1517450093 wait complete. 2024-09-21T06:16:17.831 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:16:20.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:16:20.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:16:22.832 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 -- 172.21.15.118:0/1108399176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a0142e40 msgr2=0x7fa4a00d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 --2- 172.21.15.118:0/1108399176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a0142e40 0x7fa4a00d13c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa498005fd0 tx=0x7fa49802aa00 comp rx=0 tx=0).stop 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 -- 172.21.15.118:0/1108399176 shutdown_connections 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 --2- 172.21.15.118:0/1108399176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a0142e40 0x7fa4a00d13c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 --2- 172.21.15.118:0/1108399176 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a013fae0 0x7fa4a00d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 -- 172.21.15.118:0/1108399176 >> 172.21.15.118:0/1108399176 conn(0x7fa4a006d110 msgr2=0x7fa4a006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 -- 172.21.15.118:0/1108399176 shutdown_connections 2024-09-21T06:16:23.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.061+0000 7fa4a6200640 1 -- 172.21.15.118:0/1108399176 wait complete. 2024-09-21T06:16:23.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.063+0000 7fa4a6200640 1 Processor -- start 2024-09-21T06:16:23.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.063+0000 7fa4a6200640 1 -- start start 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa4a6200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a013fae0 0x7fa4a0073790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa4a6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a013fef0 0x7fa4a0139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa4a6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a0142e40 0x7fa4a0139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa4a6200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a00cfac0 con 0x7fa4a013fae0 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa4a6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a00cf940 con 0x7fa4a013fef0 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa4a6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a00cfc40 con 0x7fa4a0142e40 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa49f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a013fae0 0x7fa4a0073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa49f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a013fae0 0x7fa4a0073790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:33460/0 (socket says 172.21.15.118:33460) 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa49f400640 1 -- 172.21.15.118:0/2556645422 learned_addr learned my addr 172.21.15.118:0/2556645422 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa49fe00640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a0142e40 0x7fa4a0139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:23.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.065+0000 7fa496a00640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a013fef0 0x7fa4a0139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa49f400640 1 -- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a0142e40 msgr2=0x7fa4a0139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa49f400640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a0142e40 0x7fa4a0139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa49f400640 1 -- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a013fef0 msgr2=0x7fa4a0139dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa49f400640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a013fef0 0x7fa4a0139dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa49f400640 1 -- 172.21.15.118:0/2556645422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a0073fe0 con 0x7fa4a013fae0 2024-09-21T06:16:23.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa49f400640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a013fae0 0x7fa4a0073790 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa49000e9f0 tx=0x7fa49000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49000cd80 con 0x7fa4a013fae0 2024-09-21T06:16:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa490004020 con 0x7fa4a013fae0 2024-09-21T06:16:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.066+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a00742c0 con 0x7fa4a013fae0 2024-09-21T06:16:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.067+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490004470 con 0x7fa4a013fae0 2024-09-21T06:16:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.067+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a0074880 con 0x7fa4a013fae0 2024-09-21T06:16:23.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.068+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a00d00f0 con 0x7fa4a013fae0 2024-09-21T06:16:23.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.069+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4900035f0 con 0x7fa4a013fae0 2024-09-21T06:16:23.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.070+0000 7fa497e00640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa47c078bc0 0x7fa47c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:23.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.070+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5709+0+0 (secure 0 0 0) 0x7fa49009b550 con 0x7fa4a013fae0 2024-09-21T06:16:23.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.070+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=180}) -- 0x7fa47c080740 con 0x7fa4a013fae0 2024-09-21T06:16:23.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.070+0000 7fa496a00640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa47c078bc0 0x7fa47c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:23.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.071+0000 7fa496a00640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa47c078bc0 0x7fa47c07b0d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00b5b00 tx=0x7fa488009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:23.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.074+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa490063330 con 0x7fa4a013fae0 2024-09-21T06:16:23.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.259+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa4a015f2c0 con 0x7fa4a013fae0 2024-09-21T06:16:23.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.260+0000 7fa497e00640 1 -- 172.21.15.118:0/2556645422 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v179) ==== 81+0+34361 (secure 0 0 0) 0x7fa490067d60 con 0x7fa4a013fae0 2024-09-21T06:16:23.264 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:23.264 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:23.264 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 179, 2024-09-21T06:16:23.264 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:23.264 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:16:23.265 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:16:15.426758+0000", 2024-09-21T06:16:23.265 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:16:23.265 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:16:23.265 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:16:23.265 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:16:23.265 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:16:23.266 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:16:23.266 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:16:23.266 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:16:23.266 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:16:23.266 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:23.267 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:16:23.267 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:16:23.267 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:16:23.267 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:16:23.267 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:16:23.267 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 23, 2024-09-21T06:16:23.268 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:16:23.268 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:16:23.268 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:16:23.268 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:16:23.268 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:16:23.268 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:16:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:16:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:16:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:16:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:23.269 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:23.270 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:23.271 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:23.271 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:23.271 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:23.271 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:23.271 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:16:23.272 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:16:23.272 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:16:23.272 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:16:23.272 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:16:23.272 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:23.272 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:23.273 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:23.273 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:23.273 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:23.273 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:23.273 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:23.273 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.273 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:16:23.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:23.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:23.274 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:23.274 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:23.274 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:23.274 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:23.274 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:23.275 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:23.275 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:23.275 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:23.275 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:23.275 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:23.275 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:23.276 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:23.276 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:23.276 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:23.276 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:23.276 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:23.276 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:23.276 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:23.277 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:23.277 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:23.277 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:23.277 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:23.277 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:23.277 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:23.277 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.278 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:23.278 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:23.278 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:23.278 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:23.278 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:23.278 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:23.279 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:16:23.280 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:16:23.280 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.280 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:23.280 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:16:23.280 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.280 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:23.280 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:23.281 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:16:23.281 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:16:23.281 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:16:23.281 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:23.281 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:23.281 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:23.281 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:23.282 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:23.282 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.282 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.282 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.282 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 22, 2024-09-21T06:16:23.282 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:16:23.282 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:54.926853+0000", 2024-09-21T06:16:23.283 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:23.283 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:23.283 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:23.283 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:23.283 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:23.283 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:23.284 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:23.284 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:23.284 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:23.284 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:23.284 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:23.284 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:23.284 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:23.285 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:23.286 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:23.286 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:23.286 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:23.286 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:23.286 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.286 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "176", 2024-09-21T06:16:23.287 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:23.287 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:23.287 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:23.287 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:23.287 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:23.287 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:23.287 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:23.288 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:23.288 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:23.288 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:23.288 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:23.288 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:23.288 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:23.288 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:23.289 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:23.289 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:23.289 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:23.289 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:23.289 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:23.289 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:23.290 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:23.290 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:23.290 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:23.290 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:23.290 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:23.290 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:23.290 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.291 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:23.291 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:23.291 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:23.291 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:23.291 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:23.291 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:23.291 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:23.292 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:23.292 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:23.292 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:23.292 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:23.292 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:23.292 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.293 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.294 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 23, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:55.983460+0000", 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1027, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:23.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:23.296 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "179", 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:23.297 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:23.298 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:23.299 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:16:23.300 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.301 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.302 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.303 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:16:23.304 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.306 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.307 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.308 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.309 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.310 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:16:23.311 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.312 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:16:23.313 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.314 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.317 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.318 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:16:23.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.322 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.324 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:16:23.327 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.328 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:16:23.329 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.330 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.331 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.332 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.333 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:16:23.334 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:16:23.337 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.338 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:23.339 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.342 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.344 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.345 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.347 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:16:23.348 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:23.349 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:16:23.350 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:16:23.351 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:16:23.352 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:16:23.352 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:16:23.352 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:16:23.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:23.352 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:23.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa47c078bc0 msgr2=0x7fa47c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:23.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa47c078bc0 0x7fa47c07b0d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00b5b00 tx=0x7fa488009040 comp rx=0 tx=0).stop 2024-09-21T06:16:23.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a013fae0 msgr2=0x7fa4a0073790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:23.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a013fae0 0x7fa4a0073790 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa49000e9f0 tx=0x7fa49000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 shutdown_connections 2024-09-21T06:16:23.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa47c078bc0 0x7fa47c07b0d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a0142e40 0x7fa4a0139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a013fef0 0x7fa4a0139dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 --2- 172.21.15.118:0/2556645422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4a013fae0 0x7fa4a0073790 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:23.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 >> 172.21.15.118:0/2556645422 conn(0x7fa4a006d110 msgr2=0x7fa4a0155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:23.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 shutdown_connections 2024-09-21T06:16:23.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:23.263+0000 7fa4a6200640 1 -- 172.21.15.118:0/2556645422 wait complete. 2024-09-21T06:16:23.354 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-21T06:16:28.355 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:16:28.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.585+0000 7efe66200640 1 -- 172.21.15.118:0/1308133994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fef0 msgr2=0x7efe60142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:28.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.585+0000 7efe66200640 1 --2- 172.21.15.118:0/1308133994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fef0 0x7efe60142e40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7efe58005fd0 tx=0x7efe5802a8b0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.585+0000 7efe66200640 1 -- 172.21.15.118:0/1308133994 shutdown_connections 2024-09-21T06:16:28.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.585+0000 7efe66200640 1 --2- 172.21.15.118:0/1308133994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fef0 0x7efe60142e40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.585+0000 7efe66200640 1 -- 172.21.15.118:0/1308133994 >> 172.21.15.118:0/1308133994 conn(0x7efe6006d110 msgr2=0x7efe6006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:28.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.585+0000 7efe66200640 1 -- 172.21.15.118:0/1308133994 shutdown_connections 2024-09-21T06:16:28.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.585+0000 7efe66200640 1 -- 172.21.15.118:0/1308133994 wait complete. 2024-09-21T06:16:28.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.588+0000 7efe66200640 1 Processor -- start 2024-09-21T06:16:28.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.588+0000 7efe66200640 1 -- start start 2024-09-21T06:16:28.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe66200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fae0 0x7efe60136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:28.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe66200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6013fef0 0x7efe6013b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:28.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe66200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe60140370 0x7efe6013b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:28.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe66200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efe60168280 con 0x7efe6013fae0 2024-09-21T06:16:28.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe66200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe60168100 con 0x7efe60140370 2024-09-21T06:16:28.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe66200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe60168400 con 0x7efe6013fef0 2024-09-21T06:16:28.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe5f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fae0 0x7efe60136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:28.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe5f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fae0 0x7efe60136ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38608/0 (socket says 172.21.15.118:38608) 2024-09-21T06:16:28.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.589+0000 7efe5f400640 1 -- 172.21.15.118:0/928080496 learned_addr learned my addr 172.21.15.118:0/928080496 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:28.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe5fe00640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe60140370 0x7efe6013b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:28.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe56a00640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6013fef0 0x7efe6013b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:28.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe5f400640 1 -- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6013fef0 msgr2=0x7efe6013b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:28.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe5f400640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6013fef0 0x7efe6013b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe5f400640 1 -- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe60140370 msgr2=0x7efe6013b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe5f400640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe60140370 0x7efe6013b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe5f400640 1 -- 172.21.15.118:0/928080496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe60158680 con 0x7efe6013fae0 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe5f400640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fae0 0x7efe60136ea0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c430 tx=0x7efe5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe57e00640 1 -- 172.21.15.118:0/928080496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50011790 con 0x7efe6013fae0 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe57e00640 1 -- 172.21.15.118:0/928080496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe50017070 con 0x7efe6013fae0 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6015ac00 con 0x7efe6013fae0 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.590+0000 7efe57e00640 1 -- 172.21.15.118:0/928080496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50011ce0 con 0x7efe6013fae0 2024-09-21T06:16:28.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.591+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe601580c0 con 0x7efe6013fae0 2024-09-21T06:16:28.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.592+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe600d0e80 con 0x7efe6013fae0 2024-09-21T06:16:28.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.593+0000 7efe57e00640 1 -- 172.21.15.118:0/928080496 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe5001c460 con 0x7efe6013fae0 2024-09-21T06:16:28.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.594+0000 7efe57e00640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efe3c078b90 0x7efe3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:28.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.594+0000 7efe57e00640 1 -- 172.21.15.118:0/928080496 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7efe5009ab90 con 0x7efe6013fae0 2024-09-21T06:16:28.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.595+0000 7efe56a00640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efe3c078b90 0x7efe3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:28.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.595+0000 7efe56a00640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efe3c078b90 0x7efe3c07b0a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efe601578a0 tx=0x7efe48009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:28.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.599+0000 7efe57e00640 1 -- 172.21.15.118:0/928080496 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efe50062fc0 con 0x7efe6013fae0 2024-09-21T06:16:28.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.793+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7efe60161090 con 0x7efe6013fae0 2024-09-21T06:16:28.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.794+0000 7efe57e00640 1 -- 172.21.15.118:0/928080496 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v180) ==== 81+0+34342 (secure 0 0 0) 0x7efe500628c0 con 0x7efe6013fae0 2024-09-21T06:16:28.797 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:28.797 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:28.797 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 180, 2024-09-21T06:16:28.797 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:28.797 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:16:25.429694+0000", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:16:28.798 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 23, 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:16:28.799 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:16:28.800 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:28.801 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:28.802 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:28.803 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:16:28.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 22, 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:16:28.805 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:54.926853+0000", 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:16:28.806 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "176", 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:28.807 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:28.808 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:28.809 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:28.810 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 23, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:55.983460+0000", 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:28.812 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:28.813 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "180", 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:16:28.814 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:28.815 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:28.816 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:28.817 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.818 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.819 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.820 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:16:28.821 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:16:28.822 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:28.823 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.824 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:16:28.825 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:16:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.828 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.829 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.830 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.831 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.832 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:16:28.833 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.835 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.836 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.837 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:16:28.838 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.839 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.840 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.841 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.842 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.843 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.844 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.845 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.846 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.847 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.848 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:16:28.849 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.850 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:16:28.851 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:16:28.852 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.853 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:28.854 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:28.855 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.856 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.857 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.858 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:28.859 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:16:28.860 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.861 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.862 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.863 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.864 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.865 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:16:28.866 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:16:28.867 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:28.868 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:28.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.797+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efe3c078b90 msgr2=0x7efe3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:28.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.797+0000 7efe66200640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efe3c078b90 0x7efe3c07b0a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efe601578a0 tx=0x7efe48009040 comp rx=0 tx=0).stop 2024-09-21T06:16:28.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.797+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fae0 msgr2=0x7efe60136ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:28.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.797+0000 7efe66200640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fae0 0x7efe60136ea0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c430 tx=0x7efe5000c8f0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 shutdown_connections 2024-09-21T06:16:28.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe60140370 0x7efe6013b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7efe3c078b90 0x7efe3c07b0a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe6013fef0 0x7efe6013b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 --2- 172.21.15.118:0/928080496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe6013fae0 0x7efe60136ea0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 >> 172.21.15.118:0/928080496 conn(0x7efe6006d110 msgr2=0x7efe60142730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:28.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 shutdown_connections 2024-09-21T06:16:28.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:28.798+0000 7efe66200640 1 -- 172.21.15.118:0/928080496 wait complete. 2024-09-21T06:16:28.871 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-21T06:16:28.872 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-21T06:16:29.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.089+0000 7f63ec400640 1 -- 172.21.15.118:0/517016199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 msgr2=0x7f63e40cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.089+0000 7f63ec400640 1 --2- 172.21.15.118:0/517016199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e40cca40 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f63e40b5db0 tx=0x7f63d002a560 comp rx=0 tx=0).stop 2024-09-21T06:16:29.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.090+0000 7f63ec400640 1 -- 172.21.15.118:0/517016199 shutdown_connections 2024-09-21T06:16:29.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.090+0000 7f63ec400640 1 --2- 172.21.15.118:0/517016199 >> v2:172.21.15.149:3300/0 conn(0x7f63e40ccf80 0x7f63e4073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.090+0000 7f63ec400640 1 --2- 172.21.15.118:0/517016199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e40cca40 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.090+0000 7f63ec400640 1 -- 172.21.15.118:0/517016199 >> 172.21.15.118:0/517016199 conn(0x7f63e406d110 msgr2=0x7f63e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:29.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.090+0000 7f63ec400640 1 -- 172.21.15.118:0/517016199 shutdown_connections 2024-09-21T06:16:29.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.090+0000 7f63ec400640 1 -- 172.21.15.118:0/517016199 wait complete. 2024-09-21T06:16:29.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.092+0000 7f63ec400640 1 Processor -- start 2024-09-21T06:16:29.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.092+0000 7f63ec400640 1 -- start start 2024-09-21T06:16:29.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.093+0000 7f63ec400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e41f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.093+0000 7f63ec400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63e40ccf80 0x7f63e40cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.093+0000 7f63ec400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63e415cfd0 0x7f63e415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.093+0000 7f63ec400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4073c40 con 0x7f63e40b3a60 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.093+0000 7f63ec400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4073ac0 con 0x7f63e415cfd0 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.093+0000 7f63ec400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f63e4073dc0 con 0x7f63e40ccf80 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e41f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e41f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38622/0 (socket says 172.21.15.118:38622) 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 -- 172.21.15.118:0/149020750 learned_addr learned my addr 172.21.15.118:0/149020750 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9000640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63e40ccf80 0x7f63e40cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63ea400640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63e415cfd0 0x7f63e415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 -- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63e40ccf80 msgr2=0x7f63e40cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63e40ccf80 0x7f63e40cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 -- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63e415cfd0 msgr2=0x7f63e415aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63e415cfd0 0x7f63e415aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 -- 172.21.15.118:0/149020750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40ce8f0 con 0x7f63e40b3a60 2024-09-21T06:16:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.094+0000 7f63e9a00640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e41f5cf0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f63d800b3f0 tx=0x7f63d800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.095+0000 7f63e1600640 1 -- 172.21.15.118:0/149020750 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8015020 con 0x7f63e40b3a60 2024-09-21T06:16:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.095+0000 7f63e1600640 1 -- 172.21.15.118:0/149020750 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63d8011920 con 0x7f63e40b3a60 2024-09-21T06:16:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.095+0000 7f63e1600640 1 -- 172.21.15.118:0/149020750 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8011d70 con 0x7f63e40b3a60 2024-09-21T06:16:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.095+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e40cebd0 con 0x7f63e40b3a60 2024-09-21T06:16:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.095+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e40cf190 con 0x7f63e40b3a60 2024-09-21T06:16:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.096+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e40cca20 con 0x7f63e40b3a60 2024-09-21T06:16:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.097+0000 7f63e1600640 1 -- 172.21.15.118:0/149020750 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63d8018020 con 0x7f63e40b3a60 2024-09-21T06:16:29.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.098+0000 7f63e1600640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63c4078bf0 0x7f63c407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.098+0000 7f63e1600640 1 -- 172.21.15.118:0/149020750 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7f63d809a8b0 con 0x7f63e40b3a60 2024-09-21T06:16:29.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.099+0000 7f63e9000640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63c4078bf0 0x7f63c407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.099+0000 7f63e9000640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63c4078bf0 0x7f63c407b100 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f63d0033000 tx=0x7f63d0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:29.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.102+0000 7f63e1600640 1 -- 172.21.15.118:0/149020750 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f63d801f030 con 0x7f63e40b3a60 2024-09-21T06:16:29.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.288+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f63e4145820 con 0x7f63e40b3a60 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.289+0000 7f63e1600640 1 -- 172.21.15.118:0/149020750 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v180) ==== 81+0+34342 (secure 0 0 0) 0x7f63d8062690 con 0x7f63e40b3a60 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "epoch": 180, 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "created": "2024-09-21T06:03:35.301335+0000", 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "modified": "2024-09-21T06:16:25.429694+0000", 2024-09-21T06:16:29.292 INFO:teuthology.orchestra.run.smithi118.stdout: "last_up_change": "2024-09-21T06:03:43.992201+0000", 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "last_in_change": "2024-09-21T06:03:40.985886+0000", 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_num": 5799936, 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_set": [ 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "pglog_hardlimit", 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "purged_snapdirs", 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_deletes", 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "sortbitwise" 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_version": 4, 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "full_ratio": 0.69999998807907104, 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_snapshot": "", 2024-09-21T06:16:29.293 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_max": 23, 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "max_osd": 8, 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "require_min_compat_client": "luminous", 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "min_compat_client": "jewel", 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "require_osd_release": "squid", 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "allow_crimson": false, 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "pools": [ 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 1, 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": ".mgr", 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:03:44.483842+0000", 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:29.294 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 1, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 1, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 1, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 1, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 1, 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:29.295 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "106", 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:29.296 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:29.297 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:29.298 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_max": 32, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 1 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": {} 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 8, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 8, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 0.25, 2024-09-21T06:16:29.299 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 22, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_metadata", 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:54.926853+0000", 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:29.300 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 32, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 32, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 32, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 32, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 32, 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "176", 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:29.302 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 0, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:29.303 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:29.304 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_bias": 4, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 16, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_priority": 5 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": "cephfs" 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 2, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 2, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:29.305 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 2, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 2, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "pool": 23, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_name": "cephfs_data", 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "create_time": "2024-09-21T06:15:55.983460+0000", 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "flags": 1, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "flags_names": "hashpspool", 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "type": 1, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "size": 2, 2024-09-21T06:16:29.306 INFO:teuthology.orchestra.run.smithi118.stdout: "min_size": 1, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_rule": 0, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_count": 0, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_target": 0, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "is_stretch_pool": false, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "object_hash": 2, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_autoscale_mode": "off", 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num": 64, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num": 64, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_placement_num_target": 64, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_target": 64, 2024-09-21T06:16:29.307 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_pending": 64, 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_pg_merge_meta": { 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "source_pgid": "0.0", 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "ready_epoch": 0, 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_started": 0, 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_epoch_clean": 0, 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "source_version": "0'0", 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "target_version": "0'0" 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_change": "180", 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend": "0", 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T06:16:29.308 INFO:teuthology.orchestra.run.smithi118.stdout: "auid": 0, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_mode": "selfmanaged", 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_seq": 0, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "snap_epoch": 0, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "pool_snaps": [], 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps": "[]", 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_bytes": 33554432, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "quota_max_objects": 0, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "tiers": [], 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "tier_of": -1, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "read_tier": -1, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "write_tier": -1, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_mode": "none", 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_bytes": 0, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "target_max_objects": 0, 2024-09-21T06:16:29.309 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_flush_age": 0, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "cache_min_evict_age": 0, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profile": "", 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_params": { 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "none" 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_period": 0, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_count": 0, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "use_gmt_hitset": true, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "min_read_recency_for_promote": 0, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "min_write_recency_for_promote": 0, 2024-09-21T06:16:29.310 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "hit_set_search_last_n": 0, 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "grade_table": [], 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "stripe_width": 0, 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "expected_num_objects": 0, 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "fast_read": false, 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "options": { 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_num_min": 64, 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "target_size_ratio": 0.89999997615814209 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "application_metadata": { 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "cephfs": { 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: "data": "cephfs" 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.311 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "read_balance": { 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "score_type": "Fair distribution", 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "score_acting": 1.3799999952316284, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "score_stable": 1.3799999952316284, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "optimal_score": 1, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity_weighted": 1, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity": 1, 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "average_primary_affinity_weighted": 1 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:29.312 INFO:teuthology.orchestra.run.smithi118.stdout: "osds": [ 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.313 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6811", 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6813", 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.314 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6815", 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6817", 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.315 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6822", 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6823", 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.316 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6819", 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6821", 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3230871877 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6813/3230871877", 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6817/3230871877", 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6823/3230871877", 2024-09-21T06:16:29.317 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6821/3230871877", 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.318 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6808", 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.319 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6809", 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6810", 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.320 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6812", 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6818", 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6820", 2024-09-21T06:16:29.321 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6814", 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.322 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6816", 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3649321090 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6809/3649321090", 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6812/3649321090", 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6820/3649321090", 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6816/3649321090", 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.323 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.324 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6824", 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6825", 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6826", 2024-09-21T06:16:29.325 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6827", 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6830", 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.326 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6831", 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6828", 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.327 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6829", 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2733819645 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6825/2733819645", 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6827/2733819645", 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6831/2733819645", 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6829/2733819645", 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.328 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.329 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6800", 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6801", 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6802", 2024-09-21T06:16:29.330 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6803", 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6806", 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.331 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6807", 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6804", 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.332 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:6805", 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2396738504 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.118:6801/2396738504", 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.118:6803/2396738504", 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.118:6807/2396738504", 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.118:6805/2396738504", 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.333 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.334 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6805", 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6807", 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.335 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6810", 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6813", 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.336 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6820", 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6822", 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.337 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6816", 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6818", 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2084856893 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6807/2084856893", 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6813/2084856893", 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6822/2084856893", 2024-09-21T06:16:29.338 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6818/2084856893", 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.339 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6802", 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6803", 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.340 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6804", 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6806", 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6812", 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6815", 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.342 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6808", 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6809", 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1726198958 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6803/1726198958", 2024-09-21T06:16:29.343 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6806/1726198958", 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6815/1726198958", 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6809/1726198958", 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.344 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6811", 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.345 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6814", 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6817", 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.346 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6819", 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6824", 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.347 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6825", 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6821", 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.348 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6823", 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3763347027 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6814/3763347027", 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6819/3763347027", 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6825/3763347027", 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6823/3763347027", 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "up": 1, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "in": 1, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "weight": 1, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_affinity": 1, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_begin": 0, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "last_clean_end": 0, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "up_from": 13, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "up_thru": 175, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "down_at": 0, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "lost_at": 0, 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addrs": { 2024-09-21T06:16:29.350 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6826", 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6827", 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addrs": { 2024-09-21T06:16:29.351 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6828", 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6829", 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addrs": { 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.352 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6832", 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6833", 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addrs": { 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: "addrvec": [ 2024-09-21T06:16:29.353 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v2", 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6830", 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.149:6831", 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2881805415 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "public_addr": "172.21.15.149:6827/2881805415", 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_addr": "172.21.15.149:6829/2881805415", 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_back_addr": "172.21.15.149:6833/2881805415", 2024-09-21T06:16:29.354 INFO:teuthology.orchestra.run.smithi118.stdout: "heartbeat_front_addr": "172.21.15.149:6831/2881805415", 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "state": [ 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "exists", 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "up" 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_xinfo": [ 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 0, 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.355 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.341206+0000", 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 1, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.318113+0000", 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 2, 2024-09-21T06:16:29.356 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.325079+0000", 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 3, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.357 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.304772+0000", 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 4, 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.241111+0000", 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.358 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 5, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.242897+0000", 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 6, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.359 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.231845+0000", 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": 7, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "down_stamp": "0.000000", 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_probability": 0, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "laggy_interval": 0, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "features": 4540719139924082687, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "old_weight": 0, 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "last_purged_snaps_scrub": "2024-09-21T06:03:42.321191+0000", 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: "dead_epoch": 0 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.360 INFO:teuthology.orchestra.run.smithi118.stdout: ], 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap": [], 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_items": [], 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_upmap_primaries": [], 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "pg_temp": [], 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "primary_temp": [], 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklist": {}, 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "range_blocklist": {}, 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "erasure_code_profiles": { 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "default": { 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "crush-failure-domain": "osd", 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "k": "2", 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "m": "1", 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "plugin": "jerasure", 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: "technique": "reed_sol_van" 2024-09-21T06:16:29.361 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "removed_snaps_queue": [], 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "new_removed_snaps": [], 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "new_purged_snaps": [], 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "crush_node_flags": {}, 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "device_class_flags": {}, 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode": { 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_enabled": false, 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_bucket_count": 0, 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "degraded_stretch_mode": 0, 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "recovering_stretch_mode": 0, 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: "stretch_mode_bucket": 0 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-21T06:16:29.362 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63c4078bf0 msgr2=0x7f63c407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63c4078bf0 0x7f63c407b100 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f63d0033000 tx=0x7f63d0004730 comp rx=0 tx=0).stop 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 msgr2=0x7f63e41f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e41f5cf0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f63d800b3f0 tx=0x7f63d800b8b0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 shutdown_connections 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63e415cfd0 0x7f63e415aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f63c4078bf0 0x7f63c407b100 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f63e40ccf80 0x7f63e40cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 --2- 172.21.15.118:0/149020750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63e40b3a60 0x7f63e41f5cf0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 >> 172.21.15.118:0/149020750 conn(0x7f63e406d110 msgr2=0x7f63e4156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:29.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 shutdown_connections 2024-09-21T06:16:29.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.292+0000 7f63ec400640 1 -- 172.21.15.118:0/149020750 wait complete. 2024-09-21T06:16:29.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:29.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.586+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1993707536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 msgr2=0x7fe1f40749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.586+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1993707536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f40749d0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400a940 tx=0x7fe1e402b850 comp rx=0 tx=0).stop 2024-09-21T06:16:29.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.586+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1993707536 shutdown_connections 2024-09-21T06:16:29.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.586+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1993707536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f40749d0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.586+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1993707536 >> 172.21.15.118:0/1993707536 conn(0x7fe1f406d6e0 msgr2=0x7fe1f40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:29.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.586+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1993707536 shutdown_connections 2024-09-21T06:16:29.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.586+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1993707536 wait complete. 2024-09-21T06:16:29.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.588+0000 7fe1f9c00640 1 Processor -- start 2024-09-21T06:16:29.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.588+0000 7fe1f9c00640 1 -- start start 2024-09-21T06:16:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f9c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1f4073180 0x7fe1f41f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f9c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f41522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f415ea10 0x7fe1f40b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f9c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f4070d30 con 0x7fe1f415ae10 2024-09-21T06:16:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f4070bb0 con 0x7fe1f415ea10 2024-09-21T06:16:29.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f9c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f4073ca0 con 0x7fe1f4073180 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f41522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f41522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38650/0 (socket says 172.21.15.118:38650) 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 -- 172.21.15.118:0/1745278327 learned_addr learned my addr 172.21.15.118:0/1745278327 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3e00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1f4073180 0x7fe1f41f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f9200640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f415ea10 0x7fe1f40b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 -- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1f4073180 msgr2=0x7fe1f41f10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1f4073180 0x7fe1f41f10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 -- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f415ea10 msgr2=0x7fe1f40b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f415ea10 0x7fe1f40b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.590+0000 7fe1f3400640 1 -- 172.21.15.118:0/1745278327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f40ab6c0 con 0x7fe1f415ae10 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.591+0000 7fe1f3400640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f41522b0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c3d0 tx=0x7fe1e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.591+0000 7fe1ebe00640 1 -- 172.21.15.118:0/1745278327 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0017070 con 0x7fe1f415ae10 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.591+0000 7fe1ebe00640 1 -- 172.21.15.118:0/1745278327 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1e00053c0 con 0x7fe1f415ae10 2024-09-21T06:16:29.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.591+0000 7fe1ebe00640 1 -- 172.21.15.118:0/1745278327 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0003850 con 0x7fe1f415ae10 2024-09-21T06:16:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.591+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f41f4340 con 0x7fe1f415ae10 2024-09-21T06:16:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.591+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f41f4900 con 0x7fe1f415ae10 2024-09-21T06:16:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.592+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f4074150 con 0x7fe1f415ae10 2024-09-21T06:16:29.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.594+0000 7fe1ebe00640 1 -- 172.21.15.118:0/1745278327 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1e001a070 con 0x7fe1f415ae10 2024-09-21T06:16:29.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.594+0000 7fe1ebe00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe1d4078b90 0x7fe1d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:29.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.595+0000 7fe1ebe00640 1 -- 172.21.15.118:0/1745278327 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7fe1e009a010 con 0x7fe1f415ae10 2024-09-21T06:16:29.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.595+0000 7fe1f3e00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe1d4078b90 0x7fe1d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:29.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.596+0000 7fe1f3e00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe1d4078b90 0x7fe1d407b0a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4036000 tx=0x7fe1e4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:29.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.599+0000 7fe1ebe00640 1 -- 172.21.15.118:0/1745278327 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe1e0061e00 con 0x7fe1f415ae10 2024-09-21T06:16:29.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.820+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1f40ad5c0 con 0x7fe1f415ae10 2024-09-21T06:16:29.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.821+0000 7fe1ebe00640 1 -- 172.21.15.118:0/1745278327 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7fe1e0066830 con 0x7fe1f415ae10 2024-09-21T06:16:29.824 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:29.824 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.823+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe1d4078b90 msgr2=0x7fe1d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.823+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe1d4078b90 0x7fe1d407b0a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4036000 tx=0x7fe1e4004730 comp rx=0 tx=0).stop 2024-09-21T06:16:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.823+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 msgr2=0x7fe1f41522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.823+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f41522b0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c3d0 tx=0x7fe1e000c890 comp rx=0 tx=0).stop 2024-09-21T06:16:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 shutdown_connections 2024-09-21T06:16:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1f415ea10 0x7fe1f40b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1f415ae10 0x7fe1f41522b0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fe1d4078b90 0x7fe1d407b0a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 --2- 172.21.15.118:0/1745278327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1f4073180 0x7fe1f41f10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 >> 172.21.15.118:0/1745278327 conn(0x7fe1f406d6e0 msgr2=0x7fe1f40cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 shutdown_connections 2024-09-21T06:16:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:29.824+0000 7fe1f9c00640 1 -- 172.21.15.118:0/1745278327 wait complete. 2024-09-21T06:16:29.849 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-21T06:16:30.088 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","whoami":0,"id":8094,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":32.524628845999999,"mdsmap_epoch":95,"osdmap_epoch":180,"osdmap_epoch_barrier":179,"uptime":37.584576785000003} 2024-09-21T06:16:30.089 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e", "fs_name": "cephfs", "id": 8094, "mdsmap_epoch": 95, "osdmap_epoch": 180, "osdmap_epoch_barrier": 179, "rank_uptime": 32.524628846, "state": "up:active", "uptime": 37.584576785, "want_state": "up:active", "whoami": 0 } 2024-09-21T06:16:30.089 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T06:16:30.089 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:30.089 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:30.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:30.124 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-21T06:16:30.571 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records in 2024-09-21T06:16:30.571 INFO:teuthology.orchestra.run.smithi118.stderr:50+0 records out 2024-09-21T06:16:30.571 INFO:teuthology.orchestra.run.smithi118.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.369651 s, 142 MB/s 2024-09-21T06:16:30.572 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:16:30.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:16:30.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:16:30.769 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:16:30.769 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:16:30.770 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:30.770 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:30.806 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:30.806 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:30.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:16:31.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 -- 172.21.15.118:0/673316435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000073fa0 msgr2=0x7fc0000749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 --2- 172.21.15.118:0/673316435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000073fa0 0x7fc0000749f0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fc00015d2e0 tx=0x7fbff002a560 comp rx=0 tx=0).stop 2024-09-21T06:16:31.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 -- 172.21.15.118:0/673316435 shutdown_connections 2024-09-21T06:16:31.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 --2- 172.21.15.118:0/673316435 >> v2:172.21.15.149:3300/0 conn(0x7fc0000b62c0 0x7fc0000d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 --2- 172.21.15.118:0/673316435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc000073fa0 0x7fc0000749f0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 -- 172.21.15.118:0/673316435 >> 172.21.15.118:0/673316435 conn(0x7fc00006d6e0 msgr2=0x7fc0000b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:31.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 -- 172.21.15.118:0/673316435 shutdown_connections 2024-09-21T06:16:31.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.139+0000 7fbfffe00640 1 -- 172.21.15.118:0/673316435 wait complete. 2024-09-21T06:16:31.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.141+0000 7fbfffe00640 1 Processor -- start 2024-09-21T06:16:31.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.141+0000 7fbfffe00640 1 -- start start 2024-09-21T06:16:31.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfffe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc000073fa0 0x7fc0001e6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfffe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0000cfe30 0x7fc0000cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfffe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000cbbc0 0x7fc0001f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfffe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc00015da00 con 0x7fc0000cbbc0 2024-09-21T06:16:31.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfffe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc00015d880 con 0x7fc000073fa0 2024-09-21T06:16:31.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfffe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc00015db80 con 0x7fc0000cfe30 2024-09-21T06:16:31.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000cbbc0 0x7fc0001f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfff400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000cbbc0 0x7fc0001f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38664/0 (socket says 172.21.15.118:38664) 2024-09-21T06:16:31.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfff400640 1 -- 172.21.15.118:0/587882699 learned_addr learned my addr 172.21.15.118:0/587882699 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:31.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbff6000640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0000cfe30 0x7fc0000cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbffea00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc000073fa0 0x7fc0001e6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.143+0000 7fbfff400640 1 -- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0000cfe30 msgr2=0x7fc0000cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbfff400640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0000cfe30 0x7fc0000cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbfff400640 1 -- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc000073fa0 msgr2=0x7fc0001e6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbfff400640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc000073fa0 0x7fc0001e6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbfff400640 1 -- 172.21.15.118:0/587882699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0000cbfd0 con 0x7fc0000cbbc0 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbffea00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc000073fa0 0x7fc0001e6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbfff400640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000cbbc0 0x7fc0001f5d00 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fbff800da10 tx=0x7fbff800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:31.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbff7400640 1 -- 172.21.15.118:0/587882699 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8017070 con 0x7fc0000cbbc0 2024-09-21T06:16:31.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbff7400640 1 -- 172.21.15.118:0/587882699 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbff8003970 con 0x7fc0000cbbc0 2024-09-21T06:16:31.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc000157a90 con 0x7fc0000cbbc0 2024-09-21T06:16:31.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbff7400640 1 -- 172.21.15.118:0/587882699 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff800be60 con 0x7fc0000cbbc0 2024-09-21T06:16:31.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.144+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc000158050 con 0x7fc0000cbbc0 2024-09-21T06:16:31.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.145+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0000cf450 con 0x7fc0000cbbc0 2024-09-21T06:16:31.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.147+0000 7fbff7400640 1 -- 172.21.15.118:0/587882699 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbff8010460 con 0x7fc0000cbbc0 2024-09-21T06:16:31.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.147+0000 7fbff7400640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbfdc078bc0 0x7fbfdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.148+0000 7fbff7400640 1 -- 172.21.15.118:0/587882699 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7fbff809b200 con 0x7fc0000cbbc0 2024-09-21T06:16:31.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.148+0000 7fbffea00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbfdc078bc0 0x7fbfdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.148+0000 7fbffea00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbfdc078bc0 0x7fbfdc07b0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbff0033000 tx=0x7fbff0004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:31.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.152+0000 7fbff7400640 1 -- 172.21.15.118:0/587882699 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc0000cf450 con 0x7fc0000cbbc0 2024-09-21T06:16:31.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.349+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc00015e030 con 0x7fc0000cbbc0 2024-09-21T06:16:31.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.349+0000 7fbff7400640 1 -- 172.21.15.118:0/587882699 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v180) ==== 80+0+0 (secure 0 0 0) 0x7fc0000cbfd0 con 0x7fc0000cbbc0 2024-09-21T06:16:31.352 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:16:31.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbfdc078bc0 msgr2=0x7fbfdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbfdc078bc0 0x7fbfdc07b0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbff0033000 tx=0x7fbff0004730 comp rx=0 tx=0).stop 2024-09-21T06:16:31.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000cbbc0 msgr2=0x7fc0001f5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000cbbc0 0x7fc0001f5d00 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fbff800da10 tx=0x7fbff800ded0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 shutdown_connections 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0000cbbc0 0x7fc0001f5d00 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbfdc078bc0 0x7fbfdc07b0d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0000cfe30 0x7fc0000cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 --2- 172.21.15.118:0/587882699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc000073fa0 0x7fc0001e6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 >> 172.21.15.118:0/587882699 conn(0x7fc00006d6e0 msgr2=0x7fc00015af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 shutdown_connections 2024-09-21T06:16:31.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.352+0000 7fbfffe00640 1 -- 172.21.15.118:0/587882699 wait complete. 2024-09-21T06:16:31.378 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:16:31.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:31.378 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:16:31.469 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:16:31.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:31.470 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:16:31.521 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:16:31.521 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:16:31.521 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:31.556 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:16:31.557 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:31.632 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:16:31.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 -- 172.21.15.118:0/2864553364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd415cfd0 msgr2=0x7f6bd40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 --2- 172.21.15.118:0/2864553364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd415cfd0 0x7f6bd40b3a60 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40b5db0 tx=0x7f6bc402a560 comp rx=0 tx=0).stop 2024-09-21T06:16:31.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 -- 172.21.15.118:0/2864553364 shutdown_connections 2024-09-21T06:16:31.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 --2- 172.21.15.118:0/2864553364 >> v2:172.21.15.149:3300/0 conn(0x7f6bd40b5450 0x7f6bd40cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 --2- 172.21.15.118:0/2864553364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd415cfd0 0x7f6bd40b3a60 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 -- 172.21.15.118:0/2864553364 >> 172.21.15.118:0/2864553364 conn(0x7f6bd406d110 msgr2=0x7f6bd406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:31.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 -- 172.21.15.118:0/2864553364 shutdown_connections 2024-09-21T06:16:31.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.851+0000 7f6bd9400640 1 -- 172.21.15.118:0/2864553364 wait complete. 2024-09-21T06:16:31.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.854+0000 7f6bd9400640 1 Processor -- start 2024-09-21T06:16:31.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.854+0000 7f6bd9400640 1 -- start start 2024-09-21T06:16:31.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.855+0000 7f6bd9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bd40b5040 0x7f6bd40cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.855+0000 7f6bd9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd40b5450 0x7f6bd413f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.855+0000 7f6bd9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bd415cfd0 0x7f6bd40abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.855+0000 7f6bd9400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd4073c60 con 0x7f6bd40b5450 2024-09-21T06:16:31.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.855+0000 7f6bd9400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd4073ae0 con 0x7f6bd40b5040 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.855+0000 7f6bd9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd4073de0 con 0x7f6bd415cfd0 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.855+0000 7f6bcbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd40b5450 0x7f6bd413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd40b5450 0x7f6bd413f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38690/0 (socket says 172.21.15.118:38690) 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 -- 172.21.15.118:0/3136187572 learned_addr learned my addr 172.21.15.118:0/3136187572 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bd2800640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bd40b5040 0x7f6bd40cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bd3200640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bd415cfd0 0x7f6bd40abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 -- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bd415cfd0 msgr2=0x7f6bd40abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bd415cfd0 0x7f6bd40abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 -- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bd40b5040 msgr2=0x7f6bd40cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bd40b5040 0x7f6bd40cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:31.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 -- 172.21.15.118:0/3136187572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd413f940 con 0x7f6bd40b5450 2024-09-21T06:16:31.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcbe00640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd40b5450 0x7f6bd413f400 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c3d0 tx=0x7f6bbc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:31.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.856+0000 7f6bcaa00640 1 -- 172.21.15.118:0/3136187572 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc017070 con 0x7f6bd40b5450 2024-09-21T06:16:31.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.857+0000 7f6bcaa00640 1 -- 172.21.15.118:0/3136187572 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bbc0053c0 con 0x7f6bd40b5450 2024-09-21T06:16:31.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.857+0000 7f6bcaa00640 1 -- 172.21.15.118:0/3136187572 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc003850 con 0x7f6bd40b5450 2024-09-21T06:16:31.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.857+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd40aaf50 con 0x7f6bd40b5450 2024-09-21T06:16:31.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.857+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd40ab4d0 con 0x7f6bd40b5450 2024-09-21T06:16:31.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.858+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd40b3a60 con 0x7f6bd40b5450 2024-09-21T06:16:31.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.859+0000 7f6bcaa00640 1 -- 172.21.15.118:0/3136187572 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6bbc01a070 con 0x7f6bd40b5450 2024-09-21T06:16:31.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.861+0000 7f6bcaa00640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bb0078bc0 0x7f6bb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:31.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.861+0000 7f6bcaa00640 1 -- 172.21.15.118:0/3136187572 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7f6bbc09a0d0 con 0x7f6bd40b5450 2024-09-21T06:16:31.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.861+0000 7f6bd2800640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bb0078bc0 0x7f6bb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:31.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.862+0000 7f6bd2800640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bb0078bc0 0x7f6bb007b0d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4033000 tx=0x7f6bc4004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:31.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:31.865+0000 7f6bcaa00640 1 -- 172.21.15.118:0/3136187572 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6bd413f940 con 0x7f6bd40b5450 2024-09-21T06:16:32.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.061+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6bd415eb90 con 0x7f6bd40b5450 2024-09-21T06:16:32.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.062+0000 7f6bcaa00640 1 -- 172.21.15.118:0/3136187572 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v180) ==== 80+0+0 (secure 0 0 0) 0x7f6bbc061e20 con 0x7f6bd40b5450 2024-09-21T06:16:32.064 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bb0078bc0 msgr2=0x7f6bb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bb0078bc0 0x7f6bb007b0d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4033000 tx=0x7f6bc4004730 comp rx=0 tx=0).stop 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd40b5450 msgr2=0x7f6bd413f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd40b5450 0x7f6bd413f400 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c3d0 tx=0x7f6bbc00c890 comp rx=0 tx=0).stop 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 shutdown_connections 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f6bb0078bc0 0x7f6bb007b0d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bd415cfd0 0x7f6bd40abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd40b5450 0x7f6bd413f400 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 --2- 172.21.15.118:0/3136187572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bd40b5040 0x7f6bd40cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 >> 172.21.15.118:0/3136187572 conn(0x7f6bd406d110 msgr2=0x7f6bd40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:32.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 shutdown_connections 2024-09-21T06:16:32.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.064+0000 7f6bd9400640 1 -- 172.21.15.118:0/3136187572 wait complete. 2024-09-21T06:16:32.089 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:16:32.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:32.089 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T06:16:32.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:16:32.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:32.152 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:16:32.188 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:16:32.188 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:32.188 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:32.223 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:16:32.224 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:16:32.224 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:16:32.224 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:32.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:16:32.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 -- 172.21.15.118:0/2355487090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca80142e40 msgr2=0x7fca800d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 --2- 172.21.15.118:0/2355487090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca80142e40 0x7fca800d13c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fca78005fd0 tx=0x7fca7802a540 comp rx=0 tx=0).stop 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 -- 172.21.15.118:0/2355487090 shutdown_connections 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 --2- 172.21.15.118:0/2355487090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca80142e40 0x7fca800d13c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 --2- 172.21.15.118:0/2355487090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca8013fae0 0x7fca800d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 -- 172.21.15.118:0/2355487090 >> 172.21.15.118:0/2355487090 conn(0x7fca8006d110 msgr2=0x7fca8006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 -- 172.21.15.118:0/2355487090 shutdown_connections 2024-09-21T06:16:32.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.479+0000 7fca86a00640 1 -- 172.21.15.118:0/2355487090 wait complete. 2024-09-21T06:16:32.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.481+0000 7fca86a00640 1 Processor -- start 2024-09-21T06:16:32.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.482+0000 7fca86a00640 1 -- start start 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca86a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8013fae0 0x7fca8013e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca86a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8013fef0 0x7fca800ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca86a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca80142e40 0x7fca80140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca86a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca800cfac0 con 0x7fca8013fae0 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca86a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca800cf940 con 0x7fca8013fef0 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca86a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fca800cfc40 con 0x7fca80142e40 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca7fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8013fae0 0x7fca8013e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca7fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8013fae0 0x7fca8013e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38718/0 (socket says 172.21.15.118:38718) 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.483+0000 7fca7fe00640 1 -- 172.21.15.118:0/216955755 learned_addr learned my addr 172.21.15.118:0/216955755 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:32.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7fe00640 1 -- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca80142e40 msgr2=0x7fca80140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7fe00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca80142e40 0x7fca80140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7fe00640 1 -- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8013fef0 msgr2=0x7fca800ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7fe00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8013fef0 0x7fca800ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7fe00640 1 -- 172.21.15.118:0/216955755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca800b5190 con 0x7fca8013fae0 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7fe00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8013fae0 0x7fca8013e000 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fca7000eb30 tx=0x7fca7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7cc00640 1 -- 172.21.15.118:0/216955755 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70010430 con 0x7fca8013fae0 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7cc00640 1 -- 172.21.15.118:0/216955755 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca700106c0 con 0x7fca8013fae0 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca7cc00640 1 -- 172.21.15.118:0/216955755 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70010b10 con 0x7fca8013fae0 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca800c6060 con 0x7fca8013fae0 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.484+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8013eff0 con 0x7fca8013fae0 2024-09-21T06:16:32.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.486+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca801578e0 con 0x7fca8013fae0 2024-09-21T06:16:32.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.487+0000 7fca7cc00640 1 -- 172.21.15.118:0/216955755 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca70010cb0 con 0x7fca8013fae0 2024-09-21T06:16:32.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.488+0000 7fca7cc00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca5c078b90 0x7fca5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.488+0000 7fca7cc00640 1 -- 172.21.15.118:0/216955755 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7fca7009bb10 con 0x7fca8013fae0 2024-09-21T06:16:32.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.488+0000 7fca77400640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca5c078b90 0x7fca5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:32.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.489+0000 7fca77400640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca5c078b90 0x7fca5c07b0a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fca68000f60 tx=0x7fca680079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:32.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.492+0000 7fca7cc00640 1 -- 172.21.15.118:0/216955755 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fca70063f50 con 0x7fca8013fae0 2024-09-21T06:16:32.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.715+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca800d00f0 con 0x7fca8013fae0 2024-09-21T06:16:32.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.715+0000 7fca7cc00640 1 -- 172.21.15.118:0/216955755 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7fca70063850 con 0x7fca8013fae0 2024-09-21T06:16:32.717 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:32.718 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:32.718 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:32.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.717+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca5c078b90 msgr2=0x7fca5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.717+0000 7fca86a00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca5c078b90 0x7fca5c07b0a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fca68000f60 tx=0x7fca680079b0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.717+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8013fae0 msgr2=0x7fca8013e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.717+0000 7fca86a00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8013fae0 0x7fca8013e000 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fca7000eb30 tx=0x7fca7000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 shutdown_connections 2024-09-21T06:16:32.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fca5c078b90 0x7fca5c07b0a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fca80142e40 0x7fca80140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca8013fef0 0x7fca800ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 --2- 172.21.15.118:0/216955755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca8013fae0 0x7fca8013e000 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 >> 172.21.15.118:0/216955755 conn(0x7fca8006d110 msgr2=0x7fca801571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:32.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 shutdown_connections 2024-09-21T06:16:32.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.718+0000 7fca86a00640 1 -- 172.21.15.118:0/216955755 wait complete. 2024-09-21T06:16:32.742 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:32.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.963+0000 7f8e09200640 1 -- 172.21.15.118:0/3999514500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 msgr2=0x7f8de8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.963+0000 7f8e09200640 1 --2- 172.21.15.118:0/3999514500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 0x7f8de8003e10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c260 tx=0x7f8de8005830 comp rx=0 tx=0).stop 2024-09-21T06:16:32.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.963+0000 7f8e02800640 1 -- 172.21.15.118:0/3999514500 reap_dead start 2024-09-21T06:16:32.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.963+0000 7f8e09200640 1 -- 172.21.15.118:0/3999514500 shutdown_connections 2024-09-21T06:16:32.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.963+0000 7f8e09200640 1 -- 172.21.15.118:0/3999514500 >> 172.21.15.118:0/3999514500 conn(0x7f8e0406d110 msgr2=0x7f8e0406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:32.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.963+0000 7f8e09200640 1 -- 172.21.15.118:0/3999514500 shutdown_connections 2024-09-21T06:16:32.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.963+0000 7f8e09200640 1 -- 172.21.15.118:0/3999514500 wait complete. 2024-09-21T06:16:32.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.965+0000 7f8e09200640 1 Processor -- start 2024-09-21T06:16:32.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.965+0000 7f8e09200640 1 -- start start 2024-09-21T06:16:32.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e09200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 0x7f8e0415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e09200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e0413b1e0 0x7f8e040ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e09200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e0413b5f0 0x7f8e040caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e09200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04142ac0 con 0x7f8de80039e0 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e09200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04142940 con 0x7f8e0413b1e0 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e09200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e04163b70 con 0x7f8e0413b5f0 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 0x7f8e0415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 0x7f8e0415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38744/0 (socket says 172.21.15.118:38744) 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 -- 172.21.15.118:0/277865611 learned_addr learned my addr 172.21.15.118:0/277865611 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01400640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e0413b1e0 0x7f8e040ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e02800640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e0413b5f0 0x7f8e040caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 -- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e0413b5f0 msgr2=0x7f8e040caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e0413b5f0 0x7f8e040caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 -- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e0413b1e0 msgr2=0x7f8e040ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e0413b1e0 0x7f8e040ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01e00640 1 -- 172.21.15.118:0/277865611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e041f5d20 con 0x7f8de80039e0 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e02800640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e0413b5f0 0x7f8e040caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.967+0000 7f8e01400640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e0413b1e0 0x7f8e040ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:32.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.968+0000 7f8e01e00640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 0x7f8e0415ca60 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c380 tx=0x7f8df4006c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:32.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.968+0000 7f8dfa000640 1 -- 172.21.15.118:0/277865611 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4031040 con 0x7f8de80039e0 2024-09-21T06:16:32.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.968+0000 7f8dfa000640 1 -- 172.21.15.118:0/277865611 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8df40035f0 con 0x7f8de80039e0 2024-09-21T06:16:32.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.968+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e041f6000 con 0x7f8de80039e0 2024-09-21T06:16:32.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.968+0000 7f8dfa000640 1 -- 172.21.15.118:0/277865611 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4003a20 con 0x7f8de80039e0 2024-09-21T06:16:32.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.968+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e041f65c0 con 0x7f8de80039e0 2024-09-21T06:16:32.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.969+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e040d0e80 con 0x7f8de80039e0 2024-09-21T06:16:32.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.970+0000 7f8dfa000640 1 -- 172.21.15.118:0/277865611 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8df4034070 con 0x7f8de80039e0 2024-09-21T06:16:32.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.971+0000 7f8dfa000640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8de4078b90 0x7f8de407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:32.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.971+0000 7f8dfa000640 1 -- 172.21.15.118:0/277865611 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7f8df40bacf0 con 0x7f8de80039e0 2024-09-21T06:16:32.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.972+0000 7f8e01400640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8de4078b90 0x7f8de407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:32.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.973+0000 7f8e01400640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8de4078b90 0x7f8de407b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8e040cdea0 tx=0x7f8df0009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:32.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:32.976+0000 7f8dfa000640 1 -- 172.21.15.118:0/277865611 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8df4083120 con 0x7f8de80039e0 2024-09-21T06:16:33.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.196+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e040cc6b0 con 0x7f8de80039e0 2024-09-21T06:16:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.197+0000 7f8dfa000640 1 -- 172.21.15.118:0/277865611 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7f8df4082a20 con 0x7f8de80039e0 2024-09-21T06:16:33.199 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:33.199 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:33.199 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8de4078b90 msgr2=0x7f8de407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8de4078b90 0x7f8de407b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8e040cdea0 tx=0x7f8df0009500 comp rx=0 tx=0).stop 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 msgr2=0x7f8e0415ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 0x7f8e0415ca60 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c380 tx=0x7f8df4006c30 comp rx=0 tx=0).stop 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 shutdown_connections 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8de4078b90 0x7f8de407b0a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e0413b5f0 0x7f8e040caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e0413b1e0 0x7f8e040ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 --2- 172.21.15.118:0/277865611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8de80039e0 0x7f8e0415ca60 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 >> 172.21.15.118:0/277865611 conn(0x7f8e0406d110 msgr2=0x7f8e0406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:33.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 shutdown_connections 2024-09-21T06:16:33.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.199+0000 7f8e09200640 1 -- 172.21.15.118:0/277865611 wait complete. 2024-09-21T06:16:33.223 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:16:33.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.441+0000 7f503ca00640 1 -- 172.21.15.118:0/2692875522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c004d40 msgr2=0x7f501c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.441+0000 7f503ca00640 1 --2- 172.21.15.118:0/2692875522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c004d40 0x7f501c005150 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f5030009ed0 tx=0x7f501c005830 comp rx=0 tx=0).stop 2024-09-21T06:16:33.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.441+0000 7f5037200640 1 -- 172.21.15.118:0/2692875522 reap_dead start 2024-09-21T06:16:33.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.441+0000 7f503ca00640 1 -- 172.21.15.118:0/2692875522 shutdown_connections 2024-09-21T06:16:33.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.441+0000 7f503ca00640 1 -- 172.21.15.118:0/2692875522 >> 172.21.15.118:0/2692875522 conn(0x7f503806d1c0 msgr2=0x7f503806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:33.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.441+0000 7f503ca00640 1 -- 172.21.15.118:0/2692875522 shutdown_connections 2024-09-21T06:16:33.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.441+0000 7f503ca00640 1 -- 172.21.15.118:0/2692875522 wait complete. 2024-09-21T06:16:33.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.443+0000 7f503ca00640 1 Processor -- start 2024-09-21T06:16:33.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.444+0000 7f503ca00640 1 -- start start 2024-09-21T06:16:33.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f503ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f501c004d40 0x7f5038154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f503ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50381562b0 0x7f50381566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f503ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5038157f40 0x7f5038158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f503ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f50380d1ad0 con 0x7f5038157f40 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f503ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50380d1950 con 0x7f50381562b0 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f503ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50380d1c50 con 0x7f501c004d40 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f5037200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5038157f40 0x7f5038158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f5037200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5038157f40 0x7f5038158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38770/0 (socket says 172.21.15.118:38770) 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.445+0000 7f5037200640 1 -- 172.21.15.118:0/2502059671 learned_addr learned my addr 172.21.15.118:0/2502059671 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5036800640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f501c004d40 0x7f5038154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5037200640 1 -- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f501c004d40 msgr2=0x7f5038154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5037200640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f501c004d40 0x7f5038154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5037200640 1 -- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50381562b0 msgr2=0x7f50381566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5035e00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50381562b0 0x7f50381566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5037200640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50381562b0 0x7f50381566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5037200640 1 -- 172.21.15.118:0/2502059671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50381f59d0 con 0x7f5038157f40 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5036800640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f501c004d40 0x7f5038154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5035e00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50381562b0 0x7f50381566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f5037200640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5038157f40 0x7f5038158350 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f503002aed0 tx=0x7f5030033bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f502ea00640 1 -- 172.21.15.118:0/2502059671 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030043070 con 0x7f5038157f40 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f502ea00640 1 -- 172.21.15.118:0/2502059671 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5030033ce0 con 0x7f5038157f40 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f502ea00640 1 -- 172.21.15.118:0/2502059671 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030038040 con 0x7f5038157f40 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.446+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503815a260 con 0x7f5038157f40 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.447+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50381f6120 con 0x7f5038157f40 2024-09-21T06:16:33.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.448+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50381f5ba0 con 0x7f5038157f40 2024-09-21T06:16:33.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.449+0000 7f502ea00640 1 -- 172.21.15.118:0/2502059671 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5030003b90 con 0x7f5038157f40 2024-09-21T06:16:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.450+0000 7f502ea00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5018078bc0 0x7f501807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.451+0000 7f502ea00640 1 -- 172.21.15.118:0/2502059671 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7f50300bae50 con 0x7f5038157f40 2024-09-21T06:16:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.451+0000 7f5036800640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5018078bc0 0x7f501807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.451+0000 7f5036800640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5018078bc0 0x7f501807b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5028009bc0 tx=0x7f5028005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.455+0000 7f502ea00640 1 -- 172.21.15.118:0/2502059671 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f50381f5ba0 con 0x7f5038157f40 2024-09-21T06:16:33.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.644+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50380d02e0 con 0x7f5038157f40 2024-09-21T06:16:33.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.645+0000 7f502ea00640 1 -- 172.21.15.118:0/2502059671 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) ==== 74+0+16811 (secure 0 0 0) 0x7f5030082c40 con 0x7f5038157f40 2024-09-21T06:16:33.647 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:33.648 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":180,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:16:25.429694+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:15:54.926853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T06:15:55.983460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5018078bc0 msgr2=0x7f501807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5018078bc0 0x7f501807b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5028009bc0 tx=0x7f5028005f90 comp rx=0 tx=0).stop 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5038157f40 msgr2=0x7f5038158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5038157f40 0x7f5038158350 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f503002aed0 tx=0x7f5030033bf0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 shutdown_connections 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5038157f40 0x7f5038158350 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50381562b0 0x7f50381566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5018078bc0 0x7f501807b0d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 --2- 172.21.15.118:0/2502059671 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f501c004d40 0x7f5038154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 >> 172.21.15.118:0/2502059671 conn(0x7f503806d1c0 msgr2=0x7f50380b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 shutdown_connections 2024-09-21T06:16:33.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.647+0000 7f503ca00640 1 -- 172.21.15.118:0/2502059671 wait complete. 2024-09-21T06:16:33.670 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:16:33.671 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:33.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3692312933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 msgr2=0x7f5fc00cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3692312933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 0x7f5fc00cf5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8005fd0 tx=0x7f5fb802a8b0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3692312933 shutdown_connections 2024-09-21T06:16:33.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3692312933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 0x7f5fc00cf5f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3692312933 >> v2:172.21.15.149:3300/0 conn(0x7f5fc00d0de0 0x7f5fc00d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3692312933 >> 172.21.15.118:0/3692312933 conn(0x7f5fc006d110 msgr2=0x7f5fc006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:33.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3692312933 shutdown_connections 2024-09-21T06:16:33.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.891+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3692312933 wait complete. 2024-09-21T06:16:33.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.893+0000 7f5fc4a00640 1 Processor -- start 2024-09-21T06:16:33.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.893+0000 7f5fc4a00640 1 -- start start 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fc4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 0x7f5fc01f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fc4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc00d0de0 0x7f5fc013e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fc4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fc013fc50 0x7f5fc013b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fc4a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00cfcb0 con 0x7f5fc013fc50 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fc4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00cfb30 con 0x7f5fc00d0de0 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fc4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc00cfe30 con 0x7f5fc00cf1e0 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fc013fc50 0x7f5fc013b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fc013fc50 0x7f5fc013b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38778/0 (socket says 172.21.15.118:38778) 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 -- 172.21.15.118:0/3116767724 learned_addr learned my addr 172.21.15.118:0/3116767724 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:33.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbde00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 0x7f5fc01f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbd400640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc00d0de0 0x7f5fc013e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 -- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 msgr2=0x7f5fc01f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 0x7f5fc01f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 -- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc00d0de0 msgr2=0x7f5fc013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc00d0de0 0x7f5fc013e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.895+0000 7f5fbe800640 1 -- 172.21.15.118:0/3116767724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc01f98e0 con 0x7f5fc013fc50 2024-09-21T06:16:33.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.896+0000 7f5fbe800640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fc013fc50 0x7f5fc013b1c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009b30 tx=0x7f5fb8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:33.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.896+0000 7f5fb6000640 1 -- 172.21.15.118:0/3116767724 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8004040 con 0x7f5fc013fc50 2024-09-21T06:16:33.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.896+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc01f9bc0 con 0x7f5fc013fc50 2024-09-21T06:16:33.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.896+0000 7f5fb6000640 1 -- 172.21.15.118:0/3116767724 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fb80042d0 con 0x7f5fc013fc50 2024-09-21T06:16:33.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.896+0000 7f5fb6000640 1 -- 172.21.15.118:0/3116767724 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8004700 con 0x7f5fc013fc50 2024-09-21T06:16:33.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.896+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc013c1a0 con 0x7f5fc013fc50 2024-09-21T06:16:33.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.897+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc00d0350 con 0x7f5fc013fc50 2024-09-21T06:16:33.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.899+0000 7f5fb6000640 1 -- 172.21.15.118:0/3116767724 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fb803b410 con 0x7f5fc013fc50 2024-09-21T06:16:33.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.899+0000 7f5fb6000640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5fa0078b90 0x7f5fa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.900+0000 7f5fb6000640 1 -- 172.21.15.118:0/3116767724 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7f5fb80bc310 con 0x7f5fc013fc50 2024-09-21T06:16:33.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.900+0000 7f5fbde00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5fa0078b90 0x7f5fa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.901+0000 7f5fbde00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5fa0078b90 0x7f5fa007b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0001720 tx=0x7f5fb0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:33.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:33.904+0000 7f5fb6000640 1 -- 172.21.15.118:0/3116767724 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5fb803f030 con 0x7f5fc013fc50 2024-09-21T06:16:34.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.127+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fc00b5800 con 0x7f5fc013fc50 2024-09-21T06:16:34.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.128+0000 7f5fb6000640 1 -- 172.21.15.118:0/3116767724 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7f5fb8031e20 con 0x7f5fc013fc50 2024-09-21T06:16:34.130 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:34.130 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:34.131 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5fa0078b90 msgr2=0x7f5fa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5fa0078b90 0x7f5fa007b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0001720 tx=0x7f5fb0009040 comp rx=0 tx=0).stop 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fc013fc50 msgr2=0x7f5fc013b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fc013fc50 0x7f5fc013b1c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009b30 tx=0x7f5fb8003970 comp rx=0 tx=0).stop 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 shutdown_connections 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fc013fc50 0x7f5fc013b1c0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc00d0de0 0x7f5fc013e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5fa0078b90 0x7f5fa007b0a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 --2- 172.21.15.118:0/3116767724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc00cf1e0 0x7f5fc01f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.130+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 >> 172.21.15.118:0/3116767724 conn(0x7f5fc006d110 msgr2=0x7f5fc0074750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.131+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 shutdown_connections 2024-09-21T06:16:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.131+0000 7f5fc4a00640 1 -- 172.21.15.118:0/3116767724 wait complete. 2024-09-21T06:16:34.158 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 -- 172.21.15.118:0/4171099191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d80d1590 msgr2=0x7f96d8142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 --2- 172.21.15.118:0/4171099191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d80d1590 0x7f96d8142730 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f96d815d420 tx=0x7f96c002a4a0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 -- 172.21.15.118:0/4171099191 shutdown_connections 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 --2- 172.21.15.118:0/4171099191 >> v2:172.21.15.149:3300/0 conn(0x7f96d813fef0 0x7f96d8142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 --2- 172.21.15.118:0/4171099191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d80d1590 0x7f96d8142730 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 -- 172.21.15.118:0/4171099191 >> 172.21.15.118:0/4171099191 conn(0x7f96d806d110 msgr2=0x7f96d806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 -- 172.21.15.118:0/4171099191 shutdown_connections 2024-09-21T06:16:34.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.374+0000 7f96dcc00640 1 -- 172.21.15.118:0/4171099191 wait complete. 2024-09-21T06:16:34.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.376+0000 7f96dcc00640 1 Processor -- start 2024-09-21T06:16:34.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.377+0000 7f96dcc00640 1 -- start start 2024-09-21T06:16:34.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96dcc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d813fae0 0x7f96d81413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96dcc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96d813fef0 0x7f96d8141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96dcc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d806f300 0x7f96d813d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96dcc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f96d80cfa70 con 0x7f96d806f300 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96dcc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f96d80cf8f0 con 0x7f96d813fae0 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96dcc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f96d80cfbf0 con 0x7f96d813fef0 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96d6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d806f300 0x7f96d813d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96d6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d806f300 0x7f96d813d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38802/0 (socket says 172.21.15.118:38802) 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96d6800640 1 -- 172.21.15.118:0/3889820662 learned_addr learned my addr 172.21.15.118:0/3889820662 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96cd400640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96d813fef0 0x7f96d8141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.378+0000 7f96d5e00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d813fae0 0x7f96d81413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96d6800640 1 -- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96d813fef0 msgr2=0x7f96d8141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96d6800640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96d813fef0 0x7f96d8141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96d6800640 1 -- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d813fae0 msgr2=0x7f96d81413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96d6800640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d813fae0 0x7f96d81413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96d6800640 1 -- 172.21.15.118:0/3889820662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d80b3b70 con 0x7f96d806f300 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96d6800640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d806f300 0x7f96d813d160 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f96d000eab0 tx=0x7f96d000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96cea00640 1 -- 172.21.15.118:0/3889820662 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d000cea0 con 0x7f96d806f300 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.379+0000 7f96cea00640 1 -- 172.21.15.118:0/3889820662 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96d0004b20 con 0x7f96d806f300 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.380+0000 7f96cea00640 1 -- 172.21.15.118:0/3889820662 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0005020 con 0x7f96d806f300 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.380+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d80b3e50 con 0x7f96d806f300 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.380+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d80b4410 con 0x7f96d806f300 2024-09-21T06:16:34.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.381+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d80d0110 con 0x7f96d806f300 2024-09-21T06:16:34.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.382+0000 7f96cea00640 1 -- 172.21.15.118:0/3889820662 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96d00051c0 con 0x7f96d806f300 2024-09-21T06:16:34.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.383+0000 7f96cea00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96b4078b90 0x7f96b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.383+0000 7f96cea00640 1 -- 172.21.15.118:0/3889820662 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7f96d009b8e0 con 0x7f96d806f300 2024-09-21T06:16:34.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.383+0000 7f96d5e00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96b4078b90 0x7f96b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.384+0000 7f96d5e00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96b4078b90 0x7f96b407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000f60 tx=0x7f96c8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:34.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.387+0000 7f96cea00640 1 -- 172.21.15.118:0/3889820662 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f96d00636d0 con 0x7f96d806f300 2024-09-21T06:16:34.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.606+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96d815ea00 con 0x7f96d806f300 2024-09-21T06:16:34.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.606+0000 7f96cea00640 1 -- 172.21.15.118:0/3889820662 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5236 (secure 0 0 0) 0x7f96d0068100 con 0x7f96d806f300 2024-09-21T06:16:34.608 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:34.609 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":95,"btime":"2024-09-21T06:16:00:554411+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:15:57.016837+0000","modified":"2024-09-21T06:16:00.048612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8094":{"gid":8094,"name":"c","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1906430452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1906430452},{"type":"v1","addr":"172.21.15.118:6835","nonce":1906430452}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8094,"qdb_cluster":[8094]},"id":11}]} 2024-09-21T06:16:34.609 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 95 2024-09-21T06:16:34.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.608+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96b4078b90 msgr2=0x7f96b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.608+0000 7f96dcc00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96b4078b90 0x7f96b407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000f60 tx=0x7f96c8009040 comp rx=0 tx=0).stop 2024-09-21T06:16:34.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.608+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d806f300 msgr2=0x7f96d813d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.608+0000 7f96dcc00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d806f300 0x7f96d813d160 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f96d000eab0 tx=0x7f96d000ef70 comp rx=0 tx=0).stop 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 shutdown_connections 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96d806f300 0x7f96d813d160 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f96b4078b90 0x7f96b407b0a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96d813fef0 0x7f96d8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 --2- 172.21.15.118:0/3889820662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d813fae0 0x7f96d81413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 >> 172.21.15.118:0/3889820662 conn(0x7f96d806d110 msgr2=0x7f96d81535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:34.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 shutdown_connections 2024-09-21T06:16:34.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.609+0000 7f96dcc00640 1 -- 172.21.15.118:0/3889820662 wait complete. 2024-09-21T06:16:34.632 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:16:34.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 -- 172.21.15.118:0/3510238472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c4073fa0 msgr2=0x7f80c40749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 --2- 172.21.15.118:0/3510238472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c4073fa0 0x7f80c40749f0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009830 tx=0x7f80b802a480 comp rx=0 tx=0).stop 2024-09-21T06:16:34.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 -- 172.21.15.118:0/3510238472 shutdown_connections 2024-09-21T06:16:34.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 --2- 172.21.15.118:0/3510238472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80c40b62c0 0x7f80c40d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 --2- 172.21.15.118:0/3510238472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c4073fa0 0x7f80c40749f0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 -- 172.21.15.118:0/3510238472 >> 172.21.15.118:0/3510238472 conn(0x7f80c406d6e0 msgr2=0x7f80c40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:34.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 -- 172.21.15.118:0/3510238472 shutdown_connections 2024-09-21T06:16:34.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.852+0000 7f80caa00640 1 -- 172.21.15.118:0/3510238472 wait complete. 2024-09-21T06:16:34.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.854+0000 7f80caa00640 1 Processor -- start 2024-09-21T06:16:34.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.854+0000 7f80caa00640 1 -- start start 2024-09-21T06:16:34.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80caa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4073fa0 0x7f80c40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80caa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c40cfe30 0x7f80c41f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80caa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80c41f47f0 0x7f80c41f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80caa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f80c415da00 con 0x7f80c40cfe30 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80caa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80c415d880 con 0x7f80c4073fa0 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80caa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f80c415db80 con 0x7f80c41f47f0 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80c8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c40cfe30 0x7f80c41f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80c8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c40cfe30 0x7f80c41f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38826/0 (socket says 172.21.15.118:38826) 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80c8c00640 1 -- 172.21.15.118:0/2754966591 learned_addr learned my addr 172.21.15.118:0/2754966591 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80c9600640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4073fa0 0x7f80c40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.856+0000 7f80ca000640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80c41f47f0 0x7f80c41f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c8c00640 1 -- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80c41f47f0 msgr2=0x7f80c41f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c8c00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80c41f47f0 0x7f80c41f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c8c00640 1 -- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4073fa0 msgr2=0x7f80c40c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c8c00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4073fa0 0x7f80c40c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:34.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c8c00640 1 -- 172.21.15.118:0/2754966591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c41589f0 con 0x7f80c40cfe30 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80ca000640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80c41f47f0 0x7f80c41f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c8c00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c40cfe30 0x7f80c41f6100 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c3c0 tx=0x7f80b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c1600640 1 -- 172.21.15.118:0/2754966591 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0017070 con 0x7f80c40cfe30 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c1600640 1 -- 172.21.15.118:0/2754966591 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80b00035f0 con 0x7f80c40cfe30 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c4158c90 con 0x7f80c40cfe30 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80c1600640 1 -- 172.21.15.118:0/2754966591 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0003a80 con 0x7f80c40cfe30 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.857+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c4159250 con 0x7f80c40cfe30 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.858+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c415e0a0 con 0x7f80c40cfe30 2024-09-21T06:16:34.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.859+0000 7f80c1600640 1 -- 172.21.15.118:0/2754966591 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80b001a070 con 0x7f80c40cfe30 2024-09-21T06:16:34.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.860+0000 7f80c1600640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80a4078b90 0x7f80a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:34.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.860+0000 7f80c1600640 1 -- 172.21.15.118:0/2754966591 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7f80b0099fe0 con 0x7f80c40cfe30 2024-09-21T06:16:34.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.861+0000 7f80c9600640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80a4078b90 0x7f80a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:34.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.862+0000 7f80c9600640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80a4078b90 0x7f80a407b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f80b8034000 tx=0x7f80b8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:34.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:34.865+0000 7f80c1600640 1 -- 172.21.15.118:0/2754966591 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f80b0061d90 con 0x7f80c40cfe30 2024-09-21T06:16:35.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.050+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80c415f3f0 con 0x7f80c40cfe30 2024-09-21T06:16:35.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.051+0000 7f80c1600640 1 -- 172.21.15.118:0/2754966591 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) ==== 74+0+16811 (secure 0 0 0) 0x7f80b00667c0 con 0x7f80c40cfe30 2024-09-21T06:16:35.054 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:35.054 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":180,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:16:25.429694+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:15:54.926853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T06:15:55.983460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:16:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80a4078b90 msgr2=0x7f80a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80a4078b90 0x7f80a407b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f80b8034000 tx=0x7f80b8004730 comp rx=0 tx=0).stop 2024-09-21T06:16:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c40cfe30 msgr2=0x7f80c41f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c40cfe30 0x7f80c41f6100 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c3c0 tx=0x7f80b000c880 comp rx=0 tx=0).stop 2024-09-21T06:16:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 shutdown_connections 2024-09-21T06:16:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f80a4078b90 0x7f80a407b0a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80c41f47f0 0x7f80c41f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80c40cfe30 0x7f80c41f6100 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 --2- 172.21.15.118:0/2754966591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80c4073fa0 0x7f80c40c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.053+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 >> 172.21.15.118:0/2754966591 conn(0x7f80c406d6e0 msgr2=0x7f80c40749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:35.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.054+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 shutdown_connections 2024-09-21T06:16:35.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.054+0000 7f80caa00640 1 -- 172.21.15.118:0/2754966591 wait complete. 2024-09-21T06:16:35.078 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:16:35.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.296+0000 7fbe7f400640 1 -- 172.21.15.118:0/1372001772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 msgr2=0x7fbe78142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.296+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1372001772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe78142b40 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fbe78071c00 tx=0x7fbe7002aa30 comp rx=0 tx=0).stop 2024-09-21T06:16:35.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.296+0000 7fbe7f400640 1 -- 172.21.15.118:0/1372001772 shutdown_connections 2024-09-21T06:16:35.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.297+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1372001772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe78142b40 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.297+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1372001772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7813fef0 0x7fbe780d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.297+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1372001772 >> v2:172.21.15.149:3300/0 conn(0x7fbe7813fae0 0x7fbe780d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.297+0000 7fbe7f400640 1 -- 172.21.15.118:0/1372001772 >> 172.21.15.118:0/1372001772 conn(0x7fbe7806d110 msgr2=0x7fbe7806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:35.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.297+0000 7fbe7f400640 1 -- 172.21.15.118:0/1372001772 shutdown_connections 2024-09-21T06:16:35.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.297+0000 7fbe7f400640 1 -- 172.21.15.118:0/1372001772 wait complete. 2024-09-21T06:16:35.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.299+0000 7fbe7f400640 1 Processor -- start 2024-09-21T06:16:35.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.299+0000 7fbe7f400640 1 -- start start 2024-09-21T06:16:35.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.300+0000 7fbe7f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7813fae0 0x7fbe78140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.300+0000 7fbe7f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7813fef0 0x7fbe78074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.300+0000 7fbe7f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe7813b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.300+0000 7fbe7f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7806f330 con 0x7fbe78142730 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.300+0000 7fbe7f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7806f1b0 con 0x7fbe7813fef0 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.300+0000 7fbe7f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7806f4b0 con 0x7fbe7813fae0 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe7813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe7813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38834/0 (socket says 172.21.15.118:38834) 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe77e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7813fef0 0x7fbe78074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 -- 172.21.15.118:0/1721277526 learned_addr learned my addr 172.21.15.118:0/1721277526 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7ca00640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7813fae0 0x7fbe78140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 -- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7813fae0 msgr2=0x7fbe78140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7813fae0 0x7fbe78140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 -- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7813fef0 msgr2=0x7fbe78074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7813fef0 0x7fbe78074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 -- 172.21.15.118:0/1721277526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe781f9dc0 con 0x7fbe78142730 2024-09-21T06:16:35.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.301+0000 7fbe7d400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe7813b410 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009d60 tx=0x7fbe70003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:35.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.302+0000 7fbe74c00640 1 -- 172.21.15.118:0/1721277526 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70033050 con 0x7fbe78142730 2024-09-21T06:16:35.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.302+0000 7fbe74c00640 1 -- 172.21.15.118:0/1721277526 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe70004450 con 0x7fbe78142730 2024-09-21T06:16:35.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.302+0000 7fbe74c00640 1 -- 172.21.15.118:0/1721277526 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70038450 con 0x7fbe78142730 2024-09-21T06:16:35.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.302+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe781fa0a0 con 0x7fbe78142730 2024-09-21T06:16:35.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.302+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe781fa660 con 0x7fbe78142730 2024-09-21T06:16:35.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.303+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7806f9d0 con 0x7fbe78142730 2024-09-21T06:16:35.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.304+0000 7fbe74c00640 1 -- 172.21.15.118:0/1721277526 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe70036070 con 0x7fbe78142730 2024-09-21T06:16:35.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.305+0000 7fbe74c00640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe58078b90 0x7fbe5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.305+0000 7fbe74c00640 1 -- 172.21.15.118:0/1721277526 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5709+0+0 (secure 0 0 0) 0x7fbe700bbff0 con 0x7fbe78142730 2024-09-21T06:16:35.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.305+0000 7fbe7ca00640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe58078b90 0x7fbe5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.306+0000 7fbe7ca00640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe58078b90 0x7fbe5807b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c005fd0 tx=0x7fbe6c00b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:35.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.309+0000 7fbe74c00640 1 -- 172.21.15.118:0/1721277526 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe70083ec0 con 0x7fbe78142730 2024-09-21T06:16:35.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.535+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbe78074ce0 con 0x7fbe78142730 2024-09-21T06:16:35.538 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-09-21T06:16:35.536+0000 7ff0a4e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:16:35.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.538+0000 7fbe74c00640 1 -- 172.21.15.118:0/1721277526 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) ==== 161+0+0 (secure 0 0 0) 0x7fbe700888f0 con 0x7fbe78142730 2024-09-21T06:16:35.541 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:16:35.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.542+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe58078b90 msgr2=0x7fbe5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.542+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe58078b90 0x7fbe5807b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c005fd0 tx=0x7fbe6c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.542+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 msgr2=0x7fbe7813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.542+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe7813b410 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009d60 tx=0x7fbe70003f10 comp rx=0 tx=0).stop 2024-09-21T06:16:35.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 shutdown_connections 2024-09-21T06:16:35.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe78142730 0x7fbe7813b410 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe7813fef0 0x7fbe78074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fbe58078b90 0x7fbe5807b0a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 --2- 172.21.15.118:0/1721277526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe7813fae0 0x7fbe78140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 >> 172.21.15.118:0/1721277526 conn(0x7fbe7806d110 msgr2=0x7fbe7815e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:35.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 shutdown_connections 2024-09-21T06:16:35.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.543+0000 7fbe7f400640 1 -- 172.21.15.118:0/1721277526 wait complete. 2024-09-21T06:16:35.573 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:16:35.688 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-09-21T06:16:35.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.796+0000 7f4710000640 1 -- 172.21.15.118:0/4108443283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 msgr2=0x7f4708142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.796+0000 7f4710000640 1 --2- 172.21.15.118:0/4108443283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708142c70 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f4700005fd0 tx=0x7f470002aa10 comp rx=0 tx=0).stop 2024-09-21T06:16:35.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.796+0000 7f4710000640 1 -- 172.21.15.118:0/4108443283 shutdown_connections 2024-09-21T06:16:35.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.796+0000 7f4710000640 1 --2- 172.21.15.118:0/4108443283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708142c70 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.796+0000 7f4710000640 1 --2- 172.21.15.118:0/4108443283 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47080d1590 0x7f4708142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.796+0000 7f4710000640 1 -- 172.21.15.118:0/4108443283 >> 172.21.15.118:0/4108443283 conn(0x7f470806d110 msgr2=0x7f470806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:35.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.797+0000 7f4710000640 1 -- 172.21.15.118:0/4108443283 shutdown_connections 2024-09-21T06:16:35.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.797+0000 7f4710000640 1 -- 172.21.15.118:0/4108443283 wait complete. 2024-09-21T06:16:35.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.799+0000 7f4710000640 1 Processor -- start 2024-09-21T06:16:35.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.799+0000 7f4710000640 1 -- start start 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.800+0000 7f4710000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470813fae0 0x7f47081f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.800+0000 7f4710000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.800+0000 7f4710000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47080b5710 0x7f470813a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.800+0000 7f4710000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f47080cfb10 con 0x7f470813fef0 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.800+0000 7f4710000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47080cf990 con 0x7f470813fae0 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.800+0000 7f4710000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47080cfc90 con 0x7f47080b5710 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.800+0000 7f470cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55806/0 (socket says 172.21.15.118:55806) 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 -- 172.21.15.118:0/3326052299 learned_addr learned my addr 172.21.15.118:0/3326052299 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470d600640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470813fae0 0x7f47081f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470e000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47080b5710 0x7f470813a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 -- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47080b5710 msgr2=0x7f470813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47080b5710 0x7f470813a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 -- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470813fae0 msgr2=0x7f47081f9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470813fae0 0x7f47081f9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 -- 172.21.15.118:0/3326052299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4708142360 con 0x7f470813fef0 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470d600640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470813fae0 0x7f47081f9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470e000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47080b5710 0x7f470813a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f470cc00640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708141e20 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f46f400d700 tx=0x7f46f400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.801+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4017070 con 0x7f470813fef0 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.802+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46f4009ab0 con 0x7f470813fef0 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.802+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4010460 con 0x7f470813fef0 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.802+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4708074740 con 0x7f470813fef0 2024-09-21T06:16:35.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.802+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47080b3be0 con 0x7f470813fef0 2024-09-21T06:16:35.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.803+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4708070590 con 0x7f470813fef0 2024-09-21T06:16:35.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.804+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46f401a070 con 0x7f470813fef0 2024-09-21T06:16:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.805+0000 7f4705600640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078b90 0x7f46e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.805+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5795+0+0 (secure 0 0 0) 0x7f46f409aed0 con 0x7f470813fef0 2024-09-21T06:16:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.805+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=183}) -- 0x7f46e8080820 con 0x7f470813fef0 2024-09-21T06:16:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.806+0000 7f470d600640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078b90 0x7f46e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.806+0000 7f470d600640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078b90 0x7f46e807b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46fc007fd0 tx=0x7f46fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:35.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:35.810+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4708070590 con 0x7f470813fef0 2024-09-21T06:16:36.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.032+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f470815d080 con 0x7f470813fef0 2024-09-21T06:16:36.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.541+0000 7f4705600640 1 -- 172.21.15.118:0/3326052299 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) ==== 104+0+0 (secure 0 0 0) 0x7f470815d080 con 0x7f470813fef0 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078b90 msgr2=0x7f46e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078b90 0x7f46e807b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46fc007fd0 tx=0x7f46fc009040 comp rx=0 tx=0).stop 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 msgr2=0x7f4708141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708141e20 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f46f400d700 tx=0x7f46f400dbc0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 shutdown_connections 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f46e8078b90 0x7f46e807b0a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47080b5710 0x7f470813a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f470813fef0 0x7f4708141e20 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 --2- 172.21.15.118:0/3326052299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f470813fae0 0x7f47081f9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.543+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 >> 172.21.15.118:0/3326052299 conn(0x7f470806d110 msgr2=0x7f47080d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:36.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.544+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 shutdown_connections 2024-09-21T06:16:36.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.544+0000 7f4710000640 1 -- 172.21.15.118:0/3326052299 wait complete. 2024-09-21T06:16:36.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:16:36.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.795+0000 7f9c05800640 1 -- 172.21.15.118:0/2099281766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c00160a50 msgr2=0x7f9c00070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:36.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.795+0000 7f9c05800640 1 --2- 172.21.15.118:0/2099281766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c00160a50 0x7f9c00070240 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009830 tx=0x7f9bf002a510 comp rx=0 tx=0).stop 2024-09-21T06:16:36.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.795+0000 7f9c05800640 1 -- 172.21.15.118:0/2099281766 shutdown_connections 2024-09-21T06:16:36.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.795+0000 7f9c05800640 1 --2- 172.21.15.118:0/2099281766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c00160a50 0x7f9c00070240 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.795+0000 7f9c05800640 1 -- 172.21.15.118:0/2099281766 >> 172.21.15.118:0/2099281766 conn(0x7f9c0006cf30 msgr2=0x7f9c0006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:36.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.795+0000 7f9c05800640 1 -- 172.21.15.118:0/2099281766 shutdown_connections 2024-09-21T06:16:36.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.795+0000 7f9c05800640 1 -- 172.21.15.118:0/2099281766 wait complete. 2024-09-21T06:16:36.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.797+0000 7f9c05800640 1 Processor -- start 2024-09-21T06:16:36.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.797+0000 7f9c05800640 1 -- start start 2024-09-21T06:16:36.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9c05800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000b4210 0x7f9c0013d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:36.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9c05800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c000cee10 0x7f9c00072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:36.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9c05800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c00160a50 0x7f9c00073430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9c05800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000cf220 con 0x7f9c000b4210 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9c05800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000ce1d0 con 0x7f9c00160a50 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9c05800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9c000cf3a0 con 0x7f9c000cee10 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000b4210 0x7f9c0013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000b4210 0x7f9c0013d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55816/0 (socket says 172.21.15.118:55816) 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 -- 172.21.15.118:0/1809273269 learned_addr learned my addr 172.21.15.118:0/1809273269 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bff400640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c00160a50 0x7f9c00073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfe000640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c000cee10 0x7f9c00072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 -- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c000cee10 msgr2=0x7f9c00072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c000cee10 0x7f9c00072ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 -- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c00160a50 msgr2=0x7f9c00073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c00160a50 0x7f9c00073430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:36.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.799+0000 7f9bfea00640 1 -- 172.21.15.118:0/1809273269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0013d8a0 con 0x7f9c000b4210 2024-09-21T06:16:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.800+0000 7f9bfea00640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000b4210 0x7f9c0013d360 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009950 tx=0x7f9bf0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.800+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0031d60 con 0x7f9c000b4210 2024-09-21T06:16:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.800+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bf0033e10 con 0x7f9c000b4210 2024-09-21T06:16:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.800+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c00156700 con 0x7f9c000b4210 2024-09-21T06:16:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.800+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0005260 con 0x7f9c000b4210 2024-09-21T06:16:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.800+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c00156cc0 con 0x7f9c000b4210 2024-09-21T06:16:36.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.801+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c00070240 con 0x7f9c000b4210 2024-09-21T06:16:36.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.803+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9bf0005400 con 0x7f9c000b4210 2024-09-21T06:16:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.804+0000 7f9bf6a00640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9be0078b90 0x7f9be007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.804+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5795+0+0 (secure 0 0 0) 0x7f9bf00bc0d0 con 0x7f9c000b4210 2024-09-21T06:16:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.804+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=183}) -- 0x7f9be0080820 con 0x7f9c000b4210 2024-09-21T06:16:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.804+0000 7f9bfe000640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9be0078b90 0x7f9be007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:36.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.805+0000 7f9bfe000640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9be0078b90 0x7f9be007b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9bec006fd0 tx=0x7f9bec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:36.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.808+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9c0013d8a0 con 0x7f9c000b4210 2024-09-21T06:16:36.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:36.992+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c0006a260 con 0x7f9c000b4210 2024-09-21T06:16:37.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.821+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v183) ==== 181+0+0 (secure 0 0 0) 0x7f9bf003f030 con 0x7f9c000b4210 2024-09-21T06:16:37.823 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:16:37.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.821+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(183..183 src has 1..183) ==== 296+0+0 (secure 0 0 0) 0x7f9bf00f32b0 con 0x7f9c000b4210 2024-09-21T06:16:37.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.821+0000 7f9bf6a00640 1 -- 172.21.15.118:0/1809273269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=184}) -- 0x7f9be007ec50 con 0x7f9c000b4210 2024-09-21T06:16:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.826+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9be0078b90 msgr2=0x7f9be007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:37.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.826+0000 7f9c05800640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9be0078b90 0x7f9be007b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9bec006fd0 tx=0x7f9bec008040 comp rx=0 tx=0).stop 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.826+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000b4210 msgr2=0x7f9c0013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.826+0000 7f9c05800640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000b4210 0x7f9c0013d360 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009950 tx=0x7f9bf0033c20 comp rx=0 tx=0).stop 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.828+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 shutdown_connections 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.828+0000 7f9c05800640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c00160a50 0x7f9c00073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.828+0000 7f9c05800640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9be0078b90 0x7f9be007b0a0 secure :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9bec006fd0 tx=0x7f9bec008040 comp rx=0 tx=0).stop 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.828+0000 7f9c05800640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c000cee10 0x7f9c00072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.828+0000 7f9c05800640 1 --2- 172.21.15.118:0/1809273269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000b4210 0x7f9c0013d360 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:37.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.828+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 >> 172.21.15.118:0/1809273269 conn(0x7f9c0006cf30 msgr2=0x7f9c0015fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:37.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.829+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 shutdown_connections 2024-09-21T06:16:37.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:37.829+0000 7f9c05800640 1 -- 172.21.15.118:0/1809273269 wait complete. 2024-09-21T06:16:37.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:16:38.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3572718915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc0b0c30 msgr2=0x7f8bcc0afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3572718915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc0b0c30 0x7f8bcc0afa30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0692e0 tx=0x7f8bc402a800 comp rx=0 tx=0).stop 2024-09-21T06:16:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3572718915 shutdown_connections 2024-09-21T06:16:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3572718915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc0b0c30 0x7f8bcc0afa30 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3572718915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bcc0b2660 0x7f8bcc161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3572718915 >> 172.21.15.118:0/3572718915 conn(0x7f8bcc074860 msgr2=0x7f8bcc074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3572718915 shutdown_connections 2024-09-21T06:16:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.083+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3572718915 wait complete. 2024-09-21T06:16:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.085+0000 7f8bd2e00640 1 Processor -- start 2024-09-21T06:16:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.085+0000 7f8bd2e00640 1 -- start start 2024-09-21T06:16:38.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.086+0000 7f8bd2e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bcc0b0c30 0x7f8bcc1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:38.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bd2e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc1541a0 0x7f8bcc06f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bd2e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bcc0b41c0 0x7f8bcc06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bd2e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b00f0 con 0x7f8bcc1541a0 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bd2e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0aff70 con 0x7f8bcc0b0c30 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bd2e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b0270 con 0x7f8bcc0b41c0 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc1541a0 0x7f8bcc06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc1541a0 0x7f8bcc06f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55834/0 (socket says 172.21.15.118:55834) 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 -- 172.21.15.118:0/3466142911 learned_addr learned my addr 172.21.15.118:0/3466142911 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcbe00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bcc0b0c30 0x7f8bcc1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bd0e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bcc0b41c0 0x7f8bcc06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 -- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bcc0b41c0 msgr2=0x7f8bcc06fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bcc0b41c0 0x7f8bcc06fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 -- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bcc0b0c30 msgr2=0x7f8bcc1525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bcc0b0c30 0x7f8bcc1525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bcb400640 1 -- 172.21.15.118:0/3466142911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc0b4930 con 0x7f8bcc1541a0 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.087+0000 7f8bd0e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bcc0b41c0 0x7f8bcc06fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.088+0000 7f8bcb400640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc1541a0 0x7f8bcc06f510 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800c9a0 tx=0x7f8bb800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.088+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8007bb0 con 0x7f8bcc1541a0 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.088+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bb8007e40 con 0x7f8bcc1541a0 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.088+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800f6b0 con 0x7f8bcc1541a0 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.088+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc0b4c10 con 0x7f8bcc1541a0 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.088+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc0cbb80 con 0x7f8bcc1541a0 2024-09-21T06:16:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.089+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc0b5130 con 0x7f8bcc1541a0 2024-09-21T06:16:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.090+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bb800f850 con 0x7f8bcc1541a0 2024-09-21T06:16:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.091+0000 7f8bc3e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8bac078b90 0x7f8bac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.091+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5357+0+0 (secure 0 0 0) 0x7f8bb809b350 con 0x7f8bcc1541a0 2024-09-21T06:16:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.092+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=184}) -- 0x7f8bac07fa10 con 0x7f8bcc1541a0 2024-09-21T06:16:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.092+0000 7f8bcbe00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8bac078b90 0x7f8bac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.093+0000 7f8bcbe00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8bac078b90 0x7f8bac07b0a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc000f60 tx=0x7f8bbc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:38.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.096+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8bcc0b5130 con 0x7f8bcc1541a0 2024-09-21T06:16:38.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.282+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8bcc0b07a0 con 0x7f8bcc1541a0 2024-09-21T06:16:38.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.827+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v184) ==== 169+0+0 (secure 0 0 0) 0x7f8bb8014030 con 0x7f8bcc1541a0 2024-09-21T06:16:38.830 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-09-21T06:16:38.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.829+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 <== mon.0 v2:172.21.15.118:3300/0 8 ==== osd_map(184..184 src has 1..184) ==== 296+0+0 (secure 0 0 0) 0x7f8bb80d22b0 con 0x7f8bcc1541a0 2024-09-21T06:16:38.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.829+0000 7f8bc3e00640 1 -- 172.21.15.118:0/3466142911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=185}) -- 0x7f8bac07e7a0 con 0x7f8bcc1541a0 2024-09-21T06:16:38.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.837+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8bac078b90 msgr2=0x7f8bac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:38.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.837+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8bac078b90 0x7f8bac07b0a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc000f60 tx=0x7f8bbc009040 comp rx=0 tx=0).stop 2024-09-21T06:16:38.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.837+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc1541a0 msgr2=0x7f8bcc06f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:38.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.837+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc1541a0 0x7f8bcc06f510 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800c9a0 tx=0x7f8bb800ce60 comp rx=0 tx=0).stop 2024-09-21T06:16:38.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.838+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 shutdown_connections 2024-09-21T06:16:38.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.838+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8bac078b90 0x7f8bac07b0a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.838+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bcc0b41c0 0x7f8bcc06fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.838+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bcc1541a0 0x7f8bcc06f510 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.838+0000 7f8bd2e00640 1 --2- 172.21.15.118:0/3466142911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bcc0b0c30 0x7f8bcc1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:38.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.838+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 >> 172.21.15.118:0/3466142911 conn(0x7f8bcc074860 msgr2=0x7f8bcc1e68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:38.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.839+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 shutdown_connections 2024-09-21T06:16:38.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:38.839+0000 7f8bd2e00640 1 -- 172.21.15.118:0/3466142911 wait complete. 2024-09-21T06:16:38.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-21T06:16:39.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.087+0000 7f3571c00640 1 -- 172.21.15.118:0/339010109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0d0e80 msgr2=0x7f356c0d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.087+0000 7f3571c00640 1 --2- 172.21.15.118:0/339010109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0d0e80 0x7f356c0d1290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f356c070520 tx=0x7f355402a580 comp rx=0 tx=0).stop 2024-09-21T06:16:39.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.087+0000 7f3571c00640 1 -- 172.21.15.118:0/339010109 shutdown_connections 2024-09-21T06:16:39.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.087+0000 7f3571c00640 1 --2- 172.21.15.118:0/339010109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0d0e80 0x7f356c0d1290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.087+0000 7f3571c00640 1 -- 172.21.15.118:0/339010109 >> 172.21.15.118:0/339010109 conn(0x7f356c06d110 msgr2=0x7f356c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:39.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.087+0000 7f3571c00640 1 -- 172.21.15.118:0/339010109 shutdown_connections 2024-09-21T06:16:39.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.088+0000 7f3571c00640 1 -- 172.21.15.118:0/339010109 wait complete. 2024-09-21T06:16:39.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.090+0000 7f3571c00640 1 Processor -- start 2024-09-21T06:16:39.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.090+0000 7f3571c00640 1 -- start start 2024-09-21T06:16:39.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.091+0000 7f3571c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c073e30 0x7f356c1f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.091+0000 7f3571c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0aea60 0x7f356c1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.091+0000 7f3571c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0d0e80 0x7f356c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.091+0000 7f3571c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f356c0af790 con 0x7f356c0d0e80 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.091+0000 7f3571c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f356c156590 con 0x7f356c073e30 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.091+0000 7f3571c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f356c0af910 con 0x7f356c0aea60 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0d0e80 0x7f356c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0d0e80 0x7f356c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55844/0 (socket says 172.21.15.118:55844) 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 -- 172.21.15.118:0/176662996 learned_addr learned my addr 172.21.15.118:0/176662996 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f3562000640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0aea60 0x7f356c1424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356aa00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c073e30 0x7f356c1f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 -- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0aea60 msgr2=0x7f356c1424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0aea60 0x7f356c1424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 -- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c073e30 msgr2=0x7f356c1f99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c073e30 0x7f356c1f99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 -- 172.21.15.118:0/176662996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c1f5f90 con 0x7f356c0d0e80 2024-09-21T06:16:39.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f356b400640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0d0e80 0x7f356c157a00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f356400c6b0 tx=0x7f356400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:39.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.092+0000 7f3563400640 1 -- 172.21.15.118:0/176662996 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564003b70 con 0x7f356c0d0e80 2024-09-21T06:16:39.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.093+0000 7f3563400640 1 -- 172.21.15.118:0/176662996 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3564003d50 con 0x7f356c0d0e80 2024-09-21T06:16:39.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.093+0000 7f3563400640 1 -- 172.21.15.118:0/176662996 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564005330 con 0x7f356c0d0e80 2024-09-21T06:16:39.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.093+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c1f6270 con 0x7f356c0d0e80 2024-09-21T06:16:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.093+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1f6830 con 0x7f356c0d0e80 2024-09-21T06:16:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.094+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c0d1290 con 0x7f356c0d0e80 2024-09-21T06:16:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.095+0000 7f3563400640 1 -- 172.21.15.118:0/176662996 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f35640054d0 con 0x7f356c0d0e80 2024-09-21T06:16:39.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.096+0000 7f3563400640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3548078b90 0x7f354807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.097+0000 7f3563400640 1 -- 172.21.15.118:0/176662996 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f356409a6b0 con 0x7f356c0d0e80 2024-09-21T06:16:39.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.097+0000 7f356aa00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3548078b90 0x7f354807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.098+0000 7f356aa00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3548078b90 0x7f354807b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c00 tx=0x7f355c007ef0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:39.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.101+0000 7f3563400640 1 -- 172.21.15.118:0/176662996 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f356c0d17d0 con 0x7f356c0d0e80 2024-09-21T06:16:39.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.285+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f356c1fa0f0 con 0x7f356c0d0e80 2024-09-21T06:16:39.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.290+0000 7f3563400640 1 -- 172.21.15.118:0/176662996 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v43) ==== 71+0+0 (secure 0 0 0) 0x7f3564062790 con 0x7f356c0d0e80 2024-09-21T06:16:39.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.292+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3548078b90 msgr2=0x7f354807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.292+0000 7f3571c00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3548078b90 0x7f354807b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c00 tx=0x7f355c007ef0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.292+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0d0e80 msgr2=0x7f356c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.292+0000 7f3571c00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0d0e80 0x7f356c157a00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f356400c6b0 tx=0x7f356400cb70 comp rx=0 tx=0).stop 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 shutdown_connections 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0d0e80 0x7f356c157a00 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f3548078b90 0x7f354807b0a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f356c0aea60 0x7f356c1424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 --2- 172.21.15.118:0/176662996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c073e30 0x7f356c1f99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 >> 172.21.15.118:0/176662996 conn(0x7f356c06d110 msgr2=0x7f356c163450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 shutdown_connections 2024-09-21T06:16:39.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.293+0000 7f3571c00640 1 -- 172.21.15.118:0/176662996 wait complete. 2024-09-21T06:16:39.316 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-21T06:16:39.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.535+0000 7fc1d1600640 1 -- 172.21.15.118:0/2244099263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1b0005250 msgr2=0x7fc1b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.535+0000 7fc1d1600640 1 --2- 172.21.15.118:0/2244099263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1b0005250 0x7fc1b000b9c0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009ed0 tx=0x7fc1b0005830 comp rx=0 tx=0).stop 2024-09-21T06:16:39.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.535+0000 7fc1d1600640 1 -- 172.21.15.118:0/2244099263 shutdown_connections 2024-09-21T06:16:39.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.535+0000 7fc1d1600640 1 --2- 172.21.15.118:0/2244099263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1b0005250 0x7fc1b000b9c0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.535+0000 7fc1d1600640 1 -- 172.21.15.118:0/2244099263 >> 172.21.15.118:0/2244099263 conn(0x7fc1cc0748d0 msgr2=0x7fc1cc074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:39.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.535+0000 7fc1d1600640 1 -- 172.21.15.118:0/2244099263 shutdown_connections 2024-09-21T06:16:39.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.535+0000 7fc1d1600640 1 -- 172.21.15.118:0/2244099263 wait complete. 2024-09-21T06:16:39.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.537+0000 7fc1d1600640 1 Processor -- start 2024-09-21T06:16:39.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.537+0000 7fc1d1600640 1 -- start start 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1d1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1b0005250 0x7fc1cc15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1d1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1cc15e0b0 0x7fc1cc15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1d1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1cc15bcf0 0x7fc1cc158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1d1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0d0930 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1d1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0d07b0 con 0x7fc1cc15e0b0 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1d1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc0d0ab0 con 0x7fc1b0005250 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1cc15bcf0 0x7fc1cc158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1cc15bcf0 0x7fc1cc158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55864/0 (socket says 172.21.15.118:55864) 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 -- 172.21.15.118:0/168098787 learned_addr learned my addr 172.21.15.118:0/168098787 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1ca000640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1cc15e0b0 0x7fc1cc15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1caa00640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1b0005250 0x7fc1cc15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 -- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1b0005250 msgr2=0x7fc1cc15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1b0005250 0x7fc1cc15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 -- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1cc15e0b0 msgr2=0x7fc1cc15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1cc15e0b0 0x7fc1cc15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1cb400640 1 -- 172.21.15.118:0/168098787 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc1571d0 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1caa00640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1b0005250 0x7fc1cc15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.539+0000 7fc1ca000640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1cc15e0b0 0x7fc1cc15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:39.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.540+0000 7fc1cb400640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1cc15bcf0 0x7fc1cc158fd0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009e20 tx=0x7fc1c40042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:39.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.540+0000 7fc1c2a00640 1 -- 172.21.15.118:0/168098787 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40046d0 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.540+0000 7fc1c2a00640 1 -- 172.21.15.118:0/168098787 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1c403c440 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.540+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc1e9900 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.540+0000 7fc1c2a00640 1 -- 172.21.15.118:0/168098787 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c403c870 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.540+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc157470 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.541+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1cc0d1360 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.543+0000 7fc1c2a00640 1 -- 172.21.15.118:0/168098787 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1c4045020 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.543+0000 7fc1c2a00640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1ac078bc0 0x7fc1ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:39.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.544+0000 7fc1c2a00640 1 -- 172.21.15.118:0/168098787 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fc1c40bc570 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.544+0000 7fc1caa00640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1ac078bc0 0x7fc1ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:39.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.545+0000 7fc1caa00640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1ac078bc0 0x7fc1ac07b0d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc000fb0 tx=0x7fc1bc0067a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:39.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.547+0000 7fc1c2a00640 1 -- 172.21.15.118:0/168098787 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc1c404c020 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.800+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7fc1cc1ebce0 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.830+0000 7fc1c2a00640 1 -- 172.21.15.118:0/168098787 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v597) ==== 135+0+0 (secure 0 0 0) 0x7fc1c4084d20 con 0x7fc1cc15bcf0 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1ac078bc0 msgr2=0x7fc1ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1ac078bc0 0x7fc1ac07b0d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc000fb0 tx=0x7fc1bc0067a0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1cc15bcf0 msgr2=0x7fc1cc158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1cc15bcf0 0x7fc1cc158fd0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009e20 tx=0x7fc1c40042d0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 shutdown_connections 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1cc15bcf0 0x7fc1cc158fd0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1cc15e0b0 0x7fc1cc15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc1ac078bc0 0x7fc1ac07b0d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 --2- 172.21.15.118:0/168098787 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1b0005250 0x7fc1cc15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:39.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 >> 172.21.15.118:0/168098787 conn(0x7fc1cc0748d0 msgr2=0x7fc1cc074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:39.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 shutdown_connections 2024-09-21T06:16:39.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:39.833+0000 7fc1d1600640 1 -- 172.21.15.118:0/168098787 wait complete. 2024-09-21T06:16:39.856 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-21T06:16:39.856 INFO:tasks.cephfs_test_runner: 2024-09-21T06:16:39.856 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-21T06:16:39.856 INFO:tasks.cephfs_test_runner:Ran 10 tests in 737.485s 2024-09-21T06:16:39.856 INFO:tasks.cephfs_test_runner: 2024-09-21T06:16:39.857 INFO:tasks.cephfs_test_runner:OK 2024-09-21T06:16:39.857 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-21T06:16:39.871 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:16:39.881 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:16:39.881 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:39.881 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:39.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:16:39.917 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-21T06:16:39.917 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:39.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:16:40.007 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:16:40.007 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:40.048 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:16:40.048 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-21T06:16:40.048 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:16:40.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1991319,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599936k,nr_inodes=399984,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199876k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:16:40.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.125 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:16:40.160 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:16:40.160 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:16:40.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:16:40.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:16:40.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-09-21T06:16:40.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.805 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-09-21T06:16:40.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.842 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-09-21T06:16:40.942 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-09-21T06:16:40.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:16:40.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.945 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:16:40.985 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:16:40.985 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:16:40.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:40.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:16:41.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:41.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:16:41.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:41.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-21T06:16:41.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:41.662 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-21T06:16:41.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:16:41.698 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-21T06:16:41.798 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-21T06:16:41.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:16:41.801 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T06:16:41.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:16:41.813 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:16:42.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.033+0000 7fd56b000640 1 -- 172.21.15.118:0/2669972623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5640d1590 msgr2=0x7fd564142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.033+0000 7fd56b000640 1 --2- 172.21.15.118:0/2669972623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5640d1590 0x7fd564142730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009830 tx=0x7fd54c02a530 comp rx=0 tx=0).stop 2024-09-21T06:16:42.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.033+0000 7fd56b000640 1 -- 172.21.15.118:0/2669972623 shutdown_connections 2024-09-21T06:16:42.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.033+0000 7fd56b000640 1 --2- 172.21.15.118:0/2669972623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5640d1590 0x7fd564142730 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.033+0000 7fd56b000640 1 -- 172.21.15.118:0/2669972623 >> 172.21.15.118:0/2669972623 conn(0x7fd56406d110 msgr2=0x7fd56406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:42.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.033+0000 7fd56b000640 1 -- 172.21.15.118:0/2669972623 shutdown_connections 2024-09-21T06:16:42.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.033+0000 7fd56b000640 1 -- 172.21.15.118:0/2669972623 wait complete. 2024-09-21T06:16:42.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.035+0000 7fd56b000640 1 Processor -- start 2024-09-21T06:16:42.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.035+0000 7fd56b000640 1 -- start start 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd56b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd56413fae0 0x7fd5641f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd56b000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd56413fef0 0x7fd5641f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd56b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd56413e450 0x7fd56413e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd56b000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd564168280 con 0x7fd56413fef0 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd56b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd564168100 con 0x7fd56413fae0 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd56b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd564168400 con 0x7fd56413e450 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd55b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd56413fef0 0x7fd5641f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd55b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd56413fef0 0x7fd5641f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55870/0 (socket says 172.21.15.118:55870) 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd55b400640 1 -- 172.21.15.118:0/3312756258 learned_addr learned my addr 172.21.15.118:0/3312756258 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd563e00640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd56413fae0 0x7fd5641f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd569000640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd56413e450 0x7fd56413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd55b400640 1 -- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd56413e450 msgr2=0x7fd56413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd55b400640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd56413e450 0x7fd56413e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd55b400640 1 -- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd56413fae0 msgr2=0x7fd5641f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.037+0000 7fd55b400640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd56413fae0 0x7fd5641f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.038+0000 7fd55b400640 1 -- 172.21.15.118:0/3312756258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56413eda0 con 0x7fd56413fef0 2024-09-21T06:16:42.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.038+0000 7fd55b400640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd56413fef0 0x7fd5641f7ae0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009950 tx=0x7fd54c033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:42.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.038+0000 7fd560c00640 1 -- 172.21.15.118:0/3312756258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c031b50 con 0x7fd56413fef0 2024-09-21T06:16:42.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.038+0000 7fd560c00640 1 -- 172.21.15.118:0/3312756258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd54c031de0 con 0x7fd56413fef0 2024-09-21T06:16:42.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.038+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5641580c0 con 0x7fd56413fef0 2024-09-21T06:16:42.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.038+0000 7fd560c00640 1 -- 172.21.15.118:0/3312756258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c005280 con 0x7fd56413fef0 2024-09-21T06:16:42.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.038+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5641f72e0 con 0x7fd56413fef0 2024-09-21T06:16:42.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.039+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd564157e30 con 0x7fd56413fef0 2024-09-21T06:16:42.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.040+0000 7fd560c00640 1 -- 172.21.15.118:0/3312756258 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd54c005420 con 0x7fd56413fef0 2024-09-21T06:16:42.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.041+0000 7fd560c00640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd540078b90 0x7fd54007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.041+0000 7fd560c00640 1 -- 172.21.15.118:0/3312756258 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fd54c0bbbc0 con 0x7fd56413fef0 2024-09-21T06:16:42.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.042+0000 7fd563e00640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd540078b90 0x7fd54007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.042+0000 7fd563e00640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd540078b90 0x7fd54007b0a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd554000f60 tx=0x7fd554009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:42.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.046+0000 7fd560c00640 1 -- 172.21.15.118:0/3312756258 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd56413eda0 con 0x7fd56413fef0 2024-09-21T06:16:42.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.228+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5640d0e80 con 0x7fd540078b90 2024-09-21T06:16:42.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.229+0000 7fd560c00640 1 -- 172.21.15.118:0/3312756258 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12586 (secure 0 0 0) 0x7fd5640d0e80 con 0x7fd540078b90 2024-09-21T06:16:42.230 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:42.230 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:16:42.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd540078b90 msgr2=0x7fd54007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd540078b90 0x7fd54007b0a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd554000f60 tx=0x7fd554009040 comp rx=0 tx=0).stop 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd56413fef0 msgr2=0x7fd5641f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd56413fef0 0x7fd5641f7ae0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009950 tx=0x7fd54c033ba0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 shutdown_connections 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd540078b90 0x7fd54007b0a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd56413e450 0x7fd56413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd56413fef0 0x7fd5641f7ae0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 --2- 172.21.15.118:0/3312756258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd56413fae0 0x7fd5641f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 >> 172.21.15.118:0/3312756258 conn(0x7fd56406d110 msgr2=0x7fd564160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 shutdown_connections 2024-09-21T06:16:42.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.231+0000 7fd56b000640 1 -- 172.21.15.118:0/3312756258 wait complete. 2024-09-21T06:16:42.255 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2024-09-21T06:16:40.668186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":95262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1467237,"statfs":{"total":1600000000,"available":1502451526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-138,"num_write_kb":-105565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.232502"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":448,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T06:16:38.838973+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:16:38.838973+0000","last_peered":"2024-09-21T06:16:38.838973+0000","last_clean":"2024-09-21T06:16:38.838973+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:16:38.838973+0000","last_undegraded":"2024-09-21T06:16:38.838973+0000","last_fullsized":"2024-09-21T06:16:38.838973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185533,"statfs":{"total":200000000,"available":189986496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19442,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175870,"statfs":{"total":200000000,"available":180091104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173822,"statfs":{"total":200000000,"available":177993952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7154,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188158,"statfs":{"total":200000000,"available":192674016,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173822,"statfs":{"total":200000000,"available":177993952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":182014,"statfs":{"total":200000000,"available":186382560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:16:42.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:16:42.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 -- 172.21.15.118:0/1608499041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 msgr2=0x7f5830160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 --2- 172.21.15.118:0/1608499041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 0x7f5830160ff0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5820009830 tx=0x7f582002a510 comp rx=0 tx=0).stop 2024-09-21T06:16:42.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 -- 172.21.15.118:0/1608499041 shutdown_connections 2024-09-21T06:16:42.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 --2- 172.21.15.118:0/1608499041 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58300d14f0 0x7f58300cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 --2- 172.21.15.118:0/1608499041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 0x7f5830160ff0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 -- 172.21.15.118:0/1608499041 >> 172.21.15.118:0/1608499041 conn(0x7f583006d110 msgr2=0x7f583006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:42.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 -- 172.21.15.118:0/1608499041 shutdown_connections 2024-09-21T06:16:42.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.475+0000 7f5836e00640 1 -- 172.21.15.118:0/1608499041 wait complete. 2024-09-21T06:16:42.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.477+0000 7f5836e00640 1 Processor -- start 2024-09-21T06:16:42.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.477+0000 7f5836e00640 1 -- start start 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5836e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 0x7f58300b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5836e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5830161530 0x7f5830135b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5836e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5830136bf0 0x7f58301360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5836e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58300cfca0 con 0x7f5830136bf0 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5836e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58300cfb20 con 0x7f583013fc50 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5836e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58300cfe20 con 0x7f5830161530 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5834e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5830136bf0 0x7f58301360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f582fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 0x7f58300b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f582f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5830161530 0x7f5830135b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5834e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5830136bf0 0x7f58301360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55882/0 (socket says 172.21.15.118:55882) 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.479+0000 7f5834e00640 1 -- 172.21.15.118:0/1174099003 learned_addr learned my addr 172.21.15.118:0/1174099003 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:42.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5834e00640 1 -- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5830161530 msgr2=0x7f5830135b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5834e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5830161530 0x7f5830135b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5834e00640 1 -- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 msgr2=0x7f58300b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5834e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 0x7f58300b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5834e00640 1 -- 172.21.15.118:0/1174099003 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58300b2370 con 0x7f5830136bf0 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5834e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5830136bf0 0x7f58301360d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f582800efc0 tx=0x7f582800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5827e00640 1 -- 172.21.15.118:0/1174099003 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582801b070 con 0x7f5830136bf0 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5827e00640 1 -- 172.21.15.118:0/1174099003 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5828003b80 con 0x7f5830136bf0 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58300b12d0 con 0x7f5830136bf0 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5827e00640 1 -- 172.21.15.118:0/1174099003 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828004030 con 0x7f5830136bf0 2024-09-21T06:16:42.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.480+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58300b1890 con 0x7f5830136bf0 2024-09-21T06:16:42.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.481+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5830156cf0 con 0x7f5830136bf0 2024-09-21T06:16:42.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.483+0000 7f5827e00640 1 -- 172.21.15.118:0/1174099003 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f582801e070 con 0x7f5830136bf0 2024-09-21T06:16:42.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.484+0000 7f5827e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5810078b90 0x7f581007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.484+0000 7f5827e00640 1 -- 172.21.15.118:0/1174099003 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f582809b130 con 0x7f5830136bf0 2024-09-21T06:16:42.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.484+0000 7f582fe00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5810078b90 0x7f581007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.485+0000 7f582fe00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5810078b90 0x7f581007b0a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5820034000 tx=0x7f5820004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:42.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.488+0000 7f5827e00640 1 -- 172.21.15.118:0/1174099003 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5830156cf0 con 0x7f5830136bf0 2024-09-21T06:16:42.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.669+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58300d0340 con 0x7f5810078b90 2024-09-21T06:16:42.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.670+0000 7f5827e00640 1 -- 172.21.15.118:0/1174099003 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12586 (secure 0 0 0) 0x7f58300d0340 con 0x7f5810078b90 2024-09-21T06:16:42.672 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:42.672 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:16:42.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5810078b90 msgr2=0x7f581007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5810078b90 0x7f581007b0a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5820034000 tx=0x7f5820004730 comp rx=0 tx=0).stop 2024-09-21T06:16:42.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5830136bf0 msgr2=0x7f58301360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5830136bf0 0x7f58301360d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f582800efc0 tx=0x7f582800c800 comp rx=0 tx=0).stop 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 shutdown_connections 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5830136bf0 0x7f58301360d0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5810078b90 0x7f581007b0a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5830161530 0x7f5830135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 --2- 172.21.15.118:0/1174099003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f583013fc50 0x7f58300b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 >> 172.21.15.118:0/1174099003 conn(0x7f583006d110 msgr2=0x7f5830157160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 shutdown_connections 2024-09-21T06:16:42.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.673+0000 7f5836e00640 1 -- 172.21.15.118:0/1174099003 wait complete. 2024-09-21T06:16:42.698 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-21T06:16:42.668675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":95262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1467237,"statfs":{"total":1600000000,"available":1502451526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-138,"num_write_kb":-105565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.123537"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":448,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T06:16:38.838973+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:16:38.838973+0000","last_peered":"2024-09-21T06:16:38.838973+0000","last_clean":"2024-09-21T06:16:38.838973+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:16:38.838973+0000","last_undegraded":"2024-09-21T06:16:38.838973+0000","last_fullsized":"2024-09-21T06:16:38.838973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185533,"statfs":{"total":200000000,"available":189986496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19442,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175870,"statfs":{"total":200000000,"available":180091104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173822,"statfs":{"total":200000000,"available":177993952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7154,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188158,"statfs":{"total":200000000,"available":192674016,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173822,"statfs":{"total":200000000,"available":177993952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":182014,"statfs":{"total":200000000,"available":186382560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:16:42.699 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:16:42.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:16:42.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 -- 172.21.15.118:0/236169819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d80aea60 msgr2=0x7f16d80aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 --2- 172.21.15.118:0/236169819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d80aea60 0x7f16d80aee70 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f16d0005fd0 tx=0x7f16d002a8b0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 -- 172.21.15.118:0/236169819 shutdown_connections 2024-09-21T06:16:42.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 --2- 172.21.15.118:0/236169819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d80aea60 0x7f16d80aee70 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 --2- 172.21.15.118:0/236169819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16d8073e30 0x7f16d81635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 -- 172.21.15.118:0/236169819 >> 172.21.15.118:0/236169819 conn(0x7f16d806d110 msgr2=0x7f16d806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:42.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 -- 172.21.15.118:0/236169819 shutdown_connections 2024-09-21T06:16:42.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.919+0000 7f16dca00640 1 -- 172.21.15.118:0/236169819 wait complete. 2024-09-21T06:16:42.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.921+0000 7f16dca00640 1 Processor -- start 2024-09-21T06:16:42.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.922+0000 7f16dca00640 1 -- start start 2024-09-21T06:16:42.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16dca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d8073e30 0x7f16d8147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16dca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80aea60 0x7f16d8147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16dca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16d80d0e80 0x7f16d81477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16dca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f16d80af740 con 0x7f16d8073e30 2024-09-21T06:16:42.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16dca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16d80af5c0 con 0x7f16d80aea60 2024-09-21T06:16:42.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16dca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16d80af8c0 con 0x7f16d80d0e80 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16d5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d8073e30 0x7f16d8147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16d5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d8073e30 0x7f16d8147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55902/0 (socket says 172.21.15.118:55902) 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.923+0000 7f16d5e00640 1 -- 172.21.15.118:0/3483614602 learned_addr learned my addr 172.21.15.118:0/3483614602 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d5400640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80aea60 0x7f16d8147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d6800640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16d80d0e80 0x7f16d81477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d5e00640 1 -- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16d80d0e80 msgr2=0x7f16d81477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d5e00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16d80d0e80 0x7f16d81477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d5e00640 1 -- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80aea60 msgr2=0x7f16d8147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d5e00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80aea60 0x7f16d8147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d5e00640 1 -- 172.21.15.118:0/3483614602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d8159290 con 0x7f16d8073e30 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d6800640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16d80d0e80 0x7f16d81477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:16:42.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16d5e00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d8073e30 0x7f16d8147e10 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e790 tx=0x7f16c800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:42.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16ce000640 1 -- 172.21.15.118:0/3483614602 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c800eea0 con 0x7f16d8073e30 2024-09-21T06:16:42.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16ce000640 1 -- 172.21.15.118:0/3483614602 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16c800cdb0 con 0x7f16d8073e30 2024-09-21T06:16:42.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16ce000640 1 -- 172.21.15.118:0/3483614602 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8010690 con 0x7f16d8073e30 2024-09-21T06:16:42.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.924+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d8145430 con 0x7f16d8073e30 2024-09-21T06:16:42.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.925+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d81459f0 con 0x7f16d8073e30 2024-09-21T06:16:42.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.926+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d81635c0 con 0x7f16d8073e30 2024-09-21T06:16:42.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.927+0000 7f16ce000640 1 -- 172.21.15.118:0/3483614602 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16c8010830 con 0x7f16d8073e30 2024-09-21T06:16:42.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.928+0000 7f16ce000640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16b8078b90 0x7f16b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:42.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.928+0000 7f16ce000640 1 -- 172.21.15.118:0/3483614602 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f16c809b450 con 0x7f16d8073e30 2024-09-21T06:16:42.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.928+0000 7f16d5400640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16b8078b90 0x7f16b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:42.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.929+0000 7f16d5400640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16b8078b90 0x7f16b807b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f16d814b8f0 tx=0x7f16c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:42.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:42.932+0000 7f16ce000640 1 -- 172.21.15.118:0/3483614602 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f16c8063b80 con 0x7f16d8073e30 2024-09-21T06:16:43.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.117+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16d815a840 con 0x7f16b8078b90 2024-09-21T06:16:43.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.118+0000 7f16ce000640 1 -- 172.21.15.118:0/3483614602 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12586 (secure 0 0 0) 0x7f16d815a840 con 0x7f16b8078b90 2024-09-21T06:16:43.120 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:43.120 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:16:43.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.120+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16b8078b90 msgr2=0x7f16b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:43.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.120+0000 7f16dca00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16b8078b90 0x7f16b807b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f16d814b8f0 tx=0x7f16c4009040 comp rx=0 tx=0).stop 2024-09-21T06:16:43.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.120+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d8073e30 msgr2=0x7f16d8147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.120+0000 7f16dca00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d8073e30 0x7f16d8147e10 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e790 tx=0x7f16c800ec50 comp rx=0 tx=0).stop 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 shutdown_connections 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f16b8078b90 0x7f16b807b0a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16d80d0e80 0x7f16d81477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16d80aea60 0x7f16d8147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 --2- 172.21.15.118:0/3483614602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16d8073e30 0x7f16d8147e10 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 >> 172.21.15.118:0/3483614602 conn(0x7f16d806d110 msgr2=0x7f16d81554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 shutdown_connections 2024-09-21T06:16:43.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.121+0000 7f16dca00640 1 -- 172.21.15.118:0/3483614602 wait complete. 2024-09-21T06:16:43.147 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-21T06:16:42.668675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":95262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1467237,"statfs":{"total":1600000000,"available":1502451526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-138,"num_write_kb":-105565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.123537"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":448,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T06:16:38.838973+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:16:38.838973+0000","last_peered":"2024-09-21T06:16:38.838973+0000","last_clean":"2024-09-21T06:16:38.838973+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:16:38.838973+0000","last_undegraded":"2024-09-21T06:16:38.838973+0000","last_fullsized":"2024-09-21T06:16:38.838973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185533,"statfs":{"total":200000000,"available":189986496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19442,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175870,"statfs":{"total":200000000,"available":180091104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173822,"statfs":{"total":200000000,"available":177993952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7154,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188158,"statfs":{"total":200000000,"available":192674016,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21490,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173822,"statfs":{"total":200000000,"available":177993952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13298,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":182014,"statfs":{"total":200000000,"available":186382560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:16:43.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:16:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 -- 172.21.15.118:0/606467571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 msgr2=0x7fc478142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 --2- 172.21.15.118:0/606467571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478142c70 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc4780ceaa0 tx=0x7fc47002aa30 comp rx=0 tx=0).stop 2024-09-21T06:16:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 -- 172.21.15.118:0/606467571 shutdown_connections 2024-09-21T06:16:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 --2- 172.21.15.118:0/606467571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478142c70 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 --2- 172.21.15.118:0/606467571 >> v2:172.21.15.149:3300/0 conn(0x7fc4780d1590 0x7fc478142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 -- 172.21.15.118:0/606467571 >> 172.21.15.118:0/606467571 conn(0x7fc47806d110 msgr2=0x7fc47806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:43.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 -- 172.21.15.118:0/606467571 shutdown_connections 2024-09-21T06:16:43.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.365+0000 7fc47dc00640 1 -- 172.21.15.118:0/606467571 wait complete. 2024-09-21T06:16:43.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.368+0000 7fc47dc00640 1 Processor -- start 2024-09-21T06:16:43.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.368+0000 7fc47dc00640 1 -- start start 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc47dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc47813fae0 0x7fc4781f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc47dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc47dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc478139220 0x7fc478140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc47dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc4780cfa70 con 0x7fc47813fef0 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc47dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc4780cf8f0 con 0x7fc478139220 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc47dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc4780cfbf0 con 0x7fc47813fae0 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc46e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc46e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55928/0 (socket says 172.21.15.118:55928) 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.369+0000 7fc46e000640 1 -- 172.21.15.118:0/4026711266 learned_addr learned my addr 172.21.15.118:0/4026711266 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc477400640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc478139220 0x7fc478140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc476a00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc47813fae0 0x7fc4781f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46e000640 1 -- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc47813fae0 msgr2=0x7fc4781f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46e000640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc47813fae0 0x7fc4781f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46e000640 1 -- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc478139220 msgr2=0x7fc478140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46e000640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc478139220 0x7fc478140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46e000640 1 -- 172.21.15.118:0/4026711266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc478150180 con 0x7fc47813fef0 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46e000640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478138ab0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc46000d770 tx=0x7fc46000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46f400640 1 -- 172.21.15.118:0/4026711266 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460017070 con 0x7fc47813fef0 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46f400640 1 -- 172.21.15.118:0/4026711266 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc460009d20 con 0x7fc47813fef0 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc46f400640 1 -- 172.21.15.118:0/4026711266 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460004280 con 0x7fc47813fef0 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.370+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4780b5490 con 0x7fc47813fef0 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.371+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4780b4730 con 0x7fc47813fef0 2024-09-21T06:16:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.372+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4780b52c0 con 0x7fc47813fef0 2024-09-21T06:16:43.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.373+0000 7fc46f400640 1 -- 172.21.15.118:0/4026711266 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc460005020 con 0x7fc47813fef0 2024-09-21T06:16:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.374+0000 7fc46f400640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc454078b90 0x7fc45407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:43.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.374+0000 7fc46f400640 1 -- 172.21.15.118:0/4026711266 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fc46009aef0 con 0x7fc47813fef0 2024-09-21T06:16:43.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.375+0000 7fc476a00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc454078b90 0x7fc45407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:43.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.375+0000 7fc476a00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc454078b90 0x7fc45407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc468007fd0 tx=0x7fc468009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:43.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.379+0000 7fc46f400640 1 -- 172.21.15.118:0/4026711266 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc460020020 con 0x7fc47813fef0 2024-09-21T06:16:43.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.567+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4780d0110 con 0x7fc47813fef0 2024-09-21T06:16:43.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.568+0000 7fc46f400640 1 -- 172.21.15.118:0/4026711266 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) ==== 74+0+13117 (secure 0 0 0) 0x7fc460063590 con 0x7fc47813fef0 2024-09-21T06:16:43.569 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:43.569 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":184,"fsid":"dc6f3bb0-0fb5-41f5-8054-0731c39e6f6e","created":"2024-09-21T06:03:35.301335+0000","modified":"2024-09-21T06:16:38.822791+0000","last_up_change":"2024-09-21T06:03:43.992201+0000","last_in_change":"2024-09-21T06:03:40.985886+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:03:44.483842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6813","nonce":3230871877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6815","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6817","nonce":3230871877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6823","nonce":3230871877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":3230871877},{"type":"v1","addr":"172.21.15.118:6821","nonce":3230871877}]},"public_addr":"172.21.15.118:6813/3230871877","cluster_addr":"172.21.15.118:6817/3230871877","heartbeat_back_addr":"172.21.15.118:6823/3230871877","heartbeat_front_addr":"172.21.15.118:6821/3230871877","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6809","nonce":3649321090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6812","nonce":3649321090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6820","nonce":3649321090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3649321090},{"type":"v1","addr":"172.21.15.118:6816","nonce":3649321090}]},"public_addr":"172.21.15.118:6809/3649321090","cluster_addr":"172.21.15.118:6812/3649321090","heartbeat_back_addr":"172.21.15.118:6820/3649321090","heartbeat_front_addr":"172.21.15.118:6816/3649321090","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6825","nonce":2733819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6827","nonce":2733819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6831","nonce":2733819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2733819645},{"type":"v1","addr":"172.21.15.118:6829","nonce":2733819645}]},"public_addr":"172.21.15.118:6825/2733819645","cluster_addr":"172.21.15.118:6827/2733819645","heartbeat_back_addr":"172.21.15.118:6831/2733819645","heartbeat_front_addr":"172.21.15.118:6829/2733819645","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6801","nonce":2396738504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6803","nonce":2396738504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6807","nonce":2396738504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":2396738504},{"type":"v1","addr":"172.21.15.118:6805","nonce":2396738504}]},"public_addr":"172.21.15.118:6801/2396738504","cluster_addr":"172.21.15.118:6803/2396738504","heartbeat_back_addr":"172.21.15.118:6807/2396738504","heartbeat_front_addr":"172.21.15.118:6805/2396738504","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6807","nonce":2084856893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6813","nonce":2084856893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6822","nonce":2084856893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2084856893},{"type":"v1","addr":"172.21.15.149:6818","nonce":2084856893}]},"public_addr":"172.21.15.149:6807/2084856893","cluster_addr":"172.21.15.149:6813/2084856893","heartbeat_back_addr":"172.21.15.149:6822/2084856893","heartbeat_front_addr":"172.21.15.149:6818/2084856893","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6803","nonce":1726198958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6806","nonce":1726198958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6815","nonce":1726198958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1726198958},{"type":"v1","addr":"172.21.15.149:6809","nonce":1726198958}]},"public_addr":"172.21.15.149:6803/1726198958","cluster_addr":"172.21.15.149:6806/1726198958","heartbeat_back_addr":"172.21.15.149:6815/1726198958","heartbeat_front_addr":"172.21.15.149:6809/1726198958","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6814","nonce":3763347027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6819","nonce":3763347027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6825","nonce":3763347027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":3763347027},{"type":"v1","addr":"172.21.15.149:6823","nonce":3763347027}]},"public_addr":"172.21.15.149:6814/3763347027","cluster_addr":"172.21.15.149:6819/3763347027","heartbeat_back_addr":"172.21.15.149:6825/3763347027","heartbeat_front_addr":"172.21.15.149:6823/3763347027","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6827","nonce":2881805415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6829","nonce":2881805415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6833","nonce":2881805415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":2881805415},{"type":"v1","addr":"172.21.15.149:6831","nonce":2881805415}]},"public_addr":"172.21.15.149:6827/2881805415","cluster_addr":"172.21.15.149:6829/2881805415","heartbeat_back_addr":"172.21.15.149:6833/2881805415","heartbeat_front_addr":"172.21.15.149:6831/2881805415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.341206+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.318113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.325079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.304772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.241111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.242897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.231845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:03:42.321191+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6835/1906430452":"2024-09-22T06:16:35.537777+0000","172.21.15.118:6833/1906430452":"2024-09-22T06:16:35.537777+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:16:43.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc454078b90 msgr2=0x7fc45407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:43.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc454078b90 0x7fc45407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc468007fd0 tx=0x7fc468009040 comp rx=0 tx=0).stop 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 msgr2=0x7fc478138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478138ab0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc46000d770 tx=0x7fc46000dc30 comp rx=0 tx=0).stop 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 shutdown_connections 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc478139220 0x7fc478140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc47813fef0 0x7fc478138ab0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc454078b90 0x7fc45407b0a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 --2- 172.21.15.118:0/4026711266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc47813fae0 0x7fc4781f9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 >> 172.21.15.118:0/4026711266 conn(0x7fc47806d110 msgr2=0x7fc478153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 shutdown_connections 2024-09-21T06:16:43.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:43.570+0000 7fc47dc00640 1 -- 172.21.15.118:0/4026711266 wait complete. 2024-09-21T06:16:44.595 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T06:16:44.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 -- 172.21.15.118:0/503775669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f680cdf00 msgr2=0x7f9f6815c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 --2- 172.21.15.118:0/503775669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f680cdf00 0x7f9f6815c3f0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f9f680d0190 tx=0x7f9f5402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 -- 172.21.15.118:0/503775669 shutdown_connections 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 --2- 172.21.15.118:0/503775669 >> v2:172.21.15.149:3300/0 conn(0x7f9f6815c930 0x7f9f68072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 --2- 172.21.15.118:0/503775669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f680cdf00 0x7f9f6815c3f0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 -- 172.21.15.118:0/503775669 >> 172.21.15.118:0/503775669 conn(0x7f9f6806cf30 msgr2=0x7f9f6806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 -- 172.21.15.118:0/503775669 shutdown_connections 2024-09-21T06:16:44.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.828+0000 7f9f6ee00640 1 -- 172.21.15.118:0/503775669 wait complete. 2024-09-21T06:16:44.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.830+0000 7f9f6ee00640 1 Processor -- start 2024-09-21T06:16:44.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.831+0000 7f9f6ee00640 1 -- start start 2024-09-21T06:16:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f681563b0 0x7f9f6814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f6815c930 0x7f9f6815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f681558c0 0x7f9f6815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f68073390 con 0x7f9f681558c0 2024-09-21T06:16:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6815cf90 con 0x7f9f6815c930 2024-09-21T06:16:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f68073510 con 0x7f9f681563b0 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f681558c0 0x7f9f6815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f67400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f6815c930 0x7f9f6815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f681558c0 0x7f9f6815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55934/0 (socket says 172.21.15.118:55934) 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f6ce00640 1 -- 172.21.15.118:0/2688636552 learned_addr learned my addr 172.21.15.118:0/2688636552 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.832+0000 7f9f67e00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f681563b0 0x7f9f6814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f6ce00640 1 -- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f681563b0 msgr2=0x7f9f6814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f6ce00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f681563b0 0x7f9f6814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f6ce00640 1 -- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f6815c930 msgr2=0x7f9f6815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f6ce00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f6815c930 0x7f9f6815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f6ce00640 1 -- 172.21.15.118:0/2688636552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680aa770 con 0x7f9f681558c0 2024-09-21T06:16:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f6ce00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f681558c0 0x7f9f6815b250 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f9f60005d00 tx=0x7f9f6000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60017070 con 0x7f9f681558c0 2024-09-21T06:16:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f60005330 con 0x7f9f681558c0 2024-09-21T06:16:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f680aaa50 con 0x7f9f681558c0 2024-09-21T06:16:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.833+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600047a0 con 0x7f9f681558c0 2024-09-21T06:16:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.834+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6814e4f0 con 0x7f9f681558c0 2024-09-21T06:16:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.834+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f680739c0 con 0x7f9f681558c0 2024-09-21T06:16:44.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.836+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f60004940 con 0x7f9f681558c0 2024-09-21T06:16:44.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.837+0000 7f9f5fe00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f48078b90 0x7f9f4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:44.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.837+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f9f6009aff0 con 0x7f9f681558c0 2024-09-21T06:16:44.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.837+0000 7f9f5fe00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f9f4807eaa0 0x7f9f48080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:44.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.837+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 --> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f480815c0 con 0x7f9f4807eaa0 2024-09-21T06:16:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.837+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7f9f6009b3e0 con 0x7f9f681558c0 2024-09-21T06:16:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.837+0000 7f9f67e00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f48078b90 0x7f9f4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.837+0000 7f9f67400640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f9f4807eaa0 0x7f9f48080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.838+0000 7f9f67400640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f9f4807eaa0 0x7f9f48080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.838+0000 7f9f67e00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f48078b90 0x7f9f4807b0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800b450 tx=0x7f9f5800d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:44.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.839+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== osd.0 v2:172.21.15.118:6811/3230871877 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f9f480815c0 con 0x7f9f4807eaa0 2024-09-21T06:16:44.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.853+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 --> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9f6806a260 con 0x7f9f4807eaa0 2024-09-21T06:16:44.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.853+0000 7f9f5fe00640 1 -- 172.21.15.118:0/2688636552 <== osd.0 v2:172.21.15.118:6811/3230871877 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f9f6806a260 con 0x7f9f4807eaa0 2024-09-21T06:16:44.855 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:44.855 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:44.855 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.853+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f9f4807eaa0 msgr2=0x7f9f48080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.853+0000 7f9f6ee00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:6811/3230871877,v1:172.21.15.118:6813/3230871877] conn(0x7f9f4807eaa0 0x7f9f48080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f48078b90 msgr2=0x7f9f4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9f48078b90 0x7f9f4807b0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800b450 tx=0x7f9f5800d040 comp rx=0 tx=0).stop 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f681558c0 msgr2=0x7f9f6815b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 --2- 172.21.15.118:0/2688636552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f681558c0 0x7f9f6815b250 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f9f60005d00 tx=0x7f9f6000dae0 comp rx=0 tx=0).stop 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ce00640 1 -- 172.21.15.118:0/2688636552 reap_dead start 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 shutdown_connections 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 >> 172.21.15.118:0/2688636552 conn(0x7f9f6806cf30 msgr2=0x7f9f6815d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 shutdown_connections 2024-09-21T06:16:44.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:44.854+0000 7f9f6ee00640 1 -- 172.21.15.118:0/2688636552 wait complete. 2024-09-21T06:16:44.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T06:16:45.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 -- 172.21.15.118:0/2636330639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff36406d400 msgr2=0x7ff3640b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 --2- 172.21.15.118:0/2636330639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff36406d400 0x7ff3640b4be0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff35c005fd0 tx=0x7ff35c02a7a0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 -- 172.21.15.118:0/2636330639 shutdown_connections 2024-09-21T06:16:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 --2- 172.21.15.118:0/2636330639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff36406d400 0x7ff3640b4be0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 --2- 172.21.15.118:0/2636330639 >> v2:172.21.15.149:3300/0 conn(0x7ff3640d03e0 0x7ff3640d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 -- 172.21.15.118:0/2636330639 >> 172.21.15.118:0/2636330639 conn(0x7ff3640b38e0 msgr2=0x7ff3640b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 -- 172.21.15.118:0/2636330639 shutdown_connections 2024-09-21T06:16:45.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.098+0000 7ff36b800640 1 -- 172.21.15.118:0/2636330639 wait complete. 2024-09-21T06:16:45.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.100+0000 7ff36b800640 1 Processor -- start 2024-09-21T06:16:45.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.100+0000 7ff36b800640 1 -- start start 2024-09-21T06:16:45.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff36b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3640d03e0 0x7ff3640aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff36b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3640d07f0 0x7ff364154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff36b800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3641f9b90 0x7ff3641f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff36b800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff3640b6d70 con 0x7ff3641f9b90 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff36b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3640b6bf0 con 0x7ff3640d07f0 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff36b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff3640b6ef0 con 0x7ff3640d03e0 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff369800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3641f9b90 0x7ff3641f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff369800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3641f9b90 0x7ff3641f8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55942/0 (socket says 172.21.15.118:55942) 2024-09-21T06:16:45.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.102+0000 7ff369800640 1 -- 172.21.15.118:0/3971535328 learned_addr learned my addr 172.21.15.118:0/3971535328 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:45.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff369800640 1 -- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3640d03e0 msgr2=0x7ff3640aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff369800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3640d03e0 0x7ff3640aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff369800640 1 -- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3640d07f0 msgr2=0x7ff364154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff35be00640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3640d07f0 0x7ff364154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff369800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3640d07f0 0x7ff364154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff369800640 1 -- 172.21.15.118:0/3971535328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3640aa7f0 con 0x7ff3641f9b90 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff35be00640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3640d07f0 0x7ff364154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff369800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3641f9b90 0x7ff3641f8fd0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009cd0 tx=0x7ff35c032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff361600640 1 -- 172.21.15.118:0/3971535328 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c041020 con 0x7ff3641f9b90 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3641e62e0 con 0x7ff3641f9b90 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff361600640 1 -- 172.21.15.118:0/3971535328 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff35c004040 con 0x7ff3641f9b90 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff361600640 1 -- 172.21.15.118:0/3971535328 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c036040 con 0x7ff3641f9b90 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.103+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3641e68a0 con 0x7ff3641f9b90 2024-09-21T06:16:45.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.105+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3640aa550 con 0x7ff3641f9b90 2024-09-21T06:16:45.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.106+0000 7ff361600640 1 -- 172.21.15.118:0/3971535328 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff35c044020 con 0x7ff3641f9b90 2024-09-21T06:16:45.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.107+0000 7ff361600640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff340078bc0 0x7ff34007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.107+0000 7ff361600640 1 -- 172.21.15.118:0/3971535328 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7ff35c0bb740 con 0x7ff3641f9b90 2024-09-21T06:16:45.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.108+0000 7ff368e00640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff340078bc0 0x7ff34007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.108+0000 7ff368e00640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff340078bc0 0x7ff34007b0d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff3540058c0 tx=0x7ff354005850 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:45.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.112+0000 7ff361600640 1 -- 172.21.15.118:0/3971535328 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff3640aa550 con 0x7ff3641f9b90 2024-09-21T06:16:45.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.298+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff36415eb50 con 0x7ff340078bc0 2024-09-21T06:16:45.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.299+0000 7ff361600640 1 -- 172.21.15.118:0/3971535328 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff36415eb50 con 0x7ff340078bc0 2024-09-21T06:16:45.300 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff340078bc0 msgr2=0x7ff34007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff340078bc0 0x7ff34007b0d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff3540058c0 tx=0x7ff354005850 comp rx=0 tx=0).stop 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3641f9b90 msgr2=0x7ff3641f8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3641f9b90 0x7ff3641f8fd0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009cd0 tx=0x7ff35c032be0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 shutdown_connections 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3641f9b90 0x7ff3641f8fd0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3640d07f0 0x7ff364154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7ff340078bc0 0x7ff34007b0d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 --2- 172.21.15.118:0/3971535328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3640d03e0 0x7ff3640aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 >> 172.21.15.118:0/3971535328 conn(0x7ff3640b38e0 msgr2=0x7ff364071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 shutdown_connections 2024-09-21T06:16:45.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.301+0000 7ff36b800640 1 -- 172.21.15.118:0/3971535328 wait complete. 2024-09-21T06:16:45.328 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T06:16:45.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.552+0000 7f1c2be00640 1 -- 172.21.15.118:0/637651316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 msgr2=0x7f1c0c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.552+0000 7f1c2be00640 1 --2- 172.21.15.118:0/637651316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 0x7f1c0c004080 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009d00 tx=0x7f1c0c005830 comp rx=0 tx=0).stop 2024-09-21T06:16:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.552+0000 7f1c2be00640 1 -- 172.21.15.118:0/637651316 shutdown_connections 2024-09-21T06:16:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.552+0000 7f1c2be00640 1 --2- 172.21.15.118:0/637651316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 0x7f1c0c004080 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.552+0000 7f1c2be00640 1 -- 172.21.15.118:0/637651316 >> 172.21.15.118:0/637651316 conn(0x7f1c240b4800 msgr2=0x7f1c240b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.552+0000 7f1c2be00640 1 -- 172.21.15.118:0/637651316 shutdown_connections 2024-09-21T06:16:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.552+0000 7f1c2be00640 1 -- 172.21.15.118:0/637651316 wait complete. 2024-09-21T06:16:45.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.555+0000 7f1c2be00640 1 Processor -- start 2024-09-21T06:16:45.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.555+0000 7f1c2be00640 1 -- start start 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.556+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 0x7f1c2413a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.556+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c241f9250 0x7f1c240b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.556+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c240b4010 0x7f1c24159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.556+0000 7f1c2be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241612f0 con 0x7f1c0c003c30 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.556+0000 7f1c2be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24161170 con 0x7f1c240b4010 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.556+0000 7f1c2be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1c24161470 con 0x7f1c241f9250 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 0x7f1c2413a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 0x7f1c2413a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55956/0 (socket says 172.21.15.118:55956) 2024-09-21T06:16:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 -- 172.21.15.118:0/588021927 learned_addr learned my addr 172.21.15.118:0/588021927 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c28a00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c241f9250 0x7f1c240b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29e00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c240b4010 0x7f1c24159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 -- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c241f9250 msgr2=0x7f1c240b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c241f9250 0x7f1c240b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 -- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c240b4010 msgr2=0x7f1c24159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c240b4010 0x7f1c24159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 -- 172.21.15.118:0/588021927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2413a560 con 0x7f1c0c003c30 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29e00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c240b4010 0x7f1c24159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.557+0000 7f1c29400640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 0x7f1c2413a020 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009c20 tx=0x7f1c180038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.558+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18038040 con 0x7f1c0c003c30 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.558+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c1802b9f0 con 0x7f1c0c003c30 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.558+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c241f9c80 con 0x7f1c0c003c30 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.558+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18003cf0 con 0x7f1c0c003c30 2024-09-21T06:16:45.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.558+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c24139820 con 0x7f1c0c003c30 2024-09-21T06:16:45.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.559+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c24139640 con 0x7f1c0c003c30 2024-09-21T06:16:45.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.560+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c18043020 con 0x7f1c0c003c30 2024-09-21T06:16:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.561+0000 7f1c21600640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1c04078bc0 0x7f1c0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.561+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f1c180bbd80 con 0x7f1c0c003c30 2024-09-21T06:16:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.562+0000 7f1c21600640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7f1c0407ead0 0x7f1c04080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.562+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 --> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c1803dec0 con 0x7f1c0407ead0 2024-09-21T06:16:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.562+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7f1c180bc130 con 0x7f1c0c003c30 2024-09-21T06:16:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.562+0000 7f1c28a00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1c04078bc0 0x7f1c0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.562+0000 7f1c29e00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7f1c0407ead0 0x7f1c04080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.562+0000 7f1c29e00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7f1c0407ead0 0x7f1c04080f20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:45.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.562+0000 7f1c28a00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1c04078bc0 0x7f1c0407b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1c240b65f0 tx=0x7f1c100011c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:45.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.563+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== osd.1 v2:172.21.15.118:6808/3649321090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f1c1803dec0 con 0x7f1c0407ead0 2024-09-21T06:16:45.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.575+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 --> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1c240b6100 con 0x7f1c0407ead0 2024-09-21T06:16:45.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.575+0000 7f1c21600640 1 -- 172.21.15.118:0/588021927 <== osd.1 v2:172.21.15.118:6808/3649321090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f1c240b6100 con 0x7f1c0407ead0 2024-09-21T06:16:45.576 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:45.577 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:45.577 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:45.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7f1c0407ead0 msgr2=0x7f1c04080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:6808/3649321090,v1:172.21.15.118:6809/3649321090] conn(0x7f1c0407ead0 0x7f1c04080f20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1c04078bc0 msgr2=0x7f1c0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1c04078bc0 0x7f1c0407b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1c240b65f0 tx=0x7f1c100011c0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 msgr2=0x7f1c2413a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 --2- 172.21.15.118:0/588021927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c0c003c30 0x7f1c2413a020 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009c20 tx=0x7f1c180038a0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c29e00640 1 -- 172.21.15.118:0/588021927 reap_dead start 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 shutdown_connections 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 >> 172.21.15.118:0/588021927 conn(0x7f1c240b4800 msgr2=0x7f1c2415f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 shutdown_connections 2024-09-21T06:16:45.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.576+0000 7f1c2be00640 1 -- 172.21.15.118:0/588021927 wait complete. 2024-09-21T06:16:45.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T06:16:45.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.821+0000 7fd8e3e00640 1 -- 172.21.15.118:0/3114233853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c80039e0 msgr2=0x7fd8c8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.821+0000 7fd8e3e00640 1 --2- 172.21.15.118:0/3114233853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c80039e0 0x7fd8c8003e10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009b50 tx=0x7fd8c8005830 comp rx=0 tx=0).stop 2024-09-21T06:16:45.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.821+0000 7fd8e3400640 1 -- 172.21.15.118:0/3114233853 reap_dead start 2024-09-21T06:16:45.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.821+0000 7fd8e3e00640 1 -- 172.21.15.118:0/3114233853 shutdown_connections 2024-09-21T06:16:45.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.821+0000 7fd8e3e00640 1 -- 172.21.15.118:0/3114233853 >> 172.21.15.118:0/3114233853 conn(0x7fd8e406d6e0 msgr2=0x7fd8e40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:45.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.821+0000 7fd8e3e00640 1 -- 172.21.15.118:0/3114233853 shutdown_connections 2024-09-21T06:16:45.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.821+0000 7fd8e3e00640 1 -- 172.21.15.118:0/3114233853 wait complete. 2024-09-21T06:16:45.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.823+0000 7fd8e3e00640 1 Processor -- start 2024-09-21T06:16:45.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.823+0000 7fd8e3e00640 1 -- start start 2024-09-21T06:16:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.824+0000 7fd8e3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c80039e0 0x7fd8e4145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.824+0000 7fd8e3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e40cc450 0x7fd8e40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.824+0000 7fd8e3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e40caa70 0x7fd8e41f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.824+0000 7fd8e3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4074d80 con 0x7fd8e40cc450 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.824+0000 7fd8e3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4074c00 con 0x7fd8e40caa70 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.824+0000 7fd8e3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e40d0240 con 0x7fd8c80039e0 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e40cc450 0x7fd8e40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e40cc450 0x7fd8e40ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60162/0 (socket says 172.21.15.118:60162) 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 -- 172.21.15.118:0/2905787642 learned_addr learned my addr 172.21.15.118:0/2905787642 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2a00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c80039e0 0x7fd8e4145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e3400640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e40caa70 0x7fd8e41f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 -- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c80039e0 msgr2=0x7fd8e4145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c80039e0 0x7fd8e4145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 -- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e40caa70 msgr2=0x7fd8e41f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e40caa70 0x7fd8e41f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 -- 172.21.15.118:0/2905787642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e40cae80 con 0x7fd8e40cc450 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.825+0000 7fd8e2000640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e40cc450 0x7fd8e40ca530 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0003e50 tx=0x7fd8d0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.826+0000 7fd8daa00640 1 -- 172.21.15.118:0/2905787642 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0015070 con 0x7fd8e40cc450 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.826+0000 7fd8daa00640 1 -- 172.21.15.118:0/2905787642 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8d0011840 con 0x7fd8e40cc450 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.826+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e40b5370 con 0x7fd8e40cc450 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.826+0000 7fd8daa00640 1 -- 172.21.15.118:0/2905787642 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0011c70 con 0x7fd8e40cc450 2024-09-21T06:16:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.826+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e40b4840 con 0x7fd8e40cc450 2024-09-21T06:16:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.827+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e40b4600 con 0x7fd8e40cc450 2024-09-21T06:16:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.828+0000 7fd8daa00640 1 -- 172.21.15.118:0/2905787642 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8d0018070 con 0x7fd8e40cc450 2024-09-21T06:16:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.829+0000 7fd8daa00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8c4078bc0 0x7fd8c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.829+0000 7fd8daa00640 1 -- 172.21.15.118:0/2905787642 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fd8d009b5f0 con 0x7fd8e40cc450 2024-09-21T06:16:45.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.829+0000 7fd8e2a00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8c4078bc0 0x7fd8c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:45.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.830+0000 7fd8e2a00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8c4078bc0 0x7fd8c407b0d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4035000 tx=0x7fd8d402d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:45.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:45.834+0000 7fd8daa00640 1 -- 172.21.15.118:0/2905787642 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd8e40cae80 con 0x7fd8e40cc450 2024-09-21T06:16:46.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.022+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd8e40b5540 con 0x7fd8c4078bc0 2024-09-21T06:16:46.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.023+0000 7fd8daa00640 1 -- 172.21.15.118:0/2905787642 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd8e40b5540 con 0x7fd8c4078bc0 2024-09-21T06:16:46.024 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8c4078bc0 msgr2=0x7fd8c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8c4078bc0 0x7fd8c407b0d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4035000 tx=0x7fd8d402d040 comp rx=0 tx=0).stop 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e40cc450 msgr2=0x7fd8e40ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e40cc450 0x7fd8e40ca530 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0003e50 tx=0x7fd8d0001710 comp rx=0 tx=0).stop 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 shutdown_connections 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8e40caa70 0x7fd8e41f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8e40cc450 0x7fd8e40ca530 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fd8c4078bc0 0x7fd8c407b0d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 --2- 172.21.15.118:0/2905787642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8c80039e0 0x7fd8e4145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 >> 172.21.15.118:0/2905787642 conn(0x7fd8e406d6e0 msgr2=0x7fd8e4156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:46.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 shutdown_connections 2024-09-21T06:16:46.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.025+0000 7fd8e3e00640 1 -- 172.21.15.118:0/2905787642 wait complete. 2024-09-21T06:16:46.048 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T06:16:46.049 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:46.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.270+0000 7f0cfca00640 1 -- 172.21.15.118:0/1132729856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 msgr2=0x7f0cf815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 --2- 172.21.15.118:0/1132729856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 0x7f0cf815dcb0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80726f0 tx=0x7f0ce002a560 comp rx=0 tx=0).stop 2024-09-21T06:16:46.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 -- 172.21.15.118:0/1132729856 shutdown_connections 2024-09-21T06:16:46.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 --2- 172.21.15.118:0/1132729856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 0x7f0cf815dcb0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 --2- 172.21.15.118:0/1132729856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cf80b3e00 0x7f0cf80b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 --2- 172.21.15.118:0/1132729856 >> v2:172.21.15.149:3300/0 conn(0x7f0cf80701f0 0x7f0cf80ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 -- 172.21.15.118:0/1132729856 >> 172.21.15.118:0/1132729856 conn(0x7f0cf806cf30 msgr2=0x7f0cf806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 -- 172.21.15.118:0/1132729856 shutdown_connections 2024-09-21T06:16:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.271+0000 7f0cfca00640 1 -- 172.21.15.118:0/1132729856 wait complete. 2024-09-21T06:16:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.273+0000 7f0cfca00640 1 Processor -- start 2024-09-21T06:16:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.273+0000 7f0cfca00640 1 -- start start 2024-09-21T06:16:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.274+0000 7f0cfca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cf80701f0 0x7f0cf81423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.274+0000 7f0cfca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cf80b3e00 0x7f0cf812e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.274+0000 7f0cfca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 0x7f0cf812e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.274+0000 7f0cfca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80cee10 con 0x7f0cf8160a50 2024-09-21T06:16:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.274+0000 7f0cfca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80cec90 con 0x7f0cf80b3e00 2024-09-21T06:16:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.274+0000 7f0cfca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf80cef90 con 0x7f0cf80701f0 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 0x7f0cf812e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 0x7f0cf812e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60184/0 (socket says 172.21.15.118:60184) 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 -- 172.21.15.118:0/2773696210 learned_addr learned my addr 172.21.15.118:0/2773696210 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0ced400640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cf80b3e00 0x7f0cf812e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf5e00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cf80701f0 0x7f0cf81423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 -- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cf80701f0 msgr2=0x7f0cf81423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cf80701f0 0x7f0cf81423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 -- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cf80b3e00 msgr2=0x7f0cf812e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0cf80b3e00 0x7f0cf812e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 -- 172.21.15.118:0/2773696210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf80aa780 con 0x7f0cf8160a50 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.275+0000 7f0cf6800640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 0x7f0cf812e6f0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000e9c0 tx=0x7f0cf000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.276+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0004d20 con 0x7f0cf8160a50 2024-09-21T06:16:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.276+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cf000cac0 con 0x7f0cf8160a50 2024-09-21T06:16:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.276+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0005020 con 0x7f0cf8160a50 2024-09-21T06:16:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.276+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf8142e20 con 0x7f0cf8160a50 2024-09-21T06:16:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.276+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf812ed30 con 0x7f0cf8160a50 2024-09-21T06:16:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.277+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cf81434e0 con 0x7f0cf8160a50 2024-09-21T06:16:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.278+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cf00051c0 con 0x7f0cf8160a50 2024-09-21T06:16:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.279+0000 7f0ceea00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0cd4078b90 0x7f0cd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.279+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f0cf009b800 con 0x7f0cf8160a50 2024-09-21T06:16:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.279+0000 7f0ceea00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f0cd407eaa0 0x7f0cd4080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.279+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 --> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cf0019e70 con 0x7f0cd407eaa0 2024-09-21T06:16:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.279+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7f0cf009bbb0 con 0x7f0cf8160a50 2024-09-21T06:16:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.280+0000 7f0cf5e00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0cd4078b90 0x7f0cd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.280+0000 7f0ced400640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f0cd407eaa0 0x7f0cd4080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.280+0000 7f0ced400640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f0cd407eaa0 0x7f0cd4080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.280+0000 7f0cf5e00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0cd4078b90 0x7f0cd407b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800daa0 tx=0x7f0ce8005d70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:46.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.281+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== osd.2 v2:172.21.15.118:6824/2733819645 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f0cf0019e70 con 0x7f0cd407eaa0 2024-09-21T06:16:46.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.293+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 --> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0cf812efd0 con 0x7f0cd407eaa0 2024-09-21T06:16:46.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.293+0000 7f0ceea00640 1 -- 172.21.15.118:0/2773696210 <== osd.2 v2:172.21.15.118:6824/2733819645 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f0cf812efd0 con 0x7f0cd407eaa0 2024-09-21T06:16:46.294 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:46.295 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:46.295 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:46.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f0cd407eaa0 msgr2=0x7f0cd4080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:6824/2733819645,v1:172.21.15.118:6825/2733819645] conn(0x7f0cd407eaa0 0x7f0cd4080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0cd4078b90 msgr2=0x7f0cd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f0cd4078b90 0x7f0cd407b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800daa0 tx=0x7f0ce8005d70 comp rx=0 tx=0).stop 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 msgr2=0x7f0cf812e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 --2- 172.21.15.118:0/2773696210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cf8160a50 0x7f0cf812e6f0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000e9c0 tx=0x7f0cf000ee80 comp rx=0 tx=0).stop 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cf6800640 1 -- 172.21.15.118:0/2773696210 reap_dead start 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 shutdown_connections 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 >> 172.21.15.118:0/2773696210 conn(0x7f0cf806cf30 msgr2=0x7f0cf815be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 shutdown_connections 2024-09-21T06:16:46.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.294+0000 7f0cfca00640 1 -- 172.21.15.118:0/2773696210 wait complete. 2024-09-21T06:16:46.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 -- 172.21.15.118:0/3831992423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e0813fe10 msgr2=0x7f1e080d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 --2- 172.21.15.118:0/3831992423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e0813fe10 0x7f1e080d0ec0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f1df8005fd0 tx=0x7f1df802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 -- 172.21.15.118:0/3831992423 shutdown_connections 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 --2- 172.21.15.118:0/3831992423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080d1400 0x7f1e081426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 --2- 172.21.15.118:0/3831992423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e0813fe10 0x7f1e080d0ec0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 -- 172.21.15.118:0/3831992423 >> 172.21.15.118:0/3831992423 conn(0x7f1e0806d110 msgr2=0x7f1e0806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 -- 172.21.15.118:0/3831992423 shutdown_connections 2024-09-21T06:16:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.540+0000 7f1e0e200640 1 -- 172.21.15.118:0/3831992423 wait complete. 2024-09-21T06:16:46.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.542+0000 7f1e0e200640 1 Processor -- start 2024-09-21T06:16:46.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.542+0000 7f1e0e200640 1 -- start start 2024-09-21T06:16:46.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e0e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080d1400 0x7f1e081324c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e0e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e0813fe10 0x7f1e0813e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e0e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08142c00 0x7f1e0813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e0e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080d03d0 con 0x7f1e08142c00 2024-09-21T06:16:46.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e0e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080d0250 con 0x7f1e0813fe10 2024-09-21T06:16:46.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e0e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0806f3e0 con 0x7f1e080d1400 2024-09-21T06:16:46.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e07e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08142c00 0x7f1e0813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e07e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08142c00 0x7f1e0813ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60210/0 (socket says 172.21.15.118:60210) 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e07e00640 1 -- 172.21.15.118:0/874927291 learned_addr learned my addr 172.21.15.118:0/874927291 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e06a00640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e0813fe10 0x7f1e0813e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.544+0000 7f1e07400640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080d1400 0x7f1e081324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e07e00640 1 -- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080d1400 msgr2=0x7f1e081324c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e07e00640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080d1400 0x7f1e081324c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e07e00640 1 -- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e0813fe10 msgr2=0x7f1e0813e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e07e00640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e0813fe10 0x7f1e0813e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e07e00640 1 -- 172.21.15.118:0/874927291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e08132a00 con 0x7f1e08142c00 2024-09-21T06:16:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e07e00640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08142c00 0x7f1e0813ec00 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000c730 tx=0x7f1e0000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1dff400640 1 -- 172.21.15.118:0/874927291 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00016020 con 0x7f1e08142c00 2024-09-21T06:16:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1dff400640 1 -- 172.21.15.118:0/874927291 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e00003990 con 0x7f1e08142c00 2024-09-21T06:16:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1dff400640 1 -- 172.21.15.118:0/874927291 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00006e60 con 0x7f1e08142c00 2024-09-21T06:16:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e080b3370 con 0x7f1e08142c00 2024-09-21T06:16:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.545+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0813dec0 con 0x7f1e08142c00 2024-09-21T06:16:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.546+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0806f7d0 con 0x7f1e08142c00 2024-09-21T06:16:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.548+0000 7f1dff400640 1 -- 172.21.15.118:0/874927291 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e000050d0 con 0x7f1e08142c00 2024-09-21T06:16:46.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.549+0000 7f1dff400640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:46.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.549+0000 7f1dff400640 1 -- 172.21.15.118:0/874927291 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f1e0009a440 con 0x7f1e08142c00 2024-09-21T06:16:46.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.549+0000 7f1e07400640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:46.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.550+0000 7f1e07400640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1df8033000 tx=0x7f1df8004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:46.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.553+0000 7f1dff400640 1 -- 172.21.15.118:0/874927291 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1e00020020 con 0x7f1e08142c00 2024-09-21T06:16:46.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.737+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f1e080b3120 con 0x7f1de8078b90 2024-09-21T06:16:46.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.738+0000 7f1dff400640 1 -- 172.21.15.118:0/874927291 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1e080b3120 con 0x7f1de8078b90 2024-09-21T06:16:46.739 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T06:16:46.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 msgr2=0x7f1de807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1df8033000 tx=0x7f1df8004730 comp rx=0 tx=0).stop 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08142c00 msgr2=0x7f1e0813ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08142c00 0x7f1e0813ec00 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000c730 tx=0x7f1e0000cb30 comp rx=0 tx=0).stop 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 shutdown_connections 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e08142c00 0x7f1e0813ec00 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e0813fe10 0x7f1e0813e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 --2- 172.21.15.118:0/874927291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e080d1400 0x7f1e081324c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 >> 172.21.15.118:0/874927291 conn(0x7f1e0806d110 msgr2=0x7f1e0815fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 shutdown_connections 2024-09-21T06:16:46.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.740+0000 7f1e0e200640 1 -- 172.21.15.118:0/874927291 wait complete. 2024-09-21T06:16:46.766 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T06:16:46.767 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.993+0000 7f51c5a00640 1 -- 172.21.15.118:0/2561499877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a4004800 msgr2=0x7f51a4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.993+0000 7f51c5a00640 1 --2- 172.21.15.118:0/2561499877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a4004800 0x7f51a4004c10 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f51a800c310 tx=0x7f51a4005830 comp rx=0 tx=0).stop 2024-09-21T06:16:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.993+0000 7f51c5a00640 1 -- 172.21.15.118:0/2561499877 shutdown_connections 2024-09-21T06:16:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.993+0000 7f51c5a00640 1 --2- 172.21.15.118:0/2561499877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a4004800 0x7f51a4004c10 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.993+0000 7f51c5a00640 1 -- 172.21.15.118:0/2561499877 >> 172.21.15.118:0/2561499877 conn(0x7f51c00b2bc0 msgr2=0x7f51c00b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.993+0000 7f51c5a00640 1 -- 172.21.15.118:0/2561499877 shutdown_connections 2024-09-21T06:16:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.993+0000 7f51c5a00640 1 -- 172.21.15.118:0/2561499877 wait complete. 2024-09-21T06:16:46.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.996+0000 7f51c5a00640 1 Processor -- start 2024-09-21T06:16:46.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.996+0000 7f51c5a00640 1 -- start start 2024-09-21T06:16:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.997+0000 7f51c5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51a4004800 0x7f51c01577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.997+0000 7f51c5a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51c0151dc0 0x7f51c015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.997+0000 7f51c5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51c015af40 0x7f51c01f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.997+0000 7f51c5a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f51c015c4e0 con 0x7f51c0151dc0 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.997+0000 7f51c5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51c015c360 con 0x7f51c015af40 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.997+0000 7f51c5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f51c015c660 con 0x7f51a4004800 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51c0151dc0 0x7f51c015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51c0151dc0 0x7f51c015aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60234/0 (socket says 172.21.15.118:60234) 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 -- 172.21.15.118:0/2758761586 learned_addr learned my addr 172.21.15.118:0/2758761586 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51bfe00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51a4004800 0x7f51c01577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51c5000640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51c015af40 0x7f51c01f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 -- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51a4004800 msgr2=0x7f51c01577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51a4004800 0x7f51c01577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 -- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51c015af40 msgr2=0x7f51c01f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51c015af40 0x7f51c01f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 -- 172.21.15.118:0/2758761586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c0156a80 con 0x7f51c0151dc0 2024-09-21T06:16:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51c5000640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51c015af40 0x7f51c01f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.998+0000 7f51b7400640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51c0151dc0 0x7f51c015aa00 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f51a802b140 tx=0x7f51a8004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.999+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8031040 con 0x7f51c0151dc0 2024-09-21T06:16:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.999+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51a8006420 con 0x7f51c0151dc0 2024-09-21T06:16:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.999+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8006c90 con 0x7f51c0151dc0 2024-09-21T06:16:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.999+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c0157d10 con 0x7f51c0151dc0 2024-09-21T06:16:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:46.999+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c0156fd0 con 0x7f51c0151dc0 2024-09-21T06:16:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.000+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51c006a710 con 0x7f51c0151dc0 2024-09-21T06:16:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.001+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51a8034070 con 0x7f51c0151dc0 2024-09-21T06:16:47.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.002+0000 7f51bcc00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f519c078b90 0x7f519c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.002+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f51a80bb0b0 con 0x7f51c0151dc0 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.002+0000 7f51bcc00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f519c07eaa0 0x7f519c080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.002+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 --> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51a8005eb0 con 0x7f519c07eaa0 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.002+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7f51a80bb460 con 0x7f51c0151dc0 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.002+0000 7f51bfe00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f519c078b90 0x7f519c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.003+0000 7f51c5000640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f519c07eaa0 0x7f519c080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.003+0000 7f51c5000640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f519c07eaa0 0x7f519c080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.003+0000 7f51bfe00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f519c078b90 0x7f519c07b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f51c006bcb0 tx=0x7f51b0006b70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.004+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== osd.3 v2:172.21.15.118:6800/2396738504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f51a8005eb0 con 0x7f519c07eaa0 2024-09-21T06:16:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.015+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 --> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f51c015cbc0 con 0x7f519c07eaa0 2024-09-21T06:16:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.016+0000 7f51bcc00640 1 -- 172.21.15.118:0/2758761586 <== osd.3 v2:172.21.15.118:6800/2396738504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f51c015cbc0 con 0x7f519c07eaa0 2024-09-21T06:16:47.017 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:47.018 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:47.018 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:47.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.016+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f519c07eaa0 msgr2=0x7f519c080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.016+0000 7f51c5a00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:6800/2396738504,v1:172.21.15.118:6801/2396738504] conn(0x7f519c07eaa0 0x7f519c080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f519c078b90 msgr2=0x7f519c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f519c078b90 0x7f519c07b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f51c006bcb0 tx=0x7f51b0006b70 comp rx=0 tx=0).stop 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51c0151dc0 msgr2=0x7f51c015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 --2- 172.21.15.118:0/2758761586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51c0151dc0 0x7f51c015aa00 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f51a802b140 tx=0x7f51a8004bc0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5000640 1 -- 172.21.15.118:0/2758761586 reap_dead start 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 shutdown_connections 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 >> 172.21.15.118:0/2758761586 conn(0x7f51c00b2bc0 msgr2=0x7f51c00cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 shutdown_connections 2024-09-21T06:16:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.017+0000 7f51c5a00640 1 -- 172.21.15.118:0/2758761586 wait complete. 2024-09-21T06:16:47.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 -- 172.21.15.118:0/4129600314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d1960 msgr2=0x7f7bc006d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/4129600314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d1960 0x7f7bc006d200 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8005fd0 tx=0x7f7bb802aa90 comp rx=0 tx=0).stop 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 -- 172.21.15.118:0/4129600314 shutdown_connections 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/4129600314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d1960 0x7f7bc006d200 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/4129600314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bc00d38d0 0x7f7bc00d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 -- 172.21.15.118:0/4129600314 >> 172.21.15.118:0/4129600314 conn(0x7f7bc00d4c00 msgr2=0x7f7bc00d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 -- 172.21.15.118:0/4129600314 shutdown_connections 2024-09-21T06:16:47.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.259+0000 7f7bbfe00640 1 -- 172.21.15.118:0/4129600314 wait complete. 2024-09-21T06:16:47.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.261+0000 7f7bbfe00640 1 Processor -- start 2024-09-21T06:16:47.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.261+0000 7f7bbfe00640 1 -- start start 2024-09-21T06:16:47.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d29e0 0x7f7bc00cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bc00d38d0 0x7f7bc0158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bc00b6800 0x7f7bc00b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbfe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc006d8c0 con 0x7f7bc00d29e0 2024-09-21T06:16:47.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc006d740 con 0x7f7bc00d38d0 2024-09-21T06:16:47.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc006da40 con 0x7f7bc00b6800 2024-09-21T06:16:47.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d29e0 0x7f7bc00cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d29e0 0x7f7bc00cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60252/0 (socket says 172.21.15.118:60252) 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbea00640 1 -- 172.21.15.118:0/516742909 learned_addr learned my addr 172.21.15.118:0/516742909 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bbf400640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bc00b6800 0x7f7bc00b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.263+0000 7f7bb6000640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bc00d38d0 0x7f7bc0158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbea00640 1 -- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bc00b6800 msgr2=0x7f7bc00b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbea00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bc00b6800 0x7f7bc00b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbea00640 1 -- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bc00d38d0 msgr2=0x7f7bc0158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbea00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bc00d38d0 0x7f7bc0158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbea00640 1 -- 172.21.15.118:0/516742909 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc00b7150 con 0x7f7bc00d29e0 2024-09-21T06:16:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbea00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d29e0 0x7f7bc00cd780 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000d700 tx=0x7f7bb000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bb7400640 1 -- 172.21.15.118:0/516742909 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0017070 con 0x7f7bc00d29e0 2024-09-21T06:16:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bb7400640 1 -- 172.21.15.118:0/516742909 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bb0009d20 con 0x7f7bc00d29e0 2024-09-21T06:16:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc01f6ab0 con 0x7f7bc00d29e0 2024-09-21T06:16:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bb7400640 1 -- 172.21.15.118:0/516742909 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00106c0 con 0x7f7bc00d29e0 2024-09-21T06:16:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.264+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc01f5fd0 con 0x7f7bc00d29e0 2024-09-21T06:16:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.265+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc006de60 con 0x7f7bc00d29e0 2024-09-21T06:16:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.267+0000 7f7bb7400640 1 -- 172.21.15.118:0/516742909 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bb001a070 con 0x7f7bc00d29e0 2024-09-21T06:16:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.268+0000 7f7bb7400640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7b9c078b90 0x7f7b9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.268+0000 7f7bb7400640 1 -- 172.21.15.118:0/516742909 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f7bb009ad30 con 0x7f7bc00d29e0 2024-09-21T06:16:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.268+0000 7f7bb6000640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7b9c078b90 0x7f7b9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.269+0000 7f7bb6000640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7b9c078b90 0x7f7b9c07b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00b2370 tx=0x7f7ba8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.272+0000 7f7bb7400640 1 -- 172.21.15.118:0/516742909 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7bc00b7150 con 0x7f7bc00d29e0 2024-09-21T06:16:47.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.457+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f7bc00ce120 con 0x7f7b9c078b90 2024-09-21T06:16:47.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.458+0000 7f7bb7400640 1 -- 172.21.15.118:0/516742909 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7bc00ce120 con 0x7f7b9c078b90 2024-09-21T06:16:47.459 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T06:16:47.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7b9c078b90 msgr2=0x7f7b9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7b9c078b90 0x7f7b9c07b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00b2370 tx=0x7f7ba8009040 comp rx=0 tx=0).stop 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d29e0 msgr2=0x7f7bc00cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d29e0 0x7f7bc00cd780 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000d700 tx=0x7f7bb000dbc0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 shutdown_connections 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7b9c078b90 0x7f7b9c07b0a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bc00b6800 0x7f7bc00b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bc00d38d0 0x7f7bc0158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 --2- 172.21.15.118:0/516742909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc00d29e0 0x7f7bc00cd780 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 >> 172.21.15.118:0/516742909 conn(0x7f7bc00d4c00 msgr2=0x7f7bc00b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 shutdown_connections 2024-09-21T06:16:47.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.460+0000 7f7bbfe00640 1 -- 172.21.15.118:0/516742909 wait complete. 2024-09-21T06:16:47.483 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T06:16:47.483 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:47.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.709+0000 7f8d7b200640 1 -- 172.21.15.118:0/1967305550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 msgr2=0x7f8d60004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.709+0000 7f8d7b200640 1 --2- 172.21.15.118:0/1967305550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 0x7f8d60004060 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c001830 tx=0x7f8d60005830 comp rx=0 tx=0).stop 2024-09-21T06:16:47.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.709+0000 7f8d7a800640 1 -- 172.21.15.118:0/1967305550 reap_dead start 2024-09-21T06:16:47.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.709+0000 7f8d7b200640 1 -- 172.21.15.118:0/1967305550 shutdown_connections 2024-09-21T06:16:47.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.709+0000 7f8d7b200640 1 -- 172.21.15.118:0/1967305550 >> 172.21.15.118:0/1967305550 conn(0x7f8d7c0d4d30 msgr2=0x7f8d7c0d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:47.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.709+0000 7f8d7b200640 1 -- 172.21.15.118:0/1967305550 shutdown_connections 2024-09-21T06:16:47.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.709+0000 7f8d7b200640 1 -- 172.21.15.118:0/1967305550 wait complete. 2024-09-21T06:16:47.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.711+0000 7f8d7b200640 1 Processor -- start 2024-09-21T06:16:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.712+0000 7f8d7b200640 1 -- start start 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d7b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 0x7f8d7c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d7b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d7c157610 0x7f8d7c162160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d7b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d7c0ccbe0 0x7f8d7c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d7b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c163590 con 0x7f8d60003c10 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d7b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c163410 con 0x7f8d7c157610 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d7b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c0b83f0 con 0x7f8d7c0ccbe0 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d79e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 0x7f8d7c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d79e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 0x7f8d7c1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60258/0 (socket says 172.21.15.118:60258) 2024-09-21T06:16:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d79e00640 1 -- 172.21.15.118:0/827538278 learned_addr learned my addr 172.21.15.118:0/827538278 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d71400640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d7c157610 0x7f8d7c162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.713+0000 7f8d7a800640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d7c0ccbe0 0x7f8d7c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d79e00640 1 -- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d7c0ccbe0 msgr2=0x7f8d7c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d79e00640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d7c0ccbe0 0x7f8d7c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d79e00640 1 -- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d7c157610 msgr2=0x7f8d7c162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d79e00640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d7c157610 0x7f8d7c162160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d79e00640 1 -- 172.21.15.118:0/827538278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c0cd530 con 0x7f8d60003c10 2024-09-21T06:16:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d79e00640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 0x7f8d7c1550a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c001830 tx=0x7f8d6c0069d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c043070 con 0x7f8d60003c10 2024-09-21T06:16:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d6c0038e0 con 0x7f8d60003c10 2024-09-21T06:16:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c003cf0 con 0x7f8d60003c10 2024-09-21T06:16:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.714+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c157a20 con 0x7f8d60003c10 2024-09-21T06:16:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.715+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c1f6010 con 0x7f8d60003c10 2024-09-21T06:16:47.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.716+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d7c1f66d0 con 0x7f8d60003c10 2024-09-21T06:16:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.717+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d6c033480 con 0x7f8d60003c10 2024-09-21T06:16:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.718+0000 7f8d72a00640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8d58078b90 0x7f8d5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.718+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f8d6c0baf70 con 0x7f8d60003c10 2024-09-21T06:16:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.718+0000 7f8d72a00640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f8d5807eaa0 0x7f8d58080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.718+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 --> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d6c034e50 con 0x7f8d5807eaa0 2024-09-21T06:16:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.718+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7f8d6c0bb400 con 0x7f8d60003c10 2024-09-21T06:16:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.719+0000 7f8d71400640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8d58078b90 0x7f8d5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.719+0000 7f8d7a800640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f8d5807eaa0 0x7f8d58080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.719+0000 7f8d71400640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8d58078b90 0x7f8d5807b0a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c1609a0 tx=0x7f8d64005f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.719+0000 7f8d7a800640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f8d5807eaa0 0x7f8d58080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.720+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== osd.4 v2:172.21.15.149:6805/2084856893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f8d6c034e50 con 0x7f8d5807eaa0 2024-09-21T06:16:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.732+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 --> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8d7c06d850 con 0x7f8d5807eaa0 2024-09-21T06:16:47.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d72a00640 1 -- 172.21.15.118:0/827538278 <== osd.4 v2:172.21.15.149:6805/2084856893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f8d7c06d850 con 0x7f8d5807eaa0 2024-09-21T06:16:47.734 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:47.734 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:47.734 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:47.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f8d5807eaa0 msgr2=0x7f8d58080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6805/2084856893,v1:172.21.15.149:6807/2084856893] conn(0x7f8d5807eaa0 0x7f8d58080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8d58078b90 msgr2=0x7f8d5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f8d58078b90 0x7f8d5807b0a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c1609a0 tx=0x7f8d64005f90 comp rx=0 tx=0).stop 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 msgr2=0x7f8d7c1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 --2- 172.21.15.118:0/827538278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d60003c10 0x7f8d7c1550a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c001830 tx=0x7f8d6c0069d0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7a800640 1 -- 172.21.15.118:0/827538278 reap_dead start 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 shutdown_connections 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 >> 172.21.15.118:0/827538278 conn(0x7f8d7c0d4d30 msgr2=0x7f8d7c0c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.733+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 shutdown_connections 2024-09-21T06:16:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.734+0000 7f8d7b200640 1 -- 172.21.15.118:0/827538278 wait complete. 2024-09-21T06:16:47.759 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T06:16:47.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.979+0000 7fac82c00640 1 -- 172.21.15.118:0/2145145315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fef0 msgr2=0x7fac7c142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.979+0000 7fac82c00640 1 --2- 172.21.15.118:0/2145145315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fef0 0x7fac7c142e40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fac74005fd0 tx=0x7fac7402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.979+0000 7fac82c00640 1 -- 172.21.15.118:0/2145145315 shutdown_connections 2024-09-21T06:16:47.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.979+0000 7fac82c00640 1 --2- 172.21.15.118:0/2145145315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fef0 0x7fac7c142e40 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.979+0000 7fac82c00640 1 -- 172.21.15.118:0/2145145315 >> 172.21.15.118:0/2145145315 conn(0x7fac7c06d110 msgr2=0x7fac7c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:47.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.980+0000 7fac82c00640 1 -- 172.21.15.118:0/2145145315 shutdown_connections 2024-09-21T06:16:47.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.980+0000 7fac82c00640 1 -- 172.21.15.118:0/2145145315 wait complete. 2024-09-21T06:16:47.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.982+0000 7fac82c00640 1 Processor -- start 2024-09-21T06:16:47.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.982+0000 7fac82c00640 1 -- start start 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.983+0000 7fac82c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fae0 0x7fac7c1f9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.983+0000 7fac82c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac7c13fef0 0x7fac7c139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.983+0000 7fac82c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac7c13d160 0x7fac7c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.983+0000 7fac82c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c168280 con 0x7fac7c13fae0 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.983+0000 7fac82c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c168100 con 0x7fac7c13fef0 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.983+0000 7fac82c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c168400 con 0x7fac7c13d160 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.983+0000 7fac7be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fae0 0x7fac7c1f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fae0 0x7fac7c1f9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60276/0 (socket says 172.21.15.118:60276) 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 -- 172.21.15.118:0/3353641927 learned_addr learned my addr 172.21.15.118:0/3353641927 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:47.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7b400640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac7c13fef0 0x7fac7c139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac80c00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac7c13d160 0x7fac7c13d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 -- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac7c13d160 msgr2=0x7fac7c13d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac7c13d160 0x7fac7c13d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 -- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac7c13fef0 msgr2=0x7fac7c139310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac7c13fef0 0x7fac7c139310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 -- 172.21.15.118:0/3353641927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c13f020 con 0x7fac7c13fae0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac7be00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fae0 0x7fac7c1f9760 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c3a0 tx=0x7fac6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.984+0000 7fac73e00640 1 -- 172.21.15.118:0/3353641927 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c017070 con 0x7fac7c13fae0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.985+0000 7fac73e00640 1 -- 172.21.15.118:0/3353641927 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac6c0035f0 con 0x7fac7c13fae0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.985+0000 7fac73e00640 1 -- 172.21.15.118:0/3353641927 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c003a40 con 0x7fac7c13fae0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.985+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7c1f9ca0 con 0x7fac7c13fae0 2024-09-21T06:16:47.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.985+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7c1420d0 con 0x7fac7c13fae0 2024-09-21T06:16:47.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.986+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7c1422a0 con 0x7fac7c13fae0 2024-09-21T06:16:47.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.987+0000 7fac73e00640 1 -- 172.21.15.118:0/3353641927 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac6c01a070 con 0x7fac7c13fae0 2024-09-21T06:16:47.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.988+0000 7fac73e00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac5c078b90 0x7fac5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:47.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.989+0000 7fac73e00640 1 -- 172.21.15.118:0/3353641927 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fac6c099d60 con 0x7fac7c13fae0 2024-09-21T06:16:47.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.989+0000 7fac7b400640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac5c078b90 0x7fac5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:47.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.990+0000 7fac7b400640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac5c078b90 0x7fac5c07b0a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fac7c141bb0 tx=0x7fac68009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:47.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:47.993+0000 7fac73e00640 1 -- 172.21.15.118:0/3353641927 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fac6c061db0 con 0x7fac7c13fae0 2024-09-21T06:16:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.179+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fac7c0d0e80 con 0x7fac5c078b90 2024-09-21T06:16:48.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.180+0000 7fac73e00640 1 -- 172.21.15.118:0/3353641927 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac7c0d0e80 con 0x7fac5c078b90 2024-09-21T06:16:48.181 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T06:16:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac5c078b90 msgr2=0x7fac5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac5c078b90 0x7fac5c07b0a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fac7c141bb0 tx=0x7fac68009040 comp rx=0 tx=0).stop 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fae0 msgr2=0x7fac7c1f9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fae0 0x7fac7c1f9760 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c3a0 tx=0x7fac6c00c860 comp rx=0 tx=0).stop 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 shutdown_connections 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fac5c078b90 0x7fac5c07b0a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac7c13d160 0x7fac7c13d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac7c13fef0 0x7fac7c139310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 --2- 172.21.15.118:0/3353641927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac7c13fae0 0x7fac7c1f9760 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 >> 172.21.15.118:0/3353641927 conn(0x7fac7c06d110 msgr2=0x7fac7c166c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 shutdown_connections 2024-09-21T06:16:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.182+0000 7fac82c00640 1 -- 172.21.15.118:0/3353641927 wait complete. 2024-09-21T06:16:48.209 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T06:16:48.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:48.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 -- 172.21.15.118:0/2574046667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 msgr2=0x7f208c15e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 --2- 172.21.15.118:0/2574046667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 0x7f208c15e090 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f208c15dd80 tx=0x7f207c02a4f0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 -- 172.21.15.118:0/2574046667 shutdown_connections 2024-09-21T06:16:48.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 --2- 172.21.15.118:0/2574046667 >> v2:172.21.15.149:3300/0 conn(0x7f208c161510 0x7f208c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 --2- 172.21.15.118:0/2574046667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 0x7f208c15e090 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 -- 172.21.15.118:0/2574046667 >> 172.21.15.118:0/2574046667 conn(0x7f208c06cf30 msgr2=0x7f208c06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:48.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 -- 172.21.15.118:0/2574046667 shutdown_connections 2024-09-21T06:16:48.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.431+0000 7f2091400640 1 -- 172.21.15.118:0/2574046667 wait complete. 2024-09-21T06:16:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.433+0000 7f2091400640 1 Processor -- start 2024-09-21T06:16:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.434+0000 7f2091400640 1 -- start start 2024-09-21T06:16:48.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f2091400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 0x7f208c1f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f2091400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f208c0cddd0 0x7f208c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f2091400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f208c161510 0x7f208c14c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f2091400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f208c0cf520 con 0x7f208c0b3e90 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f2091400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1579e0 con 0x7f208c161510 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f2091400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f208c0cf6a0 con 0x7f208c0cddd0 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f208a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 0x7f208c1f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f208a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 0x7f208c1f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60300/0 (socket says 172.21.15.118:60300) 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.435+0000 7f208a800640 1 -- 172.21.15.118:0/3548449921 learned_addr learned my addr 172.21.15.118:0/3548449921 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f208b200640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f208c161510 0x7f208c14c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f2089e00640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f208c0cddd0 0x7f208c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f208a800640 1 -- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f208c0cddd0 msgr2=0x7f208c151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f208a800640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f208c0cddd0 0x7f208c151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f208a800640 1 -- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f208c161510 msgr2=0x7f208c14c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f208a800640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f208c161510 0x7f208c14c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f208a800640 1 -- 172.21.15.118:0/3548449921 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c15cab0 con 0x7f208c0b3e90 2024-09-21T06:16:48.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f208a800640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 0x7f208c1f5030 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f207c034040 tx=0x7f207c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:48.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.436+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c03e030 con 0x7f208c0b3e90 2024-09-21T06:16:48.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.437+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f207c003e00 con 0x7f208c0b3e90 2024-09-21T06:16:48.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.437+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c15cd90 con 0x7f208c0b3e90 2024-09-21T06:16:48.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.437+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c035040 con 0x7f208c0b3e90 2024-09-21T06:16:48.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.437+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c151270 con 0x7f208c0b3e90 2024-09-21T06:16:48.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.437+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f208c15e090 con 0x7f208c0b3e90 2024-09-21T06:16:48.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.439+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f207c041030 con 0x7f208c0b3e90 2024-09-21T06:16:48.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.440+0000 7f2082a00640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f206c078b90 0x7f206c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.440+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f207c0bb870 con 0x7f208c0b3e90 2024-09-21T06:16:48.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.440+0000 7f2082a00640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f206c07eaa0 0x7f206c080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.440+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 --> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f207c005310 con 0x7f206c07eaa0 2024-09-21T06:16:48.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.440+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7f207c0bbc20 con 0x7f208c0b3e90 2024-09-21T06:16:48.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.440+0000 7f2089e00640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f206c078b90 0x7f206c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.441+0000 7f208b200640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f206c07eaa0 0x7f206c080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.441+0000 7f2089e00640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f206c078b90 0x7f206c07b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f208c14d4a0 tx=0x7f207800b2e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:48.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.441+0000 7f208b200640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f206c07eaa0 0x7f206c080ef0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:48.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.442+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== osd.5 v2:172.21.15.149:6802/1726198958 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f207c005310 con 0x7f206c07eaa0 2024-09-21T06:16:48.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.454+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 --> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f208c06a260 con 0x7f206c07eaa0 2024-09-21T06:16:48.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.454+0000 7f2082a00640 1 -- 172.21.15.118:0/3548449921 <== osd.5 v2:172.21.15.149:6802/1726198958 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f208c06a260 con 0x7f206c07eaa0 2024-09-21T06:16:48.457 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:48.458 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:48.458 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f206c07eaa0 msgr2=0x7f206c080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6802/1726198958,v1:172.21.15.149:6803/1726198958] conn(0x7f206c07eaa0 0x7f206c080ef0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f206c078b90 msgr2=0x7f206c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f206c078b90 0x7f206c07b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f208c14d4a0 tx=0x7f207800b2e0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 msgr2=0x7f208c1f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 --2- 172.21.15.118:0/3548449921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f208c0b3e90 0x7f208c1f5030 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f207c034040 tx=0x7f207c003910 comp rx=0 tx=0).stop 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f208b200640 1 -- 172.21.15.118:0/3548449921 reap_dead start 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 shutdown_connections 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 >> 172.21.15.118:0/3548449921 conn(0x7f208c06cf30 msgr2=0x7f208c15fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 shutdown_connections 2024-09-21T06:16:48.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.455+0000 7f2091400640 1 -- 172.21.15.118:0/3548449921 wait complete. 2024-09-21T06:16:48.477 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T06:16:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.698+0000 7fa429200640 1 -- 172.21.15.118:0/2090345216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa408004d90 msgr2=0x7fa408005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.698+0000 7fa429200640 1 --2- 172.21.15.118:0/2090345216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa408004d90 0x7fa408005220 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa41c006f90 tx=0x7fa408005830 comp rx=0 tx=0).stop 2024-09-21T06:16:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.698+0000 7fa423e00640 1 -- 172.21.15.118:0/2090345216 reap_dead start 2024-09-21T06:16:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.698+0000 7fa429200640 1 -- 172.21.15.118:0/2090345216 shutdown_connections 2024-09-21T06:16:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.698+0000 7fa429200640 1 -- 172.21.15.118:0/2090345216 >> 172.21.15.118:0/2090345216 conn(0x7fa42406d6e0 msgr2=0x7fa4240b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.698+0000 7fa429200640 1 -- 172.21.15.118:0/2090345216 shutdown_connections 2024-09-21T06:16:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.698+0000 7fa429200640 1 -- 172.21.15.118:0/2090345216 wait complete. 2024-09-21T06:16:48.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.700+0000 7fa429200640 1 Processor -- start 2024-09-21T06:16:48.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.701+0000 7fa429200640 1 -- start start 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa429200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa408004d90 0x7fa4241f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa429200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4240cb7a0 0x7fa4240b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa429200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4240cbbb0 0x7fa4241f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa429200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa424074d80 con 0x7fa4240cbbb0 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa429200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa424074c00 con 0x7fa4240cb7a0 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa429200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4240d0240 con 0x7fa408004d90 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa423e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4240cbbb0 0x7fa4241f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa423e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4240cbbb0 0x7fa4241f92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60318/0 (socket says 172.21.15.118:60318) 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.702+0000 7fa423e00640 1 -- 172.21.15.118:0/360155255 learned_addr learned my addr 172.21.15.118:0/360155255 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa41aa00640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4240cb7a0 0x7fa4240b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa423400640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa408004d90 0x7fa4241f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa423e00640 1 -- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa408004d90 msgr2=0x7fa4241f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa423e00640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa408004d90 0x7fa4241f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa423e00640 1 -- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4240cb7a0 msgr2=0x7fa4240b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa423e00640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4240cb7a0 0x7fa4240b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa423e00640 1 -- 172.21.15.118:0/360155255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4240b3f80 con 0x7fa4240cbbb0 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa423e00640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4240cbbb0 0x7fa4241f92f0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fa41c031040 tx=0x7fa41c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa41be00640 1 -- 172.21.15.118:0/360155255 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0037f0 con 0x7fa4240cbbb0 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa41be00640 1 -- 172.21.15.118:0/360155255 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa41c003aa0 con 0x7fa4240cbbb0 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa41be00640 1 -- 172.21.15.118:0/360155255 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c02e480 con 0x7fa4240cbbb0 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4240b4260 con 0x7fa4240cbbb0 2024-09-21T06:16:48.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.703+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4240b4820 con 0x7fa4240cbbb0 2024-09-21T06:16:48.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.705+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4240b3cf0 con 0x7fa4240cbbb0 2024-09-21T06:16:48.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.706+0000 7fa41be00640 1 -- 172.21.15.118:0/360155255 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa41c035020 con 0x7fa4240cbbb0 2024-09-21T06:16:48.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.707+0000 7fa41be00640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa400078b90 0x7fa40007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:48.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.708+0000 7fa41be00640 1 -- 172.21.15.118:0/360155255 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fa41c0ba780 con 0x7fa4240cbbb0 2024-09-21T06:16:48.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.708+0000 7fa423400640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa400078b90 0x7fa40007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:48.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.709+0000 7fa423400640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa400078b90 0x7fa40007b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa414005fd0 tx=0x7fa414009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:48.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.712+0000 7fa41be00640 1 -- 172.21.15.118:0/360155255 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa41c03d070 con 0x7fa4240cbbb0 2024-09-21T06:16:48.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.907+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fa4240764e0 con 0x7fa400078b90 2024-09-21T06:16:48.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.907+0000 7fa41be00640 1 -- 172.21.15.118:0/360155255 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa4240764e0 con 0x7fa400078b90 2024-09-21T06:16:48.909 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa400078b90 msgr2=0x7fa40007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa400078b90 0x7fa40007b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa414005fd0 tx=0x7fa414009500 comp rx=0 tx=0).stop 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4240cbbb0 msgr2=0x7fa4241f92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4240cbbb0 0x7fa4241f92f0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fa41c031040 tx=0x7fa41c000ed0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 shutdown_connections 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4240cbbb0 0x7fa4241f92f0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4240cb7a0 0x7fa4240b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fa400078b90 0x7fa40007b0a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 --2- 172.21.15.118:0/360155255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa408004d90 0x7fa4241f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.910+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 >> 172.21.15.118:0/360155255 conn(0x7fa42406d6e0 msgr2=0x7fa424073380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.911+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 shutdown_connections 2024-09-21T06:16:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:48.911+0000 7fa429200640 1 -- 172.21.15.118:0/360155255 wait complete. 2024-09-21T06:16:48.937 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T06:16:48.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:49.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.164+0000 7fc64e600640 1 -- 172.21.15.118:0/557460203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 msgr2=0x7fc62c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.164+0000 7fc64e600640 1 --2- 172.21.15.118:0/557460203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 0x7fc62c004c10 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc630009b50 tx=0x7fc62c005830 comp rx=0 tx=0).stop 2024-09-21T06:16:49.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.164+0000 7fc64dc00640 1 -- 172.21.15.118:0/557460203 reap_dead start 2024-09-21T06:16:49.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.164+0000 7fc64e600640 1 -- 172.21.15.118:0/557460203 shutdown_connections 2024-09-21T06:16:49.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.164+0000 7fc64e600640 1 -- 172.21.15.118:0/557460203 >> 172.21.15.118:0/557460203 conn(0x7fc64806d420 msgr2=0x7fc6480b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:49.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.164+0000 7fc64e600640 1 -- 172.21.15.118:0/557460203 shutdown_connections 2024-09-21T06:16:49.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.164+0000 7fc64e600640 1 -- 172.21.15.118:0/557460203 wait complete. 2024-09-21T06:16:49.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.166+0000 7fc64e600640 1 Processor -- start 2024-09-21T06:16:49.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.167+0000 7fc64e600640 1 -- start start 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 0x7fc64815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc64814b1e0 0x7fc6480b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64814b5f0 0x7fc6480b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480741d0 con 0x7fc62c004800 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc648074050 con 0x7fc64814b5f0 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc64814ce30 con 0x7fc64814b1e0 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 0x7fc64815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 0x7fc64815e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60330/0 (socket says 172.21.15.118:60330) 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc64d200640 1 -- 172.21.15.118:0/2992653688 learned_addr learned my addr 172.21.15.118:0/2992653688 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.168+0000 7fc63fe00640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc64814b1e0 0x7fc6480b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64dc00640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64814b5f0 0x7fc6480b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64d200640 1 -- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc64814b1e0 msgr2=0x7fc6480b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64d200640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc64814b1e0 0x7fc6480b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64d200640 1 -- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64814b5f0 msgr2=0x7fc6480b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64d200640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64814b5f0 0x7fc6480b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64d200640 1 -- 172.21.15.118:0/2992653688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6481f9b70 con 0x7fc62c004800 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64d200640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 0x7fc64815e7b0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc638000fb0 tx=0x7fc6380039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638015070 con 0x7fc62c004800 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc638011920 con 0x7fc62c004800 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638011d70 con 0x7fc62c004800 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6481f9e50 con 0x7fc62c004800 2024-09-21T06:16:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.169+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6481fa410 con 0x7fc62c004800 2024-09-21T06:16:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.170+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc64806fd70 con 0x7fc62c004800 2024-09-21T06:16:49.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.172+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc638018070 con 0x7fc62c004800 2024-09-21T06:16:49.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.173+0000 7fc645600640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc624078b90 0x7fc62407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.173+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fc63809bb50 con 0x7fc62c004800 2024-09-21T06:16:49.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.173+0000 7fc645600640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7fc62407eaa0 0x7fc624080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.173+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 --> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6240815c0 con 0x7fc62407eaa0 2024-09-21T06:16:49.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.173+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7fc63809bf00 con 0x7fc62c004800 2024-09-21T06:16:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.173+0000 7fc63fe00640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc624078b90 0x7fc62407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.173+0000 7fc64dc00640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7fc62407eaa0 0x7fc624080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.174+0000 7fc63fe00640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc624078b90 0x7fc62407b0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc630035000 tx=0x7fc63002d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.174+0000 7fc64dc00640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7fc62407eaa0 0x7fc624080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.175+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== osd.6 v2:172.21.15.149:6811/3763347027 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fc6240815c0 con 0x7fc62407eaa0 2024-09-21T06:16:49.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.186+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 --> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc6480b5000 con 0x7fc62407eaa0 2024-09-21T06:16:49.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.187+0000 7fc645600640 1 -- 172.21.15.118:0/2992653688 <== osd.6 v2:172.21.15.149:6811/3763347027 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fc6480b5000 con 0x7fc62407eaa0 2024-09-21T06:16:49.188 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:49.189 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:49.189 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:49.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.187+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7fc62407eaa0 msgr2=0x7fc624080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.187+0000 7fc64e600640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6811/3763347027,v1:172.21.15.149:6814/3763347027] conn(0x7fc62407eaa0 0x7fc624080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc624078b90 msgr2=0x7fc62407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc624078b90 0x7fc62407b0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc630035000 tx=0x7fc63002d040 comp rx=0 tx=0).stop 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 msgr2=0x7fc64815e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 --2- 172.21.15.118:0/2992653688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc62c004800 0x7fc64815e7b0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc638000fb0 tx=0x7fc6380039c0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64dc00640 1 -- 172.21.15.118:0/2992653688 reap_dead start 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 shutdown_connections 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 >> 172.21.15.118:0/2992653688 conn(0x7fc64806d420 msgr2=0x7fc64806e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 shutdown_connections 2024-09-21T06:16:49.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.188+0000 7fc64e600640 1 -- 172.21.15.118:0/2992653688 wait complete. 2024-09-21T06:16:49.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T06:16:49.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 -- 172.21.15.118:0/1543030661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413fef0 msgr2=0x7fb864142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 --2- 172.21.15.118:0/1543030661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413fef0 0x7fb864142c70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fb8640ceaa0 tx=0x7fb85c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:16:49.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 -- 172.21.15.118:0/1543030661 shutdown_connections 2024-09-21T06:16:49.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 --2- 172.21.15.118:0/1543030661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413fef0 0x7fb864142c70 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 --2- 172.21.15.118:0/1543030661 >> v2:172.21.15.149:3300/0 conn(0x7fb8640d1590 0x7fb864142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 -- 172.21.15.118:0/1543030661 >> 172.21.15.118:0/1543030661 conn(0x7fb86406d110 msgr2=0x7fb86406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:49.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 -- 172.21.15.118:0/1543030661 shutdown_connections 2024-09-21T06:16:49.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.432+0000 7fb86b600640 1 -- 172.21.15.118:0/1543030661 wait complete. 2024-09-21T06:16:49.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.434+0000 7fb86b600640 1 Processor -- start 2024-09-21T06:16:49.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.434+0000 7fb86b600640 1 -- start start 2024-09-21T06:16:49.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb86b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86413fae0 0x7fb8641f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb86b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb86413fef0 0x7fb86413ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb86b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413ad60 0x7fb86413b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb86b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb8640cfa70 con 0x7fb86413ad60 2024-09-21T06:16:49.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb86b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8640cf8f0 con 0x7fb86413fae0 2024-09-21T06:16:49.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb86b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8640cfbf0 con 0x7fb86413fef0 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb869600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413ad60 0x7fb86413b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb869600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413ad60 0x7fb86413b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60346/0 (socket says 172.21.15.118:60346) 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb869600640 1 -- 172.21.15.118:0/1014649174 learned_addr learned my addr 172.21.15.118:0/1014649174 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb85be00640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb86413fef0 0x7fb86413ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.436+0000 7fb868c00640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86413fae0 0x7fb8641f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb869600640 1 -- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb86413fef0 msgr2=0x7fb86413ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb869600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb86413fef0 0x7fb86413ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb869600640 1 -- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86413fae0 msgr2=0x7fb8641f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb869600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86413fae0 0x7fb8641f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb869600640 1 -- 172.21.15.118:0/1014649174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86413b6b0 con 0x7fb86413ad60 2024-09-21T06:16:49.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb869600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413ad60 0x7fb86413b170 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fb85c02b020 tx=0x7fb85c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb861600640 1 -- 172.21.15.118:0/1014649174 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c033050 con 0x7fb86413ad60 2024-09-21T06:16:49.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb861600640 1 -- 172.21.15.118:0/1014649174 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb85c004450 con 0x7fb86413ad60 2024-09-21T06:16:49.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb861600640 1 -- 172.21.15.118:0/1014649174 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c038450 con 0x7fb86413ad60 2024-09-21T06:16:49.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb864159e80 con 0x7fb86413ad60 2024-09-21T06:16:49.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.437+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86415a5d0 con 0x7fb86413ad60 2024-09-21T06:16:49.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.439+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8640d0110 con 0x7fb86413ad60 2024-09-21T06:16:49.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.440+0000 7fb861600640 1 -- 172.21.15.118:0/1014649174 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb85c036070 con 0x7fb86413ad60 2024-09-21T06:16:49.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.441+0000 7fb861600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb840078b90 0x7fb84007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.441+0000 7fb861600640 1 -- 172.21.15.118:0/1014649174 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fb85c0bbfd0 con 0x7fb86413ad60 2024-09-21T06:16:49.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.441+0000 7fb868c00640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb840078b90 0x7fb84007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.442+0000 7fb868c00640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb840078b90 0x7fb84007b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb854007fd0 tx=0x7fb854009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.445+0000 7fb861600640 1 -- 172.21.15.118:0/1014649174 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb86413b6b0 con 0x7fb86413ad60 2024-09-21T06:16:49.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.632+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb86406f870 con 0x7fb840078b90 2024-09-21T06:16:49.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.633+0000 7fb861600640 1 -- 172.21.15.118:0/1014649174 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb86406f870 con 0x7fb840078b90 2024-09-21T06:16:49.634 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T06:16:49.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb840078b90 msgr2=0x7fb84007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb840078b90 0x7fb84007b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb854007fd0 tx=0x7fb854009040 comp rx=0 tx=0).stop 2024-09-21T06:16:49.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413ad60 msgr2=0x7fb86413b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413ad60 0x7fb86413b170 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fb85c02b020 tx=0x7fb85c003f10 comp rx=0 tx=0).stop 2024-09-21T06:16:49.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 shutdown_connections 2024-09-21T06:16:49.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb86413ad60 0x7fb86413b170 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fb840078b90 0x7fb84007b0a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb86413fef0 0x7fb86413ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 --2- 172.21.15.118:0/1014649174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86413fae0 0x7fb8641f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 >> 172.21.15.118:0/1014649174 conn(0x7fb86406d110 msgr2=0x7fb86415f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:49.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 shutdown_connections 2024-09-21T06:16:49.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.636+0000 7fb86b600640 1 -- 172.21.15.118:0/1014649174 wait complete. 2024-09-21T06:16:49.658 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T06:16:49.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:16:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.881+0000 7fde5d400640 1 -- 172.21.15.118:0/3365527747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 msgr2=0x7fde580b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.881+0000 7fde5d400640 1 --2- 172.21.15.118:0/3365527747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 0x7fde580b3d40 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fde580d2a60 tx=0x7fde4802a540 comp rx=0 tx=0).stop 2024-09-21T06:16:49.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.882+0000 7fde5d400640 1 -- 172.21.15.118:0/3365527747 shutdown_connections 2024-09-21T06:16:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.882+0000 7fde5d400640 1 --2- 172.21.15.118:0/3365527747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde580d1840 0x7fde5806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.882+0000 7fde5d400640 1 --2- 172.21.15.118:0/3365527747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 0x7fde580b3d40 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.882+0000 7fde5d400640 1 -- 172.21.15.118:0/3365527747 >> 172.21.15.118:0/3365527747 conn(0x7fde580d4b00 msgr2=0x7fde580d4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.882+0000 7fde5d400640 1 -- 172.21.15.118:0/3365527747 shutdown_connections 2024-09-21T06:16:49.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.882+0000 7fde5d400640 1 -- 172.21.15.118:0/3365527747 wait complete. 2024-09-21T06:16:49.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.884+0000 7fde5d400640 1 Processor -- start 2024-09-21T06:16:49.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.884+0000 7fde5d400640 1 -- start start 2024-09-21T06:16:49.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.885+0000 7fde5d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde580b9e30 0x7fde58150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde5d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 0x7fde580a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde5d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde580a2390 0x7fde5815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde5d400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fde580d0320 con 0x7fde580d5620 2024-09-21T06:16:49.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde5d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fde580d01a0 con 0x7fde580b9e30 2024-09-21T06:16:49.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde5d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde580d04a0 con 0x7fde580a2390 2024-09-21T06:16:49.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 0x7fde580a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde580b9e30 0x7fde58150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 0x7fde580a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60354/0 (socket says 172.21.15.118:60354) 2024-09-21T06:16:49.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 -- 172.21.15.118:0/776193597 learned_addr learned my addr 172.21.15.118:0/776193597 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:49.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde5ca00640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde580a2390 0x7fde5815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 -- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde580a2390 msgr2=0x7fde5815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde580a2390 0x7fde5815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 -- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde580b9e30 msgr2=0x7fde58150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde580b9e30 0x7fde58150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.886+0000 7fde57400640 1 -- 172.21.15.118:0/776193597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5809e980 con 0x7fde580d5620 2024-09-21T06:16:49.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.887+0000 7fde57400640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 0x7fde580a1e50 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fde4400c340 tx=0x7fde4400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.887+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440052d0 con 0x7fde580d5620 2024-09-21T06:16:49.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.887+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde44007020 con 0x7fde580d5620 2024-09-21T06:16:49.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.887+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44007470 con 0x7fde580d5620 2024-09-21T06:16:49.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.887+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5809ec40 con 0x7fde580d5620 2024-09-21T06:16:49.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.887+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5809f200 con 0x7fde580d5620 2024-09-21T06:16:49.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.888+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde580d0950 con 0x7fde580d5620 2024-09-21T06:16:49.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.889+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde440067d0 con 0x7fde580d5620 2024-09-21T06:16:49.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.890+0000 7fde4fe00640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fde38078bc0 0x7fde3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.891+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fde44099ef0 con 0x7fde580d5620 2024-09-21T06:16:49.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.891+0000 7fde4fe00640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fde3807ead0 0x7fde38080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:49.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.891+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 --> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde380815f0 con 0x7fde3807ead0 2024-09-21T06:16:49.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.891+0000 7fde57e00640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fde38078bc0 0x7fde3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.891+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) ==== 24+0+0 (secure 0 0 0) 0x7fde4409c510 con 0x7fde580d5620 2024-09-21T06:16:49.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.891+0000 7fde5ca00640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fde3807ead0 0x7fde38080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:49.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.892+0000 7fde57e00640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fde38078bc0 0x7fde3807b0d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fde48033000 tx=0x7fde48004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.892+0000 7fde5ca00640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fde3807ead0 0x7fde38080f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:49.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.893+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== osd.7 v2:172.21.15.149:6826/2881805415 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fde380815f0 con 0x7fde3807ead0 2024-09-21T06:16:49.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.905+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 --> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fde580d2330 con 0x7fde3807ead0 2024-09-21T06:16:49.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.905+0000 7fde4fe00640 1 -- 172.21.15.118:0/776193597 <== osd.7 v2:172.21.15.149:6826/2881805415 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fde580d2330 con 0x7fde3807ead0 2024-09-21T06:16:49.907 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-21T06:16:49.907 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-21T06:16:49.907 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fde3807ead0 msgr2=0x7fde38080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6826/2881805415,v1:172.21.15.149:6827/2881805415] conn(0x7fde3807ead0 0x7fde38080f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fde38078bc0 msgr2=0x7fde3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fde38078bc0 0x7fde3807b0d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fde48033000 tx=0x7fde48004730 comp rx=0 tx=0).stop 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 msgr2=0x7fde580a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 --2- 172.21.15.118:0/776193597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde580d5620 0x7fde580a1e50 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fde4400c340 tx=0x7fde4400c800 comp rx=0 tx=0).stop 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5ca00640 1 -- 172.21.15.118:0/776193597 reap_dead start 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 shutdown_connections 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 >> 172.21.15.118:0/776193597 conn(0x7fde580d4b00 msgr2=0x7fde5806d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 shutdown_connections 2024-09-21T06:16:49.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:49.906+0000 7fde5d400640 1 -- 172.21.15.118:0/776193597 wait complete. 2024-09-21T06:16:49.928 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T06:16:50.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1626407876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca0073fa0 msgr2=0x7f7ca00749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1626407876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca0073fa0 0x7f7ca00749f0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f7ca015d2e0 tx=0x7f7c9402a560 comp rx=0 tx=0).stop 2024-09-21T06:16:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1626407876 shutdown_connections 2024-09-21T06:16:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1626407876 >> v2:172.21.15.149:3300/0 conn(0x7f7ca00b62c0 0x7f7ca00d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1626407876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca0073fa0 0x7f7ca00749f0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1626407876 >> 172.21.15.118:0/1626407876 conn(0x7f7ca006d6e0 msgr2=0x7f7ca00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1626407876 shutdown_connections 2024-09-21T06:16:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.148+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1626407876 wait complete. 2024-09-21T06:16:50.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.150+0000 7f7ca6e00640 1 Processor -- start 2024-09-21T06:16:50.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.150+0000 7f7ca6e00640 1 -- start start 2024-09-21T06:16:50.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ca0073fa0 0x7f7ca01f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca00cfe30 0x7f7ca0158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca015a910 0x7f7ca01f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca015da00 con 0x7f7ca015a910 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca015d880 con 0x7f7ca00cfe30 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca015db80 con 0x7f7ca0073fa0 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca015a910 0x7f7ca01f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca015a910 0x7f7ca01f69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60364/0 (socket says 172.21.15.118:60364) 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 -- 172.21.15.118:0/1308819192 learned_addr learned my addr 172.21.15.118:0/1308819192 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca5000640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca00cfe30 0x7f7ca0158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca5a00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ca0073fa0 0x7f7ca01f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 -- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ca0073fa0 msgr2=0x7f7ca01f97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ca0073fa0 0x7f7ca01f97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 -- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca00cfe30 msgr2=0x7f7ca0158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca00cfe30 0x7f7ca0158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.152+0000 7f7ca6400640 1 -- 172.21.15.118:0/1308819192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca01fa020 con 0x7f7ca015a910 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.153+0000 7f7ca6400640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca015a910 0x7f7ca01f69f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800ea80 tx=0x7f7c9800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.153+0000 7f7c9d600640 1 -- 172.21.15.118:0/1308819192 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98004b20 con 0x7f7ca015a910 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.153+0000 7f7c9d600640 1 -- 172.21.15.118:0/1308819192 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c98004ce0 con 0x7f7ca015a910 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.153+0000 7f7c9d600640 1 -- 172.21.15.118:0/1308819192 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98005280 con 0x7f7ca015a910 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.153+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca01fa300 con 0x7f7ca015a910 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.153+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca01f64f0 con 0x7f7ca015a910 2024-09-21T06:16:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.154+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca015cc70 con 0x7f7ca015a910 2024-09-21T06:16:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.155+0000 7f7c9d600640 1 -- 172.21.15.118:0/1308819192 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c98005420 con 0x7f7ca015a910 2024-09-21T06:16:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.156+0000 7f7c9d600640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c80078bc0 0x7f7c8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.156+0000 7f7c9d600640 1 -- 172.21.15.118:0/1308819192 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f7c9809b5c0 con 0x7f7ca015a910 2024-09-21T06:16:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.157+0000 7f7ca5a00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c80078bc0 0x7f7c8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.158+0000 7f7ca5a00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c80078bc0 0x7f7c8007b0d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7c94033000 tx=0x7f7c94004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:50.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.161+0000 7f7c9d600640 1 -- 172.21.15.118:0/1308819192 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7ca015cc70 con 0x7f7ca015a910 2024-09-21T06:16:50.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.345+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f7ca01f9db0 con 0x7f7c80078bc0 2024-09-21T06:16:50.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.346+0000 7f7c9d600640 1 -- 172.21.15.118:0/1308819192 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7ca01f9db0 con 0x7f7c80078bc0 2024-09-21T06:16:50.347 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T06:16:50.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.348+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c80078bc0 msgr2=0x7f7c8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.348+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c80078bc0 0x7f7c8007b0d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7c94033000 tx=0x7f7c94004730 comp rx=0 tx=0).stop 2024-09-21T06:16:50.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca015a910 msgr2=0x7f7ca01f69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca015a910 0x7f7ca01f69f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800ea80 tx=0x7f7c9800ef40 comp rx=0 tx=0).stop 2024-09-21T06:16:50.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 shutdown_connections 2024-09-21T06:16:50.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ca015a910 0x7f7ca01f69f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ca00cfe30 0x7f7ca0158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f7c80078bc0 0x7f7c8007b0d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 --2- 172.21.15.118:0/1308819192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ca0073fa0 0x7f7ca01f97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 >> 172.21.15.118:0/1308819192 conn(0x7f7ca006d6e0 msgr2=0x7f7ca0145fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:50.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 shutdown_connections 2024-09-21T06:16:50.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.349+0000 7f7ca6e00640 1 -- 172.21.15.118:0/1308819192 wait complete. 2024-09-21T06:16:50.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:16:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 -- 172.21.15.118:0/2657425601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba413fae0 msgr2=0x7f5ba40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 --2- 172.21.15.118:0/2657425601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba413fae0 0x7f5ba40d0e80 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005fd0 tx=0x7f5b9402a5d0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 -- 172.21.15.118:0/2657425601 shutdown_connections 2024-09-21T06:16:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 --2- 172.21.15.118:0/2657425601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ba4142e40 0x7f5ba40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 --2- 172.21.15.118:0/2657425601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba413fae0 0x7f5ba40d0e80 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 -- 172.21.15.118:0/2657425601 >> 172.21.15.118:0/2657425601 conn(0x7f5ba406d110 msgr2=0x7f5ba406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 -- 172.21.15.118:0/2657425601 shutdown_connections 2024-09-21T06:16:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.595+0000 7f5ba9200640 1 -- 172.21.15.118:0/2657425601 wait complete. 2024-09-21T06:16:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.598+0000 7f5ba9200640 1 Processor -- start 2024-09-21T06:16:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.598+0000 7f5ba9200640 1 -- start start 2024-09-21T06:16:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ba413fae0 0x7f5ba41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba413fef0 0x7f5ba413d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4142e40 0x7f5ba4154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba9200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba40cfa90 con 0x7f5ba4142e40 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba40cf910 con 0x7f5ba413fef0 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba40cfc10 con 0x7f5ba413fae0 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4142e40 0x7f5ba4154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.599+0000 7f5ba2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4142e40 0x7f5ba4154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60376/0 (socket says 172.21.15.118:60376) 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba2800640 1 -- 172.21.15.118:0/4121671563 learned_addr learned my addr 172.21.15.118:0/4121671563 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba1e00640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ba413fae0 0x7f5ba41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5b99400640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba413fef0 0x7f5ba413d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba2800640 1 -- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ba413fae0 msgr2=0x7f5ba41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba2800640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ba413fae0 0x7f5ba41572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba2800640 1 -- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba413fef0 msgr2=0x7f5ba413d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba2800640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba413fef0 0x7f5ba413d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba2800640 1 -- 172.21.15.118:0/4121671563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba4156520 con 0x7f5ba4142e40 2024-09-21T06:16:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5ba2800640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4142e40 0x7f5ba4154770 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00daf0 tx=0x7f5b9c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.600+0000 7f5b9aa00640 1 -- 172.21.15.118:0/4121671563 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c017070 con 0x7f5ba4142e40 2024-09-21T06:16:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.601+0000 7f5b9aa00640 1 -- 172.21.15.118:0/4121671563 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b9c003970 con 0x7f5ba4142e40 2024-09-21T06:16:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.601+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba4156800 con 0x7f5ba4142e40 2024-09-21T06:16:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.601+0000 7f5b9aa00640 1 -- 172.21.15.118:0/4121671563 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c003da0 con 0x7f5ba4142e40 2024-09-21T06:16:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.601+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba4157820 con 0x7f5ba4142e40 2024-09-21T06:16:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.602+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba41f47e0 con 0x7f5ba4142e40 2024-09-21T06:16:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.603+0000 7f5b9aa00640 1 -- 172.21.15.118:0/4121671563 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b9c003f40 con 0x7f5ba4142e40 2024-09-21T06:16:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.604+0000 7f5b9aa00640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b80078b90 0x7f5b8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.604+0000 7f5b9aa00640 1 -- 172.21.15.118:0/4121671563 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f5b9c09acc0 con 0x7f5ba4142e40 2024-09-21T06:16:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.604+0000 7f5ba1e00640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b80078b90 0x7f5b8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.605+0000 7f5ba1e00640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b80078b90 0x7f5b8007b0a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5b94033000 tx=0x7f5b94004730 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.608+0000 7f5b9aa00640 1 -- 172.21.15.118:0/4121671563 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5b9c062ed0 con 0x7f5ba4142e40 2024-09-21T06:16:50.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.791+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ba40d0150 con 0x7f5b80078b90 2024-09-21T06:16:50.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.792+0000 7f5b9aa00640 1 -- 172.21.15.118:0/4121671563 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12545 (secure 0 0 0) 0x7f5ba40d0150 con 0x7f5b80078b90 2024-09-21T06:16:50.793 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:16:50.794 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b80078b90 msgr2=0x7f5b8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b80078b90 0x7f5b8007b0a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5b94033000 tx=0x7f5b94004730 comp rx=0 tx=0).stop 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4142e40 msgr2=0x7f5ba4154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4142e40 0x7f5ba4154770 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00daf0 tx=0x7f5b9c009f60 comp rx=0 tx=0).stop 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 shutdown_connections 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4142e40 0x7f5ba4154770 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba413fef0 0x7f5ba413d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f5b80078b90 0x7f5b8007b0a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 --2- 172.21.15.118:0/4121671563 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ba413fae0 0x7f5ba41572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:50.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 >> 172.21.15.118:0/4121671563 conn(0x7f5ba406d110 msgr2=0x7f5ba40d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:50.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.794+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 shutdown_connections 2024-09-21T06:16:50.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:16:50.795+0000 7f5ba9200640 1 -- 172.21.15.118:0/4121671563 wait complete. 2024-09-21T06:16:50.817 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":572,"stamp":"2024-09-21T06:16:50.670537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9278,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553221,"statfs":{"total":1600000000,"available":1590498520,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.840092"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":448,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T06:16:38.838973+0000","last_change":"2024-09-21T06:03:46.387014+0000","last_active":"2024-09-21T06:16:38.838973+0000","last_peered":"2024-09-21T06:16:38.838973+0000","last_clean":"2024-09-21T06:16:38.838973+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:16:38.838973+0000","last_undegraded":"2024-09-21T06:16:38.838973+0000","last_fullsized":"2024-09-21T06:16:38.838973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:03:44.994687+0000","last_clean_scrub_stamp":"2024-09-21T06:03:44.994687+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:49.937550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:16:50.820 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T06:03:44.994687+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=6, tm_min=3, tm_sec=44, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=6, tm_min=16, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T06:16:50.820 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T06:16:51.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:16:51.007 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:17:10.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:17:11.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.065+0000 7fc6e9000640 1 -- 172.21.15.118:0/2825237069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fef0 msgr2=0x7fc6e4142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.065+0000 7fc6e9000640 1 --2- 172.21.15.118:0/2825237069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fef0 0x7fc6e4142e40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005fd0 tx=0x7fc6dc02a8b0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.065+0000 7fc6e9000640 1 -- 172.21.15.118:0/2825237069 shutdown_connections 2024-09-21T06:17:11.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.065+0000 7fc6e9000640 1 --2- 172.21.15.118:0/2825237069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fef0 0x7fc6e4142e40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.065+0000 7fc6e9000640 1 -- 172.21.15.118:0/2825237069 >> 172.21.15.118:0/2825237069 conn(0x7fc6e406d110 msgr2=0x7fc6e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:11.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.065+0000 7fc6e9000640 1 -- 172.21.15.118:0/2825237069 shutdown_connections 2024-09-21T06:17:11.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.065+0000 7fc6e9000640 1 -- 172.21.15.118:0/2825237069 wait complete. 2024-09-21T06:17:11.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.068+0000 7fc6e9000640 1 Processor -- start 2024-09-21T06:17:11.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.068+0000 7fc6e9000640 1 -- start start 2024-09-21T06:17:11.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.069+0000 7fc6e9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fae0 0x7fc6e41f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.069+0000 7fc6e9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6e413fef0 0x7fc6e41395c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.069+0000 7fc6e9000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e41f74d0 0x7fc6e41f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.069+0000 7fc6e9000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e4168290 con 0x7fc6e41f74d0 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.069+0000 7fc6e9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e4168110 con 0x7fc6e413fae0 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.069+0000 7fc6e9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e4168410 con 0x7fc6e413fef0 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.069+0000 7fc6e2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e41f74d0 0x7fc6e41f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e41f74d0 0x7fc6e41f78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41686/0 (socket says 172.21.15.118:41686) 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 -- 172.21.15.118:0/3146098961 learned_addr learned my addr 172.21.15.118:0/3146098961 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e1e00640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fae0 0x7fc6e41f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6d9400640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6e413fef0 0x7fc6e41395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 -- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6e413fef0 msgr2=0x7fc6e41395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6e413fef0 0x7fc6e41395c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 -- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fae0 msgr2=0x7fc6e41f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fae0 0x7fc6e41f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 -- 172.21.15.118:0/3146098961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e41668b0 con 0x7fc6e41f74d0 2024-09-21T06:17:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.070+0000 7fc6e2800640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e41f74d0 0x7fc6e41f78e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009cd0 tx=0x7fc6dc031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.071+0000 7fc6daa00640 1 -- 172.21.15.118:0/3146098961 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc031990 con 0x7fc6e41f74d0 2024-09-21T06:17:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.071+0000 7fc6daa00640 1 -- 172.21.15.118:0/3146098961 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6dc031c20 con 0x7fc6e41f74d0 2024-09-21T06:17:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.071+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e41f6370 con 0x7fc6e41f74d0 2024-09-21T06:17:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.071+0000 7fc6daa00640 1 -- 172.21.15.118:0/3146098961 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc0330d0 con 0x7fc6e41f74d0 2024-09-21T06:17:11.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.071+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e41f6930 con 0x7fc6e41f74d0 2024-09-21T06:17:11.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.072+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e40d0e80 con 0x7fc6e41f74d0 2024-09-21T06:17:11.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.073+0000 7fc6daa00640 1 -- 172.21.15.118:0/3146098961 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6dc033270 con 0x7fc6e41f74d0 2024-09-21T06:17:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.074+0000 7fc6daa00640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc6c0078bc0 0x7fc6c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.074+0000 7fc6daa00640 1 -- 172.21.15.118:0/3146098961 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7fc6dc0bbe80 con 0x7fc6e41f74d0 2024-09-21T06:17:11.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.075+0000 7fc6e1e00640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc6c0078bc0 0x7fc6c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.076+0000 7fc6e1e00640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc6c0078bc0 0x7fc6c007b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4000f60 tx=0x7fc6d4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.079+0000 7fc6daa00640 1 -- 172.21.15.118:0/3146098961 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6dc03f030 con 0x7fc6e41f74d0 2024-09-21T06:17:11.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.257+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 --> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6e40b3630 con 0x7fc6c0078bc0 2024-09-21T06:17:11.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.258+0000 7fc6daa00640 1 -- 172.21.15.118:0/3146098961 <== mgr.4109 v2:172.21.15.149:6800/952547634 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12552 (secure 0 0 0) 0x7fc6e40b3630 con 0x7fc6c0078bc0 2024-09-21T06:17:11.261 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:17:11.261 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-09-21T06:17:11.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc6c0078bc0 msgr2=0x7fc6c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc6c0078bc0 0x7fc6c007b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4000f60 tx=0x7fc6d4009040 comp rx=0 tx=0).stop 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e41f74d0 msgr2=0x7fc6e41f78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e41f74d0 0x7fc6e41f78e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009cd0 tx=0x7fc6dc031700 comp rx=0 tx=0).stop 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 shutdown_connections 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6e41f74d0 0x7fc6e41f78e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7fc6c0078bc0 0x7fc6c007b0d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6e413fef0 0x7fc6e41395c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 --2- 172.21.15.118:0/3146098961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e413fae0 0x7fc6e41f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 >> 172.21.15.118:0/3146098961 conn(0x7fc6e406d110 msgr2=0x7fc6e413c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 shutdown_connections 2024-09-21T06:17:11.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.261+0000 7fc6e9000640 1 -- 172.21.15.118:0/3146098961 wait complete. 2024-09-21T06:17:11.285 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":582,"stamp":"2024-09-21T06:17:10.675300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9278,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553221,"statfs":{"total":1600000000,"available":1590498520,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002638"},"pg_stats":[{"pgid":"1.0","version":"184'74","reported_seq":458,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-09-21T06:16:50.387251+0000","last_change":"2024-09-21T06:16:50.387251+0000","last_active":"2024-09-21T06:16:50.387251+0000","last_peered":"2024-09-21T06:16:50.387251+0000","last_clean":"2024-09-21T06:16:50.387251+0000","last_became_active":"2024-09-21T06:03:46.386762+0000","last_became_peered":"2024-09-21T06:03:46.386762+0000","last_unstale":"2024-09-21T06:16:50.387251+0000","last_undegraded":"2024-09-21T06:16:50.387251+0000","last_fullsized":"2024-09-21T06:16:50.387251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'74","last_scrub_stamp":"2024-09-21T06:16:50.387194+0000","last_deep_scrub":"184'74","last_deep_scrub_stamp":"2024-09-21T06:16:50.387194+0000","last_clean_scrub_stamp":"2024-09-21T06:16:50.387194+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:05.610863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-21T06:17:11.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T06:17:11.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.499+0000 7f9e48600640 1 -- 172.21.15.118:0/2296050820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 msgr2=0x7f9e400d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.499+0000 7f9e48600640 1 --2- 172.21.15.118:0/2296050820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e400d0e80 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f9e400ce7c0 tx=0x7f9e3402a560 comp rx=0 tx=0).stop 2024-09-21T06:17:11.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.499+0000 7f9e48600640 1 -- 172.21.15.118:0/2296050820 shutdown_connections 2024-09-21T06:17:11.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.499+0000 7f9e48600640 1 --2- 172.21.15.118:0/2296050820 >> v2:172.21.15.149:3300/0 conn(0x7f9e40142e40 0x7f9e400d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.499+0000 7f9e48600640 1 --2- 172.21.15.118:0/2296050820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e400d0e80 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.499+0000 7f9e48600640 1 -- 172.21.15.118:0/2296050820 >> 172.21.15.118:0/2296050820 conn(0x7f9e4006d110 msgr2=0x7f9e4006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:11.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.499+0000 7f9e48600640 1 -- 172.21.15.118:0/2296050820 shutdown_connections 2024-09-21T06:17:11.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.500+0000 7f9e48600640 1 -- 172.21.15.118:0/2296050820 wait complete. 2024-09-21T06:17:11.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.502+0000 7f9e48600640 1 Processor -- start 2024-09-21T06:17:11.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.502+0000 7f9e48600640 1 -- start start 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e48600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e401420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e48600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e4013fef0 0x7f9e40133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e48600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e40142e40 0x7f9e4013d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e48600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9e400cfa70 con 0x7f9e4013fae0 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e48600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e400cf8f0 con 0x7f9e4013fef0 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e48600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e400cfbf0 con 0x7f9e40142e40 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e45c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e401420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e45c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e401420f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41696/0 (socket says 172.21.15.118:41696) 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.503+0000 7f9e45c00640 1 -- 172.21.15.118:0/3387500128 learned_addr learned my addr 172.21.15.118:0/3387500128 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:17:11.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e45200640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e4013fef0 0x7f9e40133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e46600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e40142e40 0x7f9e4013d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e45c00640 1 -- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e40142e40 msgr2=0x7f9e4013d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e45c00640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e40142e40 0x7f9e4013d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e45c00640 1 -- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e4013fef0 msgr2=0x7f9e40133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e45c00640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e4013fef0 0x7f9e40133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e45c00640 1 -- 172.21.15.118:0/3387500128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e40141050 con 0x7f9e4013fae0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e45c00640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e401420f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9e34034040 tx=0x7f9e340038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3403e030 con 0x7f9e4013fae0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e34003db0 con 0x7f9e4013fae0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.504+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e40141330 con 0x7f9e4013fae0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.505+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34035040 con 0x7f9e4013fae0 2024-09-21T06:17:11.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.505+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e401418f0 con 0x7f9e4013fae0 2024-09-21T06:17:11.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.506+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e40153920 con 0x7f9e4013fae0 2024-09-21T06:17:11.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.507+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e34041030 con 0x7f9e4013fae0 2024-09-21T06:17:11.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.508+0000 7f9e3d600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e20078b90 0x7f9e2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.508+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f9e340bb4a0 con 0x7f9e4013fae0 2024-09-21T06:17:11.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.509+0000 7f9e45200640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e20078b90 0x7f9e2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.509+0000 7f9e45200640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e20078b90 0x7f9e2007b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9e400cdb20 tx=0x7f9e2c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.512+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e34083bd0 con 0x7f9e4013fae0 2024-09-21T06:17:11.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.697+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9e400d0110 con 0x7f9e4013fae0 2024-09-21T06:17:11.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.702+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v44)=0 v44) ==== 123+0+0 (secure 0 0 0) 0x7f9e340834d0 con 0x7f9e4013fae0 2024-09-21T06:17:11.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.702+0000 7f9e3d600640 1 -- 172.21.15.118:0/3387500128 <== mon.0 v2:172.21.15.118:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f9e34082fe0 con 0x7f9e4013fae0 2024-09-21T06:17:11.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e20078b90 msgr2=0x7f9e2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e20078b90 0x7f9e2007b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9e400cdb20 tx=0x7f9e2c009040 comp rx=0 tx=0).stop 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 msgr2=0x7f9e401420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e401420f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9e34034040 tx=0x7f9e340038a0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 shutdown_connections 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f9e20078b90 0x7f9e2007b0a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e40142e40 0x7f9e4013d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e4013fef0 0x7f9e40133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 --2- 172.21.15.118:0/3387500128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e4013fae0 0x7f9e401420f0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 >> 172.21.15.118:0/3387500128 conn(0x7f9e4006d110 msgr2=0x7f9e4015bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 shutdown_connections 2024-09-21T06:17:11.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.705+0000 7f9e48600640 1 -- 172.21.15.118:0/3387500128 wait complete. 2024-09-21T06:17:11.729 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:17:11.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:17:11.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.950+0000 7f14dc000640 1 -- 172.21.15.118:0/1267862454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 msgr2=0x7f14d4142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.950+0000 7f14dc000640 1 --2- 172.21.15.118:0/1267862454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d4142e40 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009830 tx=0x7f14cc02a480 comp rx=0 tx=0).stop 2024-09-21T06:17:11.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.950+0000 7f14dc000640 1 -- 172.21.15.118:0/1267862454 shutdown_connections 2024-09-21T06:17:11.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.950+0000 7f14dc000640 1 --2- 172.21.15.118:0/1267862454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d4142e40 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.950+0000 7f14dc000640 1 -- 172.21.15.118:0/1267862454 >> 172.21.15.118:0/1267862454 conn(0x7f14d406d110 msgr2=0x7f14d406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:11.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.950+0000 7f14dc000640 1 -- 172.21.15.118:0/1267862454 shutdown_connections 2024-09-21T06:17:11.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.950+0000 7f14dc000640 1 -- 172.21.15.118:0/1267862454 wait complete. 2024-09-21T06:17:11.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.953+0000 7f14dc000640 1 Processor -- start 2024-09-21T06:17:11.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.953+0000 7f14dc000640 1 -- start start 2024-09-21T06:17:11.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.954+0000 7f14dc000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d413fae0 0x7f14d4141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.954+0000 7f14dc000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d413c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.954+0000 7f14dc000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d4073ee0 0x7f14d413c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.954+0000 7f14dc000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f14d4168350 con 0x7f14d413fef0 2024-09-21T06:17:11.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.954+0000 7f14dc000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f14d41681d0 con 0x7f14d4073ee0 2024-09-21T06:17:11.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.954+0000 7f14dc000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f14d41684d0 con 0x7f14d413fae0 2024-09-21T06:17:11.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.954+0000 7f14d8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d413c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d413c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41714/0 (socket says 172.21.15.118:41714) 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 -- 172.21.15.118:0/1837209471 learned_addr learned my addr 172.21.15.118:0/1837209471 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14da000640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d4073ee0 0x7f14d413c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d9600640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d413fae0 0x7f14d4141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 -- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d413fae0 msgr2=0x7f14d4141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d413fae0 0x7f14d4141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 -- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d4073ee0 msgr2=0x7f14d413c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d4073ee0 0x7f14d413c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 -- 172.21.15.118:0/1837209471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d41f95f0 con 0x7f14d413fef0 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.955+0000 7f14d8c00640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d413c030 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b3e0 tx=0x7f14c000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.956+0000 7f14d1600640 1 -- 172.21.15.118:0/1837209471 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0015020 con 0x7f14d413fef0 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.956+0000 7f14d1600640 1 -- 172.21.15.118:0/1837209471 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f14c0011850 con 0x7f14d413fef0 2024-09-21T06:17:11.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.956+0000 7f14d1600640 1 -- 172.21.15.118:0/1837209471 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0011cc0 con 0x7f14d413fef0 2024-09-21T06:17:11.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.956+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d41f98d0 con 0x7f14d413fef0 2024-09-21T06:17:11.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.956+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d41f9e90 con 0x7f14d413fef0 2024-09-21T06:17:11.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.957+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d40d0e80 con 0x7f14d413fef0 2024-09-21T06:17:11.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.958+0000 7f14d1600640 1 -- 172.21.15.118:0/1837209471 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14c0018020 con 0x7f14d413fef0 2024-09-21T06:17:11.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.959+0000 7f14d1600640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f14b4078b90 0x7f14b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.959+0000 7f14d1600640 1 -- 172.21.15.118:0/1837209471 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4943+0+0 (secure 0 0 0) 0x7f14c009ab50 con 0x7f14d413fef0 2024-09-21T06:17:11.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.959+0000 7f14d9600640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f14b4078b90 0x7f14b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.960+0000 7f14d9600640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f14b4078b90 0x7f14b407b0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f14c8007fd0 tx=0x7f14c8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:11.964+0000 7f14d1600640 1 -- 172.21.15.118:0/1837209471 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f14c001f020 con 0x7f14d413fef0 2024-09-21T06:17:12.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.185+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14d40b3610 con 0x7f14d413fef0 2024-09-21T06:17:12.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.185+0000 7f14d1600640 1 -- 172.21.15.118:0/1837209471 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) ==== 94+0+3920 (secure 0 0 0) 0x7f14c00631f0 con 0x7f14d413fef0 2024-09-21T06:17:12.188 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-21T06:17:12.188 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":97,"btime":"2024-09-21T06:16:36:540249+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6749,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/893957829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":893957829},{"type":"v1","addr":"172.21.15.149:6836","nonce":893957829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3324502064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":3324502064},{"type":"v1","addr":"172.21.15.149:6837","nonce":3324502064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3087929926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3087929926},{"type":"v1","addr":"172.21.15.118:6834","nonce":3087929926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2638143750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2638143750},{"type":"v1","addr":"172.21.15.118:6835","nonce":2638143750}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[]} 2024-09-21T06:17:12.188 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 97 2024-09-21T06:17:12.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f14b4078b90 msgr2=0x7f14b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:12.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f14b4078b90 0x7f14b407b0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f14c8007fd0 tx=0x7f14c8009040 comp rx=0 tx=0).stop 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 msgr2=0x7f14d413c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d413c030 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b3e0 tx=0x7f14c000b8a0 comp rx=0 tx=0).stop 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 shutdown_connections 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d4073ee0 0x7f14d413c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d413fef0 0x7f14d413c030 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:6800/952547634,v1:172.21.15.149:6801/952547634] conn(0x7f14b4078b90 0x7f14b407b0a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 --2- 172.21.15.118:0/1837209471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d413fae0 0x7f14d4141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 >> 172.21.15.118:0/1837209471 conn(0x7f14d406d110 msgr2=0x7f14d4160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 shutdown_connections 2024-09-21T06:17:12.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-21T06:17:12.188+0000 7f14dc000640 1 -- 172.21.15.118:0/1837209471 wait complete. 2024-09-21T06:17:12.215 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-21T06:17:12.215 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T06:17:12.216 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:17:12.216 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.238 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:17:12.238 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:17:12.238 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.304 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:17:12.305 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:17:12.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.329 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:17:12.330 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:17:12.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.394 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:17:12.394 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T06:17:12.394 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T06:17:12.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.444 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T06:17:12.444 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T06:17:12.444 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.499 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T06:17:12.499 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T06:17:12.499 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.569 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T06:17:12.569 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T06:17:12.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.614 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T06:17:12.614 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T06:17:12.614 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.661 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T06:17:12.661 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T06:17:12.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.704 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T06:17:12.704 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T06:17:12.704 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.759 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T06:17:12.760 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T06:17:12.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.826 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T06:17:12.827 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T06:17:12.827 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T06:17:12.827 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.899 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T06:17:12.899 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T06:17:12.899 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:12.980 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T06:17:12.981 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T06:17:12.981 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T06:17:12.981 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:13.012 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T06:17:13.012 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T06:17:13.012 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:13.038 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T06:17:13.038 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T06:17:13.038 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:17:13.120 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T06:17:13.120 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T06:17:13.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-21T06:17:13.208 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:17:13.208 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T06:17:13.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:17:13.395 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T06:17:13.513 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:17:13.514 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T06:17:13.624 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:17:13.624 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T06:17:13.742 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:17:13.742 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T06:17:13.929 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:17:13.929 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T06:17:14.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:17:14.038 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T06:17:14.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:17:14.148 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T06:17:14.291 INFO:tasks.ceph:Archiving mon data... 2024-09-21T06:17:14.292 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/data/mon.a.tgz 2024-09-21T06:17:14.292 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-21T06:17:14.328 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.SwvAwTwGL3 2024-09-21T06:17:14.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SwvAwTwGL3 2024-09-21T06:17:14.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.SwvAwTwGL3 2024-09-21T06:17:14.609 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.SwvAwTwGL3 is 417KB 2024-09-21T06:17:14.699 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.SwvAwTwGL3 2024-09-21T06:17:14.733 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/data/mon.b.tgz 2024-09-21T06:17:14.733 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T06:17:14.768 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.QnW0YAsf2i 2024-09-21T06:17:14.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QnW0YAsf2i 2024-09-21T06:17:14.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.QnW0YAsf2i 2024-09-21T06:17:15.062 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.QnW0YAsf2i is 419KB 2024-09-21T06:17:15.150 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.QnW0YAsf2i 2024-09-21T06:17:15.185 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/data/mon.c.tgz 2024-09-21T06:17:15.185 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-21T06:17:15.259 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.yBgmKkFLAv 2024-09-21T06:17:15.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.yBgmKkFLAv 2024-09-21T06:17:15.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.yBgmKkFLAv 2024-09-21T06:17:15.530 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.yBgmKkFLAv is 419KB 2024-09-21T06:17:15.619 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.yBgmKkFLAv 2024-09-21T06:17:15.653 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T06:17:15.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T06:17:15.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T06:17:15.785 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T06:17:15.820 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T06:17:15.820 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T06:17:15.822 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/remote/smithi118/crash 2024-09-21T06:17:15.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T06:17:15.881 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/remote/smithi149/crash 2024-09-21T06:17:15.882 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T06:17:15.936 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T06:17:15.936 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:17:15.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:17:16.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T06:17:16.081 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T06:17:16.136 INFO:tasks.ceph:Compressing logs... 2024-09-21T06:17:16.136 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:17:16.140 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:17:16.190 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T06:17:16.191 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55802.log 2024-09-21T06:17:16.192 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57284.log 2024-09-21T06:17:16.193 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.55802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56295.log 2024-09-21T06:17:16.193 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55802.log.gz 2024-09-21T06:17:16.193 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50333.log 2024-09-21T06:17:16.193 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57284.log.gz 2024-09-21T06:17:16.194 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35279.log 2024-09-21T06:17:16.194 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34228.log 2024-09-21T06:17:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35279.log.gz 2024-09-21T06:17:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36295.log 2024-09-21T06:17:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.34228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34228.log.gz 2024-09-21T06:17:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T06:17:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.36295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36295.log.gz 2024-09-21T06:17:16.197 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T06:17:16.198 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40487.log 2024-09-21T06:17:16.198 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2024-09-21T06:17:16.198 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58181.log 2024-09-21T06:17:16.198 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50333.log.gz 2024-09-21T06:17:16.198 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-09-21T06:17:16.198 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40487.log.gz 2024-09-21T06:17:16.199 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57032.log 2024-09-21T06:17:16.199 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58181.log.gz 2024-09-21T06:17:16.199 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42809.log 2024-09-21T06:17:16.199 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2024-09-21T06:17:16.202 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32209.log 2024-09-21T06:17:16.202 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T06:17:16.202 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.32209.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T06:17:16.202 INFO:teuthology.orchestra.run.smithi149.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.32209.log.gz 2024-09-21T06:17:16.202 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32049.log 2024-09-21T06:17:16.202 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32089.log 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54112.log 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57032.log.gz 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65188.log 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42809.log.gz 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53593.log 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54112.log.gz 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65188.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.65188.log.gz 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33761.log 2024-09-21T06:17:16.203 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58689.log 2024-09-21T06:17:16.204 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53593.log.gz 2024-09-21T06:17:16.204 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39810.log 2024-09-21T06:17:16.204 INFO:teuthology.orchestra.run.smithi118.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33761.log.gz 2024-09-21T06:17:16.206 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.32049.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T06:17:16.206 INFO:teuthology.orchestra.run.smithi149.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32049.log.gz 2024-09-21T06:17:16.207 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.32089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33194.log 2024-09-21T06:17:16.207 INFO:teuthology.orchestra.run.smithi149.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32089.log.gz 2024-09-21T06:17:16.207 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37806.log 2024-09-21T06:17:16.207 INFO:teuthology.orchestra.run.smithi149.stderr: 94.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T06:17:16.207 INFO:teuthology.orchestra.run.smithi149.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T06:17:16.207 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.33194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33194.log.gz 2024-09-21T06:17:16.207 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33620.log 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58689.log.gz 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39810.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39810.log.gz 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60886.log 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55700.log 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49978.log 2024-09-21T06:17:16.208 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60886.log.gz 2024-09-21T06:17:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47914.log 2024-09-21T06:17:16.209 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55700.log.gz 2024-09-21T06:17:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49978.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz 2024-09-21T06:17:16.209 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32678.log 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40794.log 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47914.log.gz 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57638.log 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32678.log.gz 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45119.log 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40794.log.gz 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57638.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57638.log.gz 2024-09-21T06:17:16.212 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58941.log 2024-09-21T06:17:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38358.log 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.37806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37806.log.gz 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.3.33620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31969.log 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33620.log.gz 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.38358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36793.log 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38358.log.gz 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.31969.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31969.log.gz 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37276.log 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.36793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36793.log.gz 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.37276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37276.log.gz 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34782.log 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.34782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34782.log.gz 2024-09-21T06:17:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T06:17:16.216 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32329.log 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31493.log 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gz 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58941.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58941.log.gz 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53513.log 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31493.log.gz 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49716.log 2024-09-21T06:17:16.218 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53513.log.gz 2024-09-21T06:17:16.219 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36998.log 2024-09-21T06:17:16.219 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-09-21T06:17:16.219 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43877.log 2024-09-21T06:17:16.219 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49716.log.gz 2024-09-21T06:17:16.219 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36998.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36998.log.gz 2024-09-21T06:17:16.219 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51297.log 2024-09-21T06:17:16.219 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2024-09-21T06:17:16.221 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T06:17:16.221 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.32329.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32329.log.gz 2024-09-21T06:17:16.222 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T06:17:16.222 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T06:17:16.222 INFO:teuthology.orchestra.run.smithi149.stderr: -- /var/log/ceph/ceph-client.1.38873.log 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51297.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43877.log.gz 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40836.log 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51297.log.gz 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46061.log 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40836.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40836.log.gz 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37794.log 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46061.log.gz 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64367.log 2024-09-21T06:17:16.223 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37794.log.gz 2024-09-21T06:17:16.227 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.38873.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T06:17:16.227 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.b.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38873.log.gz 2024-09-21T06:17:16.227 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32169.log 2024-09-21T06:17:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57116.log 2024-09-21T06:17:16.227 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2024-09-21T06:17:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64367.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64367.log.gz 2024-09-21T06:17:16.227 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42496.log 2024-09-21T06:17:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51171.log 2024-09-21T06:17:16.228 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57116.log.gz 2024-09-21T06:17:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42683.log 87.2% 2024-09-21T06:17:16.228 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42496.log.gz 2024-09-21T06:17:16.228 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-09-21T06:17:16.228 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51171.log.gz 2024-09-21T06:17:16.228 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32129.log 2024-09-21T06:17:16.230 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60964.log 2024-09-21T06:17:16.230 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42683.log.gz 2024-09-21T06:17:16.230 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36117.log 2024-09-21T06:17:16.230 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-09-21T06:17:16.230 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60964.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60964.log.gz 2024-09-21T06:17:16.230 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58815.log 2024-09-21T06:17:16.231 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61731.log 2024-09-21T06:17:16.231 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36117.log.gz 2024-09-21T06:17:16.231 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31735.log 2024-09-21T06:17:16.231 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58815.log.gz 2024-09-21T06:17:16.233 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.32169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35797.log 2024-09-21T06:17:16.233 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38703.log 2024-09-21T06:17:16.233 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61731.log.gz 2024-09-21T06:17:16.233 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31735.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31735.log.gz 2024-09-21T06:17:16.233 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54760.log 2024-09-21T06:17:16.234 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43519.log 2024-09-21T06:17:16.234 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38703.log.gz 2024-09-21T06:17:16.234 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62551.log 2024-09-21T06:17:16.234 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54760.log.gz 2024-09-21T06:17:16.235 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32092.log 2024-09-21T06:17:16.236 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43519.log.gz 2024-09-21T06:17:16.237 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53124.log 2024-09-21T06:17:16.237 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62551.log.gz 2024-09-21T06:17:16.238 INFO:teuthology.orchestra.run.smithi149.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32169.log.gz 2024-09-21T06:17:16.238 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32009.log 2024-09-21T06:17:16.238 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35797.log.gz 2024-09-21T06:17:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63928.log 2024-09-21T06:17:16.239 INFO:teuthology.orchestra.run.smithi118.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32092.log.gz 2024-09-21T06:17:16.239 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41603.log 2024-09-21T06:17:16.239 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53124.log.gz 2024-09-21T06:17:16.240 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45402.log 2024-09-21T06:17:16.240 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.63928.log.gz 2024-09-21T06:17:16.240 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.32129.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32129.log.gz 2024-09-21T06:17:16.241 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34362.log 2024-09-21T06:17:16.241 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41603.log.gz 2024-09-21T06:17:16.241 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50375.log 2024-09-21T06:17:16.242 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45402.log.gz 2024-09-21T06:17:16.242 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47327.log 2024-09-21T06:17:16.242 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34362.log.gz 2024-09-21T06:17:16.242 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37243.log 2024-09-21T06:17:16.242 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50375.log.gz 2024-09-21T06:17:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.32009.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32009.log.gz 2024-09-21T06:17:16.244 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-09-21T06:17:16.244 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47327.log.gz 2024-09-21T06:17:16.244 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46872.log 2024-09-21T06:17:16.244 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37243.log.gz 2024-09-21T06:17:16.245 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43477.log 2024-09-21T06:17:16.245 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-09-21T06:17:16.246 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52709.log 2024-09-21T06:17:16.246 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46872.log.gz 2024-09-21T06:17:16.246 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-09-21T06:17:16.247 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43477.log.gz 2024-09-21T06:17:16.247 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2024-09-21T06:17:16.247 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52709.log.gz 2024-09-21T06:17:16.248 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39894.log 2024-09-21T06:17:16.248 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-09-21T06:17:16.249 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48563.log 2024-09-21T06:17:16.250 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz 2024-09-21T06:17:16.250 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39894.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39894.log.gz 2024-09-21T06:17:16.250 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63644.log 2024-09-21T06:17:16.251 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52252.log 2024-09-21T06:17:16.252 INFO:teuthology.orchestra.run.smithi118.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48563.log.gz 2024-09-21T06:17:16.252 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56516.log 2024-09-21T06:17:16.252 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63644.log.gz 2024-09-21T06:17:16.253 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45935.log 2024-09-21T06:17:16.253 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52252.log.gz 2024-09-21T06:17:16.253 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32101.log 2024-09-21T06:17:16.254 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56516.log.gz 2024-09-21T06:17:16.254 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44806.log 2024-09-21T06:17:16.254 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45935.log.gz 2024-09-21T06:17:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31841.log 2024-09-21T06:17:16.255 INFO:teuthology.orchestra.run.smithi118.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32101.log.gz 2024-09-21T06:17:16.258 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42641.log 2024-09-21T06:17:16.258 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44806.log.gz 2024-09-21T06:17:16.259 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59920.log 2024-09-21T06:17:16.259 INFO:teuthology.orchestra.run.smithi118.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31841.log.gz 2024-09-21T06:17:16.259 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46103.log 2024-09-21T06:17:16.259 INFO:teuthology.orchestra.run.smithi118.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42641.log.gz 2024-09-21T06:17:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44131.log 2024-09-21T06:17:16.260 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59920.log.gz 2024-09-21T06:17:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65272.log 2024-09-21T06:17:16.260 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46103.log.gz 2024-09-21T06:17:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.44131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44131.log.gz 2024-09-21T06:17:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61587.log 2024-09-21T06:17:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49794.log 2024-09-21T06:17:16.261 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65272.log.gz 2024-09-21T06:17:16.262 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48000.log 2024-09-21T06:17:16.262 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61587.log.gz 2024-09-21T06:17:16.263 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2024-09-21T06:17:16.263 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49794.log.gz 2024-09-21T06:17:16.264 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64600.log 2024-09-21T06:17:16.264 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48000.log.gz 2024-09-21T06:17:16.265 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46794.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T06:17:16.265 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-09-21T06:17:16.266 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39211.log 2024-09-21T06:17:16.266 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64600.log.gz 2024-09-21T06:17:16.267 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2024-09-21T06:17:16.268 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39211.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39211.log.gz 2024-09-21T06:17:16.268 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40443.log 2024-09-21T06:17:16.269 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37624.log 2024-09-21T06:17:16.269 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gz 2024-09-21T06:17:16.269 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40443.log: gzip 86.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.40443.log.gz --verbose 2024-09-21T06:17:16.269 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.43296.log 2024-09-21T06:17:16.270 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58285.log 2024-09-21T06:17:16.270 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37624.log.gz 2024-09-21T06:17:16.271 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43296.log: gzip 87.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.43296.log.gz --verbose 2024-09-21T06:17:16.271 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.61316.log 2024-09-21T06:17:16.272 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58285.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58285.log.gz 2024-09-21T06:17:16.272 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55939.log 2024-09-21T06:17:16.273 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61316.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.61316.log.gz 2024-09-21T06:17:16.273 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55290.log 2024-09-21T06:17:16.274 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61190.log 2024-09-21T06:17:16.274 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55939.log.gz 2024-09-21T06:17:16.275 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55290.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55290.log.gz 2024-09-21T06:17:16.275 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34351.log 2024-09-21T06:17:16.276 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2024-09-21T06:17:16.276 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61190.log.gz 2024-09-21T06:17:16.277 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34351.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34351.log.gz 2024-09-21T06:17:16.277 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60009.log 2024-09-21T06:17:16.278 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2024-09-21T06:17:16.278 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2024-09-21T06:17:16.279 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60009.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.60009.log.gz --verbose 2024-09-21T06:17:16.279 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.56986.log 2024-09-21T06:17:16.279 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61987.log 2024-09-21T06:17:16.280 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2024-09-21T06:17:16.280 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2024-09-21T06:17:16.280 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56986.log.gz 2024-09-21T06:17:16.281 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59836.log 2024-09-21T06:17:16.281 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61987.log.gz 2024-09-21T06:17:16.282 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41876.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2024-09-21T06:17:16.282 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56676.log 2024-09-21T06:17:16.283 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48521.log 2024-09-21T06:17:16.283 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59836.log.gz 2024-09-21T06:17:16.284 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44596.log 2024-09-21T06:17:16.284 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56676.log.gz 2024-09-21T06:17:16.285 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2024-09-21T06:17:16.285 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48521.log.gz 2024-09-21T06:17:16.286 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44596.log: gzip -5 87.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44596.log.gz 2024-09-21T06:17:16.286 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.48437.log 2024-09-21T06:17:16.287 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51424.log 2024-09-21T06:17:16.287 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2024-09-21T06:17:16.288 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48437.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2024-09-21T06:17:16.288 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-09-21T06:17:16.289 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36033.log 2024-09-21T06:17:16.289 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51424.log.gz 2024-09-21T06:17:16.289 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47471.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-09-21T06:17:16.289 INFO:teuthology.orchestra.run.smithi118.stderr: /var/log/ceph/ceph-client.admin.57494.log 2024-09-21T06:17:16.290 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31811.log 2024-09-21T06:17:16.290 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36033.log.gz 2024-09-21T06:17:16.291 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57494.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.57494.log.gz 2024-09-21T06:17:16.291 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60135.log 2024-09-21T06:17:16.292 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52835.log 2024-09-21T06:17:16.292 INFO:teuthology.orchestra.run.smithi118.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31811.log.gz 2024-09-21T06:17:16.293 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60135.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.60135.log.gz 2024-09-21T06:17:16.293 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37328.log 2024-09-21T06:17:16.294 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31916.log 2024-09-21T06:17:16.294 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52835.log.gz 2024-09-21T06:17:16.295 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37328.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.37328.log.gz 2024-09-21T06:17:16.295 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58731.log 2024-09-21T06:17:16.296 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31916.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31916.log.gz 2024-09-21T06:17:16.296 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65553.log 2024-09-21T06:17:16.297 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56596.log 87.9% 2024-09-21T06:17:16.297 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58731.log.gz 2024-09-21T06:17:16.298 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57074.log 2024-09-21T06:17:16.298 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65553.log.gz 2024-09-21T06:17:16.299 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56596.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.56596.log.gz --verbose 2024-09-21T06:17:16.299 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.63602.log 2024-09-21T06:17:16.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63010.log 2024-09-21T06:17:16.300 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57074.log.gz 2024-09-21T06:17:16.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47956.log 2024-09-21T06:17:16.300 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63602.log.gz 2024-09-21T06:17:16.301 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53716.log 2024-09-21T06:17:16.301 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63010.log.gz 2024-09-21T06:17:16.302 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47956.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47956.log.gz 2024-09-21T06:17:16.302 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51083.log 2024-09-21T06:17:16.303 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46019.log 2024-09-21T06:17:16.303 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53716.log.gz 2024-09-21T06:17:16.304 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59635.log 2024-09-21T06:17:16.304 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51083.log.gz 2024-09-21T06:17:16.305 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60177.log 2024-09-21T06:17:16.305 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46019.log.gz 2024-09-21T06:17:16.306 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36495.log 2024-09-21T06:17:16.306 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59635.log.gz 2024-09-21T06:17:16.307 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49568.log 2024-09-21T06:17:16.307 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60177.log.gz 2024-09-21T06:17:16.308 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44538.log 87.6% 2024-09-21T06:17:16.308 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36495.log.gz 2024-09-21T06:17:16.308 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54322.log 2024-09-21T06:17:16.309 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49568.log.gz 2024-09-21T06:17:16.309 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-09-21T06:17:16.310 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44538.log.gz 2024-09-21T06:17:16.310 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49936.log 2024-09-21T06:17:16.311 INFO:teuthology.orchestra.run.smithi118.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54322.log.gz 2024-09-21T06:17:16.312 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51508.log 2024-09-21T06:17:16.312 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-09-21T06:17:16.313 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46604.log 2024-09-21T06:17:16.313 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49936.log.gz 2024-09-21T06:17:16.314 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59697.log 2024-09-21T06:17:16.314 INFO:teuthology.orchestra.run.smithi118.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51508.log.gz 2024-09-21T06:17:16.314 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46604.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46604.log.gz 2024-09-21T06:17:16.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60219.log 2024-09-21T06:17:16.315 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37082.log 2024-09-21T06:17:16.315 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.59697.log.gz 2024-09-21T06:17:16.316 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52979.log 2024-09-21T06:17:16.316 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60219.log.gz 2024-09-21T06:17:16.317 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59254.log 2024-09-21T06:17:16.317 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37082.log.gz 2024-09-21T06:17:16.318 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52979.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.52979.log.gz --verbose 2024-09-21T06:17:16.318 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.54990.log 2024-09-21T06:17:16.319 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34013.log 2024-09-21T06:17:16.319 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59254.log.gz 2024-09-21T06:17:16.320 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61377.log 2024-09-21T06:17:16.320 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54990.log.gz 2024-09-21T06:17:16.321 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52793.log 2024-09-21T06:17:16.321 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34013.log.gz 2024-09-21T06:17:16.322 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49093.log 2024-09-21T06:17:16.322 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61377.log.gz 2024-09-21T06:17:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61274.log 2024-09-21T06:17:16.323 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52793.log.gz 2024-09-21T06:17:16.323 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49093.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.49093.log.gz 2024-09-21T06:17:16.324 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60636.log 2024-09-21T06:17:16.324 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59044.log 2024-09-21T06:17:16.325 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61274.log.gz 2024-09-21T06:17:16.325 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38570.log 2024-09-21T06:17:16.325 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60636.log.gz 2024-09-21T06:17:16.326 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52009.log 2024-09-21T06:17:16.326 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59044.log.gz 2024-09-21T06:17:16.327 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.38570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38570.log.gz 2024-09-21T06:17:16.327 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57848.log 2024-09-21T06:17:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2024-09-21T06:17:16.328 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52009.log.gz 2024-09-21T06:17:16.329 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37980.log 2024-09-21T06:17:16.329 INFO:teuthology.orchestra.run.smithi118.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57848.log.gz 2024-09-21T06:17:16.330 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34685.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2024-09-21T06:17:16.330 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57368.log 2024-09-21T06:17:16.331 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37980.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37980.log.gz 2024-09-21T06:17:16.331 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41834.log 2024-09-21T06:17:16.332 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63320.log 2024-09-21T06:17:16.332 INFO:teuthology.orchestra.run.smithi118.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57368.log.gz 2024-09-21T06:17:16.333 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41834.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41834.log.gz 2024-09-21T06:17:16.333 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38064.log 2024-09-21T06:17:16.334 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52919.log 2024-09-21T06:17:16.334 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63320.log.gz 2024-09-21T06:17:16.335 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65314.log 2024-09-21T06:17:16.335 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38064.log.gz 2024-09-21T06:17:16.336 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51381.log 2024-09-21T06:17:16.336 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52919.log.gz 2024-09-21T06:17:16.337 INFO:teuthology.orchestra.run.smithi149.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T06:17:16.337 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59212.log 2024-09-21T06:17:16.337 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65314.log.gz 2024-09-21T06:17:16.338 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39515.log 2024-09-21T06:17:16.338 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51381.log.gz 2024-09-21T06:17:16.338 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59212.log: gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.59212.log.gz /var/log/ceph/ceph-client.admin.51339.log 2024-09-21T06:17:16.338 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.339 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39515.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.39515.log.gz 2024-09-21T06:17:16.339 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62701.log 2024-09-21T06:17:16.340 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51339.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51339.log.gz 2024-09-21T06:17:16.340 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50291.log 2024-09-21T06:17:16.341 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2024-09-21T06:17:16.341 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62701.log.gz 2024-09-21T06:17:16.342 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40135.log 2024-09-21T06:17:16.342 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50291.log.gz 2024-09-21T06:17:16.343 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57764.log 2024-09-21T06:17:16.343 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz 2024-09-21T06:17:16.344 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40135.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40135.log.gz 2024-09-21T06:17:16.344 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56211.log 2024-09-21T06:17:16.345 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57764.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57764.log.gz 2024-09-21T06:17:16.345 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59785.log 2024-09-21T06:17:16.346 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56211.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56211.log.gz 2024-09-21T06:17:16.346 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58589.log 2024-09-21T06:17:16.347 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45307.log 2024-09-21T06:17:16.347 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59785.log.gz 2024-09-21T06:17:16.348 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55066.log 2024-09-21T06:17:16.348 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58589.log.gz 2024-09-21T06:17:16.349 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45307.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45307.log.gz 2024-09-21T06:17:16.349 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41645.log 2024-09-21T06:17:16.349 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55066.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55066.log.gz 2024-09-21T06:17:16.350 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53334.log 2024-09-21T06:17:16.350 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41645.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41645.log.gz 2024-09-21T06:17:16.351 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39289.log 2024-09-21T06:17:16.351 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53334.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53334.log.gz 2024-09-21T06:17:16.351 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34355.log 2024-09-21T06:17:16.352 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39289.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39289.log.gz 2024-09-21T06:17:16.352 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37454.log 2024-09-21T06:17:16.353 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34355.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2024-09-21T06:17:16.353 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48088.log 2024-09-21T06:17:16.354 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37454.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37454.log.gz 2024-09-21T06:17:16.354 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40314.log 2024-09-21T06:17:16.355 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48088.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48088.log.gz 2024-09-21T06:17:16.355 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34021.log 2024-09-21T06:17:16.356 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40314.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40314.log.gz 2024-09-21T06:17:16.356 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51592.log 2024-09-21T06:17:16.357 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54576.log 2024-09-21T06:17:16.357 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34021.log.gz 2024-09-21T06:17:16.358 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51592.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51592.log.gz 2024-09-21T06:17:16.358 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2024-09-21T06:17:16.358 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.54576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54576.log.gz 2024-09-21T06:17:16.359 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54655.log 2024-09-21T06:17:16.360 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48896.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2024-09-21T06:17:16.360 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63970.log 2024-09-21T06:17:16.361 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54655.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54655.log.gz 2024-09-21T06:17:16.361 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36159.log 2024-09-21T06:17:16.361 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50990.log 2024-09-21T06:17:16.362 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63970.log.gz 2024-09-21T06:17:16.362 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36159.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.36159.log.gz 2024-09-21T06:17:16.362 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55332.log 2024-09-21T06:17:16.363 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50990.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50990.log.gz 2024-09-21T06:17:16.363 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35796.log 2024-09-21T06:17:16.364 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55332.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55332.log.gz 2024-09-21T06:17:16.364 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62509.log 2024-09-21T06:17:16.365 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.2.35796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35796.log.gz 2024-09-21T06:17:16.365 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34853.log 2024-09-21T06:17:16.367 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62509.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.62509.log.gz 2024-09-21T06:17:16.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2024-09-21T06:17:16.368 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57242.log 2024-09-21T06:17:16.368 INFO:teuthology.orchestra.run.smithi118.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34853.log.gz 2024-09-21T06:17:16.368 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46145.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2024-09-21T06:17:16.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31608.log 2024-09-21T06:17:16.369 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57242.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57242.log.gz 2024-09-21T06:17:16.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34025.log 2024-09-21T06:17:16.370 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31608.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.31608.log.gz 2024-09-21T06:17:16.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64684.log 2024-09-21T06:17:16.371 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34025.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34025.log.gz 2024-09-21T06:17:16.371 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65230.log 2024-09-21T06:17:16.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64684.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64684.log.gz 2024-09-21T06:17:16.372 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38190.log 2024-09-21T06:17:16.373 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65230.log: gzip -5 --verbose -- 86.8% /var/log/ceph/ceph-client.admin.33169.log -- replaced with /var/log/ceph/ceph-client.admin.65230.log.gz 2024-09-21T06:17:16.373 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.374 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38190.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38190.log.gz 2024-09-21T06:17:16.374 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64096.log 2024-09-21T06:17:16.375 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33169.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33169.log.gz 2024-09-21T06:17:16.375 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50725.log 2024-09-21T06:17:16.376 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64096.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64096.log.gz 2024-09-21T06:17:16.376 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2024-09-21T06:17:16.377 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50725.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50725.log.gz 2024-09-21T06:17:16.377 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38316.log 2024-09-21T06:17:16.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50902.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2024-09-21T06:17:16.378 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51213.log 2024-09-21T06:17:16.379 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46187.log 2024-09-21T06:17:16.379 INFO:teuthology.orchestra.run.smithi118.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38316.log.gz 2024-09-21T06:17:16.380 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51213.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51213.log.gz 2024-09-21T06:17:16.380 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62425.log 2024-09-21T06:17:16.381 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46187.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46187.log.gz 2024-09-21T06:17:16.381 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59967.log 2024-09-21T06:17:16.381 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62425.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.62425.log.gz 2024-09-21T06:17:16.381 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51700.log 2024-09-21T06:17:16.382 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59967.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.59967.log.gz 2024-09-21T06:17:16.382 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39431.log 2024-09-21T06:17:16.383 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-09-21T06:17:16.383 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51700.log.gz 2024-09-21T06:17:16.384 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39431.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39431.log.gz 2024-09-21T06:17:16.384 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50858.log 2024-09-21T06:17:16.385 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47140.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-09-21T06:17:16.385 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T06:17:16.386 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50858.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50858.log.gz 2024-09-21T06:17:16.386 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60515.log 2024-09-21T06:17:16.387 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37836.log 2024-09-21T06:17:16.388 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.60515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60515.log.gz 2024-09-21T06:17:16.388 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33467.log 2024-09-21T06:17:16.389 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37836.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37836.log.gz 2024-09-21T06:17:16.389 INFO:teuthology.orchestra.run.smithi118.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T06:17:16.389 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2024-09-21T06:17:16.390 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33677.log 2024-09-21T06:17:16.390 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33467.log.gz 2024-09-21T06:17:16.391 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44951.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2024-09-21T06:17:16.391 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34559.log 2024-09-21T06:17:16.392 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33677.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33677.log.gz 2024-09-21T06:17:16.392 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37412.log 2024-09-21T06:17:16.393 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34559.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34559.log.gz 2024-09-21T06:17:16.393 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53418.log 2024-09-21T06:17:16.394 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65146.log 2024-09-21T06:17:16.394 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37412.log.gz 2024-09-21T06:17:16.395 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53418.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53418.log.gz 2024-09-21T06:17:16.395 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49894.log 2024-09-21T06:17:16.396 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65146.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.65146.log.gz 2024-09-21T06:17:16.396 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34727.log 2024-09-21T06:17:16.397 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49894.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.41528.log 2024-09-21T06:17:16.397 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49894.log.gz 2024-09-21T06:17:16.397 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34727.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.33845.log -- replaced with /var/log/ceph/ceph-client.admin.34727.log.gz 2024-09-21T06:17:16.398 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.398 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T06:17:16.399 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41528.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41528.log.gz 2024-09-21T06:17:16.399 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38022.log 2024-09-21T06:17:16.399 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33845.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-09-21T06:17:16.399 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29966.log 2024-09-21T06:17:16.400 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38022.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38022.log.gz 2024-09-21T06:17:16.400 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38650.log 2024-09-21T06:17:16.401 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.tmp-client.admin.29966.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29966.log.gz 2024-09-21T06:17:16.401 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2024-09-21T06:17:16.402 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47014.log 2024-09-21T06:17:16.402 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38650.log.gz 2024-09-21T06:17:16.403 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52168.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2024-09-21T06:17:16.403 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65398.log 2024-09-21T06:17:16.404 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47014.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2024-09-21T06:17:16.404 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52210.log 2024-09-21T06:17:16.405 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65398.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65398.log.gz 2024-09-21T06:17:16.405 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40399.log 2024-09-21T06:17:16.406 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48395.log 2024-09-21T06:17:16.406 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52210.log.gz 2024-09-21T06:17:16.407 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34023.log 2024-09-21T06:17:16.407 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40399.log.gz 2024-09-21T06:17:16.408 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48395.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-09-21T06:17:16.408 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36306.log 2024-09-21T06:17:16.409 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34023.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.34023.log.gz 2024-09-21T06:17:16.409 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64726.log 2024-09-21T06:17:16.410 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61503.log 2024-09-21T06:17:16.410 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36306.log.gz 2024-09-21T06:17:16.411 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64726.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.64726.log.gz /var/log/ceph/ceph-client.admin.44210.log 2024-09-21T06:17:16.411 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.411 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61503.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.61503.log.gz 2024-09-21T06:17:16.412 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-09-21T06:17:16.412 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36662.log 2024-09-21T06:17:16.413 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-09-21T06:17:16.413 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50417.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-09-21T06:17:16.413 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37496.log 2024-09-21T06:17:16.414 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36662.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36662.log.gz 2024-09-21T06:17:16.414 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65062.log 2024-09-21T06:17:16.415 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37496.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37496.log.gz 2024-09-21T06:17:16.415 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56851.log 2024-09-21T06:17:16.416 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65062.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65062.log.gz 2024-09-21T06:17:16.416 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48479.log 2024-09-21T06:17:16.417 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56851.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.33509.log -- replaced with /var/log/ceph/ceph-client.admin.56851.log.gz 2024-09-21T06:17:16.417 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.418 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48479.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48479.log.gz 2024-09-21T06:17:16.418 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64325.log 2024-09-21T06:17:16.419 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31533.log 2024-09-21T06:17:16.419 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33509.log.gz 2024-09-21T06:17:16.420 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64325.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.40878.log -- replaced with /var/log/ceph/ceph-client.admin.64325.log.gz 2024-09-21T06:17:16.420 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.420 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31533.log: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.31533.log.gz 2024-09-21T06:17:16.421 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57596.log 2024-09-21T06:17:16.422 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40878.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40878.log.gz 2024-09-21T06:17:16.422 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36417.log 2024-09-21T06:17:16.422 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57596.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.57596.log.gz --verbose 2024-09-21T06:17:16.423 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.61671.log 2024-09-21T06:17:16.423 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36417.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36417.log.gz 2024-09-21T06:17:16.423 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45203.log 2024-09-21T06:17:16.424 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61671.log: gzip -5 87.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.61671.log.gz -- 2024-09-21T06:17:16.424 INFO:teuthology.orchestra.run.smithi118.stderr: /var/log/ceph/ceph-client.admin.52573.log 2024-09-21T06:17:16.425 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45203.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.45203.log.gz 2024-09-21T06:17:16.425 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45805.log 2024-09-21T06:17:16.426 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52573.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52573.log.gz 2024-09-21T06:17:16.426 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2024-09-21T06:17:16.427 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45805.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45805.log.gz 2024-09-21T06:17:16.427 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33635.log 2024-09-21T06:17:16.428 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51967.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2024-09-21T06:17:16.428 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55742.log 2024-09-21T06:17:16.429 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33635.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.33635.log.gz 2024-09-21T06:17:16.429 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 2024-09-21T06:17:16.430 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55742.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55742.log.gz 2024-09-21T06:17:16.430 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57200.log 2024-09-21T06:17:16.431 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36075.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2024-09-21T06:17:16.431 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39726.log 2024-09-21T06:17:16.432 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57200.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57200.log.gz 2024-09-21T06:17:16.432 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49400.log 2024-09-21T06:17:16.432 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50459.log 2024-09-21T06:17:16.432 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39726.log.gz 2024-09-21T06:17:16.433 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49400.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49400.log.gz 2024-09-21T06:17:16.433 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59338.log 2024-09-21T06:17:16.434 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50459.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50459.log.gz -5 2024-09-21T06:17:16.434 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39998.log 2024-09-21T06:17:16.435 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59338.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59338.log.gz 2024-09-21T06:17:16.435 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60594.log 2024-09-21T06:17:16.436 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39998.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39998.log.gz 2024-09-21T06:17:16.436 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36201.log 2024-09-21T06:17:16.437 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60594.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60594.log.gz 2024-09-21T06:17:16.437 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58647.log 2024-09-21T06:17:16.438 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2024-09-21T06:17:16.438 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36201.log.gz 2024-09-21T06:17:16.439 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58647.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.58647.log.gz 2024-09-21T06:17:16.439 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47834.log 2024-09-21T06:17:16.440 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45847.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz --verbose 2024-09-21T06:17:16.440 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.59002.log 2024-09-21T06:17:16.440 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47834.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47834.log.gz 2024-09-21T06:17:16.441 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46483.log 2024-09-21T06:17:16.441 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59002.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.59002.log.gz /var/log/ceph/ceph-client.admin.33383.log 2024-09-21T06:17:16.441 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.442 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.46483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46483.log.gz 2024-09-21T06:17:16.442 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43435.log 2024-09-21T06:17:16.443 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33383.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33383.log.gz 2024-09-21T06:17:16.443 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46930.log 2024-09-21T06:17:16.444 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43435.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43435.log.gz 2024-09-21T06:17:16.444 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46972.log 2024-09-21T06:17:16.445 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46930.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46930.log.gz 2024-09-21T06:17:16.445 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-09-21T06:17:16.446 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46972.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46972.log.gz 2024-09-21T06:17:16.446 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2024-09-21T06:17:16.447 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32054.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz 2024-09-21T06:17:16.447 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34811.log 2024-09-21T06:17:16.448 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43340.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2024-09-21T06:17:16.448 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53898.log 2024-09-21T06:17:16.449 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34811.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34811.log.gzgzip 2024-09-21T06:17:16.449 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54280.log 2024-09-21T06:17:16.450 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53898.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.53898.log.gz 2024-09-21T06:17:16.450 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61232.log 2024-09-21T06:17:16.451 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54280.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54280.log.gz 2024-09-21T06:17:16.451 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45077.log 2024-09-21T06:17:16.452 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61232.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61232.log.gz 2024-09-21T06:17:16.452 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37162.log 2024-09-21T06:17:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45077.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45077.log.gz 2024-09-21T06:17:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34363.log 2024-09-21T06:17:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37162.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37162.log.gz 2024-09-21T06:17:16.454 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63243.log 2024-09-21T06:17:16.454 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34363.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34363.log.gz 2024-09-21T06:17:16.455 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55642.log 2024-09-21T06:17:16.455 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63243.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.63243.log.gz 2024-09-21T06:17:16.455 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65104.log 2024-09-21T06:17:16.456 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55642.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55642.log.gz 2024-09-21T06:17:16.456 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49442.log 2024-09-21T06:17:16.457 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65104.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.65104.log.gz 2024-09-21T06:17:16.457 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62116.log 2024-09-21T06:17:16.458 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49442.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.49442.log.gz 2024-09-21T06:17:16.458 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60698.log 2024-09-21T06:17:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62116.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62116.log.gz 2024-09-21T06:17:16.459 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59170.log 2024-09-21T06:17:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60698.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60698.log.gz 2024-09-21T06:17:16.461 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53803.log 2024-09-21T06:17:16.462 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59170.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59170.log.gz 2024-09-21T06:17:16.462 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49484.log 2024-09-21T06:17:16.463 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53803.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53803.log.gz 2024-09-21T06:17:16.463 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56379.log 2024-09-21T06:17:16.463 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49484.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.49484.log.gz 2024-09-21T06:17:16.463 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62072.log 2024-09-21T06:17:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56379.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56379.log.gzgzip 2024-09-21T06:17:16.464 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33341.log 2024-09-21T06:17:16.464 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62383.log 87.6% 2024-09-21T06:17:16.465 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62072.log.gz 2024-09-21T06:17:16.465 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33341.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.33341.log.gz 2024-09-21T06:17:16.466 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55416.log 2024-09-21T06:17:16.466 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42538.log 2024-09-21T06:17:16.466 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62383.log.gz 2024-09-21T06:17:16.467 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36704.log 2024-09-21T06:17:16.467 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55416.log.gz 2024-09-21T06:17:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2024-09-21T06:17:16.468 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42538.log.gz 2024-09-21T06:17:16.469 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36704.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.34643.log -- replaced with /var/log/ceph/ceph-client.admin.36704.log.gz 2024-09-21T06:17:16.469 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41918.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2024-09-21T06:17:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53166.log 2024-09-21T06:17:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34643.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34643.log.gz 2024-09-21T06:17:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56763.log 2024-09-21T06:17:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53166.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53166.log.gz 2024-09-21T06:17:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53021.log 2024-09-21T06:17:16.473 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53674.log 2024-09-21T06:17:16.473 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56763.log.gz 2024-09-21T06:17:16.474 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38106.log 2024-09-21T06:17:16.474 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53021.log.gz 2024-09-21T06:17:16.474 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53674.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53674.log.gz -5 2024-09-21T06:17:16.475 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42454.log 2024-09-21T06:17:16.475 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64222.log 2024-09-21T06:17:16.475 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38106.log.gz 2024-09-21T06:17:16.476 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60051.log 2024-09-21T06:17:16.476 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42454.log.gz 2024-09-21T06:17:16.477 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64222.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64222.log.gz -5 2024-09-21T06:17:16.477 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42412.log 2024-09-21T06:17:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60051.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.60051.log.gz 2024-09-21T06:17:16.478 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48044.log 2024-09-21T06:17:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42412.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42412.log.gz 2024-09-21T06:17:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62467.log 2024-09-21T06:17:16.480 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61906.log 2024-09-21T06:17:16.480 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48044.log.gz 2024-09-21T06:17:16.481 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62467.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62467.log.gz 2024-09-21T06:17:16.481 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59433.log 2024-09-21T06:17:16.482 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38274.log 2024-09-21T06:17:16.482 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61906.log.gz 2024-09-21T06:17:16.483 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59433.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59433.log.gz 2024-09-21T06:17:16.483 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39768.log 2024-09-21T06:17:16.484 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52751.log 2024-09-21T06:17:16.484 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38274.log.gz 2024-09-21T06:17:16.485 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39768.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39768.log.gz 2024-09-21T06:17:16.485 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32475.log 2024-09-21T06:17:16.486 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56337.log 2024-09-21T06:17:16.486 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52751.log.gz 2024-09-21T06:17:16.486 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32475.log: gzip 86.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.32475.log.gz 2024-09-21T06:17:16.486 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T06:17:16.487 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31697.log 2024-09-21T06:17:16.487 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56337.log.gz 2024-09-21T06:17:16.488 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44722.log 2024-09-21T06:17:16.489 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31697.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31697.log.gz 2024-09-21T06:17:16.489 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34601.log 2024-09-21T06:17:16.490 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64978.log 2024-09-21T06:17:16.491 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44722.log.gz 2024-09-21T06:17:16.491 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34601.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34601.log.gz 2024-09-21T06:17:16.491 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57537.log 2024-09-21T06:17:16.492 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61106.log 2024-09-21T06:17:16.493 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64978.log.gz 2024-09-21T06:17:16.493 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57537.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57537.log.gz 2024-09-21T06:17:16.494 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56902.log 2024-09-21T06:17:16.494 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50020.log 2024-09-21T06:17:16.495 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61106.log.gz 2024-09-21T06:17:16.496 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62889.log 2024-09-21T06:17:16.496 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56902.log.gz 2024-09-21T06:17:16.497 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50020.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50020.log.gz 2024-09-21T06:17:16.497 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34026.log 2024-09-21T06:17:16.498 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.62889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-09-21T06:17:16.498 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62889.log.gz 2024-09-21T06:17:16.499 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34026.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34026.log.gz 2024-09-21T06:17:16.499 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40962.log 2024-09-21T06:17:16.500 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52071.log 2024-09-21T06:17:16.500 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-09-21T06:17:16.501 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51466.log 2024-09-21T06:17:16.501 INFO:teuthology.orchestra.run.smithi118.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40962.log.gz 2024-09-21T06:17:16.502 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35990.log 2024-09-21T06:17:16.503 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51466.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52071.log.gz 2024-09-21T06:17:16.503 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51466.log.gz 2024-09-21T06:17:16.503 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 2024-09-21T06:17:16.504 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.35990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44890.log 2024-09-21T06:17:16.504 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35990.log.gz 2024-09-21T06:17:16.505 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47555.log 2024-09-21T06:17:16.505 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2024-09-21T06:17:16.506 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44890.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44890.log.gz 2024-09-21T06:17:16.506 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45035.log 2024-09-21T06:17:16.508 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37538.log 2024-09-21T06:17:16.508 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2024-09-21T06:17:16.509 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45035.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45035.log.gz 2024-09-21T06:17:16.509 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2024-09-21T06:17:16.510 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-09-21T06:17:16.510 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37538.log.gz 2024-09-21T06:17:16.511 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.35930.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2024-09-21T06:17:16.511 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59086.log 2024-09-21T06:17:16.512 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50638.log 2024-09-21T06:17:16.512 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-09-21T06:17:16.513 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59086.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59086.log.gz 2024-09-21T06:17:16.513 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58857.log 2024-09-21T06:17:16.514 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37040.log 2024-09-21T06:17:16.515 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50638.log.gz 2024-09-21T06:17:16.515 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58857.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58857.log.gz 2024-09-21T06:17:16.515 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62635.log 2024-09-21T06:17:16.517 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62341.log 2024-09-21T06:17:16.517 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37040.log.gz 2024-09-21T06:17:16.518 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33087.log 2024-09-21T06:17:16.518 INFO:teuthology.orchestra.run.smithi118.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62635.log.gz 2024-09-21T06:17:16.519 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59296.log 2024-09-21T06:17:16.519 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62341.log.gz 2024-09-21T06:17:16.520 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58773.log 2024-09-21T06:17:16.520 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33087.log.gz 2024-09-21T06:17:16.521 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44848.log 2024-09-21T06:17:16.521 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59296.log.gz 2024-09-21T06:17:16.522 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58773.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58773.log.gz 2024-09-21T06:17:16.522 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39473.log 2024-09-21T06:17:16.523 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2024-09-21T06:17:16.524 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44848.log.gz 2024-09-21T06:17:16.524 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39473.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39473.log.gz -5 2024-09-21T06:17:16.524 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53759.log 2024-09-21T06:17:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45710.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2024-09-21T06:17:16.525 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39642.log 2024-09-21T06:17:16.527 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55374.log 2024-09-21T06:17:16.527 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53759.log.gz 2024-09-21T06:17:16.528 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39642.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39642.log.gz 2024-09-21T06:17:16.528 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40580.log 2024-09-21T06:17:16.529 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56127.log 2024-09-21T06:17:16.529 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55374.log.gz 2024-09-21T06:17:16.530 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40580.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40580.log.gz 2024-09-21T06:17:16.530 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57722.log 2024-09-21T06:17:16.531 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51634.log 2024-09-21T06:17:16.531 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56127.log.gz 2024-09-21T06:17:16.532 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44460.log 2024-09-21T06:17:16.533 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57722.log.gz 2024-09-21T06:17:16.533 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58223.log 2024-09-21T06:17:16.534 INFO:teuthology.orchestra.run.smithi118.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2024-09-21T06:17:16.535 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37752.log 2024-09-21T06:17:16.535 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44460.log.gz 2024-09-21T06:17:16.535 INFO:teuthology.orchestra.run.smithi118.stderr:gzip/var/log/ceph/ceph-client.admin.58223.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31931.log 2024-09-21T06:17:16.536 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4%/var/log/ceph/ceph-client.admin.37752.log: -- replaced with /var/log/ceph/ceph-client.admin.58223.log.gz 2024-09-21T06:17:16.536 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37752.log.gz 2024-09-21T06:17:16.537 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2024-09-21T06:17:16.538 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31931.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31931.log.gz 2024-09-21T06:17:16.538 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47285.log 2024-09-21T06:17:16.539 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44993.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2024-09-21T06:17:16.539 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49852.log 2024-09-21T06:17:16.540 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47617.log 2024-09-21T06:17:16.541 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47285.log.gz 2024-09-21T06:17:16.541 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49852.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.57806.log 2024-09-21T06:17:16.541 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49852.log.gz 2024-09-21T06:17:16.542 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47617.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47617.log.gz 2024-09-21T06:17:16.543 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51129.log 2024-09-21T06:17:16.543 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41028.log 2024-09-21T06:17:16.544 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57806.log.gz 2024-09-21T06:17:16.545 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51129.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51129.log.gz 2024-09-21T06:17:16.545 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43943.log 2024-09-21T06:17:16.546 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41028.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41028.log.gz 2024-09-21T06:17:16.546 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2024-09-21T06:17:16.547 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42286.log 2024-09-21T06:17:16.547 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43943.log.gz 2024-09-21T06:17:16.548 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48938.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2024-09-21T06:17:16.548 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62029.log 2024-09-21T06:17:16.549 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65020.log 2024-09-21T06:17:16.550 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42286.log.gz 2024-09-21T06:17:16.551 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62029.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62029.log.gz 2024-09-21T06:17:16.551 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48185.log 2024-09-21T06:17:16.551 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47182.log 2024-09-21T06:17:16.552 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1%/var/log/ceph/ceph-client.admin.48185.log: -- replaced with /var/log/ceph/ceph-client.admin.65020.log.gz 2024-09-21T06:17:16.553 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.62253.log 2024-09-21T06:17:16.553 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48185.log.gz 2024-09-21T06:17:16.553 INFO:teuthology.orchestra.run.smithi118.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T06:17:16.554 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58511.log 2024-09-21T06:17:16.554 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2024-09-21T06:17:16.555 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62253.log: 87.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.62253.log.gz --verbose 2024-09-21T06:17:16.555 INFO:teuthology.orchestra.run.smithi118.stderr: -- /var/log/ceph/ceph-client.admin.64810.log 2024-09-21T06:17:16.556 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43130.log 2024-09-21T06:17:16.556 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58511.log.gz 2024-09-21T06:17:16.556 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64810.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64810.log.gz 2024-09-21T06:17:16.557 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2024-09-21T06:17:16.557 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43130.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43130.log.gz 2024-09-21T06:17:16.557 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38926.log 2024-09-21T06:17:16.558 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40538.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2024-09-21T06:17:16.558 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T06:17:16.559 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38926.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.38926.log.gz 2024-09-21T06:17:16.559 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31785.log 2024-09-21T06:17:16.560 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42767.log 2024-09-21T06:17:16.561 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31785.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31785.log.gz 2024-09-21T06:17:16.561 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54028.log 2024-09-21T06:17:16.563 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50104.log 2024-09-21T06:17:16.563 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42767.log.gz 2024-09-21T06:17:16.564 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54028.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.54028.log.gz 2024-09-21T06:17:16.564 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39600.log 2024-09-21T06:17:16.565 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56719.log 2024-09-21T06:17:16.565 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0%/var/log/ceph/ceph-client.admin.39600.log: -- replaced with /var/log/ceph/ceph-client.admin.50104.log.gz 2024-09-21T06:17:16.566 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39600.log.gz 2024-09-21T06:17:16.566 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32102.log 2024-09-21T06:17:16.567 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56719.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56719.log.gz 2024-09-21T06:17:16.567 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2024-09-21T06:17:16.568 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-09-21T06:17:16.568 INFO:teuthology.orchestra.run.smithi118.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz 2024-09-21T06:17:16.569 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43252.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2024-09-21T06:17:16.569 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64180.log 2024-09-21T06:17:16.570 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42244.log 2024-09-21T06:17:16.571 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gz 2024-09-21T06:17:16.572 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46229.log 2024-09-21T06:17:16.572 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64180.log.gz 2024-09-21T06:17:16.572 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64852.log 2024-09-21T06:17:16.573 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42244.log.gz 2024-09-21T06:17:16.574 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32091.log 2024-09-21T06:17:16.574 INFO:teuthology.orchestra.run.smithi118.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46229.log.gz 2024-09-21T06:17:16.575 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-09-21T06:17:16.575 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64852.log.gz 2024-09-21T06:17:16.576 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45482.log 2024-09-21T06:17:16.576 INFO:teuthology.orchestra.run.smithi118.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.32091.log.gz 2024-09-21T06:17:16.577 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42955.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz -5 2024-09-21T06:17:16.577 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60093.log 2024-09-21T06:17:16.578 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45482.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45482.log.gz 2024-09-21T06:17:16.578 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63560.log 2024-09-21T06:17:16.579 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49526.log 2024-09-21T06:17:16.579 INFO:teuthology.orchestra.run.smithi118.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.60093.log.gz 2024-09-21T06:17:16.580 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41295.log 2024-09-21T06:17:16.581 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63560.log.gz 2024-09-21T06:17:16.582 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65440.log 2024-09-21T06:17:16.582 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49526.log.gz 2024-09-21T06:17:16.583 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41295.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41295.log.gz 2024-09-21T06:17:16.583 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33253.log 2024-09-21T06:17:16.584 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34991.log 2024-09-21T06:17:16.584 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65440.log.gz 2024-09-21T06:17:16.585 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33253.log: gzip 87.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.33253.log.gz -- 2024-09-21T06:17:16.585 INFO:teuthology.orchestra.run.smithi118.stderr: /var/log/ceph/ceph-client.admin.63458.log 2024-09-21T06:17:16.586 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48227.log 2024-09-21T06:17:16.586 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34991.log.gz 2024-09-21T06:17:16.587 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63458.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63458.log.gz 2024-09-21T06:17:16.587 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31652.log 2024-09-21T06:17:16.588 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2024-09-21T06:17:16.589 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48227.log.gz 2024-09-21T06:17:16.589 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31652.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31652.log.gz 2024-09-21T06:17:16.589 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64012.log 2024-09-21T06:17:16.590 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53376.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2024-09-21T06:17:16.591 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61022.log 2024-09-21T06:17:16.591 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2024-09-21T06:17:16.592 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64012.log.gz 2024-09-21T06:17:16.593 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61022.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61022.log.gz 2024-09-21T06:17:16.593 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65356.log 2024-09-21T06:17:16.594 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41960.log 2024-09-21T06:17:16.594 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2024-09-21T06:17:16.595 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65356.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65356.log.gz 2024-09-21T06:17:16.595 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44638.log 2024-09-21T06:17:16.596 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37668.log 2024-09-21T06:17:16.596 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41960.log.gz 2024-09-21T06:17:16.597 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44638.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44638.log.gz 2024-09-21T06:17:16.597 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63518.log 2024-09-21T06:17:16.599 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56085.log 2024-09-21T06:17:16.599 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37668.log.gz 2024-09-21T06:17:16.600 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63518.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63518.log.gz 2024-09-21T06:17:16.600 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57410.log 2024-09-21T06:17:16.601 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5/var/log/ceph/ceph-client.admin.56085.log: --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T06:17:16.601 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57410.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56085.log.gz 2024-09-21T06:17:16.602 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57410.log.gz 2024-09-21T06:17:16.602 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35492.log 2024-09-21T06:17:16.603 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-09-21T06:17:16.604 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.35492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55108.log 2024-09-21T06:17:16.604 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35492.log.gz 2024-09-21T06:17:16.605 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34027.log 2024-09-21T06:17:16.605 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2024-09-21T06:17:16.606 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34769.log 2024-09-21T06:17:16.607 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55108.log.gz 2024-09-21T06:17:16.607 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42108.log 2024-09-21T06:17:16.608 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34027.log.gz 2024-09-21T06:17:16.609 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57914.log 2024-09-21T06:17:16.609 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34769.log.gz 2024-09-21T06:17:16.610 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53208.log 2024-09-21T06:17:16.610 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42108.log.gz 2024-09-21T06:17:16.611 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48353.log 2024-09-21T06:17:16.611 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57914.log.gz 2024-09-21T06:17:16.613 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56421.log 2024-09-21T06:17:16.613 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53208.log.gz 2024-09-21T06:17:16.614 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61545.log 2024-09-21T06:17:16.614 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48353.log.gz 2024-09-21T06:17:16.615 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59128.log 2024-09-21T06:17:16.615 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56421.log.gz 2024-09-21T06:17:16.616 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43384.log 2024-09-21T06:17:16.616 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61545.log.gz 2024-09-21T06:17:16.617 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50816.log 2024-09-21T06:17:16.618 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59128.log.gz 2024-09-21T06:17:16.618 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54196.log 2024-09-21T06:17:16.619 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43384.log.gz 2024-09-21T06:17:16.620 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38232.log 2024-09-21T06:17:16.620 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50816.log.gz 2024-09-21T06:17:16.621 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39852.log 2024-09-21T06:17:16.621 INFO:teuthology.orchestra.run.smithi118.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54196.log.gz 2024-09-21T06:17:16.622 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50501.log 2024-09-21T06:17:16.622 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38232.log.gz 2024-09-21T06:17:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39852.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T06:17:16.623 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39852.log.gz 2024-09-21T06:17:16.624 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-09-21T06:17:16.625 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50501.log.gz 2024-09-21T06:17:16.625 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34360.log 2024-09-21T06:17:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59513.log 2024-09-21T06:17:16.627 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2024-09-21T06:17:16.628 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38745.log 2024-09-21T06:17:16.628 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34360.log.gz 2024-09-21T06:17:16.629 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59513.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59513.log.gz 2024-09-21T06:17:16.630 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43210.log 2024-09-21T06:17:16.630 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38745.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38745.log.gz 2024-09-21T06:17:16.631 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62160.log 2024-09-21T06:17:16.632 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2024-09-21T06:17:16.632 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43210.log.gz 2024-09-21T06:17:16.633 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62160.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62160.log.gz 2024-09-21T06:17:16.634 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-09-21T06:17:16.635 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36746.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42725.log 2024-09-21T06:17:16.635 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2024-09-21T06:17:16.636 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43751.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-09-21T06:17:16.636 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48311.log 2024-09-21T06:17:16.637 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42725.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42725.log.gz 2024-09-21T06:17:16.637 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39347.log 2024-09-21T06:17:16.638 INFO:teuthology.orchestra.run.smithi118.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T06:17:16.639 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50146.log 2024-09-21T06:17:16.639 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48311.log.gz 2024-09-21T06:17:16.640 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56169.log 2024-09-21T06:17:16.640 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39347.log.gz 2024-09-21T06:17:16.641 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54154.log 2024-09-21T06:17:16.641 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50146.log.gz 2024-09-21T06:17:16.643 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57326.log 2024-09-21T06:17:16.643 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56169.log.gz 2024-09-21T06:17:16.644 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34012.log 2024-09-21T06:17:16.644 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54154.log.gz 2024-09-21T06:17:16.645 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36264.log 2024-09-21T06:17:16.645 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57326.log.gz 2024-09-21T06:17:16.646 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34012.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T06:17:16.646 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-09-21T06:17:16.647 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50249.log 2024-09-21T06:17:16.647 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36264.log.gz 2024-09-21T06:17:16.648 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32435.log 2024-09-21T06:17:16.650 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60327.log 2024-09-21T06:17:16.650 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50249.log.gz 2024-09-21T06:17:16.651 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32435.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32435.log.gz 2024-09-21T06:17:16.651 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39389.log 2024-09-21T06:17:16.652 INFO:teuthology.orchestra.run.smithi118.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T06:17:16.652 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60327.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60261.log 2024-09-21T06:17:16.652 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60327.log.gz 2024-09-21T06:17:16.654 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-09-21T06:17:16.654 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39389.log.gz 2024-09-21T06:17:16.655 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.60261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59593.log 2024-09-21T06:17:16.655 INFO:teuthology.orchestra.run.smithi118.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60261.log.gz 2024-09-21T06:17:16.656 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33719.log 2024-09-21T06:17:16.656 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-09-21T06:17:16.657 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47224.log 2024-09-21T06:17:16.657 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59593.log.gz 2024-09-21T06:17:16.658 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63870.log 2024-09-21T06:17:16.658 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33719.log.gz 2024-09-21T06:17:16.659 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56253.log 2024-09-21T06:17:16.660 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47224.log.gz 2024-09-21T06:17:16.661 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61826.log 2024-09-21T06:17:16.661 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63870.log.gz 2024-09-21T06:17:16.662 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40920.log 2024-09-21T06:17:16.662 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56253.log.gz 2024-09-21T06:17:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2024-09-21T06:17:16.666 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61826.log.gz 2024-09-21T06:17:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38148.log 2024-09-21T06:17:16.666 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40920.log.gz 2024-09-21T06:17:16.666 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45623.log 2024-09-21T06:17:16.667 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2024-09-21T06:17:16.667 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62968.log 2024-09-21T06:17:16.667 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38148.log.gz 2024-09-21T06:17:16.668 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43625.log 2024-09-21T06:17:16.668 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45623.log.gz 2024-09-21T06:17:16.669 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58899.log 2024-09-21T06:17:16.669 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62968.log.gz 2024-09-21T06:17:16.670 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34359.log 2024-09-21T06:17:16.670 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43625.log.gz 2024-09-21T06:17:16.671 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.58899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40356.log 2024-09-21T06:17:16.672 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58899.log.gz 2024-09-21T06:17:16.673 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36872.log 2024-09-21T06:17:16.673 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34359.log.gz 2024-09-21T06:17:16.674 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31567.log 2024-09-21T06:17:16.674 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40356.log.gz 2024-09-21T06:17:16.675 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48817.log 2024-09-21T06:17:16.675 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36872.log.gz 2024-09-21T06:17:16.676 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53940.log 2024-09-21T06:17:16.676 INFO:teuthology.orchestra.run.smithi118.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.31567.log.gz 2024-09-21T06:17:16.677 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.48817.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32013.log 2024-09-21T06:17:16.677 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.0.48817.log.gz 2024-09-21T06:17:16.678 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38884.log 2024-09-21T06:17:16.679 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53940.log.gz 2024-09-21T06:17:16.680 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39557.log 2024-09-21T06:17:16.680 INFO:teuthology.orchestra.run.smithi118.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32013.log.gz 2024-09-21T06:17:16.681 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-09-21T06:17:16.681 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38884.log.gz 2024-09-21T06:17:16.682 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55247.log 2024-09-21T06:17:16.682 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39557.log.gz 2024-09-21T06:17:16.683 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59741.log 2024-09-21T06:17:16.683 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-09-21T06:17:16.685 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55982.log 2024-09-21T06:17:16.685 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55247.log.gz 2024-09-21T06:17:16.686 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-09-21T06:17:16.686 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.59741.log.gz 2024-09-21T06:17:16.687 INFO:teuthology.orchestra.run.smithi149.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T06:17:16.687 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55564.log 2024-09-21T06:17:16.687 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2024-09-21T06:17:16.688 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2024-09-21T06:17:16.688 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-09-21T06:17:16.689 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64054.log 2024-09-21T06:17:16.689 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55564.log.gz 2024-09-21T06:17:16.690 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49271.log 2024-09-21T06:17:16.691 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2024-09-21T06:17:16.692 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56807.log 2024-09-21T06:17:16.692 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64054.log.gz 2024-09-21T06:17:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40668.log 2024-09-21T06:17:16.693 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49271.log.gz 2024-09-21T06:17:16.694 INFO:teuthology.orchestra.run.smithi149.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T06:17:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42913.log 2024-09-21T06:17:16.694 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56807.log.gz 2024-09-21T06:17:16.695 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41486.log 2024-09-21T06:17:16.695 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40668.log.gz 2024-09-21T06:17:16.696 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40215.log 2024-09-21T06:17:16.696 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42913.log.gz 2024-09-21T06:17:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55204.log 2024-09-21T06:17:16.698 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41486.log.gz 2024-09-21T06:17:16.699 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-09-21T06:17:16.699 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40215.log.gz 2024-09-21T06:17:16.700 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54070.log 2024-09-21T06:17:16.700 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55204.log.gz 2024-09-21T06:17:16.701 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47098.log 2024-09-21T06:17:16.701 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-09-21T06:17:16.702 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45754.log 2024-09-21T06:17:16.702 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54070.log.gz 2024-09-21T06:17:16.703 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64768.log 2024-09-21T06:17:16.704 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47098.log.gz 2024-09-21T06:17:16.705 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 2024-09-21T06:17:16.705 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45754.log.gz 2024-09-21T06:17:16.706 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40752.log 2024-09-21T06:17:16.706 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64768.log.gz 2024-09-21T06:17:16.707 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39684.log 2024-09-21T06:17:16.707 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2024-09-21T06:17:16.708 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40752.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40752.log.gz 2024-09-21T06:17:16.709 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42599.log 2024-09-21T06:17:16.709 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39684.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39684.log.gz 2024-09-21T06:17:16.710 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34345.log 2024-09-21T06:17:16.711 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62211.log 2024-09-21T06:17:16.711 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42599.log.gz 2024-09-21T06:17:16.712 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.34345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38382.log 2024-09-21T06:17:16.712 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34345.log.gz 2024-09-21T06:17:16.713 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55845.log 2024-09-21T06:17:16.713 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62211.log.gz 2024-09-21T06:17:16.714 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52349.log 2024-09-21T06:17:16.715 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38382.log.gz 2024-09-21T06:17:16.716 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40622.log 2024-09-21T06:17:16.716 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55845.log.gz 2024-09-21T06:17:16.717 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41216.log 2024-09-21T06:17:16.717 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52349.log.gz 2024-09-21T06:17:16.718 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2024-09-21T06:17:16.718 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40622.log.gz 2024-09-21T06:17:16.719 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.41216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61064.log 2024-09-21T06:17:16.719 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41216.log.gz 2024-09-21T06:17:16.720 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37878.log 2024-09-21T06:17:16.720 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz 2024-09-21T06:17:16.721 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59878.log 2024-09-21T06:17:16.722 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61064.log.gz 2024-09-21T06:17:16.723 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61148.log 2024-09-21T06:17:16.723 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37878.log.gz 2024-09-21T06:17:16.724 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.59878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63362.log 2024-09-21T06:17:16.724 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59878.log.gz 2024-09-21T06:17:16.725 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51888.log 2024-09-21T06:17:16.725 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61148.log.gz 2024-09-21T06:17:16.726 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40710.log 2024-09-21T06:17:16.726 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63362.log.gz 2024-09-21T06:17:16.727 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.51888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51888.log.gz 2024-09-21T06:17:16.727 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49229.log 2024-09-21T06:17:16.729 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35339.log 2024-09-21T06:17:16.729 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40710.log.gz 2024-09-21T06:17:16.729 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51255.log 2024-09-21T06:17:16.730 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49229.log.gz 2024-09-21T06:17:16.731 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.35339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57680.log 2024-09-21T06:17:16.731 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35339.log.gz 2024-09-21T06:17:16.732 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42851.log 2024-09-21T06:17:16.732 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51255.log.gz 2024-09-21T06:17:16.733 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51550.log 2024-09-21T06:17:16.733 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57680.log.gz 2024-09-21T06:17:16.735 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33211.log 2024-09-21T06:17:16.735 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42851.log.gz 2024-09-21T06:17:16.736 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-09-21T06:17:16.736 INFO:teuthology.orchestra.run.smithi118.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51550.log.gz 2024-09-21T06:17:16.737 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-09-21T06:17:16.737 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33211.log.gz 2024-09-21T06:17:16.738 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33803.log 2024-09-21T06:17:16.738 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-09-21T06:17:16.739 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62593.log 2024-09-21T06:17:16.739 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-09-21T06:17:16.740 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2024-09-21T06:17:16.741 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33803.log.gz 2024-09-21T06:17:16.742 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31515.log 2024-09-21T06:17:16.742 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62593.log.gz 2024-09-21T06:17:16.743 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55890.log 2024-09-21T06:17:16.743 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2024-09-21T06:17:16.744 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.31515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64138.log 2024-09-21T06:17:16.744 INFO:teuthology.orchestra.run.smithi118.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.31515.log.gz 2024-09-21T06:17:16.745 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.55890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2024-09-21T06:17:16.745 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55890.log.gz 2024-09-21T06:17:16.746 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56024.log 2024-09-21T06:17:16.747 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64138.log.gz 2024-09-21T06:17:16.747 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54948.log 2024-09-21T06:17:16.748 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2024-09-21T06:17:16.749 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39936.log 2024-09-21T06:17:16.749 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56024.log.gz 2024-09-21T06:17:16.750 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39023.log 2024-09-21T06:17:16.750 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54948.log.gz 2024-09-21T06:17:16.751 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63072.log 2024-09-21T06:17:16.751 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39936.log.gz 2024-09-21T06:17:16.752 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.39023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37285.log 2024-09-21T06:17:16.752 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39023.log.gz 2024-09-21T06:17:16.753 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65595.log 2024-09-21T06:17:16.753 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63072.log.gz 2024-09-21T06:17:16.755 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45265.log 2024-09-21T06:17:16.755 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37285.log.gz 2024-09-21T06:17:16.756 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40040.log 2024-09-21T06:17:16.756 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65595.log.gz 2024-09-21T06:17:16.757 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61419.log 2024-09-21T06:17:16.757 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45265.log.gz 2024-09-21T06:17:16.758 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33425.log 2024-09-21T06:17:16.758 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40040.log.gz 2024-09-21T06:17:16.759 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33551.log 2024-09-21T06:17:16.760 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61419.log.gz 2024-09-21T06:17:16.760 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-09-21T06:17:16.761 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33425.log.gz 2024-09-21T06:17:16.762 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61461.log 2024-09-21T06:17:16.762 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33551.log.gz 2024-09-21T06:17:16.763 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61629.log 2024-09-21T06:17:16.763 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-09-21T06:17:16.764 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53082.log 2024-09-21T06:17:16.765 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61461.log.gz 2024-09-21T06:17:16.765 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.61629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-09-21T06:17:16.766 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61629.log.gz 2024-09-21T06:17:16.766 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44252.log 2024-09-21T06:17:16.767 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53082.log.gz 2024-09-21T06:17:16.768 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52877.log 2024-09-21T06:17:16.768 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-09-21T06:17:16.769 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50946.log 2024-09-21T06:17:16.769 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44252.log.gz 2024-09-21T06:17:16.770 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52651.log 2024-09-21T06:17:16.771 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52877.log.gz 2024-09-21T06:17:16.771 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.50946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44764.log 2024-09-21T06:17:16.771 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50946.log.gz 2024-09-21T06:17:16.772 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52651.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52651.log.gz 2024-09-21T06:17:16.773 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57158.log 2024-09-21T06:17:16.774 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44764.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44764.log.gz 2024-09-21T06:17:16.774 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56944.log 2024-09-21T06:17:16.775 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-09-21T06:17:16.775 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57158.log.gz 2024-09-21T06:17:16.776 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.56944.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56944.log.gz 2024-09-21T06:17:16.777 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53292.log 2024-09-21T06:17:16.778 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57452.log 2024-09-21T06:17:16.778 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-09-21T06:17:16.779 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54388.log 2024-09-21T06:17:16.779 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53292.log.gz 2024-09-21T06:17:16.780 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.57452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53982.log 2024-09-21T06:17:16.781 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57452.log.gz 2024-09-21T06:17:16.782 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33297.log 2024-09-21T06:17:16.782 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54388.log.gz 2024-09-21T06:17:16.783 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 2024-09-21T06:17:16.783 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53982.log.gz 2024-09-21T06:17:16.784 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.33297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62295.log 2024-09-21T06:17:16.784 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33297.log.gz 2024-09-21T06:17:16.785 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49153.log 2024-09-21T06:17:16.785 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2024-09-21T06:17:16.786 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.62295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-09-21T06:17:16.786 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62295.log.gz 2024-09-21T06:17:16.788 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49153.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49153.log.gz 2024-09-21T06:17:16.788 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36914.log 2024-09-21T06:17:16.789 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46562.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-09-21T06:17:16.790 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54698.log 2024-09-21T06:17:16.790 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36914.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36914.log.gz 2024-09-21T06:17:16.791 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37370.log 2024-09-21T06:17:16.792 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32076.log 2024-09-21T06:17:16.792 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54698.log.gz 2024-09-21T06:17:16.793 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51041.log 2024-09-21T06:17:16.793 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37370.log.gz 2024-09-21T06:17:16.794 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65513.log 2024-09-21T06:17:16.794 INFO:teuthology.orchestra.run.smithi118.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32076.log.gz 2024-09-21T06:17:16.796 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51041.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T06:17:16.796 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51041.log.gz 2024-09-21T06:17:16.797 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.65513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32923.log 2024-09-21T06:17:16.797 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65513.log.gz 2024-09-21T06:17:16.798 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37710.log 2024-09-21T06:17:16.799 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45666.log 2024-09-21T06:17:16.799 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32923.log.gz 2024-09-21T06:17:16.801 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37710.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37710.log.gz 2024-09-21T06:17:16.801 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37920.log 2024-09-21T06:17:16.803 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45666.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45666.log.gz 2024-09-21T06:17:16.804 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37920.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37920.log.gz 2024-09-21T06:17:16.804 INFO:teuthology.orchestra.run.smithi118.stderr: /var/log/ceph/ceph-mds.c.log 2024-09-21T06:17:16.805 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64936.log 2024-09-21T06:17:16.806 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36830.log 2024-09-21T06:17:16.808 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64936.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64936.log.gz 2024-09-21T06:17:16.808 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63201.log 2024-09-21T06:17:16.809 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36830.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36830.log.gz 2024-09-21T06:17:16.810 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64409.log 2024-09-21T06:17:16.811 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63201.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63201.log.gz 2024-09-21T06:17:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2024-09-21T06:17:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64409.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64409.log.gz 2024-09-21T06:17:16.813 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64283.log 2024-09-21T06:17:16.815 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47056.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2024-09-21T06:17:16.816 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38842.log/var/log/ceph/ceph-client.admin.64283.log: 2024-09-21T06:17:16.816 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64283.log.gz 2024-09-21T06:17:16.817 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-09-21T06:17:16.818 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38842.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38842.log.gz 2024-09-21T06:17:16.819 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54238.log/var/log/ceph/ceph-client.admin.43667.log: 2024-09-21T06:17:16.819 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-09-21T06:17:16.820 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64642.log 2024-09-21T06:17:16.822 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.54238.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54238.log.gz 2024-09-21T06:17:16.823 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.64642.log: /var/log/ceph/ceph-client.admin.64894.log 2024-09-21T06:17:16.823 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64642.log.gz 2024-09-21T06:17:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32104.log 2024-09-21T06:17:16.825 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.64894.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.64894.log.gz 2024-09-21T06:17:16.826 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58102.log 2024-09-21T06:17:16.827 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.32104.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32104.log.gz 2024-09-21T06:17:16.827 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63792.log 2024-09-21T06:17:16.828 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.58102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58102.log.gz 2024-09-21T06:17:16.829 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53250.log 2024-09-21T06:17:16.830 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.63792.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63792.log.gz 2024-09-21T06:17:16.832 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53250.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53250.log.gz 2024-09-21T06:17:17.049 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T06:17:17.097 INFO:teuthology.orchestra.run.smithi149.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T06:17:17.115 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T06:17:17.116 INFO:teuthology.orchestra.run.smithi149.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T06:17:17.166 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T06:17:17.170 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-09-21T06:17:17.170 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m0.997s 2024-09-21T06:17:17.170 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m4.476s 2024-09-21T06:17:17.170 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.491s 2024-09-21T06:17:17.334 INFO:teuthology.orchestra.run.smithi118.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T06:17:17.347 INFO:teuthology.orchestra.run.smithi118.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T06:17:17.577 INFO:teuthology.orchestra.run.smithi118.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T06:17:17.643 INFO:teuthology.orchestra.run.smithi118.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T06:17:17.758 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T06:17:17.761 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-09-21T06:17:17.761 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m1.593s 2024-09-21T06:17:17.762 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m5.364s 2024-09-21T06:17:17.762 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m1.806s 2024-09-21T06:17:17.763 INFO:tasks.ceph:Archiving logs... 2024-09-21T06:17:17.763 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/remote/smithi118/log 2024-09-21T06:17:17.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:17:18.896 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/remote/smithi149/log 2024-09-21T06:17:18.897 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:17:19.502 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:17:19.514 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:17:19.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:17:19.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:17:19.624 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:17:19.645 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:17:19.645 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:17:19.649 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:17:19.679 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:17:19.682 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:17:19.686 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:17:19.686 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-21T06:17:19.686 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 -119us[ -105us] +/- 36ms 2024-09-21T06:17:19.686 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 +399us[ +399us] +/- 63ms 2024-09-21T06:17:19.686 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -171us[ -156us] +/- 67ms 2024-09-21T06:17:19.686 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:17:19.688 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:17:19.688 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-21T06:17:19.688 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 -115us[ -111us] +/- 36ms 2024-09-21T06:17:19.689 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 +398us[ +398us] +/- 63ms 2024-09-21T06:17:19.689 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -157us[ -153us] +/- 67ms 2024-09-21T06:17:19.689 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:17:19.689 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:17:19.698 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:17:19.698 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:17:19.712 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:17:19.861 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:17:19.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:17:20.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:17:20.041 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:17:20.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:17:20.102 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:17:20.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:17:20.199 INFO:teuthology.task.internal:Duration was 1247.587829 seconds 2024-09-21T06:17:20.199 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:17:20.213 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:17:20.213 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:17:20.217 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:17:20.300 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:17:20.304 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:17:20.709 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:17:20.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-09-21T06:17:20.709 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:17:20.758 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-21T06:17:20.758 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:17:20.818 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:17:20.818 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:17:20.822 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:17:20.882 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:17:20.882 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:17:20.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:17:21.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:17:21.059 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:17:21.059 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:17:21.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:17:21.171 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:17:21.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:17:21.186 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:17:21.252 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-09-21T06:17:21.256 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-21T06:17:21.286 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:17:21.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:17:21.319 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:17:21.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:17:21.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:17:21.364 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:17:21.364 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/remote/smithi118 2024-09-21T06:17:21.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:17:21.429 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913522/remote/smithi149 2024-09-21T06:17:21.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:17:21.491 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:17:21.491 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:17:21.495 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:17:21.530 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:17:21.541 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:17:21.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:17:21.555 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:17:21.556 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:17:21.571 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:17:21.601 INFO:teuthology.orchestra.run.smithi118.stdout: 393598 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:17 /home/ubuntu/cephtest 2024-09-21T06:17:21.606 INFO:teuthology.orchestra.run.smithi149.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:17 /home/ubuntu/cephtest 2024-09-21T06:17:21.608 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:17:21.620 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:17:21.649 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full} duration: 1247.5878293514252 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:17:21.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:17:21.760 INFO:teuthology.run:pass